2024-09-17T02:45:10.642 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T02:45:10.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T02:45:10.761 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full} email: pdonnell@redhat.com first_in_suite: false job_id: '7908385' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCA6kX4QPuYW7rB/MWB88UUBUUw2Et2jwdcF6nG9nzSTZJ92kTkdH6Gfzzap7pXagyMDz0PEEv+FgEk8IK+KC2U= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2Rh5E8lt29ksn+m6jkK9QPdULPziqndc6M/bPKzuXlHAAfZ2fJUUV1mVoW0T0j1oW+t/BzSZhm3RVOSzFOj+0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T02:45:10.761 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T02:45:10.762 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T02:45:10.762 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T02:45:10.764 INFO:teuthology.task.internal:Checking packages... 2024-09-17T02:45:10.786 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T02:45:10.786 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T02:45:10.786 INFO:teuthology.packaging:ref: None 2024-09-17T02:45:10.786 INFO:teuthology.packaging:tag: None 2024-09-17T02:45:10.786 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T02:45:10.786 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T02:45:10.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T02:45:10.928 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T02:45:10.930 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T02:45:10.938 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T02:45:10.939 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T02:45:11.007 INFO:teuthology.task.internal:Saving configuration 2024-09-17T02:45:11.026 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T02:45:11.034 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T02:45:11.058 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 02:40:12.596243', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCA6kX4QPuYW7rB/MWB88UUBUUw2Et2jwdcF6nG9nzSTZJ92kTkdH6Gfzzap7pXagyMDz0PEEv+FgEk8IK+KC2U='} 2024-09-17T02:45:11.082 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 02:40:12.597685', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2Rh5E8lt29ksn+m6jkK9QPdULPziqndc6M/bPKzuXlHAAfZ2fJUUV1mVoW0T0j1oW+t/BzSZhm3RVOSzFOj+0='} 2024-09-17T02:45:11.083 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T02:45:11.090 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T02:45:11.090 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T02:45:11.090 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T02:45:11.150 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa39c74fac0>, signals=[15]) 2024-09-17T02:45:11.150 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T02:45:11.156 INFO:teuthology.task.internal:Opening connections... 2024-09-17T02:45:11.156 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:45:11.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:45:11.237 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:45:11.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:45:11.316 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T02:45:11.323 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-09-17T02:45:11.341 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-09-17T02:45:11.341 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-09-17T02:45:11.399 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-09-17T02:45:11.399 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-09-17T02:45:11.399 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-09-17T02:45:11.399 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-09-17T02:45:11.399 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-09-17T02:45:11.399 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-09-17T02:45:11.399 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T02:45:11.399 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-09-17T02:45:11.400 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-09-17T02:45:11.400 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T02:45:11.400 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-09-17T02:45:11.400 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T02:45:11.400 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T02:45:11.400 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T02:45:11.401 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-09-17T02:45:11.423 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-09-17T02:45:11.442 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-09-17T02:45:11.442 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-09-17T02:45:11.500 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-09-17T02:45:11.500 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-09-17T02:45:11.500 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-09-17T02:45:11.500 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-09-17T02:45:11.500 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-09-17T02:45:11.500 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-09-17T02:45:11.500 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T02:45:11.501 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-09-17T02:45:11.501 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-09-17T02:45:11.501 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T02:45:11.501 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-09-17T02:45:11.501 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T02:45:11.501 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T02:45:11.501 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T02:45:11.501 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-09-17T02:45:11.524 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T02:45:11.533 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T02:45:11.931 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T02:45:11.931 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-09-17T02:45:11.933 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-09-17T02:45:11.950 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T02:45:11.957 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T02:45:11.957 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-09-17T02:45:11.991 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-09-17T02:45:12.074 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T02:45:12.127 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T02:45:12.141 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T02:45:12.141 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-17T02:45:12.141 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-17T02:45:12.141 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T02:45:12.142 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T02:45:12.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:45:12.159 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-17T02:45:12.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:45:12.161 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-17T02:45:12.218 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-503.el9.x86_64 2024-09-17T02:45:12.218 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.14.0-503.el9.x86_64 2024-09-17T02:45:12.219 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum install -y kernel 2024-09-17T02:45:12.220 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-503.el9.x86_64 2024-09-17T02:45:12.220 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.14.0-503.el9.x86_64 2024-09-17T02:45:12.220 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2024-09-17T02:45:14.472 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-17T02:45:16.204 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-17T02:45:16.269 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.3 MB 00:02 2024-09-17T02:45:19.634 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 20 MB 00:02 2024-09-17T02:45:20.664 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-17T02:45:22.123 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-17T02:45:23.035 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-17T02:45:25.101 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-17T02:45:26.593 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-17T02:45:27.780 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-17T02:45:28.374 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-17T02:45:30.223 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T02:45:30.223 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T02:45:30.313 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-17T02:45:30.323 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-17T02:45:30.324 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-17T02:45:30.324 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-17T02:45:30.324 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-17T02:45:30.324 INFO:teuthology.orchestra.run.smithi192.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T02:45:30.324 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-17T02:45:30.324 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T02:45:30.324 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T02:45:30.324 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T02:45:30.325 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:45:30.325 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-17T02:45:30.325 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-17T02:45:30.326 INFO:teuthology.orchestra.run.smithi192.stdout:Install 4 Packages 2024-09-17T02:45:30.326 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:45:30.327 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 79 M 2024-09-17T02:45:30.327 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 126 M 2024-09-17T02:45:30.327 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-17T02:45:30.541 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.21) 2024-09-17T02:45:30.571 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.21) 2024-09-17T02:45:30.578 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.21) 2024-09-17T02:45:30.692 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T02:45:30.753 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T02:45:30.779 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T02:45:31.318 INFO:teuthology.orchestra.run.smithi192.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 37 kB/s | 36 kB 00:00 2024-09-17T02:45:31.450 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T02:45:31.626 INFO:teuthology.orchestra.run.smithi192.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.21) 2024-09-17T02:45:32.076 INFO:teuthology.orchestra.run.smithi192.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-09-17T02:45:32.985 INFO:teuthology.orchestra.run.smithi192.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 13 MB/s | 35 MB 00:02 2024-09-17T02:45:33.119 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-17T02:45:33.985 INFO:teuthology.orchestra.run.smithi192.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-17T02:45:33.986 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-17T02:45:33.987 INFO:teuthology.orchestra.run.smithi192.stdout:Total 22 MB/s | 79 MB 00:03 2024-09-17T02:45:34.672 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-17T02:45:35.009 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-17T02:45:35.009 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-17T02:45:35.026 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T02:45:35.026 INFO:teuthology.orchestra.run.smithi104.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T02:45:35.136 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-17T02:45:35.141 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-17T02:45:35.141 INFO:teuthology.orchestra.run.smithi104.stdout: Package Architecture Version Repository Size 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout:================================================================================ 2024-09-17T02:45:35.142 INFO:teuthology.orchestra.run.smithi104.stdout:Install 4 Packages 2024-09-17T02:45:35.143 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:45:35.143 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 79 M 2024-09-17T02:45:35.143 INFO:teuthology.orchestra.run.smithi104.stdout:Installed size: 126 M 2024-09-17T02:45:35.143 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-17T02:45:35.489 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T02:45:35.494 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T02:45:35.497 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T02:45:35.576 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T02:45:35.584 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T02:45:35.586 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T02:45:35.879 INFO:teuthology.orchestra.run.smithi104.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 79 kB/s | 36 kB 00:00 2024-09-17T02:45:35.926 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T02:45:35.945 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-17T02:45:35.945 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-17T02:45:35.976 INFO:teuthology.orchestra.run.smithi104.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T02:45:36.912 INFO:teuthology.orchestra.run.smithi104.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-17T02:45:37.704 INFO:teuthology.orchestra.run.smithi104.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-17T02:45:37.979 INFO:teuthology.orchestra.run.smithi104.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-17T02:45:37.983 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-17T02:45:37.983 INFO:teuthology.orchestra.run.smithi104.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-17T02:45:38.367 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-17T02:45:38.665 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-17T02:45:39.009 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-17T02:45:39.009 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-17T02:45:39.049 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T02:45:39.129 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:45:39.981 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-17T02:45:39.982 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-17T02:45:41.866 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:45:42.000 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:45:42.419 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-17T02:45:43.104 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T02:45:43.195 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:45:45.953 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:45:46.081 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:45:46.818 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:45:46.942 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:45:50.898 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:45:51.031 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:45:51.790 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:45:55.860 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:29.977 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:30.017 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:30.359 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:30.359 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T02:46:30.359 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:46:30.359 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:46:31.213 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-17T02:46:31.557 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T02:46:31.643 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T02:46:31.644 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T02:46:31.644 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T02:46:31.644 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T02:46:31.644 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T02:46:31.644 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-17T02:46:31.644 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T02:46:31.644 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T02:46:31.704 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T02:46:31.704 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T02:46:31.704 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2024-09-17T02:46:31.742 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.06 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 82.el9 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Group : Unspecified 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 8274670 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T02:46:31.743 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : builder@centos.org 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2024-09-17T02:46:31.744 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:46:31.745 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T02:46:31.745 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T02:46:31.746 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 5.14.0-508.el9.x86_64 2024-09-17T02:46:31.746 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T02:46:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2024-09-17T02:46:33.764 INFO:teuthology.orchestra.run.smithi192.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T02:46:33.787 INFO:teuthology.orchestra.run.smithi192.stderr:done 2024-09-17T02:46:33.789 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-17T02:46:33.804 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.PEuF9BwDRy 2024-09-17T02:46:33.805 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PEuF9BwDRy 2024-09-17T02:46:33.871 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.PEuF9BwDRy 2024-09-17T02:46:34.003 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.PEuF9BwDRy is 6KB 2024-09-17T02:46:34.051 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.PEuF9BwDRy 2024-09-17T02:46:34.067 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T02:46:34.129 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T02:46:34.129 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T02:46:34.129 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T02:46:34.129 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T02:46:34.131 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T02:46:34.287 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2024-09-17T02:46:34.295 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:34.341 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:34.674 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:34.675 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T02:46:34.675 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:46:34.675 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:46:35.522 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:46:35.523 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:46:35.523 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-17T02:46:35.523 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T02:46:35.523 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T02:46:35.523 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T02:46:35.523 INFO:teuthology.orchestra.run.smithi104.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T02:46:35.523 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:46:35.523 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-17T02:46:35.863 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T02:46:35.986 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T02:46:35.987 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T02:46:35.987 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T02:46:35.987 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T02:46:35.987 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T02:46:35.987 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-17T02:46:35.987 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T02:46:35.987 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T02:46:36.045 INFO:teuthology.orchestra.run.smithi104.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T02:46:36.045 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T02:46:36.045 DEBUG:teuthology.orchestra.run.smithi104:> sudo rpm -qi grub2-tools 2024-09-17T02:46:36.077 INFO:teuthology.orchestra.run.smithi104.stdout:Name : grub2-tools 2024-09-17T02:46:36.077 INFO:teuthology.orchestra.run.smithi104.stdout:Epoch : 1 2024-09-17T02:46:36.077 INFO:teuthology.orchestra.run.smithi104.stdout:Version : 2.06 2024-09-17T02:46:36.077 INFO:teuthology.orchestra.run.smithi104.stdout:Release : 82.el9 2024-09-17T02:46:36.077 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: x86_64 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Group : Unspecified 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Size : 8274670 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:License : GPLv3+ 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Packager : builder@centos.org 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Vendor : CentOS 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Summary : Support tools for GRUB. 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout:Description : 2024-09-17T02:46:36.078 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:46:36.079 INFO:teuthology.orchestra.run.smithi104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T02:46:36.079 INFO:teuthology.orchestra.run.smithi104.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T02:46:36.079 INFO:teuthology.orchestra.run.smithi104.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T02:46:36.079 INFO:teuthology.orchestra.run.smithi104.stdout:hardware devices. 2024-09-17T02:46:36.079 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:46:36.079 INFO:teuthology.orchestra.run.smithi104.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T02:46:36.080 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T02:46:36.080 INFO:teuthology.task.kernel:Updating grub on smithi104 to boot 5.14.0-508.el9.x86_64 2024-09-17T02:46:36.080 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T02:46:36.728 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-09-17T02:46:38.044 INFO:teuthology.orchestra.run.smithi104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T02:46:38.072 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-09-17T02:46:38.075 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-09-17T02:46:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.4csn6vcWrP 2024-09-17T02:46:38.091 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4csn6vcWrP 2024-09-17T02:46:38.158 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.4csn6vcWrP 2024-09-17T02:46:38.295 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.4csn6vcWrP is 6KB 2024-09-17T02:46:38.342 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.4csn6vcWrP 2024-09-17T02:46:38.357 DEBUG:teuthology.orchestra.run.smithi104:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T02:46:38.424 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T02:46:38.424 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T02:46:38.425 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T02:46:38.425 INFO:teuthology.orchestra.run.smithi104.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T02:46:38.426 DEBUG:teuthology.orchestra.run.smithi104:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T02:46:38.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-09-17T02:47:04.313 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T02:47:04.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T02:47:04.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:47:08.601 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T02:47:08.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T02:47:08.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:47:22.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-17T02:47:27.041 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-17T02:47:31.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T02:47:31.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:47:34.753 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-17T02:47:36.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T02:47:36.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:47:39.101 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-17T02:47:46.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T02:47:46.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:47:51.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T02:47:51.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:48:05.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-17T02:48:09.537 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-17T02:48:20.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T02:48:20.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:48:20.647 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-17T02:48:20.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T02:48:20.980 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-17T02:48:20.980 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-17T02:48:21.038 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-508.el9.x86_64 2024-09-17T02:48:21.039 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T02:48:21.039 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T02:48:21.039 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T02:48:22.039 DEBUG:teuthology.parallel:result is None 2024-09-17T02:48:24.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T02:48:24.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:48:24.958 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-17T02:48:25.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T02:48:25.348 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-17T02:48:25.348 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-17T02:48:25.363 INFO:teuthology.orchestra.run.smithi104.stdout:5.14.0-508.el9.x86_64 2024-09-17T02:48:25.364 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T02:48:25.364 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T02:48:25.364 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T02:48:26.365 DEBUG:teuthology.parallel:result is None 2024-09-17T02:48:26.365 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T02:48:26.373 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T02:48:26.373 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T02:48:26.376 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T02:48:26.396 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T02:48:26.411 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T02:48:26.436 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T02:48:26.437 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T02:48:26.439 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T02:48:26.551 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T02:48:26.557 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T02:48:26.557 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T02:48:26.560 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T02:48:26.645 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:48:26.651 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:48:26.680 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:48:26.701 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T02:48:26.703 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T02:48:26.709 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T02:48:26.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T02:48:26.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T02:48:26.739 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T02:48:26.747 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T02:48:26.747 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T02:48:26.778 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T02:48:26.795 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T02:48:26.872 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T02:48:26.977 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T02:48:27.020 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T02:48:27.074 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:48:27.074 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T02:48:27.179 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T02:48:27.225 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T02:48:27.277 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T02:48:27.360 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T02:48:27.404 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:48:27.404 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T02:48:27.470 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-09-17T02:48:27.473 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-09-17T02:48:27.563 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T02:48:27.564 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T02:48:28.072 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T02:48:28.082 INFO:teuthology.task.internal:Starting timer... 2024-09-17T02:48:28.082 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T02:48:28.118 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T02:48:28.140 DEBUG:teuthology.orchestra.run.smithi104:> sudo service auditd rotate 2024-09-17T02:48:28.211 INFO:teuthology.orchestra.run.smithi104.stdout:Rotating logs: 2024-09-17T02:48:28.213 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-09-17T02:48:28.294 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-09-17T02:48:28.296 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T02:48:28.296 DEBUG:teuthology.orchestra.run.smithi104:> /usr/sbin/getenforce 2024-09-17T02:48:28.483 INFO:teuthology.orchestra.run.smithi104.stdout:Permissive 2024-09-17T02:48:28.484 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-09-17T02:48:28.513 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-09-17T02:48:28.513 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi104.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-09-17T02:48:28.513 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T02:48:28.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:48:28.541 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T02:48:28.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:48:28.581 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T02:48:28.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo /usr/sbin/setenforce permissive 2024-09-17T02:48:28.638 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-09-17T02:48:28.668 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T02:48:28.678 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T02:48:28.689 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T02:48:28.690 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi104.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T02:52:12.430 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi104.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-09-17T02:52:12.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T02:52:12.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:52:12.552 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-17T02:52:12.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-17T02:52:12.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T02:52:12.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:52:12.666 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-17T02:52:12.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-17T02:52:12.744 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T02:52:12.753 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T02:52:12.754 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T02:52:12.754 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:52:12.756 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T02:52:12.757 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T02:52:12.783 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T02:52:12.798 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T02:52:12.813 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T02:52:12.822 INFO:teuthology.orchestra.run.smithi104.stderr:sudo: ntpd: command not found 2024-09-17T02:52:12.828 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T02:52:12.833 INFO:teuthology.orchestra.run.smithi104.stdout:506 Cannot talk to daemon 2024-09-17T02:52:12.847 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T02:52:12.853 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-09-17T02:52:12.861 INFO:teuthology.orchestra.run.smithi104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T02:52:12.863 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-09-17T02:52:12.878 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T02:52:12.892 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T02:52:12.916 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-09-17T02:52:12.919 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T02:52:12.919 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-09-17T02:52:12.919 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:52:12.920 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:52:12.920 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:52:12.920 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:52:12.951 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-17T02:52:12.955 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T02:52:12.955 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-17T02:52:12.955 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:52:12.955 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:52:12.956 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:52:12.956 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T02:52:12.956 INFO:teuthology.run_tasks:Running task install... 2024-09-17T02:52:12.968 DEBUG:teuthology.task.install:project ceph 2024-09-17T02:52:12.969 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T02:52:12.969 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T02:52:12.969 INFO:teuthology.task.install:Using flavor: default 2024-09-17T02:52:12.981 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T02:52:12.981 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T02:52:12.982 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T02:52:12.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T02:52:12.986 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T02:52:12.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T02:52:13.133 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T02:52:13.133 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T02:52:13.137 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T02:52:13.137 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T02:52:13.244 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T02:52:13.244 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:52:13.244 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T02:52:13.254 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T02:52:13.254 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:52:13.254 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T02:52:13.271 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T02:52:13.271 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T02:52:13.280 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T02:52:13.280 DEBUG:teuthology.orchestra.run.smithi104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T02:52:13.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T02:52:13.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T02:52:13.413 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T02:52:13.422 DEBUG:teuthology.orchestra.run.smithi104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T02:52:13.477 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-09-17T02:52:13.479 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-09-17T02:52:13.485 INFO:teuthology.orchestra.run.smithi104.stdout:check_obsoletes = 1 2024-09-17T02:52:13.487 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum clean all 2024-09-17T02:52:13.714 INFO:teuthology.orchestra.run.smithi192.stdout:45 files removed 2024-09-17T02:52:13.722 INFO:teuthology.orchestra.run.smithi104.stdout:45 files removed 2024-09-17T02:52:13.742 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T02:52:13.750 DEBUG:teuthology.orchestra.run.smithi104:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T02:52:14.301 INFO:teuthology.orchestra.run.smithi104.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-17T02:52:14.307 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-17T02:52:14.576 INFO:teuthology.orchestra.run.smithi104.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-17T02:52:14.591 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-17T02:52:15.144 INFO:teuthology.orchestra.run.smithi104.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2024-09-17T02:52:15.151 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-09-17T02:52:16.867 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-17T02:52:17.287 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.3 MB 00:02 2024-09-17T02:52:18.802 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-17T02:52:19.889 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-17T02:52:24.213 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-17T02:52:24.278 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-17T02:52:25.770 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-17T02:52:26.038 INFO:teuthology.orchestra.run.smithi104.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-17T02:52:26.858 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-17T02:52:27.017 INFO:teuthology.orchestra.run.smithi104.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-17T02:52:32.205 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T02:52:32.464 INFO:teuthology.orchestra.run.smithi104.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-17T02:52:34.374 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T02:52:34.374 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T02:52:34.385 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T02:52:34.386 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T02:52:34.387 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T02:52:34.388 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T02:52:34.390 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T02:52:34.392 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T02:52:34.393 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T02:52:34.454 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-17T02:52:34.480 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-17T02:52:34.480 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-17T02:52:34.480 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-17T02:52:34.480 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-17T02:52:34.480 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T02:52:34.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T02:52:34.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T02:52:34.480 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T02:52:34.481 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T02:52:34.482 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T02:52:34.483 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T02:52:34.484 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T02:52:34.485 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T02:52:34.486 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T02:52:34.487 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T02:52:34.488 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T02:52:34.489 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T02:52:34.490 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T02:52:34.491 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-09-17T02:52:34.492 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T02:52:34.493 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:52:34.493 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-17T02:52:34.493 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-17T02:52:34.493 INFO:teuthology.orchestra.run.smithi192.stdout:Install 149 Packages 2024-09-17T02:52:34.493 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 8 Packages 2024-09-17T02:52:34.493 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:52:34.493 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 228 M 2024-09-17T02:52:34.493 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-17T02:52:34.677 INFO:teuthology.orchestra.run.smithi104.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T02:52:34.677 INFO:teuthology.orchestra.run.smithi104.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T02:52:34.689 INFO:teuthology.orchestra.run.smithi104.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T02:52:34.690 INFO:teuthology.orchestra.run.smithi104.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T02:52:34.690 INFO:teuthology.orchestra.run.smithi104.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T02:52:34.691 INFO:teuthology.orchestra.run.smithi104.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T02:52:34.693 INFO:teuthology.orchestra.run.smithi104.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T02:52:34.695 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T02:52:34.696 INFO:teuthology.orchestra.run.smithi104.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T02:52:34.758 INFO:teuthology.orchestra.run.smithi104.stdout:Dependencies resolved. 2024-09-17T02:52:34.778 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: Package Arch Version Repository Size 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout:Installing: 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T02:52:34.779 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T02:52:34.780 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T02:52:34.781 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrading: 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T02:52:34.782 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout:Installing dependencies: 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T02:52:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T02:52:34.784 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T02:52:34.785 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T02:52:34.786 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T02:52:34.787 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T02:52:34.788 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T02:52:34.789 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T02:52:34.790 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout:Installing weak dependencies: 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction Summary 2024-09-17T02:52:34.791 INFO:teuthology.orchestra.run.smithi104.stdout:======================================================================================= 2024-09-17T02:52:34.792 INFO:teuthology.orchestra.run.smithi104.stdout:Install 149 Packages 2024-09-17T02:52:34.792 INFO:teuthology.orchestra.run.smithi104.stdout:Upgrade 8 Packages 2024-09-17T02:52:34.792 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:52:34.792 INFO:teuthology.orchestra.run.smithi104.stdout:Total download size: 228 M 2024-09-17T02:52:34.792 INFO:teuthology.orchestra.run.smithi104.stdout:Downloading Packages: 2024-09-17T02:52:35.199 INFO:teuthology.orchestra.run.smithi192.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-09-17T02:52:35.409 INFO:teuthology.orchestra.run.smithi104.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-09-17T02:52:35.540 INFO:teuthology.orchestra.run.smithi192.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 2.5 MB/s | 873 kB 00:00 2024-09-17T02:52:35.616 INFO:teuthology.orchestra.run.smithi192.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.9 MB/s | 148 kB 00:00 2024-09-17T02:52:35.791 INFO:teuthology.orchestra.run.smithi192.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 6.3 MB/s | 5.5 MB 00:00 2024-09-17T02:52:35.834 INFO:teuthology.orchestra.run.smithi104.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 2.0 MB/s | 873 kB 00:00 2024-09-17T02:52:35.950 INFO:teuthology.orchestra.run.smithi192.stdout:(5/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 9.6 MB/s | 1.5 MB 00:00 2024-09-17T02:52:35.951 INFO:teuthology.orchestra.run.smithi104.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 1.2 MB/s | 148 kB 00:00 2024-09-17T02:52:36.308 INFO:teuthology.orchestra.run.smithi192.stdout:(6/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 3.3 MB/s | 2.3 MB 00:00 2024-09-17T02:52:36.458 INFO:teuthology.orchestra.run.smithi192.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 9.8 MB/s | 5.0 MB 00:00 2024-09-17T02:52:37.092 INFO:teuthology.orchestra.run.smithi192.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 9.2 MB/s | 20 MB 00:02 2024-09-17T02:52:37.209 INFO:teuthology.orchestra.run.smithi192.stdout:(9/157): ceph-radosgw-19.3.0-4989.gce1b342b.el9 14 MB/s | 10 MB 00:00 2024-09-17T02:52:37.251 INFO:teuthology.orchestra.run.smithi192.stdout:(10/157): ceph-selinux-19.3.0-4989.gce1b342b.el 159 kB/s | 25 kB 00:00 2024-09-17T02:52:37.318 INFO:teuthology.orchestra.run.smithi104.stdout:(4/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 1.7 MB/s | 2.3 MB 00:01 2024-09-17T02:52:37.543 INFO:teuthology.orchestra.run.smithi104.stdout:(5/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 2.4 MB/s | 5.5 MB 00:02 2024-09-17T02:52:37.785 INFO:teuthology.orchestra.run.smithi192.stdout:(11/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 422 kB/s | 225 kB 00:00 2024-09-17T02:52:37.877 INFO:teuthology.orchestra.run.smithi192.stdout:(12/157): cephfs-shell-19.3.0-4989.gce1b342b.el 295 kB/s | 27 kB 00:00 2024-09-17T02:52:37.968 INFO:teuthology.orchestra.run.smithi192.stdout:(13/157): libcephfs-devel-19.3.0-4989.gce1b342b 347 kB/s | 32 kB 00:00 2024-09-17T02:52:38.010 INFO:teuthology.orchestra.run.smithi104.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-09-17T02:52:38.219 INFO:teuthology.orchestra.run.smithi192.stdout:(14/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 3.0 MB/s | 766 kB 00:00 2024-09-17T02:52:38.327 INFO:teuthology.orchestra.run.smithi192.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 1.4 MB/s | 159 kB 00:00 2024-09-17T02:52:38.436 INFO:teuthology.orchestra.run.smithi192.stdout:(16/157): librados-devel-19.3.0-4989.gce1b342b. 1.1 MB/s | 127 kB 00:00 2024-09-17T02:52:38.711 INFO:teuthology.orchestra.run.smithi192.stdout:(17/157): libradosstriper1-19.3.0-4989.gce1b342 1.8 MB/s | 507 kB 00:00 2024-09-17T02:52:39.085 INFO:teuthology.orchestra.run.smithi104.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 3.2 MB/s | 5.0 MB 00:01 2024-09-17T02:52:39.720 INFO:teuthology.orchestra.run.smithi192.stdout:(18/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 16 MB/s | 40 MB 00:02 2024-09-17T02:52:39.770 INFO:teuthology.orchestra.run.smithi192.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 911 kB/s | 45 kB 00:00 2024-09-17T02:52:39.820 INFO:teuthology.orchestra.run.smithi192.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 2.8 MB/s | 143 kB 00:00 2024-09-17T02:52:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:(21/157): python3-cephfs-19.3.0-4989.gce1b342b. 2.7 MB/s | 162 kB 00:00 2024-09-17T02:52:39.946 INFO:teuthology.orchestra.run.smithi192.stdout:(22/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 4.3 MB/s | 5.3 MB 00:01 2024-09-17T02:52:39.971 INFO:teuthology.orchestra.run.smithi192.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 3.4 MB/s | 321 kB 00:00 2024-09-17T02:52:40.030 INFO:teuthology.orchestra.run.smithi192.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 3.6 MB/s | 305 kB 00:00 2024-09-17T02:52:40.055 INFO:teuthology.orchestra.run.smithi192.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.2 MB/s | 99 kB 00:00 2024-09-17T02:52:40.097 INFO:teuthology.orchestra.run.smithi192.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.3 MB/s | 86 kB 00:00 2024-09-17T02:52:40.164 INFO:teuthology.orchestra.run.smithi192.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-17T02:52:40.248 INFO:teuthology.orchestra.run.smithi192.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4989.g 412 kB/s | 34 kB 00:00 2024-09-17T02:52:40.306 INFO:teuthology.orchestra.run.smithi192.stdout:(29/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 12 MB/s | 3.1 MB 00:00 2024-09-17T02:52:40.332 INFO:teuthology.orchestra.run.smithi192.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 1.8 MB/s | 154 kB 00:00 2024-09-17T02:52:41.094 INFO:teuthology.orchestra.run.smithi104.stdout:(8/157): ceph-radosgw-19.3.0-4989.gce1b342b.el9 5.2 MB/s | 10 MB 00:02 2024-09-17T02:52:41.135 INFO:teuthology.orchestra.run.smithi104.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 610 kB/s | 25 kB 00:00 2024-09-17T02:52:41.249 INFO:teuthology.orchestra.run.smithi192.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 15 MB/s | 14 MB 00:00 2024-09-17T02:52:41.307 INFO:teuthology.orchestra.run.smithi192.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.9 MB/s | 291 kB 00:00 2024-09-17T02:52:41.358 INFO:teuthology.orchestra.run.smithi192.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 989 kB/s | 49 kB 00:00 2024-09-17T02:52:41.524 INFO:teuthology.orchestra.run.smithi192.stdout:(34/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 3.4 MB/s | 18 MB 00:05 2024-09-17T02:52:41.549 INFO:teuthology.orchestra.run.smithi192.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 86 kB/s | 16 kB 00:00 2024-09-17T02:52:41.600 INFO:teuthology.orchestra.run.smithi192.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 3.7 MB/s | 285 kB 00:00 2024-09-17T02:52:41.642 INFO:teuthology.orchestra.run.smithi192.stdout:(37/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 8.3 MB/s | 784 kB 00:00 2024-09-17T02:52:41.667 INFO:teuthology.orchestra.run.smithi192.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 272 kB/s | 18 kB 00:00 2024-09-17T02:52:41.784 INFO:teuthology.orchestra.run.smithi192.stdout:(39/157): ceph-mgr-diskprediction-local-19.3.0- 5.1 MB/s | 7.4 MB 00:01 2024-09-17T02:52:41.926 INFO:teuthology.orchestra.run.smithi192.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 281 kB/s | 80 kB 00:00 2024-09-17T02:52:41.985 INFO:teuthology.orchestra.run.smithi192.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 955 kB/s | 191 kB 00:00 2024-09-17T02:52:42.051 INFO:teuthology.orchestra.run.smithi192.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 801 kB 00:00 2024-09-17T02:52:42.077 INFO:teuthology.orchestra.run.smithi192.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-17T02:52:42.102 INFO:teuthology.orchestra.run.smithi192.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-17T02:52:42.127 INFO:teuthology.orchestra.run.smithi192.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-17T02:52:42.135 INFO:teuthology.orchestra.run.smithi104.stdout:(10/157): ceph-common-19.3.0-4989.gce1b342b.el9 2.9 MB/s | 20 MB 00:06 2024-09-17T02:52:42.152 INFO:teuthology.orchestra.run.smithi192.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-17T02:52:42.186 INFO:teuthology.orchestra.run.smithi192.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-17T02:52:42.237 INFO:teuthology.orchestra.run.smithi192.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.9 MB/s | 1.2 MB 00:00 2024-09-17T02:52:42.311 INFO:teuthology.orchestra.run.smithi104.stdout:(11/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 4.1 MB/s | 18 MB 00:04 2024-09-17T02:52:42.336 INFO:teuthology.orchestra.run.smithi104.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 1.1 MB/s | 225 kB 00:00 2024-09-17T02:52:42.353 INFO:teuthology.orchestra.run.smithi104.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 649 kB/s | 27 kB 00:00 2024-09-17T02:52:42.370 INFO:teuthology.orchestra.run.smithi104.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 954 kB/s | 32 kB 00:00 2024-09-17T02:52:42.420 INFO:teuthology.orchestra.run.smithi104.stdout:(15/157): libcephsqlite-19.3.0-4989.gce1b342b.e 3.1 MB/s | 159 kB 00:00 2024-09-17T02:52:42.462 INFO:teuthology.orchestra.run.smithi104.stdout:(16/157): librados-devel-19.3.0-4989.gce1b342b. 3.0 MB/s | 127 kB 00:00 2024-09-17T02:52:42.512 INFO:teuthology.orchestra.run.smithi104.stdout:(17/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 4.7 MB/s | 766 kB 00:00 2024-09-17T02:52:42.579 INFO:teuthology.orchestra.run.smithi104.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 4.2 MB/s | 507 kB 00:00 2024-09-17T02:52:42.621 INFO:teuthology.orchestra.run.smithi104.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 1.1 MB/s | 45 kB 00:00 2024-09-17T02:52:42.671 INFO:teuthology.orchestra.run.smithi104.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 2.8 MB/s | 143 kB 00:00 2024-09-17T02:52:42.721 INFO:teuthology.orchestra.run.smithi104.stdout:(21/157): python3-cephfs-19.3.0-4989.gce1b342b. 3.2 MB/s | 162 kB 00:00 2024-09-17T02:52:42.789 INFO:teuthology.orchestra.run.smithi104.stdout:(22/157): python3-rados-19.3.0-4989.gce1b342b.e 4.7 MB/s | 321 kB 00:00 2024-09-17T02:52:42.855 INFO:teuthology.orchestra.run.smithi104.stdout:(23/157): python3-rbd-19.3.0-4989.gce1b342b.el9 4.5 MB/s | 305 kB 00:00 2024-09-17T02:52:42.904 INFO:teuthology.orchestra.run.smithi192.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-09-17T02:52:42.906 INFO:teuthology.orchestra.run.smithi104.stdout:(24/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.9 MB/s | 99 kB 00:00 2024-09-17T02:52:42.956 INFO:teuthology.orchestra.run.smithi104.stdout:(25/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T02:52:43.037 INFO:teuthology.orchestra.run.smithi192.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 779 kB/s | 689 kB 00:00 2024-09-17T02:52:43.087 INFO:teuthology.orchestra.run.smithi192.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-17T02:52:43.182 INFO:teuthology.orchestra.run.smithi104.stdout:(26/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 7.9 MB/s | 5.3 MB 00:00 2024-09-17T02:52:43.232 INFO:teuthology.orchestra.run.smithi104.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-17T02:52:43.282 INFO:teuthology.orchestra.run.smithi104.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4989.g 686 kB/s | 34 kB 00:00 2024-09-17T02:52:43.332 INFO:teuthology.orchestra.run.smithi104.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T02:52:43.458 INFO:teuthology.orchestra.run.smithi104.stdout:(30/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 6.2 MB/s | 3.1 MB 00:00 2024-09-17T02:52:43.479 INFO:teuthology.orchestra.run.smithi192.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-09-17T02:52:43.638 INFO:teuthology.orchestra.run.smithi192.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-17T02:52:43.830 INFO:teuthology.orchestra.run.smithi192.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 396 kB/s | 313 kB 00:00 2024-09-17T02:52:44.164 INFO:teuthology.orchestra.run.smithi192.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-09-17T02:52:44.308 INFO:teuthology.orchestra.run.smithi104.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 8.7 MB/s | 7.4 MB 00:00 2024-09-17T02:52:44.314 INFO:teuthology.orchestra.run.smithi192.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-17T02:52:44.375 INFO:teuthology.orchestra.run.smithi104.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.3 MB/s | 291 kB 00:00 2024-09-17T02:52:44.425 INFO:teuthology.orchestra.run.smithi104.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 989 kB/s | 49 kB 00:00 2024-09-17T02:52:44.475 INFO:teuthology.orchestra.run.smithi104.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 330 kB/s | 16 kB 00:00 2024-09-17T02:52:44.539 INFO:teuthology.orchestra.run.smithi192.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-17T02:52:44.542 INFO:teuthology.orchestra.run.smithi104.stdout:(35/157): ceph-volume-19.3.0-4989.gce1b342b.el9 4.2 MB/s | 285 kB 00:00 2024-09-17T02:52:44.676 INFO:teuthology.orchestra.run.smithi104.stdout:(36/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 5.8 MB/s | 784 kB 00:00 2024-09-17T02:52:44.728 INFO:teuthology.orchestra.run.smithi104.stdout:(37/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 366 kB/s | 18 kB 00:00 2024-09-17T02:52:44.885 INFO:teuthology.orchestra.run.smithi104.stdout:(38/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 9.1 MB/s | 14 MB 00:01 2024-09-17T02:52:44.910 INFO:teuthology.orchestra.run.smithi104.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-17T02:52:44.956 INFO:teuthology.orchestra.run.smithi192.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 215 kB/s | 171 kB 00:00 2024-09-17T02:52:45.098 INFO:teuthology.orchestra.run.smithi192.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 204 kB/s | 160 kB 00:00 2024-09-17T02:52:45.115 INFO:teuthology.orchestra.run.smithi192.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 80 kB/s | 45 kB 00:00 2024-09-17T02:52:45.261 INFO:teuthology.orchestra.run.smithi104.stdout:(40/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 9.7 MB/s | 40 MB 00:04 2024-09-17T02:52:45.327 INFO:teuthology.orchestra.run.smithi104.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 458 kB/s | 191 kB 00:00 2024-09-17T02:52:45.386 INFO:teuthology.orchestra.run.smithi104.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-17T02:52:45.428 INFO:teuthology.orchestra.run.smithi104.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-17T02:52:45.453 INFO:teuthology.orchestra.run.smithi104.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-17T02:52:45.495 INFO:teuthology.orchestra.run.smithi104.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-17T02:52:45.520 INFO:teuthology.orchestra.run.smithi104.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-17T02:52:45.545 INFO:teuthology.orchestra.run.smithi104.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-17T02:52:45.571 INFO:teuthology.orchestra.run.smithi104.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-17T02:52:45.665 INFO:teuthology.orchestra.run.smithi192.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-17T02:52:45.721 INFO:teuthology.orchestra.run.smithi104.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 714 kB/s | 107 kB 00:00 2024-09-17T02:52:45.763 INFO:teuthology.orchestra.run.smithi104.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-17T02:52:45.780 INFO:teuthology.orchestra.run.smithi104.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-17T02:52:45.805 INFO:teuthology.orchestra.run.smithi104.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-09-17T02:52:45.815 INFO:teuthology.orchestra.run.smithi192.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 771 kB/s | 662 kB 00:00 2024-09-17T02:52:45.822 INFO:teuthology.orchestra.run.smithi104.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 781 kB/s | 33 kB 00:00 2024-09-17T02:52:45.847 INFO:teuthology.orchestra.run.smithi104.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 313 kB 00:00 2024-09-17T02:52:45.864 INFO:teuthology.orchestra.run.smithi104.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 432 kB/s | 18 kB 00:00 2024-09-17T02:52:45.881 INFO:teuthology.orchestra.run.smithi104.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 332 kB/s | 11 kB 00:00 2024-09-17T02:52:45.940 INFO:teuthology.orchestra.run.smithi104.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-17T02:52:45.965 INFO:teuthology.orchestra.run.smithi104.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-17T02:52:45.990 INFO:teuthology.orchestra.run.smithi104.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-17T02:52:46.016 INFO:teuthology.orchestra.run.smithi104.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-17T02:52:46.041 INFO:teuthology.orchestra.run.smithi192.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 617 kB/s | 581 kB 00:00 2024-09-17T02:52:46.057 INFO:teuthology.orchestra.run.smithi104.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-17T02:52:46.083 INFO:teuthology.orchestra.run.smithi104.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-17T02:52:46.108 INFO:teuthology.orchestra.run.smithi104.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-17T02:52:46.142 INFO:teuthology.orchestra.run.smithi104.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-17T02:52:46.167 INFO:teuthology.orchestra.run.smithi104.stdout:(65/157): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-17T02:52:46.192 INFO:teuthology.orchestra.run.smithi104.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-17T02:52:46.218 INFO:teuthology.orchestra.run.smithi104.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-17T02:52:46.249 INFO:teuthology.orchestra.run.smithi192.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-17T02:52:46.293 INFO:teuthology.orchestra.run.smithi104.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-17T02:52:46.393 INFO:teuthology.orchestra.run.smithi104.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-17T02:52:46.427 INFO:teuthology.orchestra.run.smithi104.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-17T02:52:46.452 INFO:teuthology.orchestra.run.smithi104.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-17T02:52:46.519 INFO:teuthology.orchestra.run.smithi104.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-17T02:52:46.561 INFO:teuthology.orchestra.run.smithi104.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-17T02:52:46.586 INFO:teuthology.orchestra.run.smithi104.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-17T02:52:46.608 INFO:teuthology.orchestra.run.smithi192.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2024-09-17T02:52:46.678 INFO:teuthology.orchestra.run.smithi104.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-17T02:52:46.695 INFO:teuthology.orchestra.run.smithi104.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-17T02:52:46.728 INFO:teuthology.orchestra.run.smithi104.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-17T02:52:46.754 INFO:teuthology.orchestra.run.smithi104.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-17T02:52:46.771 INFO:teuthology.orchestra.run.smithi104.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-09-17T02:52:46.816 INFO:teuthology.orchestra.run.smithi192.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-09-17T02:52:46.846 INFO:teuthology.orchestra.run.smithi104.stdout:(80/157): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-09-17T02:52:46.850 INFO:teuthology.orchestra.run.smithi192.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 235 kB/s | 188 kB 00:00 2024-09-17T02:52:46.863 INFO:teuthology.orchestra.run.smithi104.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-17T02:52:46.888 INFO:teuthology.orchestra.run.smithi104.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-17T02:52:46.905 INFO:teuthology.orchestra.run.smithi104.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-09-17T02:52:46.938 INFO:teuthology.orchestra.run.smithi104.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-17T02:52:46.964 INFO:teuthology.orchestra.run.smithi104.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-17T02:52:46.989 INFO:teuthology.orchestra.run.smithi104.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T02:52:47.006 INFO:teuthology.orchestra.run.smithi104.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-17T02:52:47.048 INFO:teuthology.orchestra.run.smithi104.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-17T02:52:47.073 INFO:teuthology.orchestra.run.smithi104.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-17T02:52:47.099 INFO:teuthology.orchestra.run.smithi104.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-17T02:52:47.124 INFO:teuthology.orchestra.run.smithi104.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T02:52:47.149 INFO:teuthology.orchestra.run.smithi104.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T02:52:47.225 INFO:teuthology.orchestra.run.smithi104.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-17T02:52:47.250 INFO:teuthology.orchestra.run.smithi104.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-17T02:52:47.275 INFO:teuthology.orchestra.run.smithi104.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-17T02:52:47.309 INFO:teuthology.orchestra.run.smithi104.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-17T02:52:47.334 INFO:teuthology.orchestra.run.smithi104.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-17T02:52:47.359 INFO:teuthology.orchestra.run.smithi104.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-17T02:52:47.385 INFO:teuthology.orchestra.run.smithi104.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T02:52:47.410 INFO:teuthology.orchestra.run.smithi104.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T02:52:47.435 INFO:teuthology.orchestra.run.smithi104.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T02:52:47.460 INFO:teuthology.orchestra.run.smithi104.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T02:52:47.485 INFO:teuthology.orchestra.run.smithi104.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-17T02:52:47.628 INFO:teuthology.orchestra.run.smithi104.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-09-17T02:52:47.678 INFO:teuthology.orchestra.run.smithi104.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-17T02:52:47.708 INFO:teuthology.orchestra.run.smithi192.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-17T02:52:47.711 INFO:teuthology.orchestra.run.smithi104.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-17T02:52:47.737 INFO:teuthology.orchestra.run.smithi104.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-17T02:52:47.770 INFO:teuthology.orchestra.run.smithi104.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-09-17T02:52:47.850 INFO:teuthology.orchestra.run.smithi192.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:01 2024-09-17T02:52:47.934 INFO:teuthology.orchestra.run.smithi192.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-17T02:52:47.946 INFO:teuthology.orchestra.run.smithi104.stdout:(109/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-17T02:52:47.979 INFO:teuthology.orchestra.run.smithi104.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 124 kB/s | 26 kB 00:00 2024-09-17T02:52:48.004 INFO:teuthology.orchestra.run.smithi104.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 865 kB/s | 49 kB 00:00 2024-09-17T02:52:48.029 INFO:teuthology.orchestra.run.smithi104.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-17T02:52:48.063 INFO:teuthology.orchestra.run.smithi104.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-17T02:52:48.113 INFO:teuthology.orchestra.run.smithi104.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-17T02:52:48.139 INFO:teuthology.orchestra.run.smithi104.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T02:52:48.181 INFO:teuthology.orchestra.run.smithi104.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-17T02:52:48.198 INFO:teuthology.orchestra.run.smithi104.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-17T02:52:48.215 INFO:teuthology.orchestra.run.smithi104.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 421 kB/s | 14 kB 00:00 2024-09-17T02:52:48.240 INFO:teuthology.orchestra.run.smithi104.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-17T02:52:48.274 INFO:teuthology.orchestra.run.smithi104.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-17T02:52:48.299 INFO:teuthology.orchestra.run.smithi104.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-17T02:52:48.324 INFO:teuthology.orchestra.run.smithi104.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T02:52:48.349 INFO:teuthology.orchestra.run.smithi104.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-17T02:52:48.375 INFO:teuthology.orchestra.run.smithi104.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-17T02:52:48.400 INFO:teuthology.orchestra.run.smithi104.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-17T02:52:48.425 INFO:teuthology.orchestra.run.smithi104.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-17T02:52:48.450 INFO:teuthology.orchestra.run.smithi104.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-17T02:52:48.518 INFO:teuthology.orchestra.run.smithi104.stdout:(128/157): libarrow-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-09-17T02:52:48.534 INFO:teuthology.orchestra.run.smithi104.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-09-17T02:52:48.559 INFO:teuthology.orchestra.run.smithi104.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T02:52:48.584 INFO:teuthology.orchestra.run.smithi192.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 187 kB/s | 137 kB 00:00 2024-09-17T02:52:48.585 INFO:teuthology.orchestra.run.smithi104.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T02:52:48.610 INFO:teuthology.orchestra.run.smithi104.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T02:52:48.617 INFO:teuthology.orchestra.run.smithi192.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-17T02:52:48.660 INFO:teuthology.orchestra.run.smithi104.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-17T02:52:48.694 INFO:teuthology.orchestra.run.smithi104.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-17T02:52:48.711 INFO:teuthology.orchestra.run.smithi104.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-17T02:52:48.744 INFO:teuthology.orchestra.run.smithi104.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-17T02:52:48.761 INFO:teuthology.orchestra.run.smithi104.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 566 kB/s | 28 kB 00:00 2024-09-17T02:52:48.786 INFO:teuthology.orchestra.run.smithi104.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-17T02:52:48.803 INFO:teuthology.orchestra.run.smithi104.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 737 kB/s | 31 kB 00:00 2024-09-17T02:52:48.820 INFO:teuthology.orchestra.run.smithi104.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-17T02:52:48.837 INFO:teuthology.orchestra.run.smithi104.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-17T02:52:48.863 INFO:teuthology.orchestra.run.smithi104.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-17T02:52:48.888 INFO:teuthology.orchestra.run.smithi104.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-17T02:52:48.913 INFO:teuthology.orchestra.run.smithi104.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-17T02:52:48.938 INFO:teuthology.orchestra.run.smithi104.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-17T02:52:48.964 INFO:teuthology.orchestra.run.smithi104.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-17T02:52:48.997 INFO:teuthology.orchestra.run.smithi104.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-17T02:52:49.033 INFO:teuthology.orchestra.run.smithi104.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-17T02:52:49.093 INFO:teuthology.orchestra.run.smithi192.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-17T02:52:49.143 INFO:teuthology.orchestra.run.smithi104.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 8.9 MB/s | 1.6 MB 00:00 2024-09-17T02:52:49.323 INFO:teuthology.orchestra.run.smithi104.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-17T02:52:49.326 INFO:teuthology.orchestra.run.smithi192.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 123 kB/s | 87 kB 00:00 2024-09-17T02:52:49.397 INFO:teuthology.orchestra.run.smithi104.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-17T02:52:49.431 INFO:teuthology.orchestra.run.smithi104.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-09-17T02:52:49.481 INFO:teuthology.orchestra.run.smithi104.stdout:(153/157): librados2-19.3.0-4989.gce1b342b.el9. 7.0 MB/s | 3.4 MB 00:00 2024-09-17T02:52:49.507 INFO:teuthology.orchestra.run.smithi104.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-17T02:52:49.566 INFO:teuthology.orchestra.run.smithi104.stdout:(155/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 5.9 MB/s | 3.2 MB 00:00 2024-09-17T02:52:49.610 INFO:teuthology.orchestra.run.smithi192.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-09-17T02:52:49.624 INFO:teuthology.orchestra.run.smithi104.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-17T02:52:49.674 INFO:teuthology.orchestra.run.smithi104.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 1.4 MB 00:00 2024-09-17T02:52:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:-------------------------------------------------------------------------------- 2024-09-17T02:52:49.680 INFO:teuthology.orchestra.run.smithi104.stdout:Total 15 MB/s | 228 MB 00:14 2024-09-17T02:52:49.960 INFO:teuthology.orchestra.run.smithi192.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 98 kB/s | 61 kB 00:00 2024-09-17T02:52:50.244 INFO:teuthology.orchestra.run.smithi192.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-17T02:52:50.369 INFO:teuthology.orchestra.run.smithi192.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 323 kB/s | 245 kB 00:00 2024-09-17T02:52:50.786 INFO:teuthology.orchestra.run.smithi192.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 48 kB/s | 26 kB 00:00 2024-09-17T02:52:50.820 INFO:teuthology.orchestra.run.smithi192.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 289 kB/s | 248 kB 00:00 2024-09-17T02:52:50.873 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction check 2024-09-17T02:52:50.873 INFO:teuthology.orchestra.run.smithi192.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-17T02:52:51.024 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction check succeeded. 2024-09-17T02:52:51.025 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction test 2024-09-17T02:52:51.370 INFO:teuthology.orchestra.run.smithi192.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-17T02:52:51.571 INFO:teuthology.orchestra.run.smithi192.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 220 kB/s | 172 kB 00:00 2024-09-17T02:52:51.971 INFO:teuthology.orchestra.run.smithi192.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.6 MB/s | 5.1 MB 00:01 2024-09-17T02:52:52.230 INFO:teuthology.orchestra.run.smithi192.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 292 kB/s | 250 kB 00:00 2024-09-17T02:52:52.371 INFO:teuthology.orchestra.run.smithi192.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 278 kB/s | 222 kB 00:00 2024-09-17T02:52:52.672 INFO:teuthology.orchestra.run.smithi192.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 110 kB/s | 77 kB 00:00 2024-09-17T02:52:52.847 INFO:teuthology.orchestra.run.smithi192.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 68 kB/s | 42 kB 00:00 2024-09-17T02:52:53.222 INFO:teuthology.orchestra.run.smithi192.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 317 kB/s | 269 kB 00:00 2024-09-17T02:52:53.269 INFO:teuthology.orchestra.run.smithi104.stdout:Transaction test succeeded. 2024-09-17T02:52:53.269 INFO:teuthology.orchestra.run.smithi104.stdout:Running transaction 2024-09-17T02:52:53.506 INFO:teuthology.orchestra.run.smithi192.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 190 kB/s | 159 kB 00:00 2024-09-17T02:52:53.739 INFO:teuthology.orchestra.run.smithi192.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 313 kB/s | 279 kB 00:00 2024-09-17T02:52:53.973 INFO:teuthology.orchestra.run.smithi192.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 68 kB/s | 51 kB 00:00 2024-09-17T02:52:54.123 INFO:teuthology.orchestra.run.smithi192.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 87 kB/s | 54 kB 00:00 2024-09-17T02:52:54.548 INFO:teuthology.orchestra.run.smithi192.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 73 kB/s | 42 kB 00:00 2024-09-17T02:52:54.690 INFO:teuthology.orchestra.run.smithi192.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-17T02:52:55.182 INFO:teuthology.orchestra.run.smithi192.stdout:(96/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-17T02:52:55.382 INFO:teuthology.orchestra.run.smithi192.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 265 kB/s | 221 kB 00:00 2024-09-17T02:52:55.407 INFO:teuthology.orchestra.run.smithi192.stdout:(98/157): qatlib-service-24.02.0-1.el9.x86_64.r 50 kB/s | 36 kB 00:00 2024-09-17T02:52:55.774 INFO:teuthology.orchestra.run.smithi192.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 80 kB/s | 47 kB 00:00 2024-09-17T02:52:56.025 INFO:teuthology.orchestra.run.smithi192.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 94 kB/s | 58 kB 00:00 2024-09-17T02:52:56.158 INFO:teuthology.orchestra.run.smithi192.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 392 kB/s | 304 kB 00:00 2024-09-17T02:52:56.450 INFO:teuthology.orchestra.run.smithi192.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 142 kB/s | 96 kB 00:00 2024-09-17T02:52:56.525 INFO:teuthology.orchestra.run.smithi192.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 302 kB/s | 22 kB 00:00 2024-09-17T02:52:56.634 INFO:teuthology.orchestra.run.smithi192.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-09-17T02:52:56.659 INFO:teuthology.orchestra.run.smithi192.stdout:(105/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 100 kB/s | 64 kB 00:00 2024-09-17T02:52:56.726 INFO:teuthology.orchestra.run.smithi192.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.9 MB/s | 548 kB 00:00 2024-09-17T02:52:56.751 INFO:teuthology.orchestra.run.smithi192.stdout:(107/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-17T02:52:56.777 INFO:teuthology.orchestra.run.smithi192.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 395 kB/s | 19 kB 00:00 2024-09-17T02:52:56.810 INFO:teuthology.orchestra.run.smithi192.stdout:(109/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.0 MB/s | 308 kB 00:00 2024-09-17T02:52:56.836 INFO:teuthology.orchestra.run.smithi192.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 505 kB/s | 26 kB 00:00 2024-09-17T02:52:56.861 INFO:teuthology.orchestra.run.smithi192.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-09-17T02:52:56.886 INFO:teuthology.orchestra.run.smithi192.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T02:52:56.912 INFO:teuthology.orchestra.run.smithi192.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-17T02:52:56.970 INFO:teuthology.orchestra.run.smithi192.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-17T02:52:57.004 INFO:teuthology.orchestra.run.smithi192.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-17T02:52:57.021 INFO:teuthology.orchestra.run.smithi192.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-17T02:52:57.037 INFO:teuthology.orchestra.run.smithi192.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 962 kB/s | 32 kB 00:00 2024-09-17T02:52:57.055 INFO:teuthology.orchestra.run.smithi192.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 421 kB/s | 14 kB 00:00 2024-09-17T02:52:57.088 INFO:teuthology.orchestra.run.smithi192.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-17T02:52:57.122 INFO:teuthology.orchestra.run.smithi192.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-17T02:52:57.147 INFO:teuthology.orchestra.run.smithi192.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-17T02:52:57.173 INFO:teuthology.orchestra.run.smithi192.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-17T02:52:57.206 INFO:teuthology.orchestra.run.smithi192.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-17T02:52:57.231 INFO:teuthology.orchestra.run.smithi192.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-17T02:52:57.256 INFO:teuthology.orchestra.run.smithi192.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-17T02:52:57.282 INFO:teuthology.orchestra.run.smithi192.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-09-17T02:52:57.315 INFO:teuthology.orchestra.run.smithi192.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 585 kB/s | 19 kB 00:00 2024-09-17T02:52:57.341 INFO:teuthology.orchestra.run.smithi192.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-17T02:52:57.408 INFO:teuthology.orchestra.run.smithi192.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-17T02:52:57.450 INFO:teuthology.orchestra.run.smithi192.stdout:(130/157): python3-grpcio-1.46.7-10.el9.x86_64. 6.7 MB/s | 2.0 MB 00:00 2024-09-17T02:52:57.475 INFO:teuthology.orchestra.run.smithi192.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2024-09-17T02:52:57.500 INFO:teuthology.orchestra.run.smithi192.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-17T02:52:57.525 INFO:teuthology.orchestra.run.smithi192.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-17T02:52:57.551 INFO:teuthology.orchestra.run.smithi192.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-17T02:52:57.576 INFO:teuthology.orchestra.run.smithi192.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-17T02:52:57.610 INFO:teuthology.orchestra.run.smithi192.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-17T02:52:57.635 INFO:teuthology.orchestra.run.smithi192.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-17T02:52:57.660 INFO:teuthology.orchestra.run.smithi192.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-17T02:52:57.694 INFO:teuthology.orchestra.run.smithi192.stdout:(139/157): python3-kubernetes-26.1.0-2.el9.noar 2.9 MB/s | 1.0 MB 00:00 2024-09-17T02:52:57.719 INFO:teuthology.orchestra.run.smithi192.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-17T02:52:57.744 INFO:teuthology.orchestra.run.smithi192.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-09-17T02:52:57.770 INFO:teuthology.orchestra.run.smithi192.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-09-17T02:52:57.803 INFO:teuthology.orchestra.run.smithi192.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 886 kB/s | 74 kB 00:00 2024-09-17T02:52:57.829 INFO:teuthology.orchestra.run.smithi192.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-17T02:52:57.854 INFO:teuthology.orchestra.run.smithi192.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-17T02:52:57.888 INFO:teuthology.orchestra.run.smithi192.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 339 kB/s | 20 kB 00:00 2024-09-17T02:52:57.913 INFO:teuthology.orchestra.run.smithi192.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-17T02:52:57.938 INFO:teuthology.orchestra.run.smithi192.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-17T02:52:57.989 INFO:teuthology.orchestra.run.smithi192.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T02:52:58.181 INFO:teuthology.orchestra.run.smithi192.stdout:(150/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-17T02:52:58.431 INFO:teuthology.orchestra.run.smithi192.stdout:(151/157): librados2-19.3.0-4989.gce1b342b.el9. 6.5 MB/s | 3.4 MB 00:00 2024-09-17T02:52:58.556 INFO:teuthology.orchestra.run.smithi192.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.1 MB/s | 2.3 MB 00:00 2024-09-17T02:52:58.573 INFO:teuthology.orchestra.run.smithi192.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 288 kB/s | 41 kB 00:00 2024-09-17T02:52:58.632 INFO:teuthology.orchestra.run.smithi192.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-09-17T02:52:58.741 INFO:teuthology.orchestra.run.smithi192.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.3 MB/s | 249 kB 00:00 2024-09-17T02:52:58.824 INFO:teuthology.orchestra.run.smithi192.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-17T02:52:59.719 INFO:teuthology.orchestra.run.smithi104.stdout: Preparing : 1/1 2024-09-17T02:52:59.844 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T02:52:59.857 INFO:teuthology.orchestra.run.smithi192.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-17T02:52:59.864 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-17T02:52:59.865 INFO:teuthology.orchestra.run.smithi192.stdout:Total 9.0 MB/s | 228 MB 00:25 2024-09-17T02:52:59.891 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T02:52:59.944 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T02:52:59.977 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T02:53:00.011 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T02:53:00.066 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T02:53:00.421 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T02:53:00.537 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T02:53:00.654 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T02:53:00.680 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T02:53:00.772 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T02:53:00.808 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T02:53:00.848 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T02:53:01.023 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T02:53:01.081 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-17T02:53:01.082 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T02:53:01.118 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T02:53:01.222 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T02:53:01.233 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-17T02:53:01.233 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-17T02:53:01.252 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T02:53:01.318 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T02:53:01.345 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T02:53:01.367 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T02:53:01.572 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T02:53:01.749 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T02:53:01.876 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T02:53:01.996 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T02:53:02.078 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T02:53:02.313 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T02:53:02.427 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T02:53:02.475 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T02:53:02.516 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T02:53:02.590 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T02:53:02.635 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T02:53:02.675 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T02:53:02.718 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T02:53:02.751 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T02:53:02.778 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T02:53:02.848 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T02:53:02.909 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T02:53:02.940 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T02:53:02.983 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T02:53:03.060 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T02:53:03.093 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T02:53:03.136 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T02:53:03.165 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T02:53:03.234 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T02:53:03.280 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T02:53:03.354 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T02:53:03.497 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T02:53:03.557 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T02:53:03.609 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-17T02:53:03.609 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-17T02:53:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T02:53:04.169 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T02:53:04.206 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T02:53:04.241 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T02:53:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T02:53:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T02:53:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T02:53:04.532 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T02:53:04.633 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T02:53:04.705 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T02:53:04.777 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T02:53:04.809 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T02:53:04.844 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T02:53:04.891 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T02:53:04.927 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T02:53:04.989 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T02:53:05.038 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T02:53:05.182 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T02:53:05.231 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T02:53:05.273 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T02:53:05.377 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T02:53:05.415 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T02:53:05.513 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T02:53:05.726 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T02:53:05.808 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T02:53:05.911 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T02:53:06.037 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T02:53:06.082 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T02:53:06.110 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T02:53:06.144 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T02:53:06.183 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T02:53:06.214 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T02:53:06.245 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T02:53:06.279 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T02:53:06.312 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T02:53:06.354 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T02:53:06.397 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T02:53:06.483 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T02:53:06.535 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T02:53:06.566 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T02:53:06.670 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T02:53:06.717 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T02:53:07.443 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T02:53:07.497 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T02:53:07.530 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T02:53:07.632 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T02:53:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T02:53:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T02:53:07.827 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T02:53:07.858 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T02:53:08.043 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T02:53:08.072 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T02:53:08.151 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T02:53:08.804 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T02:53:08.920 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T02:53:10.125 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-17T02:53:10.178 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T02:53:10.253 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T02:53:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T02:53:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T02:53:10.300 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T02:53:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T02:53:10.352 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T02:53:10.395 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T02:53:10.420 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T02:53:10.481 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T02:53:10.660 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T02:53:10.707 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T02:53:10.798 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T02:53:10.821 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T02:53:10.837 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T02:53:10.873 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T02:53:10.938 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T02:53:11.064 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T02:53:11.089 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T02:53:11.181 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T02:53:11.248 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T02:53:11.282 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T02:53:11.370 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T02:53:11.402 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T02:53:11.459 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T02:53:11.472 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T02:53:11.503 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T02:53:11.524 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T02:53:11.552 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T02:53:11.666 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T02:53:11.695 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T02:53:11.758 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T02:53:11.788 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T02:53:11.812 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T02:53:12.007 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T02:53:12.178 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T02:53:12.294 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T02:53:12.397 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T02:53:12.496 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T02:53:12.738 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T02:53:12.842 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T02:53:12.866 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T02:53:12.901 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T02:53:12.966 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T02:53:13.010 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T02:53:13.043 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T02:53:13.085 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T02:53:13.119 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T02:53:13.146 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T02:53:13.214 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T02:53:13.268 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T02:53:13.299 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T02:53:13.342 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T02:53:13.429 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T02:53:13.462 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T02:53:13.505 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T02:53:13.534 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T02:53:13.605 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T02:53:13.649 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T02:53:13.723 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T02:53:13.754 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T02:53:13.799 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T02:53:13.860 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T02:53:13.910 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T02:53:14.385 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T02:53:14.419 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T02:53:14.452 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T02:53:14.495 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T02:53:14.495 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T02:53:14.495 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T02:53:14.495 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:14.528 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T02:53:14.530 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T02:53:14.559 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T02:53:14.602 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T02:53:14.631 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T02:53:14.674 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T02:53:14.837 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T02:53:14.900 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T02:53:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T02:53:15.057 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T02:53:15.129 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T02:53:15.161 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T02:53:15.197 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T02:53:15.244 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T02:53:15.279 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T02:53:15.322 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T02:53:15.365 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T02:53:15.501 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T02:53:15.541 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T02:53:15.582 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T02:53:15.685 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T02:53:15.725 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T02:53:15.766 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T02:53:15.798 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T02:53:15.826 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T02:53:15.932 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T02:53:16.060 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T02:53:16.092 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T02:53:16.126 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T02:53:16.162 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T02:53:16.201 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T02:53:16.232 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T02:53:16.262 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T02:53:16.297 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T02:53:16.330 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T02:53:16.371 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T02:53:16.406 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T02:53:16.493 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T02:53:16.536 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T02:53:16.567 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T02:53:16.663 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T02:53:16.710 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T02:53:17.437 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T02:53:17.490 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T02:53:17.524 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T02:53:17.628 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T02:53:17.673 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T02:53:17.718 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T02:53:17.806 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T02:53:17.845 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T02:53:18.031 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T02:53:18.060 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T02:53:18.137 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T02:53:18.796 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T02:53:18.917 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T02:53:20.187 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T02:53:20.280 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T02:53:20.308 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T02:53:20.340 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T02:53:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T02:53:20.712 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T02:53:20.786 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T02:53:20.816 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T02:53:20.853 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T02:53:21.352 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T02:53:21.381 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T02:53:21.444 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T02:53:21.466 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T02:53:23.718 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T02:53:23.754 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T02:53:24.331 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T02:53:24.374 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T02:53:24.467 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T02:53:24.468 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T02:53:24.468 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T02:53:24.468 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:24.509 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T02:53:26.050 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T02:53:26.051 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /sys 2024-09-17T02:53:26.051 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /proc 2024-09-17T02:53:26.051 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /mnt 2024-09-17T02:53:26.051 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /var/tmp 2024-09-17T02:53:26.051 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /home 2024-09-17T02:53:26.051 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /root 2024-09-17T02:53:26.051 INFO:teuthology.orchestra.run.smithi104.stdout:skipping the directory /tmp 2024-09-17T02:53:26.051 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:26.222 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T02:53:26.238 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T02:53:26.238 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:26.238 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T02:53:26.238 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:27.834 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T02:53:27.861 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T02:53:27.861 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:27.861 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T02:53:27.861 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T02:53:27.861 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T02:53:27.861 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:28.092 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T02:53:28.115 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T02:53:28.116 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:28.116 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T02:53:28.116 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T02:53:28.116 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T02:53:28.116 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:28.585 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T02:53:28.608 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T02:53:28.608 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:28.608 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T02:53:28.608 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T02:53:28.608 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T02:53:28.609 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:28.715 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T02:53:28.772 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T02:53:28.827 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T02:53:29.023 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T02:53:29.069 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T02:53:29.156 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T02:53:29.244 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T02:53:29.392 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T02:53:29.436 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T02:53:29.467 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T02:53:29.494 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T02:53:29.966 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T02:53:29.993 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T02:53:30.025 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T02:53:30.092 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T02:53:30.116 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T02:53:33.323 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T02:53:33.388 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T02:53:34.353 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T02:53:34.380 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T02:53:34.495 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T02:53:34.664 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T02:53:34.690 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T02:53:34.714 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T02:53:34.714 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:34.714 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T02:53:34.714 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T02:53:34.714 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T02:53:34.714 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:34.758 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T02:53:34.769 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T02:53:34.868 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T02:53:34.930 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T02:53:35.895 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T02:53:35.927 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T02:53:35.950 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T02:53:35.950 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:35.950 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T02:53:35.950 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:53:35.950 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:53:35.950 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:35.994 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T02:53:36.016 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T02:53:36.017 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:36.017 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T02:53:36.017 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:36.061 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T02:53:36.084 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T02:53:36.084 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:36.084 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T02:53:36.084 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T02:53:36.084 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T02:53:36.085 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:36.403 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T02:53:36.426 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T02:53:36.427 INFO:teuthology.orchestra.run.smithi104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:36.427 INFO:teuthology.orchestra.run.smithi104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T02:53:36.427 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T02:53:36.427 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T02:53:36.427 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-09-17T02:53:36.440 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:36.619 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T02:53:36.636 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T02:53:36.636 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:36.637 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T02:53:36.637 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:38.231 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T02:53:38.258 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T02:53:38.258 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:38.258 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T02:53:38.258 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T02:53:38.258 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T02:53:38.258 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:38.482 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T02:53:38.505 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T02:53:38.505 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:38.505 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T02:53:38.506 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T02:53:38.506 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T02:53:38.506 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:38.974 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T02:53:38.998 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T02:53:38.998 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:38.998 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T02:53:38.998 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T02:53:38.998 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T02:53:38.998 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:39.104 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T02:53:39.161 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T02:53:39.216 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T02:53:39.405 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T02:53:39.450 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T02:53:39.528 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T02:53:39.617 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T02:53:39.756 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T02:53:39.800 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T02:53:39.832 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T02:53:39.859 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T02:53:40.306 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T02:53:40.333 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T02:53:40.365 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T02:53:40.416 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T02:53:40.432 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T02:53:40.455 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T02:53:40.465 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T02:53:40.506 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T02:53:40.537 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T02:53:40.565 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T02:53:40.755 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T02:53:40.803 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T02:53:40.833 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T02:53:40.862 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T02:53:40.917 INFO:teuthology.orchestra.run.smithi104.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T02:53:41.568 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T02:53:41.606 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T02:53:41.626 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T02:53:42.461 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T02:53:42.544 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T02:53:42.591 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T02:53:42.675 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T02:53:42.713 INFO:teuthology.orchestra.run.smithi104.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T02:53:42.739 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T02:53:42.764 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T02:53:42.764 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T02:53:42.877 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T02:53:42.877 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T02:53:42.966 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T02:53:42.991 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T02:53:42.996 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T02:53:42.996 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T02:53:43.176 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T02:53:43.176 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T02:53:43.260 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T02:53:43.333 INFO:teuthology.orchestra.run.smithi104.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T02:53:43.663 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T02:53:43.720 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T02:53:44.688 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T02:53:44.712 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T02:53:44.828 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T02:53:44.996 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T02:53:45.022 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T02:53:45.046 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T02:53:45.047 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:45.047 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T02:53:45.047 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T02:53:45.047 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T02:53:45.047 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:45.090 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T02:53:45.102 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T02:53:45.203 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T02:53:45.257 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T02:53:46.231 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T02:53:46.259 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T02:53:46.283 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T02:53:46.283 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:46.283 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T02:53:46.283 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:53:46.283 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T02:53:46.283 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:46.326 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T02:53:46.349 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T02:53:46.349 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:46.350 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T02:53:46.350 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:46.402 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T02:53:46.425 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T02:53:46.425 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:46.425 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T02:53:46.425 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T02:53:46.425 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T02:53:46.426 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:46.744 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T02:53:46.767 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T02:53:46.768 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T02:53:46.768 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T02:53:46.768 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T02:53:46.768 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T02:53:46.768 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:53:50.078 INFO:teuthology.orchestra.run.smithi104.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T02:53:50.079 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T02:53:50.080 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T02:53:50.081 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T02:53:50.082 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T02:53:50.083 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T02:53:50.084 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T02:53:50.085 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T02:53:50.086 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T02:53:50.087 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T02:53:50.088 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T02:53:50.089 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T02:53:50.090 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T02:53:50.091 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T02:53:50.092 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T02:53:50.093 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T02:53:50.094 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T02:53:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T02:53:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T02:53:50.872 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T02:53:50.904 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T02:53:50.931 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T02:53:51.121 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T02:53:51.170 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T02:53:51.200 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T02:53:51.229 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T02:53:51.268 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T02:53:51.905 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T02:53:51.940 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T02:53:51.960 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout:Upgraded: 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.485 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout:Installed: 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.486 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.487 INFO:teuthology.orchestra.run.smithi104.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T02:53:52.488 INFO:teuthology.orchestra.run.smithi104.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T02:53:52.489 INFO:teuthology.orchestra.run.smithi104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T02:53:52.490 INFO:teuthology.orchestra.run.smithi104.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T02:53:52.491 INFO:teuthology.orchestra.run.smithi104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T02:53:52.492 INFO:teuthology.orchestra.run.smithi104.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T02:53:52.493 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T02:53:52.494 INFO:teuthology.orchestra.run.smithi104.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T02:53:52.495 INFO:teuthology.orchestra.run.smithi104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T02:53:52.496 INFO:teuthology.orchestra.run.smithi104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T02:53:52.497 INFO:teuthology.orchestra.run.smithi104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T02:53:52.498 INFO:teuthology.orchestra.run.smithi104.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T02:53:52.498 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:53:52.498 INFO:teuthology.orchestra.run.smithi104.stdout:Complete! 2024-09-17T02:53:52.789 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T02:53:52.862 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T02:53:52.896 DEBUG:teuthology.parallel:result is None 2024-09-17T02:53:52.946 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T02:53:53.042 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T02:53:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T02:53:53.099 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T02:53:53.135 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T02:53:53.135 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T02:53:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T02:53:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T02:53:53.309 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T02:53:53.334 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T02:53:53.341 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T02:53:53.341 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T02:53:53.527 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T02:53:53.528 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T02:53:53.603 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T02:53:53.668 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T02:53:59.821 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T02:53:59.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T02:53:59.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T02:53:59.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T02:53:59.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T02:53:59.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T02:53:59.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T02:53:59.821 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T02:53:59.822 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T02:53:59.823 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T02:53:59.824 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T02:53:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T02:53:59.826 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T02:53:59.827 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T02:53:59.828 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T02:53:59.829 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T02:53:59.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T02:53:59.831 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T02:53:59.832 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T02:53:59.833 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T02:54:02.635 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T02:54:02.635 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:02.635 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T02:54:02.636 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.637 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.638 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T02:54:02.639 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T02:54:02.640 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T02:54:02.641 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T02:54:02.642 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T02:54:02.643 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T02:54:02.644 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T02:54:02.645 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T02:54:02.646 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T02:54:02.647 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T02:54:02.648 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T02:54:02.649 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T02:54:02.649 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:02.649 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-17T02:54:03.078 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:03.079 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T02:54:03.232 DEBUG:teuthology.orchestra.run.smithi104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T02:54:03.259 INFO:teuthology.orchestra.run.smithi104.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T02:54:03.260 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T02:54:03.260 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T02:54:03.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T02:54:03.404 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T02:54:03.427 INFO:teuthology.orchestra.run.smithi192.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T02:54:03.428 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T02:54:03.428 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T02:54:03.430 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T02:54:03.430 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:03.430 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T02:54:03.463 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:03.463 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T02:54:03.496 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T02:54:03.497 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:03.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T02:54:03.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T02:54:03.600 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:03.600 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T02:54:03.626 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T02:54:03.692 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T02:54:03.692 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:03.692 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T02:54:03.720 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T02:54:03.787 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:03.787 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T02:54:03.812 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T02:54:03.878 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T02:54:03.878 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:03.878 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T02:54:03.905 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T02:54:03.971 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:03.971 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T02:54:03.996 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T02:54:04.061 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T02:54:04.142 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T02:54:04.142 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /var/log/ceph 2024-09-17T02:54:04.145 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2024-09-17T02:54:04.169 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T02:54:04.169 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T02:54:04.211 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T02:54:04.235 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T02:54:04.235 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T02:54:04.277 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T02:54:04.307 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T02:54:04.307 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T02:54:04.307 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T02:54:04.308 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:04.308 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T02:54:04.355 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T02:54:04.465 DEBUG:teuthology.orchestra.run.smithi104:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T02:54:04.490 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:04.490 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T02:54:04.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T02:54:04.616 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T02:54:04.646 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T02:54:04.646 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T02:54:04.647 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908385', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCA6kX4QPuYW7rB/MWB88UUBUUw2Et2jwdcF6nG9nzSTZJ92kTkdH6Gfzzap7pXagyMDz0PEEv+FgEk8IK+KC2U=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC2Rh5E8lt29ksn+m6jkK9QPdULPziqndc6M/bPKzuXlHAAfZ2fJUUV1mVoW0T0j1oW+t/BzSZhm3RVOSzFOj+0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T02:54:04.647 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T02:54:04.650 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T02:54:04.697 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T02:54:04.704 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T02:54:04.762 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:04.762 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T02:54:04.782 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T02:54:04.783 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-09-17T02:54:04.837 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T02:54:04.837 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:54:04.837 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T02:54:04.838 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:54:04.838 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T02:54:04.838 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-17 02:53:43.723529616 +0000 2024-09-17T02:54:04.838 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 02:51:51.946366707 +0000 2024-09-17T02:54:04.838 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 02:51:51.946366707 +0000 2024-09-17T02:54:04.838 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 02:51:51.946366707 +0000 2024-09-17T02:54:04.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T02:54:04.901 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-17T02:54:04.901 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-17T02:54:04.901 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000200862 s, 2.5 MB/s 2024-09-17T02:54:04.902 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T02:54:04.958 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-17 02:53:43.724529603 +0000 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 02:51:52.270362690 +0000 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 02:51:52.270362690 +0000 2024-09-17T02:54:05.014 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 02:51:52.270362690 +0000 2024-09-17T02:54:05.015 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T02:54:05.077 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-17T02:54:05.077 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-17T02:54:05.077 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000212677 s, 2.4 MB/s 2024-09-17T02:54:05.078 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T02:54:05.134 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-09-17T02:54:05.189 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T02:54:05.190 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:54:05.190 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T02:54:05.190 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:54:05.190 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T02:54:05.190 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-17 02:53:43.724529603 +0000 2024-09-17T02:54:05.190 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 02:51:52.587358759 +0000 2024-09-17T02:54:05.190 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 02:51:52.587358759 +0000 2024-09-17T02:54:05.190 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 02:51:52.587358759 +0000 2024-09-17T02:54:05.190 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T02:54:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-17T02:54:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-17T02:54:05.253 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00019044 s, 2.7 MB/s 2024-09-17T02:54:05.254 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T02:54:05.311 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-09-17T02:54:05.367 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T02:54:05.367 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:54:05.367 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T02:54:05.367 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:54:05.367 INFO:teuthology.orchestra.run.smithi104.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T02:54:05.368 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-17 02:53:43.724529603 +0000 2024-09-17T02:54:05.368 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-17 02:51:52.931354493 +0000 2024-09-17T02:54:05.368 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-17 02:51:52.931354493 +0000 2024-09-17T02:54:05.368 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: 2024-09-17 02:51:52.931354493 +0000 2024-09-17T02:54:05.368 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T02:54:05.430 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-17T02:54:05.431 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-17T02:54:05.431 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000185528 s, 2.8 MB/s 2024-09-17T02:54:05.432 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T02:54:05.489 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:05.489 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:05.489 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T02:54:05.507 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T02:54:05.507 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-09-17T02:54:05.564 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T02:54:05.564 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:54:05.564 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T02:54:05.564 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:54:05.564 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T02:54:05.564 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-17 02:53:54.031572392 +0000 2024-09-17T02:54:05.564 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-17 02:51:54.151448792 +0000 2024-09-17T02:54:05.565 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-17 02:51:54.151448792 +0000 2024-09-17T02:54:05.565 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-17 02:51:54.151448792 +0000 2024-09-17T02:54:05.565 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T02:54:05.629 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-17T02:54:05.629 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-17T02:54:05.629 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000268036 s, 1.9 MB/s 2024-09-17T02:54:05.630 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T02:54:05.688 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-09-17T02:54:05.745 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T02:54:05.745 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:54:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-17T02:54:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:54:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T02:54:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-17 02:53:54.031572392 +0000 2024-09-17T02:54:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-17 02:51:54.492442149 +0000 2024-09-17T02:54:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-17 02:51:54.492442149 +0000 2024-09-17T02:54:05.746 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-17 02:51:54.492442149 +0000 2024-09-17T02:54:05.746 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T02:54:05.809 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-17T02:54:05.809 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-17T02:54:05.810 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000287995 s, 1.8 MB/s 2024-09-17T02:54:05.811 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T02:54:05.867 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-09-17T02:54:05.923 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T02:54:05.923 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:54:05.923 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T02:54:05.924 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:54:05.924 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T02:54:05.924 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-17 02:53:54.032572372 +0000 2024-09-17T02:54:05.924 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-17 02:51:54.828435606 +0000 2024-09-17T02:54:05.924 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-17 02:51:54.828435606 +0000 2024-09-17T02:54:05.924 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-17 02:51:54.828435606 +0000 2024-09-17T02:54:05.924 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T02:54:05.988 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-17T02:54:05.988 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-17T02:54:05.988 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000264005 s, 1.9 MB/s 2024-09-17T02:54:05.989 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T02:54:06.046 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-17 02:53:54.032572372 +0000 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-17 02:51:55.163429083 +0000 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-17 02:51:55.163429083 +0000 2024-09-17T02:54:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-17 02:51:55.163429083 +0000 2024-09-17T02:54:06.103 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T02:54:06.164 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-17T02:54:06.165 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-17T02:54:06.165 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000187766 s, 2.7 MB/s 2024-09-17T02:54:06.166 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T02:54:06.222 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:06.222 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T02:54:06.222 INFO:tasks.ceph:Generating config... 2024-09-17T02:54:06.223 INFO:tasks.ceph:[client] pid file = 2024-09-17T02:54:06.224 INFO:tasks.ceph:[client.0] debug client = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[client.1] debug client = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[client.1] debug objecter = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T02:54:06.224 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T02:54:06.224 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T02:54:06.224 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T02:54:06.224 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T02:54:06.224 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2024-09-17T02:54:06.225 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2024-09-17T02:54:06.225 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T02:54:06.225 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2024-09-17T02:54:06.226 INFO:tasks.ceph:[osd] osd mon report interval = 5 2024-09-17T02:54:06.226 INFO:tasks.ceph:[osd] osd objectstore = memstore 2024-09-17T02:54:06.226 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T02:54:06.226 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T02:54:06.284 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T02:54:06.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T02:54:06.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T02:54:06.365 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.104'), ('mon.b', '172.21.15.192'), ('mon.c', '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]')] 2024-09-17T02:54:06.366 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.104,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}} 2024-09-17T02:54:06.367 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:06.367 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T02:54:06.420 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.104 --add b 172.21.15.192 --addv c '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: generated fsid 5ed2cc55-4a25-471e-9183-b1048a1a073c 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:setting min_mon_release = quincy 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 0 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:fsid 5ed2cc55-4a25-471e-9183-b1048a1a073c 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:last_changed 2024-09-17T02:54:06.520830+0000 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:created 2024-09-17T02:54:06.520830+0000 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:min_mon_release 17 (quincy) 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:election_strategy: 1 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:0: [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon.a 2024-09-17T02:54:06.519 INFO:teuthology.orchestra.run.smithi104.stdout:1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.b 2024-09-17T02:54:06.520 INFO:teuthology.orchestra.run.smithi104.stdout:2: [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] mon.c 2024-09-17T02:54:06.520 INFO:teuthology.orchestra.run.smithi104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T02:54:06.521 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T02:54:06.536 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5ed2cc55-4a25-471e-9183-b1048a1a073c... 2024-09-17T02:54:06.537 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T02:54:06.579 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T02:54:06.619 INFO:teuthology.orchestra.run.smithi104.stdout:[global] 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: chdir = "" 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: auth supported = cephx 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: filestore xattr use omap = true 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: mon clock drift allowed = 1.000 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: osd crush chooseleaf type = 0 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: auth debug = true 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on old message = true 2024-09-17T02:54:06.620 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on bug = true 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: mon pg warn max object skew = 0 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default size = 2 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow primary affinity = true 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd allow pg remap = true 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on legacy crush tunables = false 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on crush straw calc version zero = false 2024-09-17T02:54:06.621 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on no sortbitwise = false 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on osd down out interval zero = false 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: mon warn on too few osds = false 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: mon_allow_pool_size_one = true 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: osd default data pool replay window = 5 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: mon allow pool delete = true 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.622 INFO:teuthology.orchestra.run.smithi104.stdout: mon cluster log file level = debug 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: debug asserts on shutdown = true 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: mon health detail to clog = false 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: mon host = "172.21.15.104,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: ms die on skipped message = False 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: fsid = 5ed2cc55-4a25-471e-9183-b1048a1a073c 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout:[osd] 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: osd journal size = 100 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub load threshold = 5.0 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: osd scrub max interval = 600 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: osd mclock profile = high_recovery_ops 2024-09-17T02:54:06.623 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd recover clone overlap = true 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd recovery max chunk = 1048576 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug shutdown = true 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug op order = true 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug verify stray on activate = true 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug trim objects = true 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd open classes on start = true 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug pg log writeout = true 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: osd deep scrub update digest min age = 30 2024-09-17T02:54:06.624 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: osd map max advance = 10 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: journal zero on create = true 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: filestore ondisk finisher threads = 3 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: filestore apply finisher threads = 3 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: bdev debug aio = true 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: osd debug misdirected ops = true 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore block size = 96636764160 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: bluestore fsck on mount = True 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluefs = 20 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: debug bluestore = 20 2024-09-17T02:54:06.625 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: debug osd = 20 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: debug rocksdb = 10 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: memstore device bytes = 200000000 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.9 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.8 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: osd failsafe full ratio = 1.0 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: osd mon report interval = 5 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: osd objectstore = memstore 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr] 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: debug mgr = 20 2024-09-17T02:54:06.626 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: mgr/telemetry/nag = false 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout:[mon] 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: debug ms = 1 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: debug mon = 20 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: debug paxos = 20 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: debug auth = 20 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: mon data avail warn = 5 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: mon mgr mkfs grace = 240 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:54:06.627 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd reporter subtree level = osd 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd prime pg temp = true 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: # 1m isn't quite enough 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: mon_down_mkfs_grace = 2m 2024-09-17T02:54:06.628 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: mon_warn_on_filestore_osds = false 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: mon down mkfs grace = 300 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd backfillfull ratio = 0.6 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd full ratio = 0.7 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: mon osd nearfull ratio = 0.6 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout:[client] 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: rgw cache enabled = true 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable ops log = true 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: rgw enable usage log = true 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout: pid file = "" 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.a] 2024-09-17T02:54:06.629 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.b] 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout:[mon.c] 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: debug objectcacher = 20 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: debug objecter = 20 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: debug client = 20 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: debug objectcacher = 20 2024-09-17T02:54:06.630 INFO:teuthology.orchestra.run.smithi104.stdout: debug objecter = 20 2024-09-17T02:54:06.631 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2024-09-17T02:54:06.631 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2024-09-17T02:54:06.631 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T02:54:06.631 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2024-09-17T02:54:06.631 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.631 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2024-09-17T02:54:06.631 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T02:54:06.632 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.633 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.104,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on skipped message = False 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 5ed2cc55-4a25-471e-9183-b1048a1a073c 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2024-09-17T02:54:06.634 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug trim objects = true 2024-09-17T02:54:06.635 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.636 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: memstore device bytes = 200000000 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 1.0 2024-09-17T02:54:06.637 INFO:teuthology.orchestra.run.smithi192.stdout: osd mon report interval = 5 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = memstore 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-17T02:54:06.638 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.639 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: mon down mkfs grace = 300 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull ratio = 0.6 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.7 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.6 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2024-09-17T02:54:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = "" 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2024-09-17T02:54:06.641 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2024-09-17T02:54:06.642 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2024-09-17T02:54:06.642 INFO:teuthology.orchestra.run.smithi192.stdout: debug objectcacher = 20 2024-09-17T02:54:06.642 INFO:teuthology.orchestra.run.smithi192.stdout: debug objecter = 20 2024-09-17T02:54:06.642 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2024-09-17T02:54:06.642 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2024-09-17T02:54:06.642 INFO:teuthology.orchestra.run.smithi192.stdout: debug objectcacher = 20 2024-09-17T02:54:06.642 INFO:teuthology.orchestra.run.smithi192.stdout: debug objecter = 20 2024-09-17T02:54:06.643 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T02:54:06.644 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T02:54:06.748 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T02:54:06.748 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:06.748 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T02:54:06.764 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:06.764 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T02:54:06.819 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:54:06.819 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:06.819 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T02:54:06.820 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T02:54:06.893 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:06.893 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:06.948 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:54:06.949 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:06.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T02:54:06.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T02:54:06.984 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:06.984 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:07.040 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T02:54:07.040 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T02:54:07.040 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T02:54:07.100 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T02:54:07.104 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T02:54:07.174 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T02:54:07.177 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T02:54:07.177 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T02:54:07.238 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T02:54:07.242 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T02:54:07.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T02:54:07.367 INFO:teuthology.orchestra.run.smithi104.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T02:54:07.370 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T02:54:07.395 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T02:54:07.456 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T02:54:07.459 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T02:54:07.483 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T02:54:07.584 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T02:54:07.587 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T02:54:07.612 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T02:54:07.612 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T02:54:07.664 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T02:54:07.677 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T02:54:07.728 INFO:teuthology.orchestra.run.smithi104.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T02:54:07.741 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T02:54:07.792 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T02:54:07.806 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T02:54:07.857 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T02:54:07.870 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T02:54:07.870 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T02:54:07.870 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T02:54:07.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:07.896 INFO:tasks.ceph:role: osd.0 2024-09-17T02:54:07.896 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:54:07.896 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T02:54:07.969 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:54:07.970 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:54:08.489 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-17T02:54:08.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-17T02:54:08.491 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T02:54:08.613 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T02:54:08.647 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T02:54:08.714 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:08.714 INFO:tasks.ceph:role: osd.1 2024-09-17T02:54:08.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:54:08.714 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T02:54:08.788 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:54:08.789 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:54:09.248 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-17T02:54:09.250 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-17T02:54:09.250 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T02:54:09.342 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T02:54:09.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T02:54:09.441 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:09.441 INFO:tasks.ceph:role: osd.2 2024-09-17T02:54:09.441 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:54:09.441 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T02:54:09.514 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:54:09.515 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:54:10.001 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-17T02:54:10.003 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-17T02:54:10.003 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T02:54:10.148 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T02:54:10.181 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T02:54:10.249 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:10.249 INFO:tasks.ceph:role: osd.3 2024-09-17T02:54:10.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:54:10.249 DEBUG:teuthology.orchestra.run.smithi104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T02:54:10.324 INFO:teuthology.orchestra.run.smithi104.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:54:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:54:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:54:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T02:54:10.325 INFO:teuthology.orchestra.run.smithi104.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:54:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:54:10.325 INFO:teuthology.orchestra.run.smithi104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:54:10.325 INFO:teuthology.orchestra.run.smithi104.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T02:54:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:54:10.325 INFO:teuthology.orchestra.run.smithi104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:54:10.856 INFO:teuthology.orchestra.run.smithi104.stdout:Discarding blocks...Done. 2024-09-17T02:54:10.858 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi104.front.sepia.ceph.com -o noatime 2024-09-17T02:54:10.858 DEBUG:teuthology.orchestra.run.smithi104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T02:54:10.992 DEBUG:teuthology.orchestra.run.smithi104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T02:54:11.026 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:11.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.138+0000 7f1b5cb45640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T02:54:11.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.138+0000 7f1b5cb45640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T02:54:11.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.139+0000 7f1b5cb45640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2024-09-17T02:54:11.146 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T02:54:11.172 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:11.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.270+0000 7f9d0361f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T02:54:11.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.270+0000 7f9d0361f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T02:54:11.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.271+0000 7f9d0361f640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2024-09-17T02:54:11.276 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T02:54:11.300 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:11.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.396+0000 7f8ef782e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T02:54:11.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.396+0000 7f8ef782e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T02:54:11.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.397+0000 7f8ef782e640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2024-09-17T02:54:11.402 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T02:54:11.427 DEBUG:teuthology.orchestra.run.smithi104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:11.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.525+0000 7f4ab84da640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T02:54:11.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.526+0000 7f4ab84da640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T02:54:11.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:11.526+0000 7f4ab84da640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2024-09-17T02:54:11.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T02:54:11.556 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T02:54:11.587 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:11.587 INFO:tasks.ceph:role: osd.4 2024-09-17T02:54:11.587 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:54:11.587 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:54:11.664 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:54:12.168 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-17T02:54:12.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-17T02:54:12.170 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T02:54:12.298 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T02:54:12.334 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T02:54:12.402 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:12.402 INFO:tasks.ceph:role: osd.5 2024-09-17T02:54:12.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:54:12.402 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T02:54:12.476 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:54:12.476 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:54:12.476 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:54:12.476 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T02:54:12.476 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:54:12.476 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:54:12.476 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:54:12.477 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T02:54:12.477 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:54:12.477 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:54:12.922 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-17T02:54:12.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-17T02:54:12.926 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T02:54:13.017 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T02:54:13.046 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T02:54:13.111 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:13.111 INFO:tasks.ceph:role: osd.6 2024-09-17T02:54:13.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:54:13.112 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T02:54:13.185 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:54:13.186 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:54:13.668 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-17T02:54:13.670 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-17T02:54:13.670 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T02:54:13.797 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T02:54:13.827 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T02:54:13.893 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T02:54:13.893 INFO:tasks.ceph:role: osd.7 2024-09-17T02:54:13.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:54:13.893 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T02:54:13.966 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T02:54:13.966 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T02:54:13.966 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T02:54:13.966 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T02:54:13.966 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T02:54:13.967 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-17T02:54:13.967 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T02:54:13.967 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T02:54:13.967 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T02:54:13.967 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T02:54:14.465 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-17T02:54:14.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-17T02:54:14.467 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T02:54:14.581 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T02:54:14.615 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.723+0000 7f797600d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T02:54:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.724+0000 7f797600d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T02:54:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.724+0000 7f797600d640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2024-09-17T02:54:14.732 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T02:54:14.757 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:14.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.853+0000 7fee7b216640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T02:54:14.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.853+0000 7fee7b216640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T02:54:14.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.854+0000 7fee7b216640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2024-09-17T02:54:14.860 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T02:54:14.885 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:14.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.981+0000 7f6907a0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T02:54:14.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.982+0000 7f6907a0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T02:54:14.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:14.982+0000 7f6907a0e640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2024-09-17T02:54:14.989 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T02:54:15.013 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:15.111+0000 7fd7badb2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T02:54:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:15.111+0000 7fd7badb2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T02:54:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:15.112+0000 7fd7badb2640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2024-09-17T02:54:15.117 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T02:54:15.142 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T02:54:15.143 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:15.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T02:54:15.173 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:15.173 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T02:54:15.243 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:15.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T02:54:15.311 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:15.312 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T02:54:15.378 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:15.378 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T02:54:15.445 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:15.445 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T02:54:15.512 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:15.512 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T02:54:15.576 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:15.576 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T02:54:15.603 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:15.603 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T02:54:15.668 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:15.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T02:54:15.733 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:15.733 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T02:54:15.798 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:15.798 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T02:54:15.863 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:15.863 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T02:54:15.928 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:15.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T02:54:15.993 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:15.993 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T02:54:16.010 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:16.010 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T02:54:16.067 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:16.067 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T02:54:16.082 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:16.082 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T02:54:16.138 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T02:54:16.138 DEBUG:teuthology.orchestra.run.smithi104:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T02:54:16.140 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T02:54:16.181 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.y] 2024-09-17T02:54:16.181 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw== 2024-09-17T02:54:16.181 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.a] 2024-09-17T02:54:16.181 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA== 2024-09-17T02:54:16.181 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.c] 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg== 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.0] 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ== 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.1] 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ== 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.2] 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA== 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.3] 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw== 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout:[mgr.x] 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw== 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.b] 2024-09-17T02:54:16.182 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg== 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout:[mds.d] 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog== 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.4] 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g== 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.5] 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg== 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.6] 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A== 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout:[osd.7] 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA== 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout:[client.2] 2024-09-17T02:54:16.183 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w== 2024-09-17T02:54:16.184 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2024-09-17T02:54:16.184 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg== 2024-09-17T02:54:16.184 INFO:teuthology.orchestra.run.smithi104.stdout:[client.3] 2024-09-17T02:54:16.184 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA== 2024-09-17T02:54:16.200 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw== 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA== 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg== 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ== 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ== 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA== 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2024-09-17T02:54:16.201 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw== 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw== 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg== 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog== 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g== 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg== 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A== 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2024-09-17T02:54:16.202 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA== 2024-09-17T02:54:16.203 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2024-09-17T02:54:16.203 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T02:54:16.203 INFO:teuthology.orchestra.run.smithi192.stdout:[client.2] 2024-09-17T02:54:16.203 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w== 2024-09-17T02:54:16.203 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2024-09-17T02:54:16.203 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg== 2024-09-17T02:54:16.203 INFO:teuthology.orchestra.run.smithi192.stdout:[client.3] 2024-09-17T02:54:16.203 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA== 2024-09-17T02:54:16.204 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T02:54:16.228 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T02:54:16.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:54:16.308 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:54:16.373 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:54:16.376 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:54:16.440 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.442 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.503 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.506 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.567 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.569 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.630 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.632 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.693 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T02:54:16.696 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T02:54:16.757 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:54:16.759 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:54:16.823 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:54:16.825 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T02:54:16.889 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.892 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.953 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:16.955 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:17.016 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:17.019 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:17.081 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:17.084 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T02:54:17.145 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:54:17.148 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:54:17.212 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:54:17.216 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:54:17.281 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:54:17.283 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:54:17.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:54:17.349 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T02:54:17.413 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T02:54:17.414 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T02:54:17.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T02:54:17.546 DEBUG:teuthology.orchestra.run.smithi104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T02:54:17.570 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T02:54:17.596 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T02:54:17.703 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T02:54:17.729 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T02:54:17.793 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T02:54:17.901 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T02:54:17.926 DEBUG:teuthology.orchestra.run.smithi104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:17.928 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T02:54:17.981 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T02:54:17.981 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T02:54:17.981 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T02:54:17.983 INFO:tasks.ceph.mon.a:Started 2024-09-17T02:54:17.983 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T02:54:17.983 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T02:54:18.023 INFO:tasks.ceph.mon.b:Started 2024-09-17T02:54:18.023 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T02:54:18.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T02:54:18.026 INFO:tasks.ceph.mon.c:Started 2024-09-17T02:54:18.026 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T02:54:18.026 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T02:54:18.026 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T02:54:18.028 INFO:tasks.ceph.mgr.y:Started 2024-09-17T02:54:18.028 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T02:54:18.028 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T02:54:18.030 INFO:tasks.ceph.mgr.x:Started 2024-09-17T02:54:18.031 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T02:54:18.031 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T02:54:18.033 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T02:54:18.033 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T02:54:18.077 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T02:54:18.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T02:54:18.120 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T02:54:18.120 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T02:54:18.163 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T02:54:18.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T02:54:18.206 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T02:54:18.207 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T02:54:18.249 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T02:54:18.249 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T02:54:18.294 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T02:54:18.294 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T02:54:18.337 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T02:54:18.337 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T02:54:18.380 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T02:54:18.380 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T02:54:18.423 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T02:54:18.423 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T02:54:18.467 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T02:54:18.467 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T02:54:18.511 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T02:54:18.511 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T02:54:18.554 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T02:54:18.554 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T02:54:18.597 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T02:54:18.598 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T02:54:18.640 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T02:54:18.640 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T02:54:18.683 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T02:54:18.683 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T02:54:18.727 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T02:54:18.727 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T02:54:18.770 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T02:54:18.770 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T02:54:18.813 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T02:54:18.814 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T02:54:18.856 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T02:54:18.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T02:54:18.899 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T02:54:18.899 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T02:54:18.943 DEBUG:tasks.ceph:set 22 configs 2024-09-17T02:54:18.943 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi104') 2024-09-17T02:54:23.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.691+0000 7f561babe640 1 -- 172.21.15.104:0/2160576110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5614152ce0 msgr2=0x7f561415e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:23.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.691+0000 7f561babe640 1 --2- 172.21.15.104:0/2160576110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5614152ce0 0x7f561415e250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f560000e0c0 tx=0x7f560c004a40 comp rx=0 tx=0).stop 2024-09-17T02:54:23.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.691+0000 7f561babe640 1 -- 172.21.15.104:0/2160576110 shutdown_connections 2024-09-17T02:54:23.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.691+0000 7f561babe640 1 --2- 172.21.15.104:0/2160576110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5600004e60 0x7f56141f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.691+0000 7f561babe640 1 --2- 172.21.15.104:0/2160576110 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5614152ce0 0x7f561415e250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.691+0000 7f561babe640 1 --2- 172.21.15.104:0/2160576110 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5600003a00 0x7f5614158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.691+0000 7f561babe640 1 -- 172.21.15.104:0/2160576110 >> 172.21.15.104:0/2160576110 conn(0x7f56140b3640 msgr2=0x7f561415abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:23.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.692+0000 7f561babe640 1 -- 172.21.15.104:0/2160576110 shutdown_connections 2024-09-17T02:54:23.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.692+0000 7f561babe640 1 -- 172.21.15.104:0/2160576110 wait complete. 2024-09-17T02:54:23.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.696+0000 7f0738ff9640 1 -- 172.21.15.104:0/3064274391 <== mon.2 v2:172.21.15.192:3301/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f0734018040 con 0x7f07240099b0 2024-09-17T02:54:23.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 -- 172.21.15.104:0/3064274391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07240099b0 msgr2=0x7f073c0d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:23.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 --2- 172.21.15.104:0/3064274391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07240099b0 0x7f073c0d1760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f073c0b1560 tx=0x7f0734011d90 comp rx=0 tx=0).stop 2024-09-17T02:54:23.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 -- 172.21.15.104:0/3064274391 shutdown_connections 2024-09-17T02:54:23.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 --2- 172.21.15.104:0/3064274391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07240099b0 0x7f073c0d1760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 --2- 172.21.15.104:0/3064274391 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0724004800 0x7f073c1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 --2- 172.21.15.104:0/3064274391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0724003a50 0x7f073c0b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 -- 172.21.15.104:0/3064274391 >> 172.21.15.104:0/3064274391 conn(0x7f073c0b3640 msgr2=0x7f073c155bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:23.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 -- 172.21.15.104:0/3064274391 shutdown_connections 2024-09-17T02:54:23.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.698+0000 7f07428de640 1 -- 172.21.15.104:0/3064274391 wait complete. 2024-09-17T02:54:23.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.700+0000 7f6133fff640 1 -- 172.21.15.104:0/4007945766 <== mon.1 v2:172.21.15.192:3300/0 10 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7f6144046c90 con 0x7f614c156720 2024-09-17T02:54:23.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 -- 172.21.15.104:0/4007945766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c156720 msgr2=0x7f614c156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 --2- 172.21.15.104:0/4007945766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c156720 0x7f614c156b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6138007310 tx=0x7f6144004a40 comp rx=0 tx=0).stop 2024-09-17T02:54:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 -- 172.21.15.104:0/4007945766 shutdown_connections 2024-09-17T02:54:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 --2- 172.21.15.104:0/4007945766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c156720 0x7f614c156b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 --2- 172.21.15.104:0/4007945766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6134004800 0x7f614c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 --2- 172.21.15.104:0/4007945766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6134003a00 0x7f614c13d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 -- 172.21.15.104:0/4007945766 >> 172.21.15.104:0/4007945766 conn(0x7f614c0b3640 msgr2=0x7f614c15c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 -- 172.21.15.104:0/4007945766 shutdown_connections 2024-09-17T02:54:23.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.702+0000 7f6152216640 1 -- 172.21.15.104:0/4007945766 wait complete. 2024-09-17T02:54:23.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.711+0000 7f6fe17fa640 1 -- 172.21.15.104:0/395809033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f6fd40050e0 con 0x7f6fe8006240 2024-09-17T02:54:23.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.715+0000 7f6fe37fe640 1 -- 172.21.15.104:0/395809033 <== mon.1 v2:172.21.15.192:3300/0 10 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f6fec02a020 con 0x7f6fe8006240 2024-09-17T02:54:23.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 -- 172.21.15.104:0/395809033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fe8006240 msgr2=0x7f6ffc1e8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:23.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 --2- 172.21.15.104:0/395809033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fe8006240 0x7f6ffc1e8640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6fec004e80 tx=0x7f6fec0127b0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 -- 172.21.15.104:0/395809033 shutdown_connections 2024-09-17T02:54:23.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 --2- 172.21.15.104:0/395809033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ffc201e80 0x7f6ffc202290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 --2- 172.21.15.104:0/395809033 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ffc155f40 0x7f6ffc1e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 --2- 172.21.15.104:0/395809033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fe8006240 0x7f6ffc1e8640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:23.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 -- 172.21.15.104:0/395809033 >> 172.21.15.104:0/395809033 conn(0x7f6ffc0b3440 msgr2=0x7f6ffc0b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:23.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 -- 172.21.15.104:0/395809033 shutdown_connections 2024-09-17T02:54:23.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:23.716+0000 7f6fe17fa640 1 -- 172.21.15.104:0/395809033 wait complete. 2024-09-17T02:54:24.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.154+0000 7f7d85b57640 1 -- 172.21.15.104:0/209532794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 msgr2=0x7f7d6c006f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.154+0000 7f7d85b57640 1 --2- 172.21.15.104:0/209532794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 0x7f7d6c006f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d74006fd0 tx=0x7f7d7402b920 comp rx=0 tx=0).stop 2024-09-17T02:54:24.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.154+0000 7f7d85b57640 1 -- 172.21.15.104:0/209532794 shutdown_connections 2024-09-17T02:54:24.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.154+0000 7f7d85b57640 1 --2- 172.21.15.104:0/209532794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 0x7f7d6c006f90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.154+0000 7f7d85b57640 1 --2- 172.21.15.104:0/209532794 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6c003bb0 0x7f7d6c006620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.154+0000 7f7d85b57640 1 -- 172.21.15.104:0/209532794 >> 172.21.15.104:0/209532794 conn(0x7f7d800b3440 msgr2=0x7f7d8006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.154+0000 7f7d85b57640 1 -- 172.21.15.104:0/209532794 shutdown_connections 2024-09-17T02:54:24.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.154+0000 7f7d85b57640 1 -- 172.21.15.104:0/209532794 wait complete. 2024-09-17T02:54:24.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.156+0000 7f7d85b57640 1 Processor -- start 2024-09-17T02:54:24.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.156+0000 7f7d85b57640 1 -- start start 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d85b57640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6c003bb0 0x7f7d80144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d85b57640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 0x7f7d80146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d85b57640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d6c007650 0x7f7d80147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d85b57640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8015f440 con 0x7f7d6c006b60 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d85b57640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8015f2c0 con 0x7f7d6c007650 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d85b57640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8015f5c0 con 0x7f7d6c003bb0 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 0x7f7d80146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 0x7f7d80146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36552/0 (socket says 172.21.15.104:36552) 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 -- 172.21.15.104:0/3837904604 learned_addr learned my addr 172.21.15.104:0/3837904604 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7f7fe640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6c003bb0 0x7f7d80144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7ffff640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d6c007650 0x7f7d80147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 -- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6c003bb0 msgr2=0x7f7d80144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6c003bb0 0x7f7d80144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 -- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d6c007650 msgr2=0x7f7d80147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d6c007650 0x7f7d80147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 -- 172.21.15.104:0/3837904604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d80157ff0 con 0x7f7d6c006b60 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7f7fe640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6c003bb0 0x7f7d80144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.158+0000 7f7d7effd640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 0x7f7d80146ac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d80072800 tx=0x7f7d74034da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.159+0000 7f7d67fff640 1 -- 172.21.15.104:0/3837904604 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74003800 con 0x7f7d6c006b60 2024-09-17T02:54:24.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.159+0000 7f7d67fff640 1 -- 172.21.15.104:0/3837904604 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f7d740039a0 con 0x7f7d6c006b60 2024-09-17T02:54:24.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.159+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d800ca6e0 con 0x7f7d6c006b60 2024-09-17T02:54:24.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.159+0000 7f7d67fff640 1 -- 172.21.15.104:0/3837904604 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74003d70 con 0x7f7d6c006b60 2024-09-17T02:54:24.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.159+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d800ca9c0 con 0x7f7d6c006b60 2024-09-17T02:54:24.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.159+0000 7f7d67fff640 1 -- 172.21.15.104:0/3837904604 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d7403c040 con 0x7f7d6c006b60 2024-09-17T02:54:24.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.159+0000 7f7d67fff640 1 -- 172.21.15.104:0/3837904604 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7d7403eda0 con 0x7f7d6c006b60 2024-09-17T02:54:24.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.160+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8006f7f0 con 0x7f7d6c006b60 2024-09-17T02:54:24.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.162+0000 7f7d67fff640 1 -- 172.21.15.104:0/3837904604 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7d7404d070 con 0x7f7d6c006b60 2024-09-17T02:54:24.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.222+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f7d80070070 con 0x7f7d6c006b60 2024-09-17T02:54:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.224+0000 7f7d67fff640 1 -- 172.21.15.104:0/3837904604 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f7d74044030 con 0x7f7d6c006b60 2024-09-17T02:54:24.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.225+0000 7f7d67fff640 1 -- 172.21.15.104:0/3837904604 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7d74034640 con 0x7f7d6c006b60 2024-09-17T02:54:24.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 msgr2=0x7f7d80146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 0x7f7d80146ac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d80072800 tx=0x7f7d74034da0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 shutdown_connections 2024-09-17T02:54:24.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d6c007650 0x7f7d80147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d6c006b60 0x7f7d80146ac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 --2- 172.21.15.104:0/3837904604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6c003bb0 0x7f7d80144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 >> 172.21.15.104:0/3837904604 conn(0x7f7d800b3440 msgr2=0x7f7d80154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 shutdown_connections 2024-09-17T02:54:24.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.227+0000 7f7d85b57640 1 -- 172.21.15.104:0/3837904604 wait complete. 2024-09-17T02:54:24.236 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.237 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.237 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.279+0000 7fc7eb269640 1 -- 172.21.15.104:0/3301801081 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 msgr2=0x7fc7c800d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.279+0000 7fc7eb269640 1 --2- 172.21.15.104:0/3301801081 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 0x7fc7c800d6a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4160760 tx=0x7fc7dc02a5a0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.280+0000 7fc7eb269640 1 -- 172.21.15.104:0/3301801081 shutdown_connections 2024-09-17T02:54:24.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.280+0000 7fc7eb269640 1 --2- 172.21.15.104:0/3301801081 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 0x7fc7c800d6a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.280+0000 7fc7eb269640 1 --2- 172.21.15.104:0/3301801081 >> v2:172.21.15.192:3300/0 conn(0x7fc7c8003ba0 0x7fc7c8006700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.280+0000 7fc7eb269640 1 -- 172.21.15.104:0/3301801081 >> 172.21.15.104:0/3301801081 conn(0x7fc7e40b35d0 msgr2=0x7fc7e40b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.280+0000 7fc7eb269640 1 -- 172.21.15.104:0/3301801081 shutdown_connections 2024-09-17T02:54:24.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.280+0000 7fc7eb269640 1 -- 172.21.15.104:0/3301801081 wait complete. 2024-09-17T02:54:24.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.283+0000 7fc7eb269640 1 Processor -- start 2024-09-17T02:54:24.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.283+0000 7fc7eb269640 1 -- start start 2024-09-17T02:54:24.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7eb269640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7c8003ba0 0x7fc7e41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7eb269640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7c8006c40 0x7fc7e40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7eb269640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 0x7fc7e41531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7eb269640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e40b5200 con 0x7fc7c800b280 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7eb269640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e415c790 con 0x7fc7c8006c40 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7eb269640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e40b5380 con 0x7fc7c8003ba0 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9806640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 0x7fc7e41531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9806640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 0x7fc7e41531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36570/0 (socket says 172.21.15.104:36570) 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9806640 1 -- 172.21.15.104:0/2837374492 learned_addr learned my addr 172.21.15.104:0/2837374492 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e8804640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7c8006c40 0x7fc7e40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9005640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7c8003ba0 0x7fc7e41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9806640 1 -- 172.21.15.104:0/2837374492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7c8003ba0 msgr2=0x7fc7e41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9806640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7c8003ba0 0x7fc7e41412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9806640 1 -- 172.21.15.104:0/2837374492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7c8006c40 msgr2=0x7fc7e40cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9806640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7c8006c40 0x7fc7e40cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.285+0000 7fc7e9806640 1 -- 172.21.15.104:0/2837374492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e41f2b30 con 0x7fc7c800b280 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.286+0000 7fc7e9806640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 0x7fc7e41531d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4073010 tx=0x7fc7dc006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.286+0000 7fc7d9ffb640 1 -- 172.21.15.104:0/2837374492 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc003c70 con 0x7fc7c800b280 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.286+0000 7fc7d9ffb640 1 -- 172.21.15.104:0/2837374492 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fc7dc044070 con 0x7fc7c800b280 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.286+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e41f2e10 con 0x7fc7c800b280 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.286+0000 7fc7d9ffb640 1 -- 172.21.15.104:0/2837374492 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0336e0 con 0x7fc7c800b280 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.286+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41f33d0 con 0x7fc7c800b280 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.286+0000 7fc7d9ffb640 1 -- 172.21.15.104:0/2837374492 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc7dc03a040 con 0x7fc7c800b280 2024-09-17T02:54:24.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.286+0000 7fc7d9ffb640 1 -- 172.21.15.104:0/2837374492 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc7dc049610 con 0x7fc7c800b280 2024-09-17T02:54:24.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.287+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e40d08e0 con 0x7fc7c800b280 2024-09-17T02:54:24.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.289+0000 7fc7d9ffb640 1 -- 172.21.15.104:0/2837374492 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc7dc033880 con 0x7fc7c800b280 2024-09-17T02:54:24.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.359+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fc7e40b6120 con 0x7fc7c800b280 2024-09-17T02:54:24.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.361+0000 7fc7d9ffb640 1 -- 172.21.15.104:0/2837374492 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 123+0+0 (secure 0 0 0) 0x7fc7dc033a60 con 0x7fc7c800b280 2024-09-17T02:54:24.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.362+0000 7fc7d9ffb640 1 -- 172.21.15.104:0/2837374492 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7dc003e10 con 0x7fc7c800b280 2024-09-17T02:54:24.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 msgr2=0x7fc7e41531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 0x7fc7e41531d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4073010 tx=0x7fc7dc006290 comp rx=0 tx=0).stop 2024-09-17T02:54:24.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 shutdown_connections 2024-09-17T02:54:24.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7c8006c40 0x7fc7e40cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7c800b280 0x7fc7e41531d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 --2- 172.21.15.104:0/2837374492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7c8003ba0 0x7fc7e41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 >> 172.21.15.104:0/2837374492 conn(0x7fc7e40b35d0 msgr2=0x7fc7e414ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 shutdown_connections 2024-09-17T02:54:24.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.363+0000 7fc7eb269640 1 -- 172.21.15.104:0/2837374492 wait complete. 2024-09-17T02:54:24.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.367+0000 7f3170630640 1 -- 172.21.15.104:0/4221495351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 msgr2=0x7f314c007020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.367+0000 7f3170630640 1 --2- 172.21.15.104:0/4221495351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 0x7f314c007020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31680d1000 tx=0x7f315802b900 comp rx=0 tx=0).stop 2024-09-17T02:54:24.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.367+0000 7f3170630640 1 -- 172.21.15.104:0/4221495351 shutdown_connections 2024-09-17T02:54:24.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.367+0000 7f3170630640 1 --2- 172.21.15.104:0/4221495351 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 0x7f314c007020 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.367+0000 7f3170630640 1 --2- 172.21.15.104:0/4221495351 >> v2:172.21.15.192:3300/0 conn(0x7f314c003b80 0x7f314c006650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.367+0000 7f3170630640 1 -- 172.21.15.104:0/4221495351 >> 172.21.15.104:0/4221495351 conn(0x7f31680b3440 msgr2=0x7f316806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.367+0000 7f3170630640 1 -- 172.21.15.104:0/4221495351 shutdown_connections 2024-09-17T02:54:24.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.367+0000 7f3170630640 1 -- 172.21.15.104:0/4221495351 wait complete. 2024-09-17T02:54:24.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.369+0000 7f3170630640 1 Processor -- start 2024-09-17T02:54:24.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.369+0000 7f3170630640 1 -- start start 2024-09-17T02:54:24.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f3170630640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f314c003b80 0x7f3168156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f3170630640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 0x7f3168151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f3170630640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f314c007710 0x7f31680ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f3170630640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f316815f440 con 0x7f314c006b90 2024-09-17T02:54:24.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f3170630640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f316815f2c0 con 0x7f314c003b80 2024-09-17T02:54:24.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f3170630640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f316815f5c0 con 0x7f314c007710 2024-09-17T02:54:24.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f316dbcb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 0x7f3168151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f316e3cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f314c003b80 0x7f3168156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f316dbcb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 0x7f3168151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36588/0 (socket says 172.21.15.104:36588) 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f316dbcb640 1 -- 172.21.15.104:0/1749702237 learned_addr learned my addr 172.21.15.104:0/1749702237 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.370+0000 7f316ebcd640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f314c007710 0x7f31680ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f316e3cc640 1 -- 172.21.15.104:0/1749702237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f314c007710 msgr2=0x7f31680ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f316e3cc640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f314c007710 0x7f31680ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f316e3cc640 1 -- 172.21.15.104:0/1749702237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 msgr2=0x7f3168151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f316e3cc640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 0x7f3168151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f316e3cc640 1 -- 172.21.15.104:0/1749702237 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31681574d0 con 0x7f314c003b80 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f316dbcb640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 0x7f3168151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f316e3cc640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f314c003b80 0x7f3168156f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f314c008f90 tx=0x7f3164011fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f315effd640 1 -- 172.21.15.104:0/1749702237 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164022030 con 0x7f314c003b80 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f315effd640 1 -- 172.21.15.104:0/1749702237 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3164010d10 con 0x7f314c003b80 2024-09-17T02:54:24.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f315effd640 1 -- 172.21.15.104:0/1749702237 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164005020 con 0x7f314c003b80 2024-09-17T02:54:24.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31681579e0 con 0x7f314c003b80 2024-09-17T02:54:24.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3168157fa0 con 0x7f314c003b80 2024-09-17T02:54:24.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f315effd640 1 -- 172.21.15.104:0/1749702237 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3164025070 con 0x7f314c003b80 2024-09-17T02:54:24.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.371+0000 7f315effd640 1 -- 172.21.15.104:0/1749702237 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3164027750 con 0x7f314c003b80 2024-09-17T02:54:24.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.372+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316806f8d0 con 0x7f314c003b80 2024-09-17T02:54:24.373 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.374 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.375+0000 7f315effd640 1 -- 172.21.15.104:0/1749702237 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f31640047a0 con 0x7f314c003b80 2024-09-17T02:54:24.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.434+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f31680b4df0 con 0x7f314c003b80 2024-09-17T02:54:24.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.440+0000 7f315effd640 1 -- 172.21.15.104:0/1749702237 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7f3164004980 con 0x7f314c003b80 2024-09-17T02:54:24.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.440+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f314c003b80 msgr2=0x7f3168156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.440+0000 7f3170630640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f314c003b80 0x7f3168156f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f314c008f90 tx=0x7f3164011fa0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.441+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 shutdown_connections 2024-09-17T02:54:24.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.441+0000 7f3170630640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f314c007710 0x7f31680ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.441+0000 7f3170630640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f314c006b90 0x7f3168151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.441+0000 7f3170630640 1 --2- 172.21.15.104:0/1749702237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f314c003b80 0x7f3168156f90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.441+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 >> 172.21.15.104:0/1749702237 conn(0x7f31680b3440 msgr2=0x7f31681549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.441+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 shutdown_connections 2024-09-17T02:54:24.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.441+0000 7f3170630640 1 -- 172.21.15.104:0/1749702237 wait complete. 2024-09-17T02:54:24.449 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.450 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.450 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.450 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.539+0000 7f6649a7e640 1 -- 172.21.15.104:0/3981888029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 msgr2=0x7f662c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.539+0000 7f6649a7e640 1 --2- 172.21.15.104:0/3981888029 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 0x7f662c004c10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f66440b6800 tx=0x7f662c005830 comp rx=0 tx=0).stop 2024-09-17T02:54:24.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.539+0000 7f6643fff640 1 -- 172.21.15.104:0/3981888029 reap_dead start 2024-09-17T02:54:24.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.540+0000 7f6649a7e640 1 -- 172.21.15.104:0/3981888029 shutdown_connections 2024-09-17T02:54:24.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.540+0000 7f6649a7e640 1 -- 172.21.15.104:0/3981888029 >> 172.21.15.104:0/3981888029 conn(0x7f66440b3440 msgr2=0x7f664406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.540+0000 7f6649a7e640 1 -- 172.21.15.104:0/3981888029 shutdown_connections 2024-09-17T02:54:24.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.540+0000 7f6649a7e640 1 -- 172.21.15.104:0/3981888029 wait complete. 2024-09-17T02:54:24.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.541+0000 7f6649a7e640 1 Processor -- start 2024-09-17T02:54:24.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.542+0000 7f6649a7e640 1 -- start start 2024-09-17T02:54:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f6649a7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 0x7f66440c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f6649a7e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6644141440 0x7f66441f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f6649a7e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66441f55e0 0x7f6644136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f6649a7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f664406f970 con 0x7f662c004800 2024-09-17T02:54:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f6649a7e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f664406f7f0 con 0x7f6644141440 2024-09-17T02:54:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f6649a7e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f664406faf0 con 0x7f66441f55e0 2024-09-17T02:54:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f66437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 0x7f66440c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f66437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 0x7f66440c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36598/0 (socket says 172.21.15.104:36598) 2024-09-17T02:54:24.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f66437fe640 1 -- 172.21.15.104:0/504613352 learned_addr learned my addr 172.21.15.104:0/504613352 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:24.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f6642ffd640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6644141440 0x7f66441f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f6643fff640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66441f55e0 0x7f6644136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f66437fe640 1 -- 172.21.15.104:0/504613352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66441f55e0 msgr2=0x7f6644136fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f66437fe640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66441f55e0 0x7f6644136fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f66437fe640 1 -- 172.21.15.104:0/504613352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6644141440 msgr2=0x7f66441f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f66437fe640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6644141440 0x7f66441f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.543+0000 7f66437fe640 1 -- 172.21.15.104:0/504613352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66441f59f0 con 0x7f662c004800 2024-09-17T02:54:24.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.544+0000 7f66437fe640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 0x7f66440c70d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6634011bd0 tx=0x7f6634011fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:24.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.544+0000 7f662bfff640 1 -- 172.21.15.104:0/504613352 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634024020 con 0x7f662c004800 2024-09-17T02:54:24.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.544+0000 7f662bfff640 1 -- 172.21.15.104:0/504613352 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6634012a00 con 0x7f662c004800 2024-09-17T02:54:24.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.544+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66440c7ab0 con 0x7f662c004800 2024-09-17T02:54:24.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.544+0000 7f662bfff640 1 -- 172.21.15.104:0/504613352 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634012dd0 con 0x7f662c004800 2024-09-17T02:54:24.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.544+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66440c8070 con 0x7f662c004800 2024-09-17T02:54:24.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.544+0000 7f662bfff640 1 -- 172.21.15.104:0/504613352 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6634027020 con 0x7f662c004800 2024-09-17T02:54:24.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.544+0000 7f662bfff640 1 -- 172.21.15.104:0/504613352 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f66340146c0 con 0x7f662c004800 2024-09-17T02:54:24.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.545+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66441601d0 con 0x7f662c004800 2024-09-17T02:54:24.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.547+0000 7f662bfff640 1 -- 172.21.15.104:0/504613352 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f663402e020 con 0x7f662c004800 2024-09-17T02:54:24.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.583+0000 7f2ed3582640 1 -- 172.21.15.104:0/2248889679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eb0006600 msgr2=0x7f2eb0003af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.583+0000 7f2ed3582640 1 --2- 172.21.15.104:0/2248889679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eb0006600 0x7f2eb0003af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8006fd0 tx=0x7f2ec802b990 comp rx=0 tx=0).stop 2024-09-17T02:54:24.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.583+0000 7f2ed3582640 1 -- 172.21.15.104:0/2248889679 shutdown_connections 2024-09-17T02:54:24.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.583+0000 7f2ed3582640 1 --2- 172.21.15.104:0/2248889679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eb0006600 0x7f2eb0003af0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.583+0000 7f2ed3582640 1 -- 172.21.15.104:0/2248889679 >> 172.21.15.104:0/2248889679 conn(0x7f2ecc073df0 msgr2=0x7f2ecc068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.583+0000 7f2ed3582640 1 -- 172.21.15.104:0/2248889679 shutdown_connections 2024-09-17T02:54:24.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.583+0000 7f2ed3582640 1 -- 172.21.15.104:0/2248889679 wait complete. 2024-09-17T02:54:24.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.585+0000 7f2ed3582640 1 Processor -- start 2024-09-17T02:54:24.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.585+0000 7f2ed3582640 1 -- start start 2024-09-17T02:54:24.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.586+0000 7f2ed3582640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2eb0004030 0x7f2ecc0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.586+0000 7f2ed3582640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eb0005cf0 0x7f2ecc0caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed3582640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eb0006600 0x7f2ecc0b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed3582640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc15f4e0 con 0x7f2eb0004030 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed3582640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc15f360 con 0x7f2eb0005cf0 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed3582640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc0d11d0 con 0x7f2eb0006600 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2eb0004030 0x7f2ecc0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2eb0004030 0x7f2ecc0b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36604/0 (socket says 172.21.15.104:36604) 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 -- 172.21.15.104:0/4231979895 learned_addr learned my addr 172.21.15.104:0/4231979895 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed0b1d640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eb0005cf0 0x7f2ecc0caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed1b1f640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eb0006600 0x7f2ecc0b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 -- 172.21.15.104:0/4231979895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eb0006600 msgr2=0x7f2ecc0b94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eb0006600 0x7f2ecc0b94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 -- 172.21.15.104:0/4231979895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eb0005cf0 msgr2=0x7f2ecc0caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eb0005cf0 0x7f2ecc0caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 -- 172.21.15.104:0/4231979895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc0cbf00 con 0x7f2eb0004030 2024-09-17T02:54:24.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed131e640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2eb0004030 0x7f2ecc0b2ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8006750 tx=0x7f2ec8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:24.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ec1ffb640 1 -- 172.21.15.104:0/4231979895 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80347e0 con 0x7f2eb0004030 2024-09-17T02:54:24.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ec1ffb640 1 -- 172.21.15.104:0/4231979895 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ec8034980 con 0x7f2eb0004030 2024-09-17T02:54:24.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc0cc1e0 con 0x7f2eb0004030 2024-09-17T02:54:24.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.587+0000 7f2ec1ffb640 1 -- 172.21.15.104:0/4231979895 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8034d70 con 0x7f2eb0004030 2024-09-17T02:54:24.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.588+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc0cc7a0 con 0x7f2eb0004030 2024-09-17T02:54:24.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.588+0000 7f2ec1ffb640 1 -- 172.21.15.104:0/4231979895 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ec803c040 con 0x7f2eb0004030 2024-09-17T02:54:24.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.588+0000 7f2ec1ffb640 1 -- 172.21.15.104:0/4231979895 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2ec80483f0 con 0x7f2eb0004030 2024-09-17T02:54:24.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.589+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ecc0cf920 con 0x7f2eb0004030 2024-09-17T02:54:24.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.591+0000 7f2ec1ffb640 1 -- 172.21.15.104:0/4231979895 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2ec804d030 con 0x7f2eb0004030 2024-09-17T02:54:24.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.609+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f664406efb0 con 0x7f662c004800 2024-09-17T02:54:24.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.614+0000 7f662bfff640 1 -- 172.21.15.104:0/504613352 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v21)=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7f66441f59f0 con 0x7f662c004800 2024-09-17T02:54:24.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.615+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 msgr2=0x7f66440c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.615+0000 7f6649a7e640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 0x7f66440c70d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6634011bd0 tx=0x7f6634011fd0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.615+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 shutdown_connections 2024-09-17T02:54:24.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.615+0000 7f6649a7e640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6644141440 0x7f66441f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.615+0000 7f6649a7e640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66441f55e0 0x7f6644136fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.615+0000 7f6649a7e640 1 --2- 172.21.15.104:0/504613352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f662c004800 0x7f66440c70d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.615+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 >> 172.21.15.104:0/504613352 conn(0x7f66440b3440 msgr2=0x7f6644144f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.616+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 shutdown_connections 2024-09-17T02:54:24.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.616+0000 7f6649a7e640 1 -- 172.21.15.104:0/504613352 wait complete. 2024-09-17T02:54:24.625 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.653+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f2ecc068da0 con 0x7f2eb0004030 2024-09-17T02:54:24.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.658+0000 7f2ec1ffb640 1 -- 172.21.15.104:0/4231979895 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f2ec8044030 con 0x7f2eb0004030 2024-09-17T02:54:24.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2eb0004030 msgr2=0x7f2ecc0b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2eb0004030 0x7f2ecc0b2ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8006750 tx=0x7f2ec8003b90 comp rx=0 tx=0).stop 2024-09-17T02:54:24.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 shutdown_connections 2024-09-17T02:54:24.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eb0005cf0 0x7f2ecc0caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2eb0006600 0x7f2ecc0b94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 --2- 172.21.15.104:0/4231979895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2eb0004030 0x7f2ecc0b2ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 >> 172.21.15.104:0/4231979895 conn(0x7f2ecc073df0 msgr2=0x7f2ecc0b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 shutdown_connections 2024-09-17T02:54:24.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.659+0000 7f2ed3582640 1 -- 172.21.15.104:0/4231979895 wait complete. 2024-09-17T02:54:24.668 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.669 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.669 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.669 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.669 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.669 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.669 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.893+0000 7f5d9c069640 1 -- 172.21.15.104:0/2553770262 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78006600 msgr2=0x7f5d78003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.893+0000 7f5d9c069640 1 --2- 172.21.15.104:0/2553770262 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78006600 0x7f5d78003b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5d90006fd0 tx=0x7f5d9002b9f0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.893+0000 7f5d9c069640 1 -- 172.21.15.104:0/2553770262 shutdown_connections 2024-09-17T02:54:24.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.893+0000 7f5d9c069640 1 --2- 172.21.15.104:0/2553770262 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78006600 0x7f5d78003b20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.893+0000 7f5d9c069640 1 -- 172.21.15.104:0/2553770262 >> 172.21.15.104:0/2553770262 conn(0x7f5d94073df0 msgr2=0x7f5d94068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.893+0000 7f5d9c069640 1 -- 172.21.15.104:0/2553770262 shutdown_connections 2024-09-17T02:54:24.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.893+0000 7f5d9c069640 1 -- 172.21.15.104:0/2553770262 wait complete. 2024-09-17T02:54:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.895+0000 7f5d9c069640 1 Processor -- start 2024-09-17T02:54:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.895+0000 7f5d9c069640 1 -- start start 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9c069640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78004060 0x7f5d940c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9c069640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d78005d10 0x7f5d9415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9c069640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d78006600 0x7f5d94158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9c069640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9415f4e0 con 0x7f5d78004060 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9c069640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9415f360 con 0x7f5d78006600 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9c069640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5d940d11d0 con 0x7f5d78005d10 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78004060 0x7f5d940c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78004060 0x7f5d940c95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36614/0 (socket says 172.21.15.104:36614) 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 -- 172.21.15.104:0/2784265355 learned_addr learned my addr 172.21.15.104:0/2784265355 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99604640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d78005d10 0x7f5d9415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9a606640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d78006600 0x7f5d94158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 -- 172.21.15.104:0/2784265355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d78005d10 msgr2=0x7f5d9415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d78005d10 0x7f5d9415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 -- 172.21.15.104:0/2784265355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d78006600 msgr2=0x7f5d94158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d78006600 0x7f5d94158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 -- 172.21.15.104:0/2784265355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d941f6930 con 0x7f5d78004060 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d99e05640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78004060 0x7f5d940c95d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d90006fd0 tx=0x7f5d90032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d8a7fc640 1 -- 172.21.15.104:0/2784265355 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90041070 con 0x7f5d78004060 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d8a7fc640 1 -- 172.21.15.104:0/2784265355 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d90000ed0 con 0x7f5d78004060 2024-09-17T02:54:24.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9415a4f0 con 0x7f5d78004060 2024-09-17T02:54:24.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d8a7fc640 1 -- 172.21.15.104:0/2784265355 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d90003c80 con 0x7f5d78004060 2024-09-17T02:54:24.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.897+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9415aab0 con 0x7f5d78004060 2024-09-17T02:54:24.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.898+0000 7f5d8a7fc640 1 -- 172.21.15.104:0/2784265355 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d90039020 con 0x7f5d78004060 2024-09-17T02:54:24.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.898+0000 7f5d8a7fc640 1 -- 172.21.15.104:0/2784265355 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5d9004e970 con 0x7f5d78004060 2024-09-17T02:54:24.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.898+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d940cf920 con 0x7f5d78004060 2024-09-17T02:54:24.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.900+0000 7f5d8a7fc640 1 -- 172.21.15.104:0/2784265355 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5d90003e20 con 0x7f5d78004060 2024-09-17T02:54:24.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.961+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f5d9415b930 con 0x7f5d78004060 2024-09-17T02:54:24.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.965+0000 7f5d8a7fc640 1 -- 172.21.15.104:0/2784265355 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v23)=0 v23) ==== 108+0+0 (secure 0 0 0) 0x7f5d90006d30 con 0x7f5d78004060 2024-09-17T02:54:24.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78004060 msgr2=0x7f5d940c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:24.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78004060 0x7f5d940c95d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d90006fd0 tx=0x7f5d90032cd0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 shutdown_connections 2024-09-17T02:54:24.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d78006600 0x7f5d94158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d78005d10 0x7f5d9415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 --2- 172.21.15.104:0/2784265355 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d78004060 0x7f5d940c95d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:24.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 >> 172.21.15.104:0/2784265355 conn(0x7f5d94073df0 msgr2=0x7f5d940d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:24.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 shutdown_connections 2024-09-17T02:54:24.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:24.966+0000 7f5d9c069640 1 -- 172.21.15.104:0/2784265355 wait complete. 2024-09-17T02:54:24.975 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.975 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.976 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.976 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi104') 2024-09-17T02:54:24.976 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config dump 2024-09-17T02:54:25.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 -- 172.21.15.104:0/3303703598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d13e0 msgr2=0x7fe940161400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 --2- 172.21.15.104:0/3303703598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d13e0 0x7fe940161400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe9400b5cb0 tx=0x7fe93802a970 comp rx=0 tx=0).stop 2024-09-17T02:54:25.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 -- 172.21.15.104:0/3303703598 shutdown_connections 2024-09-17T02:54:25.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 --2- 172.21.15.104:0/3303703598 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d13e0 0x7fe940161400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 --2- 172.21.15.104:0/3303703598 >> v2:172.21.15.192:3300/0 conn(0x7fe9400d0fd0 0x7fe940160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 --2- 172.21.15.104:0/3303703598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9400d3490 0x7fe9400b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 -- 172.21.15.104:0/3303703598 >> 172.21.15.104:0/3303703598 conn(0x7fe9400d2970 msgr2=0x7fe9400d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:25.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 -- 172.21.15.104:0/3303703598 shutdown_connections 2024-09-17T02:54:25.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.090+0000 7fe94750b640 1 -- 172.21.15.104:0/3303703598 wait complete. 2024-09-17T02:54:25.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.092+0000 7fe94750b640 1 Processor -- start 2024-09-17T02:54:25.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.092+0000 7fe94750b640 1 -- start start 2024-09-17T02:54:25.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.093+0000 7fe94750b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d0fd0 0x7fe9400c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.093+0000 7fe94750b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9400d13e0 0x7fe9401f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.093+0000 7fe94750b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9400d3490 0x7fe9401f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.093+0000 7fe94750b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9400b2270 con 0x7fe9400d0fd0 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.093+0000 7fe94750b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe9400b20f0 con 0x7fe9400d13e0 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.093+0000 7fe94750b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe9400b23f0 con 0x7fe9400d3490 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d0fd0 0x7fe9400c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d0fd0 0x7fe9400c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36626/0 (socket says 172.21.15.104:36626) 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 -- 172.21.15.104:0/198577578 learned_addr learned my addr 172.21.15.104:0/198577578 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe944aa6640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9400d13e0 0x7fe9401f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe945aa8640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9400d3490 0x7fe9401f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 -- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9400d3490 msgr2=0x7fe9401f7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9400d3490 0x7fe9401f7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 -- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9400d13e0 msgr2=0x7fe9401f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9400d13e0 0x7fe9401f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 -- 172.21.15.104:0/198577578 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9400c9300 con 0x7fe9400d0fd0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe944aa6640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9400d13e0 0x7fe9401f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe9452a7640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d0fd0 0x7fe9400c6260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe93000d740 tx=0x7fe93000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe935ffb640 1 -- 172.21.15.104:0/198577578 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe930017070 con 0x7fe9400d0fd0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe935ffb640 1 -- 172.21.15.104:0/198577578 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe930009d20 con 0x7fe9400d0fd0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9401f83b0 con 0x7fe9400d0fd0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.094+0000 7fe935ffb640 1 -- 172.21.15.104:0/198577578 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300106c0 con 0x7fe9400d0fd0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.095+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9400c8cd0 con 0x7fe9400d0fd0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.095+0000 7fe935ffb640 1 -- 172.21.15.104:0/198577578 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe93001a070 con 0x7fe9400d0fd0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.095+0000 7fe935ffb640 1 -- 172.21.15.104:0/198577578 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe93001cab0 con 0x7fe9400d0fd0 2024-09-17T02:54:25.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.095+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9400b7c80 con 0x7fe9400d0fd0 2024-09-17T02:54:25.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.097+0000 7fe935ffb640 1 -- 172.21.15.104:0/198577578 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe930010860 con 0x7fe9400d0fd0 2024-09-17T02:54:25.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.157+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe940153480 con 0x7fe9400d0fd0 2024-09-17T02:54:25.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.158+0000 7fe935ffb640 1 -- 172.21.15.104:0/198577578 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7fe930010a40 con 0x7fe9400d0fd0 2024-09-17T02:54:25.158 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T02:54:25.158 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T02:54:25.158 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T02:54:25.159 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T02:54:25.159 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T02:54:25.159 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T02:54:25.159 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T02:54:25.159 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T02:54:25.160 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T02:54:25.160 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T02:54:25.160 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T02:54:25.160 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T02:54:25.160 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T02:54:25.161 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T02:54:25.161 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T02:54:25.161 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T02:54:25.161 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T02:54:25.161 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T02:54:25.161 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T02:54:25.162 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T02:54:25.162 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T02:54:25.162 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T02:54:25.162 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T02:54:25.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d0fd0 msgr2=0x7fe9400c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d0fd0 0x7fe9400c6260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe93000d740 tx=0x7fe93000dc00 comp rx=0 tx=0).stop 2024-09-17T02:54:25.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 shutdown_connections 2024-09-17T02:54:25.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9400d13e0 0x7fe9401f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9400d3490 0x7fe9401f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 --2- 172.21.15.104:0/198577578 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9400d0fd0 0x7fe9400c6260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 >> 172.21.15.104:0/198577578 conn(0x7fe9400d2970 msgr2=0x7fe940071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:25.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 shutdown_connections 2024-09-17T02:54:25.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.159+0000 7fe94750b640 1 -- 172.21.15.104:0/198577578 wait complete. 2024-09-17T02:54:25.169 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T02:54:25.169 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T02:54:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.282+0000 7f655f582640 1 -- 172.21.15.104:0/2912217863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d3490 msgr2=0x7f65580b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.282+0000 7f655f582640 1 --2- 172.21.15.104:0/2912217863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d3490 0x7f65580b7c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65580d2500 tx=0x7f655402a4a0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.282+0000 7f655f582640 1 -- 172.21.15.104:0/2912217863 shutdown_connections 2024-09-17T02:54:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.282+0000 7f655f582640 1 --2- 172.21.15.104:0/2912217863 >> v2:172.21.15.192:3300/0 conn(0x7f65580d0fd0 0x7f6558160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.282+0000 7f655f582640 1 --2- 172.21.15.104:0/2912217863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d3490 0x7f65580b7c80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.282+0000 7f655f582640 1 -- 172.21.15.104:0/2912217863 >> 172.21.15.104:0/2912217863 conn(0x7f65580d2970 msgr2=0x7f65580d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.283+0000 7f655f582640 1 -- 172.21.15.104:0/2912217863 shutdown_connections 2024-09-17T02:54:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.283+0000 7f655f582640 1 -- 172.21.15.104:0/2912217863 wait complete. 2024-09-17T02:54:25.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.284+0000 7f655f582640 1 Processor -- start 2024-09-17T02:54:25.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.284+0000 7f655f582640 1 -- start start 2024-09-17T02:54:25.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655f582640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d0fd0 0x7f6558152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655f582640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65580d13e0 0x7f6558160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655f582640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65580d3490 0x7f65581610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655f582640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f65580b6bd0 con 0x7f65580d0fd0 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655f582640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65580b6a50 con 0x7f65580d13e0 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655f582640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f65580b6d50 con 0x7f65580d3490 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d0fd0 0x7f6558152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d0fd0 0x7f6558152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36652/0 (socket says 172.21.15.104:36652) 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 -- 172.21.15.104:0/253817359 learned_addr learned my addr 172.21.15.104:0/253817359 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655cb1d640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65580d13e0 0x7f6558160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655db1f640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65580d3490 0x7f65581610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 -- 172.21.15.104:0/253817359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65580d3490 msgr2=0x7f65581610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65580d3490 0x7f65581610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 -- 172.21.15.104:0/253817359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65580d13e0 msgr2=0x7f6558160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65580d13e0 0x7f6558160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 -- 172.21.15.104:0/253817359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6558152a60 con 0x7f65580d0fd0 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f655d31e640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d0fd0 0x7f6558152520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6554009780 tx=0x7f6554033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.286+0000 7f654dffb640 1 -- 172.21.15.104:0/253817359 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554031d60 con 0x7f65580d0fd0 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.287+0000 7f654dffb640 1 -- 172.21.15.104:0/253817359 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6554033e10 con 0x7f65580d0fd0 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.287+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6558159f20 con 0x7f65580d0fd0 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.287+0000 7f654dffb640 1 -- 172.21.15.104:0/253817359 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554005260 con 0x7f65580d0fd0 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.287+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6558158950 con 0x7f65580d0fd0 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.287+0000 7f654dffb640 1 -- 172.21.15.104:0/253817359 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f65540047a0 con 0x7f65580d0fd0 2024-09-17T02:54:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.287+0000 7f654dffb640 1 -- 172.21.15.104:0/253817359 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6554033470 con 0x7f65580d0fd0 2024-09-17T02:54:25.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.288+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65580b7c80 con 0x7f65580d0fd0 2024-09-17T02:54:25.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.290+0000 7f654dffb640 1 -- 172.21.15.104:0/253817359 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f655403f030 con 0x7f65580d0fd0 2024-09-17T02:54:25.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.355+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f65580d0900 con 0x7f65580d0fd0 2024-09-17T02:54:25.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.359+0000 7f654dffb640 1 -- 172.21.15.104:0/253817359 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f65540336c0 con 0x7f65580d0fd0 2024-09-17T02:54:25.357 INFO:teuthology.orchestra.run.smithi104.stderr:adjusted tunables profile to default 2024-09-17T02:54:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d0fd0 msgr2=0x7f6558152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d0fd0 0x7f6558152520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6554009780 tx=0x7f6554033c20 comp rx=0 tx=0).stop 2024-09-17T02:54:25.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 shutdown_connections 2024-09-17T02:54:25.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65580d13e0 0x7f6558160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65580d3490 0x7f65581610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 --2- 172.21.15.104:0/253817359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65580d0fd0 0x7f6558152520 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 >> 172.21.15.104:0/253817359 conn(0x7f65580d2970 msgr2=0x7f65580d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:25.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 shutdown_connections 2024-09-17T02:54:25.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:25.360+0000 7f655f582640 1 -- 172.21.15.104:0/253817359 wait complete. 2024-09-17T02:54:25.369 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T02:54:25.370 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T02:54:25.370 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:25.370 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T02:54:25.394 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:25.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T02:54:25.459 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:25.459 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T02:54:25.526 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:54:25.526 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T02:54:25.591 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:25.591 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T02:54:25.617 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:25.617 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T02:54:25.683 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:25.683 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T02:54:25.750 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:54:25.750 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T02:54:25.817 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2024-09-17T02:54:25.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.970+0000 7f44264f4640 1 -- 172.21.15.192:0/2074162524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 msgr2=0x7f44201523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.970+0000 7f44264f4640 1 --2- 172.21.15.192:0/2074162524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 0x7f44201523a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4410005fd0 tx=0x7f441002b9a0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.970+0000 7f44264f4640 1 -- 172.21.15.192:0/2074162524 shutdown_connections 2024-09-17T02:54:25.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.970+0000 7f44264f4640 1 --2- 172.21.15.192:0/2074162524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 0x7f44201523a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.970+0000 7f44264f4640 1 -- 172.21.15.192:0/2074162524 >> 172.21.15.192:0/2074162524 conn(0x7f44200b3440 msgr2=0x7f442006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:25.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.971+0000 7f44264f4640 1 -- 172.21.15.192:0/2074162524 shutdown_connections 2024-09-17T02:54:25.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.971+0000 7f44264f4640 1 -- 172.21.15.192:0/2074162524 wait complete. 2024-09-17T02:54:25.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.972+0000 7f44264f4640 1 Processor -- start 2024-09-17T02:54:25.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.973+0000 7f44264f4640 1 -- start start 2024-09-17T02:54:25.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f44264f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f442006f3e0 0x7f44201493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f44264f4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 0x7f4420159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f44264f4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442015eeb0 0x7f4420145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f44264f4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4420076d90 con 0x7f442006f3e0 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f44264f4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4420076c10 con 0x7f442015c4b0 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f44264f4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4420072d50 con 0x7f442015eeb0 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 0x7f4420159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f4424a91640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442015eeb0 0x7f4420145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f442006f3e0 0x7f44201493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 0x7f4420159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52640/0 (socket says 172.21.15.192:52640) 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 -- 172.21.15.192:0/270500218 learned_addr learned my addr 172.21.15.192:0/270500218 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 -- 172.21.15.192:0/270500218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442015eeb0 msgr2=0x7f4420145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 --2- 172.21.15.192:0/270500218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442015eeb0 0x7f4420145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 -- 172.21.15.192:0/270500218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f442006f3e0 msgr2=0x7f44201493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 --2- 172.21.15.192:0/270500218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f442006f3e0 0x7f44201493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 -- 172.21.15.192:0/270500218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442015a950 con 0x7f442015c4b0 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f4424a91640 1 --2- 172.21.15.192:0/270500218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442015eeb0 0x7f4420145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.974+0000 7f441f7fe640 1 --2- 172.21.15.192:0/270500218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 0x7f4420159bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f440800c3d0 tx=0x7f440800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.975+0000 7f441cff9640 1 -- 172.21.15.192:0/270500218 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408017070 con 0x7f442015c4b0 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.975+0000 7f441cff9640 1 -- 172.21.15.192:0/270500218 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44080053c0 con 0x7f442015c4b0 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.975+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4420143950 con 0x7f442015c4b0 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.975+0000 7f441cff9640 1 -- 172.21.15.192:0/270500218 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408003850 con 0x7f442015c4b0 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.975+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4420149910 con 0x7f442015c4b0 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.975+0000 7f441cff9640 1 -- 172.21.15.192:0/270500218 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f440801a070 con 0x7f442015c4b0 2024-09-17T02:54:25.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.975+0000 7f441cff9640 1 -- 172.21.15.192:0/270500218 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f440801c780 con 0x7f442015c4b0 2024-09-17T02:54:25.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.976+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44201523a0 con 0x7f442015c4b0 2024-09-17T02:54:25.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:25.980+0000 7f441cff9640 1 -- 172.21.15.192:0/270500218 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4408021020 con 0x7f442015c4b0 2024-09-17T02:54:26.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.049+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) -- 0x7f442015f7d0 con 0x7f442015c4b0 2024-09-17T02:54:26.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.053+0000 7f441cff9640 1 -- 172.21.15.192:0/270500218 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f4408011d50 con 0x7f442015c4b0 2024-09-17T02:54:26.053 INFO:teuthology.orchestra.run.smithi192.stdout:0 2024-09-17T02:54:26.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 msgr2=0x7f4420159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 --2- 172.21.15.192:0/270500218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 0x7f4420159bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f440800c3d0 tx=0x7f440800c890 comp rx=0 tx=0).stop 2024-09-17T02:54:26.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 shutdown_connections 2024-09-17T02:54:26.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 --2- 172.21.15.192:0/270500218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442015c4b0 0x7f4420159bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 --2- 172.21.15.192:0/270500218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442015eeb0 0x7f4420145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 --2- 172.21.15.192:0/270500218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f442006f3e0 0x7f44201493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 >> 172.21.15.192:0/270500218 conn(0x7f44200b3440 msgr2=0x7f442015cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 shutdown_connections 2024-09-17T02:54:26.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.054+0000 7f44264f4640 1 -- 172.21.15.192:0/270500218 wait complete. 2024-09-17T02:54:26.065 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2024-09-17T02:54:26.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.177+0000 7f395b939640 1 -- 172.21.15.192:0/3785796533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395415c4b0 msgr2=0x7f39541523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.177+0000 7f395b939640 1 --2- 172.21.15.192:0/3785796533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395415c4b0 0x7f39541523a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3950005fd0 tx=0x7f395002a5d0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.177+0000 7f395b939640 1 -- 172.21.15.192:0/3785796533 shutdown_connections 2024-09-17T02:54:26.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.177+0000 7f395b939640 1 --2- 172.21.15.192:0/3785796533 >> v2:172.21.15.104:3300/0 conn(0x7f395406f3e0 0x7f395406f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.177+0000 7f395b939640 1 --2- 172.21.15.192:0/3785796533 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395415c4b0 0x7f39541523a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.177+0000 7f395b939640 1 -- 172.21.15.192:0/3785796533 >> 172.21.15.192:0/3785796533 conn(0x7f39540b3440 msgr2=0x7f395406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.177+0000 7f395b939640 1 -- 172.21.15.192:0/3785796533 shutdown_connections 2024-09-17T02:54:26.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.177+0000 7f395b939640 1 -- 172.21.15.192:0/3785796533 wait complete. 2024-09-17T02:54:26.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.179+0000 7f395b939640 1 Processor -- start 2024-09-17T02:54:26.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.179+0000 7f395b939640 1 -- start start 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f395b939640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f395406f3e0 0x7f39541e6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f395b939640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395415c4b0 0x7f3954143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f395b939640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395415eeb0 0x7f395415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f395b939640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3954076be0 con 0x7f395406f3e0 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f395b939640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3954076a60 con 0x7f395415c4b0 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f395b939640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3954076d60 con 0x7f395415eeb0 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f3958ed4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395415c4b0 0x7f3954143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f3959ed6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395415eeb0 0x7f395415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f3958ed4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395415c4b0 0x7f3954143660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52654/0 (socket says 172.21.15.192:52654) 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f3958ed4640 1 -- 172.21.15.192:0/3754284410 learned_addr learned my addr 172.21.15.192:0/3754284410 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T02:54:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.180+0000 7f39596d5640 1 --2- 172.21.15.192:0/3754284410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f395406f3e0 0x7f39541e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3958ed4640 1 -- 172.21.15.192:0/3754284410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395415eeb0 msgr2=0x7f395415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3958ed4640 1 --2- 172.21.15.192:0/3754284410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395415eeb0 0x7f395415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3958ed4640 1 -- 172.21.15.192:0/3754284410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f395406f3e0 msgr2=0x7f39541e6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3958ed4640 1 --2- 172.21.15.192:0/3754284410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f395406f3e0 0x7f39541e6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3958ed4640 1 -- 172.21.15.192:0/3754284410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3954143ba0 con 0x7f395415c4b0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3958ed4640 1 --2- 172.21.15.192:0/3754284410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395415c4b0 0x7f3954143660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f394800eb00 tx=0x7f394800a350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3945ffb640 1 -- 172.21.15.192:0/3754284410 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394800ad80 con 0x7f395415c4b0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3945ffb640 1 -- 172.21.15.192:0/3754284410 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3948004020 con 0x7f395415c4b0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39541e6f70 con 0x7f395415c4b0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3945ffb640 1 -- 172.21.15.192:0/3754284410 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948004470 con 0x7f395415c4b0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39541e7530 con 0x7f395415c4b0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3945ffb640 1 -- 172.21.15.192:0/3754284410 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39480035f0 con 0x7f395415c4b0 2024-09-17T02:54:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.181+0000 7f3945ffb640 1 -- 172.21.15.192:0/3754284410 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f3948018ba0 con 0x7f395415c4b0 2024-09-17T02:54:26.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.182+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395406f7f0 con 0x7f395415c4b0 2024-09-17T02:54:26.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.184+0000 7f3945ffb640 1 -- 172.21.15.192:0/3754284410 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3948026020 con 0x7f395415c4b0 2024-09-17T02:54:26.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.253+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) -- 0x7f39541e6c90 con 0x7f395415c4b0 2024-09-17T02:54:26.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.257+0000 7f3945ffb640 1 -- 172.21.15.192:0/3754284410 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f3948013070 con 0x7f395415c4b0 2024-09-17T02:54:26.257 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395415c4b0 msgr2=0x7f3954143660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 --2- 172.21.15.192:0/3754284410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395415c4b0 0x7f3954143660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f394800eb00 tx=0x7f394800a350 comp rx=0 tx=0).stop 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 shutdown_connections 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 --2- 172.21.15.192:0/3754284410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395415c4b0 0x7f3954143660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 --2- 172.21.15.192:0/3754284410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f395415eeb0 0x7f395415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 --2- 172.21.15.192:0/3754284410 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f395406f3e0 0x7f39541e6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 >> 172.21.15.192:0/3754284410 conn(0x7f39540b3440 msgr2=0x7f3954151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 shutdown_connections 2024-09-17T02:54:26.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.258+0000 7f395b939640 1 -- 172.21.15.192:0/3754284410 wait complete. 2024-09-17T02:54:26.269 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2024-09-17T02:54:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.381+0000 7fa108333640 1 -- 172.21.15.192:0/2813897450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1000d0a50 msgr2=0x7fa100166840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.381+0000 7fa108333640 1 --2- 172.21.15.192:0/2813897450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1000d0a50 0x7fa100166840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8005fd0 tx=0x7fa0f802ab40 comp rx=0 tx=0).stop 2024-09-17T02:54:26.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.381+0000 7fa108333640 1 -- 172.21.15.192:0/2813897450 shutdown_connections 2024-09-17T02:54:26.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.381+0000 7fa108333640 1 --2- 172.21.15.192:0/2813897450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1000d0a50 0x7fa100166840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.381+0000 7fa108333640 1 -- 172.21.15.192:0/2813897450 >> 172.21.15.192:0/2813897450 conn(0x7fa1000b3440 msgr2=0x7fa10006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.381+0000 7fa108333640 1 -- 172.21.15.192:0/2813897450 shutdown_connections 2024-09-17T02:54:26.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.381+0000 7fa108333640 1 -- 172.21.15.192:0/2813897450 wait complete. 2024-09-17T02:54:26.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.383+0000 7fa108333640 1 Processor -- start 2024-09-17T02:54:26.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.383+0000 7fa108333640 1 -- start start 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.384+0000 7fa108333640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa10006f3e0 0x7fa100139a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.384+0000 7fa108333640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1000d0a50 0x7fa1001543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.384+0000 7fa108333640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa10015fb60 0x7fa100153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.384+0000 7fa108333640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa100167110 con 0x7fa1000d0a50 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.384+0000 7fa108333640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa100166f90 con 0x7fa10006f3e0 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.384+0000 7fa108333640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa100167290 con 0x7fa10015fb60 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1060cf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa10006f3e0 0x7fa100139a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1060cf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa10006f3e0 0x7fa100139a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52676/0 (socket says 172.21.15.192:52676) 2024-09-17T02:54:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1060cf640 1 -- 172.21.15.192:0/2189088702 learned_addr learned my addr 172.21.15.192:0/2189088702 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1068d0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa10015fb60 0x7fa100153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1058ce640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1000d0a50 0x7fa1001543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1068d0640 1 -- 172.21.15.192:0/2189088702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa10006f3e0 msgr2=0x7fa100139a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1068d0640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa10006f3e0 0x7fa100139a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1068d0640 1 -- 172.21.15.192:0/2189088702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1000d0a50 msgr2=0x7fa1001543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1068d0640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1000d0a50 0x7fa1001543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1068d0640 1 -- 172.21.15.192:0/2189088702 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa100141ec0 con 0x7fa10015fb60 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1060cf640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa10006f3e0 0x7fa100139a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa1068d0640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa10015fb60 0x7fa100153320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8032000 tx=0x7fa0f802c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa0f6ffd640 1 -- 172.21.15.192:0/2189088702 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8044070 con 0x7fa10015fb60 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa0f6ffd640 1 -- 172.21.15.192:0/2189088702 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0f8004250 con 0x7fa10015fb60 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa0f6ffd640 1 -- 172.21.15.192:0/2189088702 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f80046a0 con 0x7fa10015fb60 2024-09-17T02:54:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa100141be0 con 0x7fa10015fb60 2024-09-17T02:54:26.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.385+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10013fe80 con 0x7fa10015fb60 2024-09-17T02:54:26.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.386+0000 7fa0f6ffd640 1 -- 172.21.15.192:0/2189088702 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa0f802d470 con 0x7fa10015fb60 2024-09-17T02:54:26.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.386+0000 7fa0f6ffd640 1 -- 172.21.15.192:0/2189088702 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa0f8036820 con 0x7fa10015fb60 2024-09-17T02:54:26.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.386+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10015ff70 con 0x7fa10015fb60 2024-09-17T02:54:26.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.390+0000 7fa0f6ffd640 1 -- 172.21.15.192:0/2189088702 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa0f8032030 con 0x7fa10015fb60 2024-09-17T02:54:26.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.459+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) -- 0x7fa100141900 con 0x7fa10015fb60 2024-09-17T02:54:26.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.464+0000 7fa0f6ffd640 1 -- 172.21.15.192:0/2189088702 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa0f80098a0 con 0x7fa10015fb60 2024-09-17T02:54:26.464 INFO:teuthology.orchestra.run.smithi192.stdout:2 2024-09-17T02:54:26.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa10015fb60 msgr2=0x7fa100153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa10015fb60 0x7fa100153320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8032000 tx=0x7fa0f802c8b0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 shutdown_connections 2024-09-17T02:54:26.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa10015fb60 0x7fa100153320 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa1000d0a50 0x7fa1001543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 --2- 172.21.15.192:0/2189088702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa10006f3e0 0x7fa100139a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 >> 172.21.15.192:0/2189088702 conn(0x7fa1000b3440 msgr2=0x7fa10006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 shutdown_connections 2024-09-17T02:54:26.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.465+0000 7fa108333640 1 -- 172.21.15.192:0/2189088702 wait complete. 2024-09-17T02:54:26.475 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2024-09-17T02:54:26.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.587+0000 7f0c94fcc640 1 -- 172.21.15.192:0/2054088626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c90071150 msgr2=0x7f0c90069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.587+0000 7f0c94fcc640 1 --2- 172.21.15.192:0/2054088626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c90071150 0x7f0c90069240 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0c88005fd0 tx=0x7f0c8802aa90 comp rx=0 tx=0).stop 2024-09-17T02:54:26.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.588+0000 7f0c94fcc640 1 -- 172.21.15.192:0/2054088626 shutdown_connections 2024-09-17T02:54:26.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.588+0000 7f0c94fcc640 1 --2- 172.21.15.192:0/2054088626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c90071150 0x7f0c90069240 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.588+0000 7f0c94fcc640 1 --2- 172.21.15.192:0/2054088626 >> v2:172.21.15.104:3300/0 conn(0x7f0c9015d3b0 0x7f0c90068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.588+0000 7f0c94fcc640 1 -- 172.21.15.192:0/2054088626 >> 172.21.15.192:0/2054088626 conn(0x7f0c900b3640 msgr2=0x7f0c900b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.588+0000 7f0c94fcc640 1 -- 172.21.15.192:0/2054088626 shutdown_connections 2024-09-17T02:54:26.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.588+0000 7f0c94fcc640 1 -- 172.21.15.192:0/2054088626 wait complete. 2024-09-17T02:54:26.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.590+0000 7f0c94fcc640 1 Processor -- start 2024-09-17T02:54:26.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.590+0000 7f0c94fcc640 1 -- start start 2024-09-17T02:54:26.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c94fcc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c9006f540 0x7f0c900c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c94fcc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c90071150 0x7f0c9014db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c94fcc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c9015d3b0 0x7f0c900aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c94fcc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0c900d0e80 con 0x7f0c90071150 2024-09-17T02:54:26.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c94fcc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c900d0d00 con 0x7f0c9015d3b0 2024-09-17T02:54:26.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c94fcc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0c900d1000 con 0x7f0c9006f540 2024-09-17T02:54:26.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8e59c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c9006f540 0x7f0c900c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8ed9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c9015d3b0 0x7f0c900aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8e59c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c9006f540 0x7f0c900c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:58088/0 (socket says 172.21.15.192:58088) 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8e59c640 1 -- 172.21.15.192:0/3863467271 learned_addr learned my addr 172.21.15.192:0/3863467271 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8dd9b640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c90071150 0x7f0c9014db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8e59c640 1 -- 172.21.15.192:0/3863467271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c9015d3b0 msgr2=0x7f0c900aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8e59c640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c9015d3b0 0x7f0c900aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8e59c640 1 -- 172.21.15.192:0/3863467271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c90071150 msgr2=0x7f0c9014db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8e59c640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c90071150 0x7f0c9014db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8e59c640 1 -- 172.21.15.192:0/3863467271 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c901f9e90 con 0x7f0c9006f540 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.591+0000 7f0c8ed9d640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c9015d3b0 0x7f0c900aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.592+0000 7f0c8e59c640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c9006f540 0x7f0c900c8810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000c3a0 tx=0x7f0c8000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.592+0000 7f0c7effd640 1 -- 172.21.15.192:0/3863467271 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80017070 con 0x7f0c9006f540 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.592+0000 7f0c7effd640 1 -- 172.21.15.192:0/3863467271 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c800053c0 con 0x7f0c9006f540 2024-09-17T02:54:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.592+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c901fa450 con 0x7f0c9006f540 2024-09-17T02:54:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.592+0000 7f0c7effd640 1 -- 172.21.15.192:0/3863467271 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80003850 con 0x7f0c9006f540 2024-09-17T02:54:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.592+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c901fa730 con 0x7f0c9006f540 2024-09-17T02:54:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.592+0000 7f0c7effd640 1 -- 172.21.15.192:0/3863467271 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0c8001a070 con 0x7f0c9006f540 2024-09-17T02:54:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.592+0000 7f0c7effd640 1 -- 172.21.15.192:0/3863467271 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0c80011c70 con 0x7f0c9006f540 2024-09-17T02:54:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.593+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c901fa170 con 0x7f0c9006f540 2024-09-17T02:54:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.595+0000 7f0c7effd640 1 -- 172.21.15.192:0/3863467271 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0c80021070 con 0x7f0c9006f540 2024-09-17T02:54:26.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.664+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) -- 0x7f0c9015a7c0 con 0x7f0c9006f540 2024-09-17T02:54:26.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.667+0000 7f0c7effd640 1 -- 172.21.15.192:0/3863467271 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0c9015a7c0 con 0x7f0c9006f540 2024-09-17T02:54:26.667 INFO:teuthology.orchestra.run.smithi192.stdout:3 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c9006f540 msgr2=0x7f0c900c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c9006f540 0x7f0c900c8810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000c3a0 tx=0x7f0c8000c860 comp rx=0 tx=0).stop 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 shutdown_connections 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c9015d3b0 0x7f0c900aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c90071150 0x7f0c9014db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 --2- 172.21.15.192:0/3863467271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c9006f540 0x7f0c900c8810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 >> 172.21.15.192:0/3863467271 conn(0x7f0c900b3640 msgr2=0x7f0c90068f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 shutdown_connections 2024-09-17T02:54:26.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.668+0000 7f0c94fcc640 1 -- 172.21.15.192:0/3863467271 wait complete. 2024-09-17T02:54:26.679 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2024-09-17T02:54:26.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.792+0000 7f48620b2640 1 -- 172.21.15.192:0/3605977474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c06f3e0 msgr2=0x7f485c06f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.792+0000 7f48620b2640 1 --2- 172.21.15.192:0/3605977474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c06f3e0 0x7f485c06f7f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f485c071c80 tx=0x7f484c02a5f0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.792+0000 7f48620b2640 1 -- 172.21.15.192:0/3605977474 shutdown_connections 2024-09-17T02:54:26.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.792+0000 7f48620b2640 1 --2- 172.21.15.192:0/3605977474 >> v2:172.21.15.104:3300/0 conn(0x7f485c0cfa40 0x7f485c0cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.792+0000 7f48620b2640 1 --2- 172.21.15.192:0/3605977474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c06f3e0 0x7f485c06f7f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.792+0000 7f48620b2640 1 -- 172.21.15.192:0/3605977474 >> 172.21.15.192:0/3605977474 conn(0x7f485c0b3440 msgr2=0x7f485c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.792+0000 7f48620b2640 1 -- 172.21.15.192:0/3605977474 shutdown_connections 2024-09-17T02:54:26.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.792+0000 7f48620b2640 1 -- 172.21.15.192:0/3605977474 wait complete. 2024-09-17T02:54:26.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.794+0000 7f48620b2640 1 Processor -- start 2024-09-17T02:54:26.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.794+0000 7f48620b2640 1 -- start start 2024-09-17T02:54:26.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f48620b2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c06f3e0 0x7f485c0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f48620b2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f485c0cfa40 0x7f485c140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f48620b2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15fb60 0x7f485c072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:26.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f48620b2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f485c0d0510 con 0x7f485c0cfa40 2024-09-17T02:54:26.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f48620b2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f485c0d0390 con 0x7f485c15fb60 2024-09-17T02:54:26.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f48620b2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f485c0d0690 con 0x7f485c06f3e0 2024-09-17T02:54:26.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c06f3e0 0x7f485c0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f485bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15fb60 0x7f485c072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f485b7fe640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c06f3e0 0x7f485c0b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:58094/0 (socket says 172.21.15.192:58094) 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.795+0000 7f485b7fe640 1 -- 172.21.15.192:0/3823733786 learned_addr learned my addr 172.21.15.192:0/3823733786 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f4853fff640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f485c0cfa40 0x7f485c140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f485bfff640 1 -- 172.21.15.192:0/3823733786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c06f3e0 msgr2=0x7f485c0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f485bfff640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c06f3e0 0x7f485c0b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f485bfff640 1 -- 172.21.15.192:0/3823733786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f485c0cfa40 msgr2=0x7f485c140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f485bfff640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f485c0cfa40 0x7f485c140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f485bfff640 1 -- 172.21.15.192:0/3823733786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c0af3f0 con 0x7f485c15fb60 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f485b7fe640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c06f3e0 0x7f485c0b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f485bfff640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15fb60 0x7f485c072d50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f485400d9a0 tx=0x7f485400de60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f4858ff9640 1 -- 172.21.15.192:0/3823733786 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485400bd10 con 0x7f485c15fb60 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c15aa50 con 0x7f485c15fb60 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f4858ff9640 1 -- 172.21.15.192:0/3823733786 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4854003970 con 0x7f485c15fb60 2024-09-17T02:54:26.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f4858ff9640 1 -- 172.21.15.192:0/3823733786 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854003dc0 con 0x7f485c15fb60 2024-09-17T02:54:26.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c0af690 con 0x7f485c15fb60 2024-09-17T02:54:26.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f4858ff9640 1 -- 172.21.15.192:0/3823733786 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f48540043c0 con 0x7f485c15fb60 2024-09-17T02:54:26.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.796+0000 7f4858ff9640 1 -- 172.21.15.192:0/3823733786 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f485401c910 con 0x7f485c15fb60 2024-09-17T02:54:26.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.797+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f485c0d0b60 con 0x7f485c15fb60 2024-09-17T02:54:26.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.799+0000 7f4858ff9640 1 -- 172.21.15.192:0/3823733786 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f485401cc30 con 0x7f485c15fb60 2024-09-17T02:54:26.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.869+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) -- 0x7f485c141a70 con 0x7f485c15fb60 2024-09-17T02:54:26.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.872+0000 7f4858ff9640 1 -- 172.21.15.192:0/3823733786 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f485401ce10 con 0x7f485c15fb60 2024-09-17T02:54:26.872 INFO:teuthology.orchestra.run.smithi192.stdout:4 2024-09-17T02:54:26.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15fb60 msgr2=0x7f485c072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15fb60 0x7f485c072d50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f485400d9a0 tx=0x7f485400de60 comp rx=0 tx=0).stop 2024-09-17T02:54:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 shutdown_connections 2024-09-17T02:54:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15fb60 0x7f485c072d50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f485c0cfa40 0x7f485c140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 --2- 172.21.15.192:0/3823733786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c06f3e0 0x7f485c0b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 >> 172.21.15.192:0/3823733786 conn(0x7f485c0b3440 msgr2=0x7f485c15ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 shutdown_connections 2024-09-17T02:54:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.873+0000 7f48620b2640 1 -- 172.21.15.192:0/3823733786 wait complete. 2024-09-17T02:54:26.885 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2024-09-17T02:54:26.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.996+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2576680925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0cf8b0 msgr2=0x7f0a9c0b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:26.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.996+0000 7f0aa2fc2640 1 --2- 172.21.15.192:0/2576680925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0cf8b0 0x7f0a9c0b57b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a88005fd0 tx=0x7f0a8802a5d0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.997+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2576680925 shutdown_connections 2024-09-17T02:54:26.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.997+0000 7f0aa2fc2640 1 --2- 172.21.15.192:0/2576680925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0cf8b0 0x7f0a9c0b57b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.997+0000 7f0aa2fc2640 1 --2- 172.21.15.192:0/2576680925 >> v2:172.21.15.104:3300/0 conn(0x7f0a9c0b7560 0x7f0a9c0cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:26.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.997+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2576680925 >> 172.21.15.192:0/2576680925 conn(0x7f0a9c0d2960 msgr2=0x7f0a9c0d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:26.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.997+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2576680925 shutdown_connections 2024-09-17T02:54:26.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.997+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2576680925 wait complete. 2024-09-17T02:54:26.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.998+0000 7f0aa2fc2640 1 Processor -- start 2024-09-17T02:54:26.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:26.998+0000 7f0aa2fc2640 1 -- start start 2024-09-17T02:54:27.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa2fc2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9c0b5cf0 0x7f0a9c1f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa2fc2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0b7560 0x7f0a9c14c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa2fc2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c0cf8b0 0x7f0a9c14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa2fc2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c0b7af0 con 0x7f0a9c0cf8b0 2024-09-17T02:54:27.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa2fc2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9c0b7970 con 0x7f0a9c0b5cf0 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa2fc2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9c0ce480 con 0x7f0a9c0b7560 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0b7560 0x7f0a9c14c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa0d5e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9c0b5cf0 0x7f0a9c1f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0b7560 0x7f0a9c14c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:58112/0 (socket says 172.21.15.192:58112) 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa0d5e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9c0b5cf0 0x7f0a9c1f3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52724/0 (socket says 172.21.15.192:52724) 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 -- 172.21.15.192:0/2709276710 learned_addr learned my addr 172.21.15.192:0/2709276710 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa155f640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c0cf8b0 0x7f0a9c14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 -- 172.21.15.192:0/2709276710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9c0b5cf0 msgr2=0x7f0a9c1f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9c0b5cf0 0x7f0a9c1f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 -- 172.21.15.192:0/2709276710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c0cf8b0 msgr2=0x7f0a9c14ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c0cf8b0 0x7f0a9c14ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 -- 172.21.15.192:0/2709276710 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9c14a400 con 0x7f0a9c0b7560 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0aa0d5e640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9c0b5cf0 0x7f0a9c1f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:27.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.000+0000 7f0a9bfff640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0b7560 0x7f0a9c14c520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a88034040 tx=0x7f0a880035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:27.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.001+0000 7f0a997fa640 1 -- 172.21.15.192:0/2709276710 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8803e030 con 0x7f0a9c0b7560 2024-09-17T02:54:27.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.001+0000 7f0a997fa640 1 -- 172.21.15.192:0/2709276710 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a88003ae0 con 0x7f0a9c0b7560 2024-09-17T02:54:27.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.001+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9c14d2e0 con 0x7f0a9c0b7560 2024-09-17T02:54:27.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.001+0000 7f0a997fa640 1 -- 172.21.15.192:0/2709276710 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a88035040 con 0x7f0a9c0b7560 2024-09-17T02:54:27.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.001+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9c15be40 con 0x7f0a9c0b7560 2024-09-17T02:54:27.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.001+0000 7f0a997fa640 1 -- 172.21.15.192:0/2709276710 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a88041030 con 0x7f0a9c0b7560 2024-09-17T02:54:27.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.001+0000 7f0a997fa640 1 -- 172.21.15.192:0/2709276710 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0a88043b20 con 0x7f0a9c0b7560 2024-09-17T02:54:27.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.002+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9c0d0d20 con 0x7f0a9c0b7560 2024-09-17T02:54:27.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.005+0000 7f0a997fa640 1 -- 172.21.15.192:0/2709276710 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0a88043dc0 con 0x7f0a9c0b7560 2024-09-17T02:54:27.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.076+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) -- 0x7f0a9c14d000 con 0x7f0a9c0b7560 2024-09-17T02:54:27.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.080+0000 7f0a997fa640 1 -- 172.21.15.192:0/2709276710 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0a88004cc0 con 0x7f0a9c0b7560 2024-09-17T02:54:27.081 INFO:teuthology.orchestra.run.smithi192.stdout:5 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.081+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0b7560 msgr2=0x7f0a9c14c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.081+0000 7f0aa2fc2640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0b7560 0x7f0a9c14c520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a88034040 tx=0x7f0a880035f0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.081+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 shutdown_connections 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.081+0000 7f0aa2fc2640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a9c0cf8b0 0x7f0a9c14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.082+0000 7f0aa2fc2640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a9c0b7560 0x7f0a9c14c520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.082+0000 7f0aa2fc2640 1 --2- 172.21.15.192:0/2709276710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a9c0b5cf0 0x7f0a9c1f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.082+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 >> 172.21.15.192:0/2709276710 conn(0x7f0a9c0d2960 msgr2=0x7f0a9c09ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.082+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 shutdown_connections 2024-09-17T02:54:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.082+0000 7f0aa2fc2640 1 -- 172.21.15.192:0/2709276710 wait complete. 2024-09-17T02:54:27.092 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2024-09-17T02:54:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.205+0000 7fc40b972640 1 -- 172.21.15.192:0/1832048598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc404068d00 msgr2=0x7fc404069110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.205+0000 7fc40b972640 1 --2- 172.21.15.192:0/1832048598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc404068d00 0x7fc404069110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4009830 tx=0x7fc3f402a510 comp rx=0 tx=0).stop 2024-09-17T02:54:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.205+0000 7fc40b972640 1 -- 172.21.15.192:0/1832048598 shutdown_connections 2024-09-17T02:54:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.205+0000 7fc40b972640 1 --2- 172.21.15.192:0/1832048598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc404068d00 0x7fc404069110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.205+0000 7fc40b972640 1 --2- 172.21.15.192:0/1832048598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc404145e30 0x7fc404073f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.205+0000 7fc40b972640 1 -- 172.21.15.192:0/1832048598 >> 172.21.15.192:0/1832048598 conn(0x7fc4040b35d0 msgr2=0x7fc4040b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:27.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.205+0000 7fc40b972640 1 -- 172.21.15.192:0/1832048598 shutdown_connections 2024-09-17T02:54:27.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.205+0000 7fc40b972640 1 -- 172.21.15.192:0/1832048598 wait complete. 2024-09-17T02:54:27.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.206+0000 7fc40b972640 1 Processor -- start 2024-09-17T02:54:27.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.207+0000 7fc40b972640 1 -- start start 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40b972640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc404068d00 0x7fc4041f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40b972640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc404145e30 0x7fc404131190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40b972640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4041607e0 0x7fc4041316d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40b972640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc404146620 con 0x7fc404145e30 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40b972640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc404070b00 con 0x7fc4041607e0 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40b972640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc4041467a0 con 0x7fc404068d00 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40970e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc404068d00 0x7fc4041f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc409f0f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4041607e0 0x7fc4041316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40970e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc404068d00 0x7fc4041f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:58124/0 (socket says 172.21.15.192:58124) 2024-09-17T02:54:27.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40970e640 1 -- 172.21.15.192:0/4036220546 learned_addr learned my addr 172.21.15.192:0/4036220546 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc408f0d640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc404145e30 0x7fc404131190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc409f0f640 1 -- 172.21.15.192:0/4036220546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc404068d00 msgr2=0x7fc4041f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc409f0f640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc404068d00 0x7fc4041f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc409f0f640 1 -- 172.21.15.192:0/4036220546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc404145e30 msgr2=0x7fc404131190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc409f0f640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc404145e30 0x7fc404131190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc409f0f640 1 -- 172.21.15.192:0/4036220546 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4041e6620 con 0x7fc4041607e0 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc40970e640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc404068d00 0x7fc4041f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.208+0000 7fc409f0f640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4041607e0 0x7fc4041316d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00c760 tx=0x7fc3fc00cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.209+0000 7fc3f9ffb640 1 -- 172.21.15.192:0/4036220546 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc003b70 con 0x7fc4041607e0 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.209+0000 7fc3f9ffb640 1 -- 172.21.15.192:0/4036220546 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3fc003d10 con 0x7fc4041607e0 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.209+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4041f7b80 con 0x7fc4041607e0 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.209+0000 7fc3f9ffb640 1 -- 172.21.15.192:0/4036220546 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00aab0 con 0x7fc4041607e0 2024-09-17T02:54:27.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.209+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4041f8140 con 0x7fc4041607e0 2024-09-17T02:54:27.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.209+0000 7fc3f9ffb640 1 -- 172.21.15.192:0/4036220546 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc3fc00ac50 con 0x7fc4041607e0 2024-09-17T02:54:27.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.209+0000 7fc3f9ffb640 1 -- 172.21.15.192:0/4036220546 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc3fc012ab0 con 0x7fc4041607e0 2024-09-17T02:54:27.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.210+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc404161580 con 0x7fc4041607e0 2024-09-17T02:54:27.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.212+0000 7fc3f9ffb640 1 -- 172.21.15.192:0/4036220546 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc404069650 con 0x7fc4041607e0 2024-09-17T02:54:27.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.281+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) -- 0x7fc404071f00 con 0x7fc4041607e0 2024-09-17T02:54:27.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.285+0000 7fc3f9ffb640 1 -- 172.21.15.192:0/4036220546 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc3fc0124c0 con 0x7fc4041607e0 2024-09-17T02:54:27.285 INFO:teuthology.orchestra.run.smithi192.stdout:6 2024-09-17T02:54:27.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4041607e0 msgr2=0x7fc4041316d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4041607e0 0x7fc4041316d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00c760 tx=0x7fc3fc00cc20 comp rx=0 tx=0).stop 2024-09-17T02:54:27.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 shutdown_connections 2024-09-17T02:54:27.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4041607e0 0x7fc4041316d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc404145e30 0x7fc404131190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 --2- 172.21.15.192:0/4036220546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc404068d00 0x7fc4041f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 >> 172.21.15.192:0/4036220546 conn(0x7fc4040b35d0 msgr2=0x7fc4040b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:27.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 shutdown_connections 2024-09-17T02:54:27.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.286+0000 7fc40b972640 1 -- 172.21.15.192:0/4036220546 wait complete. 2024-09-17T02:54:27.297 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2024-09-17T02:54:27.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.412+0000 7fb5264cc640 1 -- 172.21.15.192:0/1106735546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52006f3e0 msgr2=0x7fb52006f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.412+0000 7fb5264cc640 1 --2- 172.21.15.192:0/1106735546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52006f3e0 0x7fb52006f7f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb510005fd0 tx=0x7fb51002a5d0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.412+0000 7fb5264cc640 1 -- 172.21.15.192:0/1106735546 shutdown_connections 2024-09-17T02:54:27.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.412+0000 7fb5264cc640 1 --2- 172.21.15.192:0/1106735546 >> v2:172.21.15.104:3300/0 conn(0x7fb52015fb60 0x7fb52015ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.412+0000 7fb5264cc640 1 --2- 172.21.15.192:0/1106735546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52006f3e0 0x7fb52006f7f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.412+0000 7fb5264cc640 1 -- 172.21.15.192:0/1106735546 >> 172.21.15.192:0/1106735546 conn(0x7fb5200b3440 msgr2=0x7fb52006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:27.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.412+0000 7fb5264cc640 1 -- 172.21.15.192:0/1106735546 shutdown_connections 2024-09-17T02:54:27.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.412+0000 7fb5264cc640 1 -- 172.21.15.192:0/1106735546 wait complete. 2024-09-17T02:54:27.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.414+0000 7fb5264cc640 1 Processor -- start 2024-09-17T02:54:27.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.414+0000 7fb5264cc640 1 -- start start 2024-09-17T02:54:27.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb5264cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb52006f3e0 0x7fb5201409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb5264cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb520073e60 0x7fb5201589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb5264cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52015fb60 0x7fb520158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb5264cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5200d0bd0 con 0x7fb52006f3e0 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb5264cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb5200d0a50 con 0x7fb520073e60 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb5264cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb5200d0d50 con 0x7fb52015fb60 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb524a69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52015fb60 0x7fb520158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb51ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb52006f3e0 0x7fb5201409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb524a69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52015fb60 0x7fb520158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:58148/0 (socket says 172.21.15.192:58148) 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb51f7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb520073e60 0x7fb5201589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.415+0000 7fb524a69640 1 -- 172.21.15.192:0/1188009539 learned_addr learned my addr 172.21.15.192:0/1188009539 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb524a69640 1 -- 172.21.15.192:0/1188009539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb520073e60 msgr2=0x7fb5201589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb524a69640 1 --2- 172.21.15.192:0/1188009539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb520073e60 0x7fb5201589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb524a69640 1 -- 172.21.15.192:0/1188009539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb52006f3e0 msgr2=0x7fb5201409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb524a69640 1 --2- 172.21.15.192:0/1188009539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb52006f3e0 0x7fb5201409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb524a69640 1 -- 172.21.15.192:0/1188009539 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb520159540 con 0x7fb52015fb60 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb51f7fe640 1 --2- 172.21.15.192:0/1188009539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb520073e60 0x7fb5201589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb524a69640 1 --2- 172.21.15.192:0/1188009539 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52015fb60 0x7fb520158ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c6e0 tx=0x7fb51800cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb51cff9640 1 -- 172.21.15.192:0/1188009539 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518003b70 con 0x7fb52015fb60 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb51cff9640 1 -- 172.21.15.192:0/1188009539 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb518003d30 con 0x7fb52015fb60 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb520159820 con 0x7fb52015fb60 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb51cff9640 1 -- 172.21.15.192:0/1188009539 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518005330 con 0x7fb52015fb60 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5201f5240 con 0x7fb52015fb60 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb51cff9640 1 -- 172.21.15.192:0/1188009539 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb5180054d0 con 0x7fb52015fb60 2024-09-17T02:54:27.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.416+0000 7fb51cff9640 1 -- 172.21.15.192:0/1188009539 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fb518012bc0 con 0x7fb52015fb60 2024-09-17T02:54:27.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.417+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb520074bc0 con 0x7fb52015fb60 2024-09-17T02:54:27.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.419+0000 7fb51cff9640 1 -- 172.21.15.192:0/1188009539 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb52006fd30 con 0x7fb52015fb60 2024-09-17T02:54:27.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.488+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) -- 0x7fb5200b0350 con 0x7fb52015fb60 2024-09-17T02:54:27.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.492+0000 7fb51cff9640 1 -- 172.21.15.192:0/1188009539 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fb518012560 con 0x7fb52015fb60 2024-09-17T02:54:27.492 INFO:teuthology.orchestra.run.smithi192.stdout:7 2024-09-17T02:54:27.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52015fb60 msgr2=0x7fb520158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 --2- 172.21.15.192:0/1188009539 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52015fb60 0x7fb520158ee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb51800c6e0 tx=0x7fb51800cba0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 shutdown_connections 2024-09-17T02:54:27.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 --2- 172.21.15.192:0/1188009539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb520073e60 0x7fb5201589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 --2- 172.21.15.192:0/1188009539 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb52015fb60 0x7fb520158ee0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 --2- 172.21.15.192:0/1188009539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb52006f3e0 0x7fb5201409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 >> 172.21.15.192:0/1188009539 conn(0x7fb5200b3440 msgr2=0x7fb520074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:27.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 shutdown_connections 2024-09-17T02:54:27.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:54:27.493+0000 7fb5264cc640 1 -- 172.21.15.192:0/1188009539 wait complete. 2024-09-17T02:54:27.504 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T02:54:27.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T02:54:27.506 INFO:tasks.ceph.osd.0:Started 2024-09-17T02:54:27.506 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T02:54:27.506 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T02:54:27.508 INFO:tasks.ceph.osd.1:Started 2024-09-17T02:54:27.509 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T02:54:27.509 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T02:54:27.511 INFO:tasks.ceph.osd.2:Started 2024-09-17T02:54:27.511 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T02:54:27.511 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T02:54:27.514 INFO:tasks.ceph.osd.3:Started 2024-09-17T02:54:27.514 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T02:54:27.514 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T02:54:27.516 INFO:tasks.ceph.osd.4:Started 2024-09-17T02:54:27.517 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T02:54:27.517 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T02:54:27.519 INFO:tasks.ceph.osd.5:Started 2024-09-17T02:54:27.519 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T02:54:27.519 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T02:54:27.521 INFO:tasks.ceph.osd.6:Started 2024-09-17T02:54:27.521 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T02:54:27.521 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T02:54:27.524 INFO:tasks.ceph.osd.7:Started 2024-09-17T02:54:27.524 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:27.617 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-09-17T02:54:27.617+0000 7f9702e12640 -1 Falling back to public interface 2024-09-17T02:54:27.618 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-09-17T02:54:27.618+0000 7f03e0e0b640 -1 Falling back to public interface 2024-09-17T02:54:27.621 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-17T02:54:27.621+0000 7fafc020b640 -1 Falling back to public interface 2024-09-17T02:54:27.625 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-09-17T02:54:27.626+0000 7fb561011640 -1 Falling back to public interface 2024-09-17T02:54:27.628 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-09-17T02:54:27.629+0000 7f2b7da33640 -1 Falling back to public interface 2024-09-17T02:54:27.633 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-09-17T02:54:27.634+0000 7f2ddc00c640 -1 Falling back to public interface 2024-09-17T02:54:27.634 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-09-17T02:54:27.634+0000 7f30d8fcc640 -1 Falling back to public interface 2024-09-17T02:54:27.637 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-09-17T02:54:27.638+0000 7f9702e12640 -1 osd.5 0 log_to_monitors true 2024-09-17T02:54:27.638 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-09-17T02:54:27.638+0000 7f03e0e0b640 -1 osd.6 0 log_to_monitors true 2024-09-17T02:54:27.640 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-09-17T02:54:27.640+0000 7f814fa12640 -1 Falling back to public interface 2024-09-17T02:54:27.641 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-09-17T02:54:27.642+0000 7f2b7da33640 -1 osd.3 0 log_to_monitors true 2024-09-17T02:54:27.644 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-17T02:54:27.644+0000 7fafc020b640 -1 osd.0 0 log_to_monitors true 2024-09-17T02:54:27.645 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-09-17T02:54:27.646+0000 7fb561011640 -1 osd.1 0 log_to_monitors true 2024-09-17T02:54:27.650 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-09-17T02:54:27.651+0000 7f30d8fcc640 -1 osd.4 0 log_to_monitors true 2024-09-17T02:54:27.652 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-09-17T02:54:27.653+0000 7f2ddc00c640 -1 osd.2 0 log_to_monitors true 2024-09-17T02:54:27.658 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-09-17T02:54:27.658+0000 7f814fa12640 -1 osd.7 0 log_to_monitors true 2024-09-17T02:54:27.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 -- 172.21.15.104:0/379161273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d3490 msgr2=0x7ff9340b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 --2- 172.21.15.104:0/379161273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d3490 0x7ff9340b7c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff9340b5cb0 tx=0x7ff92402a4b0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 -- 172.21.15.104:0/379161273 shutdown_connections 2024-09-17T02:54:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 --2- 172.21.15.104:0/379161273 >> v2:172.21.15.192:3300/0 conn(0x7ff9340d13e0 0x7ff934161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 --2- 172.21.15.104:0/379161273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340d0fd0 0x7ff934160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 --2- 172.21.15.104:0/379161273 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d3490 0x7ff9340b7c80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 -- 172.21.15.104:0/379161273 >> 172.21.15.104:0/379161273 conn(0x7ff9340d2970 msgr2=0x7ff9340d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 -- 172.21.15.104:0/379161273 shutdown_connections 2024-09-17T02:54:27.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.675+0000 7ff93a870640 1 -- 172.21.15.104:0/379161273 wait complete. 2024-09-17T02:54:27.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.677+0000 7ff93a870640 1 Processor -- start 2024-09-17T02:54:27.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.677+0000 7ff93a870640 1 -- start start 2024-09-17T02:54:27.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff93a870640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d0fd0 0x7ff9341f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff93a870640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340d13e0 0x7ff9341611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff93a870640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340d3490 0x7ff9341e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff93a870640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340b2270 con 0x7ff9340d0fd0 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff93a870640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340b20f0 con 0x7ff9340d3490 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff93a870640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff9340b23f0 con 0x7ff9340d13e0 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff933fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d0fd0 0x7ff9341f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff938e0d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340d3490 0x7ff9341e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff933fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d0fd0 0x7ff9341f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36724/0 (socket says 172.21.15.104:36724) 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff933fff640 1 -- 172.21.15.104:0/2768993994 learned_addr learned my addr 172.21.15.104:0/2768993994 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff938e0d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340d3490 0x7ff9341e6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:44494/0 (socket says 172.21.15.104:44494) 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff9337fe640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340d13e0 0x7ff9341611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff9337fe640 1 -- 172.21.15.104:0/2768993994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340d3490 msgr2=0x7ff9341e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff9337fe640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340d3490 0x7ff9341e6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff9337fe640 1 -- 172.21.15.104:0/2768993994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d0fd0 msgr2=0x7ff9341f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff9337fe640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d0fd0 0x7ff9341f46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff9337fe640 1 -- 172.21.15.104:0/2768993994 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9340cad80 con 0x7ff9340d13e0 2024-09-17T02:54:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff933fff640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d0fd0 0x7ff9341f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff9337fe640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340d13e0 0x7ff9341611e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00e600 tx=0x7ff91c00eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff930ff9640 1 -- 172.21.15.104:0/2768993994 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c004220 con 0x7ff9340d13e0 2024-09-17T02:54:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff930ff9640 1 -- 172.21.15.104:0/2768993994 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff91c005020 con 0x7ff9340d13e0 2024-09-17T02:54:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.679+0000 7ff930ff9640 1 -- 172.21.15.104:0/2768993994 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c005470 con 0x7ff9340d13e0 2024-09-17T02:54:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.680+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff934161720 con 0x7ff9340d13e0 2024-09-17T02:54:27.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.680+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9340ca7c0 con 0x7ff9340d13e0 2024-09-17T02:54:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.680+0000 7ff930ff9640 1 -- 172.21.15.104:0/2768993994 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7ff91c00c810 con 0x7ff9340d13e0 2024-09-17T02:54:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.681+0000 7ff930ff9640 1 -- 172.21.15.104:0/2768993994 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff91c052a50 con 0x7ff9340d13e0 2024-09-17T02:54:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.681+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9340b7c80 con 0x7ff9340d13e0 2024-09-17T02:54:27.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.683+0000 7ff930ff9640 1 -- 172.21.15.104:0/2768993994 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff91c013c20 con 0x7ff9340d13e0 2024-09-17T02:54:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.744+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9340d0900 con 0x7ff9340d13e0 2024-09-17T02:54:27.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.745+0000 7ff930ff9640 1 -- 172.21.15.104:0/2768993994 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff91c017b20 con 0x7ff9340d13e0 2024-09-17T02:54:27.745 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:27.745 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":10,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:27.491467+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340d13e0 msgr2=0x7ff9341611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340d13e0 0x7ff9341611e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff91c00e600 tx=0x7ff91c00eac0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 shutdown_connections 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340d3490 0x7ff9341e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340d13e0 0x7ff9341611e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 --2- 172.21.15.104:0/2768993994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9340d0fd0 0x7ff9341f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 >> 172.21.15.104:0/2768993994 conn(0x7ff9340d2970 msgr2=0x7ff9340b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 shutdown_connections 2024-09-17T02:54:27.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:27.746+0000 7ff93a870640 1 -- 172.21.15.104:0/2768993994 wait complete. 2024-09-17T02:54:27.757 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T02:54:27.757 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T02:54:28.564 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:28.625 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-09-17T02:54:28.625+0000 7f978c9de640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T02:54:28.626 INFO:tasks.ceph.mgr.x.smithi192.stderr:2024-09-17T02:54:28.625+0000 7f978c9de640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T02:54:28.683 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.683+0000 7feb651c3640 1 -- 172.21.15.104:0/3769708495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48005150 msgr2=0x7feb4800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:28.683 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.683+0000 7feb651c3640 1 --2- 172.21.15.104:0/3769708495 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48005150 0x7feb4800b9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb58009b20 tx=0x7feb48005830 comp rx=0 tx=0).stop 2024-09-17T02:54:28.684 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.683+0000 7feb5f59e640 1 -- 172.21.15.104:0/3769708495 reap_dead start 2024-09-17T02:54:28.684 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.683+0000 7feb651c3640 1 -- 172.21.15.104:0/3769708495 shutdown_connections 2024-09-17T02:54:28.684 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.683+0000 7feb651c3640 1 -- 172.21.15.104:0/3769708495 >> 172.21.15.104:0/3769708495 conn(0x7feb60068ee0 msgr2=0x7feb600692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:28.684 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.683+0000 7feb651c3640 1 -- 172.21.15.104:0/3769708495 shutdown_connections 2024-09-17T02:54:28.684 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.683+0000 7feb651c3640 1 -- 172.21.15.104:0/3769708495 wait complete. 2024-09-17T02:54:28.685 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.686+0000 7feb651c3640 1 Processor -- start 2024-09-17T02:54:28.685 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.686+0000 7feb651c3640 1 -- start start 2024-09-17T02:54:28.690 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb651c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb48005150 0x7feb600c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:28.690 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb651c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb600cb4d0 0x7feb600ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:28.690 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb651c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb601f90b0 0x7feb601f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:28.690 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb651c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb600d20f0 con 0x7feb600cb4d0 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb651c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb600d1f70 con 0x7feb601f90b0 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb651c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feb6015f830 con 0x7feb48005150 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb600cb4d0 0x7feb600ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb600cb4d0 0x7feb600ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36734/0 (socket says 172.21.15.104:36734) 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5e59c640 1 -- 172.21.15.104:0/3986038142 learned_addr learned my addr 172.21.15.104:0/3986038142 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5ed9d640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb48005150 0x7feb600c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5f59e640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb601f90b0 0x7feb601f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5e59c640 1 -- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb48005150 msgr2=0x7feb600c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5e59c640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb48005150 0x7feb600c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5e59c640 1 -- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb601f90b0 msgr2=0x7feb601f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5e59c640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb601f90b0 0x7feb601f94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.687+0000 7feb5e59c640 1 -- 172.21.15.104:0/3986038142 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb601f9a00 con 0x7feb600cb4d0 2024-09-17T02:54:28.691 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.688+0000 7feb5e59c640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb600cb4d0 0x7feb600ce0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb54003620 tx=0x7feb54003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.688+0000 7feb477fe640 1 -- 172.21.15.104:0/3986038142 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54015070 con 0x7feb600cb4d0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.688+0000 7feb477fe640 1 -- 172.21.15.104:0/3986038142 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb5400fa10 con 0x7feb600cb4d0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.688+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb600ca470 con 0x7feb600cb4d0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.688+0000 7feb477fe640 1 -- 172.21.15.104:0/3986038142 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5400fe60 con 0x7feb600cb4d0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.688+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb600ca9f0 con 0x7feb600cb4d0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.689+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb600cfeb0 con 0x7feb600cb4d0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.689+0000 7feb477fe640 1 -- 172.21.15.104:0/3986038142 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 3) ==== 101279+0+0 (secure 0 0 0) 0x7feb54011430 con 0x7feb600cb4d0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.690+0000 7feb477fe640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb4c0789e0 0x7feb4c07aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.690+0000 7feb477fe640 1 -- 172.21.15.104:0/3986038142 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1883+0+0 (secure 0 0 0) 0x7feb5409a8d0 con 0x7feb600cb4d0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.690+0000 7feb5ed9d640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb4c0789e0 0x7feb4c07aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:28.692 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.691+0000 7feb5ed9d640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb4c0789e0 0x7feb4c07aef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb50005fd0 tx=0x7feb50009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:28.694 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.695+0000 7feb477fe640 1 -- 172.21.15.104:0/3986038142 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb601f9a00 con 0x7feb600cb4d0 2024-09-17T02:54:28.866 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.867+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb6015de40 con 0x7feb600cb4d0 2024-09-17T02:54:28.867 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.868+0000 7feb477fe640 1 -- 172.21.15.104:0/3986038142 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+7058 (secure 0 0 0) 0x7feb54063980 con 0x7feb600cb4d0 2024-09-17T02:54:28.867 INFO:teuthology.misc.health.smithi104.stdout: 2024-09-17T02:54:28.867 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":11,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:28.609610+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:28.869 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb4c0789e0 msgr2=0x7feb4c07aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb4c0789e0 0x7feb4c07aef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb50005fd0 tx=0x7feb50009500 comp rx=0 tx=0).stop 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb600cb4d0 msgr2=0x7feb600ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb600cb4d0 0x7feb600ce0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb54003620 tx=0x7feb54003ae0 comp rx=0 tx=0).stop 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 shutdown_connections 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb4c0789e0 0x7feb4c07aef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb601f90b0 0x7feb601f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb600cb4d0 0x7feb600ce0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 --2- 172.21.15.104:0/3986038142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb48005150 0x7feb600c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 >> 172.21.15.104:0/3986038142 conn(0x7feb60068ee0 msgr2=0x7feb6015cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 shutdown_connections 2024-09-17T02:54:28.870 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:28.870+0000 7feb651c3640 1 -- 172.21.15.104:0/3986038142 wait complete. 2024-09-17T02:54:28.879 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T02:54:29.618 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-09-17T02:54:29.619+0000 7f2dd78c8640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T02:54:29.619 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-17T02:54:29.619+0000 7fafbbb91640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T02:54:29.619 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-09-17T02:54:29.619+0000 7f2b799c1640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T02:54:29.620 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-09-17T02:54:29.620+0000 7f814b3df640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T02:54:29.622 INFO:tasks.ceph.osd.2.smithi104.stderr:2024-09-17T02:54:29.623+0000 7f2dd0ed2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:54:29.623 INFO:tasks.ceph.osd.3.smithi104.stderr:2024-09-17T02:54:29.623+0000 7f2b72fcb640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:54:29.623 INFO:tasks.ceph.osd.0.smithi104.stderr:2024-09-17T02:54:29.623+0000 7fafb519b640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:54:29.623 INFO:tasks.ceph.osd.7.smithi192.stderr:2024-09-17T02:54:29.623+0000 7f81449e9640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:54:29.624 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-09-17T02:54:29.624+0000 7fb55c8ec640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T02:54:29.624 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-09-17T02:54:29.623+0000 7f03dceab640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T02:54:29.624 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-09-17T02:54:29.623+0000 7f96fe822640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T02:54:29.624 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-09-17T02:54:29.624+0000 7f30d4f5a640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T02:54:29.626 INFO:tasks.ceph.osd.6.smithi192.stderr:2024-09-17T02:54:29.626+0000 7f03d5ca0640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:54:29.627 INFO:tasks.ceph.osd.1.smithi104.stderr:2024-09-17T02:54:29.628+0000 7fb555ef6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:54:29.629 INFO:tasks.ceph.osd.4.smithi192.stderr:2024-09-17T02:54:29.629+0000 7f30ce564640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:54:29.629 INFO:tasks.ceph.osd.5.smithi192.stderr:2024-09-17T02:54:29.629+0000 7f96f7e2c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T02:54:34.649 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:54:34.652 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:54:35.686 DEBUG:teuthology.orchestra.run.smithi104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:35.800 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.800+0000 7ff4696f9640 1 -- 172.21.15.104:0/2131312506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff450003ff0 msgr2=0x7ff450004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:35.800 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.800+0000 7ff4696f9640 1 --2- 172.21.15.104:0/2131312506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff450003ff0 0x7ff450004800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009b50 tx=0x7ff450005830 comp rx=0 tx=0).stop 2024-09-17T02:54:35.800 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.800+0000 7ff4637fe640 1 -- 172.21.15.104:0/2131312506 reap_dead start 2024-09-17T02:54:35.800 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.800+0000 7ff4696f9640 1 -- 172.21.15.104:0/2131312506 shutdown_connections 2024-09-17T02:54:35.800 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.800+0000 7ff4696f9640 1 -- 172.21.15.104:0/2131312506 >> 172.21.15.104:0/2131312506 conn(0x7ff4640b3440 msgr2=0x7ff46406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:35.801 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.800+0000 7ff4696f9640 1 -- 172.21.15.104:0/2131312506 shutdown_connections 2024-09-17T02:54:35.801 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.800+0000 7ff4696f9640 1 -- 172.21.15.104:0/2131312506 wait complete. 2024-09-17T02:54:35.801 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.802+0000 7ff4696f9640 1 Processor -- start 2024-09-17T02:54:35.801 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.802+0000 7ff4696f9640 1 -- start start 2024-09-17T02:54:35.804 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4696f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450003ff0 0x7ff4640afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:35.804 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4696f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4640b0090 0x7ff464159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:35.804 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4696f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff464159750 0x7ff4640b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4696f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff4640cffd0 con 0x7ff464159750 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4696f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4640cfe50 con 0x7ff4640b0090 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4696f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff4640d0150 con 0x7ff450003ff0 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff464159750 0x7ff4640b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff464159750 0x7ff4640b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43706/0 (socket says 172.21.15.104:43706) 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff4637fe640 1 -- 172.21.15.104:0/2659401806 learned_addr learned my addr 172.21.15.104:0/2659401806 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.803+0000 7ff462ffd640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450003ff0 0x7ff4640afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff45a7fc640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4640b0090 0x7ff464159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff4637fe640 1 -- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450003ff0 msgr2=0x7ff4640afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff4637fe640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450003ff0 0x7ff4640afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff4637fe640 1 -- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4640b0090 msgr2=0x7ff464159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff4637fe640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4640b0090 0x7ff464159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:35.805 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff4637fe640 1 -- 172.21.15.104:0/2659401806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff464131a50 con 0x7ff464159750 2024-09-17T02:54:35.806 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff4637fe640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff464159750 0x7ff4640b1cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4640751b0 tx=0x7ff45c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:35.806 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff45bfff640 1 -- 172.21.15.104:0/2659401806 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00fce0 con 0x7ff464159750 2024-09-17T02:54:35.806 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff45bfff640 1 -- 172.21.15.104:0/2659401806 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff45c00fe80 con 0x7ff464159750 2024-09-17T02:54:35.806 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff464131d30 con 0x7ff464159750 2024-09-17T02:54:35.806 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff45bfff640 1 -- 172.21.15.104:0/2659401806 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c004d60 con 0x7ff464159750 2024-09-17T02:54:35.806 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.804+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4641322f0 con 0x7ff464159750 2024-09-17T02:54:35.807 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.805+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4641317c0 con 0x7ff464159750 2024-09-17T02:54:35.807 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.806+0000 7ff45bfff640 1 -- 172.21.15.104:0/2659401806 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff45c020020 con 0x7ff464159750 2024-09-17T02:54:35.807 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.806+0000 7ff45bfff640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff444078b90 0x7ff44407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:35.807 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.806+0000 7ff45bfff640 1 -- 172.21.15.104:0/2659401806 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff45c09ad30 con 0x7ff464159750 2024-09-17T02:54:35.807 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.806+0000 7ff462ffd640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff444078b90 0x7ff44407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:35.807 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.807+0000 7ff462ffd640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff444078b90 0x7ff44407b0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff464076ee0 tx=0x7ff4540067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:35.810 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.811+0000 7ff45bfff640 1 -- 172.21.15.104:0/2659401806 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff45c062f00 con 0x7ff464159750 2024-09-17T02:54:35.984 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.984+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff46415ff70 con 0x7ff464159750 2024-09-17T02:54:35.984 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.985+0000 7ff45bfff640 1 -- 172.21.15.104:0/2659401806 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12944 (secure 0 0 0) 0x7ff45c067930 con 0x7ff464159750 2024-09-17T02:54:35.984 INFO:teuthology.misc.health.smithi104.stdout: 2024-09-17T02:54:35.985 INFO:teuthology.misc.health.smithi104.stdout:{"epoch":17,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:34.659080+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:35.989 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff444078b90 msgr2=0x7ff44407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:35.989 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff444078b90 0x7ff44407b0a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff464076ee0 tx=0x7ff4540067a0 comp rx=0 tx=0).stop 2024-09-17T02:54:35.989 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff464159750 msgr2=0x7ff4640b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff464159750 0x7ff4640b1cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4640751b0 tx=0x7ff45c011f90 comp rx=0 tx=0).stop 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 shutdown_connections 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff444078b90 0x7ff44407b0a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4640b0090 0x7ff464159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff464159750 0x7ff4640b1cf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 --2- 172.21.15.104:0/2659401806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff450003ff0 0x7ff4640afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 >> 172.21.15.104:0/2659401806 conn(0x7ff4640b3440 msgr2=0x7ff464141760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 shutdown_connections 2024-09-17T02:54:35.990 INFO:teuthology.misc.health.smithi104.stderr:2024-09-17T02:54:35.987+0000 7ff4696f9640 1 -- 172.21.15.104:0/2659401806 wait complete. 2024-09-17T02:54:35.996 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T02:54:35.997 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T02:54:35.997 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T02:54:35.997 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T02:54:35.999 INFO:tasks.ceph.mds.a:Started 2024-09-17T02:54:36.000 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T02:54:36.000 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T02:54:36.002 INFO:tasks.ceph.mds.c:Started 2024-09-17T02:54:36.002 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T02:54:36.002 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T02:54:36.004 INFO:tasks.ceph.mds.b:Started 2024-09-17T02:54:36.005 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T02:54:36.005 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T02:54:36.007 INFO:tasks.ceph.mds.d:Started 2024-09-17T02:54:36.007 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T02:54:36.007 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:54:36.085 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T02:54:36.086 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:54:36.103 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T02:54:36.105 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T02:54:36.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.127+0000 7fcd67e84640 1 -- 172.21.15.104:0/4019804145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd60152cd0 msgr2=0x7fcd600b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:36.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.127+0000 7fcd67e84640 1 --2- 172.21.15.104:0/4019804145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd60152cd0 0x7fcd600b5200 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c005fd0 tx=0x7fcd5c02a540 comp rx=0 tx=0).stop 2024-09-17T02:54:36.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.127+0000 7fcd67e84640 1 -- 172.21.15.104:0/4019804145 shutdown_connections 2024-09-17T02:54:36.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.127+0000 7fcd67e84640 1 --2- 172.21.15.104:0/4019804145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd6015c060 0x7fcd6015c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.127+0000 7fcd67e84640 1 --2- 172.21.15.104:0/4019804145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd60152cd0 0x7fcd600b5200 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.127+0000 7fcd67e84640 1 -- 172.21.15.104:0/4019804145 >> 172.21.15.104:0/4019804145 conn(0x7fcd600b35d0 msgr2=0x7fcd600b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:36.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.127+0000 7fcd67e84640 1 -- 172.21.15.104:0/4019804145 shutdown_connections 2024-09-17T02:54:36.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.127+0000 7fcd67e84640 1 -- 172.21.15.104:0/4019804145 wait complete. 2024-09-17T02:54:36.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.129+0000 7fcd67e84640 1 Processor -- start 2024-09-17T02:54:36.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.129+0000 7fcd67e84640 1 -- start start 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd67e84640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd60073560 0x7fcd60153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd67e84640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd60152cd0 0x7fcd60148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd67e84640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd6015c060 0x7fcd601557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd67e84640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6006f7d0 con 0x7fcd6015c060 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd67e84640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6006f650 con 0x7fcd60073560 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd67e84640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcd6006f950 con 0x7fcd60152cd0 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd66421640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd6015c060 0x7fcd601557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd66421640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd6015c060 0x7fcd601557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43740/0 (socket says 172.21.15.104:43740) 2024-09-17T02:54:36.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd66421640 1 -- 172.21.15.104:0/3739702680 learned_addr learned my addr 172.21.15.104:0/3739702680 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd65c20640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd60073560 0x7fcd60153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.130+0000 7fcd6541f640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd60152cd0 0x7fcd60148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd66421640 1 -- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd60152cd0 msgr2=0x7fcd60148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd66421640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd60152cd0 0x7fcd60148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd66421640 1 -- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd60073560 msgr2=0x7fcd60153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd66421640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd60073560 0x7fcd60153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd66421640 1 -- 172.21.15.104:0/3739702680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd60153f90 con 0x7fcd6015c060 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd66421640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd6015c060 0x7fcd601557c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c730 tx=0x7fcd5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd567fc640 1 -- 172.21.15.104:0/3739702680 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd58003b70 con 0x7fcd6015c060 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd567fc640 1 -- 172.21.15.104:0/3739702680 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd58003d30 con 0x7fcd6015c060 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd601f2fa0 con 0x7fcd6015c060 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd567fc640 1 -- 172.21.15.104:0/3739702680 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd580052d0 con 0x7fcd6015c060 2024-09-17T02:54:36.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.131+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd601f3560 con 0x7fcd6015c060 2024-09-17T02:54:36.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.132+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6006fe00 con 0x7fcd6015c060 2024-09-17T02:54:36.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.133+0000 7fcd567fc640 1 -- 172.21.15.104:0/3739702680 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd58005470 con 0x7fcd6015c060 2024-09-17T02:54:36.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.133+0000 7fcd567fc640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd44078b90 0x7fcd4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:36.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.134+0000 7fcd567fc640 1 -- 172.21.15.104:0/3739702680 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fcd5809a680 con 0x7fcd6015c060 2024-09-17T02:54:36.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.134+0000 7fcd65c20640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd44078b90 0x7fcd4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:36.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.134+0000 7fcd65c20640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd44078b90 0x7fcd4407b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c033000 tx=0x7fcd5c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:36.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.138+0000 7fcd567fc640 1 -- 172.21.15.104:0/3739702680 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcd580627c0 con 0x7fcd6015c060 2024-09-17T02:54:36.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.347+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd600b6120 con 0x7fcd6015c060 2024-09-17T02:54:36.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.347+0000 7fcd567fc640 1 -- 172.21.15.104:0/3739702680 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7fcd580671f0 con 0x7fcd6015c060 2024-09-17T02:54:36.347 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:36.348 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":2,"btime":"2024-09-17T02:54:36:091689+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T02:54:36.348 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 2 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd44078b90 msgr2=0x7fcd4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd44078b90 0x7fcd4407b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c033000 tx=0x7fcd5c004730 comp rx=0 tx=0).stop 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd6015c060 msgr2=0x7fcd601557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd6015c060 0x7fcd601557c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800c730 tx=0x7fcd5800cbf0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 shutdown_connections 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd44078b90 0x7fcd4407b0a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd6015c060 0x7fcd601557c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd60152cd0 0x7fcd60148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 --2- 172.21.15.104:0/3739702680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd60073560 0x7fcd60153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 >> 172.21.15.104:0/3739702680 conn(0x7fcd600b35d0 msgr2=0x7fcd600b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:36.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 shutdown_connections 2024-09-17T02:54:36.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:36.350+0000 7fcd67e84640 1 -- 172.21.15.104:0/3739702680 wait complete. 2024-09-17T02:54:38.361 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:54:38.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.487+0000 7fefc0069640 1 -- 172.21.15.104:0/3343421263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb80b6ae0 msgr2=0x7fefb81600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:38.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.487+0000 7fefc0069640 1 --2- 172.21.15.104:0/3343421263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb80b6ae0 0x7fefb81600c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fefb0005fd0 tx=0x7fefb002aa90 comp rx=0 tx=0).stop 2024-09-17T02:54:38.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.487+0000 7fefc0069640 1 -- 172.21.15.104:0/3343421263 shutdown_connections 2024-09-17T02:54:38.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.487+0000 7fefc0069640 1 --2- 172.21.15.104:0/3343421263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb80b6ae0 0x7fefb81600c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.487+0000 7fefc0069640 1 --2- 172.21.15.104:0/3343421263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefb8162cb0 0x7fefb80b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.487+0000 7fefc0069640 1 -- 172.21.15.104:0/3343421263 >> 172.21.15.104:0/3343421263 conn(0x7fefb8069120 msgr2=0x7fefb8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:38.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.487+0000 7fefc0069640 1 -- 172.21.15.104:0/3343421263 shutdown_connections 2024-09-17T02:54:38.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.487+0000 7fefc0069640 1 -- 172.21.15.104:0/3343421263 wait complete. 2024-09-17T02:54:38.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.489+0000 7fefc0069640 1 Processor -- start 2024-09-17T02:54:38.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.489+0000 7fefc0069640 1 -- start start 2024-09-17T02:54:38.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.490+0000 7fefc0069640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefb80b6ae0 0x7fefb8153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.490+0000 7fefc0069640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefb8162cb0 0x7fefb8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.490+0000 7fefc0069640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb81630c0 0x7fefb80ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.490+0000 7fefc0069640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fefb8161e10 con 0x7fefb81630c0 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.490+0000 7fefc0069640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fefb8161c90 con 0x7fefb80b6ae0 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.490+0000 7fefc0069640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fefb8161f90 con 0x7fefb8162cb0 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb81630c0 0x7fefb80ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb81630c0 0x7fefb80ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43758/0 (socket says 172.21.15.104:43758) 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 -- 172.21.15.104:0/419433534 learned_addr learned my addr 172.21.15.104:0/419433534 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbde05640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefb80b6ae0 0x7fefb8153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbd604640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefb8162cb0 0x7fefb8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 -- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefb8162cb0 msgr2=0x7fefb8156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefb8162cb0 0x7fefb8156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 -- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefb80b6ae0 msgr2=0x7fefb8153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefb80b6ae0 0x7fefb8153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 -- 172.21.15.104:0/419433534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb81f9bb0 con 0x7fefb81630c0 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefbe606640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb81630c0 0x7fefb80ce390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefb0006010 tx=0x7fefb0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefb67fc640 1 -- 172.21.15.104:0/419433534 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0044070 con 0x7fefb81630c0 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefb67fc640 1 -- 172.21.15.104:0/419433534 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefb002e7f0 con 0x7fefb81630c0 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb81541a0 con 0x7fefb81630c0 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefb67fc640 1 -- 172.21.15.104:0/419433534 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb00044b0 con 0x7fefb81630c0 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.491+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb81fa390 con 0x7fefb81630c0 2024-09-17T02:54:38.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.492+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb815dc20 con 0x7fefb81630c0 2024-09-17T02:54:38.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.493+0000 7fefb67fc640 1 -- 172.21.15.104:0/419433534 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fefb0047070 con 0x7fefb81630c0 2024-09-17T02:54:38.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.494+0000 7fefb67fc640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefa4078bc0 0x7fefa407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:38.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.494+0000 7fefb67fc640 1 -- 172.21.15.104:0/419433534 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fefb00bba70 con 0x7fefb81630c0 2024-09-17T02:54:38.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.494+0000 7fefbde05640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefa4078bc0 0x7fefa407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:38.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.494+0000 7fefbde05640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefa4078bc0 0x7fefa407b0d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fefa800bb30 tx=0x7fefa800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:38.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.497+0000 7fefb67fc640 1 -- 172.21.15.104:0/419433534 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fefb815dc20 con 0x7fefb81630c0 2024-09-17T02:54:38.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.704+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefb8162440 con 0x7fefb81630c0 2024-09-17T02:54:38.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.705+0000 7fefb67fc640 1 -- 172.21.15.104:0/419433534 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7fefb004e080 con 0x7fefb81630c0 2024-09-17T02:54:38.705 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:38.705 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":3,"btime":"2024-09-17T02:54:37:094966+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4378,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T02:54:38.705 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 3 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefa4078bc0 msgr2=0x7fefa407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefa4078bc0 0x7fefa407b0d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fefa800bb30 tx=0x7fefa800b2e0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb81630c0 msgr2=0x7fefb80ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb81630c0 0x7fefb80ce390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fefb0006010 tx=0x7fefb0003f10 comp rx=0 tx=0).stop 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 shutdown_connections 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefa4078bc0 0x7fefa407b0d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefb81630c0 0x7fefb80ce390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefb8162cb0 0x7fefb8156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 --2- 172.21.15.104:0/419433534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefb80b6ae0 0x7fefb8153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 >> 172.21.15.104:0/419433534 conn(0x7fefb8069120 msgr2=0x7fefb80d4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:38.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 shutdown_connections 2024-09-17T02:54:38.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.707+0000 7fefc0069640 1 -- 172.21.15.104:0/419433534 wait complete. 2024-09-17T02:54:38.718 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T02:54:38.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 -- 172.21.15.104:0/4006420876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b3f00 msgr2=0x7fb7e80b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:38.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 --2- 172.21.15.104:0/4006420876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b3f00 0x7fb7e80b57e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80d3a70 tx=0x7fb7d802a560 comp rx=0 tx=0).stop 2024-09-17T02:54:38.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 -- 172.21.15.104:0/4006420876 shutdown_connections 2024-09-17T02:54:38.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 --2- 172.21.15.104:0/4006420876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7e80b5d20 0x7fb7e80cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 --2- 172.21.15.104:0/4006420876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b3f00 0x7fb7e80b57e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 --2- 172.21.15.104:0/4006420876 >> v2:172.21.15.192:3300/0 conn(0x7fb7e80b4fc0 0x7fb7e80b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 -- 172.21.15.104:0/4006420876 >> 172.21.15.104:0/4006420876 conn(0x7fb7e80b44a0 msgr2=0x7fb7e80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:38.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 -- 172.21.15.104:0/4006420876 shutdown_connections 2024-09-17T02:54:38.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.830+0000 7fb7eee94640 1 -- 172.21.15.104:0/4006420876 wait complete. 2024-09-17T02:54:38.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.831+0000 7fb7eee94640 1 Processor -- start 2024-09-17T02:54:38.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.831+0000 7fb7eee94640 1 -- start start 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7eee94640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7e80b3f00 0x7fb7e80b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7eee94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e80b4fc0 0x7fb7e815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7eee94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b5d20 0x7fb7e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7eee94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80cdf10 con 0x7fb7e80b5d20 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7eee94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80d0310 con 0x7fb7e80b4fc0 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7eee94640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e80ce090 con 0x7fb7e80b3f00 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b5d20 0x7fb7e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b5d20 0x7fb7e806e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43764/0 (socket says 172.21.15.104:43764) 2024-09-17T02:54:38.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 -- 172.21.15.104:0/3847481960 learned_addr learned my addr 172.21.15.104:0/3847481960 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ecc30640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7e80b3f00 0x7fb7e80b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7dffff640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e80b4fc0 0x7fb7e815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 -- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7e80b3f00 msgr2=0x7fb7e80b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7e80b3f00 0x7fb7e80b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 -- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e80b4fc0 msgr2=0x7fb7e815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e80b4fc0 0x7fb7e815ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 -- 172.21.15.104:0/3847481960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e80b24a0 con 0x7fb7e80b5d20 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.833+0000 7fb7ed431640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b5d20 0x7fb7e806e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000e990 tx=0x7fb7e000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.834+0000 7fb7dd7fa640 1 -- 172.21.15.104:0/3847481960 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0004d20 con 0x7fb7e80b5d20 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.834+0000 7fb7dd7fa640 1 -- 172.21.15.104:0/3847481960 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7e000caa0 con 0x7fb7e80b5d20 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.834+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e806d6d0 con 0x7fb7e80b5d20 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.834+0000 7fb7dd7fa640 1 -- 172.21.15.104:0/3847481960 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0005020 con 0x7fb7e80b5d20 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.834+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e806dc90 con 0x7fb7e80b5d20 2024-09-17T02:54:38.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.835+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e80b39c0 con 0x7fb7e80b5d20 2024-09-17T02:54:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.835+0000 7fb7dd7fa640 1 -- 172.21.15.104:0/3847481960 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb7e00051c0 con 0x7fb7e80b5d20 2024-09-17T02:54:38.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.836+0000 7fb7dd7fa640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb7d4078b90 0x7fb7d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:38.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.836+0000 7fb7dd7fa640 1 -- 172.21.15.104:0/3847481960 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb7e009b240 con 0x7fb7e80b5d20 2024-09-17T02:54:38.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.836+0000 7fb7ecc30640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb7d4078b90 0x7fb7d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:38.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.836+0000 7fb7ecc30640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb7d4078b90 0x7fb7d407b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400bb50 tx=0x7fb7e400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:38.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:38.840+0000 7fb7dd7fa640 1 -- 172.21.15.104:0/3847481960 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb7e0016030 con 0x7fb7e80b5d20 2024-09-17T02:54:39.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.014+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb7e80cead0 con 0x7fb7e80b5d20 2024-09-17T02:54:39.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.014+0000 7fb7dd7fa640 1 -- 172.21.15.104:0/3847481960 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fb7e0063380 con 0x7fb7e80b5d20 2024-09-17T02:54:39.014 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:39.014 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T02:54:39.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:54:39.014 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T02:54:39.014 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T02:54:39.014 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:54:39.014 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T02:54:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb7d4078b90 msgr2=0x7fb7d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb7d4078b90 0x7fb7d407b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400bb50 tx=0x7fb7e400b2e0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b5d20 msgr2=0x7fb7e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b5d20 0x7fb7e806e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000e990 tx=0x7fb7e000ee50 comp rx=0 tx=0).stop 2024-09-17T02:54:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 shutdown_connections 2024-09-17T02:54:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb7d4078b90 0x7fb7d407b0a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e80b4fc0 0x7fb7e815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7e80b5d20 0x7fb7e806e770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 --2- 172.21.15.104:0/3847481960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7e80b3f00 0x7fb7e80b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 >> 172.21.15.104:0/3847481960 conn(0x7fb7e80b44a0 msgr2=0x7fb7e80c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 shutdown_connections 2024-09-17T02:54:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.016+0000 7fb7eee94640 1 -- 172.21.15.104:0/3847481960 wait complete. 2024-09-17T02:54:39.027 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T02:54:39.027 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T02:54:39.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 -- 172.21.15.104:0/159058761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9140b4600 msgr2=0x7fc91415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:39.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 --2- 172.21.15.104:0/159058761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9140b4600 0x7fc91415fa30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc91406e8c0 tx=0x7fc90c02a560 comp rx=0 tx=0).stop 2024-09-17T02:54:39.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 -- 172.21.15.104:0/159058761 shutdown_connections 2024-09-17T02:54:39.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 --2- 172.21.15.104:0/159058761 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9140b4600 0x7fc91415fa30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 --2- 172.21.15.104:0/159058761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9140766b0 0x7fc9140b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 --2- 172.21.15.104:0/159058761 >> v2:172.21.15.192:3300/0 conn(0x7fc914074d60 0x7fc91415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 -- 172.21.15.104:0/159058761 >> 172.21.15.104:0/159058761 conn(0x7fc914074240 msgr2=0x7fc914074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:39.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 -- 172.21.15.104:0/159058761 shutdown_connections 2024-09-17T02:54:39.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.144+0000 7fc91bb50640 1 -- 172.21.15.104:0/159058761 wait complete. 2024-09-17T02:54:39.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.146+0000 7fc91bb50640 1 Processor -- start 2024-09-17T02:54:39.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.146+0000 7fc91bb50640 1 -- start start 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc91bb50640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc914074d60 0x7fc914154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc91bb50640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9140766b0 0x7fc9140cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc91bb50640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9140b4600 0x7fc914151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc91bb50640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc914160300 con 0x7fc914074d60 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc91bb50640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc914160180 con 0x7fc9140b4600 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc91bb50640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc914160480 con 0x7fc9140766b0 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc9198ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc914074d60 0x7fc914154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc9198ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc914074d60 0x7fc914154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43782/0 (socket says 172.21.15.104:43782) 2024-09-17T02:54:39.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.147+0000 7fc9198ec640 1 -- 172.21.15.104:0/3811511337 learned_addr learned my addr 172.21.15.104:0/3811511337 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9190eb640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9140766b0 0x7fc9140cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc91a0ed640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9140b4600 0x7fc914151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9198ec640 1 -- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9140766b0 msgr2=0x7fc9140cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9198ec640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9140766b0 0x7fc9140cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9198ec640 1 -- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9140b4600 msgr2=0x7fc914151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9198ec640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9140b4600 0x7fc914151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9198ec640 1 -- 172.21.15.104:0/3811511337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9141f7150 con 0x7fc914074d60 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9198ec640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc914074d60 0x7fc914154ba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc904005fd0 tx=0x7fc90400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9127fc640 1 -- 172.21.15.104:0/3811511337 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90400f450 con 0x7fc914074d60 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9127fc640 1 -- 172.21.15.104:0/3811511337 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc90400f6e0 con 0x7fc914074d60 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9141f7430 con 0x7fc914074d60 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc9127fc640 1 -- 172.21.15.104:0/3811511337 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90400fb10 con 0x7fc914074d60 2024-09-17T02:54:39.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.148+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc914151b60 con 0x7fc914074d60 2024-09-17T02:54:39.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.149+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9140b40c0 con 0x7fc914074d60 2024-09-17T02:54:39.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.150+0000 7fc9127fc640 1 -- 172.21.15.104:0/3811511337 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc90400fcb0 con 0x7fc914074d60 2024-09-17T02:54:39.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.150+0000 7fc9127fc640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc900078b90 0x7fc90007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:39.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.150+0000 7fc9127fc640 1 -- 172.21.15.104:0/3811511337 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc90409b550 con 0x7fc914074d60 2024-09-17T02:54:39.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.150+0000 7fc9190eb640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc900078b90 0x7fc90007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:39.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.151+0000 7fc9190eb640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc900078b90 0x7fc90007b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc908005fd0 tx=0x7fc908005d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:39.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.155+0000 7fc9127fc640 1 -- 172.21.15.104:0/3811511337 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc904014030 con 0x7fc914074d60 2024-09-17T02:54:39.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:39.329+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc9140d0e80 con 0x7fc914074d60 2024-09-17T02:54:40.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.113+0000 7fc9127fc640 1 -- 172.21.15.104:0/3811511337 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fc904063ce0 con 0x7fc914074d60 2024-09-17T02:54:40.113 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T02:54:40.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.116+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc900078b90 msgr2=0x7fc90007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:40.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.116+0000 7fc91bb50640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc900078b90 0x7fc90007b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc908005fd0 tx=0x7fc908005d80 comp rx=0 tx=0).stop 2024-09-17T02:54:40.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.116+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc914074d60 msgr2=0x7fc914154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:40.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.116+0000 7fc91bb50640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc914074d60 0x7fc914154ba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc904005fd0 tx=0x7fc90400a620 comp rx=0 tx=0).stop 2024-09-17T02:54:40.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.117+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 shutdown_connections 2024-09-17T02:54:40.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.117+0000 7fc91bb50640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc900078b90 0x7fc90007b0a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:40.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.117+0000 7fc91bb50640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9140b4600 0x7fc914151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:40.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.117+0000 7fc91bb50640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9140766b0 0x7fc9140cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:40.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.117+0000 7fc91bb50640 1 --2- 172.21.15.104:0/3811511337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc914074d60 0x7fc914154ba0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:40.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.117+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 >> 172.21.15.104:0/3811511337 conn(0x7fc914074240 msgr2=0x7fc9140b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:40.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.117+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 shutdown_connections 2024-09-17T02:54:40.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.117+0000 7fc91bb50640 1 -- 172.21.15.104:0/3811511337 wait complete. 2024-09-17T02:54:40.131 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T02:54:40.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.258+0000 7fe72cff1640 1 -- 172.21.15.104:0/2881164206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe728073580 msgr2=0x7fe728073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:40.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.258+0000 7fe72cff1640 1 --2- 172.21.15.104:0/2881164206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe728073580 0x7fe728073990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe728070b10 tx=0x7fe71002a560 comp rx=0 tx=0).stop 2024-09-17T02:54:40.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.258+0000 7fe72cff1640 1 -- 172.21.15.104:0/2881164206 shutdown_connections 2024-09-17T02:54:40.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.258+0000 7fe72cff1640 1 --2- 172.21.15.104:0/2881164206 >> v2:172.21.15.192:3300/0 conn(0x7fe7280b4ce0 0x7fe7280b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:40.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.258+0000 7fe72cff1640 1 --2- 172.21.15.104:0/2881164206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe728073580 0x7fe728073990 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:40.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.258+0000 7fe72cff1640 1 -- 172.21.15.104:0/2881164206 >> 172.21.15.104:0/2881164206 conn(0x7fe7280b3640 msgr2=0x7fe7280b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:40.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.258+0000 7fe72cff1640 1 -- 172.21.15.104:0/2881164206 shutdown_connections 2024-09-17T02:54:40.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.258+0000 7fe72cff1640 1 -- 172.21.15.104:0/2881164206 wait complete. 2024-09-17T02:54:40.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.260+0000 7fe72cff1640 1 Processor -- start 2024-09-17T02:54:40.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.260+0000 7fe72cff1640 1 -- start start 2024-09-17T02:54:40.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.261+0000 7fe72cff1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe728073580 0x7fe7281f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:40.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.261+0000 7fe72cff1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7280b4ce0 0x7fe728142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:40.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.261+0000 7fe72cff1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe728152ce0 0x7fe728145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:40.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe72cff1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280b59c0 con 0x7fe7280b4ce0 2024-09-17T02:54:40.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe72cff1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280b5840 con 0x7fe728073580 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe72cff1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe7280b5b40 con 0x7fe728152ce0 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7280b4ce0 0x7fe728142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7280b4ce0 0x7fe728142a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43790/0 (socket says 172.21.15.104:43790) 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 -- 172.21.15.104:0/3371415050 learned_addr learned my addr 172.21.15.104:0/3371415050 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe72659c640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe728073580 0x7fe7281f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe726d9d640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe728152ce0 0x7fe728145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 -- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe728152ce0 msgr2=0x7fe728145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe728152ce0 0x7fe728145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 -- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe728073580 msgr2=0x7fe7281f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe728073580 0x7fe7281f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 -- 172.21.15.104:0/3371415050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe728145540 con 0x7fe7280b4ce0 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe725d9b640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7280b4ce0 0x7fe728142a20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe710034040 tx=0x7fe710003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe71effd640 1 -- 172.21.15.104:0/3371415050 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71003e030 con 0x7fe7280b4ce0 2024-09-17T02:54:40.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe71effd640 1 -- 172.21.15.104:0/3371415050 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe710003e00 con 0x7fe7280b4ce0 2024-09-17T02:54:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7281f9bf0 con 0x7fe7280b4ce0 2024-09-17T02:54:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.262+0000 7fe71effd640 1 -- 172.21.15.104:0/3371415050 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710035040 con 0x7fe7280b4ce0 2024-09-17T02:54:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.263+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7281fa1b0 con 0x7fe7280b4ce0 2024-09-17T02:54:40.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.263+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7281f9960 con 0x7fe7280b4ce0 2024-09-17T02:54:40.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.264+0000 7fe71effd640 1 -- 172.21.15.104:0/3371415050 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe710041030 con 0x7fe7280b4ce0 2024-09-17T02:54:40.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.265+0000 7fe71effd640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe708078bc0 0x7fe70807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:40.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.265+0000 7fe71effd640 1 -- 172.21.15.104:0/3371415050 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fe7100bb700 con 0x7fe7280b4ce0 2024-09-17T02:54:40.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.265+0000 7fe72659c640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe708078bc0 0x7fe70807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:40.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.265+0000 7fe72659c640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe708078bc0 0x7fe70807b0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7180012e0 tx=0x7fe718009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:40.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.269+0000 7fe71effd640 1 -- 172.21.15.104:0/3371415050 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe7100837b0 con 0x7fe7280b4ce0 2024-09-17T02:54:40.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:40.442+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe728151bb0 con 0x7fe7280b4ce0 2024-09-17T02:54:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.115+0000 7fe71effd640 1 -- 172.21.15.104:0/3371415050 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fe7100881e0 con 0x7fe7280b4ce0 2024-09-17T02:54:41.115 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T02:54:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe708078bc0 msgr2=0x7fe70807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe708078bc0 0x7fe70807b0d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7180012e0 tx=0x7fe718009040 comp rx=0 tx=0).stop 2024-09-17T02:54:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7280b4ce0 msgr2=0x7fe728142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7280b4ce0 0x7fe728142a20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe710034040 tx=0x7fe710003910 comp rx=0 tx=0).stop 2024-09-17T02:54:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 shutdown_connections 2024-09-17T02:54:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe708078bc0 0x7fe70807b0d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe728152ce0 0x7fe728145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7280b4ce0 0x7fe728142a20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 --2- 172.21.15.104:0/3371415050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe728073580 0x7fe7281f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 >> 172.21.15.104:0/3371415050 conn(0x7fe7280b3640 msgr2=0x7fe728155190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 shutdown_connections 2024-09-17T02:54:41.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.118+0000 7fe72cff1640 1 -- 172.21.15.104:0/3371415050 wait complete. 2024-09-17T02:54:41.141 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T02:54:41.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.261+0000 7fb5a54f9640 1 -- 172.21.15.104:0/1968449909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00d1180 msgr2=0x7fb5a00d1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:41.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.261+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/1968449909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00d1180 0x7fb5a00d1590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb594005fd0 tx=0x7fb59402a540 comp rx=0 tx=0).stop 2024-09-17T02:54:41.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.261+0000 7fb5a54f9640 1 -- 172.21.15.104:0/1968449909 shutdown_connections 2024-09-17T02:54:41.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.261+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/1968449909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00d1180 0x7fb5a00d1590 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:41.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.261+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/1968449909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5a00b7ae0 0x7fb5a00b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:41.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.261+0000 7fb5a54f9640 1 -- 172.21.15.104:0/1968449909 >> 172.21.15.104:0/1968449909 conn(0x7fb5a00d28e0 msgr2=0x7fb5a00d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:41.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.261+0000 7fb5a54f9640 1 -- 172.21.15.104:0/1968449909 shutdown_connections 2024-09-17T02:54:41.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.261+0000 7fb5a54f9640 1 -- 172.21.15.104:0/1968449909 wait complete. 2024-09-17T02:54:41.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.263+0000 7fb5a54f9640 1 Processor -- start 2024-09-17T02:54:41.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.263+0000 7fb5a54f9640 1 -- start start 2024-09-17T02:54:41.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb5a54f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5a00b7ae0 0x7fb5a00b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:41.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb5a54f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00cdad0 0x7fb5a015f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb5a54f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5a00d1180 0x7fb5a009f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb5a54f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a00cf380 con 0x7fb5a00cdad0 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb5a54f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a00cf200 con 0x7fb5a00d1180 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb5a54f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a00cf500 con 0x7fb5a00b7ae0 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00cdad0 0x7fb5a015f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00cdad0 0x7fb5a015f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43808/0 (socket says 172.21.15.104:43808) 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59e7fc640 1 -- 172.21.15.104:0/817437524 learned_addr learned my addr 172.21.15.104:0/817437524 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59f7fe640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5a00d1180 0x7fb5a009f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59effd640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5a00b7ae0 0x7fb5a00b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59e7fc640 1 -- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5a00b7ae0 msgr2=0x7fb5a00b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59e7fc640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5a00b7ae0 0x7fb5a00b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:41.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59e7fc640 1 -- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5a00d1180 msgr2=0x7fb5a009f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59e7fc640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5a00d1180 0x7fb5a009f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59e7fc640 1 -- 172.21.15.104:0/817437524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a00b0aa0 con 0x7fb5a00cdad0 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.264+0000 7fb59effd640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5a00b7ae0 0x7fb5a00b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.265+0000 7fb59e7fc640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00cdad0 0x7fb5a015f910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb594034040 tx=0x7fb5940038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.265+0000 7fb5877fe640 1 -- 172.21.15.104:0/817437524 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59403e030 con 0x7fb5a00cdad0 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.265+0000 7fb5877fe640 1 -- 172.21.15.104:0/817437524 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb594003d90 con 0x7fb5a00cdad0 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.265+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a00b0d80 con 0x7fb5a00cdad0 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.265+0000 7fb5877fe640 1 -- 172.21.15.104:0/817437524 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594035040 con 0x7fb5a00cdad0 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.265+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a009f020 con 0x7fb5a00cdad0 2024-09-17T02:54:41.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.266+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a00b5730 con 0x7fb5a00cdad0 2024-09-17T02:54:41.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.267+0000 7fb5877fe640 1 -- 172.21.15.104:0/817437524 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb594041030 con 0x7fb5a00cdad0 2024-09-17T02:54:41.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.267+0000 7fb5877fe640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb58c078b90 0x7fb58c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:41.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.267+0000 7fb5877fe640 1 -- 172.21.15.104:0/817437524 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fb5940bb870 con 0x7fb5a00cdad0 2024-09-17T02:54:41.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.267+0000 7fb59effd640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb58c078b90 0x7fb58c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:41.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.268+0000 7fb59effd640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb58c078b90 0x7fb58c07b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb590009a80 tx=0x7fb590005cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:41.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.272+0000 7fb5877fe640 1 -- 172.21.15.104:0/817437524 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb594083d10 con 0x7fb5a00cdad0 2024-09-17T02:54:41.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:41.481+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb5a015e090 con 0x7fb5a00cdad0 2024-09-17T02:54:42.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.141+0000 7fb5877fe640 1 -- 172.21.15.104:0/817437524 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb594083610 con 0x7fb5a00cdad0 2024-09-17T02:54:42.141 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T02:54:42.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb58c078b90 msgr2=0x7fb58c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb58c078b90 0x7fb58c07b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb590009a80 tx=0x7fb590005cc0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00cdad0 msgr2=0x7fb5a015f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00cdad0 0x7fb5a015f910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb594034040 tx=0x7fb5940038a0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 shutdown_connections 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb58c078b90 0x7fb58c07b0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5a00d1180 0x7fb5a009f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5a00cdad0 0x7fb5a015f910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 --2- 172.21.15.104:0/817437524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5a00b7ae0 0x7fb5a00b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 >> 172.21.15.104:0/817437524 conn(0x7fb5a00d28e0 msgr2=0x7fb5a0070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 shutdown_connections 2024-09-17T02:54:42.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.148+0000 7fb5a54f9640 1 -- 172.21.15.104:0/817437524 wait complete. 2024-09-17T02:54:42.163 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.277+0000 7f3dcaba1640 1 -- 172.21.15.104:0/3291573198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc40b65e0 msgr2=0x7f3dc40b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.277+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/3291573198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc40b65e0 0x7f3dc40b69f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3dc408dde0 tx=0x7f3db402aa30 comp rx=0 tx=0).stop 2024-09-17T02:54:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.277+0000 7f3dcaba1640 1 -- 172.21.15.104:0/3291573198 shutdown_connections 2024-09-17T02:54:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.277+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/3291573198 >> v2:172.21.15.192:3300/0 conn(0x7f3dc415fd10 0x7f3dc4161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.277+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/3291573198 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc40b65e0 0x7f3dc40b69f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.277+0000 7f3dcaba1640 1 -- 172.21.15.104:0/3291573198 >> 172.21.15.104:0/3291573198 conn(0x7f3dc4069120 msgr2=0x7f3dc4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.277+0000 7f3dcaba1640 1 -- 172.21.15.104:0/3291573198 shutdown_connections 2024-09-17T02:54:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.277+0000 7f3dcaba1640 1 -- 172.21.15.104:0/3291573198 wait complete. 2024-09-17T02:54:42.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.279+0000 7f3dcaba1640 1 Processor -- start 2024-09-17T02:54:42.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.279+0000 7f3dcaba1640 1 -- start start 2024-09-17T02:54:42.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dcaba1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dc40b65e0 0x7f3dc414cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dcaba1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc415f1f0 0x7f3dc40ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dcaba1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc415fd10 0x7f3dc40b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dcaba1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4161d90 con 0x7f3dc415f1f0 2024-09-17T02:54:42.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dcaba1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4161c10 con 0x7f3dc415fd10 2024-09-17T02:54:42.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dcaba1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc4161f10 con 0x7f3dc40b65e0 2024-09-17T02:54:42.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dc3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc415f1f0 0x7f3dc40ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dc3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc415f1f0 0x7f3dc40ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43832/0 (socket says 172.21.15.104:43832) 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dc3fff640 1 -- 172.21.15.104:0/579163396 learned_addr learned my addr 172.21.15.104:0/579163396 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dc913e640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc415fd10 0x7f3dc40b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.280+0000 7f3dc893d640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dc40b65e0 0x7f3dc414cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc3fff640 1 -- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dc40b65e0 msgr2=0x7f3dc414cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc3fff640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dc40b65e0 0x7f3dc414cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc3fff640 1 -- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc415fd10 msgr2=0x7f3dc40b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc3fff640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc415fd10 0x7f3dc40b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc3fff640 1 -- 172.21.15.104:0/579163396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc41f6110 con 0x7f3dc415f1f0 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc3fff640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc415f1f0 0x7f3dc40ca450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00c3c0 tx=0x7f3dac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc17fa640 1 -- 172.21.15.104:0/579163396 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac017070 con 0x7f3dc415f1f0 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc17fa640 1 -- 172.21.15.104:0/579163396 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dac0035f0 con 0x7f3dc415f1f0 2024-09-17T02:54:42.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dc17fa640 1 -- 172.21.15.104:0/579163396 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac003a40 con 0x7f3dc415f1f0 2024-09-17T02:54:42.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc41f6390 con 0x7f3dc415f1f0 2024-09-17T02:54:42.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.281+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc41f6950 con 0x7f3dc415f1f0 2024-09-17T02:54:42.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.282+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc40caf30 con 0x7f3dc415f1f0 2024-09-17T02:54:42.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.283+0000 7f3dc17fa640 1 -- 172.21.15.104:0/579163396 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3dac01a070 con 0x7f3dc415f1f0 2024-09-17T02:54:42.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.283+0000 7f3dc17fa640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3da4078b90 0x7f3da407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.283+0000 7f3dc17fa640 1 -- 172.21.15.104:0/579163396 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3dac099f00 con 0x7f3dc415f1f0 2024-09-17T02:54:42.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.283+0000 7f3dc893d640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3da4078b90 0x7f3da407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.284+0000 7f3dc893d640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3da4078b90 0x7f3da407b0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3db4035000 tx=0x7f3db403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:42.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.288+0000 7f3dc17fa640 1 -- 172.21.15.104:0/579163396 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3dc41f6110 con 0x7f3dc415f1f0 2024-09-17T02:54:42.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.463+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3dc4162430 con 0x7f3dc415f1f0 2024-09-17T02:54:42.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.464+0000 7f3dc17fa640 1 -- 172.21.15.104:0/579163396 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16726 (secure 0 0 0) 0x7f3dc40b6f30 con 0x7f3dc415f1f0 2024-09-17T02:54:42.465 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:42.465 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:41.483680+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:42.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3da4078b90 msgr2=0x7f3da407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3da4078b90 0x7f3da407b0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3db4035000 tx=0x7f3db403b040 comp rx=0 tx=0).stop 2024-09-17T02:54:42.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc415f1f0 msgr2=0x7f3dc40ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc415f1f0 0x7f3dc40ca450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00c3c0 tx=0x7f3dac00c880 comp rx=0 tx=0).stop 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 shutdown_connections 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3da4078b90 0x7f3da407b0a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc415fd10 0x7f3dc40b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3dc415f1f0 0x7f3dc40ca450 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 --2- 172.21.15.104:0/579163396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3dc40b65e0 0x7f3dc414cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 >> 172.21.15.104:0/579163396 conn(0x7f3dc4069120 msgr2=0x7f3dc40d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 shutdown_connections 2024-09-17T02:54:42.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.467+0000 7f3dcaba1640 1 -- 172.21.15.104:0/579163396 wait complete. 2024-09-17T02:54:42.478 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.589+0000 7fd45a00e640 1 -- 172.21.15.104:0/204376596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 msgr2=0x7fd4540b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.589+0000 7fd45a00e640 1 --2- 172.21.15.104:0/204376596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 0x7fd4540b57e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd448005fd0 tx=0x7fd44802a5d0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.589+0000 7fd45a00e640 1 -- 172.21.15.104:0/204376596 shutdown_connections 2024-09-17T02:54:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.589+0000 7fd45a00e640 1 --2- 172.21.15.104:0/204376596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 0x7fd4540b57e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.589+0000 7fd45a00e640 1 --2- 172.21.15.104:0/204376596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4540b4fc0 0x7fd4540b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.589+0000 7fd45a00e640 1 -- 172.21.15.104:0/204376596 >> 172.21.15.104:0/204376596 conn(0x7fd4540b44a0 msgr2=0x7fd4540b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:42.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.589+0000 7fd45a00e640 1 -- 172.21.15.104:0/204376596 shutdown_connections 2024-09-17T02:54:42.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.589+0000 7fd45a00e640 1 -- 172.21.15.104:0/204376596 wait complete. 2024-09-17T02:54:42.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.591+0000 7fd45a00e640 1 Processor -- start 2024-09-17T02:54:42.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.591+0000 7fd45a00e640 1 -- start start 2024-09-17T02:54:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd45a00e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 0x7fd4540cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd45a00e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4540b4fc0 0x7fd45415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd45a00e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4540b5d20 0x7fd45414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd45a00e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd454160f50 con 0x7fd4540b3f00 2024-09-17T02:54:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd45a00e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd4540ce160 con 0x7fd4540b4fc0 2024-09-17T02:54:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd45a00e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd4541610d0 con 0x7fd4540b5d20 2024-09-17T02:54:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd4537fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 0x7fd4540cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd4537fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 0x7fd4540cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43850/0 (socket says 172.21.15.104:43850) 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd4537fe640 1 -- 172.21.15.104:0/195914145 learned_addr learned my addr 172.21.15.104:0/195914145 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd452ffd640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4540b4fc0 0x7fd45415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.592+0000 7fd453fff640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4540b5d20 0x7fd45414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd4537fe640 1 -- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4540b5d20 msgr2=0x7fd45414ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd4537fe640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4540b5d20 0x7fd45414ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd4537fe640 1 -- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4540b4fc0 msgr2=0x7fd45415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd4537fe640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4540b4fc0 0x7fd45415caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd4537fe640 1 -- 172.21.15.104:0/195914145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45415f5e0 con 0x7fd4540b3f00 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd4537fe640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 0x7fd4540cc4b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd44400c9a0 tx=0x7fd44400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd43bfff640 1 -- 172.21.15.104:0/195914145 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444007bb0 con 0x7fd4540b3f00 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd43bfff640 1 -- 172.21.15.104:0/195914145 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd444007e40 con 0x7fd4540b3f00 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45415f8c0 con 0x7fd4540b3f00 2024-09-17T02:54:42.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd43bfff640 1 -- 172.21.15.104:0/195914145 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444005280 con 0x7fd4540b3f00 2024-09-17T02:54:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.593+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd45415fe80 con 0x7fd4540b3f00 2024-09-17T02:54:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.594+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4540b57e0 con 0x7fd4540b3f00 2024-09-17T02:54:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.595+0000 7fd43bfff640 1 -- 172.21.15.104:0/195914145 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd444005420 con 0x7fd4540b3f00 2024-09-17T02:54:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.595+0000 7fd43bfff640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd440078b90 0x7fd44007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.595+0000 7fd43bfff640 1 -- 172.21.15.104:0/195914145 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd44409b0f0 con 0x7fd4540b3f00 2024-09-17T02:54:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.595+0000 7fd452ffd640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd440078b90 0x7fd44007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.596+0000 7fd452ffd640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd440078b90 0x7fd44007b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd448033000 tx=0x7fd448004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:42.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.600+0000 7fd43bfff640 1 -- 172.21.15.104:0/195914145 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd444014030 con 0x7fd4540b3f00 2024-09-17T02:54:42.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.773+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4540cead0 con 0x7fd4540b3f00 2024-09-17T02:54:42.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.774+0000 7fd43bfff640 1 -- 172.21.15.104:0/195914145 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16726 (secure 0 0 0) 0x7fd444063030 con 0x7fd4540b3f00 2024-09-17T02:54:42.774 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:42.774 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:41.483680+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:42.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd440078b90 msgr2=0x7fd44007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd440078b90 0x7fd44007b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd448033000 tx=0x7fd448004730 comp rx=0 tx=0).stop 2024-09-17T02:54:42.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 msgr2=0x7fd4540cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 0x7fd4540cc4b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd44400c9a0 tx=0x7fd44400ce60 comp rx=0 tx=0).stop 2024-09-17T02:54:42.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 shutdown_connections 2024-09-17T02:54:42.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd440078b90 0x7fd44007b0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4540b4fc0 0x7fd45415caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4540b5d20 0x7fd45414ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 --2- 172.21.15.104:0/195914145 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd4540b3f00 0x7fd4540cc4b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 >> 172.21.15.104:0/195914145 conn(0x7fd4540b44a0 msgr2=0x7fd4540b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:42.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 shutdown_connections 2024-09-17T02:54:42.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.776+0000 7fd45a00e640 1 -- 172.21.15.104:0/195914145 wait complete. 2024-09-17T02:54:42.787 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T02:54:42.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.903+0000 7f17ef65c640 1 -- 172.21.15.104:0/1357302504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17e815f6e0 msgr2=0x7f17e80d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.903+0000 7f17ef65c640 1 --2- 172.21.15.104:0/1357302504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17e815f6e0 0x7f17e80d0120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009830 tx=0x7f17e402a410 comp rx=0 tx=0).stop 2024-09-17T02:54:42.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.903+0000 7f17ef65c640 1 -- 172.21.15.104:0/1357302504 shutdown_connections 2024-09-17T02:54:42.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.903+0000 7f17ef65c640 1 --2- 172.21.15.104:0/1357302504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17e80b6cf0 0x7f17e80d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.903+0000 7f17ef65c640 1 --2- 172.21.15.104:0/1357302504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17e815f6e0 0x7f17e80d0120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.903+0000 7f17ef65c640 1 -- 172.21.15.104:0/1357302504 >> 172.21.15.104:0/1357302504 conn(0x7f17e8069120 msgr2=0x7f17e8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:42.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.903+0000 7f17ef65c640 1 -- 172.21.15.104:0/1357302504 shutdown_connections 2024-09-17T02:54:42.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.903+0000 7f17ef65c640 1 -- 172.21.15.104:0/1357302504 wait complete. 2024-09-17T02:54:42.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.905+0000 7f17ef65c640 1 Processor -- start 2024-09-17T02:54:42.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.905+0000 7f17ef65c640 1 -- start start 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17ef65c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17e815f6e0 0x7f17e81f9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17ef65c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17e815faf0 0x7f17e80acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17ef65c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e80ad450 0x7f17e814fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17ef65c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f17e80d3a40 con 0x7f17e80ad450 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17ef65c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f17e80d38c0 con 0x7f17e815faf0 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17ef65c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f17e80d3bc0 con 0x7f17e815f6e0 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17edbf9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e80ad450 0x7f17e814fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17edbf9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e80ad450 0x7f17e814fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43858/0 (socket says 172.21.15.104:43858) 2024-09-17T02:54:42.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17edbf9640 1 -- 172.21.15.104:0/3257658704 learned_addr learned my addr 172.21.15.104:0/3257658704 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17ed3f8640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17e815f6e0 0x7f17e81f9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17ecbf7640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17e815faf0 0x7f17e80acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17edbf9640 1 -- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17e815f6e0 msgr2=0x7f17e81f9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17edbf9640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17e815f6e0 0x7f17e81f9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17edbf9640 1 -- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17e815faf0 msgr2=0x7f17e80acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17edbf9640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17e815faf0 0x7f17e80acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.906+0000 7f17edbf9640 1 -- 172.21.15.104:0/3257658704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e81fa170 con 0x7f17e80ad450 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.907+0000 7f17edbf9640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e80ad450 0x7f17e814fc10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17e000ebf0 tx=0x7f17e000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.907+0000 7f17ddffb640 1 -- 172.21.15.104:0/3257658704 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0003b70 con 0x7f17e80ad450 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.907+0000 7f17ddffb640 1 -- 172.21.15.104:0/3257658704 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17e0003d10 con 0x7f17e80ad450 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.907+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e80ab9b0 con 0x7f17e80ad450 2024-09-17T02:54:42.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.907+0000 7f17ddffb640 1 -- 172.21.15.104:0/3257658704 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0004280 con 0x7f17e80ad450 2024-09-17T02:54:42.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.907+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e80abf70 con 0x7f17e80ad450 2024-09-17T02:54:42.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.908+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e80ab720 con 0x7f17e80ad450 2024-09-17T02:54:42.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.909+0000 7f17ddffb640 1 -- 172.21.15.104:0/3257658704 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f17e0004420 con 0x7f17e80ad450 2024-09-17T02:54:42.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.909+0000 7f17ddffb640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f17cc078b90 0x7f17cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:42.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.909+0000 7f17ddffb640 1 -- 172.21.15.104:0/3257658704 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f17e009b970 con 0x7f17e80ad450 2024-09-17T02:54:42.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.910+0000 7f17ed3f8640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f17cc078b90 0x7f17cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:42.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.910+0000 7f17ed3f8640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f17cc078b90 0x7f17cc07b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17e4034000 tx=0x7f17e4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:42.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:42.914+0000 7f17ddffb640 1 -- 172.21.15.104:0/3257658704 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f17e81fa170 con 0x7f17e80ad450 2024-09-17T02:54:43.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:43.125+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f17e8069a60 con 0x7f17e80ad450 2024-09-17T02:54:44.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.081+0000 7f17ddffb640 1 -- 172.21.15.104:0/3257658704 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f17e8069a60 con 0x7f17e80ad450 2024-09-17T02:54:44.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f17cc078b90 msgr2=0x7f17cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f17cc078b90 0x7f17cc07b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17e4034000 tx=0x7f17e4004730 comp rx=0 tx=0).stop 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e80ad450 msgr2=0x7f17e814fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e80ad450 0x7f17e814fc10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f17e000ebf0 tx=0x7f17e000c6a0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 shutdown_connections 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f17cc078b90 0x7f17cc07b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17e815faf0 0x7f17e80acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17e80ad450 0x7f17e814fc10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 --2- 172.21.15.104:0/3257658704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17e815f6e0 0x7f17e81f9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 >> 172.21.15.104:0/3257658704 conn(0x7f17e8069120 msgr2=0x7f17e80b9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 shutdown_connections 2024-09-17T02:54:44.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.084+0000 7f17ef65c640 1 -- 172.21.15.104:0/3257658704 wait complete. 2024-09-17T02:54:44.096 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']} 2024-09-17T02:54:44.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T02:54:44.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.218+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3884232183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415f6e0 msgr2=0x7f63a40d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:44.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.218+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3884232183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415f6e0 0x7f63a40d0120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63a40cf2b0 tx=0x7f639c02a4d0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.218+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3884232183 shutdown_connections 2024-09-17T02:54:44.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.218+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3884232183 >> v2:172.21.15.192:3300/0 conn(0x7f63a415faf0 0x7f63a40b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.218+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3884232183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415f6e0 0x7f63a40d0120 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.218+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3884232183 >> 172.21.15.104:0/3884232183 conn(0x7f63a4069120 msgr2=0x7f63a4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:44.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.218+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3884232183 shutdown_connections 2024-09-17T02:54:44.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.218+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3884232183 wait complete. 2024-09-17T02:54:44.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.220+0000 7f63ac3eb640 1 Processor -- start 2024-09-17T02:54:44.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.220+0000 7f63ac3eb640 1 -- start start 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63ac3eb640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a40b6b20 0x7f63a415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63ac3eb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a415f6e0 0x7f63a415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63ac3eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415faf0 0x7f63a41f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63ac3eb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f63a41633e0 con 0x7f63a415faf0 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63ac3eb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f63a40d41f0 con 0x7f63a415f6e0 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63ac3eb640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f63a4163560 con 0x7f63a40b6b20 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa988640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415faf0 0x7f63a41f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa988640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415faf0 0x7f63a41f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52124/0 (socket says 172.21.15.104:52124) 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa988640 1 -- 172.21.15.104:0/3874863060 learned_addr learned my addr 172.21.15.104:0/3874863060 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63a9986640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a415f6e0 0x7f63a415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa187640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a40b6b20 0x7f63a415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:44.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa988640 1 -- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a40b6b20 msgr2=0x7f63a415db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa988640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a40b6b20 0x7f63a415db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa988640 1 -- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a415f6e0 msgr2=0x7f63a415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa988640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a415f6e0 0x7f63a415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.221+0000 7f63aa988640 1 -- 172.21.15.104:0/3874863060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a415f0c0 con 0x7f63a415faf0 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.222+0000 7f63aa988640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415faf0 0x7f63a41f6020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f639400b4c0 tx=0x7f639400b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.222+0000 7f63a2ffd640 1 -- 172.21.15.104:0/3874863060 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394015020 con 0x7f63a415faf0 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.222+0000 7f63a2ffd640 1 -- 172.21.15.104:0/3874863060 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6394011940 con 0x7f63a415faf0 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.222+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a4154290 con 0x7f63a415faf0 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.222+0000 7f63a2ffd640 1 -- 172.21.15.104:0/3874863060 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6394011d90 con 0x7f63a415faf0 2024-09-17T02:54:44.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.222+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a41f6ee0 con 0x7f63a415faf0 2024-09-17T02:54:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.223+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a4163ab0 con 0x7f63a415faf0 2024-09-17T02:54:44.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.224+0000 7f63a2ffd640 1 -- 172.21.15.104:0/3874863060 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6394018020 con 0x7f63a415faf0 2024-09-17T02:54:44.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.224+0000 7f63a2ffd640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6390078bc0 0x7f639007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:44.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.224+0000 7f63a2ffd640 1 -- 172.21.15.104:0/3874863060 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f639409aeb0 con 0x7f63a415faf0 2024-09-17T02:54:44.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.224+0000 7f63aa187640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6390078bc0 0x7f639007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:44.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.225+0000 7f63aa187640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6390078bc0 0x7f639007b0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f639c033000 tx=0x7f639c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:44.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.228+0000 7f63a2ffd640 1 -- 172.21.15.104:0/3874863060 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f639401f070 con 0x7f63a415faf0 2024-09-17T02:54:44.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:44.439+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f63a4163190 con 0x7f63a415faf0 2024-09-17T02:54:45.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.143+0000 7f63a2ffd640 1 -- 172.21.15.104:0/3874863060 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f63940633d0 con 0x7f63a415faf0 2024-09-17T02:54:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6390078bc0 msgr2=0x7f639007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6390078bc0 0x7f639007b0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f639c033000 tx=0x7f639c004730 comp rx=0 tx=0).stop 2024-09-17T02:54:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415faf0 msgr2=0x7f63a41f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415faf0 0x7f63a41f6020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f639400b4c0 tx=0x7f639400b980 comp rx=0 tx=0).stop 2024-09-17T02:54:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 shutdown_connections 2024-09-17T02:54:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6390078bc0 0x7f639007b0d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a415f6e0 0x7f63a415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63a415faf0 0x7f63a41f6020 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 --2- 172.21.15.104:0/3874863060 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63a40b6b20 0x7f63a415db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 >> 172.21.15.104:0/3874863060 conn(0x7f63a4069120 msgr2=0x7f63a40cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:45.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 shutdown_connections 2024-09-17T02:54:45.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.145+0000 7f63ac3eb640 1 -- 172.21.15.104:0/3874863060 wait complete. 2024-09-17T02:54:45.157 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T02:54:45.158 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:54:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.273+0000 7f340bdba640 1 -- 172.21.15.104:0/109595483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 msgr2=0x7f33f0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.273+0000 7f340bdba640 1 --2- 172.21.15.104:0/109595483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 0x7f33f0005150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33fc005fd0 tx=0x7f33f0005830 comp rx=0 tx=0).stop 2024-09-17T02:54:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.273+0000 7f340a357640 1 -- 172.21.15.104:0/109595483 reap_dead start 2024-09-17T02:54:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.273+0000 7f340bdba640 1 -- 172.21.15.104:0/109595483 shutdown_connections 2024-09-17T02:54:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.273+0000 7f340bdba640 1 -- 172.21.15.104:0/109595483 >> 172.21.15.104:0/109595483 conn(0x7f34040b3640 msgr2=0x7f34040b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.273+0000 7f340bdba640 1 -- 172.21.15.104:0/109595483 shutdown_connections 2024-09-17T02:54:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.273+0000 7f340bdba640 1 -- 172.21.15.104:0/109595483 wait complete. 2024-09-17T02:54:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.275+0000 7f340bdba640 1 Processor -- start 2024-09-17T02:54:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.275+0000 7f340bdba640 1 -- start start 2024-09-17T02:54:45.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f340bdba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 0x7f3404157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f340bdba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34041f6a50 0x7f3404144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f340bdba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34041f9ca0 0x7f34041fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f340bdba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3404073d20 con 0x7f33f0004d40 2024-09-17T02:54:45.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f340bdba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3404073ba0 con 0x7f34041f9ca0 2024-09-17T02:54:45.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f340bdba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3404074490 con 0x7f34041f6a50 2024-09-17T02:54:45.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409b56640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 0x7f3404157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409b56640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 0x7f3404157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52132/0 (socket says 172.21.15.104:52132) 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409b56640 1 -- 172.21.15.104:0/3050427723 learned_addr learned my addr 172.21.15.104:0/3050427723 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f340a357640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34041f9ca0 0x7f34041fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409355640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34041f6a50 0x7f3404144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409b56640 1 -- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34041f6a50 msgr2=0x7f3404144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409b56640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34041f6a50 0x7f3404144160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409b56640 1 -- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34041f9ca0 msgr2=0x7f34041fa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409b56640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34041f9ca0 0x7f34041fa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.276+0000 7f3409b56640 1 -- 172.21.15.104:0/3050427723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34040c7340 con 0x7f33f0004d40 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.277+0000 7f3409b56640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 0x7f3404157fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3400001c30 tx=0x7f34000039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.277+0000 7f33fa7fc640 1 -- 172.21.15.104:0/3050427723 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400015070 con 0x7f33f0004d40 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.277+0000 7f33fa7fc640 1 -- 172.21.15.104:0/3050427723 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3400011900 con 0x7f33f0004d40 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.277+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34040c7620 con 0x7f33f0004d40 2024-09-17T02:54:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.277+0000 7f33fa7fc640 1 -- 172.21.15.104:0/3050427723 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400011d30 con 0x7f33f0004d40 2024-09-17T02:54:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.277+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3404158690 con 0x7f33f0004d40 2024-09-17T02:54:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.278+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34041f95a0 con 0x7f33f0004d40 2024-09-17T02:54:45.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.279+0000 7f33fa7fc640 1 -- 172.21.15.104:0/3050427723 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f340000f430 con 0x7f33f0004d40 2024-09-17T02:54:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.279+0000 7f33fa7fc640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f33e8078b90 0x7f33e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.279+0000 7f33fa7fc640 1 -- 172.21.15.104:0/3050427723 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f340009ba80 con 0x7f33f0004d40 2024-09-17T02:54:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.279+0000 7f3409355640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f33e8078b90 0x7f33e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.280+0000 7f3409355640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f33e8078b90 0x7f33e807b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34041578f0 tx=0x7f33f4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:45.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.284+0000 7f33fa7fc640 1 -- 172.21.15.104:0/3050427723 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34041f95a0 con 0x7f33f0004d40 2024-09-17T02:54:45.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.496+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34040b50f0 con 0x7f33f0004d40 2024-09-17T02:54:45.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.497+0000 7f33fa7fc640 1 -- 172.21.15.104:0/3050427723 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5229 (secure 0 0 0) 0x7f3404073ed0 con 0x7f33f0004d40 2024-09-17T02:54:45.497 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:45.497 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:54:41.483636+0000","modified":"2024-09-17T02:54:44.441267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-17T02:54:45.498 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T02:54:45.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f33e8078b90 msgr2=0x7f33e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f33e8078b90 0x7f33e807b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34041578f0 tx=0x7f33f4005f90 comp rx=0 tx=0).stop 2024-09-17T02:54:45.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 msgr2=0x7f3404157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 0x7f3404157fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3400001c30 tx=0x7f34000039c0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 shutdown_connections 2024-09-17T02:54:45.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f33e8078b90 0x7f33e807b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34041f9ca0 0x7f34041fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34041f6a50 0x7f3404144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 --2- 172.21.15.104:0/3050427723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f33f0004d40 0x7f3404157fe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 >> 172.21.15.104:0/3050427723 conn(0x7f34040b3640 msgr2=0x7f34040d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:45.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 shutdown_connections 2024-09-17T02:54:45.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.500+0000 7f340bdba640 1 -- 172.21.15.104:0/3050427723 wait complete. 2024-09-17T02:54:45.510 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:45.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.623+0000 7ffb3b182640 1 -- 172.21.15.104:0/3319665763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb200041c0 msgr2=0x7ffb20004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.623+0000 7ffb3b182640 1 --2- 172.21.15.104:0/3319665763 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb200041c0 0x7ffb20004800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffb34070e40 tx=0x7ffb20005830 comp rx=0 tx=0).stop 2024-09-17T02:54:45.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.623+0000 7ffb3971f640 1 -- 172.21.15.104:0/3319665763 reap_dead start 2024-09-17T02:54:45.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.623+0000 7ffb3b182640 1 -- 172.21.15.104:0/3319665763 shutdown_connections 2024-09-17T02:54:45.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.623+0000 7ffb3b182640 1 -- 172.21.15.104:0/3319665763 >> 172.21.15.104:0/3319665763 conn(0x7ffb340b3640 msgr2=0x7ffb340b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:45.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.623+0000 7ffb3b182640 1 -- 172.21.15.104:0/3319665763 shutdown_connections 2024-09-17T02:54:45.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.623+0000 7ffb3b182640 1 -- 172.21.15.104:0/3319665763 wait complete. 2024-09-17T02:54:45.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.624+0000 7ffb3b182640 1 Processor -- start 2024-09-17T02:54:45.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.624+0000 7ffb3b182640 1 -- start start 2024-09-17T02:54:45.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb3b182640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb200041c0 0x7ffb341f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb3b182640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb34143570 0x7ffb34142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb3b182640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34068d70 0x7ffb34069180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb3b182640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ffb340b5570 con 0x7ffb34143570 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb3b182640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffb340b53f0 con 0x7ffb34068d70 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb3b182640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ffb340b56f0 con 0x7ffb200041c0 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb34143570 0x7ffb34142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb34143570 0x7ffb34142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52140/0 (socket says 172.21.15.104:52140) 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 -- 172.21.15.104:0/4123652152 learned_addr learned my addr 172.21.15.104:0/4123652152 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb38f1e640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb200041c0 0x7ffb341f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb3971f640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34068d70 0x7ffb34069180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 -- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb200041c0 msgr2=0x7ffb341f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb200041c0 0x7ffb341f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 -- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34068d70 msgr2=0x7ffb34069180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34068d70 0x7ffb34069180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 -- 172.21.15.104:0/4123652152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb340696c0 con 0x7ffb34143570 2024-09-17T02:54:45.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.626+0000 7ffb33fff640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb34143570 0x7ffb34142c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c000f60 tx=0x7ffb1c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:45.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.627+0000 7ffb317fa640 1 -- 172.21.15.104:0/4123652152 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c032030 con 0x7ffb34143570 2024-09-17T02:54:45.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.627+0000 7ffb317fa640 1 -- 172.21.15.104:0/4123652152 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb1c003af0 con 0x7ffb34143570 2024-09-17T02:54:45.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.627+0000 7ffb317fa640 1 -- 172.21.15.104:0/4123652152 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c042480 con 0x7ffb34143570 2024-09-17T02:54:45.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.627+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb341f7800 con 0x7ffb34143570 2024-09-17T02:54:45.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.627+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb34145f00 con 0x7ffb34143570 2024-09-17T02:54:45.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.628+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb340b5bf0 con 0x7ffb34143570 2024-09-17T02:54:45.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.628+0000 7ffb317fa640 1 -- 172.21.15.104:0/4123652152 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb1c035020 con 0x7ffb34143570 2024-09-17T02:54:45.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.629+0000 7ffb317fa640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffb14078bc0 0x7ffb1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.629+0000 7ffb317fa640 1 -- 172.21.15.104:0/4123652152 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffb1c0bbb10 con 0x7ffb34143570 2024-09-17T02:54:45.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.629+0000 7ffb38f1e640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffb14078bc0 0x7ffb1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.629+0000 7ffb38f1e640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffb14078bc0 0x7ffb1407b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb34073380 tx=0x7ffb24009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:45.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.633+0000 7ffb317fa640 1 -- 172.21.15.104:0/4123652152 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffb1c047060 con 0x7ffb34143570 2024-09-17T02:54:45.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.808+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb34145940 con 0x7ffb34143570 2024-09-17T02:54:45.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.809+0000 7ffb317fa640 1 -- 172.21.15.104:0/4123652152 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7ffb340696c0 con 0x7ffb34143570 2024-09-17T02:54:45.809 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:45.809 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:43.133211+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:45.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.811+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffb14078bc0 msgr2=0x7ffb1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.811+0000 7ffb3b182640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffb14078bc0 0x7ffb1407b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb34073380 tx=0x7ffb24009500 comp rx=0 tx=0).stop 2024-09-17T02:54:45.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.811+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb34143570 msgr2=0x7ffb34142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.811+0000 7ffb3b182640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb34143570 0x7ffb34142c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c000f60 tx=0x7ffb1c001cb0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.812+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 shutdown_connections 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.812+0000 7ffb3b182640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffb14078bc0 0x7ffb1407b0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.812+0000 7ffb3b182640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34068d70 0x7ffb34069180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.812+0000 7ffb3b182640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffb34143570 0x7ffb34142c50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.812+0000 7ffb3b182640 1 --2- 172.21.15.104:0/4123652152 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb200041c0 0x7ffb341f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.812+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 >> 172.21.15.104:0/4123652152 conn(0x7ffb340b3640 msgr2=0x7ffb340d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.812+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 shutdown_connections 2024-09-17T02:54:45.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.812+0000 7ffb3b182640 1 -- 172.21.15.104:0/4123652152 wait complete. 2024-09-17T02:54:45.822 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:54:45.823 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:54:45.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.935+0000 7fc9e8c25640 1 -- 172.21.15.104:0/2826444537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9cc004d40 msgr2=0x7fc9cc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.935+0000 7fc9e8c25640 1 --2- 172.21.15.104:0/2826444537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9cc004d40 0x7fc9cc005150 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40b4510 tx=0x7fc9cc005830 comp rx=0 tx=0).stop 2024-09-17T02:54:45.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.935+0000 7fc9e2d9d640 1 -- 172.21.15.104:0/2826444537 reap_dead start 2024-09-17T02:54:45.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.935+0000 7fc9e8c25640 1 -- 172.21.15.104:0/2826444537 shutdown_connections 2024-09-17T02:54:45.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.935+0000 7fc9e8c25640 1 -- 172.21.15.104:0/2826444537 >> 172.21.15.104:0/2826444537 conn(0x7fc9e4073df0 msgr2=0x7fc9e4068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:45.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.935+0000 7fc9e8c25640 1 -- 172.21.15.104:0/2826444537 shutdown_connections 2024-09-17T02:54:45.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.935+0000 7fc9e8c25640 1 -- 172.21.15.104:0/2826444537 wait complete. 2024-09-17T02:54:45.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.937+0000 7fc9e8c25640 1 Processor -- start 2024-09-17T02:54:45.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.937+0000 7fc9e8c25640 1 -- start start 2024-09-17T02:54:45.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e8c25640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9cc004d40 0x7fc9e41520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e8c25640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e415b210 0x7fc9e41f9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e8c25640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9e41f9a60 0x7fc9e41f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e8c25640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e415f320 con 0x7fc9e415b210 2024-09-17T02:54:45.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e8c25640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e415f1a0 con 0x7fc9cc004d40 2024-09-17T02:54:45.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e8c25640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e40d3a30 con 0x7fc9e41f9a60 2024-09-17T02:54:45.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e415b210 0x7fc9e41f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e415b210 0x7fc9e41f9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52146/0 (socket says 172.21.15.104:52146) 2024-09-17T02:54:45.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.938+0000 7fc9e1d9b640 1 -- 172.21.15.104:0/1004597160 learned_addr learned my addr 172.21.15.104:0/1004597160 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:45.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e259c640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9cc004d40 0x7fc9e41520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e2d9d640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9e41f9a60 0x7fc9e41f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e1d9b640 1 -- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9e41f9a60 msgr2=0x7fc9e41f9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e1d9b640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9e41f9a60 0x7fc9e41f9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e1d9b640 1 -- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9cc004d40 msgr2=0x7fc9e41520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e1d9b640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9cc004d40 0x7fc9e41520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e1d9b640 1 -- 172.21.15.104:0/1004597160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e40c9570 con 0x7fc9e415b210 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e1d9b640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e415b210 0x7fc9e41f9520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8006740 tx=0x7fc9d80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9d2ffd640 1 -- 172.21.15.104:0/1004597160 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8015070 con 0x7fc9e415b210 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9d2ffd640 1 -- 172.21.15.104:0/1004597160 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9d8011920 con 0x7fc9e415b210 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e40cb390 con 0x7fc9e415b210 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9d2ffd640 1 -- 172.21.15.104:0/1004597160 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8011d70 con 0x7fc9e415b210 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.939+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e40c9810 con 0x7fc9e415b210 2024-09-17T02:54:45.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.940+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e406af30 con 0x7fc9e415b210 2024-09-17T02:54:45.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.941+0000 7fc9d2ffd640 1 -- 172.21.15.104:0/1004597160 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9d8010420 con 0x7fc9e415b210 2024-09-17T02:54:45.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.941+0000 7fc9d2ffd640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9c4078b90 0x7fc9c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:45.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.941+0000 7fc9d2ffd640 1 -- 172.21.15.104:0/1004597160 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9d809b9a0 con 0x7fc9e415b210 2024-09-17T02:54:45.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.942+0000 7fc9e259c640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9c4078b90 0x7fc9c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:45.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.942+0000 7fc9e259c640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9c4078b90 0x7fc9c407b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009c50 tx=0x7fc9d4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:45.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:45.946+0000 7fc9d2ffd640 1 -- 172.21.15.104:0/1004597160 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9d8063830 con 0x7fc9e415b210 2024-09-17T02:54:46.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.115+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9e40cec50 con 0x7fc9c4078b90 2024-09-17T02:54:46.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.120+0000 7fc9d2ffd640 1 -- 172.21.15.104:0/1004597160 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242229 (secure 0 0 0) 0x7fc9d405c250 con 0x7fc9c4078b90 2024-09-17T02:54:46.122 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:46.123 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.122+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9c4078b90 msgr2=0x7fc9c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.122+0000 7fc9e8c25640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9c4078b90 0x7fc9c407b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009c50 tx=0x7fc9d4005f90 comp rx=0 tx=0).stop 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.122+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e415b210 msgr2=0x7fc9e41f9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.122+0000 7fc9e8c25640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e415b210 0x7fc9e41f9520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8006740 tx=0x7fc9d80039c0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.123+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 shutdown_connections 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.123+0000 7fc9e8c25640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9c4078b90 0x7fc9c407b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.123+0000 7fc9e8c25640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9e41f9a60 0x7fc9e41f9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.123+0000 7fc9e8c25640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9e415b210 0x7fc9e41f9520 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.123+0000 7fc9e8c25640 1 --2- 172.21.15.104:0/1004597160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9cc004d40 0x7fc9e41520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.123+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 >> 172.21.15.104:0/1004597160 conn(0x7fc9e4073df0 msgr2=0x7fc9e415e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.123+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 shutdown_connections 2024-09-17T02:54:46.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.123+0000 7fc9e8c25640 1 -- 172.21.15.104:0/1004597160 wait complete. 2024-09-17T02:54:46.133 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-17T02:54:45.620096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560878,"statfs":{"total":1600000000,"available":1598339129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.503119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130517+0000","last_change":"2024-09-17T02:54:41.130517+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130517+0000","last_undegraded":"2024-09-17T02:54:41.130517+0000","last_fullsized":"2024-09-17T02:54:41.130517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122171+0000","last_change":"2024-09-17T02:54:41.122171+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122171+0000","last_undegraded":"2024-09-17T02:54:41.122171+0000","last_fullsized":"2024-09-17T02:54:41.122171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131260+0000","last_change":"2024-09-17T02:54:41.131260+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131260+0000","last_undegraded":"2024-09-17T02:54:41.131260+0000","last_fullsized":"2024-09-17T02:54:41.131260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.126552+0000","last_change":"2024-09-17T02:54:41.126552+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.126552+0000","last_undegraded":"2024-09-17T02:54:41.126552+0000","last_fullsized":"2024-09-17T02:54:41.126552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130398+0000","last_change":"2024-09-17T02:54:41.130398+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130398+0000","last_undegraded":"2024-09-17T02:54:41.130398+0000","last_fullsized":"2024-09-17T02:54:41.130398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130327+0000","last_change":"2024-09-17T02:54:41.130327+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130327+0000","last_undegraded":"2024-09-17T02:54:41.130327+0000","last_fullsized":"2024-09-17T02:54:41.130327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130279+0000","last_change":"2024-09-17T02:54:41.130279+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130279+0000","last_undegraded":"2024-09-17T02:54:41.130279+0000","last_fullsized":"2024-09-17T02:54:41.130279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.135110+0000","last_change":"2024-09-17T02:54:41.135110+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.135110+0000","last_undegraded":"2024-09-17T02:54:41.135110+0000","last_fullsized":"2024-09-17T02:54:41.135110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133007+0000","last_change":"2024-09-17T02:54:41.133007+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133007+0000","last_undegraded":"2024-09-17T02:54:41.133007+0000","last_fullsized":"2024-09-17T02:54:41.133007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.123404+0000","last_change":"2024-09-17T02:54:41.123404+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.123404+0000","last_undegraded":"2024-09-17T02:54:41.123404+0000","last_fullsized":"2024-09-17T02:54:41.123404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125964+0000","last_change":"2024-09-17T02:54:41.125964+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125964+0000","last_undegraded":"2024-09-17T02:54:41.125964+0000","last_fullsized":"2024-09-17T02:54:41.125964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120120+0000","last_change":"2024-09-17T02:54:41.120120+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120120+0000","last_undegraded":"2024-09-17T02:54:41.120120+0000","last_fullsized":"2024-09-17T02:54:41.120120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.134702+0000","last_change":"2024-09-17T02:54:41.134702+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.134702+0000","last_undegraded":"2024-09-17T02:54:41.134702+0000","last_fullsized":"2024-09-17T02:54:41.134702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132885+0000","last_change":"2024-09-17T02:54:41.132885+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132885+0000","last_undegraded":"2024-09-17T02:54:41.132885+0000","last_fullsized":"2024-09-17T02:54:41.132885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122576+0000","last_change":"2024-09-17T02:54:41.122576+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122576+0000","last_undegraded":"2024-09-17T02:54:41.122576+0000","last_fullsized":"2024-09-17T02:54:41.122576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130773+0000","last_change":"2024-09-17T02:54:41.130773+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130773+0000","last_undegraded":"2024-09-17T02:54:41.130773+0000","last_fullsized":"2024-09-17T02:54:41.130773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131322+0000","last_change":"2024-09-17T02:54:41.131322+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131322+0000","last_undegraded":"2024-09-17T02:54:41.131322+0000","last_fullsized":"2024-09-17T02:54:41.131322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.126593+0000","last_change":"2024-09-17T02:54:41.126593+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.126593+0000","last_undegraded":"2024-09-17T02:54:41.126593+0000","last_fullsized":"2024-09-17T02:54:41.126593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131949+0000","last_change":"2024-09-17T02:54:41.131949+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131949+0000","last_undegraded":"2024-09-17T02:54:41.131949+0000","last_fullsized":"2024-09-17T02:54:41.131949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121576+0000","last_change":"2024-09-17T02:54:41.121576+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121576+0000","last_undegraded":"2024-09-17T02:54:41.121576+0000","last_fullsized":"2024-09-17T02:54:41.121576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131790+0000","last_change":"2024-09-17T02:54:41.131790+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131790+0000","last_undegraded":"2024-09-17T02:54:41.131790+0000","last_fullsized":"2024-09-17T02:54:41.131790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128916+0000","last_change":"2024-09-17T02:54:41.128916+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128916+0000","last_undegraded":"2024-09-17T02:54:41.128916+0000","last_fullsized":"2024-09-17T02:54:41.128916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132876+0000","last_change":"2024-09-17T02:54:41.132876+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132876+0000","last_undegraded":"2024-09-17T02:54:41.132876+0000","last_fullsized":"2024-09-17T02:54:41.132876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125363+0000","last_change":"2024-09-17T02:54:41.125363+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125363+0000","last_undegraded":"2024-09-17T02:54:41.125363+0000","last_fullsized":"2024-09-17T02:54:41.125363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133659+0000","last_change":"2024-09-17T02:54:41.133659+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133659+0000","last_undegraded":"2024-09-17T02:54:41.133659+0000","last_fullsized":"2024-09-17T02:54:41.133659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.124025+0000","last_change":"2024-09-17T02:54:41.124025+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.124025+0000","last_undegraded":"2024-09-17T02:54:41.124025+0000","last_fullsized":"2024-09-17T02:54:41.124025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121705+0000","last_change":"2024-09-17T02:54:41.121705+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121705+0000","last_undegraded":"2024-09-17T02:54:41.121705+0000","last_fullsized":"2024-09-17T02:54:41.121705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132067+0000","last_change":"2024-09-17T02:54:41.132067+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132067+0000","last_undegraded":"2024-09-17T02:54:41.132067+0000","last_fullsized":"2024-09-17T02:54:41.132067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132505+0000","last_change":"2024-09-17T02:54:41.132505+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132505+0000","last_undegraded":"2024-09-17T02:54:41.132505+0000","last_fullsized":"2024-09-17T02:54:41.132505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129522+0000","last_change":"2024-09-17T02:54:41.129522+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129522+0000","last_undegraded":"2024-09-17T02:54:41.129522+0000","last_fullsized":"2024-09-17T02:54:41.129522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125871+0000","last_change":"2024-09-17T02:54:41.125871+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125871+0000","last_undegraded":"2024-09-17T02:54:41.125871+0000","last_fullsized":"2024-09-17T02:54:41.125871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121813+0000","last_change":"2024-09-17T02:54:41.121813+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121813+0000","last_undegraded":"2024-09-17T02:54:41.121813+0000","last_fullsized":"2024-09-17T02:54:41.121813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.119974+0000","last_change":"2024-09-17T02:54:41.119974+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.119974+0000","last_undegraded":"2024-09-17T02:54:41.119974+0000","last_fullsized":"2024-09-17T02:54:41.119974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.137195+0000","last_change":"2024-09-17T02:54:41.136992+0000","last_active":"2024-09-17T02:54:41.137195+0000","last_peered":"2024-09-17T02:54:41.137195+0000","last_clean":"2024-09-17T02:54:41.137195+0000","last_became_active":"2024-09-17T02:54:41.136720+0000","last_became_peered":"2024-09-17T02:54:41.136720+0000","last_unstale":"2024-09-17T02:54:41.137195+0000","last_undegraded":"2024-09-17T02:54:41.137195+0000","last_fullsized":"2024-09-17T02:54:41.137195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:21.267377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129425+0000","last_change":"2024-09-17T02:54:41.129425+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129425+0000","last_undegraded":"2024-09-17T02:54:41.129425+0000","last_fullsized":"2024-09-17T02:54:41.129425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127168+0000","last_change":"2024-09-17T02:54:41.125908+0000","last_active":"2024-09-17T02:54:41.127168+0000","last_peered":"2024-09-17T02:54:41.127168+0000","last_clean":"2024-09-17T02:54:41.127168+0000","last_became_active":"2024-09-17T02:54:41.124285+0000","last_became_peered":"2024-09-17T02:54:41.124285+0000","last_unstale":"2024-09-17T02:54:41.127168+0000","last_undegraded":"2024-09-17T02:54:41.127168+0000","last_fullsized":"2024-09-17T02:54:41.127168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:05.746577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134195+0000","last_change":"2024-09-17T02:54:41.133974+0000","last_active":"2024-09-17T02:54:41.134195+0000","last_peered":"2024-09-17T02:54:41.134195+0000","last_clean":"2024-09-17T02:54:41.134195+0000","last_became_active":"2024-09-17T02:54:41.130208+0000","last_became_peered":"2024-09-17T02:54:41.130208+0000","last_unstale":"2024-09-17T02:54:41.134195+0000","last_undegraded":"2024-09-17T02:54:41.134195+0000","last_fullsized":"2024-09-17T02:54:41.134195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:56.463219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132526+0000","last_change":"2024-09-17T02:54:41.132526+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132526+0000","last_undegraded":"2024-09-17T02:54:41.132526+0000","last_fullsized":"2024-09-17T02:54:41.132526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133864+0000","last_change":"2024-09-17T02:54:41.133392+0000","last_active":"2024-09-17T02:54:41.133864+0000","last_peered":"2024-09-17T02:54:41.133864+0000","last_clean":"2024-09-17T02:54:41.133864+0000","last_became_active":"2024-09-17T02:54:41.130773+0000","last_became_peered":"2024-09-17T02:54:41.130773+0000","last_unstale":"2024-09-17T02:54:41.133864+0000","last_undegraded":"2024-09-17T02:54:41.133864+0000","last_fullsized":"2024-09-17T02:54:41.133864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:53.322507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122907+0000","last_change":"2024-09-17T02:54:41.122907+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122907+0000","last_undegraded":"2024-09-17T02:54:41.122907+0000","last_fullsized":"2024-09-17T02:54:41.122907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.136369+0000","last_change":"2024-09-17T02:54:41.136164+0000","last_active":"2024-09-17T02:54:41.136369+0000","last_peered":"2024-09-17T02:54:41.136369+0000","last_clean":"2024-09-17T02:54:41.136369+0000","last_became_active":"2024-09-17T02:54:41.135870+0000","last_became_peered":"2024-09-17T02:54:41.135870+0000","last_unstale":"2024-09-17T02:54:41.136369+0000","last_undegraded":"2024-09-17T02:54:41.136369+0000","last_fullsized":"2024-09-17T02:54:41.136369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:14.379519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130202+0000","last_change":"2024-09-17T02:54:41.130202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130202+0000","last_undegraded":"2024-09-17T02:54:41.130202+0000","last_fullsized":"2024-09-17T02:54:41.130202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134987+0000","last_change":"2024-09-17T02:54:41.134782+0000","last_active":"2024-09-17T02:54:41.134987+0000","last_peered":"2024-09-17T02:54:41.134987+0000","last_clean":"2024-09-17T02:54:41.134987+0000","last_became_active":"2024-09-17T02:54:41.133444+0000","last_became_peered":"2024-09-17T02:54:41.133444+0000","last_unstale":"2024-09-17T02:54:41.134987+0000","last_undegraded":"2024-09-17T02:54:41.134987+0000","last_fullsized":"2024-09-17T02:54:41.134987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:12.223351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130537+0000","last_change":"2024-09-17T02:54:41.130537+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130537+0000","last_undegraded":"2024-09-17T02:54:41.130537+0000","last_fullsized":"2024-09-17T02:54:41.130537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133346+0000","last_change":"2024-09-17T02:54:41.133126+0000","last_active":"2024-09-17T02:54:41.133346+0000","last_peered":"2024-09-17T02:54:41.133346+0000","last_clean":"2024-09-17T02:54:41.133346+0000","last_became_active":"2024-09-17T02:54:41.132866+0000","last_became_peered":"2024-09-17T02:54:41.132866+0000","last_unstale":"2024-09-17T02:54:41.133346+0000","last_undegraded":"2024-09-17T02:54:41.133346+0000","last_fullsized":"2024-09-17T02:54:41.133346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:50.498949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120006+0000","last_change":"2024-09-17T02:54:41.120006+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120006+0000","last_undegraded":"2024-09-17T02:54:41.120006+0000","last_fullsized":"2024-09-17T02:54:41.120006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129424+0000","last_change":"2024-09-17T02:54:41.128843+0000","last_active":"2024-09-17T02:54:41.129424+0000","last_peered":"2024-09-17T02:54:41.129424+0000","last_clean":"2024-09-17T02:54:41.129424+0000","last_became_active":"2024-09-17T02:54:41.128490+0000","last_became_peered":"2024-09-17T02:54:41.128490+0000","last_unstale":"2024-09-17T02:54:41.129424+0000","last_undegraded":"2024-09-17T02:54:41.129424+0000","last_fullsized":"2024-09-17T02:54:41.129424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:51.918042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129800+0000","last_change":"2024-09-17T02:54:41.129800+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129800+0000","last_undegraded":"2024-09-17T02:54:41.129800+0000","last_fullsized":"2024-09-17T02:54:41.129800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127223+0000","last_change":"2024-09-17T02:54:41.126988+0000","last_active":"2024-09-17T02:54:41.127223+0000","last_peered":"2024-09-17T02:54:41.127223+0000","last_clean":"2024-09-17T02:54:41.127223+0000","last_became_active":"2024-09-17T02:54:41.126723+0000","last_became_peered":"2024-09-17T02:54:41.126723+0000","last_unstale":"2024-09-17T02:54:41.127223+0000","last_undegraded":"2024-09-17T02:54:41.127223+0000","last_fullsized":"2024-09-17T02:54:41.127223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:13.136462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129581+0000","last_change":"2024-09-17T02:54:41.129581+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129581+0000","last_undegraded":"2024-09-17T02:54:41.129581+0000","last_fullsized":"2024-09-17T02:54:41.129581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133215+0000","last_change":"2024-09-17T02:54:41.132996+0000","last_active":"2024-09-17T02:54:41.133215+0000","last_peered":"2024-09-17T02:54:41.133215+0000","last_clean":"2024-09-17T02:54:41.133215+0000","last_became_active":"2024-09-17T02:54:41.132135+0000","last_became_peered":"2024-09-17T02:54:41.132135+0000","last_unstale":"2024-09-17T02:54:41.133215+0000","last_undegraded":"2024-09-17T02:54:41.133215+0000","last_fullsized":"2024-09-17T02:54:41.133215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:34.553877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129798+0000","last_change":"2024-09-17T02:54:41.129798+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129798+0000","last_undegraded":"2024-09-17T02:54:41.129798+0000","last_fullsized":"2024-09-17T02:54:41.129798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127391+0000","last_change":"2024-09-17T02:54:41.127168+0000","last_active":"2024-09-17T02:54:41.127391+0000","last_peered":"2024-09-17T02:54:41.127391+0000","last_clean":"2024-09-17T02:54:41.127391+0000","last_became_active":"2024-09-17T02:54:41.126901+0000","last_became_peered":"2024-09-17T02:54:41.126901+0000","last_unstale":"2024-09-17T02:54:41.127391+0000","last_undegraded":"2024-09-17T02:54:41.127391+0000","last_fullsized":"2024-09-17T02:54:41.127391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:58.704223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121166+0000","last_change":"2024-09-17T02:54:41.121166+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121166+0000","last_undegraded":"2024-09-17T02:54:41.121166+0000","last_fullsized":"2024-09-17T02:54:41.121166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132252+0000","last_change":"2024-09-17T02:54:41.131775+0000","last_active":"2024-09-17T02:54:41.132252+0000","last_peered":"2024-09-17T02:54:41.132252+0000","last_clean":"2024-09-17T02:54:41.132252+0000","last_became_active":"2024-09-17T02:54:41.131311+0000","last_became_peered":"2024-09-17T02:54:41.131311+0000","last_unstale":"2024-09-17T02:54:41.132252+0000","last_undegraded":"2024-09-17T02:54:41.132252+0000","last_fullsized":"2024-09-17T02:54:41.132252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:01.120087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129637+0000","last_change":"2024-09-17T02:54:41.129637+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129637+0000","last_undegraded":"2024-09-17T02:54:41.129637+0000","last_fullsized":"2024-09-17T02:54:41.129637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.126141+0000","last_change":"2024-09-17T02:54:41.124818+0000","last_active":"2024-09-17T02:54:41.126141+0000","last_peered":"2024-09-17T02:54:41.126141+0000","last_clean":"2024-09-17T02:54:41.126141+0000","last_became_active":"2024-09-17T02:54:41.124391+0000","last_became_peered":"2024-09-17T02:54:41.124391+0000","last_unstale":"2024-09-17T02:54:41.126141+0000","last_undegraded":"2024-09-17T02:54:41.126141+0000","last_fullsized":"2024-09-17T02:54:41.126141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:59.494494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129293+0000","last_change":"2024-09-17T02:54:41.129293+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129293+0000","last_undegraded":"2024-09-17T02:54:41.129293+0000","last_fullsized":"2024-09-17T02:54:41.129293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.136924+0000","last_change":"2024-09-17T02:54:41.136678+0000","last_active":"2024-09-17T02:54:41.136924+0000","last_peered":"2024-09-17T02:54:41.136924+0000","last_clean":"2024-09-17T02:54:41.136924+0000","last_became_active":"2024-09-17T02:54:41.136398+0000","last_became_peered":"2024-09-17T02:54:41.136398+0000","last_unstale":"2024-09-17T02:54:41.136924+0000","last_undegraded":"2024-09-17T02:54:41.136924+0000","last_fullsized":"2024-09-17T02:54:41.136924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:00.204367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131095+0000","last_change":"2024-09-17T02:54:41.131095+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131095+0000","last_undegraded":"2024-09-17T02:54:41.131095+0000","last_fullsized":"2024-09-17T02:54:41.131095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129863+0000","last_change":"2024-09-17T02:54:41.129677+0000","last_active":"2024-09-17T02:54:41.129863+0000","last_peered":"2024-09-17T02:54:41.129863+0000","last_clean":"2024-09-17T02:54:41.129863+0000","last_became_active":"2024-09-17T02:54:41.128120+0000","last_became_peered":"2024-09-17T02:54:41.128120+0000","last_unstale":"2024-09-17T02:54:41.129863+0000","last_undegraded":"2024-09-17T02:54:41.129863+0000","last_fullsized":"2024-09-17T02:54:41.129863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:46.494366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128503+0000","last_change":"2024-09-17T02:54:41.128503+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128503+0000","last_undegraded":"2024-09-17T02:54:41.128503+0000","last_fullsized":"2024-09-17T02:54:41.128503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.135852+0000","last_change":"2024-09-17T02:54:41.135494+0000","last_active":"2024-09-17T02:54:41.135852+0000","last_peered":"2024-09-17T02:54:41.135852+0000","last_clean":"2024-09-17T02:54:41.135852+0000","last_became_active":"2024-09-17T02:54:41.135146+0000","last_became_peered":"2024-09-17T02:54:41.135146+0000","last_unstale":"2024-09-17T02:54:41.135852+0000","last_undegraded":"2024-09-17T02:54:41.135852+0000","last_fullsized":"2024-09-17T02:54:41.135852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:08.413771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129371+0000","last_change":"2024-09-17T02:54:41.129371+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129371+0000","last_undegraded":"2024-09-17T02:54:41.129371+0000","last_fullsized":"2024-09-17T02:54:41.129371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":107,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.123127+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:54:41.123127+0000","last_peered":"2024-09-17T02:54:41.123127+0000","last_clean":"2024-09-17T02:54:41.123127+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:54:41.123127+0000","last_undegraded":"2024-09-17T02:54:41.123127+0000","last_fullsized":"2024-09-17T02:54:41.123127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132634+0000","last_change":"2024-09-17T02:54:41.132405+0000","last_active":"2024-09-17T02:54:41.132634+0000","last_peered":"2024-09-17T02:54:41.132634+0000","last_clean":"2024-09-17T02:54:41.132634+0000","last_became_active":"2024-09-17T02:54:41.131396+0000","last_became_peered":"2024-09-17T02:54:41.131396+0000","last_unstale":"2024-09-17T02:54:41.132634+0000","last_undegraded":"2024-09-17T02:54:41.132634+0000","last_fullsized":"2024-09-17T02:54:41.132634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:55.412737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133920+0000","last_change":"2024-09-17T02:54:41.133920+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133920+0000","last_undegraded":"2024-09-17T02:54:41.133920+0000","last_fullsized":"2024-09-17T02:54:41.133920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134238+0000","last_change":"2024-09-17T02:54:41.134010+0000","last_active":"2024-09-17T02:54:41.134238+0000","last_peered":"2024-09-17T02:54:41.134238+0000","last_clean":"2024-09-17T02:54:41.134238+0000","last_became_active":"2024-09-17T02:54:41.133330+0000","last_became_peered":"2024-09-17T02:54:41.133330+0000","last_unstale":"2024-09-17T02:54:41.134238+0000","last_undegraded":"2024-09-17T02:54:41.134238+0000","last_fullsized":"2024-09-17T02:54:41.134238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:22.013803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128493+0000","last_change":"2024-09-17T02:54:41.128493+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128493+0000","last_undegraded":"2024-09-17T02:54:41.128493+0000","last_fullsized":"2024-09-17T02:54:41.128493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.137095+0000","last_change":"2024-09-17T02:54:41.136814+0000","last_active":"2024-09-17T02:54:41.137095+0000","last_peered":"2024-09-17T02:54:41.137095+0000","last_clean":"2024-09-17T02:54:41.137095+0000","last_became_active":"2024-09-17T02:54:41.136504+0000","last_became_peered":"2024-09-17T02:54:41.136504+0000","last_unstale":"2024-09-17T02:54:41.137095+0000","last_undegraded":"2024-09-17T02:54:41.137095+0000","last_fullsized":"2024-09-17T02:54:41.137095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:43.506144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121835+0000","last_change":"2024-09-17T02:54:41.121835+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121835+0000","last_undegraded":"2024-09-17T02:54:41.121835+0000","last_fullsized":"2024-09-17T02:54:41.121835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.135266+0000","last_change":"2024-09-17T02:54:41.135077+0000","last_active":"2024-09-17T02:54:41.135266+0000","last_peered":"2024-09-17T02:54:41.135266+0000","last_clean":"2024-09-17T02:54:41.135266+0000","last_became_active":"2024-09-17T02:54:41.134456+0000","last_became_peered":"2024-09-17T02:54:41.134456+0000","last_unstale":"2024-09-17T02:54:41.135266+0000","last_undegraded":"2024-09-17T02:54:41.135266+0000","last_fullsized":"2024-09-17T02:54:41.135266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:44.578710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120202+0000","last_change":"2024-09-17T02:54:41.120202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120202+0000","last_undegraded":"2024-09-17T02:54:41.120202+0000","last_fullsized":"2024-09-17T02:54:41.120202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129498+0000","last_change":"2024-09-17T02:54:41.129281+0000","last_active":"2024-09-17T02:54:41.129498+0000","last_peered":"2024-09-17T02:54:41.129498+0000","last_clean":"2024-09-17T02:54:41.129498+0000","last_became_active":"2024-09-17T02:54:41.129016+0000","last_became_peered":"2024-09-17T02:54:41.129016+0000","last_unstale":"2024-09-17T02:54:41.129498+0000","last_undegraded":"2024-09-17T02:54:41.129498+0000","last_fullsized":"2024-09-17T02:54:41.129498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:06.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.124882+0000","last_change":"2024-09-17T02:54:41.124882+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.124882+0000","last_undegraded":"2024-09-17T02:54:41.124882+0000","last_fullsized":"2024-09-17T02:54:41.124882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.128403+0000","last_change":"2024-09-17T02:54:41.127905+0000","last_active":"2024-09-17T02:54:41.128403+0000","last_peered":"2024-09-17T02:54:41.128403+0000","last_clean":"2024-09-17T02:54:41.128403+0000","last_became_active":"2024-09-17T02:54:41.127616+0000","last_became_peered":"2024-09-17T02:54:41.127616+0000","last_unstale":"2024-09-17T02:54:41.128403+0000","last_undegraded":"2024-09-17T02:54:41.128403+0000","last_fullsized":"2024-09-17T02:54:41.128403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:02.722545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.123201+0000","last_change":"2024-09-17T02:54:41.123201+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.123201+0000","last_undegraded":"2024-09-17T02:54:41.123201+0000","last_fullsized":"2024-09-17T02:54:41.123201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.131382+0000","last_change":"2024-09-17T02:54:41.130345+0000","last_active":"2024-09-17T02:54:41.131382+0000","last_peered":"2024-09-17T02:54:41.131382+0000","last_clean":"2024-09-17T02:54:41.131382+0000","last_became_active":"2024-09-17T02:54:41.130078+0000","last_became_peered":"2024-09-17T02:54:41.130078+0000","last_unstale":"2024-09-17T02:54:41.131382+0000","last_undegraded":"2024-09-17T02:54:41.131382+0000","last_fullsized":"2024-09-17T02:54:41.131382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:36.803460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.134299+0000","last_change":"2024-09-17T02:54:41.134299+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.134299+0000","last_undegraded":"2024-09-17T02:54:41.134299+0000","last_fullsized":"2024-09-17T02:54:41.134299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.125742+0000","last_change":"2024-09-17T02:54:41.125471+0000","last_active":"2024-09-17T02:54:41.125742+0000","last_peered":"2024-09-17T02:54:41.125742+0000","last_clean":"2024-09-17T02:54:41.125742+0000","last_became_active":"2024-09-17T02:54:41.124551+0000","last_became_peered":"2024-09-17T02:54:41.124551+0000","last_unstale":"2024-09-17T02:54:41.125742+0000","last_undegraded":"2024-09-17T02:54:41.125742+0000","last_fullsized":"2024-09-17T02:54:41.125742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.897379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128964+0000","last_change":"2024-09-17T02:54:41.128964+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128964+0000","last_undegraded":"2024-09-17T02:54:41.128964+0000","last_fullsized":"2024-09-17T02:54:41.128964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127405+0000","last_change":"2024-09-17T02:54:41.127039+0000","last_active":"2024-09-17T02:54:41.127405+0000","last_peered":"2024-09-17T02:54:41.127405+0000","last_clean":"2024-09-17T02:54:41.127405+0000","last_became_active":"2024-09-17T02:54:41.126724+0000","last_became_peered":"2024-09-17T02:54:41.126724+0000","last_unstale":"2024-09-17T02:54:41.127405+0000","last_undegraded":"2024-09-17T02:54:41.127405+0000","last_fullsized":"2024-09-17T02:54:41.127405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:41.785060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121403+0000","last_change":"2024-09-17T02:54:41.121403+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121403+0000","last_undegraded":"2024-09-17T02:54:41.121403+0000","last_fullsized":"2024-09-17T02:54:41.121403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132278+0000","last_change":"2024-09-17T02:54:41.131579+0000","last_active":"2024-09-17T02:54:41.132278+0000","last_peered":"2024-09-17T02:54:41.132278+0000","last_clean":"2024-09-17T02:54:41.132278+0000","last_became_active":"2024-09-17T02:54:41.131123+0000","last_became_peered":"2024-09-17T02:54:41.131123+0000","last_unstale":"2024-09-17T02:54:41.132278+0000","last_undegraded":"2024-09-17T02:54:41.132278+0000","last_fullsized":"2024-09-17T02:54:41.132278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:57.401823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130586+0000","last_change":"2024-09-17T02:54:41.130586+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130586+0000","last_undegraded":"2024-09-17T02:54:41.130586+0000","last_fullsized":"2024-09-17T02:54:41.130586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129835+0000","last_change":"2024-09-17T02:54:41.127869+0000","last_active":"2024-09-17T02:54:41.129835+0000","last_peered":"2024-09-17T02:54:41.129835+0000","last_clean":"2024-09-17T02:54:41.129835+0000","last_became_active":"2024-09-17T02:54:41.127552+0000","last_became_peered":"2024-09-17T02:54:41.127552+0000","last_unstale":"2024-09-17T02:54:41.129835+0000","last_undegraded":"2024-09-17T02:54:41.129835+0000","last_fullsized":"2024-09-17T02:54:41.129835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:41.305801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130557+0000","last_change":"2024-09-17T02:54:41.130557+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130557+0000","last_undegraded":"2024-09-17T02:54:41.130557+0000","last_fullsized":"2024-09-17T02:54:41.130557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127062+0000","last_change":"2024-09-17T02:54:41.126814+0000","last_active":"2024-09-17T02:54:41.127062+0000","last_peered":"2024-09-17T02:54:41.127062+0000","last_clean":"2024-09-17T02:54:41.127062+0000","last_became_active":"2024-09-17T02:54:41.126505+0000","last_became_peered":"2024-09-17T02:54:41.126505+0000","last_unstale":"2024-09-17T02:54:41.127062+0000","last_undegraded":"2024-09-17T02:54:41.127062+0000","last_fullsized":"2024-09-17T02:54:41.127062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:52.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121904+0000","last_change":"2024-09-17T02:54:41.121904+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121904+0000","last_undegraded":"2024-09-17T02:54:41.121904+0000","last_fullsized":"2024-09-17T02:54:41.121904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128954+0000","last_change":"2024-09-17T02:54:41.128954+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128954+0000","last_undegraded":"2024-09-17T02:54:41.128954+0000","last_fullsized":"2024-09-17T02:54:41.128954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133576+0000","last_change":"2024-09-17T02:54:41.133352+0000","last_active":"2024-09-17T02:54:41.133576+0000","last_peered":"2024-09-17T02:54:41.133576+0000","last_clean":"2024-09-17T02:54:41.133576+0000","last_became_active":"2024-09-17T02:54:41.133001+0000","last_became_peered":"2024-09-17T02:54:41.133001+0000","last_unstale":"2024-09-17T02:54:41.133576+0000","last_undegraded":"2024-09-17T02:54:41.133576+0000","last_fullsized":"2024-09-17T02:54:41.133576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:19.533069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.127705+0000","last_change":"2024-09-17T02:54:41.127705+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.127705+0000","last_undegraded":"2024-09-17T02:54:41.127705+0000","last_fullsized":"2024-09-17T02:54:41.127705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.131668+0000","last_change":"2024-09-17T02:54:41.131298+0000","last_active":"2024-09-17T02:54:41.131668+0000","last_peered":"2024-09-17T02:54:41.131668+0000","last_clean":"2024-09-17T02:54:41.131668+0000","last_became_active":"2024-09-17T02:54:41.131019+0000","last_became_peered":"2024-09-17T02:54:41.131019+0000","last_unstale":"2024-09-17T02:54:41.131668+0000","last_undegraded":"2024-09-17T02:54:41.131668+0000","last_fullsized":"2024-09-17T02:54:41.131668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:34.067992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130202+0000","last_change":"2024-09-17T02:54:41.130202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130202+0000","last_undegraded":"2024-09-17T02:54:41.130202+0000","last_fullsized":"2024-09-17T02:54:41.130202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129312+0000","last_change":"2024-09-17T02:54:41.128714+0000","last_active":"2024-09-17T02:54:41.129312+0000","last_peered":"2024-09-17T02:54:41.129312+0000","last_clean":"2024-09-17T02:54:41.129312+0000","last_became_active":"2024-09-17T02:54:41.128099+0000","last_became_peered":"2024-09-17T02:54:41.128099+0000","last_unstale":"2024-09-17T02:54:41.129312+0000","last_undegraded":"2024-09-17T02:54:41.129312+0000","last_fullsized":"2024-09-17T02:54:41.129312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:30.938338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133695+0000","last_change":"2024-09-17T02:54:41.133695+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133695+0000","last_undegraded":"2024-09-17T02:54:41.133695+0000","last_fullsized":"2024-09-17T02:54:41.133695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.125711+0000","last_change":"2024-09-17T02:54:41.125421+0000","last_active":"2024-09-17T02:54:41.125711+0000","last_peered":"2024-09-17T02:54:41.125711+0000","last_clean":"2024-09-17T02:54:41.125711+0000","last_became_active":"2024-09-17T02:54:41.124528+0000","last_became_peered":"2024-09-17T02:54:41.124528+0000","last_unstale":"2024-09-17T02:54:41.125711+0000","last_undegraded":"2024-09-17T02:54:41.125711+0000","last_fullsized":"2024-09-17T02:54:41.125711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:34.437280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194675,"statfs":{"total":200000000,"available":199347262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:54:46.138 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:54:46.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.287+0000 7f5fe8694640 1 -- 172.21.15.104:0/3907485272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fcc004800 msgr2=0x7f5fcc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.287+0000 7f5fe8694640 1 --2- 172.21.15.104:0/3907485272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fcc004800 0x7f5fcc004c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009b50 tx=0x7f5fcc005830 comp rx=0 tx=0).stop 2024-09-17T02:54:46.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.287+0000 7f5fe6c31640 1 -- 172.21.15.104:0/3907485272 reap_dead start 2024-09-17T02:54:46.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.287+0000 7f5fe8694640 1 -- 172.21.15.104:0/3907485272 shutdown_connections 2024-09-17T02:54:46.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.287+0000 7f5fe8694640 1 -- 172.21.15.104:0/3907485272 >> 172.21.15.104:0/3907485272 conn(0x7f5fe00b44a0 msgr2=0x7f5fe00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:46.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.287+0000 7f5fe8694640 1 -- 172.21.15.104:0/3907485272 shutdown_connections 2024-09-17T02:54:46.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.287+0000 7f5fe8694640 1 -- 172.21.15.104:0/3907485272 wait complete. 2024-09-17T02:54:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.288+0000 7f5fe8694640 1 Processor -- start 2024-09-17T02:54:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.288+0000 7f5fe8694640 1 -- start start 2024-09-17T02:54:46.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe8694640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fcc004800 0x7f5fe01f9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe8694640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe00cc390 0x7f5fe009ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe8694640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fe00ca3a0 0x7f5fe00ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe8694640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe00d0320 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe8694640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe00ce160 con 0x7f5fe00cc390 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe8694640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe00b57e0 con 0x7f5fcc004800 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fe00ca3a0 0x7f5fe00ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fe00ca3a0 0x7f5fe00ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52170/0 (socket says 172.21.15.104:52170) 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 -- 172.21.15.104:0/1358648037 learned_addr learned my addr 172.21.15.104:0/1358648037 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe5c2f640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe00cc390 0x7f5fe009ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6430640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fcc004800 0x7f5fe01f9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 -- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fcc004800 msgr2=0x7f5fe01f9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fcc004800 0x7f5fe01f9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 -- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe00cc390 msgr2=0x7f5fe009ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe00cc390 0x7f5fe009ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 -- 172.21.15.104:0/1358648037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe00cacf0 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe6c31640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fe00ca3a0 0x7f5fe00ca7b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00c98d0 tx=0x7f5fd8006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fd6ffd640 1 -- 172.21.15.104:0/1358648037 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800fc30 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fd6ffd640 1 -- 172.21.15.104:0/1358648037 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fd8018070 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe00ccb70 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fd6ffd640 1 -- 172.21.15.104:0/1358648037 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011430 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.290+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe006da00 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.291+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe00b39c0 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.292+0000 7f5fd6ffd640 1 -- 172.21.15.104:0/1358648037 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fd80115d0 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.293+0000 7f5fd6ffd640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fc4078b90 0x7f5fc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.293+0000 7f5fd6ffd640 1 -- 172.21.15.104:0/1358648037 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5fd809b450 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.293+0000 7f5fe6430640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fc4078b90 0x7f5fc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.294+0000 7f5fe6430640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fc4078b90 0x7f5fc407b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005e00 tx=0x7f5fdc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:46.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.297+0000 7f5fd6ffd640 1 -- 172.21.15.104:0/1358648037 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5fe00cacf0 con 0x7f5fe00ca3a0 2024-09-17T02:54:46.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.467+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5fe00cc900 con 0x7f5fc4078b90 2024-09-17T02:54:46.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.472+0000 7f5fd6ffd640 1 -- 172.21.15.104:0/1358648037 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242229 (secure 0 0 0) 0x7f5fe00cc900 con 0x7f5fc4078b90 2024-09-17T02:54:46.474 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:46.475 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fc4078b90 msgr2=0x7f5fc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fc4078b90 0x7f5fc407b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005e00 tx=0x7f5fdc005f90 comp rx=0 tx=0).stop 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fe00ca3a0 msgr2=0x7f5fe00ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fe00ca3a0 0x7f5fe00ca7b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00c98d0 tx=0x7f5fd8006720 comp rx=0 tx=0).stop 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 shutdown_connections 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fc4078b90 0x7f5fc407b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fe00cc390 0x7f5fe009ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fe00ca3a0 0x7f5fe00ca7b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 --2- 172.21.15.104:0/1358648037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fcc004800 0x7f5fe01f9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.475+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 >> 172.21.15.104:0/1358648037 conn(0x7f5fe00b44a0 msgr2=0x7f5fe00d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:46.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.476+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 shutdown_connections 2024-09-17T02:54:46.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.476+0000 7f5fe8694640 1 -- 172.21.15.104:0/1358648037 wait complete. 2024-09-17T02:54:46.486 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-17T02:54:45.620096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560878,"statfs":{"total":1600000000,"available":1598339129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.503119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130517+0000","last_change":"2024-09-17T02:54:41.130517+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130517+0000","last_undegraded":"2024-09-17T02:54:41.130517+0000","last_fullsized":"2024-09-17T02:54:41.130517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122171+0000","last_change":"2024-09-17T02:54:41.122171+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122171+0000","last_undegraded":"2024-09-17T02:54:41.122171+0000","last_fullsized":"2024-09-17T02:54:41.122171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131260+0000","last_change":"2024-09-17T02:54:41.131260+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131260+0000","last_undegraded":"2024-09-17T02:54:41.131260+0000","last_fullsized":"2024-09-17T02:54:41.131260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.126552+0000","last_change":"2024-09-17T02:54:41.126552+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.126552+0000","last_undegraded":"2024-09-17T02:54:41.126552+0000","last_fullsized":"2024-09-17T02:54:41.126552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130398+0000","last_change":"2024-09-17T02:54:41.130398+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130398+0000","last_undegraded":"2024-09-17T02:54:41.130398+0000","last_fullsized":"2024-09-17T02:54:41.130398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130327+0000","last_change":"2024-09-17T02:54:41.130327+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130327+0000","last_undegraded":"2024-09-17T02:54:41.130327+0000","last_fullsized":"2024-09-17T02:54:41.130327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130279+0000","last_change":"2024-09-17T02:54:41.130279+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130279+0000","last_undegraded":"2024-09-17T02:54:41.130279+0000","last_fullsized":"2024-09-17T02:54:41.130279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.135110+0000","last_change":"2024-09-17T02:54:41.135110+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.135110+0000","last_undegraded":"2024-09-17T02:54:41.135110+0000","last_fullsized":"2024-09-17T02:54:41.135110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133007+0000","last_change":"2024-09-17T02:54:41.133007+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133007+0000","last_undegraded":"2024-09-17T02:54:41.133007+0000","last_fullsized":"2024-09-17T02:54:41.133007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.123404+0000","last_change":"2024-09-17T02:54:41.123404+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.123404+0000","last_undegraded":"2024-09-17T02:54:41.123404+0000","last_fullsized":"2024-09-17T02:54:41.123404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125964+0000","last_change":"2024-09-17T02:54:41.125964+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125964+0000","last_undegraded":"2024-09-17T02:54:41.125964+0000","last_fullsized":"2024-09-17T02:54:41.125964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120120+0000","last_change":"2024-09-17T02:54:41.120120+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120120+0000","last_undegraded":"2024-09-17T02:54:41.120120+0000","last_fullsized":"2024-09-17T02:54:41.120120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.134702+0000","last_change":"2024-09-17T02:54:41.134702+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.134702+0000","last_undegraded":"2024-09-17T02:54:41.134702+0000","last_fullsized":"2024-09-17T02:54:41.134702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132885+0000","last_change":"2024-09-17T02:54:41.132885+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132885+0000","last_undegraded":"2024-09-17T02:54:41.132885+0000","last_fullsized":"2024-09-17T02:54:41.132885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122576+0000","last_change":"2024-09-17T02:54:41.122576+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122576+0000","last_undegraded":"2024-09-17T02:54:41.122576+0000","last_fullsized":"2024-09-17T02:54:41.122576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130773+0000","last_change":"2024-09-17T02:54:41.130773+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130773+0000","last_undegraded":"2024-09-17T02:54:41.130773+0000","last_fullsized":"2024-09-17T02:54:41.130773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131322+0000","last_change":"2024-09-17T02:54:41.131322+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131322+0000","last_undegraded":"2024-09-17T02:54:41.131322+0000","last_fullsized":"2024-09-17T02:54:41.131322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.126593+0000","last_change":"2024-09-17T02:54:41.126593+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.126593+0000","last_undegraded":"2024-09-17T02:54:41.126593+0000","last_fullsized":"2024-09-17T02:54:41.126593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131949+0000","last_change":"2024-09-17T02:54:41.131949+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131949+0000","last_undegraded":"2024-09-17T02:54:41.131949+0000","last_fullsized":"2024-09-17T02:54:41.131949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121576+0000","last_change":"2024-09-17T02:54:41.121576+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121576+0000","last_undegraded":"2024-09-17T02:54:41.121576+0000","last_fullsized":"2024-09-17T02:54:41.121576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131790+0000","last_change":"2024-09-17T02:54:41.131790+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131790+0000","last_undegraded":"2024-09-17T02:54:41.131790+0000","last_fullsized":"2024-09-17T02:54:41.131790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128916+0000","last_change":"2024-09-17T02:54:41.128916+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128916+0000","last_undegraded":"2024-09-17T02:54:41.128916+0000","last_fullsized":"2024-09-17T02:54:41.128916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132876+0000","last_change":"2024-09-17T02:54:41.132876+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132876+0000","last_undegraded":"2024-09-17T02:54:41.132876+0000","last_fullsized":"2024-09-17T02:54:41.132876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125363+0000","last_change":"2024-09-17T02:54:41.125363+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125363+0000","last_undegraded":"2024-09-17T02:54:41.125363+0000","last_fullsized":"2024-09-17T02:54:41.125363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133659+0000","last_change":"2024-09-17T02:54:41.133659+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133659+0000","last_undegraded":"2024-09-17T02:54:41.133659+0000","last_fullsized":"2024-09-17T02:54:41.133659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.124025+0000","last_change":"2024-09-17T02:54:41.124025+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.124025+0000","last_undegraded":"2024-09-17T02:54:41.124025+0000","last_fullsized":"2024-09-17T02:54:41.124025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121705+0000","last_change":"2024-09-17T02:54:41.121705+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121705+0000","last_undegraded":"2024-09-17T02:54:41.121705+0000","last_fullsized":"2024-09-17T02:54:41.121705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132067+0000","last_change":"2024-09-17T02:54:41.132067+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132067+0000","last_undegraded":"2024-09-17T02:54:41.132067+0000","last_fullsized":"2024-09-17T02:54:41.132067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132505+0000","last_change":"2024-09-17T02:54:41.132505+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132505+0000","last_undegraded":"2024-09-17T02:54:41.132505+0000","last_fullsized":"2024-09-17T02:54:41.132505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129522+0000","last_change":"2024-09-17T02:54:41.129522+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129522+0000","last_undegraded":"2024-09-17T02:54:41.129522+0000","last_fullsized":"2024-09-17T02:54:41.129522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125871+0000","last_change":"2024-09-17T02:54:41.125871+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125871+0000","last_undegraded":"2024-09-17T02:54:41.125871+0000","last_fullsized":"2024-09-17T02:54:41.125871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121813+0000","last_change":"2024-09-17T02:54:41.121813+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121813+0000","last_undegraded":"2024-09-17T02:54:41.121813+0000","last_fullsized":"2024-09-17T02:54:41.121813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.119974+0000","last_change":"2024-09-17T02:54:41.119974+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.119974+0000","last_undegraded":"2024-09-17T02:54:41.119974+0000","last_fullsized":"2024-09-17T02:54:41.119974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.137195+0000","last_change":"2024-09-17T02:54:41.136992+0000","last_active":"2024-09-17T02:54:41.137195+0000","last_peered":"2024-09-17T02:54:41.137195+0000","last_clean":"2024-09-17T02:54:41.137195+0000","last_became_active":"2024-09-17T02:54:41.136720+0000","last_became_peered":"2024-09-17T02:54:41.136720+0000","last_unstale":"2024-09-17T02:54:41.137195+0000","last_undegraded":"2024-09-17T02:54:41.137195+0000","last_fullsized":"2024-09-17T02:54:41.137195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:21.267377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129425+0000","last_change":"2024-09-17T02:54:41.129425+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129425+0000","last_undegraded":"2024-09-17T02:54:41.129425+0000","last_fullsized":"2024-09-17T02:54:41.129425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127168+0000","last_change":"2024-09-17T02:54:41.125908+0000","last_active":"2024-09-17T02:54:41.127168+0000","last_peered":"2024-09-17T02:54:41.127168+0000","last_clean":"2024-09-17T02:54:41.127168+0000","last_became_active":"2024-09-17T02:54:41.124285+0000","last_became_peered":"2024-09-17T02:54:41.124285+0000","last_unstale":"2024-09-17T02:54:41.127168+0000","last_undegraded":"2024-09-17T02:54:41.127168+0000","last_fullsized":"2024-09-17T02:54:41.127168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:05.746577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134195+0000","last_change":"2024-09-17T02:54:41.133974+0000","last_active":"2024-09-17T02:54:41.134195+0000","last_peered":"2024-09-17T02:54:41.134195+0000","last_clean":"2024-09-17T02:54:41.134195+0000","last_became_active":"2024-09-17T02:54:41.130208+0000","last_became_peered":"2024-09-17T02:54:41.130208+0000","last_unstale":"2024-09-17T02:54:41.134195+0000","last_undegraded":"2024-09-17T02:54:41.134195+0000","last_fullsized":"2024-09-17T02:54:41.134195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:56.463219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132526+0000","last_change":"2024-09-17T02:54:41.132526+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132526+0000","last_undegraded":"2024-09-17T02:54:41.132526+0000","last_fullsized":"2024-09-17T02:54:41.132526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133864+0000","last_change":"2024-09-17T02:54:41.133392+0000","last_active":"2024-09-17T02:54:41.133864+0000","last_peered":"2024-09-17T02:54:41.133864+0000","last_clean":"2024-09-17T02:54:41.133864+0000","last_became_active":"2024-09-17T02:54:41.130773+0000","last_became_peered":"2024-09-17T02:54:41.130773+0000","last_unstale":"2024-09-17T02:54:41.133864+0000","last_undegraded":"2024-09-17T02:54:41.133864+0000","last_fullsized":"2024-09-17T02:54:41.133864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:53.322507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122907+0000","last_change":"2024-09-17T02:54:41.122907+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122907+0000","last_undegraded":"2024-09-17T02:54:41.122907+0000","last_fullsized":"2024-09-17T02:54:41.122907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.136369+0000","last_change":"2024-09-17T02:54:41.136164+0000","last_active":"2024-09-17T02:54:41.136369+0000","last_peered":"2024-09-17T02:54:41.136369+0000","last_clean":"2024-09-17T02:54:41.136369+0000","last_became_active":"2024-09-17T02:54:41.135870+0000","last_became_peered":"2024-09-17T02:54:41.135870+0000","last_unstale":"2024-09-17T02:54:41.136369+0000","last_undegraded":"2024-09-17T02:54:41.136369+0000","last_fullsized":"2024-09-17T02:54:41.136369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:14.379519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130202+0000","last_change":"2024-09-17T02:54:41.130202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130202+0000","last_undegraded":"2024-09-17T02:54:41.130202+0000","last_fullsized":"2024-09-17T02:54:41.130202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134987+0000","last_change":"2024-09-17T02:54:41.134782+0000","last_active":"2024-09-17T02:54:41.134987+0000","last_peered":"2024-09-17T02:54:41.134987+0000","last_clean":"2024-09-17T02:54:41.134987+0000","last_became_active":"2024-09-17T02:54:41.133444+0000","last_became_peered":"2024-09-17T02:54:41.133444+0000","last_unstale":"2024-09-17T02:54:41.134987+0000","last_undegraded":"2024-09-17T02:54:41.134987+0000","last_fullsized":"2024-09-17T02:54:41.134987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:12.223351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130537+0000","last_change":"2024-09-17T02:54:41.130537+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130537+0000","last_undegraded":"2024-09-17T02:54:41.130537+0000","last_fullsized":"2024-09-17T02:54:41.130537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133346+0000","last_change":"2024-09-17T02:54:41.133126+0000","last_active":"2024-09-17T02:54:41.133346+0000","last_peered":"2024-09-17T02:54:41.133346+0000","last_clean":"2024-09-17T02:54:41.133346+0000","last_became_active":"2024-09-17T02:54:41.132866+0000","last_became_peered":"2024-09-17T02:54:41.132866+0000","last_unstale":"2024-09-17T02:54:41.133346+0000","last_undegraded":"2024-09-17T02:54:41.133346+0000","last_fullsized":"2024-09-17T02:54:41.133346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:50.498949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120006+0000","last_change":"2024-09-17T02:54:41.120006+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120006+0000","last_undegraded":"2024-09-17T02:54:41.120006+0000","last_fullsized":"2024-09-17T02:54:41.120006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129424+0000","last_change":"2024-09-17T02:54:41.128843+0000","last_active":"2024-09-17T02:54:41.129424+0000","last_peered":"2024-09-17T02:54:41.129424+0000","last_clean":"2024-09-17T02:54:41.129424+0000","last_became_active":"2024-09-17T02:54:41.128490+0000","last_became_peered":"2024-09-17T02:54:41.128490+0000","last_unstale":"2024-09-17T02:54:41.129424+0000","last_undegraded":"2024-09-17T02:54:41.129424+0000","last_fullsized":"2024-09-17T02:54:41.129424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:51.918042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129800+0000","last_change":"2024-09-17T02:54:41.129800+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129800+0000","last_undegraded":"2024-09-17T02:54:41.129800+0000","last_fullsized":"2024-09-17T02:54:41.129800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127223+0000","last_change":"2024-09-17T02:54:41.126988+0000","last_active":"2024-09-17T02:54:41.127223+0000","last_peered":"2024-09-17T02:54:41.127223+0000","last_clean":"2024-09-17T02:54:41.127223+0000","last_became_active":"2024-09-17T02:54:41.126723+0000","last_became_peered":"2024-09-17T02:54:41.126723+0000","last_unstale":"2024-09-17T02:54:41.127223+0000","last_undegraded":"2024-09-17T02:54:41.127223+0000","last_fullsized":"2024-09-17T02:54:41.127223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:13.136462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129581+0000","last_change":"2024-09-17T02:54:41.129581+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129581+0000","last_undegraded":"2024-09-17T02:54:41.129581+0000","last_fullsized":"2024-09-17T02:54:41.129581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133215+0000","last_change":"2024-09-17T02:54:41.132996+0000","last_active":"2024-09-17T02:54:41.133215+0000","last_peered":"2024-09-17T02:54:41.133215+0000","last_clean":"2024-09-17T02:54:41.133215+0000","last_became_active":"2024-09-17T02:54:41.132135+0000","last_became_peered":"2024-09-17T02:54:41.132135+0000","last_unstale":"2024-09-17T02:54:41.133215+0000","last_undegraded":"2024-09-17T02:54:41.133215+0000","last_fullsized":"2024-09-17T02:54:41.133215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:34.553877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129798+0000","last_change":"2024-09-17T02:54:41.129798+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129798+0000","last_undegraded":"2024-09-17T02:54:41.129798+0000","last_fullsized":"2024-09-17T02:54:41.129798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127391+0000","last_change":"2024-09-17T02:54:41.127168+0000","last_active":"2024-09-17T02:54:41.127391+0000","last_peered":"2024-09-17T02:54:41.127391+0000","last_clean":"2024-09-17T02:54:41.127391+0000","last_became_active":"2024-09-17T02:54:41.126901+0000","last_became_peered":"2024-09-17T02:54:41.126901+0000","last_unstale":"2024-09-17T02:54:41.127391+0000","last_undegraded":"2024-09-17T02:54:41.127391+0000","last_fullsized":"2024-09-17T02:54:41.127391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:58.704223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121166+0000","last_change":"2024-09-17T02:54:41.121166+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121166+0000","last_undegraded":"2024-09-17T02:54:41.121166+0000","last_fullsized":"2024-09-17T02:54:41.121166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132252+0000","last_change":"2024-09-17T02:54:41.131775+0000","last_active":"2024-09-17T02:54:41.132252+0000","last_peered":"2024-09-17T02:54:41.132252+0000","last_clean":"2024-09-17T02:54:41.132252+0000","last_became_active":"2024-09-17T02:54:41.131311+0000","last_became_peered":"2024-09-17T02:54:41.131311+0000","last_unstale":"2024-09-17T02:54:41.132252+0000","last_undegraded":"2024-09-17T02:54:41.132252+0000","last_fullsized":"2024-09-17T02:54:41.132252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:01.120087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129637+0000","last_change":"2024-09-17T02:54:41.129637+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129637+0000","last_undegraded":"2024-09-17T02:54:41.129637+0000","last_fullsized":"2024-09-17T02:54:41.129637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.126141+0000","last_change":"2024-09-17T02:54:41.124818+0000","last_active":"2024-09-17T02:54:41.126141+0000","last_peered":"2024-09-17T02:54:41.126141+0000","last_clean":"2024-09-17T02:54:41.126141+0000","last_became_active":"2024-09-17T02:54:41.124391+0000","last_became_peered":"2024-09-17T02:54:41.124391+0000","last_unstale":"2024-09-17T02:54:41.126141+0000","last_undegraded":"2024-09-17T02:54:41.126141+0000","last_fullsized":"2024-09-17T02:54:41.126141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:59.494494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129293+0000","last_change":"2024-09-17T02:54:41.129293+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129293+0000","last_undegraded":"2024-09-17T02:54:41.129293+0000","last_fullsized":"2024-09-17T02:54:41.129293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.136924+0000","last_change":"2024-09-17T02:54:41.136678+0000","last_active":"2024-09-17T02:54:41.136924+0000","last_peered":"2024-09-17T02:54:41.136924+0000","last_clean":"2024-09-17T02:54:41.136924+0000","last_became_active":"2024-09-17T02:54:41.136398+0000","last_became_peered":"2024-09-17T02:54:41.136398+0000","last_unstale":"2024-09-17T02:54:41.136924+0000","last_undegraded":"2024-09-17T02:54:41.136924+0000","last_fullsized":"2024-09-17T02:54:41.136924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:00.204367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131095+0000","last_change":"2024-09-17T02:54:41.131095+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131095+0000","last_undegraded":"2024-09-17T02:54:41.131095+0000","last_fullsized":"2024-09-17T02:54:41.131095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129863+0000","last_change":"2024-09-17T02:54:41.129677+0000","last_active":"2024-09-17T02:54:41.129863+0000","last_peered":"2024-09-17T02:54:41.129863+0000","last_clean":"2024-09-17T02:54:41.129863+0000","last_became_active":"2024-09-17T02:54:41.128120+0000","last_became_peered":"2024-09-17T02:54:41.128120+0000","last_unstale":"2024-09-17T02:54:41.129863+0000","last_undegraded":"2024-09-17T02:54:41.129863+0000","last_fullsized":"2024-09-17T02:54:41.129863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:46.494366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128503+0000","last_change":"2024-09-17T02:54:41.128503+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128503+0000","last_undegraded":"2024-09-17T02:54:41.128503+0000","last_fullsized":"2024-09-17T02:54:41.128503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.135852+0000","last_change":"2024-09-17T02:54:41.135494+0000","last_active":"2024-09-17T02:54:41.135852+0000","last_peered":"2024-09-17T02:54:41.135852+0000","last_clean":"2024-09-17T02:54:41.135852+0000","last_became_active":"2024-09-17T02:54:41.135146+0000","last_became_peered":"2024-09-17T02:54:41.135146+0000","last_unstale":"2024-09-17T02:54:41.135852+0000","last_undegraded":"2024-09-17T02:54:41.135852+0000","last_fullsized":"2024-09-17T02:54:41.135852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:08.413771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129371+0000","last_change":"2024-09-17T02:54:41.129371+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129371+0000","last_undegraded":"2024-09-17T02:54:41.129371+0000","last_fullsized":"2024-09-17T02:54:41.129371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":107,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.123127+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:54:41.123127+0000","last_peered":"2024-09-17T02:54:41.123127+0000","last_clean":"2024-09-17T02:54:41.123127+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:54:41.123127+0000","last_undegraded":"2024-09-17T02:54:41.123127+0000","last_fullsized":"2024-09-17T02:54:41.123127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132634+0000","last_change":"2024-09-17T02:54:41.132405+0000","last_active":"2024-09-17T02:54:41.132634+0000","last_peered":"2024-09-17T02:54:41.132634+0000","last_clean":"2024-09-17T02:54:41.132634+0000","last_became_active":"2024-09-17T02:54:41.131396+0000","last_became_peered":"2024-09-17T02:54:41.131396+0000","last_unstale":"2024-09-17T02:54:41.132634+0000","last_undegraded":"2024-09-17T02:54:41.132634+0000","last_fullsized":"2024-09-17T02:54:41.132634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:55.412737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133920+0000","last_change":"2024-09-17T02:54:41.133920+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133920+0000","last_undegraded":"2024-09-17T02:54:41.133920+0000","last_fullsized":"2024-09-17T02:54:41.133920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134238+0000","last_change":"2024-09-17T02:54:41.134010+0000","last_active":"2024-09-17T02:54:41.134238+0000","last_peered":"2024-09-17T02:54:41.134238+0000","last_clean":"2024-09-17T02:54:41.134238+0000","last_became_active":"2024-09-17T02:54:41.133330+0000","last_became_peered":"2024-09-17T02:54:41.133330+0000","last_unstale":"2024-09-17T02:54:41.134238+0000","last_undegraded":"2024-09-17T02:54:41.134238+0000","last_fullsized":"2024-09-17T02:54:41.134238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:22.013803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128493+0000","last_change":"2024-09-17T02:54:41.128493+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128493+0000","last_undegraded":"2024-09-17T02:54:41.128493+0000","last_fullsized":"2024-09-17T02:54:41.128493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.137095+0000","last_change":"2024-09-17T02:54:41.136814+0000","last_active":"2024-09-17T02:54:41.137095+0000","last_peered":"2024-09-17T02:54:41.137095+0000","last_clean":"2024-09-17T02:54:41.137095+0000","last_became_active":"2024-09-17T02:54:41.136504+0000","last_became_peered":"2024-09-17T02:54:41.136504+0000","last_unstale":"2024-09-17T02:54:41.137095+0000","last_undegraded":"2024-09-17T02:54:41.137095+0000","last_fullsized":"2024-09-17T02:54:41.137095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:43.506144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121835+0000","last_change":"2024-09-17T02:54:41.121835+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121835+0000","last_undegraded":"2024-09-17T02:54:41.121835+0000","last_fullsized":"2024-09-17T02:54:41.121835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.135266+0000","last_change":"2024-09-17T02:54:41.135077+0000","last_active":"2024-09-17T02:54:41.135266+0000","last_peered":"2024-09-17T02:54:41.135266+0000","last_clean":"2024-09-17T02:54:41.135266+0000","last_became_active":"2024-09-17T02:54:41.134456+0000","last_became_peered":"2024-09-17T02:54:41.134456+0000","last_unstale":"2024-09-17T02:54:41.135266+0000","last_undegraded":"2024-09-17T02:54:41.135266+0000","last_fullsized":"2024-09-17T02:54:41.135266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:44.578710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120202+0000","last_change":"2024-09-17T02:54:41.120202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120202+0000","last_undegraded":"2024-09-17T02:54:41.120202+0000","last_fullsized":"2024-09-17T02:54:41.120202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129498+0000","last_change":"2024-09-17T02:54:41.129281+0000","last_active":"2024-09-17T02:54:41.129498+0000","last_peered":"2024-09-17T02:54:41.129498+0000","last_clean":"2024-09-17T02:54:41.129498+0000","last_became_active":"2024-09-17T02:54:41.129016+0000","last_became_peered":"2024-09-17T02:54:41.129016+0000","last_unstale":"2024-09-17T02:54:41.129498+0000","last_undegraded":"2024-09-17T02:54:41.129498+0000","last_fullsized":"2024-09-17T02:54:41.129498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:06.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.124882+0000","last_change":"2024-09-17T02:54:41.124882+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.124882+0000","last_undegraded":"2024-09-17T02:54:41.124882+0000","last_fullsized":"2024-09-17T02:54:41.124882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.128403+0000","last_change":"2024-09-17T02:54:41.127905+0000","last_active":"2024-09-17T02:54:41.128403+0000","last_peered":"2024-09-17T02:54:41.128403+0000","last_clean":"2024-09-17T02:54:41.128403+0000","last_became_active":"2024-09-17T02:54:41.127616+0000","last_became_peered":"2024-09-17T02:54:41.127616+0000","last_unstale":"2024-09-17T02:54:41.128403+0000","last_undegraded":"2024-09-17T02:54:41.128403+0000","last_fullsized":"2024-09-17T02:54:41.128403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:02.722545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.123201+0000","last_change":"2024-09-17T02:54:41.123201+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.123201+0000","last_undegraded":"2024-09-17T02:54:41.123201+0000","last_fullsized":"2024-09-17T02:54:41.123201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.131382+0000","last_change":"2024-09-17T02:54:41.130345+0000","last_active":"2024-09-17T02:54:41.131382+0000","last_peered":"2024-09-17T02:54:41.131382+0000","last_clean":"2024-09-17T02:54:41.131382+0000","last_became_active":"2024-09-17T02:54:41.130078+0000","last_became_peered":"2024-09-17T02:54:41.130078+0000","last_unstale":"2024-09-17T02:54:41.131382+0000","last_undegraded":"2024-09-17T02:54:41.131382+0000","last_fullsized":"2024-09-17T02:54:41.131382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:36.803460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.134299+0000","last_change":"2024-09-17T02:54:41.134299+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.134299+0000","last_undegraded":"2024-09-17T02:54:41.134299+0000","last_fullsized":"2024-09-17T02:54:41.134299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.125742+0000","last_change":"2024-09-17T02:54:41.125471+0000","last_active":"2024-09-17T02:54:41.125742+0000","last_peered":"2024-09-17T02:54:41.125742+0000","last_clean":"2024-09-17T02:54:41.125742+0000","last_became_active":"2024-09-17T02:54:41.124551+0000","last_became_peered":"2024-09-17T02:54:41.124551+0000","last_unstale":"2024-09-17T02:54:41.125742+0000","last_undegraded":"2024-09-17T02:54:41.125742+0000","last_fullsized":"2024-09-17T02:54:41.125742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.897379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128964+0000","last_change":"2024-09-17T02:54:41.128964+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128964+0000","last_undegraded":"2024-09-17T02:54:41.128964+0000","last_fullsized":"2024-09-17T02:54:41.128964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127405+0000","last_change":"2024-09-17T02:54:41.127039+0000","last_active":"2024-09-17T02:54:41.127405+0000","last_peered":"2024-09-17T02:54:41.127405+0000","last_clean":"2024-09-17T02:54:41.127405+0000","last_became_active":"2024-09-17T02:54:41.126724+0000","last_became_peered":"2024-09-17T02:54:41.126724+0000","last_unstale":"2024-09-17T02:54:41.127405+0000","last_undegraded":"2024-09-17T02:54:41.127405+0000","last_fullsized":"2024-09-17T02:54:41.127405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:41.785060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121403+0000","last_change":"2024-09-17T02:54:41.121403+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121403+0000","last_undegraded":"2024-09-17T02:54:41.121403+0000","last_fullsized":"2024-09-17T02:54:41.121403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132278+0000","last_change":"2024-09-17T02:54:41.131579+0000","last_active":"2024-09-17T02:54:41.132278+0000","last_peered":"2024-09-17T02:54:41.132278+0000","last_clean":"2024-09-17T02:54:41.132278+0000","last_became_active":"2024-09-17T02:54:41.131123+0000","last_became_peered":"2024-09-17T02:54:41.131123+0000","last_unstale":"2024-09-17T02:54:41.132278+0000","last_undegraded":"2024-09-17T02:54:41.132278+0000","last_fullsized":"2024-09-17T02:54:41.132278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:57.401823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130586+0000","last_change":"2024-09-17T02:54:41.130586+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130586+0000","last_undegraded":"2024-09-17T02:54:41.130586+0000","last_fullsized":"2024-09-17T02:54:41.130586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129835+0000","last_change":"2024-09-17T02:54:41.127869+0000","last_active":"2024-09-17T02:54:41.129835+0000","last_peered":"2024-09-17T02:54:41.129835+0000","last_clean":"2024-09-17T02:54:41.129835+0000","last_became_active":"2024-09-17T02:54:41.127552+0000","last_became_peered":"2024-09-17T02:54:41.127552+0000","last_unstale":"2024-09-17T02:54:41.129835+0000","last_undegraded":"2024-09-17T02:54:41.129835+0000","last_fullsized":"2024-09-17T02:54:41.129835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:41.305801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130557+0000","last_change":"2024-09-17T02:54:41.130557+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130557+0000","last_undegraded":"2024-09-17T02:54:41.130557+0000","last_fullsized":"2024-09-17T02:54:41.130557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127062+0000","last_change":"2024-09-17T02:54:41.126814+0000","last_active":"2024-09-17T02:54:41.127062+0000","last_peered":"2024-09-17T02:54:41.127062+0000","last_clean":"2024-09-17T02:54:41.127062+0000","last_became_active":"2024-09-17T02:54:41.126505+0000","last_became_peered":"2024-09-17T02:54:41.126505+0000","last_unstale":"2024-09-17T02:54:41.127062+0000","last_undegraded":"2024-09-17T02:54:41.127062+0000","last_fullsized":"2024-09-17T02:54:41.127062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:52.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121904+0000","last_change":"2024-09-17T02:54:41.121904+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121904+0000","last_undegraded":"2024-09-17T02:54:41.121904+0000","last_fullsized":"2024-09-17T02:54:41.121904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128954+0000","last_change":"2024-09-17T02:54:41.128954+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128954+0000","last_undegraded":"2024-09-17T02:54:41.128954+0000","last_fullsized":"2024-09-17T02:54:41.128954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133576+0000","last_change":"2024-09-17T02:54:41.133352+0000","last_active":"2024-09-17T02:54:41.133576+0000","last_peered":"2024-09-17T02:54:41.133576+0000","last_clean":"2024-09-17T02:54:41.133576+0000","last_became_active":"2024-09-17T02:54:41.133001+0000","last_became_peered":"2024-09-17T02:54:41.133001+0000","last_unstale":"2024-09-17T02:54:41.133576+0000","last_undegraded":"2024-09-17T02:54:41.133576+0000","last_fullsized":"2024-09-17T02:54:41.133576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:19.533069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.127705+0000","last_change":"2024-09-17T02:54:41.127705+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.127705+0000","last_undegraded":"2024-09-17T02:54:41.127705+0000","last_fullsized":"2024-09-17T02:54:41.127705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.131668+0000","last_change":"2024-09-17T02:54:41.131298+0000","last_active":"2024-09-17T02:54:41.131668+0000","last_peered":"2024-09-17T02:54:41.131668+0000","last_clean":"2024-09-17T02:54:41.131668+0000","last_became_active":"2024-09-17T02:54:41.131019+0000","last_became_peered":"2024-09-17T02:54:41.131019+0000","last_unstale":"2024-09-17T02:54:41.131668+0000","last_undegraded":"2024-09-17T02:54:41.131668+0000","last_fullsized":"2024-09-17T02:54:41.131668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:34.067992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130202+0000","last_change":"2024-09-17T02:54:41.130202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130202+0000","last_undegraded":"2024-09-17T02:54:41.130202+0000","last_fullsized":"2024-09-17T02:54:41.130202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129312+0000","last_change":"2024-09-17T02:54:41.128714+0000","last_active":"2024-09-17T02:54:41.129312+0000","last_peered":"2024-09-17T02:54:41.129312+0000","last_clean":"2024-09-17T02:54:41.129312+0000","last_became_active":"2024-09-17T02:54:41.128099+0000","last_became_peered":"2024-09-17T02:54:41.128099+0000","last_unstale":"2024-09-17T02:54:41.129312+0000","last_undegraded":"2024-09-17T02:54:41.129312+0000","last_fullsized":"2024-09-17T02:54:41.129312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:30.938338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133695+0000","last_change":"2024-09-17T02:54:41.133695+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133695+0000","last_undegraded":"2024-09-17T02:54:41.133695+0000","last_fullsized":"2024-09-17T02:54:41.133695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.125711+0000","last_change":"2024-09-17T02:54:41.125421+0000","last_active":"2024-09-17T02:54:41.125711+0000","last_peered":"2024-09-17T02:54:41.125711+0000","last_clean":"2024-09-17T02:54:41.125711+0000","last_became_active":"2024-09-17T02:54:41.124528+0000","last_became_peered":"2024-09-17T02:54:41.124528+0000","last_unstale":"2024-09-17T02:54:41.125711+0000","last_undegraded":"2024-09-17T02:54:41.125711+0000","last_fullsized":"2024-09-17T02:54:41.125711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:34.437280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194675,"statfs":{"total":200000000,"available":199347262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:54:46.489 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:54:46.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.639+0000 7f61ab513640 1 -- 172.21.15.104:0/344934599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6190003f90 msgr2=0x7f6190004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.639+0000 7f61ab513640 1 --2- 172.21.15.104:0/344934599 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6190003f90 0x7f6190004800 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f61a40713d0 tx=0x7f6190005830 comp rx=0 tx=0).stop 2024-09-17T02:54:46.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.639+0000 7f61a9ab0640 1 -- 172.21.15.104:0/344934599 reap_dead start 2024-09-17T02:54:46.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.639+0000 7f61ab513640 1 -- 172.21.15.104:0/344934599 shutdown_connections 2024-09-17T02:54:46.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.639+0000 7f61ab513640 1 -- 172.21.15.104:0/344934599 >> 172.21.15.104:0/344934599 conn(0x7f61a40b3640 msgr2=0x7f61a40b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:46.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.639+0000 7f61ab513640 1 -- 172.21.15.104:0/344934599 shutdown_connections 2024-09-17T02:54:46.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.639+0000 7f61ab513640 1 -- 172.21.15.104:0/344934599 wait complete. 2024-09-17T02:54:46.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.641+0000 7f61ab513640 1 Processor -- start 2024-09-17T02:54:46.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.641+0000 7f61ab513640 1 -- start start 2024-09-17T02:54:46.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61ab513640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190003f90 0x7f61a414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61ab513640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a41f5870 0x7f61a40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61ab513640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a41f95d0 0x7f61a41512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61ab513640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f61a4164b90 con 0x7f61a41f5870 2024-09-17T02:54:46.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61ab513640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61a4164a10 con 0x7f6190003f90 2024-09-17T02:54:46.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61ab513640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61a4164d10 con 0x7f61a41f95d0 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a41f5870 0x7f61a40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a41f5870 0x7f61a40cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52186/0 (socket says 172.21.15.104:52186) 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 -- 172.21.15.104:0/76413871 learned_addr learned my addr 172.21.15.104:0/76413871 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a92af640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190003f90 0x7f61a414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a9ab0640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a41f95d0 0x7f61a41512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 -- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a41f95d0 msgr2=0x7f61a41512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a41f95d0 0x7f61a41512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 -- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190003f90 msgr2=0x7f61a414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190003f90 0x7f61a414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 -- 172.21.15.104:0/76413871 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a40d0700 con 0x7f61a41f5870 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a92af640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190003f90 0x7f61a414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a9ab0640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a41f95d0 0x7f61a41512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.642+0000 7f61a8aae640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a41f5870 0x7f61a40cdb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61940017d0 tx=0x7f6194004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:46.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.643+0000 7f6199ffb640 1 -- 172.21.15.104:0/76413871 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194038070 con 0x7f61a41f5870 2024-09-17T02:54:46.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.643+0000 7f6199ffb640 1 -- 172.21.15.104:0/76413871 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6194033470 con 0x7f61a41f5870 2024-09-17T02:54:46.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.643+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a40d09e0 con 0x7f61a41f5870 2024-09-17T02:54:46.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.643+0000 7f6199ffb640 1 -- 172.21.15.104:0/76413871 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940068c0 con 0x7f61a41f5870 2024-09-17T02:54:46.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.643+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a41f6030 con 0x7f61a41f5870 2024-09-17T02:54:46.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.644+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a40d0420 con 0x7f61a41f5870 2024-09-17T02:54:46.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.644+0000 7f6199ffb640 1 -- 172.21.15.104:0/76413871 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6194043020 con 0x7f61a41f5870 2024-09-17T02:54:46.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.645+0000 7f6199ffb640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6188078bc0 0x7f618807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.645+0000 7f6199ffb640 1 -- 172.21.15.104:0/76413871 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f61940ba930 con 0x7f61a41f5870 2024-09-17T02:54:46.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.645+0000 7f61a92af640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6188078bc0 0x7f618807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.646+0000 7f61a92af640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6188078bc0 0x7f618807b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61a4073380 tx=0x7f61a0006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:46.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.649+0000 7f6199ffb640 1 -- 172.21.15.104:0/76413871 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6194082e90 con 0x7f61a41f5870 2024-09-17T02:54:46.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.820+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61a406f520 con 0x7f6188078bc0 2024-09-17T02:54:46.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.824+0000 7f6199ffb640 1 -- 172.21.15.104:0/76413871 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242229 (secure 0 0 0) 0x7f61a406f520 con 0x7f6188078bc0 2024-09-17T02:54:46.826 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:46.827 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:54:46.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.827+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6188078bc0 msgr2=0x7f618807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.827+0000 7f61ab513640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6188078bc0 0x7f618807b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f61a4073380 tx=0x7f61a0006720 comp rx=0 tx=0).stop 2024-09-17T02:54:46.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.827+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a41f5870 msgr2=0x7f61a40cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.827+0000 7f61ab513640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a41f5870 0x7f61a40cdb30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f61940017d0 tx=0x7f6194004830 comp rx=0 tx=0).stop 2024-09-17T02:54:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.828+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 shutdown_connections 2024-09-17T02:54:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.828+0000 7f61ab513640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6188078bc0 0x7f618807b0d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.828+0000 7f61ab513640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a41f95d0 0x7f61a41512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.828+0000 7f61ab513640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61a41f5870 0x7f61a40cdb30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.828+0000 7f61ab513640 1 --2- 172.21.15.104:0/76413871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190003f90 0x7f61a414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.828+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 >> 172.21.15.104:0/76413871 conn(0x7f61a40b3640 msgr2=0x7f61a415ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.828+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 shutdown_connections 2024-09-17T02:54:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.828+0000 7f61ab513640 1 -- 172.21.15.104:0/76413871 wait complete. 2024-09-17T02:54:46.838 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-17T02:54:45.620096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560878,"statfs":{"total":1600000000,"available":1598339129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.503119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130517+0000","last_change":"2024-09-17T02:54:41.130517+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130517+0000","last_undegraded":"2024-09-17T02:54:41.130517+0000","last_fullsized":"2024-09-17T02:54:41.130517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122171+0000","last_change":"2024-09-17T02:54:41.122171+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122171+0000","last_undegraded":"2024-09-17T02:54:41.122171+0000","last_fullsized":"2024-09-17T02:54:41.122171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131260+0000","last_change":"2024-09-17T02:54:41.131260+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131260+0000","last_undegraded":"2024-09-17T02:54:41.131260+0000","last_fullsized":"2024-09-17T02:54:41.131260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.126552+0000","last_change":"2024-09-17T02:54:41.126552+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.126552+0000","last_undegraded":"2024-09-17T02:54:41.126552+0000","last_fullsized":"2024-09-17T02:54:41.126552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130398+0000","last_change":"2024-09-17T02:54:41.130398+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130398+0000","last_undegraded":"2024-09-17T02:54:41.130398+0000","last_fullsized":"2024-09-17T02:54:41.130398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130327+0000","last_change":"2024-09-17T02:54:41.130327+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130327+0000","last_undegraded":"2024-09-17T02:54:41.130327+0000","last_fullsized":"2024-09-17T02:54:41.130327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130279+0000","last_change":"2024-09-17T02:54:41.130279+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130279+0000","last_undegraded":"2024-09-17T02:54:41.130279+0000","last_fullsized":"2024-09-17T02:54:41.130279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.135110+0000","last_change":"2024-09-17T02:54:41.135110+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.135110+0000","last_undegraded":"2024-09-17T02:54:41.135110+0000","last_fullsized":"2024-09-17T02:54:41.135110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133007+0000","last_change":"2024-09-17T02:54:41.133007+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133007+0000","last_undegraded":"2024-09-17T02:54:41.133007+0000","last_fullsized":"2024-09-17T02:54:41.133007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.123404+0000","last_change":"2024-09-17T02:54:41.123404+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.123404+0000","last_undegraded":"2024-09-17T02:54:41.123404+0000","last_fullsized":"2024-09-17T02:54:41.123404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125964+0000","last_change":"2024-09-17T02:54:41.125964+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125964+0000","last_undegraded":"2024-09-17T02:54:41.125964+0000","last_fullsized":"2024-09-17T02:54:41.125964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120120+0000","last_change":"2024-09-17T02:54:41.120120+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120120+0000","last_undegraded":"2024-09-17T02:54:41.120120+0000","last_fullsized":"2024-09-17T02:54:41.120120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.134702+0000","last_change":"2024-09-17T02:54:41.134702+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.134702+0000","last_undegraded":"2024-09-17T02:54:41.134702+0000","last_fullsized":"2024-09-17T02:54:41.134702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132885+0000","last_change":"2024-09-17T02:54:41.132885+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132885+0000","last_undegraded":"2024-09-17T02:54:41.132885+0000","last_fullsized":"2024-09-17T02:54:41.132885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122576+0000","last_change":"2024-09-17T02:54:41.122576+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122576+0000","last_undegraded":"2024-09-17T02:54:41.122576+0000","last_fullsized":"2024-09-17T02:54:41.122576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130773+0000","last_change":"2024-09-17T02:54:41.130773+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130773+0000","last_undegraded":"2024-09-17T02:54:41.130773+0000","last_fullsized":"2024-09-17T02:54:41.130773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131322+0000","last_change":"2024-09-17T02:54:41.131322+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131322+0000","last_undegraded":"2024-09-17T02:54:41.131322+0000","last_fullsized":"2024-09-17T02:54:41.131322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.126593+0000","last_change":"2024-09-17T02:54:41.126593+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.126593+0000","last_undegraded":"2024-09-17T02:54:41.126593+0000","last_fullsized":"2024-09-17T02:54:41.126593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131949+0000","last_change":"2024-09-17T02:54:41.131949+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131949+0000","last_undegraded":"2024-09-17T02:54:41.131949+0000","last_fullsized":"2024-09-17T02:54:41.131949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121576+0000","last_change":"2024-09-17T02:54:41.121576+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121576+0000","last_undegraded":"2024-09-17T02:54:41.121576+0000","last_fullsized":"2024-09-17T02:54:41.121576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131790+0000","last_change":"2024-09-17T02:54:41.131790+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131790+0000","last_undegraded":"2024-09-17T02:54:41.131790+0000","last_fullsized":"2024-09-17T02:54:41.131790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128916+0000","last_change":"2024-09-17T02:54:41.128916+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128916+0000","last_undegraded":"2024-09-17T02:54:41.128916+0000","last_fullsized":"2024-09-17T02:54:41.128916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132876+0000","last_change":"2024-09-17T02:54:41.132876+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132876+0000","last_undegraded":"2024-09-17T02:54:41.132876+0000","last_fullsized":"2024-09-17T02:54:41.132876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125363+0000","last_change":"2024-09-17T02:54:41.125363+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125363+0000","last_undegraded":"2024-09-17T02:54:41.125363+0000","last_fullsized":"2024-09-17T02:54:41.125363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133659+0000","last_change":"2024-09-17T02:54:41.133659+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133659+0000","last_undegraded":"2024-09-17T02:54:41.133659+0000","last_fullsized":"2024-09-17T02:54:41.133659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.124025+0000","last_change":"2024-09-17T02:54:41.124025+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.124025+0000","last_undegraded":"2024-09-17T02:54:41.124025+0000","last_fullsized":"2024-09-17T02:54:41.124025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121705+0000","last_change":"2024-09-17T02:54:41.121705+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121705+0000","last_undegraded":"2024-09-17T02:54:41.121705+0000","last_fullsized":"2024-09-17T02:54:41.121705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132067+0000","last_change":"2024-09-17T02:54:41.132067+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132067+0000","last_undegraded":"2024-09-17T02:54:41.132067+0000","last_fullsized":"2024-09-17T02:54:41.132067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132505+0000","last_change":"2024-09-17T02:54:41.132505+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132505+0000","last_undegraded":"2024-09-17T02:54:41.132505+0000","last_fullsized":"2024-09-17T02:54:41.132505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129522+0000","last_change":"2024-09-17T02:54:41.129522+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129522+0000","last_undegraded":"2024-09-17T02:54:41.129522+0000","last_fullsized":"2024-09-17T02:54:41.129522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125871+0000","last_change":"2024-09-17T02:54:41.125871+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125871+0000","last_undegraded":"2024-09-17T02:54:41.125871+0000","last_fullsized":"2024-09-17T02:54:41.125871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121813+0000","last_change":"2024-09-17T02:54:41.121813+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121813+0000","last_undegraded":"2024-09-17T02:54:41.121813+0000","last_fullsized":"2024-09-17T02:54:41.121813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.119974+0000","last_change":"2024-09-17T02:54:41.119974+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.119974+0000","last_undegraded":"2024-09-17T02:54:41.119974+0000","last_fullsized":"2024-09-17T02:54:41.119974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.137195+0000","last_change":"2024-09-17T02:54:41.136992+0000","last_active":"2024-09-17T02:54:41.137195+0000","last_peered":"2024-09-17T02:54:41.137195+0000","last_clean":"2024-09-17T02:54:41.137195+0000","last_became_active":"2024-09-17T02:54:41.136720+0000","last_became_peered":"2024-09-17T02:54:41.136720+0000","last_unstale":"2024-09-17T02:54:41.137195+0000","last_undegraded":"2024-09-17T02:54:41.137195+0000","last_fullsized":"2024-09-17T02:54:41.137195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:21.267377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129425+0000","last_change":"2024-09-17T02:54:41.129425+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129425+0000","last_undegraded":"2024-09-17T02:54:41.129425+0000","last_fullsized":"2024-09-17T02:54:41.129425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127168+0000","last_change":"2024-09-17T02:54:41.125908+0000","last_active":"2024-09-17T02:54:41.127168+0000","last_peered":"2024-09-17T02:54:41.127168+0000","last_clean":"2024-09-17T02:54:41.127168+0000","last_became_active":"2024-09-17T02:54:41.124285+0000","last_became_peered":"2024-09-17T02:54:41.124285+0000","last_unstale":"2024-09-17T02:54:41.127168+0000","last_undegraded":"2024-09-17T02:54:41.127168+0000","last_fullsized":"2024-09-17T02:54:41.127168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:05.746577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134195+0000","last_change":"2024-09-17T02:54:41.133974+0000","last_active":"2024-09-17T02:54:41.134195+0000","last_peered":"2024-09-17T02:54:41.134195+0000","last_clean":"2024-09-17T02:54:41.134195+0000","last_became_active":"2024-09-17T02:54:41.130208+0000","last_became_peered":"2024-09-17T02:54:41.130208+0000","last_unstale":"2024-09-17T02:54:41.134195+0000","last_undegraded":"2024-09-17T02:54:41.134195+0000","last_fullsized":"2024-09-17T02:54:41.134195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:56.463219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132526+0000","last_change":"2024-09-17T02:54:41.132526+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132526+0000","last_undegraded":"2024-09-17T02:54:41.132526+0000","last_fullsized":"2024-09-17T02:54:41.132526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133864+0000","last_change":"2024-09-17T02:54:41.133392+0000","last_active":"2024-09-17T02:54:41.133864+0000","last_peered":"2024-09-17T02:54:41.133864+0000","last_clean":"2024-09-17T02:54:41.133864+0000","last_became_active":"2024-09-17T02:54:41.130773+0000","last_became_peered":"2024-09-17T02:54:41.130773+0000","last_unstale":"2024-09-17T02:54:41.133864+0000","last_undegraded":"2024-09-17T02:54:41.133864+0000","last_fullsized":"2024-09-17T02:54:41.133864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:53.322507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122907+0000","last_change":"2024-09-17T02:54:41.122907+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122907+0000","last_undegraded":"2024-09-17T02:54:41.122907+0000","last_fullsized":"2024-09-17T02:54:41.122907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.136369+0000","last_change":"2024-09-17T02:54:41.136164+0000","last_active":"2024-09-17T02:54:41.136369+0000","last_peered":"2024-09-17T02:54:41.136369+0000","last_clean":"2024-09-17T02:54:41.136369+0000","last_became_active":"2024-09-17T02:54:41.135870+0000","last_became_peered":"2024-09-17T02:54:41.135870+0000","last_unstale":"2024-09-17T02:54:41.136369+0000","last_undegraded":"2024-09-17T02:54:41.136369+0000","last_fullsized":"2024-09-17T02:54:41.136369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:14.379519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130202+0000","last_change":"2024-09-17T02:54:41.130202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130202+0000","last_undegraded":"2024-09-17T02:54:41.130202+0000","last_fullsized":"2024-09-17T02:54:41.130202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134987+0000","last_change":"2024-09-17T02:54:41.134782+0000","last_active":"2024-09-17T02:54:41.134987+0000","last_peered":"2024-09-17T02:54:41.134987+0000","last_clean":"2024-09-17T02:54:41.134987+0000","last_became_active":"2024-09-17T02:54:41.133444+0000","last_became_peered":"2024-09-17T02:54:41.133444+0000","last_unstale":"2024-09-17T02:54:41.134987+0000","last_undegraded":"2024-09-17T02:54:41.134987+0000","last_fullsized":"2024-09-17T02:54:41.134987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:12.223351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130537+0000","last_change":"2024-09-17T02:54:41.130537+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130537+0000","last_undegraded":"2024-09-17T02:54:41.130537+0000","last_fullsized":"2024-09-17T02:54:41.130537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133346+0000","last_change":"2024-09-17T02:54:41.133126+0000","last_active":"2024-09-17T02:54:41.133346+0000","last_peered":"2024-09-17T02:54:41.133346+0000","last_clean":"2024-09-17T02:54:41.133346+0000","last_became_active":"2024-09-17T02:54:41.132866+0000","last_became_peered":"2024-09-17T02:54:41.132866+0000","last_unstale":"2024-09-17T02:54:41.133346+0000","last_undegraded":"2024-09-17T02:54:41.133346+0000","last_fullsized":"2024-09-17T02:54:41.133346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:50.498949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120006+0000","last_change":"2024-09-17T02:54:41.120006+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120006+0000","last_undegraded":"2024-09-17T02:54:41.120006+0000","last_fullsized":"2024-09-17T02:54:41.120006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129424+0000","last_change":"2024-09-17T02:54:41.128843+0000","last_active":"2024-09-17T02:54:41.129424+0000","last_peered":"2024-09-17T02:54:41.129424+0000","last_clean":"2024-09-17T02:54:41.129424+0000","last_became_active":"2024-09-17T02:54:41.128490+0000","last_became_peered":"2024-09-17T02:54:41.128490+0000","last_unstale":"2024-09-17T02:54:41.129424+0000","last_undegraded":"2024-09-17T02:54:41.129424+0000","last_fullsized":"2024-09-17T02:54:41.129424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:51.918042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129800+0000","last_change":"2024-09-17T02:54:41.129800+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129800+0000","last_undegraded":"2024-09-17T02:54:41.129800+0000","last_fullsized":"2024-09-17T02:54:41.129800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127223+0000","last_change":"2024-09-17T02:54:41.126988+0000","last_active":"2024-09-17T02:54:41.127223+0000","last_peered":"2024-09-17T02:54:41.127223+0000","last_clean":"2024-09-17T02:54:41.127223+0000","last_became_active":"2024-09-17T02:54:41.126723+0000","last_became_peered":"2024-09-17T02:54:41.126723+0000","last_unstale":"2024-09-17T02:54:41.127223+0000","last_undegraded":"2024-09-17T02:54:41.127223+0000","last_fullsized":"2024-09-17T02:54:41.127223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:13.136462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129581+0000","last_change":"2024-09-17T02:54:41.129581+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129581+0000","last_undegraded":"2024-09-17T02:54:41.129581+0000","last_fullsized":"2024-09-17T02:54:41.129581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133215+0000","last_change":"2024-09-17T02:54:41.132996+0000","last_active":"2024-09-17T02:54:41.133215+0000","last_peered":"2024-09-17T02:54:41.133215+0000","last_clean":"2024-09-17T02:54:41.133215+0000","last_became_active":"2024-09-17T02:54:41.132135+0000","last_became_peered":"2024-09-17T02:54:41.132135+0000","last_unstale":"2024-09-17T02:54:41.133215+0000","last_undegraded":"2024-09-17T02:54:41.133215+0000","last_fullsized":"2024-09-17T02:54:41.133215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:34.553877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129798+0000","last_change":"2024-09-17T02:54:41.129798+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129798+0000","last_undegraded":"2024-09-17T02:54:41.129798+0000","last_fullsized":"2024-09-17T02:54:41.129798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127391+0000","last_change":"2024-09-17T02:54:41.127168+0000","last_active":"2024-09-17T02:54:41.127391+0000","last_peered":"2024-09-17T02:54:41.127391+0000","last_clean":"2024-09-17T02:54:41.127391+0000","last_became_active":"2024-09-17T02:54:41.126901+0000","last_became_peered":"2024-09-17T02:54:41.126901+0000","last_unstale":"2024-09-17T02:54:41.127391+0000","last_undegraded":"2024-09-17T02:54:41.127391+0000","last_fullsized":"2024-09-17T02:54:41.127391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:58.704223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121166+0000","last_change":"2024-09-17T02:54:41.121166+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121166+0000","last_undegraded":"2024-09-17T02:54:41.121166+0000","last_fullsized":"2024-09-17T02:54:41.121166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132252+0000","last_change":"2024-09-17T02:54:41.131775+0000","last_active":"2024-09-17T02:54:41.132252+0000","last_peered":"2024-09-17T02:54:41.132252+0000","last_clean":"2024-09-17T02:54:41.132252+0000","last_became_active":"2024-09-17T02:54:41.131311+0000","last_became_peered":"2024-09-17T02:54:41.131311+0000","last_unstale":"2024-09-17T02:54:41.132252+0000","last_undegraded":"2024-09-17T02:54:41.132252+0000","last_fullsized":"2024-09-17T02:54:41.132252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:01.120087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129637+0000","last_change":"2024-09-17T02:54:41.129637+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129637+0000","last_undegraded":"2024-09-17T02:54:41.129637+0000","last_fullsized":"2024-09-17T02:54:41.129637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.126141+0000","last_change":"2024-09-17T02:54:41.124818+0000","last_active":"2024-09-17T02:54:41.126141+0000","last_peered":"2024-09-17T02:54:41.126141+0000","last_clean":"2024-09-17T02:54:41.126141+0000","last_became_active":"2024-09-17T02:54:41.124391+0000","last_became_peered":"2024-09-17T02:54:41.124391+0000","last_unstale":"2024-09-17T02:54:41.126141+0000","last_undegraded":"2024-09-17T02:54:41.126141+0000","last_fullsized":"2024-09-17T02:54:41.126141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:59.494494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129293+0000","last_change":"2024-09-17T02:54:41.129293+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129293+0000","last_undegraded":"2024-09-17T02:54:41.129293+0000","last_fullsized":"2024-09-17T02:54:41.129293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.136924+0000","last_change":"2024-09-17T02:54:41.136678+0000","last_active":"2024-09-17T02:54:41.136924+0000","last_peered":"2024-09-17T02:54:41.136924+0000","last_clean":"2024-09-17T02:54:41.136924+0000","last_became_active":"2024-09-17T02:54:41.136398+0000","last_became_peered":"2024-09-17T02:54:41.136398+0000","last_unstale":"2024-09-17T02:54:41.136924+0000","last_undegraded":"2024-09-17T02:54:41.136924+0000","last_fullsized":"2024-09-17T02:54:41.136924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:00.204367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131095+0000","last_change":"2024-09-17T02:54:41.131095+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131095+0000","last_undegraded":"2024-09-17T02:54:41.131095+0000","last_fullsized":"2024-09-17T02:54:41.131095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129863+0000","last_change":"2024-09-17T02:54:41.129677+0000","last_active":"2024-09-17T02:54:41.129863+0000","last_peered":"2024-09-17T02:54:41.129863+0000","last_clean":"2024-09-17T02:54:41.129863+0000","last_became_active":"2024-09-17T02:54:41.128120+0000","last_became_peered":"2024-09-17T02:54:41.128120+0000","last_unstale":"2024-09-17T02:54:41.129863+0000","last_undegraded":"2024-09-17T02:54:41.129863+0000","last_fullsized":"2024-09-17T02:54:41.129863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:46.494366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128503+0000","last_change":"2024-09-17T02:54:41.128503+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128503+0000","last_undegraded":"2024-09-17T02:54:41.128503+0000","last_fullsized":"2024-09-17T02:54:41.128503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.135852+0000","last_change":"2024-09-17T02:54:41.135494+0000","last_active":"2024-09-17T02:54:41.135852+0000","last_peered":"2024-09-17T02:54:41.135852+0000","last_clean":"2024-09-17T02:54:41.135852+0000","last_became_active":"2024-09-17T02:54:41.135146+0000","last_became_peered":"2024-09-17T02:54:41.135146+0000","last_unstale":"2024-09-17T02:54:41.135852+0000","last_undegraded":"2024-09-17T02:54:41.135852+0000","last_fullsized":"2024-09-17T02:54:41.135852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:08.413771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129371+0000","last_change":"2024-09-17T02:54:41.129371+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129371+0000","last_undegraded":"2024-09-17T02:54:41.129371+0000","last_fullsized":"2024-09-17T02:54:41.129371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":107,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.123127+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:54:41.123127+0000","last_peered":"2024-09-17T02:54:41.123127+0000","last_clean":"2024-09-17T02:54:41.123127+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:54:41.123127+0000","last_undegraded":"2024-09-17T02:54:41.123127+0000","last_fullsized":"2024-09-17T02:54:41.123127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132634+0000","last_change":"2024-09-17T02:54:41.132405+0000","last_active":"2024-09-17T02:54:41.132634+0000","last_peered":"2024-09-17T02:54:41.132634+0000","last_clean":"2024-09-17T02:54:41.132634+0000","last_became_active":"2024-09-17T02:54:41.131396+0000","last_became_peered":"2024-09-17T02:54:41.131396+0000","last_unstale":"2024-09-17T02:54:41.132634+0000","last_undegraded":"2024-09-17T02:54:41.132634+0000","last_fullsized":"2024-09-17T02:54:41.132634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:55.412737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133920+0000","last_change":"2024-09-17T02:54:41.133920+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133920+0000","last_undegraded":"2024-09-17T02:54:41.133920+0000","last_fullsized":"2024-09-17T02:54:41.133920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134238+0000","last_change":"2024-09-17T02:54:41.134010+0000","last_active":"2024-09-17T02:54:41.134238+0000","last_peered":"2024-09-17T02:54:41.134238+0000","last_clean":"2024-09-17T02:54:41.134238+0000","last_became_active":"2024-09-17T02:54:41.133330+0000","last_became_peered":"2024-09-17T02:54:41.133330+0000","last_unstale":"2024-09-17T02:54:41.134238+0000","last_undegraded":"2024-09-17T02:54:41.134238+0000","last_fullsized":"2024-09-17T02:54:41.134238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:22.013803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128493+0000","last_change":"2024-09-17T02:54:41.128493+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128493+0000","last_undegraded":"2024-09-17T02:54:41.128493+0000","last_fullsized":"2024-09-17T02:54:41.128493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.137095+0000","last_change":"2024-09-17T02:54:41.136814+0000","last_active":"2024-09-17T02:54:41.137095+0000","last_peered":"2024-09-17T02:54:41.137095+0000","last_clean":"2024-09-17T02:54:41.137095+0000","last_became_active":"2024-09-17T02:54:41.136504+0000","last_became_peered":"2024-09-17T02:54:41.136504+0000","last_unstale":"2024-09-17T02:54:41.137095+0000","last_undegraded":"2024-09-17T02:54:41.137095+0000","last_fullsized":"2024-09-17T02:54:41.137095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:43.506144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121835+0000","last_change":"2024-09-17T02:54:41.121835+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121835+0000","last_undegraded":"2024-09-17T02:54:41.121835+0000","last_fullsized":"2024-09-17T02:54:41.121835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.135266+0000","last_change":"2024-09-17T02:54:41.135077+0000","last_active":"2024-09-17T02:54:41.135266+0000","last_peered":"2024-09-17T02:54:41.135266+0000","last_clean":"2024-09-17T02:54:41.135266+0000","last_became_active":"2024-09-17T02:54:41.134456+0000","last_became_peered":"2024-09-17T02:54:41.134456+0000","last_unstale":"2024-09-17T02:54:41.135266+0000","last_undegraded":"2024-09-17T02:54:41.135266+0000","last_fullsized":"2024-09-17T02:54:41.135266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:44.578710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120202+0000","last_change":"2024-09-17T02:54:41.120202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120202+0000","last_undegraded":"2024-09-17T02:54:41.120202+0000","last_fullsized":"2024-09-17T02:54:41.120202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129498+0000","last_change":"2024-09-17T02:54:41.129281+0000","last_active":"2024-09-17T02:54:41.129498+0000","last_peered":"2024-09-17T02:54:41.129498+0000","last_clean":"2024-09-17T02:54:41.129498+0000","last_became_active":"2024-09-17T02:54:41.129016+0000","last_became_peered":"2024-09-17T02:54:41.129016+0000","last_unstale":"2024-09-17T02:54:41.129498+0000","last_undegraded":"2024-09-17T02:54:41.129498+0000","last_fullsized":"2024-09-17T02:54:41.129498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:06.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.124882+0000","last_change":"2024-09-17T02:54:41.124882+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.124882+0000","last_undegraded":"2024-09-17T02:54:41.124882+0000","last_fullsized":"2024-09-17T02:54:41.124882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.128403+0000","last_change":"2024-09-17T02:54:41.127905+0000","last_active":"2024-09-17T02:54:41.128403+0000","last_peered":"2024-09-17T02:54:41.128403+0000","last_clean":"2024-09-17T02:54:41.128403+0000","last_became_active":"2024-09-17T02:54:41.127616+0000","last_became_peered":"2024-09-17T02:54:41.127616+0000","last_unstale":"2024-09-17T02:54:41.128403+0000","last_undegraded":"2024-09-17T02:54:41.128403+0000","last_fullsized":"2024-09-17T02:54:41.128403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:02.722545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.123201+0000","last_change":"2024-09-17T02:54:41.123201+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.123201+0000","last_undegraded":"2024-09-17T02:54:41.123201+0000","last_fullsized":"2024-09-17T02:54:41.123201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.131382+0000","last_change":"2024-09-17T02:54:41.130345+0000","last_active":"2024-09-17T02:54:41.131382+0000","last_peered":"2024-09-17T02:54:41.131382+0000","last_clean":"2024-09-17T02:54:41.131382+0000","last_became_active":"2024-09-17T02:54:41.130078+0000","last_became_peered":"2024-09-17T02:54:41.130078+0000","last_unstale":"2024-09-17T02:54:41.131382+0000","last_undegraded":"2024-09-17T02:54:41.131382+0000","last_fullsized":"2024-09-17T02:54:41.131382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:36.803460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.134299+0000","last_change":"2024-09-17T02:54:41.134299+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.134299+0000","last_undegraded":"2024-09-17T02:54:41.134299+0000","last_fullsized":"2024-09-17T02:54:41.134299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.125742+0000","last_change":"2024-09-17T02:54:41.125471+0000","last_active":"2024-09-17T02:54:41.125742+0000","last_peered":"2024-09-17T02:54:41.125742+0000","last_clean":"2024-09-17T02:54:41.125742+0000","last_became_active":"2024-09-17T02:54:41.124551+0000","last_became_peered":"2024-09-17T02:54:41.124551+0000","last_unstale":"2024-09-17T02:54:41.125742+0000","last_undegraded":"2024-09-17T02:54:41.125742+0000","last_fullsized":"2024-09-17T02:54:41.125742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.897379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128964+0000","last_change":"2024-09-17T02:54:41.128964+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128964+0000","last_undegraded":"2024-09-17T02:54:41.128964+0000","last_fullsized":"2024-09-17T02:54:41.128964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127405+0000","last_change":"2024-09-17T02:54:41.127039+0000","last_active":"2024-09-17T02:54:41.127405+0000","last_peered":"2024-09-17T02:54:41.127405+0000","last_clean":"2024-09-17T02:54:41.127405+0000","last_became_active":"2024-09-17T02:54:41.126724+0000","last_became_peered":"2024-09-17T02:54:41.126724+0000","last_unstale":"2024-09-17T02:54:41.127405+0000","last_undegraded":"2024-09-17T02:54:41.127405+0000","last_fullsized":"2024-09-17T02:54:41.127405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:41.785060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121403+0000","last_change":"2024-09-17T02:54:41.121403+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121403+0000","last_undegraded":"2024-09-17T02:54:41.121403+0000","last_fullsized":"2024-09-17T02:54:41.121403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132278+0000","last_change":"2024-09-17T02:54:41.131579+0000","last_active":"2024-09-17T02:54:41.132278+0000","last_peered":"2024-09-17T02:54:41.132278+0000","last_clean":"2024-09-17T02:54:41.132278+0000","last_became_active":"2024-09-17T02:54:41.131123+0000","last_became_peered":"2024-09-17T02:54:41.131123+0000","last_unstale":"2024-09-17T02:54:41.132278+0000","last_undegraded":"2024-09-17T02:54:41.132278+0000","last_fullsized":"2024-09-17T02:54:41.132278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:57.401823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130586+0000","last_change":"2024-09-17T02:54:41.130586+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130586+0000","last_undegraded":"2024-09-17T02:54:41.130586+0000","last_fullsized":"2024-09-17T02:54:41.130586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129835+0000","last_change":"2024-09-17T02:54:41.127869+0000","last_active":"2024-09-17T02:54:41.129835+0000","last_peered":"2024-09-17T02:54:41.129835+0000","last_clean":"2024-09-17T02:54:41.129835+0000","last_became_active":"2024-09-17T02:54:41.127552+0000","last_became_peered":"2024-09-17T02:54:41.127552+0000","last_unstale":"2024-09-17T02:54:41.129835+0000","last_undegraded":"2024-09-17T02:54:41.129835+0000","last_fullsized":"2024-09-17T02:54:41.129835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:41.305801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130557+0000","last_change":"2024-09-17T02:54:41.130557+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130557+0000","last_undegraded":"2024-09-17T02:54:41.130557+0000","last_fullsized":"2024-09-17T02:54:41.130557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127062+0000","last_change":"2024-09-17T02:54:41.126814+0000","last_active":"2024-09-17T02:54:41.127062+0000","last_peered":"2024-09-17T02:54:41.127062+0000","last_clean":"2024-09-17T02:54:41.127062+0000","last_became_active":"2024-09-17T02:54:41.126505+0000","last_became_peered":"2024-09-17T02:54:41.126505+0000","last_unstale":"2024-09-17T02:54:41.127062+0000","last_undegraded":"2024-09-17T02:54:41.127062+0000","last_fullsized":"2024-09-17T02:54:41.127062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:52.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121904+0000","last_change":"2024-09-17T02:54:41.121904+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121904+0000","last_undegraded":"2024-09-17T02:54:41.121904+0000","last_fullsized":"2024-09-17T02:54:41.121904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128954+0000","last_change":"2024-09-17T02:54:41.128954+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128954+0000","last_undegraded":"2024-09-17T02:54:41.128954+0000","last_fullsized":"2024-09-17T02:54:41.128954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133576+0000","last_change":"2024-09-17T02:54:41.133352+0000","last_active":"2024-09-17T02:54:41.133576+0000","last_peered":"2024-09-17T02:54:41.133576+0000","last_clean":"2024-09-17T02:54:41.133576+0000","last_became_active":"2024-09-17T02:54:41.133001+0000","last_became_peered":"2024-09-17T02:54:41.133001+0000","last_unstale":"2024-09-17T02:54:41.133576+0000","last_undegraded":"2024-09-17T02:54:41.133576+0000","last_fullsized":"2024-09-17T02:54:41.133576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:19.533069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.127705+0000","last_change":"2024-09-17T02:54:41.127705+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.127705+0000","last_undegraded":"2024-09-17T02:54:41.127705+0000","last_fullsized":"2024-09-17T02:54:41.127705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.131668+0000","last_change":"2024-09-17T02:54:41.131298+0000","last_active":"2024-09-17T02:54:41.131668+0000","last_peered":"2024-09-17T02:54:41.131668+0000","last_clean":"2024-09-17T02:54:41.131668+0000","last_became_active":"2024-09-17T02:54:41.131019+0000","last_became_peered":"2024-09-17T02:54:41.131019+0000","last_unstale":"2024-09-17T02:54:41.131668+0000","last_undegraded":"2024-09-17T02:54:41.131668+0000","last_fullsized":"2024-09-17T02:54:41.131668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:34.067992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130202+0000","last_change":"2024-09-17T02:54:41.130202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130202+0000","last_undegraded":"2024-09-17T02:54:41.130202+0000","last_fullsized":"2024-09-17T02:54:41.130202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129312+0000","last_change":"2024-09-17T02:54:41.128714+0000","last_active":"2024-09-17T02:54:41.129312+0000","last_peered":"2024-09-17T02:54:41.129312+0000","last_clean":"2024-09-17T02:54:41.129312+0000","last_became_active":"2024-09-17T02:54:41.128099+0000","last_became_peered":"2024-09-17T02:54:41.128099+0000","last_unstale":"2024-09-17T02:54:41.129312+0000","last_undegraded":"2024-09-17T02:54:41.129312+0000","last_fullsized":"2024-09-17T02:54:41.129312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:30.938338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133695+0000","last_change":"2024-09-17T02:54:41.133695+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133695+0000","last_undegraded":"2024-09-17T02:54:41.133695+0000","last_fullsized":"2024-09-17T02:54:41.133695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.125711+0000","last_change":"2024-09-17T02:54:41.125421+0000","last_active":"2024-09-17T02:54:41.125711+0000","last_peered":"2024-09-17T02:54:41.125711+0000","last_clean":"2024-09-17T02:54:41.125711+0000","last_became_active":"2024-09-17T02:54:41.124528+0000","last_became_peered":"2024-09-17T02:54:41.124528+0000","last_unstale":"2024-09-17T02:54:41.125711+0000","last_undegraded":"2024-09-17T02:54:41.125711+0000","last_fullsized":"2024-09-17T02:54:41.125711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:34.437280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194675,"statfs":{"total":200000000,"available":199347262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:54:46.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-17T02:54:46.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130517+0000', 'last_change': '2024-09-17T02:54:41.130517+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130517+0000', 'last_undegraded': '2024-09-17T02:54:41.130517+0000', 'last_fullsized': '2024-09-17T02:54:41.130517+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-17T02:54:46.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.122171+0000', 'last_change': '2024-09-17T02:54:41.122171+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.122171+0000', 'last_undegraded': '2024-09-17T02:54:41.122171+0000', 'last_fullsized': '2024-09-17T02:54:41.122171+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:54:46.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-17T02:54:46.842 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.131260+0000', 'last_change': '2024-09-17T02:54:41.131260+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.131260+0000', 'last_undegraded': '2024-09-17T02:54:41.131260+0000', 'last_fullsized': '2024-09-17T02:54:41.131260+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.842 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.126552+0000', 'last_change': '2024-09-17T02:54:41.126552+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.126552+0000', 'last_undegraded': '2024-09-17T02:54:41.126552+0000', 'last_fullsized': '2024-09-17T02:54:41.126552+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130398+0000', 'last_change': '2024-09-17T02:54:41.130398+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130398+0000', 'last_undegraded': '2024-09-17T02:54:41.130398+0000', 'last_fullsized': '2024-09-17T02:54:41.130398+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130327+0000', 'last_change': '2024-09-17T02:54:41.130327+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130327+0000', 'last_undegraded': '2024-09-17T02:54:41.130327+0000', 'last_fullsized': '2024-09-17T02:54:41.130327+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130279+0000', 'last_change': '2024-09-17T02:54:41.130279+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130279+0000', 'last_undegraded': '2024-09-17T02:54:41.130279+0000', 'last_fullsized': '2024-09-17T02:54:41.130279+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.135110+0000', 'last_change': '2024-09-17T02:54:41.135110+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.135110+0000', 'last_undegraded': '2024-09-17T02:54:41.135110+0000', 'last_fullsized': '2024-09-17T02:54:41.135110+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-17T02:54:46.843 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.133007+0000', 'last_change': '2024-09-17T02:54:41.133007+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.133007+0000', 'last_undegraded': '2024-09-17T02:54:41.133007+0000', 'last_fullsized': '2024-09-17T02:54:41.133007+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.123404+0000', 'last_change': '2024-09-17T02:54:41.123404+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.123404+0000', 'last_undegraded': '2024-09-17T02:54:41.123404+0000', 'last_fullsized': '2024-09-17T02:54:41.123404+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.125964+0000', 'last_change': '2024-09-17T02:54:41.125964+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.125964+0000', 'last_undegraded': '2024-09-17T02:54:41.125964+0000', 'last_fullsized': '2024-09-17T02:54:41.125964+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.120120+0000', 'last_change': '2024-09-17T02:54:41.120120+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.120120+0000', 'last_undegraded': '2024-09-17T02:54:41.120120+0000', 'last_fullsized': '2024-09-17T02:54:41.120120+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.134702+0000', 'last_change': '2024-09-17T02:54:41.134702+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.134702+0000', 'last_undegraded': '2024-09-17T02:54:41.134702+0000', 'last_fullsized': '2024-09-17T02:54:41.134702+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.132885+0000', 'last_change': '2024-09-17T02:54:41.132885+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.132885+0000', 'last_undegraded': '2024-09-17T02:54:41.132885+0000', 'last_fullsized': '2024-09-17T02:54:41.132885+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.844 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.122576+0000', 'last_change': '2024-09-17T02:54:41.122576+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.122576+0000', 'last_undegraded': '2024-09-17T02:54:41.122576+0000', 'last_fullsized': '2024-09-17T02:54:41.122576+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130773+0000', 'last_change': '2024-09-17T02:54:41.130773+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130773+0000', 'last_undegraded': '2024-09-17T02:54:41.130773+0000', 'last_fullsized': '2024-09-17T02:54:41.130773+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.131322+0000', 'last_change': '2024-09-17T02:54:41.131322+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.131322+0000', 'last_undegraded': '2024-09-17T02:54:41.131322+0000', 'last_fullsized': '2024-09-17T02:54:41.131322+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.126593+0000', 'last_change': '2024-09-17T02:54:41.126593+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.126593+0000', 'last_undegraded': '2024-09-17T02:54:41.126593+0000', 'last_fullsized': '2024-09-17T02:54:41.126593+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.131949+0000', 'last_change': '2024-09-17T02:54:41.131949+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.131949+0000', 'last_undegraded': '2024-09-17T02:54:41.131949+0000', 'last_fullsized': '2024-09-17T02:54:41.131949+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-17T02:54:46.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.121576+0000', 'last_change': '2024-09-17T02:54:41.121576+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.121576+0000', 'last_undegraded': '2024-09-17T02:54:41.121576+0000', 'last_fullsized': '2024-09-17T02:54:41.121576+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.131790+0000', 'last_change': '2024-09-17T02:54:41.131790+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.131790+0000', 'last_undegraded': '2024-09-17T02:54:41.131790+0000', 'last_fullsized': '2024-09-17T02:54:41.131790+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.128916+0000', 'last_change': '2024-09-17T02:54:41.128916+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.128916+0000', 'last_undegraded': '2024-09-17T02:54:41.128916+0000', 'last_fullsized': '2024-09-17T02:54:41.128916+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.132876+0000', 'last_change': '2024-09-17T02:54:41.132876+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.132876+0000', 'last_undegraded': '2024-09-17T02:54:41.132876+0000', 'last_fullsized': '2024-09-17T02:54:41.132876+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.125363+0000', 'last_change': '2024-09-17T02:54:41.125363+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.125363+0000', 'last_undegraded': '2024-09-17T02:54:41.125363+0000', 'last_fullsized': '2024-09-17T02:54:41.125363+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.133659+0000', 'last_change': '2024-09-17T02:54:41.133659+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.133659+0000', 'last_undegraded': '2024-09-17T02:54:41.133659+0000', 'last_fullsized': '2024-09-17T02:54:41.133659+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-17T02:54:46.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.124025+0000', 'last_change': '2024-09-17T02:54:41.124025+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.124025+0000', 'last_undegraded': '2024-09-17T02:54:41.124025+0000', 'last_fullsized': '2024-09-17T02:54:41.124025+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.121705+0000', 'last_change': '2024-09-17T02:54:41.121705+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.121705+0000', 'last_undegraded': '2024-09-17T02:54:41.121705+0000', 'last_fullsized': '2024-09-17T02:54:41.121705+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.132067+0000', 'last_change': '2024-09-17T02:54:41.132067+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.132067+0000', 'last_undegraded': '2024-09-17T02:54:41.132067+0000', 'last_fullsized': '2024-09-17T02:54:41.132067+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.132505+0000', 'last_change': '2024-09-17T02:54:41.132505+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.132505+0000', 'last_undegraded': '2024-09-17T02:54:41.132505+0000', 'last_fullsized': '2024-09-17T02:54:41.132505+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.129522+0000', 'last_change': '2024-09-17T02:54:41.129522+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.129522+0000', 'last_undegraded': '2024-09-17T02:54:41.129522+0000', 'last_fullsized': '2024-09-17T02:54:41.129522+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.125871+0000', 'last_change': '2024-09-17T02:54:41.125871+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.125871+0000', 'last_undegraded': '2024-09-17T02:54:41.125871+0000', 'last_fullsized': '2024-09-17T02:54:41.125871+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:54:46.847 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.121813+0000', 'last_change': '2024-09-17T02:54:41.121813+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.121813+0000', 'last_undegraded': '2024-09-17T02:54:41.121813+0000', 'last_fullsized': '2024-09-17T02:54:41.121813+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.119974+0000', 'last_change': '2024-09-17T02:54:41.119974+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.119974+0000', 'last_undegraded': '2024-09-17T02:54:41.119974+0000', 'last_fullsized': '2024-09-17T02:54:41.119974+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.129425+0000', 'last_change': '2024-09-17T02:54:41.129425+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.129425+0000', 'last_undegraded': '2024-09-17T02:54:41.129425+0000', 'last_fullsized': '2024-09-17T02:54:41.129425+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.132526+0000', 'last_change': '2024-09-17T02:54:41.132526+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.132526+0000', 'last_undegraded': '2024-09-17T02:54:41.132526+0000', 'last_fullsized': '2024-09-17T02:54:41.132526+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.122907+0000', 'last_change': '2024-09-17T02:54:41.122907+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.122907+0000', 'last_undegraded': '2024-09-17T02:54:41.122907+0000', 'last_fullsized': '2024-09-17T02:54:41.122907+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-17T02:54:46.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130202+0000', 'last_change': '2024-09-17T02:54:41.130202+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130202+0000', 'last_undegraded': '2024-09-17T02:54:41.130202+0000', 'last_fullsized': '2024-09-17T02:54:41.130202+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130537+0000', 'last_change': '2024-09-17T02:54:41.130537+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130537+0000', 'last_undegraded': '2024-09-17T02:54:41.130537+0000', 'last_fullsized': '2024-09-17T02:54:41.130537+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.120006+0000', 'last_change': '2024-09-17T02:54:41.120006+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.120006+0000', 'last_undegraded': '2024-09-17T02:54:41.120006+0000', 'last_fullsized': '2024-09-17T02:54:41.120006+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.129800+0000', 'last_change': '2024-09-17T02:54:41.129800+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.129800+0000', 'last_undegraded': '2024-09-17T02:54:41.129800+0000', 'last_fullsized': '2024-09-17T02:54:41.129800+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.129581+0000', 'last_change': '2024-09-17T02:54:41.129581+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.129581+0000', 'last_undegraded': '2024-09-17T02:54:41.129581+0000', 'last_fullsized': '2024-09-17T02:54:41.129581+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.129798+0000', 'last_change': '2024-09-17T02:54:41.129798+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.129798+0000', 'last_undegraded': '2024-09-17T02:54:41.129798+0000', 'last_fullsized': '2024-09-17T02:54:41.129798+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-17T02:54:46.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.121166+0000', 'last_change': '2024-09-17T02:54:41.121166+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.121166+0000', 'last_undegraded': '2024-09-17T02:54:41.121166+0000', 'last_fullsized': '2024-09-17T02:54:41.121166+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.129637+0000', 'last_change': '2024-09-17T02:54:41.129637+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.129637+0000', 'last_undegraded': '2024-09-17T02:54:41.129637+0000', 'last_fullsized': '2024-09-17T02:54:41.129637+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.129293+0000', 'last_change': '2024-09-17T02:54:41.129293+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.129293+0000', 'last_undegraded': '2024-09-17T02:54:41.129293+0000', 'last_fullsized': '2024-09-17T02:54:41.129293+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.131095+0000', 'last_change': '2024-09-17T02:54:41.131095+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.131095+0000', 'last_undegraded': '2024-09-17T02:54:41.131095+0000', 'last_fullsized': '2024-09-17T02:54:41.131095+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.128503+0000', 'last_change': '2024-09-17T02:54:41.128503+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.128503+0000', 'last_undegraded': '2024-09-17T02:54:41.128503+0000', 'last_fullsized': '2024-09-17T02:54:41.128503+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.129371+0000', 'last_change': '2024-09-17T02:54:41.129371+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.129371+0000', 'last_undegraded': '2024-09-17T02:54:41.129371+0000', 'last_fullsized': '2024-09-17T02:54:41.129371+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-17T02:54:46.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.133920+0000', 'last_change': '2024-09-17T02:54:41.133920+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.133920+0000', 'last_undegraded': '2024-09-17T02:54:41.133920+0000', 'last_fullsized': '2024-09-17T02:54:41.133920+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.128493+0000', 'last_change': '2024-09-17T02:54:41.128493+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.128493+0000', 'last_undegraded': '2024-09-17T02:54:41.128493+0000', 'last_fullsized': '2024-09-17T02:54:41.128493+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.121835+0000', 'last_change': '2024-09-17T02:54:41.121835+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.121835+0000', 'last_undegraded': '2024-09-17T02:54:41.121835+0000', 'last_fullsized': '2024-09-17T02:54:41.121835+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.120202+0000', 'last_change': '2024-09-17T02:54:41.120202+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.120202+0000', 'last_undegraded': '2024-09-17T02:54:41.120202+0000', 'last_fullsized': '2024-09-17T02:54:41.120202+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.124882+0000', 'last_change': '2024-09-17T02:54:41.124882+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.124882+0000', 'last_undegraded': '2024-09-17T02:54:41.124882+0000', 'last_fullsized': '2024-09-17T02:54:41.124882+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.123201+0000', 'last_change': '2024-09-17T02:54:41.123201+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.123201+0000', 'last_undegraded': '2024-09-17T02:54:41.123201+0000', 'last_fullsized': '2024-09-17T02:54:41.123201+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:54:46.851 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.134299+0000', 'last_change': '2024-09-17T02:54:41.134299+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.134299+0000', 'last_undegraded': '2024-09-17T02:54:41.134299+0000', 'last_fullsized': '2024-09-17T02:54:41.134299+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.128964+0000', 'last_change': '2024-09-17T02:54:41.128964+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.128964+0000', 'last_undegraded': '2024-09-17T02:54:41.128964+0000', 'last_fullsized': '2024-09-17T02:54:41.128964+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.121403+0000', 'last_change': '2024-09-17T02:54:41.121403+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.121403+0000', 'last_undegraded': '2024-09-17T02:54:41.121403+0000', 'last_fullsized': '2024-09-17T02:54:41.121403+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130586+0000', 'last_change': '2024-09-17T02:54:41.130586+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130586+0000', 'last_undegraded': '2024-09-17T02:54:41.130586+0000', 'last_fullsized': '2024-09-17T02:54:41.130586+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130557+0000', 'last_change': '2024-09-17T02:54:41.130557+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130557+0000', 'last_undegraded': '2024-09-17T02:54:41.130557+0000', 'last_fullsized': '2024-09-17T02:54:41.130557+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-17T02:54:46.852 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.121904+0000', 'last_change': '2024-09-17T02:54:41.121904+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.121904+0000', 'last_undegraded': '2024-09-17T02:54:41.121904+0000', 'last_fullsized': '2024-09-17T02:54:41.121904+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:54:46.853 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-17T02:54:46.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.128954+0000', 'last_change': '2024-09-17T02:54:41.128954+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.128954+0000', 'last_undegraded': '2024-09-17T02:54:41.128954+0000', 'last_fullsized': '2024-09-17T02:54:41.128954+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.853 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-17T02:54:46.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.127705+0000', 'last_change': '2024-09-17T02:54:41.127705+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.127705+0000', 'last_undegraded': '2024-09-17T02:54:41.127705+0000', 'last_fullsized': '2024-09-17T02:54:41.127705+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:54:46.853 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-17T02:54:46.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.130202+0000', 'last_change': '2024-09-17T02:54:41.130202+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.130202+0000', 'last_undegraded': '2024-09-17T02:54:41.130202+0000', 'last_fullsized': '2024-09-17T02:54:41.130202+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:54:46.853 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-17T02:54:46.853 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:54:41.133695+0000', 'last_change': '2024-09-17T02:54:41.133695+0000', 'last_active': '2024-09-17T02:54:41.114667+0000', 'last_peered': '2024-09-17T02:54:41.114667+0000', 'last_clean': '2024-09-17T02:54:41.114667+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:54:41.133695+0000', 'last_undegraded': '2024-09-17T02:54:41.133695+0000', 'last_fullsized': '2024-09-17T02:54:41.133695+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'last_clean_scrub_stamp': '2024-09-17T02:54:41.114667+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:54:46.854 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T02:54:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.989+0000 7f7808a25640 1 -- 172.21.15.104:0/2188598121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 msgr2=0x7f7804073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.989+0000 7f7808a25640 1 --2- 172.21.15.104:0/2188598121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 0x7f7804073560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f77f4005fd0 tx=0x7f77f402a5d0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.989+0000 7f7808a25640 1 -- 172.21.15.104:0/2188598121 shutdown_connections 2024-09-17T02:54:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.989+0000 7f7808a25640 1 --2- 172.21.15.104:0/2188598121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7804073aa0 0x7f780415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.989+0000 7f7808a25640 1 --2- 172.21.15.104:0/2188598121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 0x7f7804073560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.989+0000 7f7808a25640 1 -- 172.21.15.104:0/2188598121 >> 172.21.15.104:0/2188598121 conn(0x7f780406d200 msgr2=0x7f780406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:46.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.989+0000 7f7808a25640 1 -- 172.21.15.104:0/2188598121 shutdown_connections 2024-09-17T02:54:46.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.989+0000 7f7808a25640 1 -- 172.21.15.104:0/2188598121 wait complete. 2024-09-17T02:54:46.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.991+0000 7f7808a25640 1 Processor -- start 2024-09-17T02:54:46.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.991+0000 7f7808a25640 1 -- start start 2024-09-17T02:54:46.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.992+0000 7f7808a25640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 0x7f78040aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.992+0000 7f7808a25640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7804073aa0 0x7f78041f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.992+0000 7f7808a25640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78040b0c60 0x7f78041f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.992+0000 7f7808a25640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f78041603f0 con 0x7f780406ffd0 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.992+0000 7f7808a25640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78040cef00 con 0x7f7804073aa0 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.992+0000 7f7808a25640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7804160570 con 0x7f78040b0c60 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 0x7f78040aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 0x7f78040aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52190/0 (socket says 172.21.15.104:52190) 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 -- 172.21.15.104:0/181273522 learned_addr learned my addr 172.21.15.104:0/181273522 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f77f9d9b640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7804073aa0 0x7f78041f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f7802d9d640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78040b0c60 0x7f78041f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 -- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78040b0c60 msgr2=0x7f78041f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78040b0c60 0x7f78041f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 -- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7804073aa0 msgr2=0x7f78041f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7804073aa0 0x7f78041f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 -- 172.21.15.104:0/181273522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78040b0470 con 0x7f780406ffd0 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f7802d9d640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78040b0c60 0x7f78041f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f780259c640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 0x7f78040aff30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f77f4034040 tx=0x7f77f40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:46.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f77fb7fe640 1 -- 172.21.15.104:0/181273522 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f403e030 con 0x7f780406ffd0 2024-09-17T02:54:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f77fb7fe640 1 -- 172.21.15.104:0/181273522 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77f4003ca0 con 0x7f780406ffd0 2024-09-17T02:54:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780415b130 con 0x7f780406ffd0 2024-09-17T02:54:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f77fb7fe640 1 -- 172.21.15.104:0/181273522 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4035040 con 0x7f780406ffd0 2024-09-17T02:54:46.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.993+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7804156100 con 0x7f780406ffd0 2024-09-17T02:54:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.995+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7804073560 con 0x7f780406ffd0 2024-09-17T02:54:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.995+0000 7f77fb7fe640 1 -- 172.21.15.104:0/181273522 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77f4041030 con 0x7f780406ffd0 2024-09-17T02:54:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.995+0000 7f77fb7fe640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77e4078b90 0x7f77e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.996+0000 7f77fb7fe640 1 -- 172.21.15.104:0/181273522 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f77f40bb310 con 0x7f780406ffd0 2024-09-17T02:54:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.996+0000 7f77f9d9b640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77e4078b90 0x7f77e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:46.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:46.996+0000 7f77f9d9b640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77e4078b90 0x7f77e407b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7804152a60 tx=0x7f77ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:46.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.000+0000 7f77fb7fe640 1 -- 172.21.15.104:0/181273522 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f77f4083870 con 0x7f780406ffd0 2024-09-17T02:54:47.104 INFO:tasks.ceph.mds.d.smithi192.stderr:2024-09-17T02:54:47.105+0000 7efee3935640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:54:47.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.244+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f78040b11b0 con 0x7f780406ffd0 2024-09-17T02:54:47.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.244+0000 7f77fb7fe640 1 -- 172.21.15.104:0/181273522 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1068 (secure 0 0 0) 0x7f77f4083170 con 0x7f780406ffd0 2024-09-17T02:54:47.244 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:47.244 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726541670,"num_in_osds":8,"osd_in_since":1726541667,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1660871,"bytes_avail":1598339129,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4378}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T02:54:23.298888+0000","services":{}},"progress_events":{}} 2024-09-17T02:54:47.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77e4078b90 msgr2=0x7f77e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:47.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77e4078b90 0x7f77e407b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7804152a60 tx=0x7f77ec009040 comp rx=0 tx=0).stop 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 msgr2=0x7f78040aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 0x7f78040aff30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f77f4034040 tx=0x7f77f40038a0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 shutdown_connections 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77e4078b90 0x7f77e407b0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7804073aa0 0x7f78041f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78040b0c60 0x7f78041f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 --2- 172.21.15.104:0/181273522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f780406ffd0 0x7f78040aff30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 >> 172.21.15.104:0/181273522 conn(0x7f780406d200 msgr2=0x7f780415e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 shutdown_connections 2024-09-17T02:54:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.247+0000 7f7808a25640 1 -- 172.21.15.104:0/181273522 wait complete. 2024-09-17T02:54:47.258 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T02:54:47.258 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:54:47.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 -- 172.21.15.104:0/2767499506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801630c0 msgr2=0x7fcc800b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:47.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 --2- 172.21.15.104:0/2767499506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801630c0 0x7fcc800b6ae0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcc80163b80 tx=0x7fcc7002a540 comp rx=0 tx=0).stop 2024-09-17T02:54:47.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 -- 172.21.15.104:0/2767499506 shutdown_connections 2024-09-17T02:54:47.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 --2- 172.21.15.104:0/2767499506 >> v2:172.21.15.192:3300/0 conn(0x7fcc801611d0 0x7fcc801615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 --2- 172.21.15.104:0/2767499506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc801630c0 0x7fcc800b6ae0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 --2- 172.21.15.104:0/2767499506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc80162cb0 0x7fcc800b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 -- 172.21.15.104:0/2767499506 >> 172.21.15.104:0/2767499506 conn(0x7fcc80069120 msgr2=0x7fcc80069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:47.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 -- 172.21.15.104:0/2767499506 shutdown_connections 2024-09-17T02:54:47.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.369+0000 7fcc88664640 1 -- 172.21.15.104:0/2767499506 wait complete. 2024-09-17T02:54:47.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.371+0000 7fcc88664640 1 Processor -- start 2024-09-17T02:54:47.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.371+0000 7fcc88664640 1 -- start start 2024-09-17T02:54:47.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.372+0000 7fcc88664640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc801611d0 0x7fcc8015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:47.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.372+0000 7fcc88664640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc80162cb0 0x7fcc800ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:47.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.372+0000 7fcc88664640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc801630c0 0x7fcc800b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:47.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.372+0000 7fcc88664640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcc801621b0 con 0x7fcc80162cb0 2024-09-17T02:54:47.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.372+0000 7fcc88664640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcc80162030 con 0x7fcc801611d0 2024-09-17T02:54:47.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.372+0000 7fcc88664640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcc80162330 con 0x7fcc801630c0 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc80162cb0 0x7fcc800ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc80162cb0 0x7fcc800ab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52210/0 (socket says 172.21.15.104:52210) 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 -- 172.21.15.104:0/3471381639 learned_addr learned my addr 172.21.15.104:0/3471381639 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc86400640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc801611d0 0x7fcc8015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc86c01640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc801630c0 0x7fcc800b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 -- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc801630c0 msgr2=0x7fcc800b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc801630c0 0x7fcc800b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 -- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc801611d0 msgr2=0x7fcc8015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc801611d0 0x7fcc8015ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 -- 172.21.15.104:0/3471381639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc801f5fa0 con 0x7fcc80162cb0 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc85bff640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc80162cb0 0x7fcc800ab3d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc70034040 tx=0x7fcc700039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc76ffd640 1 -- 172.21.15.104:0/3471381639 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7003e030 con 0x7fcc80162cb0 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc76ffd640 1 -- 172.21.15.104:0/3471381639 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc700047a0 con 0x7fcc80162cb0 2024-09-17T02:54:47.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc801f6280 con 0x7fcc80162cb0 2024-09-17T02:54:47.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc76ffd640 1 -- 172.21.15.104:0/3471381639 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70035040 con 0x7fcc80162cb0 2024-09-17T02:54:47.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.373+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc801f6840 con 0x7fcc80162cb0 2024-09-17T02:54:47.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.374+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc801615e0 con 0x7fcc80162cb0 2024-09-17T02:54:47.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.375+0000 7fcc76ffd640 1 -- 172.21.15.104:0/3471381639 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc70041030 con 0x7fcc80162cb0 2024-09-17T02:54:47.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.375+0000 7fcc76ffd640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc64078bc0 0x7fcc6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:47.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.375+0000 7fcc76ffd640 1 -- 172.21.15.104:0/3471381639 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcc700bb360 con 0x7fcc80162cb0 2024-09-17T02:54:47.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.375+0000 7fcc86400640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc64078bc0 0x7fcc6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:47.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.376+0000 7fcc86400640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc64078bc0 0x7fcc6407b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00ab20 tx=0x7fcc7c00a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:47.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.380+0000 7fcc76ffd640 1 -- 172.21.15.104:0/3471381639 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc70083270 con 0x7fcc80162cb0 2024-09-17T02:54:47.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.550+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc800cf150 con 0x7fcc64078bc0 2024-09-17T02:54:47.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.554+0000 7fcc76ffd640 1 -- 172.21.15.104:0/3471381639 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242229 (secure 0 0 0) 0x7fcc800cf150 con 0x7fcc64078bc0 2024-09-17T02:54:47.556 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:47.557 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:54:47.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc64078bc0 msgr2=0x7fcc6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc64078bc0 0x7fcc6407b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00ab20 tx=0x7fcc7c00a250 comp rx=0 tx=0).stop 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc80162cb0 msgr2=0x7fcc800ab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc80162cb0 0x7fcc800ab3d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcc70034040 tx=0x7fcc700039e0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 shutdown_connections 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc64078bc0 0x7fcc6407b0d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc801630c0 0x7fcc800b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc80162cb0 0x7fcc800ab3d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 --2- 172.21.15.104:0/3471381639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc801611d0 0x7fcc8015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 >> 172.21.15.104:0/3471381639 conn(0x7fcc80069120 msgr2=0x7fcc800b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 shutdown_connections 2024-09-17T02:54:47.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:47.557+0000 7fcc88664640 1 -- 172.21.15.104:0/3471381639 wait complete. 2024-09-17T02:54:47.568 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-17T02:54:45.620096+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560878,"statfs":{"total":1600000000,"available":1598339129,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.503119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130517+0000","last_change":"2024-09-17T02:54:41.130517+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130517+0000","last_undegraded":"2024-09-17T02:54:41.130517+0000","last_fullsized":"2024-09-17T02:54:41.130517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122171+0000","last_change":"2024-09-17T02:54:41.122171+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122171+0000","last_undegraded":"2024-09-17T02:54:41.122171+0000","last_fullsized":"2024-09-17T02:54:41.122171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131260+0000","last_change":"2024-09-17T02:54:41.131260+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131260+0000","last_undegraded":"2024-09-17T02:54:41.131260+0000","last_fullsized":"2024-09-17T02:54:41.131260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.126552+0000","last_change":"2024-09-17T02:54:41.126552+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.126552+0000","last_undegraded":"2024-09-17T02:54:41.126552+0000","last_fullsized":"2024-09-17T02:54:41.126552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130398+0000","last_change":"2024-09-17T02:54:41.130398+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130398+0000","last_undegraded":"2024-09-17T02:54:41.130398+0000","last_fullsized":"2024-09-17T02:54:41.130398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130327+0000","last_change":"2024-09-17T02:54:41.130327+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130327+0000","last_undegraded":"2024-09-17T02:54:41.130327+0000","last_fullsized":"2024-09-17T02:54:41.130327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130279+0000","last_change":"2024-09-17T02:54:41.130279+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130279+0000","last_undegraded":"2024-09-17T02:54:41.130279+0000","last_fullsized":"2024-09-17T02:54:41.130279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.135110+0000","last_change":"2024-09-17T02:54:41.135110+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.135110+0000","last_undegraded":"2024-09-17T02:54:41.135110+0000","last_fullsized":"2024-09-17T02:54:41.135110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133007+0000","last_change":"2024-09-17T02:54:41.133007+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133007+0000","last_undegraded":"2024-09-17T02:54:41.133007+0000","last_fullsized":"2024-09-17T02:54:41.133007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.123404+0000","last_change":"2024-09-17T02:54:41.123404+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.123404+0000","last_undegraded":"2024-09-17T02:54:41.123404+0000","last_fullsized":"2024-09-17T02:54:41.123404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125964+0000","last_change":"2024-09-17T02:54:41.125964+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125964+0000","last_undegraded":"2024-09-17T02:54:41.125964+0000","last_fullsized":"2024-09-17T02:54:41.125964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120120+0000","last_change":"2024-09-17T02:54:41.120120+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120120+0000","last_undegraded":"2024-09-17T02:54:41.120120+0000","last_fullsized":"2024-09-17T02:54:41.120120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.134702+0000","last_change":"2024-09-17T02:54:41.134702+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.134702+0000","last_undegraded":"2024-09-17T02:54:41.134702+0000","last_fullsized":"2024-09-17T02:54:41.134702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132885+0000","last_change":"2024-09-17T02:54:41.132885+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132885+0000","last_undegraded":"2024-09-17T02:54:41.132885+0000","last_fullsized":"2024-09-17T02:54:41.132885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122576+0000","last_change":"2024-09-17T02:54:41.122576+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122576+0000","last_undegraded":"2024-09-17T02:54:41.122576+0000","last_fullsized":"2024-09-17T02:54:41.122576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130773+0000","last_change":"2024-09-17T02:54:41.130773+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130773+0000","last_undegraded":"2024-09-17T02:54:41.130773+0000","last_fullsized":"2024-09-17T02:54:41.130773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131322+0000","last_change":"2024-09-17T02:54:41.131322+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131322+0000","last_undegraded":"2024-09-17T02:54:41.131322+0000","last_fullsized":"2024-09-17T02:54:41.131322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.126593+0000","last_change":"2024-09-17T02:54:41.126593+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.126593+0000","last_undegraded":"2024-09-17T02:54:41.126593+0000","last_fullsized":"2024-09-17T02:54:41.126593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131949+0000","last_change":"2024-09-17T02:54:41.131949+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131949+0000","last_undegraded":"2024-09-17T02:54:41.131949+0000","last_fullsized":"2024-09-17T02:54:41.131949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121576+0000","last_change":"2024-09-17T02:54:41.121576+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121576+0000","last_undegraded":"2024-09-17T02:54:41.121576+0000","last_fullsized":"2024-09-17T02:54:41.121576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131790+0000","last_change":"2024-09-17T02:54:41.131790+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131790+0000","last_undegraded":"2024-09-17T02:54:41.131790+0000","last_fullsized":"2024-09-17T02:54:41.131790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128916+0000","last_change":"2024-09-17T02:54:41.128916+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128916+0000","last_undegraded":"2024-09-17T02:54:41.128916+0000","last_fullsized":"2024-09-17T02:54:41.128916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132876+0000","last_change":"2024-09-17T02:54:41.132876+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132876+0000","last_undegraded":"2024-09-17T02:54:41.132876+0000","last_fullsized":"2024-09-17T02:54:41.132876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125363+0000","last_change":"2024-09-17T02:54:41.125363+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125363+0000","last_undegraded":"2024-09-17T02:54:41.125363+0000","last_fullsized":"2024-09-17T02:54:41.125363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133659+0000","last_change":"2024-09-17T02:54:41.133659+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133659+0000","last_undegraded":"2024-09-17T02:54:41.133659+0000","last_fullsized":"2024-09-17T02:54:41.133659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.124025+0000","last_change":"2024-09-17T02:54:41.124025+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.124025+0000","last_undegraded":"2024-09-17T02:54:41.124025+0000","last_fullsized":"2024-09-17T02:54:41.124025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121705+0000","last_change":"2024-09-17T02:54:41.121705+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121705+0000","last_undegraded":"2024-09-17T02:54:41.121705+0000","last_fullsized":"2024-09-17T02:54:41.121705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132067+0000","last_change":"2024-09-17T02:54:41.132067+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132067+0000","last_undegraded":"2024-09-17T02:54:41.132067+0000","last_fullsized":"2024-09-17T02:54:41.132067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132505+0000","last_change":"2024-09-17T02:54:41.132505+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132505+0000","last_undegraded":"2024-09-17T02:54:41.132505+0000","last_fullsized":"2024-09-17T02:54:41.132505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129522+0000","last_change":"2024-09-17T02:54:41.129522+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129522+0000","last_undegraded":"2024-09-17T02:54:41.129522+0000","last_fullsized":"2024-09-17T02:54:41.129522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.125871+0000","last_change":"2024-09-17T02:54:41.125871+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.125871+0000","last_undegraded":"2024-09-17T02:54:41.125871+0000","last_fullsized":"2024-09-17T02:54:41.125871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121813+0000","last_change":"2024-09-17T02:54:41.121813+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121813+0000","last_undegraded":"2024-09-17T02:54:41.121813+0000","last_fullsized":"2024-09-17T02:54:41.121813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.119974+0000","last_change":"2024-09-17T02:54:41.119974+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.119974+0000","last_undegraded":"2024-09-17T02:54:41.119974+0000","last_fullsized":"2024-09-17T02:54:41.119974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.137195+0000","last_change":"2024-09-17T02:54:41.136992+0000","last_active":"2024-09-17T02:54:41.137195+0000","last_peered":"2024-09-17T02:54:41.137195+0000","last_clean":"2024-09-17T02:54:41.137195+0000","last_became_active":"2024-09-17T02:54:41.136720+0000","last_became_peered":"2024-09-17T02:54:41.136720+0000","last_unstale":"2024-09-17T02:54:41.137195+0000","last_undegraded":"2024-09-17T02:54:41.137195+0000","last_fullsized":"2024-09-17T02:54:41.137195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:21.267377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129425+0000","last_change":"2024-09-17T02:54:41.129425+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129425+0000","last_undegraded":"2024-09-17T02:54:41.129425+0000","last_fullsized":"2024-09-17T02:54:41.129425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127168+0000","last_change":"2024-09-17T02:54:41.125908+0000","last_active":"2024-09-17T02:54:41.127168+0000","last_peered":"2024-09-17T02:54:41.127168+0000","last_clean":"2024-09-17T02:54:41.127168+0000","last_became_active":"2024-09-17T02:54:41.124285+0000","last_became_peered":"2024-09-17T02:54:41.124285+0000","last_unstale":"2024-09-17T02:54:41.127168+0000","last_undegraded":"2024-09-17T02:54:41.127168+0000","last_fullsized":"2024-09-17T02:54:41.127168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:05.746577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134195+0000","last_change":"2024-09-17T02:54:41.133974+0000","last_active":"2024-09-17T02:54:41.134195+0000","last_peered":"2024-09-17T02:54:41.134195+0000","last_clean":"2024-09-17T02:54:41.134195+0000","last_became_active":"2024-09-17T02:54:41.130208+0000","last_became_peered":"2024-09-17T02:54:41.130208+0000","last_unstale":"2024-09-17T02:54:41.134195+0000","last_undegraded":"2024-09-17T02:54:41.134195+0000","last_fullsized":"2024-09-17T02:54:41.134195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:56.463219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.132526+0000","last_change":"2024-09-17T02:54:41.132526+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.132526+0000","last_undegraded":"2024-09-17T02:54:41.132526+0000","last_fullsized":"2024-09-17T02:54:41.132526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133864+0000","last_change":"2024-09-17T02:54:41.133392+0000","last_active":"2024-09-17T02:54:41.133864+0000","last_peered":"2024-09-17T02:54:41.133864+0000","last_clean":"2024-09-17T02:54:41.133864+0000","last_became_active":"2024-09-17T02:54:41.130773+0000","last_became_peered":"2024-09-17T02:54:41.130773+0000","last_unstale":"2024-09-17T02:54:41.133864+0000","last_undegraded":"2024-09-17T02:54:41.133864+0000","last_fullsized":"2024-09-17T02:54:41.133864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:53.322507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.122907+0000","last_change":"2024-09-17T02:54:41.122907+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.122907+0000","last_undegraded":"2024-09-17T02:54:41.122907+0000","last_fullsized":"2024-09-17T02:54:41.122907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.136369+0000","last_change":"2024-09-17T02:54:41.136164+0000","last_active":"2024-09-17T02:54:41.136369+0000","last_peered":"2024-09-17T02:54:41.136369+0000","last_clean":"2024-09-17T02:54:41.136369+0000","last_became_active":"2024-09-17T02:54:41.135870+0000","last_became_peered":"2024-09-17T02:54:41.135870+0000","last_unstale":"2024-09-17T02:54:41.136369+0000","last_undegraded":"2024-09-17T02:54:41.136369+0000","last_fullsized":"2024-09-17T02:54:41.136369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:14.379519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130202+0000","last_change":"2024-09-17T02:54:41.130202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130202+0000","last_undegraded":"2024-09-17T02:54:41.130202+0000","last_fullsized":"2024-09-17T02:54:41.130202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134987+0000","last_change":"2024-09-17T02:54:41.134782+0000","last_active":"2024-09-17T02:54:41.134987+0000","last_peered":"2024-09-17T02:54:41.134987+0000","last_clean":"2024-09-17T02:54:41.134987+0000","last_became_active":"2024-09-17T02:54:41.133444+0000","last_became_peered":"2024-09-17T02:54:41.133444+0000","last_unstale":"2024-09-17T02:54:41.134987+0000","last_undegraded":"2024-09-17T02:54:41.134987+0000","last_fullsized":"2024-09-17T02:54:41.134987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:12.223351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130537+0000","last_change":"2024-09-17T02:54:41.130537+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130537+0000","last_undegraded":"2024-09-17T02:54:41.130537+0000","last_fullsized":"2024-09-17T02:54:41.130537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133346+0000","last_change":"2024-09-17T02:54:41.133126+0000","last_active":"2024-09-17T02:54:41.133346+0000","last_peered":"2024-09-17T02:54:41.133346+0000","last_clean":"2024-09-17T02:54:41.133346+0000","last_became_active":"2024-09-17T02:54:41.132866+0000","last_became_peered":"2024-09-17T02:54:41.132866+0000","last_unstale":"2024-09-17T02:54:41.133346+0000","last_undegraded":"2024-09-17T02:54:41.133346+0000","last_fullsized":"2024-09-17T02:54:41.133346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:50.498949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120006+0000","last_change":"2024-09-17T02:54:41.120006+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120006+0000","last_undegraded":"2024-09-17T02:54:41.120006+0000","last_fullsized":"2024-09-17T02:54:41.120006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129424+0000","last_change":"2024-09-17T02:54:41.128843+0000","last_active":"2024-09-17T02:54:41.129424+0000","last_peered":"2024-09-17T02:54:41.129424+0000","last_clean":"2024-09-17T02:54:41.129424+0000","last_became_active":"2024-09-17T02:54:41.128490+0000","last_became_peered":"2024-09-17T02:54:41.128490+0000","last_unstale":"2024-09-17T02:54:41.129424+0000","last_undegraded":"2024-09-17T02:54:41.129424+0000","last_fullsized":"2024-09-17T02:54:41.129424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:51.918042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129800+0000","last_change":"2024-09-17T02:54:41.129800+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129800+0000","last_undegraded":"2024-09-17T02:54:41.129800+0000","last_fullsized":"2024-09-17T02:54:41.129800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127223+0000","last_change":"2024-09-17T02:54:41.126988+0000","last_active":"2024-09-17T02:54:41.127223+0000","last_peered":"2024-09-17T02:54:41.127223+0000","last_clean":"2024-09-17T02:54:41.127223+0000","last_became_active":"2024-09-17T02:54:41.126723+0000","last_became_peered":"2024-09-17T02:54:41.126723+0000","last_unstale":"2024-09-17T02:54:41.127223+0000","last_undegraded":"2024-09-17T02:54:41.127223+0000","last_fullsized":"2024-09-17T02:54:41.127223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:13.136462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129581+0000","last_change":"2024-09-17T02:54:41.129581+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129581+0000","last_undegraded":"2024-09-17T02:54:41.129581+0000","last_fullsized":"2024-09-17T02:54:41.129581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133215+0000","last_change":"2024-09-17T02:54:41.132996+0000","last_active":"2024-09-17T02:54:41.133215+0000","last_peered":"2024-09-17T02:54:41.133215+0000","last_clean":"2024-09-17T02:54:41.133215+0000","last_became_active":"2024-09-17T02:54:41.132135+0000","last_became_peered":"2024-09-17T02:54:41.132135+0000","last_unstale":"2024-09-17T02:54:41.133215+0000","last_undegraded":"2024-09-17T02:54:41.133215+0000","last_fullsized":"2024-09-17T02:54:41.133215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:34.553877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129798+0000","last_change":"2024-09-17T02:54:41.129798+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129798+0000","last_undegraded":"2024-09-17T02:54:41.129798+0000","last_fullsized":"2024-09-17T02:54:41.129798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127391+0000","last_change":"2024-09-17T02:54:41.127168+0000","last_active":"2024-09-17T02:54:41.127391+0000","last_peered":"2024-09-17T02:54:41.127391+0000","last_clean":"2024-09-17T02:54:41.127391+0000","last_became_active":"2024-09-17T02:54:41.126901+0000","last_became_peered":"2024-09-17T02:54:41.126901+0000","last_unstale":"2024-09-17T02:54:41.127391+0000","last_undegraded":"2024-09-17T02:54:41.127391+0000","last_fullsized":"2024-09-17T02:54:41.127391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:58.704223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121166+0000","last_change":"2024-09-17T02:54:41.121166+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121166+0000","last_undegraded":"2024-09-17T02:54:41.121166+0000","last_fullsized":"2024-09-17T02:54:41.121166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132252+0000","last_change":"2024-09-17T02:54:41.131775+0000","last_active":"2024-09-17T02:54:41.132252+0000","last_peered":"2024-09-17T02:54:41.132252+0000","last_clean":"2024-09-17T02:54:41.132252+0000","last_became_active":"2024-09-17T02:54:41.131311+0000","last_became_peered":"2024-09-17T02:54:41.131311+0000","last_unstale":"2024-09-17T02:54:41.132252+0000","last_undegraded":"2024-09-17T02:54:41.132252+0000","last_fullsized":"2024-09-17T02:54:41.132252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:01.120087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129637+0000","last_change":"2024-09-17T02:54:41.129637+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129637+0000","last_undegraded":"2024-09-17T02:54:41.129637+0000","last_fullsized":"2024-09-17T02:54:41.129637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.126141+0000","last_change":"2024-09-17T02:54:41.124818+0000","last_active":"2024-09-17T02:54:41.126141+0000","last_peered":"2024-09-17T02:54:41.126141+0000","last_clean":"2024-09-17T02:54:41.126141+0000","last_became_active":"2024-09-17T02:54:41.124391+0000","last_became_peered":"2024-09-17T02:54:41.124391+0000","last_unstale":"2024-09-17T02:54:41.126141+0000","last_undegraded":"2024-09-17T02:54:41.126141+0000","last_fullsized":"2024-09-17T02:54:41.126141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:59.494494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129293+0000","last_change":"2024-09-17T02:54:41.129293+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129293+0000","last_undegraded":"2024-09-17T02:54:41.129293+0000","last_fullsized":"2024-09-17T02:54:41.129293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.136924+0000","last_change":"2024-09-17T02:54:41.136678+0000","last_active":"2024-09-17T02:54:41.136924+0000","last_peered":"2024-09-17T02:54:41.136924+0000","last_clean":"2024-09-17T02:54:41.136924+0000","last_became_active":"2024-09-17T02:54:41.136398+0000","last_became_peered":"2024-09-17T02:54:41.136398+0000","last_unstale":"2024-09-17T02:54:41.136924+0000","last_undegraded":"2024-09-17T02:54:41.136924+0000","last_fullsized":"2024-09-17T02:54:41.136924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:00.204367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.131095+0000","last_change":"2024-09-17T02:54:41.131095+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.131095+0000","last_undegraded":"2024-09-17T02:54:41.131095+0000","last_fullsized":"2024-09-17T02:54:41.131095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129863+0000","last_change":"2024-09-17T02:54:41.129677+0000","last_active":"2024-09-17T02:54:41.129863+0000","last_peered":"2024-09-17T02:54:41.129863+0000","last_clean":"2024-09-17T02:54:41.129863+0000","last_became_active":"2024-09-17T02:54:41.128120+0000","last_became_peered":"2024-09-17T02:54:41.128120+0000","last_unstale":"2024-09-17T02:54:41.129863+0000","last_undegraded":"2024-09-17T02:54:41.129863+0000","last_fullsized":"2024-09-17T02:54:41.129863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:46.494366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128503+0000","last_change":"2024-09-17T02:54:41.128503+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128503+0000","last_undegraded":"2024-09-17T02:54:41.128503+0000","last_fullsized":"2024-09-17T02:54:41.128503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.135852+0000","last_change":"2024-09-17T02:54:41.135494+0000","last_active":"2024-09-17T02:54:41.135852+0000","last_peered":"2024-09-17T02:54:41.135852+0000","last_clean":"2024-09-17T02:54:41.135852+0000","last_became_active":"2024-09-17T02:54:41.135146+0000","last_became_peered":"2024-09-17T02:54:41.135146+0000","last_unstale":"2024-09-17T02:54:41.135852+0000","last_undegraded":"2024-09-17T02:54:41.135852+0000","last_fullsized":"2024-09-17T02:54:41.135852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:08.413771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.129371+0000","last_change":"2024-09-17T02:54:41.129371+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.129371+0000","last_undegraded":"2024-09-17T02:54:41.129371+0000","last_fullsized":"2024-09-17T02:54:41.129371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":107,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.123127+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:54:41.123127+0000","last_peered":"2024-09-17T02:54:41.123127+0000","last_clean":"2024-09-17T02:54:41.123127+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:54:41.123127+0000","last_undegraded":"2024-09-17T02:54:41.123127+0000","last_fullsized":"2024-09-17T02:54:41.123127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132634+0000","last_change":"2024-09-17T02:54:41.132405+0000","last_active":"2024-09-17T02:54:41.132634+0000","last_peered":"2024-09-17T02:54:41.132634+0000","last_clean":"2024-09-17T02:54:41.132634+0000","last_became_active":"2024-09-17T02:54:41.131396+0000","last_became_peered":"2024-09-17T02:54:41.131396+0000","last_unstale":"2024-09-17T02:54:41.132634+0000","last_undegraded":"2024-09-17T02:54:41.132634+0000","last_fullsized":"2024-09-17T02:54:41.132634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:55.412737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133920+0000","last_change":"2024-09-17T02:54:41.133920+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133920+0000","last_undegraded":"2024-09-17T02:54:41.133920+0000","last_fullsized":"2024-09-17T02:54:41.133920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.134238+0000","last_change":"2024-09-17T02:54:41.134010+0000","last_active":"2024-09-17T02:54:41.134238+0000","last_peered":"2024-09-17T02:54:41.134238+0000","last_clean":"2024-09-17T02:54:41.134238+0000","last_became_active":"2024-09-17T02:54:41.133330+0000","last_became_peered":"2024-09-17T02:54:41.133330+0000","last_unstale":"2024-09-17T02:54:41.134238+0000","last_undegraded":"2024-09-17T02:54:41.134238+0000","last_fullsized":"2024-09-17T02:54:41.134238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:22.013803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128493+0000","last_change":"2024-09-17T02:54:41.128493+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128493+0000","last_undegraded":"2024-09-17T02:54:41.128493+0000","last_fullsized":"2024-09-17T02:54:41.128493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.137095+0000","last_change":"2024-09-17T02:54:41.136814+0000","last_active":"2024-09-17T02:54:41.137095+0000","last_peered":"2024-09-17T02:54:41.137095+0000","last_clean":"2024-09-17T02:54:41.137095+0000","last_became_active":"2024-09-17T02:54:41.136504+0000","last_became_peered":"2024-09-17T02:54:41.136504+0000","last_unstale":"2024-09-17T02:54:41.137095+0000","last_undegraded":"2024-09-17T02:54:41.137095+0000","last_fullsized":"2024-09-17T02:54:41.137095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:43.506144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121835+0000","last_change":"2024-09-17T02:54:41.121835+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121835+0000","last_undegraded":"2024-09-17T02:54:41.121835+0000","last_fullsized":"2024-09-17T02:54:41.121835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.135266+0000","last_change":"2024-09-17T02:54:41.135077+0000","last_active":"2024-09-17T02:54:41.135266+0000","last_peered":"2024-09-17T02:54:41.135266+0000","last_clean":"2024-09-17T02:54:41.135266+0000","last_became_active":"2024-09-17T02:54:41.134456+0000","last_became_peered":"2024-09-17T02:54:41.134456+0000","last_unstale":"2024-09-17T02:54:41.135266+0000","last_undegraded":"2024-09-17T02:54:41.135266+0000","last_fullsized":"2024-09-17T02:54:41.135266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:44.578710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.120202+0000","last_change":"2024-09-17T02:54:41.120202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.120202+0000","last_undegraded":"2024-09-17T02:54:41.120202+0000","last_fullsized":"2024-09-17T02:54:41.120202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129498+0000","last_change":"2024-09-17T02:54:41.129281+0000","last_active":"2024-09-17T02:54:41.129498+0000","last_peered":"2024-09-17T02:54:41.129498+0000","last_clean":"2024-09-17T02:54:41.129498+0000","last_became_active":"2024-09-17T02:54:41.129016+0000","last_became_peered":"2024-09-17T02:54:41.129016+0000","last_unstale":"2024-09-17T02:54:41.129498+0000","last_undegraded":"2024-09-17T02:54:41.129498+0000","last_fullsized":"2024-09-17T02:54:41.129498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:06.862966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.124882+0000","last_change":"2024-09-17T02:54:41.124882+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.124882+0000","last_undegraded":"2024-09-17T02:54:41.124882+0000","last_fullsized":"2024-09-17T02:54:41.124882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.128403+0000","last_change":"2024-09-17T02:54:41.127905+0000","last_active":"2024-09-17T02:54:41.128403+0000","last_peered":"2024-09-17T02:54:41.128403+0000","last_clean":"2024-09-17T02:54:41.128403+0000","last_became_active":"2024-09-17T02:54:41.127616+0000","last_became_peered":"2024-09-17T02:54:41.127616+0000","last_unstale":"2024-09-17T02:54:41.128403+0000","last_undegraded":"2024-09-17T02:54:41.128403+0000","last_fullsized":"2024-09-17T02:54:41.128403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:02.722545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.123201+0000","last_change":"2024-09-17T02:54:41.123201+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.123201+0000","last_undegraded":"2024-09-17T02:54:41.123201+0000","last_fullsized":"2024-09-17T02:54:41.123201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.131382+0000","last_change":"2024-09-17T02:54:41.130345+0000","last_active":"2024-09-17T02:54:41.131382+0000","last_peered":"2024-09-17T02:54:41.131382+0000","last_clean":"2024-09-17T02:54:41.131382+0000","last_became_active":"2024-09-17T02:54:41.130078+0000","last_became_peered":"2024-09-17T02:54:41.130078+0000","last_unstale":"2024-09-17T02:54:41.131382+0000","last_undegraded":"2024-09-17T02:54:41.131382+0000","last_fullsized":"2024-09-17T02:54:41.131382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:36.803460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.134299+0000","last_change":"2024-09-17T02:54:41.134299+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.134299+0000","last_undegraded":"2024-09-17T02:54:41.134299+0000","last_fullsized":"2024-09-17T02:54:41.134299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.125742+0000","last_change":"2024-09-17T02:54:41.125471+0000","last_active":"2024-09-17T02:54:41.125742+0000","last_peered":"2024-09-17T02:54:41.125742+0000","last_clean":"2024-09-17T02:54:41.125742+0000","last_became_active":"2024-09-17T02:54:41.124551+0000","last_became_peered":"2024-09-17T02:54:41.124551+0000","last_unstale":"2024-09-17T02:54:41.125742+0000","last_undegraded":"2024-09-17T02:54:41.125742+0000","last_fullsized":"2024-09-17T02:54:41.125742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:40.897379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128964+0000","last_change":"2024-09-17T02:54:41.128964+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128964+0000","last_undegraded":"2024-09-17T02:54:41.128964+0000","last_fullsized":"2024-09-17T02:54:41.128964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127405+0000","last_change":"2024-09-17T02:54:41.127039+0000","last_active":"2024-09-17T02:54:41.127405+0000","last_peered":"2024-09-17T02:54:41.127405+0000","last_clean":"2024-09-17T02:54:41.127405+0000","last_became_active":"2024-09-17T02:54:41.126724+0000","last_became_peered":"2024-09-17T02:54:41.126724+0000","last_unstale":"2024-09-17T02:54:41.127405+0000","last_undegraded":"2024-09-17T02:54:41.127405+0000","last_fullsized":"2024-09-17T02:54:41.127405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:41.785060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121403+0000","last_change":"2024-09-17T02:54:41.121403+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121403+0000","last_undegraded":"2024-09-17T02:54:41.121403+0000","last_fullsized":"2024-09-17T02:54:41.121403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.132278+0000","last_change":"2024-09-17T02:54:41.131579+0000","last_active":"2024-09-17T02:54:41.132278+0000","last_peered":"2024-09-17T02:54:41.132278+0000","last_clean":"2024-09-17T02:54:41.132278+0000","last_became_active":"2024-09-17T02:54:41.131123+0000","last_became_peered":"2024-09-17T02:54:41.131123+0000","last_unstale":"2024-09-17T02:54:41.132278+0000","last_undegraded":"2024-09-17T02:54:41.132278+0000","last_fullsized":"2024-09-17T02:54:41.132278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:57.401823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130586+0000","last_change":"2024-09-17T02:54:41.130586+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130586+0000","last_undegraded":"2024-09-17T02:54:41.130586+0000","last_fullsized":"2024-09-17T02:54:41.130586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129835+0000","last_change":"2024-09-17T02:54:41.127869+0000","last_active":"2024-09-17T02:54:41.129835+0000","last_peered":"2024-09-17T02:54:41.129835+0000","last_clean":"2024-09-17T02:54:41.129835+0000","last_became_active":"2024-09-17T02:54:41.127552+0000","last_became_peered":"2024-09-17T02:54:41.127552+0000","last_unstale":"2024-09-17T02:54:41.129835+0000","last_undegraded":"2024-09-17T02:54:41.129835+0000","last_fullsized":"2024-09-17T02:54:41.129835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:41.305801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130557+0000","last_change":"2024-09-17T02:54:41.130557+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130557+0000","last_undegraded":"2024-09-17T02:54:41.130557+0000","last_fullsized":"2024-09-17T02:54:41.130557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.127062+0000","last_change":"2024-09-17T02:54:41.126814+0000","last_active":"2024-09-17T02:54:41.127062+0000","last_peered":"2024-09-17T02:54:41.127062+0000","last_clean":"2024-09-17T02:54:41.127062+0000","last_became_active":"2024-09-17T02:54:41.126505+0000","last_became_peered":"2024-09-17T02:54:41.126505+0000","last_unstale":"2024-09-17T02:54:41.127062+0000","last_undegraded":"2024-09-17T02:54:41.127062+0000","last_fullsized":"2024-09-17T02:54:41.127062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:52.628113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.121904+0000","last_change":"2024-09-17T02:54:41.121904+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.121904+0000","last_undegraded":"2024-09-17T02:54:41.121904+0000","last_fullsized":"2024-09-17T02:54:41.121904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.128954+0000","last_change":"2024-09-17T02:54:41.128954+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.128954+0000","last_undegraded":"2024-09-17T02:54:41.128954+0000","last_fullsized":"2024-09-17T02:54:41.128954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.133576+0000","last_change":"2024-09-17T02:54:41.133352+0000","last_active":"2024-09-17T02:54:41.133576+0000","last_peered":"2024-09-17T02:54:41.133576+0000","last_clean":"2024-09-17T02:54:41.133576+0000","last_became_active":"2024-09-17T02:54:41.133001+0000","last_became_peered":"2024-09-17T02:54:41.133001+0000","last_unstale":"2024-09-17T02:54:41.133576+0000","last_undegraded":"2024-09-17T02:54:41.133576+0000","last_fullsized":"2024-09-17T02:54:41.133576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:19.533069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.127705+0000","last_change":"2024-09-17T02:54:41.127705+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.127705+0000","last_undegraded":"2024-09-17T02:54:41.127705+0000","last_fullsized":"2024-09-17T02:54:41.127705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.131668+0000","last_change":"2024-09-17T02:54:41.131298+0000","last_active":"2024-09-17T02:54:41.131668+0000","last_peered":"2024-09-17T02:54:41.131668+0000","last_clean":"2024-09-17T02:54:41.131668+0000","last_became_active":"2024-09-17T02:54:41.131019+0000","last_became_peered":"2024-09-17T02:54:41.131019+0000","last_unstale":"2024-09-17T02:54:41.131668+0000","last_undegraded":"2024-09-17T02:54:41.131668+0000","last_fullsized":"2024-09-17T02:54:41.131668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:34.067992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.130202+0000","last_change":"2024-09-17T02:54:41.130202+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.130202+0000","last_undegraded":"2024-09-17T02:54:41.130202+0000","last_fullsized":"2024-09-17T02:54:41.130202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.129312+0000","last_change":"2024-09-17T02:54:41.128714+0000","last_active":"2024-09-17T02:54:41.129312+0000","last_peered":"2024-09-17T02:54:41.129312+0000","last_clean":"2024-09-17T02:54:41.129312+0000","last_became_active":"2024-09-17T02:54:41.128099+0000","last_became_peered":"2024-09-17T02:54:41.128099+0000","last_unstale":"2024-09-17T02:54:41.129312+0000","last_undegraded":"2024-09-17T02:54:41.129312+0000","last_fullsized":"2024-09-17T02:54:41.129312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:30.938338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-17T02:54:41.133695+0000","last_change":"2024-09-17T02:54:41.133695+0000","last_active":"2024-09-17T02:54:41.114667+0000","last_peered":"2024-09-17T02:54:41.114667+0000","last_clean":"2024-09-17T02:54:41.114667+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:54:41.133695+0000","last_undegraded":"2024-09-17T02:54:41.133695+0000","last_fullsized":"2024-09-17T02:54:41.133695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T02:54:41.125711+0000","last_change":"2024-09-17T02:54:41.125421+0000","last_active":"2024-09-17T02:54:41.125711+0000","last_peered":"2024-09-17T02:54:41.125711+0000","last_clean":"2024-09-17T02:54:41.125711+0000","last_became_active":"2024-09-17T02:54:41.124528+0000","last_became_peered":"2024-09-17T02:54:41.124528+0000","last_unstale":"2024-09-17T02:54:41.125711+0000","last_undegraded":"2024-09-17T02:54:41.125711+0000","last_fullsized":"2024-09-17T02:54:41.125711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:34.437280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194675,"statfs":{"total":200000000,"available":199347262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:54:50.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:54:50.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.699+0000 7fccb368b640 1 -- 172.21.15.104:0/1298343448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc98003a50 msgr2=0x7fcc98003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:50.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.699+0000 7fccb368b640 1 --2- 172.21.15.104:0/1298343448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc98003a50 0x7fcc98003ec0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcca800c760 tx=0x7fcc98005830 comp rx=0 tx=0).stop 2024-09-17T02:54:50.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.699+0000 7fccb1c28640 1 -- 172.21.15.104:0/1298343448 reap_dead start 2024-09-17T02:54:50.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.699+0000 7fccb368b640 1 -- 172.21.15.104:0/1298343448 shutdown_connections 2024-09-17T02:54:50.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.699+0000 7fccb368b640 1 -- 172.21.15.104:0/1298343448 >> 172.21.15.104:0/1298343448 conn(0x7fccac06d200 msgr2=0x7fccac06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:50.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.699+0000 7fccb368b640 1 -- 172.21.15.104:0/1298343448 shutdown_connections 2024-09-17T02:54:50.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.699+0000 7fccb368b640 1 -- 172.21.15.104:0/1298343448 wait complete. 2024-09-17T02:54:50.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.700+0000 7fccb368b640 1 Processor -- start 2024-09-17T02:54:50.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.701+0000 7fccb368b640 1 -- start start 2024-09-17T02:54:50.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb368b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc98003a50 0x7fccac1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:50.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb368b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccac156730 0x7fccac15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:50.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb368b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac15b1e0 0x7fccac1f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:50.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb368b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fccac0b0e50 con 0x7fccac156730 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb368b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fccac073c80 con 0x7fccac15b1e0 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb368b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fccac0b0fd0 con 0x7fcc98003a50 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccac156730 0x7fccac15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccac156730 0x7fccac15aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52220/0 (socket says 172.21.15.104:52220) 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 -- 172.21.15.104:0/3795410768 learned_addr learned my addr 172.21.15.104:0/3795410768 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb1427640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc98003a50 0x7fccac1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb1c28640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac15b1e0 0x7fccac1f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 -- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc98003a50 msgr2=0x7fccac1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc98003a50 0x7fccac1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 -- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac15b1e0 msgr2=0x7fccac1f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac15b1e0 0x7fccac1f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 -- 172.21.15.104:0/3795410768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac1f5ce0 con 0x7fccac156730 2024-09-17T02:54:50.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb1427640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc98003a50 0x7fccac1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:50.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb1c28640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac15b1e0 0x7fccac1f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:50.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fccb0c26640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccac156730 0x7fccac15aca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c011830 tx=0x7fcc9c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:50.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.702+0000 7fcca1ffb640 1 -- 172.21.15.104:0/3795410768 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c01f070 con 0x7fccac156730 2024-09-17T02:54:50.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.703+0000 7fcca1ffb640 1 -- 172.21.15.104:0/3795410768 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc9c00fe40 con 0x7fccac156730 2024-09-17T02:54:50.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.703+0000 7fcca1ffb640 1 -- 172.21.15.104:0/3795410768 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0126b0 con 0x7fccac156730 2024-09-17T02:54:50.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.703+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccac15b5f0 con 0x7fccac156730 2024-09-17T02:54:50.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.703+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccac157450 con 0x7fccac156730 2024-09-17T02:54:50.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.704+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccac0b0910 con 0x7fccac156730 2024-09-17T02:54:50.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.705+0000 7fcca1ffb640 1 -- 172.21.15.104:0/3795410768 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc9c022070 con 0x7fccac156730 2024-09-17T02:54:50.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.705+0000 7fcca1ffb640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc90078b90 0x7fcc9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:50.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.705+0000 7fcca1ffb640 1 -- 172.21.15.104:0/3795410768 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcc9c09b740 con 0x7fccac156730 2024-09-17T02:54:50.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.705+0000 7fccb1427640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc90078b90 0x7fcc9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:50.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.706+0000 7fccb1427640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc90078b90 0x7fcc9007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcca8033000 tx=0x7fcca8037040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:50.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.710+0000 7fcca1ffb640 1 -- 172.21.15.104:0/3795410768 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fccac15b5f0 con 0x7fccac156730 2024-09-17T02:54:50.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.879+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fccac1571e0 con 0x7fcc90078b90 2024-09-17T02:54:50.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.884+0000 7fcca1ffb640 1 -- 172.21.15.104:0/3795410768 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247474 (secure 0 0 0) 0x7fccac1571e0 con 0x7fcc90078b90 2024-09-17T02:54:50.885 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:50.887 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.886+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc90078b90 msgr2=0x7fcc9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.886+0000 7fccb368b640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc90078b90 0x7fcc9007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcca8033000 tx=0x7fcca8037040 comp rx=0 tx=0).stop 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.886+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccac156730 msgr2=0x7fccac15aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.886+0000 7fccb368b640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccac156730 0x7fccac15aca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c011830 tx=0x7fcc9c011cf0 comp rx=0 tx=0).stop 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.886+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 shutdown_connections 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.886+0000 7fccb368b640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc90078b90 0x7fcc9007b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.887+0000 7fccb368b640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccac15b1e0 0x7fccac1f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.887+0000 7fccb368b640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fccac156730 0x7fccac15aca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.887+0000 7fccb368b640 1 --2- 172.21.15.104:0/3795410768 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc98003a50 0x7fccac1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.887+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 >> 172.21.15.104:0/3795410768 conn(0x7fccac06d200 msgr2=0x7fccac069570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:50.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.887+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 shutdown_connections 2024-09-17T02:54:50.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:50.887+0000 7fccb368b640 1 -- 172.21.15.104:0/3795410768 wait complete. 2024-09-17T02:54:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T02:54:49.621070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210884,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001993"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137914+0000","last_change":"2024-09-17T02:54:42.140130+0000","last_active":"2024-09-17T02:54:43.137914+0000","last_peered":"2024-09-17T02:54:43.137914+0000","last_clean":"2024-09-17T02:54:43.137914+0000","last_became_active":"2024-09-17T02:54:42.139834+0000","last_became_peered":"2024-09-17T02:54:42.139834+0000","last_unstale":"2024-09-17T02:54:43.137914+0000","last_undegraded":"2024-09-17T02:54:43.137914+0000","last_fullsized":"2024-09-17T02:54:43.137914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:28.350535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155882+0000","last_change":"2024-09-17T02:54:42.141968+0000","last_active":"2024-09-17T02:54:43.155882+0000","last_peered":"2024-09-17T02:54:43.155882+0000","last_clean":"2024-09-17T02:54:43.155882+0000","last_became_active":"2024-09-17T02:54:42.141689+0000","last_became_peered":"2024-09-17T02:54:42.141689+0000","last_unstale":"2024-09-17T02:54:43.155882+0000","last_undegraded":"2024-09-17T02:54:43.155882+0000","last_fullsized":"2024-09-17T02:54:43.155882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:20.331776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358124+0000","last_change":"2024-09-17T02:54:42.142005+0000","last_active":"2024-09-17T02:54:43.358124+0000","last_peered":"2024-09-17T02:54:43.358124+0000","last_clean":"2024-09-17T02:54:43.358124+0000","last_became_active":"2024-09-17T02:54:42.141718+0000","last_became_peered":"2024-09-17T02:54:42.141718+0000","last_unstale":"2024-09-17T02:54:43.358124+0000","last_undegraded":"2024-09-17T02:54:43.358124+0000","last_fullsized":"2024-09-17T02:54:43.358124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:56.699293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357892+0000","last_change":"2024-09-17T02:54:42.150263+0000","last_active":"2024-09-17T02:54:43.357892+0000","last_peered":"2024-09-17T02:54:43.357892+0000","last_clean":"2024-09-17T02:54:43.357892+0000","last_became_active":"2024-09-17T02:54:42.149350+0000","last_became_peered":"2024-09-17T02:54:42.149350+0000","last_unstale":"2024-09-17T02:54:43.357892+0000","last_undegraded":"2024-09-17T02:54:43.357892+0000","last_fullsized":"2024-09-17T02:54:43.357892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:06.932470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136283+0000","last_change":"2024-09-17T02:54:42.144157+0000","last_active":"2024-09-17T02:54:43.136283+0000","last_peered":"2024-09-17T02:54:43.136283+0000","last_clean":"2024-09-17T02:54:43.136283+0000","last_became_active":"2024-09-17T02:54:42.143838+0000","last_became_peered":"2024-09-17T02:54:42.143838+0000","last_unstale":"2024-09-17T02:54:43.136283+0000","last_undegraded":"2024-09-17T02:54:43.136283+0000","last_fullsized":"2024-09-17T02:54:43.136283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:54.631778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358412+0000","last_change":"2024-09-17T02:54:42.153836+0000","last_active":"2024-09-17T02:54:43.358412+0000","last_peered":"2024-09-17T02:54:43.358412+0000","last_clean":"2024-09-17T02:54:43.358412+0000","last_became_active":"2024-09-17T02:54:42.153241+0000","last_became_peered":"2024-09-17T02:54:42.153241+0000","last_unstale":"2024-09-17T02:54:43.358412+0000","last_undegraded":"2024-09-17T02:54:43.358412+0000","last_fullsized":"2024-09-17T02:54:43.358412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:48.474724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136521+0000","last_change":"2024-09-17T02:54:42.145342+0000","last_active":"2024-09-17T02:54:43.136521+0000","last_peered":"2024-09-17T02:54:43.136521+0000","last_clean":"2024-09-17T02:54:43.136521+0000","last_became_active":"2024-09-17T02:54:42.145047+0000","last_became_peered":"2024-09-17T02:54:42.145047+0000","last_unstale":"2024-09-17T02:54:43.136521+0000","last_undegraded":"2024-09-17T02:54:43.136521+0000","last_fullsized":"2024-09-17T02:54:43.136521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:42.226480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359172+0000","last_change":"2024-09-17T02:54:42.148964+0000","last_active":"2024-09-17T02:54:43.359172+0000","last_peered":"2024-09-17T02:54:43.359172+0000","last_clean":"2024-09-17T02:54:43.359172+0000","last_became_active":"2024-09-17T02:54:42.148715+0000","last_became_peered":"2024-09-17T02:54:42.148715+0000","last_unstale":"2024-09-17T02:54:43.359172+0000","last_undegraded":"2024-09-17T02:54:43.359172+0000","last_fullsized":"2024-09-17T02:54:43.359172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:04.427855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136047+0000","last_change":"2024-09-17T02:54:42.152096+0000","last_active":"2024-09-17T02:54:43.136047+0000","last_peered":"2024-09-17T02:54:43.136047+0000","last_clean":"2024-09-17T02:54:43.136047+0000","last_became_active":"2024-09-17T02:54:42.149125+0000","last_became_peered":"2024-09-17T02:54:42.149125+0000","last_unstale":"2024-09-17T02:54:43.136047+0000","last_undegraded":"2024-09-17T02:54:43.136047+0000","last_fullsized":"2024-09-17T02:54:43.136047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:02.023988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137292+0000","last_change":"2024-09-17T02:54:42.149053+0000","last_active":"2024-09-17T02:54:43.137292+0000","last_peered":"2024-09-17T02:54:43.137292+0000","last_clean":"2024-09-17T02:54:43.137292+0000","last_became_active":"2024-09-17T02:54:42.148769+0000","last_became_peered":"2024-09-17T02:54:42.148769+0000","last_unstale":"2024-09-17T02:54:43.137292+0000","last_undegraded":"2024-09-17T02:54:43.137292+0000","last_fullsized":"2024-09-17T02:54:43.137292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:15.308833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137914+0000","last_change":"2024-09-17T02:54:42.153697+0000","last_active":"2024-09-17T02:54:43.137914+0000","last_peered":"2024-09-17T02:54:43.137914+0000","last_clean":"2024-09-17T02:54:43.137914+0000","last_became_active":"2024-09-17T02:54:42.153422+0000","last_became_peered":"2024-09-17T02:54:42.153422+0000","last_unstale":"2024-09-17T02:54:43.137914+0000","last_undegraded":"2024-09-17T02:54:43.137914+0000","last_fullsized":"2024-09-17T02:54:43.137914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.907995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137542+0000","last_change":"2024-09-17T02:54:42.145613+0000","last_active":"2024-09-17T02:54:43.137542+0000","last_peered":"2024-09-17T02:54:43.137542+0000","last_clean":"2024-09-17T02:54:43.137542+0000","last_became_active":"2024-09-17T02:54:42.145348+0000","last_became_peered":"2024-09-17T02:54:42.145348+0000","last_unstale":"2024-09-17T02:54:43.137542+0000","last_undegraded":"2024-09-17T02:54:43.137542+0000","last_fullsized":"2024-09-17T02:54:43.137542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:59.383826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359478+0000","last_change":"2024-09-17T02:54:42.147714+0000","last_active":"2024-09-17T02:54:43.359478+0000","last_peered":"2024-09-17T02:54:43.359478+0000","last_clean":"2024-09-17T02:54:43.359478+0000","last_became_active":"2024-09-17T02:54:42.147073+0000","last_became_peered":"2024-09-17T02:54:42.147073+0000","last_unstale":"2024-09-17T02:54:43.359478+0000","last_undegraded":"2024-09-17T02:54:43.359478+0000","last_fullsized":"2024-09-17T02:54:43.359478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:38.256856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357881+0000","last_change":"2024-09-17T02:54:42.140804+0000","last_active":"2024-09-17T02:54:43.357881+0000","last_peered":"2024-09-17T02:54:43.357881+0000","last_clean":"2024-09-17T02:54:43.357881+0000","last_became_active":"2024-09-17T02:54:42.140549+0000","last_became_peered":"2024-09-17T02:54:42.140549+0000","last_unstale":"2024-09-17T02:54:43.357881+0000","last_undegraded":"2024-09-17T02:54:43.357881+0000","last_fullsized":"2024-09-17T02:54:43.357881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.021489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155948+0000","last_change":"2024-09-17T02:54:42.156204+0000","last_active":"2024-09-17T02:54:43.155948+0000","last_peered":"2024-09-17T02:54:43.155948+0000","last_clean":"2024-09-17T02:54:43.155948+0000","last_became_active":"2024-09-17T02:54:42.155909+0000","last_became_peered":"2024-09-17T02:54:42.155909+0000","last_unstale":"2024-09-17T02:54:43.155948+0000","last_undegraded":"2024-09-17T02:54:43.155948+0000","last_fullsized":"2024-09-17T02:54:43.155948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:17.059902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358116+0000","last_change":"2024-09-17T02:54:42.155716+0000","last_active":"2024-09-17T02:54:43.358116+0000","last_peered":"2024-09-17T02:54:43.358116+0000","last_clean":"2024-09-17T02:54:43.358116+0000","last_became_active":"2024-09-17T02:54:42.153579+0000","last_became_peered":"2024-09-17T02:54:42.153579+0000","last_unstale":"2024-09-17T02:54:43.358116+0000","last_undegraded":"2024-09-17T02:54:43.358116+0000","last_fullsized":"2024-09-17T02:54:43.358116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:05.617863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358011+0000","last_change":"2024-09-17T02:54:42.156424+0000","last_active":"2024-09-17T02:54:43.358011+0000","last_peered":"2024-09-17T02:54:43.358011+0000","last_clean":"2024-09-17T02:54:43.358011+0000","last_became_active":"2024-09-17T02:54:42.153491+0000","last_became_peered":"2024-09-17T02:54:42.153491+0000","last_unstale":"2024-09-17T02:54:43.358011+0000","last_undegraded":"2024-09-17T02:54:43.358011+0000","last_fullsized":"2024-09-17T02:54:43.358011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:29.742009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357974+0000","last_change":"2024-09-17T02:54:42.137938+0000","last_active":"2024-09-17T02:54:43.357974+0000","last_peered":"2024-09-17T02:54:43.357974+0000","last_clean":"2024-09-17T02:54:43.357974+0000","last_became_active":"2024-09-17T02:54:42.137668+0000","last_became_peered":"2024-09-17T02:54:42.137668+0000","last_unstale":"2024-09-17T02:54:43.357974+0000","last_undegraded":"2024-09-17T02:54:43.357974+0000","last_fullsized":"2024-09-17T02:54:43.357974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:10.660192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136589+0000","last_change":"2024-09-17T02:54:42.149999+0000","last_active":"2024-09-17T02:54:43.136589+0000","last_peered":"2024-09-17T02:54:43.136589+0000","last_clean":"2024-09-17T02:54:43.136589+0000","last_became_active":"2024-09-17T02:54:42.148750+0000","last_became_peered":"2024-09-17T02:54:42.148750+0000","last_unstale":"2024-09-17T02:54:43.136589+0000","last_undegraded":"2024-09-17T02:54:43.136589+0000","last_fullsized":"2024-09-17T02:54:43.136589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:44.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137550+0000","last_change":"2024-09-17T02:54:42.158291+0000","last_active":"2024-09-17T02:54:43.137550+0000","last_peered":"2024-09-17T02:54:43.137550+0000","last_clean":"2024-09-17T02:54:43.137550+0000","last_became_active":"2024-09-17T02:54:42.157953+0000","last_became_peered":"2024-09-17T02:54:42.157953+0000","last_unstale":"2024-09-17T02:54:43.137550+0000","last_undegraded":"2024-09-17T02:54:43.137550+0000","last_fullsized":"2024-09-17T02:54:43.137550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:02.774661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359170+0000","last_change":"2024-09-17T02:54:42.148225+0000","last_active":"2024-09-17T02:54:43.359170+0000","last_peered":"2024-09-17T02:54:43.359170+0000","last_clean":"2024-09-17T02:54:43.359170+0000","last_became_active":"2024-09-17T02:54:42.147920+0000","last_became_peered":"2024-09-17T02:54:42.147920+0000","last_unstale":"2024-09-17T02:54:43.359170+0000","last_undegraded":"2024-09-17T02:54:43.359170+0000","last_fullsized":"2024-09-17T02:54:43.359170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:41.335772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358522+0000","last_change":"2024-09-17T02:54:42.154258+0000","last_active":"2024-09-17T02:54:43.358522+0000","last_peered":"2024-09-17T02:54:43.358522+0000","last_clean":"2024-09-17T02:54:43.358522+0000","last_became_active":"2024-09-17T02:54:42.151466+0000","last_became_peered":"2024-09-17T02:54:42.151466+0000","last_unstale":"2024-09-17T02:54:43.358522+0000","last_undegraded":"2024-09-17T02:54:43.358522+0000","last_fullsized":"2024-09-17T02:54:43.358522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:00.920687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359980+0000","last_change":"2024-09-17T02:54:42.157130+0000","last_active":"2024-09-17T02:54:43.359980+0000","last_peered":"2024-09-17T02:54:43.359980+0000","last_clean":"2024-09-17T02:54:43.359980+0000","last_became_active":"2024-09-17T02:54:42.156580+0000","last_became_peered":"2024-09-17T02:54:42.156580+0000","last_unstale":"2024-09-17T02:54:43.359980+0000","last_undegraded":"2024-09-17T02:54:43.359980+0000","last_fullsized":"2024-09-17T02:54:43.359980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:10.309065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358156+0000","last_change":"2024-09-17T02:54:42.149936+0000","last_active":"2024-09-17T02:54:43.358156+0000","last_peered":"2024-09-17T02:54:43.358156+0000","last_clean":"2024-09-17T02:54:43.358156+0000","last_became_active":"2024-09-17T02:54:42.148805+0000","last_became_peered":"2024-09-17T02:54:42.148805+0000","last_unstale":"2024-09-17T02:54:43.358156+0000","last_undegraded":"2024-09-17T02:54:43.358156+0000","last_fullsized":"2024-09-17T02:54:43.358156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:12.654505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358203+0000","last_change":"2024-09-17T02:54:42.156633+0000","last_active":"2024-09-17T02:54:43.358203+0000","last_peered":"2024-09-17T02:54:43.358203+0000","last_clean":"2024-09-17T02:54:43.358203+0000","last_became_active":"2024-09-17T02:54:42.156344+0000","last_became_peered":"2024-09-17T02:54:42.156344+0000","last_unstale":"2024-09-17T02:54:43.358203+0000","last_undegraded":"2024-09-17T02:54:43.358203+0000","last_fullsized":"2024-09-17T02:54:43.358203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:26.079679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138163+0000","last_change":"2024-09-17T02:54:42.141191+0000","last_active":"2024-09-17T02:54:43.138163+0000","last_peered":"2024-09-17T02:54:43.138163+0000","last_clean":"2024-09-17T02:54:43.138163+0000","last_became_active":"2024-09-17T02:54:42.140736+0000","last_became_peered":"2024-09-17T02:54:42.140736+0000","last_unstale":"2024-09-17T02:54:43.138163+0000","last_undegraded":"2024-09-17T02:54:43.138163+0000","last_fullsized":"2024-09-17T02:54:43.138163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:45.082145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156112+0000","last_change":"2024-09-17T02:54:42.144099+0000","last_active":"2024-09-17T02:54:43.156112+0000","last_peered":"2024-09-17T02:54:43.156112+0000","last_clean":"2024-09-17T02:54:43.156112+0000","last_became_active":"2024-09-17T02:54:42.143809+0000","last_became_peered":"2024-09-17T02:54:42.143809+0000","last_unstale":"2024-09-17T02:54:43.156112+0000","last_undegraded":"2024-09-17T02:54:43.156112+0000","last_fullsized":"2024-09-17T02:54:43.156112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:19.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359685+0000","last_change":"2024-09-17T02:54:42.156846+0000","last_active":"2024-09-17T02:54:43.359685+0000","last_peered":"2024-09-17T02:54:43.359685+0000","last_clean":"2024-09-17T02:54:43.359685+0000","last_became_active":"2024-09-17T02:54:42.156229+0000","last_became_peered":"2024-09-17T02:54:42.156229+0000","last_unstale":"2024-09-17T02:54:43.359685+0000","last_undegraded":"2024-09-17T02:54:43.359685+0000","last_fullsized":"2024-09-17T02:54:43.359685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:14.258007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358116+0000","last_change":"2024-09-17T02:54:42.147973+0000","last_active":"2024-09-17T02:54:43.358116+0000","last_peered":"2024-09-17T02:54:43.358116+0000","last_clean":"2024-09-17T02:54:43.358116+0000","last_became_active":"2024-09-17T02:54:42.147642+0000","last_became_peered":"2024-09-17T02:54:42.147642+0000","last_unstale":"2024-09-17T02:54:43.358116+0000","last_undegraded":"2024-09-17T02:54:43.358116+0000","last_fullsized":"2024-09-17T02:54:43.358116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:32.329063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358017+0000","last_change":"2024-09-17T02:54:42.148238+0000","last_active":"2024-09-17T02:54:43.358017+0000","last_peered":"2024-09-17T02:54:43.358017+0000","last_clean":"2024-09-17T02:54:43.358017+0000","last_became_active":"2024-09-17T02:54:42.147968+0000","last_became_peered":"2024-09-17T02:54:42.147968+0000","last_unstale":"2024-09-17T02:54:43.358017+0000","last_undegraded":"2024-09-17T02:54:43.358017+0000","last_fullsized":"2024-09-17T02:54:43.358017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:34.663251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358738+0000","last_change":"2024-09-17T02:54:42.153412+0000","last_active":"2024-09-17T02:54:43.358738+0000","last_peered":"2024-09-17T02:54:43.358738+0000","last_clean":"2024-09-17T02:54:43.358738+0000","last_became_active":"2024-09-17T02:54:42.153203+0000","last_became_peered":"2024-09-17T02:54:42.153203+0000","last_unstale":"2024-09-17T02:54:43.358738+0000","last_undegraded":"2024-09-17T02:54:43.358738+0000","last_fullsized":"2024-09-17T02:54:43.358738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:17.922940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137503+0000","last_change":"2024-09-17T02:54:42.143439+0000","last_active":"2024-09-17T02:54:43.137503+0000","last_peered":"2024-09-17T02:54:43.137503+0000","last_clean":"2024-09-17T02:54:43.137503+0000","last_became_active":"2024-09-17T02:54:42.141811+0000","last_became_peered":"2024-09-17T02:54:42.141811+0000","last_unstale":"2024-09-17T02:54:43.137503+0000","last_undegraded":"2024-09-17T02:54:43.137503+0000","last_fullsized":"2024-09-17T02:54:43.137503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:00.262503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.139107+0000","last_change":"2024-09-17T02:54:42.155339+0000","last_active":"2024-09-17T02:54:43.139107+0000","last_peered":"2024-09-17T02:54:43.139107+0000","last_clean":"2024-09-17T02:54:43.139107+0000","last_became_active":"2024-09-17T02:54:42.154873+0000","last_became_peered":"2024-09-17T02:54:42.154873+0000","last_unstale":"2024-09-17T02:54:43.139107+0000","last_undegraded":"2024-09-17T02:54:43.139107+0000","last_fullsized":"2024-09-17T02:54:43.139107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:05.213755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359385+0000","last_change":"2024-09-17T02:54:41.136992+0000","last_active":"2024-09-17T02:54:43.359385+0000","last_peered":"2024-09-17T02:54:43.359385+0000","last_clean":"2024-09-17T02:54:43.359385+0000","last_became_active":"2024-09-17T02:54:41.136720+0000","last_became_peered":"2024-09-17T02:54:41.136720+0000","last_unstale":"2024-09-17T02:54:43.359385+0000","last_undegraded":"2024-09-17T02:54:43.359385+0000","last_fullsized":"2024-09-17T02:54:43.359385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:03.837671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358718+0000","last_change":"2024-09-17T02:54:42.156499+0000","last_active":"2024-09-17T02:54:43.358718+0000","last_peered":"2024-09-17T02:54:43.358718+0000","last_clean":"2024-09-17T02:54:43.358718+0000","last_became_active":"2024-09-17T02:54:42.156211+0000","last_became_peered":"2024-09-17T02:54:42.156211+0000","last_unstale":"2024-09-17T02:54:43.358718+0000","last_undegraded":"2024-09-17T02:54:43.358718+0000","last_fullsized":"2024-09-17T02:54:43.358718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:40.881577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136922+0000","last_change":"2024-09-17T02:54:41.125908+0000","last_active":"2024-09-17T02:54:43.136922+0000","last_peered":"2024-09-17T02:54:43.136922+0000","last_clean":"2024-09-17T02:54:43.136922+0000","last_became_active":"2024-09-17T02:54:41.124285+0000","last_became_peered":"2024-09-17T02:54:41.124285+0000","last_unstale":"2024-09-17T02:54:43.136922+0000","last_undegraded":"2024-09-17T02:54:43.136922+0000","last_fullsized":"2024-09-17T02:54:43.136922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:26.638048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358830+0000","last_change":"2024-09-17T02:54:41.133974+0000","last_active":"2024-09-17T02:54:43.358830+0000","last_peered":"2024-09-17T02:54:43.358830+0000","last_clean":"2024-09-17T02:54:43.358830+0000","last_became_active":"2024-09-17T02:54:41.130208+0000","last_became_peered":"2024-09-17T02:54:41.130208+0000","last_unstale":"2024-09-17T02:54:43.358830+0000","last_undegraded":"2024-09-17T02:54:43.358830+0000","last_fullsized":"2024-09-17T02:54:43.358830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.121870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358442+0000","last_change":"2024-09-17T02:54:42.147110+0000","last_active":"2024-09-17T02:54:43.358442+0000","last_peered":"2024-09-17T02:54:43.358442+0000","last_clean":"2024-09-17T02:54:43.358442+0000","last_became_active":"2024-09-17T02:54:42.146853+0000","last_became_peered":"2024-09-17T02:54:42.146853+0000","last_unstale":"2024-09-17T02:54:43.358442+0000","last_undegraded":"2024-09-17T02:54:43.358442+0000","last_fullsized":"2024-09-17T02:54:43.358442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:08.683366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358321+0000","last_change":"2024-09-17T02:54:41.133392+0000","last_active":"2024-09-17T02:54:43.358321+0000","last_peered":"2024-09-17T02:54:43.358321+0000","last_clean":"2024-09-17T02:54:43.358321+0000","last_became_active":"2024-09-17T02:54:41.130773+0000","last_became_peered":"2024-09-17T02:54:41.130773+0000","last_unstale":"2024-09-17T02:54:43.358321+0000","last_undegraded":"2024-09-17T02:54:43.358321+0000","last_fullsized":"2024-09-17T02:54:43.358321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:55.515228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155934+0000","last_change":"2024-09-17T02:54:42.144622+0000","last_active":"2024-09-17T02:54:43.155934+0000","last_peered":"2024-09-17T02:54:43.155934+0000","last_clean":"2024-09-17T02:54:43.155934+0000","last_became_active":"2024-09-17T02:54:42.144372+0000","last_became_peered":"2024-09-17T02:54:42.144372+0000","last_unstale":"2024-09-17T02:54:43.155934+0000","last_undegraded":"2024-09-17T02:54:43.155934+0000","last_fullsized":"2024-09-17T02:54:43.155934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:30.258039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138441+0000","last_change":"2024-09-17T02:54:41.136164+0000","last_active":"2024-09-17T02:54:43.138441+0000","last_peered":"2024-09-17T02:54:43.138441+0000","last_clean":"2024-09-17T02:54:43.138441+0000","last_became_active":"2024-09-17T02:54:41.135870+0000","last_became_peered":"2024-09-17T02:54:41.135870+0000","last_unstale":"2024-09-17T02:54:43.138441+0000","last_undegraded":"2024-09-17T02:54:43.138441+0000","last_fullsized":"2024-09-17T02:54:43.138441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:21.739561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358283+0000","last_change":"2024-09-17T02:54:42.155081+0000","last_active":"2024-09-17T02:54:43.358283+0000","last_peered":"2024-09-17T02:54:43.358283+0000","last_clean":"2024-09-17T02:54:43.358283+0000","last_became_active":"2024-09-17T02:54:42.152288+0000","last_became_peered":"2024-09-17T02:54:42.152288+0000","last_unstale":"2024-09-17T02:54:43.358283+0000","last_undegraded":"2024-09-17T02:54:43.358283+0000","last_fullsized":"2024-09-17T02:54:43.358283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:39.172434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358934+0000","last_change":"2024-09-17T02:54:41.134782+0000","last_active":"2024-09-17T02:54:43.358934+0000","last_peered":"2024-09-17T02:54:43.358934+0000","last_clean":"2024-09-17T02:54:43.358934+0000","last_became_active":"2024-09-17T02:54:41.133444+0000","last_became_peered":"2024-09-17T02:54:41.133444+0000","last_unstale":"2024-09-17T02:54:43.358934+0000","last_undegraded":"2024-09-17T02:54:43.358934+0000","last_fullsized":"2024-09-17T02:54:43.358934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:16.840770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359426+0000","last_change":"2024-09-17T02:54:42.153615+0000","last_active":"2024-09-17T02:54:43.359426+0000","last_peered":"2024-09-17T02:54:43.359426+0000","last_clean":"2024-09-17T02:54:43.359426+0000","last_became_active":"2024-09-17T02:54:42.153338+0000","last_became_peered":"2024-09-17T02:54:42.153338+0000","last_unstale":"2024-09-17T02:54:43.359426+0000","last_undegraded":"2024-09-17T02:54:43.359426+0000","last_fullsized":"2024-09-17T02:54:43.359426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:32.477196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155969+0000","last_change":"2024-09-17T02:54:41.133126+0000","last_active":"2024-09-17T02:54:43.155969+0000","last_peered":"2024-09-17T02:54:43.155969+0000","last_clean":"2024-09-17T02:54:43.155969+0000","last_became_active":"2024-09-17T02:54:41.132866+0000","last_became_peered":"2024-09-17T02:54:41.132866+0000","last_unstale":"2024-09-17T02:54:43.155969+0000","last_undegraded":"2024-09-17T02:54:43.155969+0000","last_fullsized":"2024-09-17T02:54:43.155969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:50.250221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137048+0000","last_change":"2024-09-17T02:54:42.150450+0000","last_active":"2024-09-17T02:54:43.137048+0000","last_peered":"2024-09-17T02:54:43.137048+0000","last_clean":"2024-09-17T02:54:43.137048+0000","last_became_active":"2024-09-17T02:54:42.150186+0000","last_became_peered":"2024-09-17T02:54:42.150186+0000","last_unstale":"2024-09-17T02:54:43.137048+0000","last_undegraded":"2024-09-17T02:54:43.137048+0000","last_fullsized":"2024-09-17T02:54:43.137048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:48.341430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138150+0000","last_change":"2024-09-17T02:54:41.128843+0000","last_active":"2024-09-17T02:54:43.138150+0000","last_peered":"2024-09-17T02:54:43.138150+0000","last_clean":"2024-09-17T02:54:43.138150+0000","last_became_active":"2024-09-17T02:54:41.128490+0000","last_became_peered":"2024-09-17T02:54:41.128490+0000","last_unstale":"2024-09-17T02:54:43.138150+0000","last_undegraded":"2024-09-17T02:54:43.138150+0000","last_fullsized":"2024-09-17T02:54:43.138150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:20.538807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.135840+0000","last_change":"2024-09-17T02:54:42.146224+0000","last_active":"2024-09-17T02:54:43.135840+0000","last_peered":"2024-09-17T02:54:43.135840+0000","last_clean":"2024-09-17T02:54:43.135840+0000","last_became_active":"2024-09-17T02:54:42.145934+0000","last_became_peered":"2024-09-17T02:54:42.145934+0000","last_unstale":"2024-09-17T02:54:43.135840+0000","last_undegraded":"2024-09-17T02:54:43.135840+0000","last_fullsized":"2024-09-17T02:54:43.135840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:26.208033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359244+0000","last_change":"2024-09-17T02:54:41.126988+0000","last_active":"2024-09-17T02:54:43.359244+0000","last_peered":"2024-09-17T02:54:43.359244+0000","last_clean":"2024-09-17T02:54:43.359244+0000","last_became_active":"2024-09-17T02:54:41.126723+0000","last_became_peered":"2024-09-17T02:54:41.126723+0000","last_unstale":"2024-09-17T02:54:43.359244+0000","last_undegraded":"2024-09-17T02:54:43.359244+0000","last_fullsized":"2024-09-17T02:54:43.359244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:06.248848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359672+0000","last_change":"2024-09-17T02:54:42.146284+0000","last_active":"2024-09-17T02:54:43.359672+0000","last_peered":"2024-09-17T02:54:43.359672+0000","last_clean":"2024-09-17T02:54:43.359672+0000","last_became_active":"2024-09-17T02:54:42.146015+0000","last_became_peered":"2024-09-17T02:54:42.146015+0000","last_unstale":"2024-09-17T02:54:43.359672+0000","last_undegraded":"2024-09-17T02:54:43.359672+0000","last_fullsized":"2024-09-17T02:54:43.359672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.467098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359153+0000","last_change":"2024-09-17T02:54:41.132996+0000","last_active":"2024-09-17T02:54:43.359153+0000","last_peered":"2024-09-17T02:54:43.359153+0000","last_clean":"2024-09-17T02:54:43.359153+0000","last_became_active":"2024-09-17T02:54:41.132135+0000","last_became_peered":"2024-09-17T02:54:41.132135+0000","last_unstale":"2024-09-17T02:54:43.359153+0000","last_undegraded":"2024-09-17T02:54:43.359153+0000","last_fullsized":"2024-09-17T02:54:43.359153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:07.376228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136531+0000","last_change":"2024-09-17T02:54:42.158937+0000","last_active":"2024-09-17T02:54:43.136531+0000","last_peered":"2024-09-17T02:54:43.136531+0000","last_clean":"2024-09-17T02:54:43.136531+0000","last_became_active":"2024-09-17T02:54:42.158282+0000","last_became_peered":"2024-09-17T02:54:42.158282+0000","last_unstale":"2024-09-17T02:54:43.136531+0000","last_undegraded":"2024-09-17T02:54:43.136531+0000","last_fullsized":"2024-09-17T02:54:43.136531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:28.545537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137699+0000","last_change":"2024-09-17T02:54:41.127168+0000","last_active":"2024-09-17T02:54:43.137699+0000","last_peered":"2024-09-17T02:54:43.137699+0000","last_clean":"2024-09-17T02:54:43.137699+0000","last_became_active":"2024-09-17T02:54:41.126901+0000","last_became_peered":"2024-09-17T02:54:41.126901+0000","last_unstale":"2024-09-17T02:54:43.137699+0000","last_undegraded":"2024-09-17T02:54:43.137699+0000","last_fullsized":"2024-09-17T02:54:43.137699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:21.080985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136732+0000","last_change":"2024-09-17T02:54:42.141939+0000","last_active":"2024-09-17T02:54:43.136732+0000","last_peered":"2024-09-17T02:54:43.136732+0000","last_clean":"2024-09-17T02:54:43.136732+0000","last_became_active":"2024-09-17T02:54:42.141638+0000","last_became_peered":"2024-09-17T02:54:42.141638+0000","last_unstale":"2024-09-17T02:54:43.136732+0000","last_undegraded":"2024-09-17T02:54:43.136732+0000","last_fullsized":"2024-09-17T02:54:43.136732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:57.994378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358218+0000","last_change":"2024-09-17T02:54:41.131775+0000","last_active":"2024-09-17T02:54:43.358218+0000","last_peered":"2024-09-17T02:54:43.358218+0000","last_clean":"2024-09-17T02:54:43.358218+0000","last_became_active":"2024-09-17T02:54:41.131311+0000","last_became_peered":"2024-09-17T02:54:41.131311+0000","last_unstale":"2024-09-17T02:54:43.358218+0000","last_undegraded":"2024-09-17T02:54:43.358218+0000","last_fullsized":"2024-09-17T02:54:43.358218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:28.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136931+0000","last_change":"2024-09-17T02:54:42.157762+0000","last_active":"2024-09-17T02:54:43.136931+0000","last_peered":"2024-09-17T02:54:43.136931+0000","last_clean":"2024-09-17T02:54:43.136931+0000","last_became_active":"2024-09-17T02:54:42.157491+0000","last_became_peered":"2024-09-17T02:54:42.157491+0000","last_unstale":"2024-09-17T02:54:43.136931+0000","last_undegraded":"2024-09-17T02:54:43.136931+0000","last_fullsized":"2024-09-17T02:54:43.136931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:19.836766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137249+0000","last_change":"2024-09-17T02:54:41.124818+0000","last_active":"2024-09-17T02:54:43.137249+0000","last_peered":"2024-09-17T02:54:43.137249+0000","last_clean":"2024-09-17T02:54:43.137249+0000","last_became_active":"2024-09-17T02:54:41.124391+0000","last_became_peered":"2024-09-17T02:54:41.124391+0000","last_unstale":"2024-09-17T02:54:43.137249+0000","last_undegraded":"2024-09-17T02:54:43.137249+0000","last_fullsized":"2024-09-17T02:54:43.137249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:16.876804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137289+0000","last_change":"2024-09-17T02:54:42.159256+0000","last_active":"2024-09-17T02:54:43.137289+0000","last_peered":"2024-09-17T02:54:43.137289+0000","last_clean":"2024-09-17T02:54:43.137289+0000","last_became_active":"2024-09-17T02:54:42.158656+0000","last_became_peered":"2024-09-17T02:54:42.158656+0000","last_unstale":"2024-09-17T02:54:43.137289+0000","last_undegraded":"2024-09-17T02:54:43.137289+0000","last_fullsized":"2024-09-17T02:54:43.137289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:05.910827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358555+0000","last_change":"2024-09-17T02:54:41.136678+0000","last_active":"2024-09-17T02:54:43.358555+0000","last_peered":"2024-09-17T02:54:43.358555+0000","last_clean":"2024-09-17T02:54:43.358555+0000","last_became_active":"2024-09-17T02:54:41.136398+0000","last_became_peered":"2024-09-17T02:54:41.136398+0000","last_unstale":"2024-09-17T02:54:43.358555+0000","last_undegraded":"2024-09-17T02:54:43.358555+0000","last_fullsized":"2024-09-17T02:54:43.358555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:39.254444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136302+0000","last_change":"2024-09-17T02:54:42.152570+0000","last_active":"2024-09-17T02:54:43.136302+0000","last_peered":"2024-09-17T02:54:43.136302+0000","last_clean":"2024-09-17T02:54:43.136302+0000","last_became_active":"2024-09-17T02:54:42.151788+0000","last_became_peered":"2024-09-17T02:54:42.151788+0000","last_unstale":"2024-09-17T02:54:43.136302+0000","last_undegraded":"2024-09-17T02:54:43.136302+0000","last_fullsized":"2024-09-17T02:54:43.136302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:07.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155816+0000","last_change":"2024-09-17T02:54:41.129677+0000","last_active":"2024-09-17T02:54:43.155816+0000","last_peered":"2024-09-17T02:54:43.155816+0000","last_clean":"2024-09-17T02:54:43.155816+0000","last_became_active":"2024-09-17T02:54:41.128120+0000","last_became_peered":"2024-09-17T02:54:41.128120+0000","last_unstale":"2024-09-17T02:54:43.155816+0000","last_undegraded":"2024-09-17T02:54:43.155816+0000","last_fullsized":"2024-09-17T02:54:43.155816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:29.303949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358791+0000","last_change":"2024-09-17T02:54:42.151741+0000","last_active":"2024-09-17T02:54:43.358791+0000","last_peered":"2024-09-17T02:54:43.358791+0000","last_clean":"2024-09-17T02:54:43.358791+0000","last_became_active":"2024-09-17T02:54:42.150459+0000","last_became_peered":"2024-09-17T02:54:42.150459+0000","last_unstale":"2024-09-17T02:54:43.358791+0000","last_undegraded":"2024-09-17T02:54:43.358791+0000","last_fullsized":"2024-09-17T02:54:43.358791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:18.116431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358136+0000","last_change":"2024-09-17T02:54:41.135494+0000","last_active":"2024-09-17T02:54:43.358136+0000","last_peered":"2024-09-17T02:54:43.358136+0000","last_clean":"2024-09-17T02:54:43.358136+0000","last_became_active":"2024-09-17T02:54:41.135146+0000","last_became_peered":"2024-09-17T02:54:41.135146+0000","last_unstale":"2024-09-17T02:54:43.358136+0000","last_undegraded":"2024-09-17T02:54:43.358136+0000","last_fullsized":"2024-09-17T02:54:43.358136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:55.347118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138244+0000","last_change":"2024-09-17T02:54:42.153708+0000","last_active":"2024-09-17T02:54:43.138244+0000","last_peered":"2024-09-17T02:54:43.138244+0000","last_clean":"2024-09-17T02:54:43.138244+0000","last_became_active":"2024-09-17T02:54:42.153438+0000","last_became_peered":"2024-09-17T02:54:42.153438+0000","last_unstale":"2024-09-17T02:54:43.138244+0000","last_undegraded":"2024-09-17T02:54:43.138244+0000","last_fullsized":"2024-09-17T02:54:43.138244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:30.371000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136979+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:54:43.136979+0000","last_peered":"2024-09-17T02:54:43.136979+0000","last_clean":"2024-09-17T02:54:43.136979+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:54:43.136979+0000","last_undegraded":"2024-09-17T02:54:43.136979+0000","last_fullsized":"2024-09-17T02:54:43.136979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359355+0000","last_change":"2024-09-17T02:54:41.132405+0000","last_active":"2024-09-17T02:54:43.359355+0000","last_peered":"2024-09-17T02:54:43.359355+0000","last_clean":"2024-09-17T02:54:43.359355+0000","last_became_active":"2024-09-17T02:54:41.131396+0000","last_became_peered":"2024-09-17T02:54:41.131396+0000","last_unstale":"2024-09-17T02:54:43.359355+0000","last_undegraded":"2024-09-17T02:54:43.359355+0000","last_fullsized":"2024-09-17T02:54:43.359355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:52.252060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359121+0000","last_change":"2024-09-17T02:54:42.151718+0000","last_active":"2024-09-17T02:54:43.359121+0000","last_peered":"2024-09-17T02:54:43.359121+0000","last_clean":"2024-09-17T02:54:43.359121+0000","last_became_active":"2024-09-17T02:54:42.151425+0000","last_became_peered":"2024-09-17T02:54:42.151425+0000","last_unstale":"2024-09-17T02:54:43.359121+0000","last_undegraded":"2024-09-17T02:54:43.359121+0000","last_fullsized":"2024-09-17T02:54:43.359121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:50.080913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136874+0000","last_change":"2024-09-17T02:54:41.134010+0000","last_active":"2024-09-17T02:54:43.136874+0000","last_peered":"2024-09-17T02:54:43.136874+0000","last_clean":"2024-09-17T02:54:43.136874+0000","last_became_active":"2024-09-17T02:54:41.133330+0000","last_became_peered":"2024-09-17T02:54:41.133330+0000","last_unstale":"2024-09-17T02:54:43.136874+0000","last_undegraded":"2024-09-17T02:54:43.136874+0000","last_fullsized":"2024-09-17T02:54:43.136874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:35.841779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358888+0000","last_change":"2024-09-17T02:54:42.156464+0000","last_active":"2024-09-17T02:54:43.358888+0000","last_peered":"2024-09-17T02:54:43.358888+0000","last_clean":"2024-09-17T02:54:43.358888+0000","last_became_active":"2024-09-17T02:54:42.156189+0000","last_became_peered":"2024-09-17T02:54:42.156189+0000","last_unstale":"2024-09-17T02:54:43.358888+0000","last_undegraded":"2024-09-17T02:54:43.358888+0000","last_fullsized":"2024-09-17T02:54:43.358888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:25:08.347022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358348+0000","last_change":"2024-09-17T02:54:41.136814+0000","last_active":"2024-09-17T02:54:43.358348+0000","last_peered":"2024-09-17T02:54:43.358348+0000","last_clean":"2024-09-17T02:54:43.358348+0000","last_became_active":"2024-09-17T02:54:41.136504+0000","last_became_peered":"2024-09-17T02:54:41.136504+0000","last_unstale":"2024-09-17T02:54:43.358348+0000","last_undegraded":"2024-09-17T02:54:43.358348+0000","last_fullsized":"2024-09-17T02:54:43.358348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:31.500343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156157+0000","last_change":"2024-09-17T02:54:42.139120+0000","last_active":"2024-09-17T02:54:43.156157+0000","last_peered":"2024-09-17T02:54:43.156157+0000","last_clean":"2024-09-17T02:54:43.156157+0000","last_became_active":"2024-09-17T02:54:42.138859+0000","last_became_peered":"2024-09-17T02:54:42.138859+0000","last_unstale":"2024-09-17T02:54:43.156157+0000","last_undegraded":"2024-09-17T02:54:43.156157+0000","last_fullsized":"2024-09-17T02:54:43.156157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:11.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359006+0000","last_change":"2024-09-17T02:54:41.135077+0000","last_active":"2024-09-17T02:54:43.359006+0000","last_peered":"2024-09-17T02:54:43.359006+0000","last_clean":"2024-09-17T02:54:43.359006+0000","last_became_active":"2024-09-17T02:54:41.134456+0000","last_became_peered":"2024-09-17T02:54:41.134456+0000","last_unstale":"2024-09-17T02:54:43.359006+0000","last_undegraded":"2024-09-17T02:54:43.359006+0000","last_fullsized":"2024-09-17T02:54:43.359006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:14.713147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136894+0000","last_change":"2024-09-17T02:54:42.148213+0000","last_active":"2024-09-17T02:54:43.136894+0000","last_peered":"2024-09-17T02:54:43.136894+0000","last_clean":"2024-09-17T02:54:43.136894+0000","last_became_active":"2024-09-17T02:54:42.147941+0000","last_became_peered":"2024-09-17T02:54:42.147941+0000","last_unstale":"2024-09-17T02:54:43.136894+0000","last_undegraded":"2024-09-17T02:54:43.136894+0000","last_fullsized":"2024-09-17T02:54:43.136894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:28.231123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156101+0000","last_change":"2024-09-17T02:54:41.129281+0000","last_active":"2024-09-17T02:54:43.156101+0000","last_peered":"2024-09-17T02:54:43.156101+0000","last_clean":"2024-09-17T02:54:43.156101+0000","last_became_active":"2024-09-17T02:54:41.129016+0000","last_became_peered":"2024-09-17T02:54:41.129016+0000","last_unstale":"2024-09-17T02:54:43.156101+0000","last_undegraded":"2024-09-17T02:54:43.156101+0000","last_fullsized":"2024-09-17T02:54:43.156101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:35.685956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358418+0000","last_change":"2024-09-17T02:54:42.149626+0000","last_active":"2024-09-17T02:54:43.358418+0000","last_peered":"2024-09-17T02:54:43.358418+0000","last_clean":"2024-09-17T02:54:43.358418+0000","last_became_active":"2024-09-17T02:54:42.148363+0000","last_became_peered":"2024-09-17T02:54:42.148363+0000","last_unstale":"2024-09-17T02:54:43.358418+0000","last_undegraded":"2024-09-17T02:54:43.358418+0000","last_fullsized":"2024-09-17T02:54:43.358418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:43.951700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136758+0000","last_change":"2024-09-17T02:54:41.127905+0000","last_active":"2024-09-17T02:54:43.136758+0000","last_peered":"2024-09-17T02:54:43.136758+0000","last_clean":"2024-09-17T02:54:43.136758+0000","last_became_active":"2024-09-17T02:54:41.127616+0000","last_became_peered":"2024-09-17T02:54:41.127616+0000","last_unstale":"2024-09-17T02:54:43.136758+0000","last_undegraded":"2024-09-17T02:54:43.136758+0000","last_fullsized":"2024-09-17T02:54:43.136758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:13.661134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155795+0000","last_change":"2024-09-17T02:54:42.137451+0000","last_active":"2024-09-17T02:54:43.155795+0000","last_peered":"2024-09-17T02:54:43.155795+0000","last_clean":"2024-09-17T02:54:43.155795+0000","last_became_active":"2024-09-17T02:54:42.137156+0000","last_became_peered":"2024-09-17T02:54:42.137156+0000","last_unstale":"2024-09-17T02:54:43.155795+0000","last_undegraded":"2024-09-17T02:54:43.155795+0000","last_fullsized":"2024-09-17T02:54:43.155795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:10.118647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156125+0000","last_change":"2024-09-17T02:54:41.130345+0000","last_active":"2024-09-17T02:54:43.156125+0000","last_peered":"2024-09-17T02:54:43.156125+0000","last_clean":"2024-09-17T02:54:43.156125+0000","last_became_active":"2024-09-17T02:54:41.130078+0000","last_became_peered":"2024-09-17T02:54:41.130078+0000","last_unstale":"2024-09-17T02:54:43.156125+0000","last_undegraded":"2024-09-17T02:54:43.156125+0000","last_fullsized":"2024-09-17T02:54:43.156125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:46.185877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358887+0000","last_change":"2024-09-17T02:54:42.146439+0000","last_active":"2024-09-17T02:54:43.358887+0000","last_peered":"2024-09-17T02:54:43.358887+0000","last_clean":"2024-09-17T02:54:43.358887+0000","last_became_active":"2024-09-17T02:54:42.146179+0000","last_became_peered":"2024-09-17T02:54:42.146179+0000","last_unstale":"2024-09-17T02:54:43.358887+0000","last_undegraded":"2024-09-17T02:54:43.358887+0000","last_fullsized":"2024-09-17T02:54:43.358887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:23.894676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137820+0000","last_change":"2024-09-17T02:54:41.125471+0000","last_active":"2024-09-17T02:54:43.137820+0000","last_peered":"2024-09-17T02:54:43.137820+0000","last_clean":"2024-09-17T02:54:43.137820+0000","last_became_active":"2024-09-17T02:54:41.124551+0000","last_became_peered":"2024-09-17T02:54:41.124551+0000","last_unstale":"2024-09-17T02:54:43.137820+0000","last_undegraded":"2024-09-17T02:54:43.137820+0000","last_fullsized":"2024-09-17T02:54:43.137820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:02.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358379+0000","last_change":"2024-09-17T02:54:42.143465+0000","last_active":"2024-09-17T02:54:43.358379+0000","last_peered":"2024-09-17T02:54:43.358379+0000","last_clean":"2024-09-17T02:54:43.358379+0000","last_became_active":"2024-09-17T02:54:42.143167+0000","last_became_peered":"2024-09-17T02:54:42.143167+0000","last_unstale":"2024-09-17T02:54:43.358379+0000","last_undegraded":"2024-09-17T02:54:43.358379+0000","last_fullsized":"2024-09-17T02:54:43.358379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:37.631386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138696+0000","last_change":"2024-09-17T02:54:41.127039+0000","last_active":"2024-09-17T02:54:43.138696+0000","last_peered":"2024-09-17T02:54:43.138696+0000","last_clean":"2024-09-17T02:54:43.138696+0000","last_became_active":"2024-09-17T02:54:41.126724+0000","last_became_peered":"2024-09-17T02:54:41.126724+0000","last_unstale":"2024-09-17T02:54:43.138696+0000","last_undegraded":"2024-09-17T02:54:43.138696+0000","last_fullsized":"2024-09-17T02:54:43.138696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:25.897861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138769+0000","last_change":"2024-09-17T02:54:42.156420+0000","last_active":"2024-09-17T02:54:43.138769+0000","last_peered":"2024-09-17T02:54:43.138769+0000","last_clean":"2024-09-17T02:54:43.138769+0000","last_became_active":"2024-09-17T02:54:42.154866+0000","last_became_peered":"2024-09-17T02:54:42.154866+0000","last_unstale":"2024-09-17T02:54:43.138769+0000","last_undegraded":"2024-09-17T02:54:43.138769+0000","last_fullsized":"2024-09-17T02:54:43.138769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:24.806778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156042+0000","last_change":"2024-09-17T02:54:41.131579+0000","last_active":"2024-09-17T02:54:43.156042+0000","last_peered":"2024-09-17T02:54:43.156042+0000","last_clean":"2024-09-17T02:54:43.156042+0000","last_became_active":"2024-09-17T02:54:41.131123+0000","last_became_peered":"2024-09-17T02:54:41.131123+0000","last_unstale":"2024-09-17T02:54:43.156042+0000","last_undegraded":"2024-09-17T02:54:43.156042+0000","last_fullsized":"2024-09-17T02:54:43.156042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:17.467321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359468+0000","last_change":"2024-09-17T02:54:42.146004+0000","last_active":"2024-09-17T02:54:43.359468+0000","last_peered":"2024-09-17T02:54:43.359468+0000","last_clean":"2024-09-17T02:54:43.359468+0000","last_became_active":"2024-09-17T02:54:42.145739+0000","last_became_peered":"2024-09-17T02:54:42.145739+0000","last_unstale":"2024-09-17T02:54:43.359468+0000","last_undegraded":"2024-09-17T02:54:43.359468+0000","last_fullsized":"2024-09-17T02:54:43.359468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:31.840015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156307+0000","last_change":"2024-09-17T02:54:41.127869+0000","last_active":"2024-09-17T02:54:43.156307+0000","last_peered":"2024-09-17T02:54:43.156307+0000","last_clean":"2024-09-17T02:54:43.156307+0000","last_became_active":"2024-09-17T02:54:41.127552+0000","last_became_peered":"2024-09-17T02:54:41.127552+0000","last_unstale":"2024-09-17T02:54:43.156307+0000","last_undegraded":"2024-09-17T02:54:43.156307+0000","last_fullsized":"2024-09-17T02:54:43.156307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:45.759358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359868+0000","last_change":"2024-09-17T02:54:42.147352+0000","last_active":"2024-09-17T02:54:43.359868+0000","last_peered":"2024-09-17T02:54:43.359868+0000","last_clean":"2024-09-17T02:54:43.359868+0000","last_became_active":"2024-09-17T02:54:42.146704+0000","last_became_peered":"2024-09-17T02:54:42.146704+0000","last_unstale":"2024-09-17T02:54:43.359868+0000","last_undegraded":"2024-09-17T02:54:43.359868+0000","last_fullsized":"2024-09-17T02:54:43.359868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:43.443564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136064+0000","last_change":"2024-09-17T02:54:41.126814+0000","last_active":"2024-09-17T02:54:43.136064+0000","last_peered":"2024-09-17T02:54:43.136064+0000","last_clean":"2024-09-17T02:54:43.136064+0000","last_became_active":"2024-09-17T02:54:41.126505+0000","last_became_peered":"2024-09-17T02:54:41.126505+0000","last_unstale":"2024-09-17T02:54:43.136064+0000","last_undegraded":"2024-09-17T02:54:43.136064+0000","last_fullsized":"2024-09-17T02:54:43.136064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:31.318671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137986+0000","last_change":"2024-09-17T02:54:42.149079+0000","last_active":"2024-09-17T02:54:43.137986+0000","last_peered":"2024-09-17T02:54:43.137986+0000","last_clean":"2024-09-17T02:54:43.137986+0000","last_became_active":"2024-09-17T02:54:42.148783+0000","last_became_peered":"2024-09-17T02:54:42.148783+0000","last_unstale":"2024-09-17T02:54:43.137986+0000","last_undegraded":"2024-09-17T02:54:43.137986+0000","last_fullsized":"2024-09-17T02:54:43.137986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:06.553170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358191+0000","last_change":"2024-09-17T02:54:42.158896+0000","last_active":"2024-09-17T02:54:43.358191+0000","last_peered":"2024-09-17T02:54:43.358191+0000","last_clean":"2024-09-17T02:54:43.358191+0000","last_became_active":"2024-09-17T02:54:42.157766+0000","last_became_peered":"2024-09-17T02:54:42.157766+0000","last_unstale":"2024-09-17T02:54:43.358191+0000","last_undegraded":"2024-09-17T02:54:43.358191+0000","last_fullsized":"2024-09-17T02:54:43.358191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:09.623648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138577+0000","last_change":"2024-09-17T02:54:41.133352+0000","last_active":"2024-09-17T02:54:43.138577+0000","last_peered":"2024-09-17T02:54:43.138577+0000","last_clean":"2024-09-17T02:54:43.138577+0000","last_became_active":"2024-09-17T02:54:41.133001+0000","last_became_peered":"2024-09-17T02:54:41.133001+0000","last_unstale":"2024-09-17T02:54:43.138577+0000","last_undegraded":"2024-09-17T02:54:43.138577+0000","last_fullsized":"2024-09-17T02:54:43.138577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:25.234888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358704+0000","last_change":"2024-09-17T02:54:42.157016+0000","last_active":"2024-09-17T02:54:43.358704+0000","last_peered":"2024-09-17T02:54:43.358704+0000","last_clean":"2024-09-17T02:54:43.358704+0000","last_became_active":"2024-09-17T02:54:42.155446+0000","last_became_peered":"2024-09-17T02:54:42.155446+0000","last_unstale":"2024-09-17T02:54:43.358704+0000","last_undegraded":"2024-09-17T02:54:43.358704+0000","last_fullsized":"2024-09-17T02:54:43.358704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:10.877471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137546+0000","last_change":"2024-09-17T02:54:41.131298+0000","last_active":"2024-09-17T02:54:43.137546+0000","last_peered":"2024-09-17T02:54:43.137546+0000","last_clean":"2024-09-17T02:54:43.137546+0000","last_became_active":"2024-09-17T02:54:41.131019+0000","last_became_peered":"2024-09-17T02:54:41.131019+0000","last_unstale":"2024-09-17T02:54:43.137546+0000","last_undegraded":"2024-09-17T02:54:43.137546+0000","last_fullsized":"2024-09-17T02:54:43.137546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:42.571738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358655+0000","last_change":"2024-09-17T02:54:42.145720+0000","last_active":"2024-09-17T02:54:43.358655+0000","last_peered":"2024-09-17T02:54:43.358655+0000","last_clean":"2024-09-17T02:54:43.358655+0000","last_became_active":"2024-09-17T02:54:42.145389+0000","last_became_peered":"2024-09-17T02:54:42.145389+0000","last_unstale":"2024-09-17T02:54:43.358655+0000","last_undegraded":"2024-09-17T02:54:43.358655+0000","last_fullsized":"2024-09-17T02:54:43.358655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:43.429332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358712+0000","last_change":"2024-09-17T02:54:41.128714+0000","last_active":"2024-09-17T02:54:43.358712+0000","last_peered":"2024-09-17T02:54:43.358712+0000","last_clean":"2024-09-17T02:54:43.358712+0000","last_became_active":"2024-09-17T02:54:41.128099+0000","last_became_peered":"2024-09-17T02:54:41.128099+0000","last_unstale":"2024-09-17T02:54:43.358712+0000","last_undegraded":"2024-09-17T02:54:43.358712+0000","last_fullsized":"2024-09-17T02:54:43.358712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.229882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358452+0000","last_change":"2024-09-17T02:54:42.146900+0000","last_active":"2024-09-17T02:54:43.358452+0000","last_peered":"2024-09-17T02:54:43.358452+0000","last_clean":"2024-09-17T02:54:43.358452+0000","last_became_active":"2024-09-17T02:54:42.146654+0000","last_became_peered":"2024-09-17T02:54:42.146654+0000","last_unstale":"2024-09-17T02:54:43.358452+0000","last_undegraded":"2024-09-17T02:54:43.358452+0000","last_fullsized":"2024-09-17T02:54:43.358452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:58.031273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359142+0000","last_change":"2024-09-17T02:54:41.125421+0000","last_active":"2024-09-17T02:54:43.359142+0000","last_peered":"2024-09-17T02:54:43.359142+0000","last_clean":"2024-09-17T02:54:43.359142+0000","last_became_active":"2024-09-17T02:54:41.124528+0000","last_became_peered":"2024-09-17T02:54:41.124528+0000","last_unstale":"2024-09-17T02:54:43.359142+0000","last_undegraded":"2024-09-17T02:54:43.359142+0000","last_fullsized":"2024-09-17T02:54:43.359142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:02.002045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333605,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:54:50.901 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:54:50.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T02:54:50.902 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T02:54:51.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.051+0000 7f440da27640 1 -- 172.21.15.104:0/3066661442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080b3b00 msgr2=0x7f44080d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.051+0000 7f440da27640 1 --2- 172.21.15.104:0/3066661442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080b3b00 0x7f44080d34f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f44080b44d0 tx=0x7f440002aa70 comp rx=0 tx=0).stop 2024-09-17T02:54:51.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.051+0000 7f440da27640 1 -- 172.21.15.104:0/3066661442 shutdown_connections 2024-09-17T02:54:51.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.051+0000 7f440da27640 1 --2- 172.21.15.104:0/3066661442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080b3b00 0x7f44080d34f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.051+0000 7f440da27640 1 --2- 172.21.15.104:0/3066661442 >> v2:172.21.15.192:3300/0 conn(0x7f44080d18e0 0x7f440815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.051+0000 7f440da27640 1 -- 172.21.15.104:0/3066661442 >> 172.21.15.104:0/3066661442 conn(0x7f4408073df0 msgr2=0x7f4408068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:51.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.051+0000 7f440da27640 1 -- 172.21.15.104:0/3066661442 shutdown_connections 2024-09-17T02:54:51.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.051+0000 7f440da27640 1 -- 172.21.15.104:0/3066661442 wait complete. 2024-09-17T02:54:51.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.053+0000 7f440da27640 1 Processor -- start 2024-09-17T02:54:51.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.053+0000 7f440da27640 1 -- start start 2024-09-17T02:54:51.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f440da27640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44080b3b00 0x7f440814ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f440da27640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44080b6f70 0x7f44081f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f440da27640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d18e0 0x7f44080cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f440da27640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f44080d3dc0 con 0x7f44080d18e0 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f440da27640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f44080d3c40 con 0x7f44080b3b00 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f440da27640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f44080d3f40 con 0x7f44080b6f70 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d18e0 0x7f44080cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d18e0 0x7f44080cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52242/0 (socket says 172.21.15.104:52242) 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 -- 172.21.15.104:0/1361153859 learned_addr learned my addr 172.21.15.104:0/1361153859 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f4406ffd640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44080b3b00 0x7f440814ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44067fc640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44080b6f70 0x7f44081f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 -- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44080b6f70 msgr2=0x7f44081f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44080b6f70 0x7f44081f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 -- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44080b3b00 msgr2=0x7f440814ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44080b3b00 0x7f440814ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 -- 172.21.15.104:0/1361153859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44081f6a80 con 0x7f44080d18e0 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f4406ffd640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44080b3b00 0x7f440814ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44067fc640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44080b6f70 0x7f44081f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f44077fe640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d18e0 0x7f44080cd620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4400006010 tx=0x7f4400003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f43effff640 1 -- 172.21.15.104:0/1361153859 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400046070 con 0x7f44080d18e0 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f43effff640 1 -- 172.21.15.104:0/1361153859 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4400004540 con 0x7f44080d18e0 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44081f5cc0 con 0x7f44080d18e0 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.055+0000 7f43effff640 1 -- 172.21.15.104:0/1361153859 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400033070 con 0x7f44080d18e0 2024-09-17T02:54:51.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.056+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44081f6280 con 0x7f44080d18e0 2024-09-17T02:54:51.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.057+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44081f9db0 con 0x7f44080d18e0 2024-09-17T02:54:51.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.057+0000 7f43effff640 1 -- 172.21.15.104:0/1361153859 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4400049070 con 0x7f44080d18e0 2024-09-17T02:54:51.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.058+0000 7f43effff640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f43f4078bc0 0x7f43f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.058+0000 7f43effff640 1 -- 172.21.15.104:0/1361153859 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f44000bbdd0 con 0x7f44080d18e0 2024-09-17T02:54:51.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.058+0000 7f4406ffd640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f43f4078bc0 0x7f43f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.058+0000 7f4406ffd640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f43f4078bc0 0x7f43f407b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43f8007fd0 tx=0x7f43f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:51.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.062+0000 7f43effff640 1 -- 172.21.15.104:0/1361153859 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f440003e070 con 0x7f44080d18e0 2024-09-17T02:54:51.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.238+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f44080d43d0 con 0x7f44080d18e0 2024-09-17T02:54:51.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.239+0000 7f43effff640 1 -- 172.21.15.104:0/1361153859 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v23) ==== 86+0+129 (secure 0 0 0) 0x7f44000842a0 con 0x7f44080d18e0 2024-09-17T02:54:51.239 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f43f4078bc0 msgr2=0x7f43f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f43f4078bc0 0x7f43f407b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43f8007fd0 tx=0x7f43f8009040 comp rx=0 tx=0).stop 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d18e0 msgr2=0x7f44080cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d18e0 0x7f44080cd620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4400006010 tx=0x7f4400003f10 comp rx=0 tx=0).stop 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 shutdown_connections 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f43f4078bc0 0x7f43f407b0d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44080d18e0 0x7f44080cd620 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44080b6f70 0x7f44081f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 --2- 172.21.15.104:0/1361153859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44080b3b00 0x7f440814ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 >> 172.21.15.104:0/1361153859 conn(0x7f4408073df0 msgr2=0x7f44080d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:51.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 shutdown_connections 2024-09-17T02:54:51.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.241+0000 7f440da27640 1 -- 172.21.15.104:0/1361153859 wait complete. 2024-09-17T02:54:51.252 INFO:teuthology.orchestra.run.smithi104.stdout:[{"version":23,"timestamp":"2024-09-17T02:54:24.961917+0000","name":"","changes":[{"name":"mgr/debug_mgr","new_value":"20/20"}]}] 2024-09-17T02:54:51.252 INFO:tasks.ceph_manager:config epoch is 23 2024-09-17T02:54:51.252 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T02:54:51.252 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T02:54:51.253 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T02:54:51.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.364+0000 7f36d82f9640 1 -- 172.21.15.104:0/374065748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36b8003a50 msgr2=0x7f36b8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.364+0000 7f36d82f9640 1 --2- 172.21.15.104:0/374065748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36b8003a50 0x7f36b8003ec0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36c000c610 tx=0x7f36b8005830 comp rx=0 tx=0).stop 2024-09-17T02:54:51.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.365+0000 7f36d82f9640 1 -- 172.21.15.104:0/374065748 shutdown_connections 2024-09-17T02:54:51.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.365+0000 7f36d82f9640 1 --2- 172.21.15.104:0/374065748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36b8003a50 0x7f36b8003ec0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.365+0000 7f36d82f9640 1 -- 172.21.15.104:0/374065748 >> 172.21.15.104:0/374065748 conn(0x7f36d00b2450 msgr2=0x7f36d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:51.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.365+0000 7f36d82f9640 1 -- 172.21.15.104:0/374065748 shutdown_connections 2024-09-17T02:54:51.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.365+0000 7f36d82f9640 1 -- 172.21.15.104:0/374065748 wait complete. 2024-09-17T02:54:51.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.366+0000 7f36d82f9640 1 Processor -- start 2024-09-17T02:54:51.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.366+0000 7f36d82f9640 1 -- start start 2024-09-17T02:54:51.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d82f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b8003a50 0x7f36d00b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d82f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d013f2e0 0x7f36d00b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d82f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d00b44d0 0x7f36d01e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d82f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f36d0072960 con 0x7f36d013f2e0 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d82f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f36d00727e0 con 0x7f36b8003a50 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d82f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f36d0072ae0 con 0x7f36d00b44d0 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d013f2e0 0x7f36d00b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d013f2e0 0x7f36d00b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52254/0 (socket says 172.21.15.104:52254) 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 -- 172.21.15.104:0/1086700126 learned_addr learned my addr 172.21.15.104:0/1086700126 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d6896640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d00b44d0 0x7f36d01e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d6095640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b8003a50 0x7f36d00b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 -- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d00b44d0 msgr2=0x7f36d01e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d00b44d0 0x7f36d01e2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 -- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b8003a50 msgr2=0x7f36d00b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b8003a50 0x7f36d00b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 -- 172.21.15.104:0/1086700126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d00b48e0 con 0x7f36d013f2e0 2024-09-17T02:54:51.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d5894640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d013f2e0 0x7f36d00b3f90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36c4004eb0 tx=0x7f36c4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:51.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36ceffd640 1 -- 172.21.15.104:0/1086700126 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c4015020 con 0x7f36d013f2e0 2024-09-17T02:54:51.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36ceffd640 1 -- 172.21.15.104:0/1086700126 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36c4011670 con 0x7f36d013f2e0 2024-09-17T02:54:51.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d01e1290 con 0x7f36d013f2e0 2024-09-17T02:54:51.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36ceffd640 1 -- 172.21.15.104:0/1086700126 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c4011aa0 con 0x7f36d013f2e0 2024-09-17T02:54:51.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.368+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d01e1850 con 0x7f36d013f2e0 2024-09-17T02:54:51.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.369+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d006a740 con 0x7f36d013f2e0 2024-09-17T02:54:51.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.370+0000 7f36ceffd640 1 -- 172.21.15.104:0/1086700126 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36c4018020 con 0x7f36d013f2e0 2024-09-17T02:54:51.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.371+0000 7f36ceffd640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36bc078bc0 0x7f36bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.371+0000 7f36ceffd640 1 -- 172.21.15.104:0/1086700126 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f36c409b5c0 con 0x7f36d013f2e0 2024-09-17T02:54:51.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.371+0000 7f36d6095640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36bc078bc0 0x7f36bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.372+0000 7f36d6095640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36bc078bc0 0x7f36bc07b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36c0033000 tx=0x7f36c0001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:51.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.375+0000 7f36ceffd640 1 -- 172.21.15.104:0/1086700126 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36d006a740 con 0x7f36d013f2e0 2024-09-17T02:54:51.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.593+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f36d0073040 con 0x7f36d013f2e0 2024-09-17T02:54:51.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.595+0000 7f36ceffd640 1 -- 172.21.15.104:0/1086700126 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194722 (secure 0 0 0) 0x7f36c401f020 con 0x7f36d013f2e0 2024-09-17T02:54:51.597 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36bc078bc0 msgr2=0x7f36bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36bc078bc0 0x7f36bc07b0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36c0033000 tx=0x7f36c0001360 comp rx=0 tx=0).stop 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d013f2e0 msgr2=0x7f36d00b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d013f2e0 0x7f36d00b3f90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36c4004eb0 tx=0x7f36c4001630 comp rx=0 tx=0).stop 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 shutdown_connections 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36bc078bc0 0x7f36bc07b0d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36d00b44d0 0x7f36d01e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36d013f2e0 0x7f36d00b3f90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 --2- 172.21.15.104:0/1086700126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36b8003a50 0x7f36d00b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 >> 172.21.15.104:0/1086700126 conn(0x7f36d00b2450 msgr2=0x7f36d00b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:51.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 shutdown_connections 2024-09-17T02:54:51.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.598+0000 7f36d82f9640 1 -- 172.21.15.104:0/1086700126 wait complete. 2024-09-17T02:54:51.609 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":3619997215},{"type":"v1","addr":"172.21.15.192:6801","nonce":3619997215}]},"active_addr":"172.21.15.192:6801/3619997215","active_change":"2024-09-17T02:54:27.606307+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4146,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":1821548167}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2316797496}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2315852486}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":1186542425}]}]} 2024-09-17T02:54:51.614 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T02:54:51.614 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T02:54:51.615 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:51.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.729+0000 7f767ce70640 1 -- 172.21.15.104:0/4290442682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780b4fc0 msgr2=0x7f76780b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.729+0000 7f767ce70640 1 --2- 172.21.15.104:0/4290442682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780b4fc0 0x7f76780b39c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f76780c98b0 tx=0x7f766802a5f0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.729+0000 7f767ce70640 1 -- 172.21.15.104:0/4290442682 shutdown_connections 2024-09-17T02:54:51.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.729+0000 7f767ce70640 1 --2- 172.21.15.104:0/4290442682 >> v2:172.21.15.192:3300/0 conn(0x7f76780cdf10 0x7f76780cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.729+0000 7f767ce70640 1 --2- 172.21.15.104:0/4290442682 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780b4fc0 0x7f76780b39c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.729+0000 7f767ce70640 1 -- 172.21.15.104:0/4290442682 >> 172.21.15.104:0/4290442682 conn(0x7f76780b44a0 msgr2=0x7f76780b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:51.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.729+0000 7f767ce70640 1 -- 172.21.15.104:0/4290442682 shutdown_connections 2024-09-17T02:54:51.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.729+0000 7f767ce70640 1 -- 172.21.15.104:0/4290442682 wait complete. 2024-09-17T02:54:51.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.731+0000 7f767ce70640 1 Processor -- start 2024-09-17T02:54:51.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.731+0000 7f767ce70640 1 -- start start 2024-09-17T02:54:51.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f767ce70640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76780b3f00 0x7f767815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f767ce70640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76780b4fc0 0x7f76780caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f767ce70640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780cdf10 0x7f767815fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f767ce70640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f76780d18c0 con 0x7f76780cdf10 2024-09-17T02:54:51.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f767ce70640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76780d01d0 con 0x7f76780b3f00 2024-09-17T02:54:51.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f767ce70640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7678160f50 con 0x7f76780b4fc0 2024-09-17T02:54:51.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780cdf10 0x7f767815fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780cdf10 0x7f767815fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52280/0 (socket says 172.21.15.104:52280) 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 -- 172.21.15.104:0/945155349 learned_addr learned my addr 172.21.15.104:0/945155349 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f767659c640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76780b3f00 0x7f767815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7675d9b640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76780b4fc0 0x7f76780caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 -- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76780b4fc0 msgr2=0x7f76780caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76780b4fc0 0x7f76780caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 -- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76780b3f00 msgr2=0x7f767815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76780b3f00 0x7f767815c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 -- 172.21.15.104:0/945155349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76780c9ae0 con 0x7f76780cdf10 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.732+0000 7f7676d9d640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780cdf10 0x7f767815fb80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f767000ea40 tx=0x7f767000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.733+0000 7f7666ffd640 1 -- 172.21.15.104:0/945155349 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767000cde0 con 0x7f76780cdf10 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.733+0000 7f7666ffd640 1 -- 172.21.15.104:0/945155349 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7670004c10 con 0x7f76780cdf10 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.733+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76780c9dc0 con 0x7f76780cdf10 2024-09-17T02:54:51.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.733+0000 7f7666ffd640 1 -- 172.21.15.104:0/945155349 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670005020 con 0x7f76780cdf10 2024-09-17T02:54:51.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.733+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76780ca380 con 0x7f76780cdf10 2024-09-17T02:54:51.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.734+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76780b39c0 con 0x7f76780cdf10 2024-09-17T02:54:51.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.734+0000 7f7666ffd640 1 -- 172.21.15.104:0/945155349 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f76700051c0 con 0x7f76780cdf10 2024-09-17T02:54:51.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.735+0000 7f7666ffd640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7658078b90 0x7f765807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:51.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.735+0000 7f7666ffd640 1 -- 172.21.15.104:0/945155349 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f767009b9a0 con 0x7f76780cdf10 2024-09-17T02:54:51.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.735+0000 7f767659c640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7658078b90 0x7f765807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:51.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.736+0000 7f767659c640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7658078b90 0x7f765807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7668033000 tx=0x7f7668004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:51.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.739+0000 7f7666ffd640 1 -- 172.21.15.104:0/945155349 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7670063820 con 0x7f76780cdf10 2024-09-17T02:54:51.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.912+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7678072300 con 0x7f76780cdf10 2024-09-17T02:54:51.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.913+0000 7f7666ffd640 1 -- 172.21.15.104:0/945155349 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f7670068250 con 0x7f76780cdf10 2024-09-17T02:54:51.913 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:51.913 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:43.133211+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7658078b90 msgr2=0x7f765807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7658078b90 0x7f765807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7668033000 tx=0x7f7668004730 comp rx=0 tx=0).stop 2024-09-17T02:54:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780cdf10 msgr2=0x7f767815fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780cdf10 0x7f767815fb80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f767000ea40 tx=0x7f767000ef00 comp rx=0 tx=0).stop 2024-09-17T02:54:51.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 shutdown_connections 2024-09-17T02:54:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7658078b90 0x7f765807b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76780cdf10 0x7f767815fb80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76780b4fc0 0x7f76780caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 --2- 172.21.15.104:0/945155349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76780b3f00 0x7f767815c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 >> 172.21.15.104:0/945155349 conn(0x7f76780b44a0 msgr2=0x7f76780d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 shutdown_connections 2024-09-17T02:54:51.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:51.915+0000 7f767ce70640 1 -- 172.21.15.104:0/945155349 wait complete. 2024-09-17T02:54:51.926 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T02:54:51.927 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:52.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.040+0000 7f423c084640 1 -- 172.21.15.104:0/1143752453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f421c003a00 msgr2=0x7f421c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.040+0000 7f423c084640 1 --2- 172.21.15.104:0/1143752453 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f421c003a00 0x7f421c003e70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4224009ef0 tx=0x7f421c005830 comp rx=0 tx=0).stop 2024-09-17T02:54:52.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.040+0000 7f423a621640 1 -- 172.21.15.104:0/1143752453 reap_dead start 2024-09-17T02:54:52.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.040+0000 7f423c084640 1 -- 172.21.15.104:0/1143752453 shutdown_connections 2024-09-17T02:54:52.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.040+0000 7f423c084640 1 -- 172.21.15.104:0/1143752453 >> 172.21.15.104:0/1143752453 conn(0x7f42340d28a0 msgr2=0x7f42340d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.040+0000 7f423c084640 1 -- 172.21.15.104:0/1143752453 shutdown_connections 2024-09-17T02:54:52.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.040+0000 7f423c084640 1 -- 172.21.15.104:0/1143752453 wait complete. 2024-09-17T02:54:52.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.042+0000 7f423c084640 1 Processor -- start 2024-09-17T02:54:52.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.042+0000 7f423c084640 1 -- start start 2024-09-17T02:54:52.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.043+0000 7f423c084640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f421c003a00 0x7f42341d3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.043+0000 7f423c084640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42341d3f40 0x7f42340cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423c084640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42340cbae0 0x7f423409e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423c084640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f42340cfd10 con 0x7f42340cbae0 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423c084640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f42340cfb90 con 0x7f42341d3f40 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423c084640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f42340cde90 con 0x7f421c003a00 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42340cbae0 0x7f423409e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42340cbae0 0x7f423409e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52304/0 (socket says 172.21.15.104:52304) 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 -- 172.21.15.104:0/2634517201 learned_addr learned my addr 172.21.15.104:0/2634517201 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423961f640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42341d3f40 0x7f42340cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f4239e20640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f421c003a00 0x7f42341d3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 -- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f421c003a00 msgr2=0x7f42341d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f421c003a00 0x7f42341d3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 -- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42341d3f40 msgr2=0x7f42340cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42341d3f40 0x7f42340cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 -- 172.21.15.104:0/2634517201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42341d16c0 con 0x7f42340cbae0 2024-09-17T02:54:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423a621640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42340cbae0 0x7f423409e700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42340b3e70 tx=0x7f422c011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f42327fc640 1 -- 172.21.15.104:0/2634517201 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c004240 con 0x7f42340cbae0 2024-09-17T02:54:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f42327fc640 1 -- 172.21.15.104:0/2634517201 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f422c016070 con 0x7f42340cbae0 2024-09-17T02:54:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42341d4760 con 0x7f42340cbae0 2024-09-17T02:54:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f42327fc640 1 -- 172.21.15.104:0/2634517201 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c00fa90 con 0x7f42340cbae0 2024-09-17T02:54:52.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.044+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423409df00 con 0x7f42340cbae0 2024-09-17T02:54:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.045+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42341d44d0 con 0x7f42340cbae0 2024-09-17T02:54:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.046+0000 7f42327fc640 1 -- 172.21.15.104:0/2634517201 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f422c00fc30 con 0x7f42340cbae0 2024-09-17T02:54:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.047+0000 7f42327fc640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4220078bc0 0x7f422007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.047+0000 7f42327fc640 1 -- 172.21.15.104:0/2634517201 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f422c09b580 con 0x7f42340cbae0 2024-09-17T02:54:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.047+0000 7f4239e20640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4220078bc0 0x7f422007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.047+0000 7f4239e20640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4220078bc0 0x7f422007b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4224035000 tx=0x7f4224004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.052+0000 7f42327fc640 1 -- 172.21.15.104:0/2634517201 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42341d16c0 con 0x7f42340cbae0 2024-09-17T02:54:52.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.231+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42340ce420 con 0x7f42340cbae0 2024-09-17T02:54:52.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.232+0000 7f42327fc640 1 -- 172.21.15.104:0/2634517201 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f422c063370 con 0x7f42340cbae0 2024-09-17T02:54:52.232 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:52.232 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:43.133211+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4220078bc0 msgr2=0x7f422007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4220078bc0 0x7f422007b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4224035000 tx=0x7f4224004a40 comp rx=0 tx=0).stop 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42340cbae0 msgr2=0x7f423409e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42340cbae0 0x7f423409e700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f42340b3e70 tx=0x7f422c011b30 comp rx=0 tx=0).stop 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 shutdown_connections 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4220078bc0 0x7f422007b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42341d3f40 0x7f42340cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42340cbae0 0x7f423409e700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 --2- 172.21.15.104:0/2634517201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f421c003a00 0x7f42341d3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 >> 172.21.15.104:0/2634517201 conn(0x7f42340d28a0 msgr2=0x7f42341e4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 shutdown_connections 2024-09-17T02:54:52.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.234+0000 7f423c084640 1 -- 172.21.15.104:0/2634517201 wait complete. 2024-09-17T02:54:52.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T02:54:52.246 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T02:54:52.246 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T02:54:52.246 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T02:54:52.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T02:54:52.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T02:54:52.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T02:54:52.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T02:54:52.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.464+0000 7f151cc57640 1 -- 172.21.15.104:0/424804188 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510032b70 con 0x7f15180d0b30 2024-09-17T02:54:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.465+0000 7f151febd640 1 -- 172.21.15.104:0/424804188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15180d0b30 msgr2=0x7f151815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.465+0000 7f151febd640 1 --2- 172.21.15.104:0/424804188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15180d0b30 0x7f151815f3b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1510005fd0 tx=0x7f151002a800 comp rx=0 tx=0).stop 2024-09-17T02:54:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.465+0000 7f151febd640 1 -- 172.21.15.104:0/424804188 shutdown_connections 2024-09-17T02:54:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.465+0000 7f151febd640 1 --2- 172.21.15.104:0/424804188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15180d0b30 0x7f151815f3b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.465+0000 7f151febd640 1 --2- 172.21.15.104:0/424804188 >> v2:172.21.15.104:3300/0 conn(0x7f15181595a0 0x7f15180b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.465+0000 7f151febd640 1 -- 172.21.15.104:0/424804188 >> 172.21.15.104:0/424804188 conn(0x7f1518068d00 msgr2=0x7f1518069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.465+0000 7f151febd640 1 -- 172.21.15.104:0/424804188 shutdown_connections 2024-09-17T02:54:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.465+0000 7f151febd640 1 -- 172.21.15.104:0/424804188 wait complete. 2024-09-17T02:54:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3305940213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbbc0aff30 msgr2=0x7fbbbc151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7fbbbbfff640 1 --2- 172.21.15.104:0/3305940213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbbc0aff30 0x7fbbbc151d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbbac005fd0 tx=0x7fbbac02b270 comp rx=0 tx=0).stop 2024-09-17T02:54:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3305940213 shutdown_connections 2024-09-17T02:54:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7fbbbbfff640 1 --2- 172.21.15.104:0/3305940213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbbc0aff30 0x7fbbbc151d40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3305940213 >> 172.21.15.104:0/3305940213 conn(0x7fbbbc069120 msgr2=0x7fbbbc069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3305940213 shutdown_connections 2024-09-17T02:54:52.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7f524a9cc640 1 -- 172.21.15.104:0/2709101309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52440af980 msgr2=0x7f5244072d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7f524a9cc640 1 --2- 172.21.15.104:0/2709101309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52440af980 0x7f5244072d30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5244072740 tx=0x7f523402a440 comp rx=0 tx=0).stop 2024-09-17T02:54:52.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f8ec8fd2640 1 -- 172.21.15.104:0/3414548741 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0035020 con 0x7f8ebc0e1010 2024-09-17T02:54:52.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.466+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3305940213 wait complete. 2024-09-17T02:54:52.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f524a9cc640 1 -- 172.21.15.104:0/2709101309 shutdown_connections 2024-09-17T02:54:52.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f524a9cc640 1 --2- 172.21.15.104:0/2709101309 >> v2:172.21.15.104:3300/0 conn(0x7f52440cd970 0x7f52440cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f524a9cc640 1 --2- 172.21.15.104:0/2709101309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52440af980 0x7f5244072d30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f524a9cc640 1 -- 172.21.15.104:0/2709101309 >> 172.21.15.104:0/2709101309 conn(0x7f52440d0f90 msgr2=0x7f52440d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f524a9cc640 1 -- 172.21.15.104:0/2709101309 shutdown_connections 2024-09-17T02:54:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f524a9cc640 1 -- 172.21.15.104:0/2709101309 wait complete. 2024-09-17T02:54:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7fe55effd640 1 -- 172.21.15.104:0/950847954 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554031bd0 con 0x7fe558036400 2024-09-17T02:54:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f8ecafd6640 1 -- 172.21.15.104:0/3414548741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ebc0e1010 msgr2=0x7f8ebc0532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f8ecafd6640 1 --2- 172.21.15.104:0/3414548741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ebc0e1010 0x7f8ebc0532b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc050f90 tx=0x7f8ec002a4a0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f8ecafd6640 1 -- 172.21.15.104:0/3414548741 shutdown_connections 2024-09-17T02:54:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f8ecafd6640 1 --2- 172.21.15.104:0/3414548741 >> v2:172.21.15.192:3300/0 conn(0x7f8ebc054ba0 0x7f8ebc0e4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f8ecafd6640 1 --2- 172.21.15.104:0/3414548741 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ebc0537f0 0x7f8ebc054660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f8ecafd6640 1 --2- 172.21.15.104:0/3414548741 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ebc0e1010 0x7f8ebc0532b0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc050f90 tx=0x7f8ec002a4a0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.467+0000 7f8ecafd6640 1 -- 172.21.15.104:0/3414548741 >> 172.21.15.104:0/3414548741 conn(0x7f8ebc01fbe0 msgr2=0x7f8ebc056940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7f69e80f9640 1 -- 172.21.15.104:0/1625646013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 msgr2=0x7f69e01523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7fe566694640 1 -- 172.21.15.104:0/950847954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe558036400 msgr2=0x7fe558036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7fe566694640 1 --2- 172.21.15.104:0/950847954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe558036400 0x7fe558036810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe5580510f0 tx=0x7fe55402a3d0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7f69e80f9640 1 --2- 172.21.15.104:0/1625646013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 0x7f69e01523a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009830 tx=0x7f69dc02b4e0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7fe566694640 1 -- 172.21.15.104:0/950847954 shutdown_connections 2024-09-17T02:54:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7fe566694640 1 --2- 172.21.15.104:0/950847954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe558036400 0x7fe558036810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7fe566694640 1 --2- 172.21.15.104:0/950847954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe558009ba0 0x7fe558005c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7fe566694640 1 -- 172.21.15.104:0/950847954 >> 172.21.15.104:0/950847954 conn(0x7fe558051420 msgr2=0x7fe558051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7f151febd640 1 Processor -- start 2024-09-17T02:54:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7f151febd640 1 -- start start 2024-09-17T02:54:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7f8ecafd6640 1 -- 172.21.15.104:0/3414548741 shutdown_connections 2024-09-17T02:54:52.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.468+0000 7f8ecafd6640 1 -- 172.21.15.104:0/3414548741 wait complete. 2024-09-17T02:54:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7fe566694640 1 -- 172.21.15.104:0/950847954 shutdown_connections 2024-09-17T02:54:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7f69e80f9640 1 -- 172.21.15.104:0/1625646013 shutdown_connections 2024-09-17T02:54:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7f69e80f9640 1 --2- 172.21.15.104:0/1625646013 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 0x7f69e01523a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7f69e80f9640 1 -- 172.21.15.104:0/1625646013 >> 172.21.15.104:0/1625646013 conn(0x7f69e00b3440 msgr2=0x7f69e006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7ff04e652640 1 -- 172.21.15.104:0/1180068428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048151d40 msgr2=0x7ff04806f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7ff04e652640 1 --2- 172.21.15.104:0/1180068428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048151d40 0x7ff04806f7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff03800b0a0 tx=0x7ff03802a860 comp rx=0 tx=0).stop 2024-09-17T02:54:52.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7ff04e652640 1 -- 172.21.15.104:0/1180068428 shutdown_connections 2024-09-17T02:54:52.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7ff04e652640 1 --2- 172.21.15.104:0/1180068428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048151d40 0x7ff04806f7c0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff03800b0a0 tx=0x7ff03802a860 comp rx=0 tx=0).stop 2024-09-17T02:54:52.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7ff04e652640 1 --2- 172.21.15.104:0/1180068428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04815b300 0x7ff048072d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7ff04e652640 1 -- 172.21.15.104:0/1180068428 >> 172.21.15.104:0/1180068428 conn(0x7ff048069120 msgr2=0x7ff048069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7f69e80f9640 1 -- 172.21.15.104:0/1625646013 shutdown_connections 2024-09-17T02:54:52.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7f69e80f9640 1 -- 172.21.15.104:0/1625646013 wait complete. 2024-09-17T02:54:52.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.470+0000 7f4a8d712640 1 -- 172.21.15.104:0/2509960330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a70005150 msgr2=0x7f4a7000dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.470+0000 7f4a8d712640 1 --2- 172.21.15.104:0/2509960330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a70005150 0x7f4a7000dbd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4a8806c420 tx=0x7f4a70005830 comp rx=0 tx=0).stop 2024-09-17T02:54:52.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.470+0000 7f4a8d712640 1 -- 172.21.15.104:0/2509960330 shutdown_connections 2024-09-17T02:54:52.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.470+0000 7f4a8d712640 1 --2- 172.21.15.104:0/2509960330 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a70005150 0x7f4a7000dbd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.470+0000 7f4a8d712640 1 -- 172.21.15.104:0/2509960330 >> 172.21.15.104:0/2509960330 conn(0x7f4a80051420 msgr2=0x7f4a80051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7fe566694640 1 -- 172.21.15.104:0/950847954 wait complete. 2024-09-17T02:54:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.470+0000 7f151febd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1518073f30 0x7f151814c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7fbbbbfff640 1 Processor -- start 2024-09-17T02:54:52.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.469+0000 7fbbbbfff640 1 -- start start 2024-09-17T02:54:52.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f8ecafd6640 1 Processor -- start 2024-09-17T02:54:52.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f4a8d712640 1 -- 172.21.15.104:0/2509960330 shutdown_connections 2024-09-17T02:54:52.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f8ecafd6640 1 -- start start 2024-09-17T02:54:52.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151dc59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1518073f30 0x7f151814c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151dc59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1518073f30 0x7f151814c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52398/0 (socket says 172.21.15.104:52398) 2024-09-17T02:54:52.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151dc59640 1 -- 172.21.15.104:0/3838597497 learned_addr learned my addr 172.21.15.104:0/3838597497 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151febd640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15181595a0 0x7f151814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151febd640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15181581d0 0x7f15181585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151febd640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f151815fc80 con 0x7f1518073f30 2024-09-17T02:54:52.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151febd640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f151815fb00 con 0x7f15181595a0 2024-09-17T02:54:52.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f4a8d712640 1 -- 172.21.15.104:0/2509960330 wait complete. 2024-09-17T02:54:52.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151febd640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f151815fe00 con 0x7f15181581d0 2024-09-17T02:54:52.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.470+0000 7f524a9cc640 1 Processor -- start 2024-09-17T02:54:52.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.470+0000 7f524a9cc640 1 -- start start 2024-09-17T02:54:52.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151d458640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15181595a0 0x7f151814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7f151e45a640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15181581d0 0x7f15181585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.471+0000 7fe566694640 1 Processor -- start 2024-09-17T02:54:52.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7ff04e652640 1 -- 172.21.15.104:0/1180068428 shutdown_connections 2024-09-17T02:54:52.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f151e45a640 1 -- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15181595a0 msgr2=0x7f151814f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f151e45a640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15181595a0 0x7f151814f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f151e45a640 1 -- 172.21.15.104:0/3838597497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1518073f30 msgr2=0x7f151814c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f151e45a640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1518073f30 0x7f151814c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f151e45a640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1518158b20 con 0x7f15181581d0 2024-09-17T02:54:52.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f69e80f9640 1 Processor -- start 2024-09-17T02:54:52.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7fe566694640 1 -- start start 2024-09-17T02:54:52.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f69e80f9640 1 -- start start 2024-09-17T02:54:52.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f151d458640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15181595a0 0x7f151814f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:52.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f151dc59640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1518073f30 0x7f151814c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:52.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f8ecafd6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ebc0537f0 0x7f8ebc0e4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f8ecafd6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ebc054ba0 0x7f8ebc1824b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f524a9cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52440af980 0x7f5244206110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f524a9cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52440cd970 0x7f5244203530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f524a9cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f524415f050 0x7f52441548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f524a9cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f52440cf6a0 con 0x7f52440af980 2024-09-17T02:54:52.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f524a9cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f52440cf520 con 0x7f524415f050 2024-09-17T02:54:52.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f524a9cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f52440cf820 con 0x7f52440cd970 2024-09-17T02:54:52.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f8ecafd6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ebc17f8d0 0x7f8ebc036db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ecafd6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc0e5240 con 0x7f8ebc17f8d0 2024-09-17T02:54:52.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ecafd6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc0e50c0 con 0x7f8ebc054ba0 2024-09-17T02:54:52.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ecafd6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8ebc0e53c0 con 0x7f8ebc0537f0 2024-09-17T02:54:52.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec9fd4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ebc0537f0 0x7f8ebc0e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7fbbbbfff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbbc072d80 0x7fbbbc1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7fbbbbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbbc15b300 0x7fbbbc1fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7fbbbbfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbbc1499e0 0x7fbbbc149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7fbbbbfff640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc0b3cf0 con 0x7fbbbc15b300 2024-09-17T02:54:52.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7f151e45a640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15181581d0 0x7f15181585e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15180b5510 tx=0x7f1510033e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510042020 con 0x7f15181581d0 2024-09-17T02:54:52.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1510038040 con 0x7f15181581d0 2024-09-17T02:54:52.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510037070 con 0x7f15181581d0 2024-09-17T02:54:52.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f151febd640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15180cccf0 con 0x7f15181581d0 2024-09-17T02:54:52.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f5248f69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f524415f050 0x7f52441548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f5248f69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f524415f050 0x7f52441548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35268/0 (socket says 172.21.15.104:35268) 2024-09-17T02:54:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f5248f69640 1 -- 172.21.15.104:0/7480779 learned_addr learned my addr 172.21.15.104:0/7480779 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f52437fe640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52440cd970 0x7f5244203530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7fbbbbfff640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc0707f0 con 0x7fbbbc1499e0 2024-09-17T02:54:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7fbbbbfff640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbbbc0b3e70 con 0x7fbbbc072d80 2024-09-17T02:54:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7fbbba7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbbc15b300 0x7fbbbc1fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7fbbbaffd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbbc072d80 0x7fbbbc1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7fbbbaffd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbbc072d80 0x7fbbbc1486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:43378/0 (socket says 172.21.15.104:43378) 2024-09-17T02:54:52.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7fbbbaffd640 1 -- 172.21.15.104:0/3151006941 learned_addr learned my addr 172.21.15.104:0/3151006941 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec9fd4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ebc0537f0 0x7f8ebc0e4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:43386/0 (socket says 172.21.15.104:43386) 2024-09-17T02:54:52.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec9fd4640 1 -- 172.21.15.104:0/2705550725 learned_addr learned my addr 172.21.15.104:0/2705550725 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec97d3640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ebc054ba0 0x7f8ebc1824b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.472+0000 7ff04e652640 1 -- 172.21.15.104:0/1180068428 wait complete. 2024-09-17T02:54:52.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f151febd640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15180cd2b0 con 0x7f15181581d0 2024-09-17T02:54:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f5248f69640 1 -- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52440cd970 msgr2=0x7f5244203530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f5248f69640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52440cd970 0x7f5244203530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f5248f69640 1 -- 172.21.15.104:0/7480779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52440af980 msgr2=0x7f5244206110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f5248f69640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52440af980 0x7f5244206110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f5248f69640 1 -- 172.21.15.104:0/7480779 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5244206af0 con 0x7f524415f050 2024-09-17T02:54:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8eca7d5640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ebc17f8d0 0x7f8ebc036db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec9fd4640 1 -- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ebc054ba0 msgr2=0x7f8ebc1824b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec9fd4640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ebc054ba0 0x7f8ebc1824b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec9fd4640 1 -- 172.21.15.104:0/2705550725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ebc17f8d0 msgr2=0x7f8ebc036db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec9fd4640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ebc17f8d0 0x7f8ebc036db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8ec9fd4640 1 -- 172.21.15.104:0/2705550725 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc182e90 con 0x7f8ebc0537f0 2024-09-17T02:54:52.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.473+0000 7f8eca7d5640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ebc17f8d0 0x7f8ebc036db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:52.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f8ec9fd4640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ebc0537f0 0x7f8ebc0e4180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0000c00 tx=0x7f8ec0004b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f5248f69640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f524415f050 0x7f52441548e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f523c00e960 tx=0x7f523c00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f4a8d712640 1 Processor -- start 2024-09-17T02:54:52.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f4a8d712640 1 -- start start 2024-09-17T02:54:52.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0035020 con 0x7f8ebc0537f0 2024-09-17T02:54:52.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ec0042070 con 0x7f8ebc0537f0 2024-09-17T02:54:52.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0003850 con 0x7f8ebc0537f0 2024-09-17T02:54:52.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc183170 con 0x7f8ebc0537f0 2024-09-17T02:54:52.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc17f3b0 con 0x7f8ebc0537f0 2024-09-17T02:54:52.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7fe566694640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe558009ba0 0x7fe558186600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7fe566694640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe55800bc30 0x7fe55818a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.474+0000 7fe566694640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe558036400 0x7fe55818aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe566694640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe558006b30 con 0x7fe558009ba0 2024-09-17T02:54:52.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe566694640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580069b0 con 0x7fe558036400 2024-09-17T02:54:52.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe566694640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe558006cb0 con 0x7fe55800bc30 2024-09-17T02:54:52.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f69e80f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69e006f3e0 0x7f69e0158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe564c31640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe558036400 0x7fe55818aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe564c31640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe558036400 0x7fe55818aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35294/0 (socket says 172.21.15.104:35294) 2024-09-17T02:54:52.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe564c31640 1 -- 172.21.15.104:0/2281021966 learned_addr learned my addr 172.21.15.104:0/2281021966 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe55ffff640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe558009ba0 0x7fe558186600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7ff04e652640 1 Processor -- start 2024-09-17T02:54:52.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f69e80f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 0x7f69e00701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe564c31640 1 -- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe55800bc30 msgr2=0x7fe55818a500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T02:54:52.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe564c31640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe55800bc30 0x7fe55818a500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe564c31640 1 -- 172.21.15.104:0/2281021966 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe558009ba0 msgr2=0x7fe558186600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe564c31640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe558009ba0 0x7fe558186600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe564c31640 1 -- 172.21.15.104:0/2281021966 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55818b2c0 con 0x7fe558036400 2024-09-17T02:54:52.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fe55ffff640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe558009ba0 0x7fe558186600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:52.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7ff04e652640 1 -- start start 2024-09-17T02:54:52.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f151febd640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1500001030 con 0x7f15181581d0 2024-09-17T02:54:52.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c004d20 con 0x7f524415f050 2024-09-17T02:54:52.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f523c00cb20 con 0x7f524415f050 2024-09-17T02:54:52.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c005020 con 0x7f524415f050 2024-09-17T02:54:52.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f524a9cc640 1 -- 172.21.15.104:0/7480779 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5244206dd0 con 0x7f524415f050 2024-09-17T02:54:52.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f524a9cc640 1 -- 172.21.15.104:0/7480779 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5244203010 con 0x7f524415f050 2024-09-17T02:54:52.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f69e5e95640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69e006f3e0 0x7f69e0158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ebc1833b0 con 0x7f8ebc0537f0 2024-09-17T02:54:52.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7fe564c31640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe558036400 0x7fe55818aa40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe554009860 tx=0x7fe5540305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f69e5e95640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69e006f3e0 0x7f69e0158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35308/0 (socket says 172.21.15.104:35308) 2024-09-17T02:54:52.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7f69e5694640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 0x7f69e00701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f69e5694640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 0x7f69e00701c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52458/0 (socket says 172.21.15.104:52458) 2024-09-17T02:54:52.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f69e5e95640 1 -- 172.21.15.104:0/4019838036 learned_addr learned my addr 172.21.15.104:0/4019838036 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f69e80f9640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69e015eeb0 0x7f69e01e5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554004220 con 0x7fe558036400 2024-09-17T02:54:52.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f69e0072d50 con 0x7f69e015c4b0 2024-09-17T02:54:52.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5540043c0 con 0x7fe558036400 2024-09-17T02:54:52.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55803ed90 con 0x7fe558036400 2024-09-17T02:54:52.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f69e0076c60 con 0x7f69e006f3e0 2024-09-17T02:54:52.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f69e6696640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69e015eeb0 0x7f69e01e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f69e0072ed0 con 0x7f69e015eeb0 2024-09-17T02:54:52.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f4a8d712640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70005150 0x7f4a80175c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7f4a8d712640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a800316e0 0x7f4a801786c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.476+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55803f350 con 0x7fe558036400 2024-09-17T02:54:52.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554030c30 con 0x7fe558036400 2024-09-17T02:54:52.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a8d712640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a8001f460 0x7f4a8001f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a867fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a800316e0 0x7f4a801786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a867fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a800316e0 0x7f4a801786c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52468/0 (socket says 172.21.15.104:52468) 2024-09-17T02:54:52.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a8001f460 0x7f4a8001f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a877fe640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a8001f460 0x7f4a8001f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:43416/0 (socket says 172.21.15.104:43416) 2024-09-17T02:54:52.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a877fe640 1 -- 172.21.15.104:0/1244651378 learned_addr learned my addr 172.21.15.104:0/1244651378 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a8d712640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8000bdb0 con 0x7f4a800316e0 2024-09-17T02:54:52.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a8d712640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8000bc30 con 0x7f4a70005150 2024-09-17T02:54:52.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f69e6696640 1 -- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69e006f3e0 msgr2=0x7f69e0158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f69e6696640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69e006f3e0 0x7f69e0158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f69e6696640 1 -- 172.21.15.104:0/4019838036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 msgr2=0x7f69e00701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f4a8d712640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4a800df180 con 0x7f4a8001f460 2024-09-17T02:54:52.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1510045020 con 0x7f15181581d0 2024-09-17T02:54:52.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f150e7fc640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14fc078c60 0x7f14fc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f69e6696640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 0x7f69e00701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.477+0000 7f69e6696640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e01f5ce0 con 0x7f69e015eeb0 2024-09-17T02:54:52.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f69e5694640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f69e015c4b0 0x7f69e00701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:52.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f69e5e95640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69e006f3e0 0x7f69e0158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:52.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f15100bb930 con 0x7f15181581d0 2024-09-17T02:54:52.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7ff04e652640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0480af820 0x7ff04813f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7ff04e652640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04815b300 0x7ff048154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f524a9cc640 1 -- 172.21.15.104:0/7480779 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5224001030 con 0x7f524415f050 2024-09-17T02:54:52.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f523c0051c0 con 0x7f524415f050 2024-09-17T02:54:52.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f151dc59640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14fc078c60 0x7f14fc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f69e6696640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69e015eeb0 0x7f69e01e5760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c730 tx=0x7f69d800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f150e7fc640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f14fc080ed0 0x7f14fc083320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f4a86ffd640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70005150 0x7f4a80175c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f4a877fe640 1 -- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70005150 msgr2=0x7f4a80175c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ec00039f0 con 0x7f8ebc0537f0 2024-09-17T02:54:52.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7ff04e652640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048152980 0x7ff048152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f4a877fe640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70005150 0x7f4a80175c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7ff04ce4f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04815b300 0x7ff048154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f4a877fe640 1 -- 172.21.15.104:0/1244651378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a800316e0 msgr2=0x7f4a801786c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f4a877fe640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a800316e0 0x7f4a801786c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f4a877fe640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a800de770 con 0x7f4a8001f460 2024-09-17T02:54:52.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7f4a867fc640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4a800316e0 0x7f4a801786c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:52.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7ff04ce4f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04815b300 0x7ff048154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:43428/0 (socket says 172.21.15.104:43428) 2024-09-17T02:54:52.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7ff04de51640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048152980 0x7ff048152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7ff04de51640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048152980 0x7ff048152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35318/0 (socket says 172.21.15.104:35318) 2024-09-17T02:54:52.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7ff04ce4f640 1 -- 172.21.15.104:0/2518250698 learned_addr learned my addr 172.21.15.104:0/2518250698 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f151d458640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f14fc080ed0 0x7f14fc083320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff048070770 con 0x7ff0480af820 2024-09-17T02:54:52.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f4a877fe640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a8001f460 0x7f4a8001f870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a8806c420 tx=0x7f4a880afae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff04806fe90 con 0x7ff048152980 2024-09-17T02:54:52.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff0480b3cf0 con 0x7ff04815b300 2024-09-17T02:54:52.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a880b4050 con 0x7f4a8001f460 2024-09-17T02:54:52.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe540001030 con 0x7fe558036400 2024-09-17T02:54:52.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f8eba7fc640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea8078c60 0x7f8ea807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fbbba7fc640 1 -- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbbc072d80 msgr2=0x7fbbbc1486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fbbba7fc640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbbc072d80 0x7fbbbc1486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fbbba7fc640 1 -- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbbc1499e0 msgr2=0x7fbbbc149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f151d458640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f14fc080ed0 0x7f14fc083320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fbbba7fc640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbbc1499e0 0x7fbbbc149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fbbba7fc640 1 -- 172.21.15.104:0/3151006941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbbc1faa70 con 0x7fbbbc15b300 2024-09-17T02:54:52.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.475+0000 7fbbba7fc640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbbc15b300 0x7fbbbc1fa530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400bd20 tx=0x7fbbb400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4019070 con 0x7fbbbc15b300 2024-09-17T02:54:52.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbb4014440 con 0x7fbbbc15b300 2024-09-17T02:54:52.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.478+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4014910 con 0x7fbbbc15b300 2024-09-17T02:54:52.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f5240ff9640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5230078c60 0x7f523007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f523c09b570 con 0x7f524415f050 2024-09-17T02:54:52.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f5240ff9640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f5230080e50 0x7f52300832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 --> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f523c01ce50 con 0x7f5230080e50 2024-09-17T02:54:52.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f523c0a2050 con 0x7f524415f050 2024-09-17T02:54:52.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ec00bbea0 con 0x7f8ebc0537f0 2024-09-17T02:54:52.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f8eba7fc640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f8ea8080f30 0x7f8ea8083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7ff04d650640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0480af820 0x7ff04813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 --> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ec0047e50 con 0x7f8ea8080f30 2024-09-17T02:54:52.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8003da0 con 0x7f69e015eeb0 2024-09-17T02:54:52.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8ec00be500 con 0x7f8ebc0537f0 2024-09-17T02:54:52.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14fc0839f0 con 0x7f14fc080ed0 2024-09-17T02:54:52.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f15100c02a0 con 0x7f15181581d0 2024-09-17T02:54:52.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7f151dc59640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14fc078c60 0x7f14fc07b170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f151400bfd0 tx=0x7f151400b410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 <== osd.0 v2:172.21.15.104:6800/717221549 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f14fc0839f0 con 0x7f14fc080ed0 2024-09-17T02:54:52.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbbc14bca0 con 0x7fbbbc15b300 2024-09-17T02:54:52.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbbc147bd0 con 0x7fbbbc15b300 2024-09-17T02:54:52.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69d800ce40 con 0x7f69e015eeb0 2024-09-17T02:54:52.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d80052d0 con 0x7f69e015eeb0 2024-09-17T02:54:52.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e01f5440 con 0x7f69e015eeb0 2024-09-17T02:54:52.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.481+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e01f5a00 con 0x7f69e015eeb0 2024-09-17T02:54:52.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5540035f0 con 0x7fe558036400 2024-09-17T02:54:52.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7fe55cff9640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe544078c60 0x7fe54407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe5540bbfa0 con 0x7fe558036400 2024-09-17T02:54:52.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a880b5040 con 0x7f4a8001f460 2024-09-17T02:54:52.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8806ae90 con 0x7f4a8001f460 2024-09-17T02:54:52.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f4a8d712640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a80179230 con 0x7f4a8001f460 2024-09-17T02:54:52.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.479+0000 7f4a8d712640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a80175420 con 0x7f4a8001f460 2024-09-17T02:54:52.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.481+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbbbc151d40 con 0x7fbbbc15b300 2024-09-17T02:54:52.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7f8ec97d3640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea8078c60 0x7f8ea807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7f8eca7d5640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f8ea8080f30 0x7f8ea8083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7ff04de51640 1 -- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04815b300 msgr2=0x7ff048154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7ff04de51640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff04815b300 0x7ff048154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7ff04de51640 1 -- 172.21.15.104:0/2518250698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0480af820 msgr2=0x7ff04813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7ff04de51640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0480af820 0x7ff04813f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7ff04de51640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0481532d0 con 0x7ff048152980 2024-09-17T02:54:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7ff04de51640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048152980 0x7ff048152d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff04000ca70 tx=0x7ff04000cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.481+0000 7fe55cff9640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7fe544080f30 0x7fe544083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.481+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 --> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe554041ec0 con 0x7fe544080f30 2024-09-17T02:54:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.481+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe5540be600 con 0x7fe558036400 2024-09-17T02:54:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.481+0000 7fe55ffff640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe544078c60 0x7fe54407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.481+0000 7fe55f7fe640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7fe544080f30 0x7fe544083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7f5243fff640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5230078c60 0x7f523007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.480+0000 7f52437fe640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f5230080e50 0x7f52300832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.481+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a80036430 con 0x7f4a8001f460 2024-09-17T02:54:52.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7fe55f7fe640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7fe544080f30 0x7fe544083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a880c0060 con 0x7f4a8001f460 2024-09-17T02:54:52.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69c8001030 con 0x7f69e015eeb0 2024-09-17T02:54:52.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7f5243fff640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5230078c60 0x7f523007b170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5234034000 tx=0x7f52340046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff040016020 con 0x7ff048152980 2024-09-17T02:54:52.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff04000ac00 con 0x7ff048152980 2024-09-17T02:54:52.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7fe55ffff640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe544078c60 0x7fe54407b170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0016a0 tx=0x7fe54c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff048140b10 con 0x7ff048152980 2024-09-17T02:54:52.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7f52437fe640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f5230080e50 0x7f52300832a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7f8ec97d3640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea8078c60 0x7f8ea807b170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc049b90 tx=0x7f8eb4005ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.483+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 <== osd.6 v2:172.21.15.192:6809/3422114417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fe554041ec0 con 0x7fe544080f30 2024-09-17T02:54:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.482+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0481410d0 con 0x7ff048152980 2024-09-17T02:54:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.483+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff040012420 con 0x7ff048152980 2024-09-17T02:54:52.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.483+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbbb401c070 con 0x7fbbbc15b300 2024-09-17T02:54:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.483+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69d8005470 con 0x7f69e015eeb0 2024-09-17T02:54:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.483+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 <== osd.1 v2:172.21.15.104:6808/1763440481 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f523c01ce50 con 0x7f5230080e50 2024-09-17T02:54:52.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.483+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff04806f7c0 con 0x7ff048152980 2024-09-17T02:54:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.483+0000 7f4a6f7fe640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4a74078b90 0x7f4a7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.483+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a88136760 con 0x7f4a8001f460 2024-09-17T02:54:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f4a6f7fe640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f4a74080de0 0x7f4a74083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a88064660 con 0x7f4a74080de0 2024-09-17T02:54:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4a8813d050 con 0x7f4a8001f460 2024-09-17T02:54:52.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f69d67fc640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f69c4078c60 0x7f69c407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7fbba37fe640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbba8078c60 0x7fbba807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbbb409ab00 con 0x7fbbbc15b300 2024-09-17T02:54:52.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7fbbbaffd640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbba8078c60 0x7fbba807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7fbba37fe640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7fbba8080ed0 0x7fbba8083320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 --> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbb4012e50 con 0x7fbba8080ed0 2024-09-17T02:54:52.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbbb409f2a0 con 0x7fbbbc15b300 2024-09-17T02:54:52.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f69d809aa30 con 0x7f69e015eeb0 2024-09-17T02:54:52.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f69e5e95640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f69c4078c60 0x7f69c407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f4a86ffd640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4a74078b90 0x7f4a7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f69d67fc640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7f69c4080f30 0x7f69c4083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.484+0000 7f4a867fc640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f4a74080de0 0x7f4a74083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69d801de70 con 0x7f69c4080f30 2024-09-17T02:54:52.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7fbbbaffd640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbba8078c60 0x7fbba807b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0000f60 tx=0x7fbbb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7fbbbb7fe640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7fbba8080ed0 0x7fbba8083320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f69d809f2a0 con 0x7f69e015eeb0 2024-09-17T02:54:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7f69e5694640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7f69c4080f30 0x7f69c4083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7f8eca7d5640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f8ea8080f30 0x7f8ea8083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7f69e5e95640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f69c4078c60 0x7f69c407b170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f69dc005eb0 tx=0x7f69dc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7f69e5694640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7f69c4080f30 0x7f69c4083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7f4a86ffd640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4a74078b90 0x7f4a7407b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006610 tx=0x7f4a78006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.485+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff040019020 con 0x7ff048152980 2024-09-17T02:54:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.486+0000 7fbbbb7fe640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7fbba8080ed0 0x7fbba8083320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.486+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 <== osd.4 v2:172.21.15.192:6818/3240881174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f8ec0047e50 con 0x7f8ea8080f30 2024-09-17T02:54:52.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.486+0000 7ff03dffb640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff02c07add0 0x7ff02c07d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.486+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff04009ad20 con 0x7ff048152980 2024-09-17T02:54:52.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.486+0000 7ff04d650640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff02c07add0 0x7ff02c07d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.486+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 <== osd.2 v2:172.21.15.104:6824/100151575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fbbb4012e50 con 0x7fbba8080ed0 2024-09-17T02:54:52.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.487+0000 7ff03dffb640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7ff02c0830a0 0x7ff02c0854f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.487+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 <== osd.3 v2:172.21.15.104:6816/1619923136 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f69d801de70 con 0x7f69c4080f30 2024-09-17T02:54:52.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.487+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff02c085bc0 con 0x7ff02c0830a0 2024-09-17T02:54:52.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.487+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff04009b110 con 0x7ff048152980 2024-09-17T02:54:52.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.487+0000 7ff04ce4f640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7ff02c0830a0 0x7ff02c0854f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.487+0000 7f4a867fc640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f4a74080de0 0x7f4a74083230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.487+0000 7ff04d650640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff02c07add0 0x7ff02c07d2e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff04400bb50 tx=0x7ff04400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.487+0000 7ff04ce4f640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7ff02c0830a0 0x7ff02c0854f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.488+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 <== osd.7 v2:172.21.15.192:6826/1791040326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f4a88064660 con 0x7f4a74080de0 2024-09-17T02:54:52.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.488+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 <== osd.5 v2:172.21.15.192:6802/3946789085 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7ff02c085bc0 con 0x7ff02c0830a0 2024-09-17T02:54:52.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.505+0000 7f151febd640 1 -- 172.21.15.104:0/3838597497 --> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1500002dd0 con 0x7f14fc080ed0 2024-09-17T02:54:52.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.505+0000 7f150e7fc640 1 -- 172.21.15.104:0/3838597497 <== osd.0 v2:172.21.15.104:6800/717221549 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1500002dd0 con 0x7f14fc080ed0 2024-09-17T02:54:52.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.506+0000 7f14fbfff640 1 -- 172.21.15.104:0/3838597497 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f14fc080ed0 msgr2=0x7f14fc083320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.506+0000 7f14fbfff640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f14fc080ed0 0x7f14fc083320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.506+0000 7f14fbfff640 1 -- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14fc078c60 msgr2=0x7f14fc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.507+0000 7f14fbfff640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14fc078c60 0x7f14fc07b170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f151400bfd0 tx=0x7f151400b410 comp rx=0 tx=0).stop 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.507+0000 7f14fbfff640 1 -- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15181581d0 msgr2=0x7f15181585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.507+0000 7f14fbfff640 1 --2- 172.21.15.104:0/3838597497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15181581d0 0x7f15181585e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15180b5510 tx=0x7f1510033e80 comp rx=0 tx=0).stop 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.507+0000 7f151e45a640 1 -- 172.21.15.104:0/3838597497 reap_dead start 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.507+0000 7f14fbfff640 1 -- 172.21.15.104:0/3838597497 shutdown_connections 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.507+0000 7f14fbfff640 1 -- 172.21.15.104:0/3838597497 >> 172.21.15.104:0/3838597497 conn(0x7f1518068d00 msgr2=0x7f1518160550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.507+0000 7f14fbfff640 1 -- 172.21.15.104:0/3838597497 shutdown_connections 2024-09-17T02:54:52.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.507+0000 7f14fbfff640 1 -- 172.21.15.104:0/3838597497 wait complete. 2024-09-17T02:54:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.510+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 --> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe540002d50 con 0x7fe544080f30 2024-09-17T02:54:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7fe55cff9640 1 -- 172.21.15.104:0/2281021966 <== osd.6 v2:172.21.15.192:6809/3422114417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe540002d50 con 0x7fe544080f30 2024-09-17T02:54:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7f524a9cc640 1 -- 172.21.15.104:0/7480779 --> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5224002dd0 con 0x7f5230080e50 2024-09-17T02:54:52.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 --> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ebc17eec0 con 0x7f8ea8080f30 2024-09-17T02:54:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7fe544080f30 msgr2=0x7fe544083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7fe566694640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7fe544080f30 0x7fe544083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe544078c60 msgr2=0x7fe54407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7fe566694640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe544078c60 0x7fe54407b170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0016a0 tx=0x7fe54c009040 comp rx=0 tx=0).stop 2024-09-17T02:54:52.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7f5240ff9640 1 -- 172.21.15.104:0/7480779 <== osd.1 v2:172.21.15.104:6808/1763440481 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5224002dd0 con 0x7f5230080e50 2024-09-17T02:54:52.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe558036400 msgr2=0x7fe55818aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.511+0000 7fe566694640 1 --2- 172.21.15.104:0/2281021966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe558036400 0x7fe55818aa40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe554009860 tx=0x7fe5540305d0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7fe564c31640 1 -- 172.21.15.104:0/2281021966 reap_dead start 2024-09-17T02:54:52.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7f8eba7fc640 1 -- 172.21.15.104:0/2705550725 <== osd.4 v2:172.21.15.192:6818/3240881174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ebc17eec0 con 0x7f8ea8080f30 2024-09-17T02:54:52.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 shutdown_connections 2024-09-17T02:54:52.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 >> 172.21.15.104:0/2281021966 conn(0x7fe558051420 msgr2=0x7fe558050660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 shutdown_connections 2024-09-17T02:54:52.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7fe566694640 1 -- 172.21.15.104:0/2281021966 wait complete. 2024-09-17T02:54:52.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7f522a7fc640 1 -- 172.21.15.104:0/7480779 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f5230080e50 msgr2=0x7f52300832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7f522a7fc640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f5230080e50 0x7f52300832a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7f522a7fc640 1 -- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5230078c60 msgr2=0x7f523007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f8ea8080f30 msgr2=0x7f8ea8083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.512+0000 7f8ecafd6640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f8ea8080f30 0x7f8ea8083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f522a7fc640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5230078c60 0x7f523007b170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5234034000 tx=0x7f52340046c0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f522a7fc640 1 -- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f524415f050 msgr2=0x7f52441548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f522a7fc640 1 --2- 172.21.15.104:0/7480779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f524415f050 0x7f52441548e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f523c00e960 tx=0x7f523c00ee20 comp rx=0 tx=0).stop 2024-09-17T02:54:52.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f5248f69640 1 -- 172.21.15.104:0/7480779 reap_dead start 2024-09-17T02:54:52.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f522a7fc640 1 -- 172.21.15.104:0/7480779 shutdown_connections 2024-09-17T02:54:52.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f522a7fc640 1 -- 172.21.15.104:0/7480779 >> 172.21.15.104:0/7480779 conn(0x7f52440d0f90 msgr2=0x7f5244073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 --> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbbbc14ba10 con 0x7fbba8080ed0 2024-09-17T02:54:52.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea8078c60 msgr2=0x7f8ea807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f8ecafd6640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea8078c60 0x7f8ea807b170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc049b90 tx=0x7f8eb4005ef0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ebc0537f0 msgr2=0x7f8ebc0e4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f8ecafd6640 1 --2- 172.21.15.104:0/2705550725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ebc0537f0 0x7f8ebc0e4180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0000c00 tx=0x7f8ec0004b10 comp rx=0 tx=0).stop 2024-09-17T02:54:52.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f8eca7d5640 1 -- 172.21.15.104:0/2705550725 reap_dead start 2024-09-17T02:54:52.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 shutdown_connections 2024-09-17T02:54:52.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.513+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 >> 172.21.15.104:0/2705550725 conn(0x7f8ebc01fbe0 msgr2=0x7f8ebc0dbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 shutdown_connections 2024-09-17T02:54:52.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7fbba37fe640 1 -- 172.21.15.104:0/3151006941 <== osd.2 v2:172.21.15.104:6824/100151575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbbbc14ba10 con 0x7fbba8080ed0 2024-09-17T02:54:52.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7f8ecafd6640 1 -- 172.21.15.104:0/2705550725 wait complete. 2024-09-17T02:54:52.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7f522a7fc640 1 -- 172.21.15.104:0/7480779 shutdown_connections 2024-09-17T02:54:52.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7f522a7fc640 1 -- 172.21.15.104:0/7480779 wait complete. 2024-09-17T02:54:52.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 --> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f69c8002dd0 con 0x7f69c4080f30 2024-09-17T02:54:52.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7f69d67fc640 1 -- 172.21.15.104:0/4019838036 <== osd.3 v2:172.21.15.104:6816/1619923136 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f69c8002dd0 con 0x7f69c4080f30 2024-09-17T02:54:52.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7fbba8080ed0 msgr2=0x7fbba8083320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.514+0000 7fbbbbfff640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7fbba8080ed0 0x7fbba8083320 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbba8078c60 msgr2=0x7fbba807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbbfff640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbba8078c60 0x7fbba807b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0000f60 tx=0x7fbbb0009040 comp rx=0 tx=0).stop 2024-09-17T02:54:52.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbbc15b300 msgr2=0x7fbbbc1fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbbfff640 1 --2- 172.21.15.104:0/3151006941 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbbbc15b300 0x7fbbbc1fa530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400bd20 tx=0x7fbbb400be10 comp rx=0 tx=0).stop 2024-09-17T02:54:52.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbb7fe640 1 -- 172.21.15.104:0/3151006941 reap_dead start 2024-09-17T02:54:52.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 shutdown_connections 2024-09-17T02:54:52.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 >> 172.21.15.104:0/3151006941 conn(0x7fbbbc069120 msgr2=0x7fbbbc0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 shutdown_connections 2024-09-17T02:54:52.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7fbbbbfff640 1 -- 172.21.15.104:0/3151006941 wait complete. 2024-09-17T02:54:52.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7f69c4080f30 msgr2=0x7f69c4083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7f69e80f9640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7f69c4080f30 0x7f69c4083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f69c4078c60 msgr2=0x7f69c407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7f69e80f9640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f69c4078c60 0x7f69c407b170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f69dc005eb0 tx=0x7f69dc004730 comp rx=0 tx=0).stop 2024-09-17T02:54:52.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69e015eeb0 msgr2=0x7f69e01e5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.515+0000 7f69e80f9640 1 --2- 172.21.15.104:0/4019838036 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69e015eeb0 0x7f69e01e5760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f69d800c730 tx=0x7f69d800cbf0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.516+0000 7f69e6696640 1 -- 172.21.15.104:0/4019838036 reap_dead start 2024-09-17T02:54:52.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.516+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 shutdown_connections 2024-09-17T02:54:52.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.516+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 >> 172.21.15.104:0/4019838036 conn(0x7f69e00b3440 msgr2=0x7f69e0151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.516+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 --> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a80178fe0 con 0x7f4a74080de0 2024-09-17T02:54:52.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.516+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 shutdown_connections 2024-09-17T02:54:52.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.516+0000 7f69e80f9640 1 -- 172.21.15.104:0/4019838036 wait complete. 2024-09-17T02:54:52.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.516+0000 7f4a6f7fe640 1 -- 172.21.15.104:0/1244651378 <== osd.7 v2:172.21.15.192:6826/1791040326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4a80178fe0 con 0x7f4a74080de0 2024-09-17T02:54:52.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.516+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 --> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff04815aa60 con 0x7ff02c0830a0 2024-09-17T02:54:52.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.517+0000 7ff03dffb640 1 -- 172.21.15.104:0/2518250698 <== osd.5 v2:172.21.15.192:6802/3946789085 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff04815aa60 con 0x7ff02c0830a0 2024-09-17T02:54:52.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.517+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f4a74080de0 msgr2=0x7f4a74083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.517+0000 7f4a6d7fa640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f4a74080de0 0x7f4a74083230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.517+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4a74078b90 msgr2=0x7f4a7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.517+0000 7f4a6d7fa640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4a74078b90 0x7f4a7407b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006610 tx=0x7f4a78006b70 comp rx=0 tx=0).stop 2024-09-17T02:54:52.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.517+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a8001f460 msgr2=0x7f4a8001f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7f4a6d7fa640 1 --2- 172.21.15.104:0/1244651378 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a8001f460 0x7f4a8001f870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a8806c420 tx=0x7f4a880afae0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7f4a877fe640 1 -- 172.21.15.104:0/1244651378 reap_dead start 2024-09-17T02:54:52.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7ff02c0830a0 msgr2=0x7ff02c0854f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04e652640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7ff02c0830a0 0x7ff02c0854f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 shutdown_connections 2024-09-17T02:54:52.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 >> 172.21.15.104:0/1244651378 conn(0x7f4a80051420 msgr2=0x7f4a80038eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff02c07add0 msgr2=0x7ff02c07d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04e652640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff02c07add0 0x7ff02c07d2e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff04400bb50 tx=0x7ff04400b2e0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048152980 msgr2=0x7ff048152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04e652640 1 --2- 172.21.15.104:0/2518250698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff048152980 0x7ff048152d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff04000ca70 tx=0x7ff04000cf30 comp rx=0 tx=0).stop 2024-09-17T02:54:52.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04de51640 1 -- 172.21.15.104:0/2518250698 reap_dead start 2024-09-17T02:54:52.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 shutdown_connections 2024-09-17T02:54:52.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 >> 172.21.15.104:0/2518250698 conn(0x7ff048069120 msgr2=0x7ff0481592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 shutdown_connections 2024-09-17T02:54:52.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.518+0000 7f4a6d7fa640 1 -- 172.21.15.104:0/1244651378 wait complete. 2024-09-17T02:54:52.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.519+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 shutdown_connections 2024-09-17T02:54:52.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.519+0000 7ff04e652640 1 -- 172.21.15.104:0/2518250698 wait complete. 2024-09-17T02:54:52.562 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:52.562 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T02:54:52.563 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-09-17T02:54:52.563 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T02:54:52.564 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:52.565 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T02:54:52.565 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:52.565 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T02:54:52.566 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:52.566 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T02:54:52.567 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:52.567 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T02:54:52.568 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2024-09-17T02:54:52.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T02:54:52.569 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:52.572 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T02:54:52.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.817+0000 7fda77fff640 1 -- 172.21.15.104:0/3879850311 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c00a590 con 0x7fda6c003ad0 2024-09-17T02:54:52.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.818+0000 7fda873c3640 1 -- 172.21.15.104:0/3879850311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda6c003ad0 msgr2=0x7fda6c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.818+0000 7fda873c3640 1 --2- 172.21.15.104:0/3879850311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda6c003ad0 0x7fda6c003f00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00a990 tx=0x7fda6c005830 comp rx=0 tx=0).stop 2024-09-17T02:54:52.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.818+0000 7fda85960640 1 -- 172.21.15.104:0/3879850311 reap_dead start 2024-09-17T02:54:52.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.818+0000 7fda873c3640 1 -- 172.21.15.104:0/3879850311 shutdown_connections 2024-09-17T02:54:52.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.818+0000 7fda873c3640 1 -- 172.21.15.104:0/3879850311 >> 172.21.15.104:0/3879850311 conn(0x7fda800b3640 msgr2=0x7fda800b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.819+0000 7fda873c3640 1 -- 172.21.15.104:0/3879850311 shutdown_connections 2024-09-17T02:54:52.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.819+0000 7fda873c3640 1 -- 172.21.15.104:0/3879850311 wait complete. 2024-09-17T02:54:52.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.819+0000 7feb1e3d6640 1 -- 172.21.15.104:0/1189464042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb100091c0 msgr2=0x7feb100557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.819+0000 7feb1e3d6640 1 --2- 172.21.15.104:0/1189464042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb100091c0 0x7feb100557d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feb14009860 tx=0x7feb1402a5b0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f5262e7c640 1 -- 172.21.15.104:0/906530977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5254009f60 msgr2=0x7f5254005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f5262e7c640 1 --2- 172.21.15.104:0/906530977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5254009f60 0x7f5254005c60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f525c077980 tx=0x7f525c0a6850 comp rx=0 tx=0).stop 2024-09-17T02:54:52.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7feb1e3d6640 1 -- 172.21.15.104:0/1189464042 shutdown_connections 2024-09-17T02:54:52.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7feb1e3d6640 1 --2- 172.21.15.104:0/1189464042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb100091c0 0x7feb100557d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7feb1e3d6640 1 -- 172.21.15.104:0/1189464042 >> 172.21.15.104:0/1189464042 conn(0x7feb1001eae0 msgr2=0x7feb1003a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f5262e7c640 1 -- 172.21.15.104:0/906530977 shutdown_connections 2024-09-17T02:54:52.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7feb1e3d6640 1 -- 172.21.15.104:0/1189464042 shutdown_connections 2024-09-17T02:54:52.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f5262e7c640 1 --2- 172.21.15.104:0/906530977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5254009f60 0x7f5254005c60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f5262e7c640 1 --2- 172.21.15.104:0/906530977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5254036ad0 0x7f52540e0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f5262e7c640 1 -- 172.21.15.104:0/906530977 >> 172.21.15.104:0/906530977 conn(0x7f5254051420 msgr2=0x7f5254051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f5262e7c640 1 -- 172.21.15.104:0/906530977 shutdown_connections 2024-09-17T02:54:52.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f5262e7c640 1 -- 172.21.15.104:0/906530977 wait complete. 2024-09-17T02:54:52.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7feb1e3d6640 1 -- 172.21.15.104:0/1189464042 wait complete. 2024-09-17T02:54:52.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.820+0000 7f99886f9640 1 -- 172.21.15.104:0/3285900310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f998006f300 msgr2=0x7f998006f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7f99886f9640 1 --2- 172.21.15.104:0/3285900310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f998006f300 0x7f998006f710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f99800cd4a0 tx=0x7f997002a4f0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7f99886f9640 1 -- 172.21.15.104:0/3285900310 shutdown_connections 2024-09-17T02:54:52.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7f99886f9640 1 --2- 172.21.15.104:0/3285900310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f998006f300 0x7f998006f710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7f99886f9640 1 --2- 172.21.15.104:0/3285900310 >> v2:172.21.15.104:3300/0 conn(0x7f9980073c00 0x7f9980074010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7f99886f9640 1 -- 172.21.15.104:0/3285900310 >> 172.21.15.104:0/3285900310 conn(0x7f99800693e0 msgr2=0x7f99800b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7fa03a1b0640 1 -- 172.21.15.104:0/881075254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03415b3f0 msgr2=0x7fa0341444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/881075254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03415b3f0 0x7fa0341444a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa01c005fd0 tx=0x7fa01c02a100 comp rx=0 tx=0).stop 2024-09-17T02:54:52.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7fa03a1b0640 1 -- 172.21.15.104:0/881075254 shutdown_connections 2024-09-17T02:54:52.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/881075254 >> v2:172.21.15.104:3300/0 conn(0x7fa03406f590 0x7fa03406f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.821+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/881075254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03415b3f0 0x7fa0341444a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.822+0000 7fa03a1b0640 1 -- 172.21.15.104:0/881075254 >> 172.21.15.104:0/881075254 conn(0x7fa0340b27f0 msgr2=0x7fa0340b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.822+0000 7f99886f9640 1 -- 172.21.15.104:0/3285900310 shutdown_connections 2024-09-17T02:54:52.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.822+0000 7f99886f9640 1 -- 172.21.15.104:0/3285900310 wait complete. 2024-09-17T02:54:52.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.822+0000 7fda873c3640 1 Processor -- start 2024-09-17T02:54:52.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.822+0000 7fa77ed46640 1 -- 172.21.15.104:0/2476214043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa778160680 msgr2=0x7fa778160a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.822+0000 7fa77ed46640 1 --2- 172.21.15.104:0/2476214043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa778160680 0x7fa778160a90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa7780d37e0 tx=0x7fa76802a400 comp rx=0 tx=0).stop 2024-09-17T02:54:52.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.822+0000 7fa03a1b0640 1 -- 172.21.15.104:0/881075254 shutdown_connections 2024-09-17T02:54:52.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7f5262e7c640 1 Processor -- start 2024-09-17T02:54:52.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7f5262e7c640 1 -- start start 2024-09-17T02:54:52.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7fda873c3640 1 -- start start 2024-09-17T02:54:52.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7fa03a1b0640 1 -- 172.21.15.104:0/881075254 wait complete. 2024-09-17T02:54:52.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7feb1e3d6640 1 Processor -- start 2024-09-17T02:54:52.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7fa77ed46640 1 -- 172.21.15.104:0/2476214043 shutdown_connections 2024-09-17T02:54:52.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7fa77ed46640 1 --2- 172.21.15.104:0/2476214043 >> v2:172.21.15.104:3300/0 conn(0x7fa77815d090 0x7fa77815d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7feb1e3d6640 1 -- start start 2024-09-17T02:54:52.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7fa77ed46640 1 --2- 172.21.15.104:0/2476214043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa778160680 0x7fa778160a90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7fa77ed46640 1 --2- 172.21.15.104:0/2476214043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7780cf1e0 0x7fa7780696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.823+0000 7fa77ed46640 1 -- 172.21.15.104:0/2476214043 >> 172.21.15.104:0/2476214043 conn(0x7fa778074520 msgr2=0x7fa778074930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.824+0000 7fa77ed46640 1 -- 172.21.15.104:0/2476214043 shutdown_connections 2024-09-17T02:54:52.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f99886f9640 1 Processor -- start 2024-09-17T02:54:52.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f99886f9640 1 -- start start 2024-09-17T02:54:52.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5262e7c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5254009f60 0x7f52540216e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5262e7c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5254032710 0x7f52540ddc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5262e7c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52540de440 0x7f5254034e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5262e7c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5254006530 con 0x7f5254032710 2024-09-17T02:54:52.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5262e7c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f52540063b0 con 0x7f5254009f60 2024-09-17T02:54:52.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5262e7c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f52540066b0 con 0x7f52540de440 2024-09-17T02:54:52.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fda873c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda80154c20 0x7fda801390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.824+0000 7fa77ed46640 1 -- 172.21.15.104:0/2476214043 wait complete. 2024-09-17T02:54:52.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fda873c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda8014ebf0 0x7fda801f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fda873c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda801f56d0 0x7fda8013b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fe3eb41d640 1 -- 172.21.15.104:0/2815533893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3e40b3e20 msgr2=0x7fe3e4072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/2815533893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3e40b3e20 0x7fe3e4072590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4005fd0 tx=0x7fe3d402a620 comp rx=0 tx=0).stop 2024-09-17T02:54:52.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f6ecd9da640 1 -- 172.21.15.104:0/1927165940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb0004800 msgr2=0x7f6eb0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fe3eb41d640 1 -- 172.21.15.104:0/2815533893 shutdown_connections 2024-09-17T02:54:52.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/2815533893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3e40b3e20 0x7fe3e4072590 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/2815533893 >> v2:172.21.15.104:3300/0 conn(0x7fe3e4070560 0x7fe3e4151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7fe3eb41d640 1 -- 172.21.15.104:0/2815533893 >> 172.21.15.104:0/2815533893 conn(0x7fe3e40b2450 msgr2=0x7fe3e40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5261679640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5254032710 0x7f52540ddc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5261679640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5254032710 0x7f52540ddc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52546/0 (socket says 172.21.15.104:52546) 2024-09-17T02:54:52.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f5261679640 1 -- 172.21.15.104:0/2532549462 learned_addr learned my addr 172.21.15.104:0/2532549462 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fa03a1b0640 1 Processor -- start 2024-09-17T02:54:52.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1e3d6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb100091c0 0x7feb100d3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.825+0000 7f6ecd9da640 1 --2- 172.21.15.104:0/1927165940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb0004800 0x7f6eb0004c10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80ccef0 tx=0x7f6eb0005830 comp rx=0 tx=0).stop 2024-09-17T02:54:52.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1e3d6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb10036770 0x7feb100e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1e3d6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb10055280 0x7feb100d8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1e3d6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb10037050 con 0x7feb10055280 2024-09-17T02:54:52.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1e3d6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb10036ed0 con 0x7feb100091c0 2024-09-17T02:54:52.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1e3d6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feb10055d10 con 0x7feb10036770 2024-09-17T02:54:52.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fa03a1b0640 1 -- start start 2024-09-17T02:54:52.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f6ec77fe640 1 -- 172.21.15.104:0/1927165940 reap_dead start 2024-09-17T02:54:52.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1d3d4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb100091c0 0x7feb100d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1d3d4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb100091c0 0x7feb100d3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35414/0 (socket says 172.21.15.104:35414) 2024-09-17T02:54:52.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1d3d4640 1 -- 172.21.15.104:0/2541774304 learned_addr learned my addr 172.21.15.104:0/2541774304 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1cbd3640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb10036770 0x7feb100e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fda8515f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda80154c20 0x7fda801390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fda8515f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda80154c20 0x7fda801390b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:43508/0 (socket says 172.21.15.104:43508) 2024-09-17T02:54:52.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fda8515f640 1 -- 172.21.15.104:0/2768608045 learned_addr learned my addr 172.21.15.104:0/2768608045 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fda8495e640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda8014ebf0 0x7fda801f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f6ecd9da640 1 -- 172.21.15.104:0/1927165940 shutdown_connections 2024-09-17T02:54:52.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f6ecd9da640 1 -- 172.21.15.104:0/1927165940 >> 172.21.15.104:0/1927165940 conn(0x7f6ec80b4400 msgr2=0x7f6ec80b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:52.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fda800b53a0 con 0x7fda8014ebf0 2024-09-17T02:54:52.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fda800b5220 con 0x7fda801f56d0 2024-09-17T02:54:52.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fda85960640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda801f56d0 0x7fda8013b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fda800b5520 con 0x7fda80154c20 2024-09-17T02:54:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f5261e7a640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5254009f60 0x7f52540216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f526267b640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52540de440 0x7f5254034e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f5261679640 1 -- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52540de440 msgr2=0x7f5254034e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f5261679640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52540de440 0x7f5254034e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f5261679640 1 -- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5254009f60 msgr2=0x7f52540216e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f5261679640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5254009f60 0x7f52540216e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f5261679640 1 -- 172.21.15.104:0/2532549462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5254021f10 con 0x7f5254032710 2024-09-17T02:54:52.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f6ecd9da640 1 -- 172.21.15.104:0/1927165940 shutdown_connections 2024-09-17T02:54:52.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f526267b640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52540de440 0x7f5254034e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:52.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7feb1dbd5640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb10055280 0x7feb100d8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f5261679640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5254032710 0x7f52540ddc90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f524c00b410 tx=0x7f524c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fa77ed46640 1 Processor -- start 2024-09-17T02:54:52.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fa77ed46640 1 -- start start 2024-09-17T02:54:52.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7feb1d3d4640 1 -- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb10036770 msgr2=0x7feb100e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7feb1d3d4640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb10036770 0x7feb100e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7feb1d3d4640 1 -- 172.21.15.104:0/2541774304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb10055280 msgr2=0x7feb100d8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7feb1d3d4640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb10055280 0x7feb100d8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7feb1d3d4640 1 -- 172.21.15.104:0/2541774304 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb100d3880 con 0x7feb100091c0 2024-09-17T02:54:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fda8515f640 1 -- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda801f56d0 msgr2=0x7fda8013b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fda8515f640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda801f56d0 0x7fda8013b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fda8515f640 1 -- 172.21.15.104:0/2768608045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda8014ebf0 msgr2=0x7fda801f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fda8515f640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda8014ebf0 0x7fda801f5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.826+0000 7f6ecd9da640 1 -- 172.21.15.104:0/1927165940 wait complete. 2024-09-17T02:54:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fda8515f640 1 -- 172.21.15.104:0/2768608045 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda801f5ae0 con 0x7fda80154c20 2024-09-17T02:54:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7feb1d3d4640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb100091c0 0x7feb100d3340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feb14009980 tx=0x7feb14033c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fda8495e640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda8014ebf0 0x7fda801f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:52.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fda85960640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda801f56d0 0x7fda8013b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:52.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7f52527fc640 1 -- 172.21.15.104:0/2532549462 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c015020 con 0x7f5254032710 2024-09-17T02:54:52.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7f52527fc640 1 -- 172.21.15.104:0/2532549462 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f524c011920 con 0x7f5254032710 2024-09-17T02:54:52.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7f52527fc640 1 -- 172.21.15.104:0/2532549462 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c011d70 con 0x7f5254032710 2024-09-17T02:54:52.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7f5262e7c640 1 -- 172.21.15.104:0/2532549462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525402b530 con 0x7f5254032710 2024-09-17T02:54:52.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7f5262e7c640 1 -- 172.21.15.104:0/2532549462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525402baf0 con 0x7f5254032710 2024-09-17T02:54:52.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7fda8515f640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda80154c20 0x7fda801390b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda7c034040 tx=0x7fda7c0316a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.827+0000 7feb0dffb640 1 -- 172.21.15.104:0/2541774304 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14031d60 con 0x7feb100091c0 2024-09-17T02:54:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7feb0dffb640 1 -- 172.21.15.104:0/2541774304 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb140330d0 con 0x7feb100091c0 2024-09-17T02:54:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7feb0dffb640 1 -- 172.21.15.104:0/2541774304 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb140334e0 con 0x7feb100091c0 2024-09-17T02:54:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb100e44f0 con 0x7feb100091c0 2024-09-17T02:54:52.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb100e4ab0 con 0x7feb100091c0 2024-09-17T02:54:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7f99886f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f998006f300 0x7f9980155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7f99886f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9980073c00 0x7f9980159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7f99886f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99800b36e0 0x7f9980148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7fa03a1b0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03406f590 0x7fa03414a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7fda75ffb640 1 -- 172.21.15.104:0/2768608045 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c03f030 con 0x7fda80154c20 2024-09-17T02:54:52.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7fda75ffb640 1 -- 172.21.15.104:0/2768608045 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda7c031c50 con 0x7fda80154c20 2024-09-17T02:54:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7fda75ffb640 1 -- 172.21.15.104:0/2768608045 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c035070 con 0x7fda80154c20 2024-09-17T02:54:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7fe3eb41d640 1 -- 172.21.15.104:0/2815533893 shutdown_connections 2024-09-17T02:54:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7f9986c96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99800b36e0 0x7f9980148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.828+0000 7f99886f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f998015caa0 con 0x7f99800b36e0 2024-09-17T02:54:52.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7f99886f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f998015c920 con 0x7f9980073c00 2024-09-17T02:54:52.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7f99886f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f998015cc20 con 0x7f998006f300 2024-09-17T02:54:52.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7f9985c94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9980073c00 0x7f9980159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7f9985c94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9980073c00 0x7f9980159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35424/0 (socket says 172.21.15.104:35424) 2024-09-17T02:54:52.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7f9985c94640 1 -- 172.21.15.104:0/271980998 learned_addr learned my addr 172.21.15.104:0/271980998 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7f9986495640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f998006f300 0x7f9980155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7f6ecd9da640 1 Processor -- start 2024-09-17T02:54:52.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda80155b30 con 0x7fda80154c20 2024-09-17T02:54:52.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f6ecd9da640 1 -- start start 2024-09-17T02:54:52.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa03a1b0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340b3af0 0x7fa03415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa03a1b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa03415b3f0 0x7fa03415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f5262e7c640 1 -- 172.21.15.104:0/2532549462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5254006ba0 con 0x7f5254032710 2024-09-17T02:54:52.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa03a1b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa034073e40 con 0x7fa03415b3f0 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77ed46640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7780cf1e0 0x7fa778155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77ed46640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa77815d090 0x7fa778159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77ed46640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa778160680 0x7fa77815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77ed46640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa77815db60 con 0x7fa7780cf1e0 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77ed46640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa77815d9e0 con 0x7fa778160680 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77ed46640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa77815dce0 con 0x7fa77815d090 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77d543640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa77815d090 0x7fa778159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77d543640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa77815d090 0x7fa778159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:43534/0 (socket says 172.21.15.104:43534) 2024-09-17T02:54:52.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa77d543640 1 -- 172.21.15.104:0/1064386547 learned_addr learned my addr 172.21.15.104:0/1064386547 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa77d543640 1 -- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa778160680 msgr2=0x7fa77815be90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T02:54:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa77d543640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa778160680 0x7fa77815be90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa77d543640 1 -- 172.21.15.104:0/1064386547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7780cf1e0 msgr2=0x7fa778155f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T02:54:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa77d543640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7780cf1e0 0x7fa778155f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa77d543640 1 -- 172.21.15.104:0/1064386547 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7781f3780 con 0x7fa77815d090 2024-09-17T02:54:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda80155570 con 0x7fda80154c20 2024-09-17T02:54:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa03a1b0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa034073cc0 con 0x7fa03406f590 2024-09-17T02:54:52.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa03a1b0640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa034073fc0 con 0x7fa0340b3af0 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa033fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa03415b3f0 0x7fa03415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa033fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa03415b3f0 0x7fa03415efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52582/0 (socket says 172.21.15.104:52582) 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.829+0000 7fa033fff640 1 -- 172.21.15.104:0/1928962553 learned_addr learned my addr 172.21.15.104:0/1928962553 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa033fff640 1 -- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340b3af0 msgr2=0x7fa03415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa033fff640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340b3af0 0x7fa03415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa033fff640 1 -- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03406f590 msgr2=0x7fa03414a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa033fff640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03406f590 0x7fa03414a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f9985c94640 1 -- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f998006f300 msgr2=0x7f9980155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f9985c94640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f998006f300 0x7f9980155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f9985c94640 1 -- 172.21.15.104:0/271980998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99800b36e0 msgr2=0x7f9980148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f9985c94640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99800b36e0 0x7f9980148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f9985c94640 1 -- 172.21.15.104:0/271980998 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9980148670 con 0x7f9980073c00 2024-09-17T02:54:52.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa033fff640 1 -- 172.21.15.104:0/1928962553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03413fab0 con 0x7fa03415b3f0 2024-09-17T02:54:52.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fe3eb41d640 1 -- 172.21.15.104:0/2815533893 wait complete. 2024-09-17T02:54:52.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f9985c94640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9980073c00 0x7f9980159280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9970000c00 tx=0x7f9970003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7fa77d543640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa77815d090 0x7fa778159ab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa768009780 tx=0x7fa768033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f9976ffd640 1 -- 172.21.15.104:0/271980998 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997003e070 con 0x7f9980073c00 2024-09-17T02:54:52.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99801549f0 con 0x7f9980073c00 2024-09-17T02:54:52.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7f9976ffd640 1 -- 172.21.15.104:0/271980998 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9970004ac0 con 0x7f9980073c00 2024-09-17T02:54:52.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7f9976ffd640 1 -- 172.21.15.104:0/271980998 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970035040 con 0x7f9980073c00 2024-09-17T02:54:52.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9980154fb0 con 0x7f9980073c00 2024-09-17T02:54:52.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7fa76e7fc640 1 -- 172.21.15.104:0/1064386547 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768031b50 con 0x7fa77815d090 2024-09-17T02:54:52.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda800b3be0 con 0x7fda80154c20 2024-09-17T02:54:52.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7fa76e7fc640 1 -- 172.21.15.104:0/1064386547 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa768031de0 con 0x7fa77815d090 2024-09-17T02:54:52.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7781f3a60 con 0x7fa77815d090 2024-09-17T02:54:52.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7781f4020 con 0x7fa77815d090 2024-09-17T02:54:52.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7feb0dffb640 1 -- 172.21.15.104:0/2541774304 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb14033680 con 0x7feb100091c0 2024-09-17T02:54:52.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.830+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf8005290 con 0x7feb100091c0 2024-09-17T02:54:52.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.831+0000 7f52527fc640 1 -- 172.21.15.104:0/2532549462 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f524c018020 con 0x7f5254032710 2024-09-17T02:54:52.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7f6ecd9da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ec815c310 0x7f6ec814a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7f6ecd9da640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ec815f0b0 0x7f6ec815f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7feb0dffb640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feafc078be0 0x7feafc07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7f6ecd9da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ec815fa00 0x7f6ec814d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7feb0dffb640 1 -- 172.21.15.104:0/2541774304 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feb140bbd40 con 0x7feb100091c0 2024-09-17T02:54:52.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7fa76e7fc640 1 -- 172.21.15.104:0/1064386547 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768005280 con 0x7fa77815d090 2024-09-17T02:54:52.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec67fc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ec815f0b0 0x7f6ec815f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7fa033fff640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa03415b3f0 0x7fa03415efe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00db80 tx=0x7fa02c009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec67fc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ec815f0b0 0x7f6ec815f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:43554/0 (socket says 172.21.15.104:43554) 2024-09-17T02:54:52.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec77fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ec815fa00 0x7f6ec814d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ecd9da640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec80b5320 con 0x7f6ec815c310 2024-09-17T02:54:52.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec77fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ec815fa00 0x7f6ec814d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35438/0 (socket says 172.21.15.104:35438) 2024-09-17T02:54:52.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec77fe640 1 -- 172.21.15.104:0/3662180164 learned_addr learned my addr 172.21.15.104:0/3662180164 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec80b6470 con 0x7f6ec815fa00 2024-09-17T02:54:52.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec80b2280 con 0x7f6ec815f0b0 2024-09-17T02:54:52.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7feb1cbd3640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feafc078be0 0x7feafc07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec77fe640 1 -- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ec815f0b0 msgr2=0x7f6ec815f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec77fe640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ec815f0b0 0x7f6ec815f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec77fe640 1 -- 172.21.15.104:0/3662180164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ec815c310 msgr2=0x7f6ec814a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec77fe640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ec815c310 0x7f6ec814a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f6ec77fe640 1 -- 172.21.15.104:0/3662180164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec80a0120 con 0x7f6ec815fa00 2024-09-17T02:54:52.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7f52527fc640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5240078c60 0x7f524007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.832+0000 7f52527fc640 1 -- 172.21.15.104:0/2532549462 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f524c09ab10 con 0x7f5254032710 2024-09-17T02:54:52.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f5261e7a640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5240078c60 0x7f524007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.834+0000 7f6ec77fe640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ec815fa00 0x7f6ec814d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80ccec0 tx=0x7f6ebc00e5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99800b03b0 con 0x7f9980073c00 2024-09-17T02:54:52.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f9976ffd640 1 -- 172.21.15.104:0/271980998 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9970041070 con 0x7f9980073c00 2024-09-17T02:54:52.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7fe3eb41d640 1 Processor -- start 2024-09-17T02:54:52.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7fe3eb41d640 1 -- start start 2024-09-17T02:54:52.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.833+0000 7f5261e7a640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5240078c60 0x7f524007b170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5258001710 tx=0x7f5258009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.834+0000 7feb1cbd3640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feafc078be0 0x7feafc07b0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb1000bf20 tx=0x7feb08007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.834+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77815a430 con 0x7fa77815d090 2024-09-17T02:54:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.834+0000 7f9976ffd640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9964078bc0 0x7f996407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.834+0000 7f9976ffd640 1 -- 172.21.15.104:0/271980998 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f99700bbf30 con 0x7f9980073c00 2024-09-17T02:54:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.834+0000 7f9986495640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9964078bc0 0x7f996407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.834+0000 7fa76e7fc640 1 -- 172.21.15.104:0/1064386547 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa768005420 con 0x7fa77815d090 2024-09-17T02:54:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.835+0000 7f9986495640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9964078bc0 0x7f996407b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f997c006fd0 tx=0x7f997c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.835+0000 7fa76e7fc640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa75c078be0 0x7fa75c07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.835+0000 7fda75ffb640 1 -- 172.21.15.104:0/2768608045 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda7c042030 con 0x7fda80154c20 2024-09-17T02:54:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.835+0000 7fa76e7fc640 1 -- 172.21.15.104:0/1064386547 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa7680bbd20 con 0x7fa77815d090 2024-09-17T02:54:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.835+0000 7fa77dd44640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa75c078be0 0x7fa75c07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.835+0000 7fe3eb41d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3e4070560 0x7fe3e41698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.835+0000 7fe3eb41d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3e4072ad0 0x7fe3e4205f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3eb41d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e40b3e20 0x7fe3e42064a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fda75ffb640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda64078b20 0x7fda6407b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3eb41d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e406fdd0 con 0x7fe3e40b3e20 2024-09-17T02:54:52.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3eb41d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e406fc50 con 0x7fe3e4070560 2024-09-17T02:54:52.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3eb41d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e40af820 con 0x7fe3e4072ad0 2024-09-17T02:54:52.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3e4072ad0 0x7fe3e4205f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fda75ffb640 1 -- 172.21.15.104:0/2768608045 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fda7c0bb6c0 con 0x7fda80154c20 2024-09-17T02:54:52.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e91b9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3e4070560 0x7fe3e41698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3e4072ad0 0x7fe3e4205f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:43568/0 (socket says 172.21.15.104:43568) 2024-09-17T02:54:52.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 -- 172.21.15.104:0/3946364718 learned_addr learned my addr 172.21.15.104:0/3946364718 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:52.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e99ba640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e40b3e20 0x7fe3e42064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fa77dd44640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa75c078be0 0x7fa75c07b0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa774005fd0 tx=0x7fa774009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fda8495e640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda64078b20 0x7fda6407b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 -- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3e4070560 msgr2=0x7fe3e41698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3e4070560 0x7fe3e41698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 -- 172.21.15.104:0/3946364718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e40b3e20 msgr2=0x7fe3e42064a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e40b3e20 0x7fe3e42064a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 -- 172.21.15.104:0/3946364718 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e4154d30 con 0x7fe3e4072ad0 2024-09-17T02:54:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e99ba640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e40b3e20 0x7fe3e42064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fe3e89b8640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3e4072ad0 0x7fe3e4205f60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009850 tx=0x7fe3d40049d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.836+0000 7fda8495e640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda64078b20 0x7fda6407b030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda78001be0 tx=0x7fda78007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.838+0000 7f6eaffff640 1 -- 172.21.15.104:0/3662180164 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc018070 con 0x7f6ec815fa00 2024-09-17T02:54:52.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.838+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec80a0400 con 0x7f6ec815fa00 2024-09-17T02:54:52.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.838+0000 7feb0dffb640 1 -- 172.21.15.104:0/2541774304 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb1403f030 con 0x7feb100091c0 2024-09-17T02:54:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.838+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec814b640 con 0x7f6ec815fa00 2024-09-17T02:54:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.839+0000 7fa02bfff640 1 -- 172.21.15.104:0/1928962553 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02c016a50 con 0x7fa03415b3f0 2024-09-17T02:54:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.839+0000 7fa02bfff640 1 -- 172.21.15.104:0/1928962553 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa02c016bf0 con 0x7fa03415b3f0 2024-09-17T02:54:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.839+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03413fd90 con 0x7fa03415b3f0 2024-09-17T02:54:52.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.839+0000 7fa02bfff640 1 -- 172.21.15.104:0/1928962553 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa02c005020 con 0x7fa03415b3f0 2024-09-17T02:54:52.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.839+0000 7f52527fc640 1 -- 172.21.15.104:0/2532549462 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f524c01f020 con 0x7f5254032710 2024-09-17T02:54:52.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.839+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec80af810 con 0x7f6ec815fa00 2024-09-17T02:54:52.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.839+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03413caf0 con 0x7fa03415b3f0 2024-09-17T02:54:52.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.840+0000 7fda75ffb640 1 -- 172.21.15.104:0/2768608045 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda801f5ae0 con 0x7fda80154c20 2024-09-17T02:54:52.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.840+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03406f9a0 con 0x7fa03415b3f0 2024-09-17T02:54:52.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.842+0000 7fa02bfff640 1 -- 172.21.15.104:0/1928962553 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa02c0051c0 con 0x7fa03415b3f0 2024-09-17T02:54:52.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.842+0000 7fa02bfff640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa014078b90 0x7fa01407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.843+0000 7f6eaffff640 1 -- 172.21.15.104:0/3662180164 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ebc01d440 con 0x7f6ec815fa00 2024-09-17T02:54:52.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.843+0000 7f6eaffff640 1 -- 172.21.15.104:0/3662180164 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc022060 con 0x7f6ec815fa00 2024-09-17T02:54:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.843+0000 7fa02bfff640 1 -- 172.21.15.104:0/1928962553 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa02c0a3b70 con 0x7fa03415b3f0 2024-09-17T02:54:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.843+0000 7fa0337fe640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa014078b90 0x7fa01407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.843+0000 7fa0337fe640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa014078b90 0x7fa01407b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa01c032000 tx=0x7fa01c0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.844+0000 7f9976ffd640 1 -- 172.21.15.104:0/271980998 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9980148670 con 0x7f9980073c00 2024-09-17T02:54:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.844+0000 7f6eaffff640 1 -- 172.21.15.104:0/3662180164 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ebc01b070 con 0x7f6ec815fa00 2024-09-17T02:54:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.845+0000 7f6eaffff640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6eb4078bc0 0x7f6eb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.845+0000 7f6eaffff640 1 -- 172.21.15.104:0/3662180164 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6ebc099ec0 con 0x7f6ec815fa00 2024-09-17T02:54:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.845+0000 7f6ec6ffd640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6eb4078bc0 0x7f6eb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.846+0000 7fa76e7fc640 1 -- 172.21.15.104:0/1064386547 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa76803f030 con 0x7fa77815d090 2024-09-17T02:54:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.846+0000 7f6ec6ffd640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6eb4078bc0 0x7f6eb407b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8005cd0 tx=0x7f6eb8005c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.847+0000 7fe3d9ffb640 1 -- 172.21.15.104:0/3946364718 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d403f070 con 0x7fe3e4072ad0 2024-09-17T02:54:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.847+0000 7fe3d9ffb640 1 -- 172.21.15.104:0/3946364718 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3d40036e0 con 0x7fe3e4072ad0 2024-09-17T02:54:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.847+0000 7fe3d9ffb640 1 -- 172.21.15.104:0/3946364718 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4035030 con 0x7fe3e4072ad0 2024-09-17T02:54:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.847+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e4203ce0 con 0x7fe3e4072ad0 2024-09-17T02:54:52.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.847+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e4205840 con 0x7fe3e4072ad0 2024-09-17T02:54:52.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.848+0000 7f6eaffff640 1 -- 172.21.15.104:0/3662180164 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ec80af810 con 0x7f6ec815fa00 2024-09-17T02:54:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.849+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e4073f00 con 0x7fe3e4072ad0 2024-09-17T02:54:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.850+0000 7fe3d9ffb640 1 -- 172.21.15.104:0/3946364718 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3d4042070 con 0x7fe3e4072ad0 2024-09-17T02:54:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.851+0000 7fe3d9ffb640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe3c8078c60 0x7fe3c807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.852+0000 7fe3d9ffb640 1 -- 172.21.15.104:0/3946364718 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe3d40bbdc0 con 0x7fe3e4072ad0 2024-09-17T02:54:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.852+0000 7fe3e91b9640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe3c8078c60 0x7fe3c807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:52.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.852+0000 7fa02bfff640 1 -- 172.21.15.104:0/1928962553 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa02c06bf90 con 0x7fa03415b3f0 2024-09-17T02:54:52.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.853+0000 7fe3e91b9640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe3c8078c60 0x7fe3c807b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000bb50 tx=0x7fe3e000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:52.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:52.854+0000 7fe3d9ffb640 1 -- 172.21.15.104:0/3946364718 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe3e4073f00 con 0x7fe3e4072ad0 2024-09-17T02:54:53.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.254+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fda80069230 con 0x7fda80154c20 2024-09-17T02:54:53.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.255+0000 7fda75ffb640 1 -- 172.21.15.104:0/2768608045 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda7c0834d0 con 0x7fda80154c20 2024-09-17T02:54:53.254 INFO:teuthology.orchestra.run.smithi104.stdout:55834574852 2024-09-17T02:54:53.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7feaf8005850 con 0x7feb100091c0 2024-09-17T02:54:53.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7feb0dffb640 1 -- 172.21.15.104:0/2541774304 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb140842f0 con 0x7feb100091c0 2024-09-17T02:54:53.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda64078b20 msgr2=0x7fda6407b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7fda873c3640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda64078b20 0x7fda6407b030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fda78001be0 tx=0x7fda78007eb0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda80154c20 msgr2=0x7fda801390b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7fda873c3640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda80154c20 0x7fda801390b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda7c034040 tx=0x7fda7c0316a0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 shutdown_connections 2024-09-17T02:54:53.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7fda873c3640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda64078b20 0x7fda6407b030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7fda873c3640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda801f56d0 0x7fda8013b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.258+0000 7fda873c3640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda8014ebf0 0x7fda801f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.259+0000 7fda873c3640 1 --2- 172.21.15.104:0/2768608045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda80154c20 0x7fda801390b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.259+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 >> 172.21.15.104:0/2768608045 conn(0x7fda800b3640 msgr2=0x7fda80073580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:53.259 INFO:teuthology.orchestra.run.smithi104.stdout:55834574852 2024-09-17T02:54:53.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.259+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 shutdown_connections 2024-09-17T02:54:53.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.259+0000 7fda873c3640 1 -- 172.21.15.104:0/2768608045 wait complete. 2024-09-17T02:54:53.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.261+0000 7f5262e7c640 1 -- 172.21.15.104:0/2532549462 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f525401de80 con 0x7f5254032710 2024-09-17T02:54:53.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7f52527fc640 1 -- 172.21.15.104:0/2532549462 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f524c062fc0 con 0x7f5254032710 2024-09-17T02:54:53.261 INFO:teuthology.orchestra.run.smithi104.stdout:55834574852 2024-09-17T02:54:53.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feafc078be0 msgr2=0x7feafc07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feafc078be0 0x7feafc07b0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feb1000bf20 tx=0x7feb08007e90 comp rx=0 tx=0).stop 2024-09-17T02:54:53.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb100091c0 msgr2=0x7feb100d3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb100091c0 0x7feb100d3340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feb14009980 tx=0x7feb14033c90 comp rx=0 tx=0).stop 2024-09-17T02:54:53.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 shutdown_connections 2024-09-17T02:54:53.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feafc078be0 0x7feafc07b0f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb10055280 0x7feb100d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb10036770 0x7feb100e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 --2- 172.21.15.104:0/2541774304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb100091c0 0x7feb100d3340 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 >> 172.21.15.104:0/2541774304 conn(0x7feb1001eae0 msgr2=0x7feb1000c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:53.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 shutdown_connections 2024-09-17T02:54:53.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.262+0000 7feb1e3d6640 1 -- 172.21.15.104:0/2541774304 wait complete. 2024-09-17T02:54:53.265 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.265+0000 7f523ffff640 1 -- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5240078c60 msgr2=0x7f524007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.265+0000 7f523ffff640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5240078c60 0x7f524007b170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5258001710 tx=0x7f5258009040 comp rx=0 tx=0).stop 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 -- 172.21.15.104:0/2532549462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5254032710 msgr2=0x7f52540ddc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5254032710 0x7f52540ddc90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f524c00b410 tx=0x7f524c00b8d0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 -- 172.21.15.104:0/2532549462 shutdown_connections 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5240078c60 0x7f524007b170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52540de440 0x7f5254034e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5254032710 0x7f52540ddc90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 --2- 172.21.15.104:0/2532549462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5254009f60 0x7f52540216e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 -- 172.21.15.104:0/2532549462 >> 172.21.15.104:0/2532549462 conn(0x7f5254051420 msgr2=0x7f52540df010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 -- 172.21.15.104:0/2532549462 shutdown_connections 2024-09-17T02:54:53.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.266+0000 7f523ffff640 1 -- 172.21.15.104:0/2532549462 wait complete. 2024-09-17T02:54:53.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.267+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f99800b00d0 con 0x7f9980073c00 2024-09-17T02:54:53.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.267+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa77815d4a0 con 0x7fa77815d090 2024-09-17T02:54:53.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.267+0000 7f9976ffd640 1 -- 172.21.15.104:0/271980998 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f998006fc50 con 0x7f9980073c00 2024-09-17T02:54:53.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.268+0000 7fa76e7fc640 1 -- 172.21.15.104:0/1064386547 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa778160fd0 con 0x7fa77815d090 2024-09-17T02:54:53.270 INFO:teuthology.orchestra.run.smithi104.stdout:55834574852 2024-09-17T02:54:53.270 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:53.271 INFO:teuthology.orchestra.run.smithi104.stdout:55834574852 2024-09-17T02:54:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.270+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6ec80b5740 con 0x7f6ec815fa00 2024-09-17T02:54:53.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.270+0000 7f6eaffff640 1 -- 172.21.15.104:0/3662180164 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ebc061db0 con 0x7f6ec815fa00 2024-09-17T02:54:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.271+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9964078bc0 msgr2=0x7f996407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.271+0000 7f99886f9640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9964078bc0 0x7f996407b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f997c006fd0 tx=0x7f997c008040 comp rx=0 tx=0).stop 2024-09-17T02:54:53.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.271+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9980073c00 msgr2=0x7f9980159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9980073c00 0x7f9980159280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9970000c00 tx=0x7f9970003b90 comp rx=0 tx=0).stop 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 shutdown_connections 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9964078bc0 0x7f996407b0d0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f997c006fd0 tx=0x7f997c008040 comp rx=0 tx=0).stop 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9980073c00 0x7f9980159280 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9970000c00 tx=0x7f9970003b90 comp rx=0 tx=0).stop 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99800b36e0 0x7f9980148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 --2- 172.21.15.104:0/271980998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f998006f300 0x7f9980155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 >> 172.21.15.104:0/271980998 conn(0x7f99800693e0 msgr2=0x7f998015f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 shutdown_connections 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7f99886f9640 1 -- 172.21.15.104:0/271980998 wait complete. 2024-09-17T02:54:53.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa75c078be0 msgr2=0x7fa75c07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7fa77ed46640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa75c078be0 0x7fa75c07b0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa774005fd0 tx=0x7fa774009260 comp rx=0 tx=0).stop 2024-09-17T02:54:53.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa03413f840 con 0x7fa03415b3f0 2024-09-17T02:54:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.272+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa77815d090 msgr2=0x7fa778159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa77815d090 0x7fa778159ab0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa768009780 tx=0x7fa768033ba0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 shutdown_connections 2024-09-17T02:54:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa75c078be0 0x7fa75c07b0f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa778160680 0x7fa77815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa77815d090 0x7fa778159ab0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa02bfff640 1 -- 172.21.15.104:0/1928962553 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa02c06bf90 con 0x7fa03415b3f0 2024-09-17T02:54:53.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 --2- 172.21.15.104:0/1064386547 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7780cf1e0 0x7fa778155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.276 INFO:teuthology.orchestra.run.smithi104.stdout:55834574853 2024-09-17T02:54:53.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 >> 172.21.15.104:0/1064386547 conn(0x7fa778074520 msgr2=0x7fa7780b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:53.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 shutdown_connections 2024-09-17T02:54:53.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.273+0000 7fa77ed46640 1 -- 172.21.15.104:0/1064386547 wait complete. 2024-09-17T02:54:53.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6eb4078bc0 msgr2=0x7f6eb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6eb4078bc0 0x7f6eb407b0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8005cd0 tx=0x7f6eb8005c20 comp rx=0 tx=0).stop 2024-09-17T02:54:53.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe3e415b7a0 con 0x7fe3e4072ad0 2024-09-17T02:54:53.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ec815fa00 msgr2=0x7f6ec814d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ec815fa00 0x7f6ec814d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80ccec0 tx=0x7f6ebc00e5c0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 shutdown_connections 2024-09-17T02:54:53.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6eb4078bc0 0x7f6eb407b0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ec815fa00 0x7f6ec814d260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ec815f0b0 0x7f6ec815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 --2- 172.21.15.104:0/3662180164 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ec815c310 0x7f6ec814a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 >> 172.21.15.104:0/3662180164 conn(0x7f6ec80b4400 msgr2=0x7f6ec80b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 shutdown_connections 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7f6ecd9da640 1 -- 172.21.15.104:0/3662180164 wait complete. 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.275+0000 7fe3d9ffb640 1 -- 172.21.15.104:0/3946364718 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3d4083b90 con 0x7fe3e4072ad0 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa014078b90 msgr2=0x7fa01407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa014078b90 0x7fa01407b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa01c032000 tx=0x7fa01c0046c0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa03415b3f0 msgr2=0x7fa03415efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa03415b3f0 0x7fa03415efe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00db80 tx=0x7fa02c009740 comp rx=0 tx=0).stop 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 shutdown_connections 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa014078b90 0x7fa01407b0a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa03415b3f0 0x7fa03415efe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0340b3af0 0x7fa03415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 --2- 172.21.15.104:0/1928962553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa03406f590 0x7fa03414a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 >> 172.21.15.104:0/1928962553 conn(0x7fa0340b27f0 msgr2=0x7fa034159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 shutdown_connections 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.278+0000 7fa03a1b0640 1 -- 172.21.15.104:0/1928962553 wait complete. 2024-09-17T02:54:53.280 INFO:teuthology.orchestra.run.smithi104.stdout:55834574852 2024-09-17T02:54:53.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe3c8078c60 msgr2=0x7fe3c807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe3c8078c60 0x7fe3c807b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000bb50 tx=0x7fe3e000b2e0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3e4072ad0 msgr2=0x7fe3e4205f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:53.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3e4072ad0 0x7fe3e4205f60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009850 tx=0x7fe3d40049d0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 shutdown_connections 2024-09-17T02:54:53.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe3c8078c60 0x7fe3c807b170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe3e40b3e20 0x7fe3e42064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3e4072ad0 0x7fe3e4205f60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 --2- 172.21.15.104:0/3946364718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3e4070560 0x7fe3e41698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:53.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 >> 172.21.15.104:0/3946364718 conn(0x7fe3e40b2450 msgr2=0x7fe3e4158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:53.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 shutdown_connections 2024-09-17T02:54:53.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:53.280+0000 7fe3eb41d640 1 -- 172.21.15.104:0/3946364718 wait complete. 2024-09-17T02:54:53.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2024-09-17T02:54:53.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.1 2024-09-17T02:54:53.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2024-09-17T02:54:53.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.7 2024-09-17T02:54:53.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.6 2024-09-17T02:54:53.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2024-09-17T02:54:53.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2024-09-17T02:54:53.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.3 2024-09-17T02:54:54.283 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T02:54:54.285 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T02:54:54.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T02:54:54.297 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T02:54:54.298 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T02:54:54.298 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T02:54:54.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T02:54:54.300 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T02:54:54.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.472+0000 7f396affd640 1 -- 172.21.15.104:0/1030748724 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c0044e0 con 0x7f396c06faf0 2024-09-17T02:54:54.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.473+0000 7f39722b6640 1 -- 172.21.15.104:0/1030748724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c06faf0 msgr2=0x7f396c1523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.473+0000 7f39722b6640 1 --2- 172.21.15.104:0/1030748724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c06faf0 0x7f396c1523a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f395c00ba80 tx=0x7f395c02c2a0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.474+0000 7f39722b6640 1 -- 172.21.15.104:0/1030748724 shutdown_connections 2024-09-17T02:54:54.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.474+0000 7f39722b6640 1 --2- 172.21.15.104:0/1030748724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c06faf0 0x7f396c1523a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.474+0000 7f39722b6640 1 -- 172.21.15.104:0/1030748724 >> 172.21.15.104:0/1030748724 conn(0x7f396c0b3440 msgr2=0x7f396c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.476+0000 7f39722b6640 1 -- 172.21.15.104:0/1030748724 shutdown_connections 2024-09-17T02:54:54.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.476+0000 7f39722b6640 1 -- 172.21.15.104:0/1030748724 wait complete. 2024-09-17T02:54:54.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.478+0000 7f3025e25640 1 -- 172.21.15.104:0/1421704743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30201600c0 msgr2=0x7f3020074110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.478+0000 7f3025e25640 1 --2- 172.21.15.104:0/1421704743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30201600c0 0x7f3020074110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3010009900 tx=0x7f301002a550 comp rx=0 tx=0).stop 2024-09-17T02:54:54.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.479+0000 7f39722b6640 1 Processor -- start 2024-09-17T02:54:54.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.479+0000 7f39722b6640 1 -- start start 2024-09-17T02:54:54.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.479+0000 7f3025e25640 1 -- 172.21.15.104:0/1421704743 shutdown_connections 2024-09-17T02:54:54.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.479+0000 7f3025e25640 1 --2- 172.21.15.104:0/1421704743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30200b4260 0x7f30200d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.480+0000 7f3025e25640 1 --2- 172.21.15.104:0/1421704743 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30201600c0 0x7f3020074110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.480+0000 7f3025e25640 1 -- 172.21.15.104:0/1421704743 >> 172.21.15.104:0/1421704743 conn(0x7f3020068d00 msgr2=0x7f3020069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.480+0000 7f3025e25640 1 -- 172.21.15.104:0/1421704743 shutdown_connections 2024-09-17T02:54:54.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.480+0000 7f3025e25640 1 -- 172.21.15.104:0/1421704743 wait complete. 2024-09-17T02:54:54.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.481+0000 7f39722b6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c15c4b0 0x7f396c157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.482+0000 7f39722b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396c15eeb0 0x7f396c1f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.482+0000 7f396bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c15c4b0 0x7f396c157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.482+0000 7f396bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c15c4b0 0x7f396c157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35326/0 (socket says 172.21.15.104:35326) 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.482+0000 7f396b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396c15eeb0 0x7f396c1f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.483+0000 7f396b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396c15eeb0 0x7f396c1f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50530/0 (socket says 172.21.15.104:50530) 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.483+0000 7f396bfff640 1 -- 172.21.15.104:0/309422674 learned_addr learned my addr 172.21.15.104:0/309422674 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.483+0000 7f39722b6640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f396c158280 0x7f396c1f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.483+0000 7f39722b6640 1 -- 172.21.15.104:0/309422674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f396c072d50 con 0x7f396c15eeb0 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.483+0000 7f39722b6640 1 -- 172.21.15.104:0/309422674 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f396c076c80 con 0x7f396c15c4b0 2024-09-17T02:54:54.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.483+0000 7f39722b6640 1 -- 172.21.15.104:0/309422674 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f396c072ed0 con 0x7f396c158280 2024-09-17T02:54:54.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.483+0000 7f3025e25640 1 Processor -- start 2024-09-17T02:54:54.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.484+0000 7f3025e25640 1 -- start start 2024-09-17T02:54:54.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.484+0000 7f396bfff640 1 -- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f396c158280 msgr2=0x7f396c1f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.483+0000 7f3970853640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f396c158280 0x7f396c1f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.484+0000 7f396bfff640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f396c158280 0x7f396c1f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.484+0000 7f396bfff640 1 -- 172.21.15.104:0/309422674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396c15eeb0 msgr2=0x7f396c1f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.484+0000 7f396bfff640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396c15eeb0 0x7f396c1f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.484+0000 7f396bfff640 1 -- 172.21.15.104:0/309422674 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c1f15a0 con 0x7f396c15c4b0 2024-09-17T02:54:54.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.485+0000 7f396b7fe640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396c15eeb0 0x7f396c1f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:54.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.485+0000 7f396bfff640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c15c4b0 0x7f396c157d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f396000b410 tx=0x7f396000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.485+0000 7f3970853640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f396c158280 0x7f396c1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:54.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f3968ff9640 1 -- 172.21.15.104:0/309422674 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960015020 con 0x7f396c15c4b0 2024-09-17T02:54:54.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f3968ff9640 1 -- 172.21.15.104:0/309422674 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3960011920 con 0x7f396c15c4b0 2024-09-17T02:54:54.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f3968ff9640 1 -- 172.21.15.104:0/309422674 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960011d50 con 0x7f396c15c4b0 2024-09-17T02:54:54.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f39722b6640 1 -- 172.21.15.104:0/309422674 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c1f58a0 con 0x7f396c15c4b0 2024-09-17T02:54:54.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f3025e25640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30200b4260 0x7f30200af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f3025e25640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30200d0b40 0x7f3020151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f301f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30200b4260 0x7f30200af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f301f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30200b4260 0x7f30200af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50534/0 (socket says 172.21.15.104:50534) 2024-09-17T02:54:54.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.486+0000 7f39722b6640 1 -- 172.21.15.104:0/309422674 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c1f1b00 con 0x7f396c15c4b0 2024-09-17T02:54:54.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f3025e25640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30201600c0 0x7f30201fdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f3025e25640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f30201637a0 con 0x7f30200b4260 2024-09-17T02:54:54.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f301f7fe640 1 -- 172.21.15.104:0/239411482 learned_addr learned my addr 172.21.15.104:0/239411482 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:54.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3020163620 con 0x7f30200d0b40 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3020072750 con 0x7f30201600c0 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f301ffff640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30201600c0 0x7f30201fdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f301effd640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30200d0b40 0x7f3020151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f301ffff640 1 -- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30200d0b40 msgr2=0x7f3020151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.487+0000 7f301ffff640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30200d0b40 0x7f3020151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.488+0000 7f301ffff640 1 -- 172.21.15.104:0/239411482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30200b4260 msgr2=0x7f30200af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.488+0000 7f301ffff640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30200b4260 0x7f30200af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.488+0000 7f301ffff640 1 -- 172.21.15.104:0/239411482 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30201fb250 con 0x7f30201600c0 2024-09-17T02:54:54.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.488+0000 7f301f7fe640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30200b4260 0x7f30200af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:54:54.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.489+0000 7f3968ff9640 1 -- 172.21.15.104:0/309422674 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3960018020 con 0x7f396c15c4b0 2024-09-17T02:54:54.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.490+0000 7f39722b6640 1 -- 172.21.15.104:0/309422674 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c06e9a0 con 0x7f396c15c4b0 2024-09-17T02:54:54.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.490+0000 7f3968ff9640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3958078c60 0x7f395807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.490+0000 7f3968ff9640 1 -- 172.21.15.104:0/309422674 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f396009ac10 con 0x7f396c15c4b0 2024-09-17T02:54:54.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.490+0000 7f301ffff640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30201600c0 0x7f30201fdc40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f301800be30 tx=0x7f301800bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.491+0000 7f3007fff640 1 -- 172.21.15.104:0/239411482 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018019070 con 0x7f30201600c0 2024-09-17T02:54:54.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.491+0000 7f396b7fe640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3958078c60 0x7f395807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.491+0000 7f3007fff640 1 -- 172.21.15.104:0/239411482 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3018014440 con 0x7f30201600c0 2024-09-17T02:54:54.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.493+0000 7f396b7fe640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3958078c60 0x7f395807b170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f395c036000 tx=0x7f395c0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.492+0000 7f3007fff640 1 -- 172.21.15.104:0/239411482 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018014890 con 0x7f30201600c0 2024-09-17T02:54:54.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.492+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30200aa540 con 0x7f30201600c0 2024-09-17T02:54:54.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.492+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30200aab00 con 0x7f30201600c0 2024-09-17T02:54:54.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.493+0000 7f3005ffb640 1 -- 172.21.15.104:0/239411482 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30200d0600 con 0x7f30201600c0 2024-09-17T02:54:54.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.495+0000 7f3007fff640 1 -- 172.21.15.104:0/239411482 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f301801c070 con 0x7f30201600c0 2024-09-17T02:54:54.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.496+0000 7f3007fff640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f300c078b90 0x7f300c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.496+0000 7f3007fff640 1 -- 172.21.15.104:0/239411482 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f301809abf0 con 0x7f30201600c0 2024-09-17T02:54:54.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.496+0000 7f3968ff9640 1 -- 172.21.15.104:0/309422674 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f396001f020 con 0x7f396c15c4b0 2024-09-17T02:54:54.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.496+0000 7f301f7fe640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f300c078b90 0x7f300c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.497+0000 7f301f7fe640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f300c078b90 0x7f300c07b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3010009850 tx=0x7f3010004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.500+0000 7f3007fff640 1 -- 172.21.15.104:0/239411482 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3018062940 con 0x7f30201600c0 2024-09-17T02:54:54.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.536+0000 7f63ca713640 1 -- 172.21.15.104:0/2984336490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63ac003a50 msgr2=0x7f63ac003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.536+0000 7f63ca713640 1 --2- 172.21.15.104:0/2984336490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63ac003a50 0x7f63ac003ec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c610 tx=0x7f63ac005830 comp rx=0 tx=0).stop 2024-09-17T02:54:54.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.536+0000 7f63c8cb0640 1 -- 172.21.15.104:0/2984336490 reap_dead start 2024-09-17T02:54:54.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.536+0000 7f63ca713640 1 -- 172.21.15.104:0/2984336490 shutdown_connections 2024-09-17T02:54:54.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.536+0000 7f63ca713640 1 -- 172.21.15.104:0/2984336490 >> 172.21.15.104:0/2984336490 conn(0x7f63c4068d00 msgr2=0x7f63c4069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.537+0000 7f63ca713640 1 -- 172.21.15.104:0/2984336490 shutdown_connections 2024-09-17T02:54:54.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.537+0000 7f63ca713640 1 -- 172.21.15.104:0/2984336490 wait complete. 2024-09-17T02:54:54.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.540+0000 7f63ca713640 1 Processor -- start 2024-09-17T02:54:54.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.540+0000 7f63ca713640 1 -- start start 2024-09-17T02:54:54.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.541+0000 7feabce0a640 1 -- 172.21.15.104:0/2805676555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feab80afd60 msgr2=0x7feab8072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.541+0000 7feabce0a640 1 --2- 172.21.15.104:0/2805676555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feab80afd60 0x7feab8072590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feab0005fd0 tx=0x7feab002a7a0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.541+0000 7feabce0a640 1 -- 172.21.15.104:0/2805676555 shutdown_connections 2024-09-17T02:54:54.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.541+0000 7feabce0a640 1 --2- 172.21.15.104:0/2805676555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feab80afd60 0x7feab8072590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.541+0000 7feabce0a640 1 --2- 172.21.15.104:0/2805676555 >> v2:172.21.15.104:3300/0 conn(0x7feab8151f50 0x7feab80af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.541+0000 7feabce0a640 1 -- 172.21.15.104:0/2805676555 >> 172.21.15.104:0/2805676555 conn(0x7feab80b2450 msgr2=0x7feab80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.542+0000 7f63ca713640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63c41f1a30 0x7f63c414f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.542+0000 7f63ca713640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63c414fd90 0x7f63c406f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63ca713640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63c41502c0 0x7f63c406f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63ca713640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f63c40d07b0 con 0x7f63c41f1a30 2024-09-17T02:54:54.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63ca713640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f63c40d0630 con 0x7f63c41502c0 2024-09-17T02:54:54.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63ca713640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f63c415f8f0 con 0x7f63c414fd90 2024-09-17T02:54:54.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63c41f1a30 0x7f63c414f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.542+0000 7feabce0a640 1 -- 172.21.15.104:0/2805676555 shutdown_connections 2024-09-17T02:54:54.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63c41f1a30 0x7f63c414f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50568/0 (socket says 172.21.15.104:50568) 2024-09-17T02:54:54.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c3fff640 1 -- 172.21.15.104:0/1713753357 learned_addr learned my addr 172.21.15.104:0/1713753357 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:54.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c37fe640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63c414fd90 0x7f63c406f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c8cb0640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63c41502c0 0x7f63c406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.544+0000 7f5c589cc640 1 -- 172.21.15.104:0/1568062357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c54152cd0 msgr2=0x7f5c540b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.544+0000 7feabce0a640 1 -- 172.21.15.104:0/2805676555 wait complete. 2024-09-17T02:54:54.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c8cb0640 1 -- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63c414fd90 msgr2=0x7f63c406f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c8cb0640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63c414fd90 0x7f63c406f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c8cb0640 1 -- 172.21.15.104:0/1713753357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63c41f1a30 msgr2=0x7f63c414f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c8cb0640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63c41f1a30 0x7f63c414f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.543+0000 7f63c8cb0640 1 -- 172.21.15.104:0/1713753357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c4158930 con 0x7f63c41502c0 2024-09-17T02:54:54.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.544+0000 7f63c8cb0640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63c41502c0 0x7f63c406f600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f63c40b0290 tx=0x7f63b400ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.544+0000 7f5c589cc640 1 --2- 172.21.15.104:0/1568062357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c54152cd0 0x7f5c540b5200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5c54159c80 tx=0x7f5c4402a5a0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.544+0000 7f63c0ff9640 1 -- 172.21.15.104:0/1713753357 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b4004220 con 0x7f63c41502c0 2024-09-17T02:54:54.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.544+0000 7f63c0ff9640 1 -- 172.21.15.104:0/1713753357 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63b4009e40 con 0x7f63c41502c0 2024-09-17T02:54:54.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.544+0000 7f63c0ff9640 1 -- 172.21.15.104:0/1713753357 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b400cc70 con 0x7f63c41502c0 2024-09-17T02:54:54.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.545+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c4158c10 con 0x7f63c41502c0 2024-09-17T02:54:54.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.545+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c40ce540 con 0x7f63c41502c0 2024-09-17T02:54:54.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.545+0000 7f5c589cc640 1 -- 172.21.15.104:0/1568062357 shutdown_connections 2024-09-17T02:54:54.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.545+0000 7f5c589cc640 1 --2- 172.21.15.104:0/1568062357 >> v2:172.21.15.192:3300/0 conn(0x7f5c54073c70 0x7f5c5415c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.545+0000 7f5c589cc640 1 --2- 172.21.15.104:0/1568062357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c54152cd0 0x7f5c540b5200 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.545+0000 7f5c589cc640 1 -- 172.21.15.104:0/1568062357 >> 172.21.15.104:0/1568062357 conn(0x7f5c540b35d0 msgr2=0x7f5c540b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.545+0000 7fb2b6932640 1 -- 172.21.15.104:0/1873757275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015c4b0 msgr2=0x7fb2b01523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.545+0000 7fb2b6932640 1 --2- 172.21.15.104:0/1873757275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015c4b0 0x7fb2b01523a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000aa10 tx=0x7fb2a002b850 comp rx=0 tx=0).stop 2024-09-17T02:54:54.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.546+0000 7f5c589cc640 1 -- 172.21.15.104:0/1568062357 shutdown_connections 2024-09-17T02:54:54.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.546+0000 7f5c589cc640 1 -- 172.21.15.104:0/1568062357 wait complete. 2024-09-17T02:54:54.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.546+0000 7fb2b6932640 1 -- 172.21.15.104:0/1873757275 shutdown_connections 2024-09-17T02:54:54.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.546+0000 7fb2b6932640 1 --2- 172.21.15.104:0/1873757275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015c4b0 0x7fb2b01523a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.546+0000 7fb2b6932640 1 -- 172.21.15.104:0/1873757275 >> 172.21.15.104:0/1873757275 conn(0x7fb2b00b3440 msgr2=0x7fb2b006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.546+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c40b4390 con 0x7f63c41502c0 2024-09-17T02:54:54.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7f007b59e640 1 -- 172.21.15.104:0/1060790481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f007403c1f0 msgr2=0x7f0074053eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7f007b59e640 1 --2- 172.21.15.104:0/1060790481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f007403c1f0 0x7f0074053eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f006c009890 tx=0x7f006c02a540 comp rx=0 tx=0).stop 2024-09-17T02:54:54.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.546+0000 7fb2b6932640 1 -- 172.21.15.104:0/1873757275 shutdown_connections 2024-09-17T02:54:54.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.546+0000 7fb2b6932640 1 -- 172.21.15.104:0/1873757275 wait complete. 2024-09-17T02:54:54.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7feabce0a640 1 Processor -- start 2024-09-17T02:54:54.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7fa802ef9640 1 -- 172.21.15.104:0/2549544539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7fc151f50 msgr2=0x7fa7fc0b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7fa802ef9640 1 --2- 172.21.15.104:0/2549544539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7fc151f50 0x7fa7fc0b3e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005fd0 tx=0x7fa7f402a940 comp rx=0 tx=0).stop 2024-09-17T02:54:54.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7f007b59e640 1 -- 172.21.15.104:0/1060790481 shutdown_connections 2024-09-17T02:54:54.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7f007b59e640 1 --2- 172.21.15.104:0/1060790481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f007403c1f0 0x7f0074053eb0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f006c009890 tx=0x7f006c02a540 comp rx=0 tx=0).stop 2024-09-17T02:54:54.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7f007b59e640 1 -- 172.21.15.104:0/1060790481 >> 172.21.15.104:0/1060790481 conn(0x7f007403a5f0 msgr2=0x7f007403aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7feabce0a640 1 -- start start 2024-09-17T02:54:54.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7fa802ef9640 1 -- 172.21.15.104:0/2549544539 shutdown_connections 2024-09-17T02:54:54.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7f007b59e640 1 -- 172.21.15.104:0/1060790481 shutdown_connections 2024-09-17T02:54:54.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7f007b59e640 1 -- 172.21.15.104:0/1060790481 wait complete. 2024-09-17T02:54:54.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.547+0000 7fa802ef9640 1 --2- 172.21.15.104:0/2549544539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7fc151f50 0x7fa7fc0b3e20 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005fd0 tx=0x7fa7f402a940 comp rx=0 tx=0).stop 2024-09-17T02:54:54.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.548+0000 7fa802ef9640 1 -- 172.21.15.104:0/2549544539 >> 172.21.15.104:0/2549544539 conn(0x7fa7fc0b2450 msgr2=0x7fa7fc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.548+0000 7fa802ef9640 1 -- 172.21.15.104:0/2549544539 shutdown_connections 2024-09-17T02:54:54.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.548+0000 7fa802ef9640 1 -- 172.21.15.104:0/2549544539 wait complete. 2024-09-17T02:54:54.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.548+0000 7f63c0ff9640 1 -- 172.21.15.104:0/1713753357 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63b4005020 con 0x7f63c41502c0 2024-09-17T02:54:54.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.549+0000 7feabce0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feab8070560 0x7feab8149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.549+0000 7f63c0ff9640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63b0078c60 0x7f63b007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.549+0000 7f63c0ff9640 1 -- 172.21.15.104:0/1713753357 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f63b409aea0 con 0x7f63c41502c0 2024-09-17T02:54:54.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.549+0000 7f63c3fff640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63b0078c60 0x7f63b007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.549+0000 7f5c589cc640 1 Processor -- start 2024-09-17T02:54:54.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.549+0000 7feab659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feab8070560 0x7feab8149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.549+0000 7feab659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feab8070560 0x7feab8149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50570/0 (socket says 172.21.15.104:50570) 2024-09-17T02:54:54.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7feab659c640 1 -- 172.21.15.104:0/1679748675 learned_addr learned my addr 172.21.15.104:0/1679748675 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:54.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7f5c589cc640 1 -- start start 2024-09-17T02:54:54.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7feabce0a640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feab80afd60 0x7feab8149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7fb2b6932640 1 Processor -- start 2024-09-17T02:54:54.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7fb2b6932640 1 -- start start 2024-09-17T02:54:54.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7f007b59e640 1 Processor -- start 2024-09-17T02:54:54.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7f007b59e640 1 -- start start 2024-09-17T02:54:54.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7feabce0a640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feab8151f50 0x7feab814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feab806f330 con 0x7feab8070560 2024-09-17T02:54:54.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feab8072ff0 con 0x7feab8151f50 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feab806f4b0 con 0x7feab80afd60 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7feab5d9b640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feab80afd60 0x7feab8149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.550+0000 7feab659c640 1 -- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feab80afd60 msgr2=0x7feab8149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feab659c640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feab80afd60 0x7feab8149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feab659c640 1 -- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feab8151f50 msgr2=0x7feab814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feab659c640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feab8151f50 0x7feab814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feab659c640 1 -- 172.21.15.104:0/1679748675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab814b220 con 0x7feab8070560 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feab659c640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feab8070560 0x7feab8149730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feaa000caf0 tx=0x7feaa000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7fa802ef9640 1 Processor -- start 2024-09-17T02:54:54.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7fa802ef9640 1 -- start start 2024-09-17T02:54:54.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7f63c3fff640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63b0078c60 0x7f63b007b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63b8000c00 tx=0x7f63b8001bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feaaeffd640 1 -- 172.21.15.104:0/1679748675 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa0017070 con 0x7feab8070560 2024-09-17T02:54:54.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feaaeffd640 1 -- 172.21.15.104:0/1679748675 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feaa0005360 con 0x7feab8070560 2024-09-17T02:54:54.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feaaeffd640 1 -- 172.21.15.104:0/1679748675 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa000a960 con 0x7feab8070560 2024-09-17T02:54:54.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.551+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab814a7f0 con 0x7feab8070560 2024-09-17T02:54:54.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.552+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab814f1d0 con 0x7feab8070560 2024-09-17T02:54:54.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.552+0000 7f5c589cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c54152cd0 0x7f5c54155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.552+0000 7f007b59e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00740537b0 0x7f00740d1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.552+0000 7f007b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0074056da0 0x7f00740d2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7f007b59e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740d40e0 0x7f00740d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7f007b59e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f00740e1a30 con 0x7f0074056da0 2024-09-17T02:54:54.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7f007b59e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f00740e18b0 con 0x7f00740537b0 2024-09-17T02:54:54.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7f007b59e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f00740e1bb0 con 0x7f00740d40e0 2024-09-17T02:54:54.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7f0079d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0074056da0 0x7f00740d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7f0079d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0074056da0 0x7f00740d2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50586/0 (socket says 172.21.15.104:50586) 2024-09-17T02:54:54.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7f0079d9b640 1 -- 172.21.15.104:0/1286245558 learned_addr learned my addr 172.21.15.104:0/1286245558 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.552+0000 7fb2b6932640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2b006f3e0 0x7fb2b00cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2b6932640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b015c4b0 0x7fb2b00cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2b6932640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015eeb0 0x7fb2b01f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b015c4b0 0x7fb2b00cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2af7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b015c4b0 0x7fb2b00cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:35408/0 (socket says 172.21.15.104:35408) 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2b4ecf640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015eeb0 0x7fb2b01f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2b4ecf640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015eeb0 0x7fb2b01f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:38392/0 (socket says 172.21.15.104:38392) 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2b4ecf640 1 -- 172.21.15.104:0/4156689228 learned_addr learned my addr 172.21.15.104:0/4156689228 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0072d50 con 0x7fb2b006f3e0 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0076ca0 con 0x7fb2b015c4b0 2024-09-17T02:54:54.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b0072ed0 con 0x7fb2b015eeb0 2024-09-17T02:54:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9c005290 con 0x7feab8070560 2024-09-17T02:54:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c5259c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c54152cd0 0x7f5c54155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c5259c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c54152cd0 0x7f5c54155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:38394/0 (socket says 172.21.15.104:38394) 2024-09-17T02:54:54.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa802ef9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7fc072590 0x7fa7fc146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c589cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c5415c060 0x7f5c54148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c5259c640 1 -- 172.21.15.104:0/3653368493 learned_addr learned my addr 172.21.15.104:0/3653368493 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:54.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f007a59c640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00740537b0 0x7f00740d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.553+0000 7fb2affff640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2b006f3e0 0x7fb2b00cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f007ad9d640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740d40e0 0x7f00740d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f0079d9b640 1 -- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740d40e0 msgr2=0x7f00740d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f0079d9b640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740d40e0 0x7f00740d26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f0079d9b640 1 -- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00740537b0 msgr2=0x7f00740d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f0079d9b640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00740537b0 0x7f00740d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f0079d9b640 1 -- 172.21.15.104:0/1286245558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00740d4830 con 0x7f0074056da0 2024-09-17T02:54:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c51d9b640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c5415c060 0x7f5c54148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa802ef9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7fc0af820 0x7fa7fc14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fb2affff640 1 -- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015eeb0 msgr2=0x7fb2b01f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fb2affff640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015eeb0 0x7fb2b01f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fb2affff640 1 -- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b015c4b0 msgr2=0x7fb2b00cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fb2affff640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b015c4b0 0x7fb2b00cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fb2affff640 1 -- 172.21.15.104:0/4156689228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b01560e0 con 0x7fb2b006f3e0 2024-09-17T02:54:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa802ef9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc0cccd0 0x7fa7fc14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f63c0ff9640 1 -- 172.21.15.104:0/1713753357 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f63b4062d90 con 0x7f63c41502c0 2024-09-17T02:54:54.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c589cc640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c541f6450 0x7f5c541f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa802ef9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc06f4b0 con 0x7fa7fc0cccd0 2024-09-17T02:54:54.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa802ef9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc06f330 con 0x7fa7fc072590 2024-09-17T02:54:54.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7fc0af820 0x7fa7fc14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa802ef9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa7fc06f630 con 0x7fa7fc0af820 2024-09-17T02:54:54.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa7fbfff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7fc0af820 0x7fa7fc14a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:38408/0 (socket says 172.21.15.104:38408) 2024-09-17T02:54:54.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fa7fbfff640 1 -- 172.21.15.104:0/661533473 learned_addr learned my addr 172.21.15.104:0/661533473 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:54.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c589cc640 1 -- 172.21.15.104:0/3653368493 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5406f790 con 0x7f5c541f6450 2024-09-17T02:54:54.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c589cc640 1 -- 172.21.15.104:0/3653368493 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5406f610 con 0x7f5c5415c060 2024-09-17T02:54:54.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f5c589cc640 1 -- 172.21.15.104:0/3653368493 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5406f910 con 0x7f5c54152cd0 2024-09-17T02:54:54.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f5c52d9d640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c541f6450 0x7f5c541f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7fa800c95640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7fc072590 0x7fa7fc146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7fa801496640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc0cccd0 0x7fa7fc14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7f0079d9b640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0074056da0 0x7f00740d2180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f007000c3a0 tx=0x7f007000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f006affd640 1 -- 172.21.15.104:0/1286245558 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070011790 con 0x7f0074056da0 2024-09-17T02:54:54.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.554+0000 7fb2b4ecf640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015eeb0 0x7fb2b01f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:54.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7fb2affff640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2b006f3e0 0x7fb2b00cf4f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00718e0 tx=0x7fb2a00044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00740d4b10 con 0x7f0074056da0 2024-09-17T02:54:54.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00740e0ea0 con 0x7f0074056da0 2024-09-17T02:54:54.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f5c51d9b640 1 -- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c54152cd0 msgr2=0x7f5c54155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f5c51d9b640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c54152cd0 0x7f5c54155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f5c51d9b640 1 -- 172.21.15.104:0/3653368493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c541f6450 msgr2=0x7f5c541f6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f5c51d9b640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c541f6450 0x7f5c541f6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f5c51d9b640 1 -- 172.21.15.104:0/3653368493 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c541f6da0 con 0x7f5c5415c060 2024-09-17T02:54:54.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f006affd640 1 -- 172.21.15.104:0/1286245558 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0070017070 con 0x7f0074056da0 2024-09-17T02:54:54.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7f006affd640 1 -- 172.21.15.104:0/1286245558 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070011ce0 con 0x7f0074056da0 2024-09-17T02:54:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7fa7fbfff640 1 -- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7fc072590 msgr2=0x7fa7fc146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7fa7fbfff640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7fc072590 0x7fa7fc146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7fa7fbfff640 1 -- 172.21.15.104:0/661533473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc0cccd0 msgr2=0x7fa7fc14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7fa7fbfff640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc0cccd0 0x7fa7fc14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.556+0000 7fa7fbfff640 1 -- 172.21.15.104:0/661533473 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc0ce2a0 con 0x7fa7fc0af820 2024-09-17T02:54:54.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7feaaeffd640 1 -- 172.21.15.104:0/1679748675 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feaa001a070 con 0x7feab8070560 2024-09-17T02:54:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.555+0000 7fb2af7fe640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b015c4b0 0x7fb2b00cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.556+0000 7fa7fbfff640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7fc0af820 0x7fa7fc14a570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c3a0 tx=0x7fa7f000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.556+0000 7feaaeffd640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea98078b90 0x7fea9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.556+0000 7feaaeffd640 1 -- 172.21.15.104:0/1679748675 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feaa009a120 con 0x7feab8070560 2024-09-17T02:54:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.556+0000 7f5c51d9b640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c5415c060 0x7f5c54148880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800e660 tx=0x7f5c4800eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.556+0000 7fa7f97fa640 1 -- 172.21.15.104:0/661533473 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0017070 con 0x7fa7fc0af820 2024-09-17T02:54:54.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7feab5d9b640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea98078b90 0x7fea9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7fa7f97fa640 1 -- 172.21.15.104:0/661533473 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7f00053c0 con 0x7fa7fc0af820 2024-09-17T02:54:54.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7fa7f97fa640 1 -- 172.21.15.104:0/661533473 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0003850 con 0x7fa7fc0af820 2024-09-17T02:54:54.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7f5c42ffd640 1 -- 172.21.15.104:0/3653368493 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480052d0 con 0x7f5c5415c060 2024-09-17T02:54:54.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7fa802ef9640 1 -- 172.21.15.104:0/661533473 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc0cdce0 con 0x7fa7fc0af820 2024-09-17T02:54:54.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7fa802ef9640 1 -- 172.21.15.104:0/661533473 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc156120 con 0x7fa7fc0af820 2024-09-17T02:54:54.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7f5c589cc640 1 -- 172.21.15.104:0/3653368493 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c54154040 con 0x7f5c5415c060 2024-09-17T02:54:54.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7f5c42ffd640 1 -- 172.21.15.104:0/3653368493 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c48007020 con 0x7f5c5415c060 2024-09-17T02:54:54.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7f5c42ffd640 1 -- 172.21.15.104:0/3653368493 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48007470 con 0x7f5c5415c060 2024-09-17T02:54:54.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7f5c589cc640 1 -- 172.21.15.104:0/3653368493 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c54149ff0 con 0x7f5c5415c060 2024-09-17T02:54:54.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.557+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0060005290 con 0x7f0074056da0 2024-09-17T02:54:54.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.558+0000 7feab5d9b640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea98078b90 0x7fea9807b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feab8151980 tx=0x7feaa8009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.558+0000 7fa7e2ffd640 1 -- 172.21.15.104:0/661533473 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d4005290 con 0x7fa7fc0af820 2024-09-17T02:54:54.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.559+0000 7f5c40ff9640 1 -- 172.21.15.104:0/3653368493 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5406f0d0 con 0x7f5c5415c060 2024-09-17T02:54:54.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.560+0000 7f5c42ffd640 1 -- 172.21.15.104:0/3653368493 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c480016c0 con 0x7f5c5415c060 2024-09-17T02:54:54.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.560+0000 7fa7f97fa640 1 -- 172.21.15.104:0/661533473 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa7f001a070 con 0x7fa7fc0af820 2024-09-17T02:54:54.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.560+0000 7f5c42ffd640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c34078b90 0x7f5c3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.560+0000 7f5c42ffd640 1 -- 172.21.15.104:0/3653368493 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c4809eb00 con 0x7f5c5415c060 2024-09-17T02:54:54.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.560+0000 7f5c5259c640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c34078b90 0x7f5c3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.561+0000 7fa7f97fa640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7e807ada0 0x7fa7e807d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.561+0000 7fa800c95640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7e807ada0 0x7fa7e807d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.561+0000 7fa7f97fa640 1 -- 172.21.15.104:0/661533473 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa7f0099ea0 con 0x7fa7fc0af820 2024-09-17T02:54:54.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.561+0000 7f5c5259c640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c34078b90 0x7f5c3407b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c440096c0 tx=0x7f5c440046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.561+0000 7fa800c95640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7e807ada0 0x7fa7e807d2b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4034000 tx=0x7fa7f4004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.563+0000 7fb2acff9640 1 -- 172.21.15.104:0/4156689228 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0044020 con 0x7fb2b006f3e0 2024-09-17T02:54:54.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.563+0000 7feaaeffd640 1 -- 172.21.15.104:0/1679748675 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feab80b0170 con 0x7feab8070560 2024-09-17T02:54:54.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.563+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b01563c0 con 0x7fb2b006f3e0 2024-09-17T02:54:54.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.563+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b01566a0 con 0x7fb2b006f3e0 2024-09-17T02:54:54.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.564+0000 7fb2acff9640 1 -- 172.21.15.104:0/4156689228 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2a0003e20 con 0x7fb2b006f3e0 2024-09-17T02:54:54.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.564+0000 7fb2acff9640 1 -- 172.21.15.104:0/4156689228 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0037040 con 0x7fb2b006f3e0 2024-09-17T02:54:54.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.565+0000 7f5c42ffd640 1 -- 172.21.15.104:0/3653368493 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c48021030 con 0x7f5c5415c060 2024-09-17T02:54:54.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.565+0000 7f006affd640 1 -- 172.21.15.104:0/1286245558 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0070026430 con 0x7f0074056da0 2024-09-17T02:54:54.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.566+0000 7fa7f97fa640 1 -- 172.21.15.104:0/661533473 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa7f0061db0 con 0x7fa7fc0af820 2024-09-17T02:54:54.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.566+0000 7f006affd640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f005c078bc0 0x7f005c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.566+0000 7f006affd640 1 -- 172.21.15.104:0/1286245558 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f007009b350 con 0x7f0074056da0 2024-09-17T02:54:54.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.567+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb290005290 con 0x7fb2b006f3e0 2024-09-17T02:54:54.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.567+0000 7fb2acff9640 1 -- 172.21.15.104:0/4156689228 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb2a0047020 con 0x7fb2b006f3e0 2024-09-17T02:54:54.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.569+0000 7f007a59c640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f005c078bc0 0x7f005c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.568+0000 7fb2acff9640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb29c078bc0 0x7fb29c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:54.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.569+0000 7fb2af7fe640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb29c078bc0 0x7fb29c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:54.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.569+0000 7f007a59c640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f005c078bc0 0x7f005c07b0d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f006c034000 tx=0x7f006c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.570+0000 7fb2af7fe640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb29c078bc0 0x7fb29c07b0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0154ee0 tx=0x7fb2a80083d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:54.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.574+0000 7f006affd640 1 -- 172.21.15.104:0/1286245558 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0070063890 con 0x7f0074056da0 2024-09-17T02:54:54.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.574+0000 7fb2acff9640 1 -- 172.21.15.104:0/4156689228 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb2a00be620 con 0x7fb2b006f3e0 2024-09-17T02:54:54.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.584+0000 7fb2acff9640 1 -- 172.21.15.104:0/4156689228 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb2a004e030 con 0x7fb2b006f3e0 2024-09-17T02:54:54.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.896+0000 7f3005ffb640 1 -- 172.21.15.104:0/239411482 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f30200cfef0 con 0x7f30201600c0 2024-09-17T02:54:54.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.896+0000 7f3007fff640 1 -- 172.21.15.104:0/239411482 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3018067370 con 0x7f30201600c0 2024-09-17T02:54:54.896 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:54.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.900+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f300c078b90 msgr2=0x7f300c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.900+0000 7f3025e25640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f300c078b90 0x7f300c07b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3010009850 tx=0x7f3010004730 comp rx=0 tx=0).stop 2024-09-17T02:54:54.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.900+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30201600c0 msgr2=0x7f30201fdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.900+0000 7f3025e25640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30201600c0 0x7f30201fdc40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f301800be30 tx=0x7f301800bf20 comp rx=0 tx=0).stop 2024-09-17T02:54:54.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.900+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 shutdown_connections 2024-09-17T02:54:54.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.901+0000 7f3025e25640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f300c078b90 0x7f300c07b0a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.901+0000 7f3025e25640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30200d0b40 0x7f3020151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.901+0000 7f3025e25640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30201600c0 0x7f30201fdc40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.901+0000 7f3025e25640 1 --2- 172.21.15.104:0/239411482 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30200b4260 0x7f30200af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.901+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 >> 172.21.15.104:0/239411482 conn(0x7f3020068d00 msgr2=0x7f3020160550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.901+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 shutdown_connections 2024-09-17T02:54:54.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.901+0000 7f3025e25640 1 -- 172.21.15.104:0/239411482 wait complete. 2024-09-17T02:54:54.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.905+0000 7f39722b6640 1 -- 172.21.15.104:0/309422674 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f396c06f050 con 0x7f396c15c4b0 2024-09-17T02:54:54.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.910+0000 7f3968ff9640 1 -- 172.21.15.104:0/309422674 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f396c1f15a0 con 0x7f396c15c4b0 2024-09-17T02:54:54.910 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 -- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3958078c60 msgr2=0x7f395807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3958078c60 0x7f395807b170 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f395c036000 tx=0x7f395c0046c0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 -- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c15c4b0 msgr2=0x7f396c157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c15c4b0 0x7f396c157d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f396000b410 tx=0x7f396000b8d0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 -- 172.21.15.104:0/309422674 shutdown_connections 2024-09-17T02:54:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3958078c60 0x7f395807b170 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f396c158280 0x7f396c1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f396c15eeb0 0x7f396c1f4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.913+0000 7f39527fc640 1 --2- 172.21.15.104:0/309422674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396c15c4b0 0x7f396c157d40 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f396000b410 tx=0x7f396000b8d0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.914+0000 7f39527fc640 1 -- 172.21.15.104:0/309422674 >> 172.21.15.104:0/309422674 conn(0x7f396c0b3440 msgr2=0x7f396c06f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.914+0000 7f39527fc640 1 -- 172.21.15.104:0/309422674 shutdown_connections 2024-09-17T02:54:54.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.914+0000 7f39527fc640 1 -- 172.21.15.104:0/309422674 wait complete. 2024-09-17T02:54:54.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-17T02:54:54.920 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:54.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-17T02:54:54.930 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:54.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.938+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f63c4158de0 con 0x7f63c41502c0 2024-09-17T02:54:54.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.939+0000 7f63c0ff9640 1 -- 172.21.15.104:0/1713753357 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f63b40677c0 con 0x7f63c41502c0 2024-09-17T02:54:54.939 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:54.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63b0078c60 msgr2=0x7f63b007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63b0078c60 0x7f63b007b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63b8000c00 tx=0x7f63b8001bc0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63c41502c0 msgr2=0x7f63c406f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63c41502c0 0x7f63c406f600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f63c40b0290 tx=0x7f63b400ed80 comp rx=0 tx=0).stop 2024-09-17T02:54:54.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 shutdown_connections 2024-09-17T02:54:54.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63b0078c60 0x7f63b007b170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63c41502c0 0x7f63c406f600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63c414fd90 0x7f63c406f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 --2- 172.21.15.104:0/1713753357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63c41f1a30 0x7f63c414f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 >> 172.21.15.104:0/1713753357 conn(0x7f63c4068d00 msgr2=0x7f63c41551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 shutdown_connections 2024-09-17T02:54:54.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.941+0000 7f63ca713640 1 -- 172.21.15.104:0/1713753357 wait complete. 2024-09-17T02:54:54.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.946+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fea9c005580 con 0x7feab8070560 2024-09-17T02:54:54.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.946+0000 7feaaeffd640 1 -- 172.21.15.104:0/1679748675 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feaa0062550 con 0x7feab8070560 2024-09-17T02:54:54.946 INFO:teuthology.orchestra.run.smithi104.stdout:55834574855 2024-09-17T02:54:54.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.948+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea98078b90 msgr2=0x7fea9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.948+0000 7feabce0a640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea98078b90 0x7fea9807b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feab8151980 tx=0x7feaa8009260 comp rx=0 tx=0).stop 2024-09-17T02:54:54.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.948+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feab8070560 msgr2=0x7feab8149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feab8070560 0x7feab8149730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feaa000caf0 tx=0x7feaa000cef0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 shutdown_connections 2024-09-17T02:54:54.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea98078b90 0x7fea9807b0a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feab8151f50 0x7feab814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feab80afd60 0x7feab8149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 --2- 172.21.15.104:0/1679748675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feab8070560 0x7feab8149730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 >> 172.21.15.104:0/1679748675 conn(0x7feab80b2450 msgr2=0x7feab80b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 shutdown_connections 2024-09-17T02:54:54.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.949+0000 7feabce0a640 1 -- 172.21.15.104:0/1679748675 wait complete. 2024-09-17T02:54:54.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-17T02:54:54.952 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:54.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-09-17T02:54:54.959 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:54.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.978+0000 7f5c40ff9640 1 -- 172.21.15.104:0/3653368493 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5c5415bb80 con 0x7f5c5415c060 2024-09-17T02:54:54.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.978+0000 7f5c42ffd640 1 -- 172.21.15.104:0/3653368493 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c541f6da0 con 0x7f5c5415c060 2024-09-17T02:54:54.978 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:54.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.981+0000 7fa7e2ffd640 1 -- 172.21.15.104:0/661533473 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa7d4005580 con 0x7fa7fc0af820 2024-09-17T02:54:54.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.981+0000 7fa7f97fa640 1 -- 172.21.15.104:0/661533473 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa7f00667e0 con 0x7fa7fc0af820 2024-09-17T02:54:54.981 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 -- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c34078b90 msgr2=0x7f5c3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c34078b90 0x7f5c3407b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c440096c0 tx=0x7f5c440046c0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 -- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c5415c060 msgr2=0x7f5c54148880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c5415c060 0x7f5c54148880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800e660 tx=0x7f5c4800eb20 comp rx=0 tx=0).stop 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 -- 172.21.15.104:0/3653368493 shutdown_connections 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c34078b90 0x7f5c3407b0a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c5415c060 0x7f5c54148880 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c541f6450 0x7f5c541f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 --2- 172.21.15.104:0/3653368493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c54152cd0 0x7f5c54155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 -- 172.21.15.104:0/3653368493 >> 172.21.15.104:0/3653368493 conn(0x7f5c540b35d0 msgr2=0x7f5c5406fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 -- 172.21.15.104:0/3653368493 shutdown_connections 2024-09-17T02:54:54.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.982+0000 7f5c40ff9640 1 -- 172.21.15.104:0/3653368493 wait complete. 2024-09-17T02:54:54.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.984+0000 7fa7e2ffd640 1 -- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7e807ada0 msgr2=0x7fa7e807d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.984+0000 7fa7e2ffd640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7e807ada0 0x7fa7e807d2b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4034000 tx=0x7fa7f4004ab0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.984+0000 7fa7e2ffd640 1 -- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7fc0af820 msgr2=0x7fa7fc14a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.984+0000 7fa7e2ffd640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7fc0af820 0x7fa7fc14a570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c3a0 tx=0x7fa7f000c860 comp rx=0 tx=0).stop 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.985+0000 7fa7e2ffd640 1 -- 172.21.15.104:0/661533473 shutdown_connections 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.985+0000 7fa7e2ffd640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7e807ada0 0x7fa7e807d2b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.985+0000 7fa7e2ffd640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7fc0cccd0 0x7fa7fc14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.985+0000 7fa7e2ffd640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7fc0af820 0x7fa7fc14a570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.985+0000 7fa7e2ffd640 1 --2- 172.21.15.104:0/661533473 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7fc072590 0x7fa7fc146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.985+0000 7fa7e2ffd640 1 -- 172.21.15.104:0/661533473 >> 172.21.15.104:0/661533473 conn(0x7fa7fc0b2450 msgr2=0x7fa7fc0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.985+0000 7fa7e2ffd640 1 -- 172.21.15.104:0/661533473 shutdown_connections 2024-09-17T02:54:54.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.985+0000 7fa7e2ffd640 1 -- 172.21.15.104:0/661533473 wait complete. 2024-09-17T02:54:54.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.988+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0060005850 con 0x7f0074056da0 2024-09-17T02:54:54.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.988+0000 7f006affd640 1 -- 172.21.15.104:0/1286245558 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0070063190 con 0x7f0074056da0 2024-09-17T02:54:54.988 INFO:teuthology.orchestra.run.smithi104.stdout:55834574856 2024-09-17T02:54:54.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.990+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f005c078bc0 msgr2=0x7f005c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f005c078bc0 0x7f005c07b0d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f006c034000 tx=0x7f006c004730 comp rx=0 tx=0).stop 2024-09-17T02:54:54.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0074056da0 msgr2=0x7f00740d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:54.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0074056da0 0x7f00740d2180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f007000c3a0 tx=0x7f007000c860 comp rx=0 tx=0).stop 2024-09-17T02:54:54.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 shutdown_connections 2024-09-17T02:54:54.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f005c078bc0 0x7f005c07b0d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00740d40e0 0x7f00740d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0074056da0 0x7f00740d2180 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 --2- 172.21.15.104:0/1286245558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00740537b0 0x7f00740d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:54.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 >> 172.21.15.104:0/1286245558 conn(0x7f007403a5f0 msgr2=0x7f00740db750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:54.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 shutdown_connections 2024-09-17T02:54:54.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.991+0000 7f007b59e640 1 -- 172.21.15.104:0/1286245558 wait complete. 2024-09-17T02:54:54.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-17T02:54:54.994 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:54.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.998+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb290005850 con 0x7fb2b006f3e0 2024-09-17T02:54:54.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:54.998+0000 7fb2acff9640 1 -- 172.21.15.104:0/4156689228 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb2a0088070 con 0x7fb2b006f3e0 2024-09-17T02:54:54.998 INFO:teuthology.orchestra.run.smithi104.stdout:55834574854 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb29c078bc0 msgr2=0x7fb29c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb29c078bc0 0x7fb29c07b0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0154ee0 tx=0x7fb2a80083d0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2b006f3e0 msgr2=0x7fb2b00cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2b006f3e0 0x7fb2b00cf4f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00718e0 tx=0x7fb2a00044b0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 shutdown_connections 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb29c078bc0 0x7fb29c07b0d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2b015c4b0 0x7fb2b00cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb2b015eeb0 0x7fb2b01f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 --2- 172.21.15.104:0/4156689228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb2b006f3e0 0x7fb2b00cf4f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.001+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 >> 172.21.15.104:0/4156689228 conn(0x7fb2b00b3440 msgr2=0x7fb2b015f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:55.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.002+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 shutdown_connections 2024-09-17T02:54:55.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.002+0000 7fb2b6932640 1 -- 172.21.15.104:0/4156689228 wait complete. 2024-09-17T02:54:55.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-17T02:54:55.005 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:55.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-09-17T02:54:55.005 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:55.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-09-17T02:54:55.012 DEBUG:teuthology.parallel:result is None 2024-09-17T02:54:55.012 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:54:55.012 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:54:55.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.164+0000 7f56f6807640 1 -- 172.21.15.104:0/2390622868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56dc004800 msgr2=0x7f56dc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.164+0000 7f56f6807640 1 --2- 172.21.15.104:0/2390622868 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56dc004800 0x7f56dc004c10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f56f0163e40 tx=0x7f56dc005830 comp rx=0 tx=0).stop 2024-09-17T02:54:55.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.164+0000 7f56f4da4640 1 -- 172.21.15.104:0/2390622868 reap_dead start 2024-09-17T02:54:55.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.165+0000 7f56f6807640 1 -- 172.21.15.104:0/2390622868 shutdown_connections 2024-09-17T02:54:55.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.165+0000 7f56f6807640 1 -- 172.21.15.104:0/2390622868 >> 172.21.15.104:0/2390622868 conn(0x7f56f0069120 msgr2=0x7f56f0069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:55.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.165+0000 7f56f6807640 1 -- 172.21.15.104:0/2390622868 shutdown_connections 2024-09-17T02:54:55.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.165+0000 7f56f6807640 1 -- 172.21.15.104:0/2390622868 wait complete. 2024-09-17T02:54:55.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.166+0000 7f56f6807640 1 Processor -- start 2024-09-17T02:54:55.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.166+0000 7f56f6807640 1 -- start start 2024-09-17T02:54:55.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f6807640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56dc004800 0x7f56f01f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f6807640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56f014f9e0 0x7f56f00cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f6807640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f00b83e0 0x7f56f00b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f6807640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f56f01618c0 con 0x7f56f014f9e0 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f6807640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f56f015f900 con 0x7f56f00b83e0 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f6807640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f56f0161a40 con 0x7f56dc004800 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56f014f9e0 0x7f56f00cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56f014f9e0 0x7f56f00cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50632/0 (socket says 172.21.15.104:50632) 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 -- 172.21.15.104:0/3619605240 learned_addr learned my addr 172.21.15.104:0/3619605240 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f4da4640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f00b83e0 0x7f56f00b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56effff640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56dc004800 0x7f56f01f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 -- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56dc004800 msgr2=0x7f56f01f8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56dc004800 0x7f56f01f8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 -- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f00b83e0 msgr2=0x7f56f00b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f00b83e0 0x7f56f00b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 -- 172.21.15.104:0/3619605240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f00cbdf0 con 0x7f56f014f9e0 2024-09-17T02:54:55.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56e7fff640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56f014f9e0 0x7f56f00cea40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56d800bbe0 tx=0x7f56d80326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:55.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56ed7fa640 1 -- 172.21.15.104:0/3619605240 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8041070 con 0x7f56f014f9e0 2024-09-17T02:54:55.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56ed7fa640 1 -- 172.21.15.104:0/3619605240 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56d8032de0 con 0x7f56f014f9e0 2024-09-17T02:54:55.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f00ce240 con 0x7f56f014f9e0 2024-09-17T02:54:55.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56ed7fa640 1 -- 172.21.15.104:0/3619605240 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8045660 con 0x7f56f014f9e0 2024-09-17T02:54:55.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.168+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f00cb760 con 0x7f56f014f9e0 2024-09-17T02:54:55.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.169+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f0161380 con 0x7f56f014f9e0 2024-09-17T02:54:55.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.170+0000 7f56ed7fa640 1 -- 172.21.15.104:0/3619605240 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56d8045800 con 0x7f56f014f9e0 2024-09-17T02:54:55.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.171+0000 7f56ed7fa640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f56d0078bc0 0x7f56d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.171+0000 7f56ed7fa640 1 -- 172.21.15.104:0/3619605240 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f56d80bb990 con 0x7f56f014f9e0 2024-09-17T02:54:55.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.171+0000 7f56effff640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f56d0078bc0 0x7f56d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.171+0000 7f56effff640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f56d0078bc0 0x7f56d007b0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56f00d1e60 tx=0x7f56e00067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:55.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.175+0000 7f56ed7fa640 1 -- 172.21.15.104:0/3619605240 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56d8083780 con 0x7f56f014f9e0 2024-09-17T02:54:55.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.346+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56f00cbba0 con 0x7f56d0078bc0 2024-09-17T02:54:55.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.351+0000 7f56ed7fa640 1 -- 172.21.15.104:0/3619605240 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247475 (secure 0 0 0) 0x7f56f00cbba0 con 0x7f56d0078bc0 2024-09-17T02:54:55.354 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:55.356 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:54:55.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.354+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f56d0078bc0 msgr2=0x7f56d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.354+0000 7f56f6807640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f56d0078bc0 0x7f56d007b0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f56f00d1e60 tx=0x7f56e00067a0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.354+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56f014f9e0 msgr2=0x7f56f00cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.354+0000 7f56f6807640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56f014f9e0 0x7f56f00cea40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56d800bbe0 tx=0x7f56d80326f0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.354+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 shutdown_connections 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.354+0000 7f56f6807640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f56d0078bc0 0x7f56d007b0d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.354+0000 7f56f6807640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56f00b83e0 0x7f56f00b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.355+0000 7f56f6807640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56f014f9e0 0x7f56f00cea40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.355+0000 7f56f6807640 1 --2- 172.21.15.104:0/3619605240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56dc004800 0x7f56f01f8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.355+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 >> 172.21.15.104:0/3619605240 conn(0x7f56f0069120 msgr2=0x7f56f00d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.355+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 shutdown_connections 2024-09-17T02:54:55.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.355+0000 7f56f6807640 1 -- 172.21.15.104:0/3619605240 wait complete. 2024-09-17T02:54:55.365 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T02:54:53.622024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210884,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.486336"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137914+0000","last_change":"2024-09-17T02:54:42.140130+0000","last_active":"2024-09-17T02:54:43.137914+0000","last_peered":"2024-09-17T02:54:43.137914+0000","last_clean":"2024-09-17T02:54:43.137914+0000","last_became_active":"2024-09-17T02:54:42.139834+0000","last_became_peered":"2024-09-17T02:54:42.139834+0000","last_unstale":"2024-09-17T02:54:43.137914+0000","last_undegraded":"2024-09-17T02:54:43.137914+0000","last_fullsized":"2024-09-17T02:54:43.137914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:28.350535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155882+0000","last_change":"2024-09-17T02:54:42.141968+0000","last_active":"2024-09-17T02:54:43.155882+0000","last_peered":"2024-09-17T02:54:43.155882+0000","last_clean":"2024-09-17T02:54:43.155882+0000","last_became_active":"2024-09-17T02:54:42.141689+0000","last_became_peered":"2024-09-17T02:54:42.141689+0000","last_unstale":"2024-09-17T02:54:43.155882+0000","last_undegraded":"2024-09-17T02:54:43.155882+0000","last_fullsized":"2024-09-17T02:54:43.155882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:20.331776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358124+0000","last_change":"2024-09-17T02:54:42.142005+0000","last_active":"2024-09-17T02:54:43.358124+0000","last_peered":"2024-09-17T02:54:43.358124+0000","last_clean":"2024-09-17T02:54:43.358124+0000","last_became_active":"2024-09-17T02:54:42.141718+0000","last_became_peered":"2024-09-17T02:54:42.141718+0000","last_unstale":"2024-09-17T02:54:43.358124+0000","last_undegraded":"2024-09-17T02:54:43.358124+0000","last_fullsized":"2024-09-17T02:54:43.358124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:56.699293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357892+0000","last_change":"2024-09-17T02:54:42.150263+0000","last_active":"2024-09-17T02:54:43.357892+0000","last_peered":"2024-09-17T02:54:43.357892+0000","last_clean":"2024-09-17T02:54:43.357892+0000","last_became_active":"2024-09-17T02:54:42.149350+0000","last_became_peered":"2024-09-17T02:54:42.149350+0000","last_unstale":"2024-09-17T02:54:43.357892+0000","last_undegraded":"2024-09-17T02:54:43.357892+0000","last_fullsized":"2024-09-17T02:54:43.357892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:06.932470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136283+0000","last_change":"2024-09-17T02:54:42.144157+0000","last_active":"2024-09-17T02:54:43.136283+0000","last_peered":"2024-09-17T02:54:43.136283+0000","last_clean":"2024-09-17T02:54:43.136283+0000","last_became_active":"2024-09-17T02:54:42.143838+0000","last_became_peered":"2024-09-17T02:54:42.143838+0000","last_unstale":"2024-09-17T02:54:43.136283+0000","last_undegraded":"2024-09-17T02:54:43.136283+0000","last_fullsized":"2024-09-17T02:54:43.136283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:54.631778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358412+0000","last_change":"2024-09-17T02:54:42.153836+0000","last_active":"2024-09-17T02:54:43.358412+0000","last_peered":"2024-09-17T02:54:43.358412+0000","last_clean":"2024-09-17T02:54:43.358412+0000","last_became_active":"2024-09-17T02:54:42.153241+0000","last_became_peered":"2024-09-17T02:54:42.153241+0000","last_unstale":"2024-09-17T02:54:43.358412+0000","last_undegraded":"2024-09-17T02:54:43.358412+0000","last_fullsized":"2024-09-17T02:54:43.358412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:48.474724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136521+0000","last_change":"2024-09-17T02:54:42.145342+0000","last_active":"2024-09-17T02:54:43.136521+0000","last_peered":"2024-09-17T02:54:43.136521+0000","last_clean":"2024-09-17T02:54:43.136521+0000","last_became_active":"2024-09-17T02:54:42.145047+0000","last_became_peered":"2024-09-17T02:54:42.145047+0000","last_unstale":"2024-09-17T02:54:43.136521+0000","last_undegraded":"2024-09-17T02:54:43.136521+0000","last_fullsized":"2024-09-17T02:54:43.136521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:42.226480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359172+0000","last_change":"2024-09-17T02:54:42.148964+0000","last_active":"2024-09-17T02:54:43.359172+0000","last_peered":"2024-09-17T02:54:43.359172+0000","last_clean":"2024-09-17T02:54:43.359172+0000","last_became_active":"2024-09-17T02:54:42.148715+0000","last_became_peered":"2024-09-17T02:54:42.148715+0000","last_unstale":"2024-09-17T02:54:43.359172+0000","last_undegraded":"2024-09-17T02:54:43.359172+0000","last_fullsized":"2024-09-17T02:54:43.359172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:04.427855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136047+0000","last_change":"2024-09-17T02:54:42.152096+0000","last_active":"2024-09-17T02:54:43.136047+0000","last_peered":"2024-09-17T02:54:43.136047+0000","last_clean":"2024-09-17T02:54:43.136047+0000","last_became_active":"2024-09-17T02:54:42.149125+0000","last_became_peered":"2024-09-17T02:54:42.149125+0000","last_unstale":"2024-09-17T02:54:43.136047+0000","last_undegraded":"2024-09-17T02:54:43.136047+0000","last_fullsized":"2024-09-17T02:54:43.136047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:02.023988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137292+0000","last_change":"2024-09-17T02:54:42.149053+0000","last_active":"2024-09-17T02:54:43.137292+0000","last_peered":"2024-09-17T02:54:43.137292+0000","last_clean":"2024-09-17T02:54:43.137292+0000","last_became_active":"2024-09-17T02:54:42.148769+0000","last_became_peered":"2024-09-17T02:54:42.148769+0000","last_unstale":"2024-09-17T02:54:43.137292+0000","last_undegraded":"2024-09-17T02:54:43.137292+0000","last_fullsized":"2024-09-17T02:54:43.137292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:15.308833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137914+0000","last_change":"2024-09-17T02:54:42.153697+0000","last_active":"2024-09-17T02:54:43.137914+0000","last_peered":"2024-09-17T02:54:43.137914+0000","last_clean":"2024-09-17T02:54:43.137914+0000","last_became_active":"2024-09-17T02:54:42.153422+0000","last_became_peered":"2024-09-17T02:54:42.153422+0000","last_unstale":"2024-09-17T02:54:43.137914+0000","last_undegraded":"2024-09-17T02:54:43.137914+0000","last_fullsized":"2024-09-17T02:54:43.137914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.907995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137542+0000","last_change":"2024-09-17T02:54:42.145613+0000","last_active":"2024-09-17T02:54:43.137542+0000","last_peered":"2024-09-17T02:54:43.137542+0000","last_clean":"2024-09-17T02:54:43.137542+0000","last_became_active":"2024-09-17T02:54:42.145348+0000","last_became_peered":"2024-09-17T02:54:42.145348+0000","last_unstale":"2024-09-17T02:54:43.137542+0000","last_undegraded":"2024-09-17T02:54:43.137542+0000","last_fullsized":"2024-09-17T02:54:43.137542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:59.383826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359478+0000","last_change":"2024-09-17T02:54:42.147714+0000","last_active":"2024-09-17T02:54:43.359478+0000","last_peered":"2024-09-17T02:54:43.359478+0000","last_clean":"2024-09-17T02:54:43.359478+0000","last_became_active":"2024-09-17T02:54:42.147073+0000","last_became_peered":"2024-09-17T02:54:42.147073+0000","last_unstale":"2024-09-17T02:54:43.359478+0000","last_undegraded":"2024-09-17T02:54:43.359478+0000","last_fullsized":"2024-09-17T02:54:43.359478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:38.256856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357881+0000","last_change":"2024-09-17T02:54:42.140804+0000","last_active":"2024-09-17T02:54:43.357881+0000","last_peered":"2024-09-17T02:54:43.357881+0000","last_clean":"2024-09-17T02:54:43.357881+0000","last_became_active":"2024-09-17T02:54:42.140549+0000","last_became_peered":"2024-09-17T02:54:42.140549+0000","last_unstale":"2024-09-17T02:54:43.357881+0000","last_undegraded":"2024-09-17T02:54:43.357881+0000","last_fullsized":"2024-09-17T02:54:43.357881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.021489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155948+0000","last_change":"2024-09-17T02:54:42.156204+0000","last_active":"2024-09-17T02:54:43.155948+0000","last_peered":"2024-09-17T02:54:43.155948+0000","last_clean":"2024-09-17T02:54:43.155948+0000","last_became_active":"2024-09-17T02:54:42.155909+0000","last_became_peered":"2024-09-17T02:54:42.155909+0000","last_unstale":"2024-09-17T02:54:43.155948+0000","last_undegraded":"2024-09-17T02:54:43.155948+0000","last_fullsized":"2024-09-17T02:54:43.155948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:17.059902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358116+0000","last_change":"2024-09-17T02:54:42.155716+0000","last_active":"2024-09-17T02:54:43.358116+0000","last_peered":"2024-09-17T02:54:43.358116+0000","last_clean":"2024-09-17T02:54:43.358116+0000","last_became_active":"2024-09-17T02:54:42.153579+0000","last_became_peered":"2024-09-17T02:54:42.153579+0000","last_unstale":"2024-09-17T02:54:43.358116+0000","last_undegraded":"2024-09-17T02:54:43.358116+0000","last_fullsized":"2024-09-17T02:54:43.358116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:05.617863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358011+0000","last_change":"2024-09-17T02:54:42.156424+0000","last_active":"2024-09-17T02:54:43.358011+0000","last_peered":"2024-09-17T02:54:43.358011+0000","last_clean":"2024-09-17T02:54:43.358011+0000","last_became_active":"2024-09-17T02:54:42.153491+0000","last_became_peered":"2024-09-17T02:54:42.153491+0000","last_unstale":"2024-09-17T02:54:43.358011+0000","last_undegraded":"2024-09-17T02:54:43.358011+0000","last_fullsized":"2024-09-17T02:54:43.358011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:29.742009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357974+0000","last_change":"2024-09-17T02:54:42.137938+0000","last_active":"2024-09-17T02:54:43.357974+0000","last_peered":"2024-09-17T02:54:43.357974+0000","last_clean":"2024-09-17T02:54:43.357974+0000","last_became_active":"2024-09-17T02:54:42.137668+0000","last_became_peered":"2024-09-17T02:54:42.137668+0000","last_unstale":"2024-09-17T02:54:43.357974+0000","last_undegraded":"2024-09-17T02:54:43.357974+0000","last_fullsized":"2024-09-17T02:54:43.357974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:10.660192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136589+0000","last_change":"2024-09-17T02:54:42.149999+0000","last_active":"2024-09-17T02:54:43.136589+0000","last_peered":"2024-09-17T02:54:43.136589+0000","last_clean":"2024-09-17T02:54:43.136589+0000","last_became_active":"2024-09-17T02:54:42.148750+0000","last_became_peered":"2024-09-17T02:54:42.148750+0000","last_unstale":"2024-09-17T02:54:43.136589+0000","last_undegraded":"2024-09-17T02:54:43.136589+0000","last_fullsized":"2024-09-17T02:54:43.136589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:44.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137550+0000","last_change":"2024-09-17T02:54:42.158291+0000","last_active":"2024-09-17T02:54:43.137550+0000","last_peered":"2024-09-17T02:54:43.137550+0000","last_clean":"2024-09-17T02:54:43.137550+0000","last_became_active":"2024-09-17T02:54:42.157953+0000","last_became_peered":"2024-09-17T02:54:42.157953+0000","last_unstale":"2024-09-17T02:54:43.137550+0000","last_undegraded":"2024-09-17T02:54:43.137550+0000","last_fullsized":"2024-09-17T02:54:43.137550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:02.774661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359170+0000","last_change":"2024-09-17T02:54:42.148225+0000","last_active":"2024-09-17T02:54:43.359170+0000","last_peered":"2024-09-17T02:54:43.359170+0000","last_clean":"2024-09-17T02:54:43.359170+0000","last_became_active":"2024-09-17T02:54:42.147920+0000","last_became_peered":"2024-09-17T02:54:42.147920+0000","last_unstale":"2024-09-17T02:54:43.359170+0000","last_undegraded":"2024-09-17T02:54:43.359170+0000","last_fullsized":"2024-09-17T02:54:43.359170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:41.335772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358522+0000","last_change":"2024-09-17T02:54:42.154258+0000","last_active":"2024-09-17T02:54:43.358522+0000","last_peered":"2024-09-17T02:54:43.358522+0000","last_clean":"2024-09-17T02:54:43.358522+0000","last_became_active":"2024-09-17T02:54:42.151466+0000","last_became_peered":"2024-09-17T02:54:42.151466+0000","last_unstale":"2024-09-17T02:54:43.358522+0000","last_undegraded":"2024-09-17T02:54:43.358522+0000","last_fullsized":"2024-09-17T02:54:43.358522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:00.920687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359980+0000","last_change":"2024-09-17T02:54:42.157130+0000","last_active":"2024-09-17T02:54:43.359980+0000","last_peered":"2024-09-17T02:54:43.359980+0000","last_clean":"2024-09-17T02:54:43.359980+0000","last_became_active":"2024-09-17T02:54:42.156580+0000","last_became_peered":"2024-09-17T02:54:42.156580+0000","last_unstale":"2024-09-17T02:54:43.359980+0000","last_undegraded":"2024-09-17T02:54:43.359980+0000","last_fullsized":"2024-09-17T02:54:43.359980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:10.309065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358156+0000","last_change":"2024-09-17T02:54:42.149936+0000","last_active":"2024-09-17T02:54:43.358156+0000","last_peered":"2024-09-17T02:54:43.358156+0000","last_clean":"2024-09-17T02:54:43.358156+0000","last_became_active":"2024-09-17T02:54:42.148805+0000","last_became_peered":"2024-09-17T02:54:42.148805+0000","last_unstale":"2024-09-17T02:54:43.358156+0000","last_undegraded":"2024-09-17T02:54:43.358156+0000","last_fullsized":"2024-09-17T02:54:43.358156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:12.654505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358203+0000","last_change":"2024-09-17T02:54:42.156633+0000","last_active":"2024-09-17T02:54:43.358203+0000","last_peered":"2024-09-17T02:54:43.358203+0000","last_clean":"2024-09-17T02:54:43.358203+0000","last_became_active":"2024-09-17T02:54:42.156344+0000","last_became_peered":"2024-09-17T02:54:42.156344+0000","last_unstale":"2024-09-17T02:54:43.358203+0000","last_undegraded":"2024-09-17T02:54:43.358203+0000","last_fullsized":"2024-09-17T02:54:43.358203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:26.079679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138163+0000","last_change":"2024-09-17T02:54:42.141191+0000","last_active":"2024-09-17T02:54:43.138163+0000","last_peered":"2024-09-17T02:54:43.138163+0000","last_clean":"2024-09-17T02:54:43.138163+0000","last_became_active":"2024-09-17T02:54:42.140736+0000","last_became_peered":"2024-09-17T02:54:42.140736+0000","last_unstale":"2024-09-17T02:54:43.138163+0000","last_undegraded":"2024-09-17T02:54:43.138163+0000","last_fullsized":"2024-09-17T02:54:43.138163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:45.082145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156112+0000","last_change":"2024-09-17T02:54:42.144099+0000","last_active":"2024-09-17T02:54:43.156112+0000","last_peered":"2024-09-17T02:54:43.156112+0000","last_clean":"2024-09-17T02:54:43.156112+0000","last_became_active":"2024-09-17T02:54:42.143809+0000","last_became_peered":"2024-09-17T02:54:42.143809+0000","last_unstale":"2024-09-17T02:54:43.156112+0000","last_undegraded":"2024-09-17T02:54:43.156112+0000","last_fullsized":"2024-09-17T02:54:43.156112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:19.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359685+0000","last_change":"2024-09-17T02:54:42.156846+0000","last_active":"2024-09-17T02:54:43.359685+0000","last_peered":"2024-09-17T02:54:43.359685+0000","last_clean":"2024-09-17T02:54:43.359685+0000","last_became_active":"2024-09-17T02:54:42.156229+0000","last_became_peered":"2024-09-17T02:54:42.156229+0000","last_unstale":"2024-09-17T02:54:43.359685+0000","last_undegraded":"2024-09-17T02:54:43.359685+0000","last_fullsized":"2024-09-17T02:54:43.359685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:14.258007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358116+0000","last_change":"2024-09-17T02:54:42.147973+0000","last_active":"2024-09-17T02:54:43.358116+0000","last_peered":"2024-09-17T02:54:43.358116+0000","last_clean":"2024-09-17T02:54:43.358116+0000","last_became_active":"2024-09-17T02:54:42.147642+0000","last_became_peered":"2024-09-17T02:54:42.147642+0000","last_unstale":"2024-09-17T02:54:43.358116+0000","last_undegraded":"2024-09-17T02:54:43.358116+0000","last_fullsized":"2024-09-17T02:54:43.358116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:32.329063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358017+0000","last_change":"2024-09-17T02:54:42.148238+0000","last_active":"2024-09-17T02:54:43.358017+0000","last_peered":"2024-09-17T02:54:43.358017+0000","last_clean":"2024-09-17T02:54:43.358017+0000","last_became_active":"2024-09-17T02:54:42.147968+0000","last_became_peered":"2024-09-17T02:54:42.147968+0000","last_unstale":"2024-09-17T02:54:43.358017+0000","last_undegraded":"2024-09-17T02:54:43.358017+0000","last_fullsized":"2024-09-17T02:54:43.358017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:34.663251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358738+0000","last_change":"2024-09-17T02:54:42.153412+0000","last_active":"2024-09-17T02:54:43.358738+0000","last_peered":"2024-09-17T02:54:43.358738+0000","last_clean":"2024-09-17T02:54:43.358738+0000","last_became_active":"2024-09-17T02:54:42.153203+0000","last_became_peered":"2024-09-17T02:54:42.153203+0000","last_unstale":"2024-09-17T02:54:43.358738+0000","last_undegraded":"2024-09-17T02:54:43.358738+0000","last_fullsized":"2024-09-17T02:54:43.358738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:17.922940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137503+0000","last_change":"2024-09-17T02:54:42.143439+0000","last_active":"2024-09-17T02:54:43.137503+0000","last_peered":"2024-09-17T02:54:43.137503+0000","last_clean":"2024-09-17T02:54:43.137503+0000","last_became_active":"2024-09-17T02:54:42.141811+0000","last_became_peered":"2024-09-17T02:54:42.141811+0000","last_unstale":"2024-09-17T02:54:43.137503+0000","last_undegraded":"2024-09-17T02:54:43.137503+0000","last_fullsized":"2024-09-17T02:54:43.137503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:00.262503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.139107+0000","last_change":"2024-09-17T02:54:42.155339+0000","last_active":"2024-09-17T02:54:43.139107+0000","last_peered":"2024-09-17T02:54:43.139107+0000","last_clean":"2024-09-17T02:54:43.139107+0000","last_became_active":"2024-09-17T02:54:42.154873+0000","last_became_peered":"2024-09-17T02:54:42.154873+0000","last_unstale":"2024-09-17T02:54:43.139107+0000","last_undegraded":"2024-09-17T02:54:43.139107+0000","last_fullsized":"2024-09-17T02:54:43.139107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:05.213755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359385+0000","last_change":"2024-09-17T02:54:41.136992+0000","last_active":"2024-09-17T02:54:43.359385+0000","last_peered":"2024-09-17T02:54:43.359385+0000","last_clean":"2024-09-17T02:54:43.359385+0000","last_became_active":"2024-09-17T02:54:41.136720+0000","last_became_peered":"2024-09-17T02:54:41.136720+0000","last_unstale":"2024-09-17T02:54:43.359385+0000","last_undegraded":"2024-09-17T02:54:43.359385+0000","last_fullsized":"2024-09-17T02:54:43.359385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:03.837671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358718+0000","last_change":"2024-09-17T02:54:42.156499+0000","last_active":"2024-09-17T02:54:43.358718+0000","last_peered":"2024-09-17T02:54:43.358718+0000","last_clean":"2024-09-17T02:54:43.358718+0000","last_became_active":"2024-09-17T02:54:42.156211+0000","last_became_peered":"2024-09-17T02:54:42.156211+0000","last_unstale":"2024-09-17T02:54:43.358718+0000","last_undegraded":"2024-09-17T02:54:43.358718+0000","last_fullsized":"2024-09-17T02:54:43.358718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:40.881577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136922+0000","last_change":"2024-09-17T02:54:41.125908+0000","last_active":"2024-09-17T02:54:43.136922+0000","last_peered":"2024-09-17T02:54:43.136922+0000","last_clean":"2024-09-17T02:54:43.136922+0000","last_became_active":"2024-09-17T02:54:41.124285+0000","last_became_peered":"2024-09-17T02:54:41.124285+0000","last_unstale":"2024-09-17T02:54:43.136922+0000","last_undegraded":"2024-09-17T02:54:43.136922+0000","last_fullsized":"2024-09-17T02:54:43.136922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:26.638048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358830+0000","last_change":"2024-09-17T02:54:41.133974+0000","last_active":"2024-09-17T02:54:43.358830+0000","last_peered":"2024-09-17T02:54:43.358830+0000","last_clean":"2024-09-17T02:54:43.358830+0000","last_became_active":"2024-09-17T02:54:41.130208+0000","last_became_peered":"2024-09-17T02:54:41.130208+0000","last_unstale":"2024-09-17T02:54:43.358830+0000","last_undegraded":"2024-09-17T02:54:43.358830+0000","last_fullsized":"2024-09-17T02:54:43.358830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.121870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358442+0000","last_change":"2024-09-17T02:54:42.147110+0000","last_active":"2024-09-17T02:54:43.358442+0000","last_peered":"2024-09-17T02:54:43.358442+0000","last_clean":"2024-09-17T02:54:43.358442+0000","last_became_active":"2024-09-17T02:54:42.146853+0000","last_became_peered":"2024-09-17T02:54:42.146853+0000","last_unstale":"2024-09-17T02:54:43.358442+0000","last_undegraded":"2024-09-17T02:54:43.358442+0000","last_fullsized":"2024-09-17T02:54:43.358442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:08.683366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358321+0000","last_change":"2024-09-17T02:54:41.133392+0000","last_active":"2024-09-17T02:54:43.358321+0000","last_peered":"2024-09-17T02:54:43.358321+0000","last_clean":"2024-09-17T02:54:43.358321+0000","last_became_active":"2024-09-17T02:54:41.130773+0000","last_became_peered":"2024-09-17T02:54:41.130773+0000","last_unstale":"2024-09-17T02:54:43.358321+0000","last_undegraded":"2024-09-17T02:54:43.358321+0000","last_fullsized":"2024-09-17T02:54:43.358321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:55.515228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155934+0000","last_change":"2024-09-17T02:54:42.144622+0000","last_active":"2024-09-17T02:54:43.155934+0000","last_peered":"2024-09-17T02:54:43.155934+0000","last_clean":"2024-09-17T02:54:43.155934+0000","last_became_active":"2024-09-17T02:54:42.144372+0000","last_became_peered":"2024-09-17T02:54:42.144372+0000","last_unstale":"2024-09-17T02:54:43.155934+0000","last_undegraded":"2024-09-17T02:54:43.155934+0000","last_fullsized":"2024-09-17T02:54:43.155934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:30.258039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138441+0000","last_change":"2024-09-17T02:54:41.136164+0000","last_active":"2024-09-17T02:54:43.138441+0000","last_peered":"2024-09-17T02:54:43.138441+0000","last_clean":"2024-09-17T02:54:43.138441+0000","last_became_active":"2024-09-17T02:54:41.135870+0000","last_became_peered":"2024-09-17T02:54:41.135870+0000","last_unstale":"2024-09-17T02:54:43.138441+0000","last_undegraded":"2024-09-17T02:54:43.138441+0000","last_fullsized":"2024-09-17T02:54:43.138441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:21.739561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358283+0000","last_change":"2024-09-17T02:54:42.155081+0000","last_active":"2024-09-17T02:54:43.358283+0000","last_peered":"2024-09-17T02:54:43.358283+0000","last_clean":"2024-09-17T02:54:43.358283+0000","last_became_active":"2024-09-17T02:54:42.152288+0000","last_became_peered":"2024-09-17T02:54:42.152288+0000","last_unstale":"2024-09-17T02:54:43.358283+0000","last_undegraded":"2024-09-17T02:54:43.358283+0000","last_fullsized":"2024-09-17T02:54:43.358283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:39.172434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358934+0000","last_change":"2024-09-17T02:54:41.134782+0000","last_active":"2024-09-17T02:54:43.358934+0000","last_peered":"2024-09-17T02:54:43.358934+0000","last_clean":"2024-09-17T02:54:43.358934+0000","last_became_active":"2024-09-17T02:54:41.133444+0000","last_became_peered":"2024-09-17T02:54:41.133444+0000","last_unstale":"2024-09-17T02:54:43.358934+0000","last_undegraded":"2024-09-17T02:54:43.358934+0000","last_fullsized":"2024-09-17T02:54:43.358934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:16.840770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359426+0000","last_change":"2024-09-17T02:54:42.153615+0000","last_active":"2024-09-17T02:54:43.359426+0000","last_peered":"2024-09-17T02:54:43.359426+0000","last_clean":"2024-09-17T02:54:43.359426+0000","last_became_active":"2024-09-17T02:54:42.153338+0000","last_became_peered":"2024-09-17T02:54:42.153338+0000","last_unstale":"2024-09-17T02:54:43.359426+0000","last_undegraded":"2024-09-17T02:54:43.359426+0000","last_fullsized":"2024-09-17T02:54:43.359426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:32.477196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155969+0000","last_change":"2024-09-17T02:54:41.133126+0000","last_active":"2024-09-17T02:54:43.155969+0000","last_peered":"2024-09-17T02:54:43.155969+0000","last_clean":"2024-09-17T02:54:43.155969+0000","last_became_active":"2024-09-17T02:54:41.132866+0000","last_became_peered":"2024-09-17T02:54:41.132866+0000","last_unstale":"2024-09-17T02:54:43.155969+0000","last_undegraded":"2024-09-17T02:54:43.155969+0000","last_fullsized":"2024-09-17T02:54:43.155969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:50.250221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137048+0000","last_change":"2024-09-17T02:54:42.150450+0000","last_active":"2024-09-17T02:54:43.137048+0000","last_peered":"2024-09-17T02:54:43.137048+0000","last_clean":"2024-09-17T02:54:43.137048+0000","last_became_active":"2024-09-17T02:54:42.150186+0000","last_became_peered":"2024-09-17T02:54:42.150186+0000","last_unstale":"2024-09-17T02:54:43.137048+0000","last_undegraded":"2024-09-17T02:54:43.137048+0000","last_fullsized":"2024-09-17T02:54:43.137048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:48.341430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138150+0000","last_change":"2024-09-17T02:54:41.128843+0000","last_active":"2024-09-17T02:54:43.138150+0000","last_peered":"2024-09-17T02:54:43.138150+0000","last_clean":"2024-09-17T02:54:43.138150+0000","last_became_active":"2024-09-17T02:54:41.128490+0000","last_became_peered":"2024-09-17T02:54:41.128490+0000","last_unstale":"2024-09-17T02:54:43.138150+0000","last_undegraded":"2024-09-17T02:54:43.138150+0000","last_fullsized":"2024-09-17T02:54:43.138150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:20.538807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.135840+0000","last_change":"2024-09-17T02:54:42.146224+0000","last_active":"2024-09-17T02:54:43.135840+0000","last_peered":"2024-09-17T02:54:43.135840+0000","last_clean":"2024-09-17T02:54:43.135840+0000","last_became_active":"2024-09-17T02:54:42.145934+0000","last_became_peered":"2024-09-17T02:54:42.145934+0000","last_unstale":"2024-09-17T02:54:43.135840+0000","last_undegraded":"2024-09-17T02:54:43.135840+0000","last_fullsized":"2024-09-17T02:54:43.135840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:26.208033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359244+0000","last_change":"2024-09-17T02:54:41.126988+0000","last_active":"2024-09-17T02:54:43.359244+0000","last_peered":"2024-09-17T02:54:43.359244+0000","last_clean":"2024-09-17T02:54:43.359244+0000","last_became_active":"2024-09-17T02:54:41.126723+0000","last_became_peered":"2024-09-17T02:54:41.126723+0000","last_unstale":"2024-09-17T02:54:43.359244+0000","last_undegraded":"2024-09-17T02:54:43.359244+0000","last_fullsized":"2024-09-17T02:54:43.359244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:06.248848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359672+0000","last_change":"2024-09-17T02:54:42.146284+0000","last_active":"2024-09-17T02:54:43.359672+0000","last_peered":"2024-09-17T02:54:43.359672+0000","last_clean":"2024-09-17T02:54:43.359672+0000","last_became_active":"2024-09-17T02:54:42.146015+0000","last_became_peered":"2024-09-17T02:54:42.146015+0000","last_unstale":"2024-09-17T02:54:43.359672+0000","last_undegraded":"2024-09-17T02:54:43.359672+0000","last_fullsized":"2024-09-17T02:54:43.359672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.467098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359153+0000","last_change":"2024-09-17T02:54:41.132996+0000","last_active":"2024-09-17T02:54:43.359153+0000","last_peered":"2024-09-17T02:54:43.359153+0000","last_clean":"2024-09-17T02:54:43.359153+0000","last_became_active":"2024-09-17T02:54:41.132135+0000","last_became_peered":"2024-09-17T02:54:41.132135+0000","last_unstale":"2024-09-17T02:54:43.359153+0000","last_undegraded":"2024-09-17T02:54:43.359153+0000","last_fullsized":"2024-09-17T02:54:43.359153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:07.376228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136531+0000","last_change":"2024-09-17T02:54:42.158937+0000","last_active":"2024-09-17T02:54:43.136531+0000","last_peered":"2024-09-17T02:54:43.136531+0000","last_clean":"2024-09-17T02:54:43.136531+0000","last_became_active":"2024-09-17T02:54:42.158282+0000","last_became_peered":"2024-09-17T02:54:42.158282+0000","last_unstale":"2024-09-17T02:54:43.136531+0000","last_undegraded":"2024-09-17T02:54:43.136531+0000","last_fullsized":"2024-09-17T02:54:43.136531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:28.545537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137699+0000","last_change":"2024-09-17T02:54:41.127168+0000","last_active":"2024-09-17T02:54:43.137699+0000","last_peered":"2024-09-17T02:54:43.137699+0000","last_clean":"2024-09-17T02:54:43.137699+0000","last_became_active":"2024-09-17T02:54:41.126901+0000","last_became_peered":"2024-09-17T02:54:41.126901+0000","last_unstale":"2024-09-17T02:54:43.137699+0000","last_undegraded":"2024-09-17T02:54:43.137699+0000","last_fullsized":"2024-09-17T02:54:43.137699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:21.080985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136732+0000","last_change":"2024-09-17T02:54:42.141939+0000","last_active":"2024-09-17T02:54:43.136732+0000","last_peered":"2024-09-17T02:54:43.136732+0000","last_clean":"2024-09-17T02:54:43.136732+0000","last_became_active":"2024-09-17T02:54:42.141638+0000","last_became_peered":"2024-09-17T02:54:42.141638+0000","last_unstale":"2024-09-17T02:54:43.136732+0000","last_undegraded":"2024-09-17T02:54:43.136732+0000","last_fullsized":"2024-09-17T02:54:43.136732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:57.994378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358218+0000","last_change":"2024-09-17T02:54:41.131775+0000","last_active":"2024-09-17T02:54:43.358218+0000","last_peered":"2024-09-17T02:54:43.358218+0000","last_clean":"2024-09-17T02:54:43.358218+0000","last_became_active":"2024-09-17T02:54:41.131311+0000","last_became_peered":"2024-09-17T02:54:41.131311+0000","last_unstale":"2024-09-17T02:54:43.358218+0000","last_undegraded":"2024-09-17T02:54:43.358218+0000","last_fullsized":"2024-09-17T02:54:43.358218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:28.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136931+0000","last_change":"2024-09-17T02:54:42.157762+0000","last_active":"2024-09-17T02:54:43.136931+0000","last_peered":"2024-09-17T02:54:43.136931+0000","last_clean":"2024-09-17T02:54:43.136931+0000","last_became_active":"2024-09-17T02:54:42.157491+0000","last_became_peered":"2024-09-17T02:54:42.157491+0000","last_unstale":"2024-09-17T02:54:43.136931+0000","last_undegraded":"2024-09-17T02:54:43.136931+0000","last_fullsized":"2024-09-17T02:54:43.136931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:19.836766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137249+0000","last_change":"2024-09-17T02:54:41.124818+0000","last_active":"2024-09-17T02:54:43.137249+0000","last_peered":"2024-09-17T02:54:43.137249+0000","last_clean":"2024-09-17T02:54:43.137249+0000","last_became_active":"2024-09-17T02:54:41.124391+0000","last_became_peered":"2024-09-17T02:54:41.124391+0000","last_unstale":"2024-09-17T02:54:43.137249+0000","last_undegraded":"2024-09-17T02:54:43.137249+0000","last_fullsized":"2024-09-17T02:54:43.137249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:16.876804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137289+0000","last_change":"2024-09-17T02:54:42.159256+0000","last_active":"2024-09-17T02:54:43.137289+0000","last_peered":"2024-09-17T02:54:43.137289+0000","last_clean":"2024-09-17T02:54:43.137289+0000","last_became_active":"2024-09-17T02:54:42.158656+0000","last_became_peered":"2024-09-17T02:54:42.158656+0000","last_unstale":"2024-09-17T02:54:43.137289+0000","last_undegraded":"2024-09-17T02:54:43.137289+0000","last_fullsized":"2024-09-17T02:54:43.137289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:05.910827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358555+0000","last_change":"2024-09-17T02:54:41.136678+0000","last_active":"2024-09-17T02:54:43.358555+0000","last_peered":"2024-09-17T02:54:43.358555+0000","last_clean":"2024-09-17T02:54:43.358555+0000","last_became_active":"2024-09-17T02:54:41.136398+0000","last_became_peered":"2024-09-17T02:54:41.136398+0000","last_unstale":"2024-09-17T02:54:43.358555+0000","last_undegraded":"2024-09-17T02:54:43.358555+0000","last_fullsized":"2024-09-17T02:54:43.358555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:39.254444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136302+0000","last_change":"2024-09-17T02:54:42.152570+0000","last_active":"2024-09-17T02:54:43.136302+0000","last_peered":"2024-09-17T02:54:43.136302+0000","last_clean":"2024-09-17T02:54:43.136302+0000","last_became_active":"2024-09-17T02:54:42.151788+0000","last_became_peered":"2024-09-17T02:54:42.151788+0000","last_unstale":"2024-09-17T02:54:43.136302+0000","last_undegraded":"2024-09-17T02:54:43.136302+0000","last_fullsized":"2024-09-17T02:54:43.136302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:07.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155816+0000","last_change":"2024-09-17T02:54:41.129677+0000","last_active":"2024-09-17T02:54:43.155816+0000","last_peered":"2024-09-17T02:54:43.155816+0000","last_clean":"2024-09-17T02:54:43.155816+0000","last_became_active":"2024-09-17T02:54:41.128120+0000","last_became_peered":"2024-09-17T02:54:41.128120+0000","last_unstale":"2024-09-17T02:54:43.155816+0000","last_undegraded":"2024-09-17T02:54:43.155816+0000","last_fullsized":"2024-09-17T02:54:43.155816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:29.303949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358791+0000","last_change":"2024-09-17T02:54:42.151741+0000","last_active":"2024-09-17T02:54:43.358791+0000","last_peered":"2024-09-17T02:54:43.358791+0000","last_clean":"2024-09-17T02:54:43.358791+0000","last_became_active":"2024-09-17T02:54:42.150459+0000","last_became_peered":"2024-09-17T02:54:42.150459+0000","last_unstale":"2024-09-17T02:54:43.358791+0000","last_undegraded":"2024-09-17T02:54:43.358791+0000","last_fullsized":"2024-09-17T02:54:43.358791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:18.116431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358136+0000","last_change":"2024-09-17T02:54:41.135494+0000","last_active":"2024-09-17T02:54:43.358136+0000","last_peered":"2024-09-17T02:54:43.358136+0000","last_clean":"2024-09-17T02:54:43.358136+0000","last_became_active":"2024-09-17T02:54:41.135146+0000","last_became_peered":"2024-09-17T02:54:41.135146+0000","last_unstale":"2024-09-17T02:54:43.358136+0000","last_undegraded":"2024-09-17T02:54:43.358136+0000","last_fullsized":"2024-09-17T02:54:43.358136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:55.347118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138244+0000","last_change":"2024-09-17T02:54:42.153708+0000","last_active":"2024-09-17T02:54:43.138244+0000","last_peered":"2024-09-17T02:54:43.138244+0000","last_clean":"2024-09-17T02:54:43.138244+0000","last_became_active":"2024-09-17T02:54:42.153438+0000","last_became_peered":"2024-09-17T02:54:42.153438+0000","last_unstale":"2024-09-17T02:54:43.138244+0000","last_undegraded":"2024-09-17T02:54:43.138244+0000","last_fullsized":"2024-09-17T02:54:43.138244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:30.371000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136979+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:54:43.136979+0000","last_peered":"2024-09-17T02:54:43.136979+0000","last_clean":"2024-09-17T02:54:43.136979+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:54:43.136979+0000","last_undegraded":"2024-09-17T02:54:43.136979+0000","last_fullsized":"2024-09-17T02:54:43.136979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359355+0000","last_change":"2024-09-17T02:54:41.132405+0000","last_active":"2024-09-17T02:54:43.359355+0000","last_peered":"2024-09-17T02:54:43.359355+0000","last_clean":"2024-09-17T02:54:43.359355+0000","last_became_active":"2024-09-17T02:54:41.131396+0000","last_became_peered":"2024-09-17T02:54:41.131396+0000","last_unstale":"2024-09-17T02:54:43.359355+0000","last_undegraded":"2024-09-17T02:54:43.359355+0000","last_fullsized":"2024-09-17T02:54:43.359355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:52.252060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359121+0000","last_change":"2024-09-17T02:54:42.151718+0000","last_active":"2024-09-17T02:54:43.359121+0000","last_peered":"2024-09-17T02:54:43.359121+0000","last_clean":"2024-09-17T02:54:43.359121+0000","last_became_active":"2024-09-17T02:54:42.151425+0000","last_became_peered":"2024-09-17T02:54:42.151425+0000","last_unstale":"2024-09-17T02:54:43.359121+0000","last_undegraded":"2024-09-17T02:54:43.359121+0000","last_fullsized":"2024-09-17T02:54:43.359121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:50.080913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136874+0000","last_change":"2024-09-17T02:54:41.134010+0000","last_active":"2024-09-17T02:54:43.136874+0000","last_peered":"2024-09-17T02:54:43.136874+0000","last_clean":"2024-09-17T02:54:43.136874+0000","last_became_active":"2024-09-17T02:54:41.133330+0000","last_became_peered":"2024-09-17T02:54:41.133330+0000","last_unstale":"2024-09-17T02:54:43.136874+0000","last_undegraded":"2024-09-17T02:54:43.136874+0000","last_fullsized":"2024-09-17T02:54:43.136874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:35.841779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358888+0000","last_change":"2024-09-17T02:54:42.156464+0000","last_active":"2024-09-17T02:54:43.358888+0000","last_peered":"2024-09-17T02:54:43.358888+0000","last_clean":"2024-09-17T02:54:43.358888+0000","last_became_active":"2024-09-17T02:54:42.156189+0000","last_became_peered":"2024-09-17T02:54:42.156189+0000","last_unstale":"2024-09-17T02:54:43.358888+0000","last_undegraded":"2024-09-17T02:54:43.358888+0000","last_fullsized":"2024-09-17T02:54:43.358888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:25:08.347022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358348+0000","last_change":"2024-09-17T02:54:41.136814+0000","last_active":"2024-09-17T02:54:43.358348+0000","last_peered":"2024-09-17T02:54:43.358348+0000","last_clean":"2024-09-17T02:54:43.358348+0000","last_became_active":"2024-09-17T02:54:41.136504+0000","last_became_peered":"2024-09-17T02:54:41.136504+0000","last_unstale":"2024-09-17T02:54:43.358348+0000","last_undegraded":"2024-09-17T02:54:43.358348+0000","last_fullsized":"2024-09-17T02:54:43.358348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:31.500343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156157+0000","last_change":"2024-09-17T02:54:42.139120+0000","last_active":"2024-09-17T02:54:43.156157+0000","last_peered":"2024-09-17T02:54:43.156157+0000","last_clean":"2024-09-17T02:54:43.156157+0000","last_became_active":"2024-09-17T02:54:42.138859+0000","last_became_peered":"2024-09-17T02:54:42.138859+0000","last_unstale":"2024-09-17T02:54:43.156157+0000","last_undegraded":"2024-09-17T02:54:43.156157+0000","last_fullsized":"2024-09-17T02:54:43.156157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:11.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359006+0000","last_change":"2024-09-17T02:54:41.135077+0000","last_active":"2024-09-17T02:54:43.359006+0000","last_peered":"2024-09-17T02:54:43.359006+0000","last_clean":"2024-09-17T02:54:43.359006+0000","last_became_active":"2024-09-17T02:54:41.134456+0000","last_became_peered":"2024-09-17T02:54:41.134456+0000","last_unstale":"2024-09-17T02:54:43.359006+0000","last_undegraded":"2024-09-17T02:54:43.359006+0000","last_fullsized":"2024-09-17T02:54:43.359006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:14.713147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136894+0000","last_change":"2024-09-17T02:54:42.148213+0000","last_active":"2024-09-17T02:54:43.136894+0000","last_peered":"2024-09-17T02:54:43.136894+0000","last_clean":"2024-09-17T02:54:43.136894+0000","last_became_active":"2024-09-17T02:54:42.147941+0000","last_became_peered":"2024-09-17T02:54:42.147941+0000","last_unstale":"2024-09-17T02:54:43.136894+0000","last_undegraded":"2024-09-17T02:54:43.136894+0000","last_fullsized":"2024-09-17T02:54:43.136894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:28.231123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156101+0000","last_change":"2024-09-17T02:54:41.129281+0000","last_active":"2024-09-17T02:54:43.156101+0000","last_peered":"2024-09-17T02:54:43.156101+0000","last_clean":"2024-09-17T02:54:43.156101+0000","last_became_active":"2024-09-17T02:54:41.129016+0000","last_became_peered":"2024-09-17T02:54:41.129016+0000","last_unstale":"2024-09-17T02:54:43.156101+0000","last_undegraded":"2024-09-17T02:54:43.156101+0000","last_fullsized":"2024-09-17T02:54:43.156101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:35.685956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358418+0000","last_change":"2024-09-17T02:54:42.149626+0000","last_active":"2024-09-17T02:54:43.358418+0000","last_peered":"2024-09-17T02:54:43.358418+0000","last_clean":"2024-09-17T02:54:43.358418+0000","last_became_active":"2024-09-17T02:54:42.148363+0000","last_became_peered":"2024-09-17T02:54:42.148363+0000","last_unstale":"2024-09-17T02:54:43.358418+0000","last_undegraded":"2024-09-17T02:54:43.358418+0000","last_fullsized":"2024-09-17T02:54:43.358418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:43.951700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136758+0000","last_change":"2024-09-17T02:54:41.127905+0000","last_active":"2024-09-17T02:54:43.136758+0000","last_peered":"2024-09-17T02:54:43.136758+0000","last_clean":"2024-09-17T02:54:43.136758+0000","last_became_active":"2024-09-17T02:54:41.127616+0000","last_became_peered":"2024-09-17T02:54:41.127616+0000","last_unstale":"2024-09-17T02:54:43.136758+0000","last_undegraded":"2024-09-17T02:54:43.136758+0000","last_fullsized":"2024-09-17T02:54:43.136758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:13.661134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155795+0000","last_change":"2024-09-17T02:54:42.137451+0000","last_active":"2024-09-17T02:54:43.155795+0000","last_peered":"2024-09-17T02:54:43.155795+0000","last_clean":"2024-09-17T02:54:43.155795+0000","last_became_active":"2024-09-17T02:54:42.137156+0000","last_became_peered":"2024-09-17T02:54:42.137156+0000","last_unstale":"2024-09-17T02:54:43.155795+0000","last_undegraded":"2024-09-17T02:54:43.155795+0000","last_fullsized":"2024-09-17T02:54:43.155795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:10.118647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156125+0000","last_change":"2024-09-17T02:54:41.130345+0000","last_active":"2024-09-17T02:54:43.156125+0000","last_peered":"2024-09-17T02:54:43.156125+0000","last_clean":"2024-09-17T02:54:43.156125+0000","last_became_active":"2024-09-17T02:54:41.130078+0000","last_became_peered":"2024-09-17T02:54:41.130078+0000","last_unstale":"2024-09-17T02:54:43.156125+0000","last_undegraded":"2024-09-17T02:54:43.156125+0000","last_fullsized":"2024-09-17T02:54:43.156125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:46.185877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358887+0000","last_change":"2024-09-17T02:54:42.146439+0000","last_active":"2024-09-17T02:54:43.358887+0000","last_peered":"2024-09-17T02:54:43.358887+0000","last_clean":"2024-09-17T02:54:43.358887+0000","last_became_active":"2024-09-17T02:54:42.146179+0000","last_became_peered":"2024-09-17T02:54:42.146179+0000","last_unstale":"2024-09-17T02:54:43.358887+0000","last_undegraded":"2024-09-17T02:54:43.358887+0000","last_fullsized":"2024-09-17T02:54:43.358887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:23.894676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137820+0000","last_change":"2024-09-17T02:54:41.125471+0000","last_active":"2024-09-17T02:54:43.137820+0000","last_peered":"2024-09-17T02:54:43.137820+0000","last_clean":"2024-09-17T02:54:43.137820+0000","last_became_active":"2024-09-17T02:54:41.124551+0000","last_became_peered":"2024-09-17T02:54:41.124551+0000","last_unstale":"2024-09-17T02:54:43.137820+0000","last_undegraded":"2024-09-17T02:54:43.137820+0000","last_fullsized":"2024-09-17T02:54:43.137820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:02.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358379+0000","last_change":"2024-09-17T02:54:42.143465+0000","last_active":"2024-09-17T02:54:43.358379+0000","last_peered":"2024-09-17T02:54:43.358379+0000","last_clean":"2024-09-17T02:54:43.358379+0000","last_became_active":"2024-09-17T02:54:42.143167+0000","last_became_peered":"2024-09-17T02:54:42.143167+0000","last_unstale":"2024-09-17T02:54:43.358379+0000","last_undegraded":"2024-09-17T02:54:43.358379+0000","last_fullsized":"2024-09-17T02:54:43.358379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:37.631386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138696+0000","last_change":"2024-09-17T02:54:41.127039+0000","last_active":"2024-09-17T02:54:43.138696+0000","last_peered":"2024-09-17T02:54:43.138696+0000","last_clean":"2024-09-17T02:54:43.138696+0000","last_became_active":"2024-09-17T02:54:41.126724+0000","last_became_peered":"2024-09-17T02:54:41.126724+0000","last_unstale":"2024-09-17T02:54:43.138696+0000","last_undegraded":"2024-09-17T02:54:43.138696+0000","last_fullsized":"2024-09-17T02:54:43.138696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:25.897861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138769+0000","last_change":"2024-09-17T02:54:42.156420+0000","last_active":"2024-09-17T02:54:43.138769+0000","last_peered":"2024-09-17T02:54:43.138769+0000","last_clean":"2024-09-17T02:54:43.138769+0000","last_became_active":"2024-09-17T02:54:42.154866+0000","last_became_peered":"2024-09-17T02:54:42.154866+0000","last_unstale":"2024-09-17T02:54:43.138769+0000","last_undegraded":"2024-09-17T02:54:43.138769+0000","last_fullsized":"2024-09-17T02:54:43.138769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:24.806778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156042+0000","last_change":"2024-09-17T02:54:41.131579+0000","last_active":"2024-09-17T02:54:43.156042+0000","last_peered":"2024-09-17T02:54:43.156042+0000","last_clean":"2024-09-17T02:54:43.156042+0000","last_became_active":"2024-09-17T02:54:41.131123+0000","last_became_peered":"2024-09-17T02:54:41.131123+0000","last_unstale":"2024-09-17T02:54:43.156042+0000","last_undegraded":"2024-09-17T02:54:43.156042+0000","last_fullsized":"2024-09-17T02:54:43.156042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:17.467321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359468+0000","last_change":"2024-09-17T02:54:42.146004+0000","last_active":"2024-09-17T02:54:43.359468+0000","last_peered":"2024-09-17T02:54:43.359468+0000","last_clean":"2024-09-17T02:54:43.359468+0000","last_became_active":"2024-09-17T02:54:42.145739+0000","last_became_peered":"2024-09-17T02:54:42.145739+0000","last_unstale":"2024-09-17T02:54:43.359468+0000","last_undegraded":"2024-09-17T02:54:43.359468+0000","last_fullsized":"2024-09-17T02:54:43.359468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:31.840015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156307+0000","last_change":"2024-09-17T02:54:41.127869+0000","last_active":"2024-09-17T02:54:43.156307+0000","last_peered":"2024-09-17T02:54:43.156307+0000","last_clean":"2024-09-17T02:54:43.156307+0000","last_became_active":"2024-09-17T02:54:41.127552+0000","last_became_peered":"2024-09-17T02:54:41.127552+0000","last_unstale":"2024-09-17T02:54:43.156307+0000","last_undegraded":"2024-09-17T02:54:43.156307+0000","last_fullsized":"2024-09-17T02:54:43.156307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:45.759358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359868+0000","last_change":"2024-09-17T02:54:42.147352+0000","last_active":"2024-09-17T02:54:43.359868+0000","last_peered":"2024-09-17T02:54:43.359868+0000","last_clean":"2024-09-17T02:54:43.359868+0000","last_became_active":"2024-09-17T02:54:42.146704+0000","last_became_peered":"2024-09-17T02:54:42.146704+0000","last_unstale":"2024-09-17T02:54:43.359868+0000","last_undegraded":"2024-09-17T02:54:43.359868+0000","last_fullsized":"2024-09-17T02:54:43.359868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:43.443564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136064+0000","last_change":"2024-09-17T02:54:41.126814+0000","last_active":"2024-09-17T02:54:43.136064+0000","last_peered":"2024-09-17T02:54:43.136064+0000","last_clean":"2024-09-17T02:54:43.136064+0000","last_became_active":"2024-09-17T02:54:41.126505+0000","last_became_peered":"2024-09-17T02:54:41.126505+0000","last_unstale":"2024-09-17T02:54:43.136064+0000","last_undegraded":"2024-09-17T02:54:43.136064+0000","last_fullsized":"2024-09-17T02:54:43.136064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:31.318671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137986+0000","last_change":"2024-09-17T02:54:42.149079+0000","last_active":"2024-09-17T02:54:43.137986+0000","last_peered":"2024-09-17T02:54:43.137986+0000","last_clean":"2024-09-17T02:54:43.137986+0000","last_became_active":"2024-09-17T02:54:42.148783+0000","last_became_peered":"2024-09-17T02:54:42.148783+0000","last_unstale":"2024-09-17T02:54:43.137986+0000","last_undegraded":"2024-09-17T02:54:43.137986+0000","last_fullsized":"2024-09-17T02:54:43.137986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:06.553170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358191+0000","last_change":"2024-09-17T02:54:42.158896+0000","last_active":"2024-09-17T02:54:43.358191+0000","last_peered":"2024-09-17T02:54:43.358191+0000","last_clean":"2024-09-17T02:54:43.358191+0000","last_became_active":"2024-09-17T02:54:42.157766+0000","last_became_peered":"2024-09-17T02:54:42.157766+0000","last_unstale":"2024-09-17T02:54:43.358191+0000","last_undegraded":"2024-09-17T02:54:43.358191+0000","last_fullsized":"2024-09-17T02:54:43.358191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:09.623648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138577+0000","last_change":"2024-09-17T02:54:41.133352+0000","last_active":"2024-09-17T02:54:43.138577+0000","last_peered":"2024-09-17T02:54:43.138577+0000","last_clean":"2024-09-17T02:54:43.138577+0000","last_became_active":"2024-09-17T02:54:41.133001+0000","last_became_peered":"2024-09-17T02:54:41.133001+0000","last_unstale":"2024-09-17T02:54:43.138577+0000","last_undegraded":"2024-09-17T02:54:43.138577+0000","last_fullsized":"2024-09-17T02:54:43.138577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:25.234888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358704+0000","last_change":"2024-09-17T02:54:42.157016+0000","last_active":"2024-09-17T02:54:43.358704+0000","last_peered":"2024-09-17T02:54:43.358704+0000","last_clean":"2024-09-17T02:54:43.358704+0000","last_became_active":"2024-09-17T02:54:42.155446+0000","last_became_peered":"2024-09-17T02:54:42.155446+0000","last_unstale":"2024-09-17T02:54:43.358704+0000","last_undegraded":"2024-09-17T02:54:43.358704+0000","last_fullsized":"2024-09-17T02:54:43.358704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:10.877471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137546+0000","last_change":"2024-09-17T02:54:41.131298+0000","last_active":"2024-09-17T02:54:43.137546+0000","last_peered":"2024-09-17T02:54:43.137546+0000","last_clean":"2024-09-17T02:54:43.137546+0000","last_became_active":"2024-09-17T02:54:41.131019+0000","last_became_peered":"2024-09-17T02:54:41.131019+0000","last_unstale":"2024-09-17T02:54:43.137546+0000","last_undegraded":"2024-09-17T02:54:43.137546+0000","last_fullsized":"2024-09-17T02:54:43.137546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:42.571738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358655+0000","last_change":"2024-09-17T02:54:42.145720+0000","last_active":"2024-09-17T02:54:43.358655+0000","last_peered":"2024-09-17T02:54:43.358655+0000","last_clean":"2024-09-17T02:54:43.358655+0000","last_became_active":"2024-09-17T02:54:42.145389+0000","last_became_peered":"2024-09-17T02:54:42.145389+0000","last_unstale":"2024-09-17T02:54:43.358655+0000","last_undegraded":"2024-09-17T02:54:43.358655+0000","last_fullsized":"2024-09-17T02:54:43.358655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:43.429332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358712+0000","last_change":"2024-09-17T02:54:41.128714+0000","last_active":"2024-09-17T02:54:43.358712+0000","last_peered":"2024-09-17T02:54:43.358712+0000","last_clean":"2024-09-17T02:54:43.358712+0000","last_became_active":"2024-09-17T02:54:41.128099+0000","last_became_peered":"2024-09-17T02:54:41.128099+0000","last_unstale":"2024-09-17T02:54:43.358712+0000","last_undegraded":"2024-09-17T02:54:43.358712+0000","last_fullsized":"2024-09-17T02:54:43.358712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.229882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358452+0000","last_change":"2024-09-17T02:54:42.146900+0000","last_active":"2024-09-17T02:54:43.358452+0000","last_peered":"2024-09-17T02:54:43.358452+0000","last_clean":"2024-09-17T02:54:43.358452+0000","last_became_active":"2024-09-17T02:54:42.146654+0000","last_became_peered":"2024-09-17T02:54:42.146654+0000","last_unstale":"2024-09-17T02:54:43.358452+0000","last_undegraded":"2024-09-17T02:54:43.358452+0000","last_fullsized":"2024-09-17T02:54:43.358452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:58.031273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359142+0000","last_change":"2024-09-17T02:54:41.125421+0000","last_active":"2024-09-17T02:54:43.359142+0000","last_peered":"2024-09-17T02:54:43.359142+0000","last_clean":"2024-09-17T02:54:43.359142+0000","last_became_active":"2024-09-17T02:54:41.124528+0000","last_became_peered":"2024-09-17T02:54:41.124528+0000","last_unstale":"2024-09-17T02:54:43.359142+0000","last_undegraded":"2024-09-17T02:54:43.359142+0000","last_fullsized":"2024-09-17T02:54:43.359142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:02.002045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333605,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:54:55.369 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:54:55.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.518+0000 7faac7c25640 1 -- 172.21.15.104:0/3507392381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac0073c90 msgr2=0x7faac00b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.518+0000 7faac7c25640 1 --2- 172.21.15.104:0/3507392381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac0073c90 0x7faac00b4ce0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faab8005fd0 tx=0x7faab802a8b0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.519+0000 7faac7c25640 1 -- 172.21.15.104:0/3507392381 shutdown_connections 2024-09-17T02:54:55.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.519+0000 7faac7c25640 1 --2- 172.21.15.104:0/3507392381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac0073c90 0x7faac00b4ce0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.519+0000 7faac7c25640 1 --2- 172.21.15.104:0/3507392381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac0152ce0 0x7faac006f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.519+0000 7faac7c25640 1 -- 172.21.15.104:0/3507392381 >> 172.21.15.104:0/3507392381 conn(0x7faac00b3640 msgr2=0x7faac00b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:55.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.519+0000 7faac7c25640 1 -- 172.21.15.104:0/3507392381 shutdown_connections 2024-09-17T02:54:55.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.519+0000 7faac7c25640 1 -- 172.21.15.104:0/3507392381 wait complete. 2024-09-17T02:54:55.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.520+0000 7faac7c25640 1 Processor -- start 2024-09-17T02:54:55.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.520+0000 7faac7c25640 1 -- start start 2024-09-17T02:54:55.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac7c25640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac006fa80 0x7faac01f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac7c25640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac0152ce0 0x7faac014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac7c25640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faac0148830 0x7faac0068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac7c25640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faac00b5880 con 0x7faac0148830 2024-09-17T02:54:55.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac7c25640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faac00b5700 con 0x7faac006fa80 2024-09-17T02:54:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac7c25640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faac00b5a00 con 0x7faac0152ce0 2024-09-17T02:54:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faac0148830 0x7faac0068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faac0148830 0x7faac0068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50640/0 (socket says 172.21.15.104:50640) 2024-09-17T02:54:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 -- 172.21.15.104:0/2287214314 learned_addr learned my addr 172.21.15.104:0/2287214314 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac51c0640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac0152ce0 0x7faac014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac59c1640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac006fa80 0x7faac01f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 -- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac0152ce0 msgr2=0x7faac014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac0152ce0 0x7faac014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 -- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac006fa80 msgr2=0x7faac01f9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac006fa80 0x7faac01f9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 -- 172.21.15.104:0/2287214314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac01f9a90 con 0x7faac0148830 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.522+0000 7faac61c2640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faac0148830 0x7faac0068d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faab802aea0 tx=0x7faab8033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.523+0000 7faab67fc640 1 -- 172.21.15.104:0/2287214314 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8031990 con 0x7faac0148830 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.523+0000 7faab67fc640 1 -- 172.21.15.104:0/2287214314 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab8031c20 con 0x7faac0148830 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.523+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac01f9d70 con 0x7faac0148830 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.523+0000 7faab67fc640 1 -- 172.21.15.104:0/2287214314 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80330d0 con 0x7faac0148830 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.523+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac00cc670 con 0x7faac0148830 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.524+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac006f870 con 0x7faac0148830 2024-09-17T02:54:55.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.524+0000 7faab67fc640 1 -- 172.21.15.104:0/2287214314 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faab8033270 con 0x7faac0148830 2024-09-17T02:54:55.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.525+0000 7faab67fc640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faaa4078b90 0x7faaa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.525+0000 7faab67fc640 1 -- 172.21.15.104:0/2287214314 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faab80bc110 con 0x7faac0148830 2024-09-17T02:54:55.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.525+0000 7faac59c1640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faaa4078b90 0x7faaa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.526+0000 7faac59c1640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faaa4078b90 0x7faaa407b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faabc0095f0 tx=0x7faabc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:55.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.529+0000 7faab67fc640 1 -- 172.21.15.104:0/2287214314 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faac006f870 con 0x7faac0148830 2024-09-17T02:54:55.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.699+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faac00cc8d0 con 0x7faaa4078b90 2024-09-17T02:54:55.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.704+0000 7faab67fc640 1 -- 172.21.15.104:0/2287214314 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247475 (secure 0 0 0) 0x7faac00cc8d0 con 0x7faaa4078b90 2024-09-17T02:54:55.706 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:55.707 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:54:55.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.706+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faaa4078b90 msgr2=0x7faaa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.706+0000 7faac7c25640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faaa4078b90 0x7faaa407b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faabc0095f0 tx=0x7faabc005f90 comp rx=0 tx=0).stop 2024-09-17T02:54:55.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.706+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faac0148830 msgr2=0x7faac0068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faac0148830 0x7faac0068d00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faab802aea0 tx=0x7faab8033f70 comp rx=0 tx=0).stop 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 shutdown_connections 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faaa4078b90 0x7faaa407b0a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faac0148830 0x7faac0068d00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac0152ce0 0x7faac014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 --2- 172.21.15.104:0/2287214314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac006fa80 0x7faac01f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 >> 172.21.15.104:0/2287214314 conn(0x7faac00b3640 msgr2=0x7faac0153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 shutdown_connections 2024-09-17T02:54:55.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.707+0000 7faac7c25640 1 -- 172.21.15.104:0/2287214314 wait complete. 2024-09-17T02:54:55.717 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-17T02:54:55.622586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210884,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003048"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137914+0000","last_change":"2024-09-17T02:54:42.140130+0000","last_active":"2024-09-17T02:54:43.137914+0000","last_peered":"2024-09-17T02:54:43.137914+0000","last_clean":"2024-09-17T02:54:43.137914+0000","last_became_active":"2024-09-17T02:54:42.139834+0000","last_became_peered":"2024-09-17T02:54:42.139834+0000","last_unstale":"2024-09-17T02:54:43.137914+0000","last_undegraded":"2024-09-17T02:54:43.137914+0000","last_fullsized":"2024-09-17T02:54:43.137914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:28.350535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155882+0000","last_change":"2024-09-17T02:54:42.141968+0000","last_active":"2024-09-17T02:54:43.155882+0000","last_peered":"2024-09-17T02:54:43.155882+0000","last_clean":"2024-09-17T02:54:43.155882+0000","last_became_active":"2024-09-17T02:54:42.141689+0000","last_became_peered":"2024-09-17T02:54:42.141689+0000","last_unstale":"2024-09-17T02:54:43.155882+0000","last_undegraded":"2024-09-17T02:54:43.155882+0000","last_fullsized":"2024-09-17T02:54:43.155882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:20.331776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358124+0000","last_change":"2024-09-17T02:54:42.142005+0000","last_active":"2024-09-17T02:54:43.358124+0000","last_peered":"2024-09-17T02:54:43.358124+0000","last_clean":"2024-09-17T02:54:43.358124+0000","last_became_active":"2024-09-17T02:54:42.141718+0000","last_became_peered":"2024-09-17T02:54:42.141718+0000","last_unstale":"2024-09-17T02:54:43.358124+0000","last_undegraded":"2024-09-17T02:54:43.358124+0000","last_fullsized":"2024-09-17T02:54:43.358124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:56.699293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357892+0000","last_change":"2024-09-17T02:54:42.150263+0000","last_active":"2024-09-17T02:54:43.357892+0000","last_peered":"2024-09-17T02:54:43.357892+0000","last_clean":"2024-09-17T02:54:43.357892+0000","last_became_active":"2024-09-17T02:54:42.149350+0000","last_became_peered":"2024-09-17T02:54:42.149350+0000","last_unstale":"2024-09-17T02:54:43.357892+0000","last_undegraded":"2024-09-17T02:54:43.357892+0000","last_fullsized":"2024-09-17T02:54:43.357892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:06.932470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136283+0000","last_change":"2024-09-17T02:54:42.144157+0000","last_active":"2024-09-17T02:54:43.136283+0000","last_peered":"2024-09-17T02:54:43.136283+0000","last_clean":"2024-09-17T02:54:43.136283+0000","last_became_active":"2024-09-17T02:54:42.143838+0000","last_became_peered":"2024-09-17T02:54:42.143838+0000","last_unstale":"2024-09-17T02:54:43.136283+0000","last_undegraded":"2024-09-17T02:54:43.136283+0000","last_fullsized":"2024-09-17T02:54:43.136283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:54.631778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358412+0000","last_change":"2024-09-17T02:54:42.153836+0000","last_active":"2024-09-17T02:54:43.358412+0000","last_peered":"2024-09-17T02:54:43.358412+0000","last_clean":"2024-09-17T02:54:43.358412+0000","last_became_active":"2024-09-17T02:54:42.153241+0000","last_became_peered":"2024-09-17T02:54:42.153241+0000","last_unstale":"2024-09-17T02:54:43.358412+0000","last_undegraded":"2024-09-17T02:54:43.358412+0000","last_fullsized":"2024-09-17T02:54:43.358412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:48.474724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136521+0000","last_change":"2024-09-17T02:54:42.145342+0000","last_active":"2024-09-17T02:54:43.136521+0000","last_peered":"2024-09-17T02:54:43.136521+0000","last_clean":"2024-09-17T02:54:43.136521+0000","last_became_active":"2024-09-17T02:54:42.145047+0000","last_became_peered":"2024-09-17T02:54:42.145047+0000","last_unstale":"2024-09-17T02:54:43.136521+0000","last_undegraded":"2024-09-17T02:54:43.136521+0000","last_fullsized":"2024-09-17T02:54:43.136521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:42.226480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359172+0000","last_change":"2024-09-17T02:54:42.148964+0000","last_active":"2024-09-17T02:54:43.359172+0000","last_peered":"2024-09-17T02:54:43.359172+0000","last_clean":"2024-09-17T02:54:43.359172+0000","last_became_active":"2024-09-17T02:54:42.148715+0000","last_became_peered":"2024-09-17T02:54:42.148715+0000","last_unstale":"2024-09-17T02:54:43.359172+0000","last_undegraded":"2024-09-17T02:54:43.359172+0000","last_fullsized":"2024-09-17T02:54:43.359172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:04.427855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136047+0000","last_change":"2024-09-17T02:54:42.152096+0000","last_active":"2024-09-17T02:54:43.136047+0000","last_peered":"2024-09-17T02:54:43.136047+0000","last_clean":"2024-09-17T02:54:43.136047+0000","last_became_active":"2024-09-17T02:54:42.149125+0000","last_became_peered":"2024-09-17T02:54:42.149125+0000","last_unstale":"2024-09-17T02:54:43.136047+0000","last_undegraded":"2024-09-17T02:54:43.136047+0000","last_fullsized":"2024-09-17T02:54:43.136047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:02.023988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137292+0000","last_change":"2024-09-17T02:54:42.149053+0000","last_active":"2024-09-17T02:54:43.137292+0000","last_peered":"2024-09-17T02:54:43.137292+0000","last_clean":"2024-09-17T02:54:43.137292+0000","last_became_active":"2024-09-17T02:54:42.148769+0000","last_became_peered":"2024-09-17T02:54:42.148769+0000","last_unstale":"2024-09-17T02:54:43.137292+0000","last_undegraded":"2024-09-17T02:54:43.137292+0000","last_fullsized":"2024-09-17T02:54:43.137292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:15.308833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137914+0000","last_change":"2024-09-17T02:54:42.153697+0000","last_active":"2024-09-17T02:54:43.137914+0000","last_peered":"2024-09-17T02:54:43.137914+0000","last_clean":"2024-09-17T02:54:43.137914+0000","last_became_active":"2024-09-17T02:54:42.153422+0000","last_became_peered":"2024-09-17T02:54:42.153422+0000","last_unstale":"2024-09-17T02:54:43.137914+0000","last_undegraded":"2024-09-17T02:54:43.137914+0000","last_fullsized":"2024-09-17T02:54:43.137914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.907995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137542+0000","last_change":"2024-09-17T02:54:42.145613+0000","last_active":"2024-09-17T02:54:43.137542+0000","last_peered":"2024-09-17T02:54:43.137542+0000","last_clean":"2024-09-17T02:54:43.137542+0000","last_became_active":"2024-09-17T02:54:42.145348+0000","last_became_peered":"2024-09-17T02:54:42.145348+0000","last_unstale":"2024-09-17T02:54:43.137542+0000","last_undegraded":"2024-09-17T02:54:43.137542+0000","last_fullsized":"2024-09-17T02:54:43.137542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:59.383826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359478+0000","last_change":"2024-09-17T02:54:42.147714+0000","last_active":"2024-09-17T02:54:43.359478+0000","last_peered":"2024-09-17T02:54:43.359478+0000","last_clean":"2024-09-17T02:54:43.359478+0000","last_became_active":"2024-09-17T02:54:42.147073+0000","last_became_peered":"2024-09-17T02:54:42.147073+0000","last_unstale":"2024-09-17T02:54:43.359478+0000","last_undegraded":"2024-09-17T02:54:43.359478+0000","last_fullsized":"2024-09-17T02:54:43.359478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:38.256856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357881+0000","last_change":"2024-09-17T02:54:42.140804+0000","last_active":"2024-09-17T02:54:43.357881+0000","last_peered":"2024-09-17T02:54:43.357881+0000","last_clean":"2024-09-17T02:54:43.357881+0000","last_became_active":"2024-09-17T02:54:42.140549+0000","last_became_peered":"2024-09-17T02:54:42.140549+0000","last_unstale":"2024-09-17T02:54:43.357881+0000","last_undegraded":"2024-09-17T02:54:43.357881+0000","last_fullsized":"2024-09-17T02:54:43.357881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:15.021489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155948+0000","last_change":"2024-09-17T02:54:42.156204+0000","last_active":"2024-09-17T02:54:43.155948+0000","last_peered":"2024-09-17T02:54:43.155948+0000","last_clean":"2024-09-17T02:54:43.155948+0000","last_became_active":"2024-09-17T02:54:42.155909+0000","last_became_peered":"2024-09-17T02:54:42.155909+0000","last_unstale":"2024-09-17T02:54:43.155948+0000","last_undegraded":"2024-09-17T02:54:43.155948+0000","last_fullsized":"2024-09-17T02:54:43.155948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:17.059902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358116+0000","last_change":"2024-09-17T02:54:42.155716+0000","last_active":"2024-09-17T02:54:43.358116+0000","last_peered":"2024-09-17T02:54:43.358116+0000","last_clean":"2024-09-17T02:54:43.358116+0000","last_became_active":"2024-09-17T02:54:42.153579+0000","last_became_peered":"2024-09-17T02:54:42.153579+0000","last_unstale":"2024-09-17T02:54:43.358116+0000","last_undegraded":"2024-09-17T02:54:43.358116+0000","last_fullsized":"2024-09-17T02:54:43.358116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:05.617863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358011+0000","last_change":"2024-09-17T02:54:42.156424+0000","last_active":"2024-09-17T02:54:43.358011+0000","last_peered":"2024-09-17T02:54:43.358011+0000","last_clean":"2024-09-17T02:54:43.358011+0000","last_became_active":"2024-09-17T02:54:42.153491+0000","last_became_peered":"2024-09-17T02:54:42.153491+0000","last_unstale":"2024-09-17T02:54:43.358011+0000","last_undegraded":"2024-09-17T02:54:43.358011+0000","last_fullsized":"2024-09-17T02:54:43.358011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:29.742009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.357974+0000","last_change":"2024-09-17T02:54:42.137938+0000","last_active":"2024-09-17T02:54:43.357974+0000","last_peered":"2024-09-17T02:54:43.357974+0000","last_clean":"2024-09-17T02:54:43.357974+0000","last_became_active":"2024-09-17T02:54:42.137668+0000","last_became_peered":"2024-09-17T02:54:42.137668+0000","last_unstale":"2024-09-17T02:54:43.357974+0000","last_undegraded":"2024-09-17T02:54:43.357974+0000","last_fullsized":"2024-09-17T02:54:43.357974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:10.660192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136589+0000","last_change":"2024-09-17T02:54:42.149999+0000","last_active":"2024-09-17T02:54:43.136589+0000","last_peered":"2024-09-17T02:54:43.136589+0000","last_clean":"2024-09-17T02:54:43.136589+0000","last_became_active":"2024-09-17T02:54:42.148750+0000","last_became_peered":"2024-09-17T02:54:42.148750+0000","last_unstale":"2024-09-17T02:54:43.136589+0000","last_undegraded":"2024-09-17T02:54:43.136589+0000","last_fullsized":"2024-09-17T02:54:43.136589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:44.699405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137550+0000","last_change":"2024-09-17T02:54:42.158291+0000","last_active":"2024-09-17T02:54:43.137550+0000","last_peered":"2024-09-17T02:54:43.137550+0000","last_clean":"2024-09-17T02:54:43.137550+0000","last_became_active":"2024-09-17T02:54:42.157953+0000","last_became_peered":"2024-09-17T02:54:42.157953+0000","last_unstale":"2024-09-17T02:54:43.137550+0000","last_undegraded":"2024-09-17T02:54:43.137550+0000","last_fullsized":"2024-09-17T02:54:43.137550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:02.774661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359170+0000","last_change":"2024-09-17T02:54:42.148225+0000","last_active":"2024-09-17T02:54:43.359170+0000","last_peered":"2024-09-17T02:54:43.359170+0000","last_clean":"2024-09-17T02:54:43.359170+0000","last_became_active":"2024-09-17T02:54:42.147920+0000","last_became_peered":"2024-09-17T02:54:42.147920+0000","last_unstale":"2024-09-17T02:54:43.359170+0000","last_undegraded":"2024-09-17T02:54:43.359170+0000","last_fullsized":"2024-09-17T02:54:43.359170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:41.335772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358522+0000","last_change":"2024-09-17T02:54:42.154258+0000","last_active":"2024-09-17T02:54:43.358522+0000","last_peered":"2024-09-17T02:54:43.358522+0000","last_clean":"2024-09-17T02:54:43.358522+0000","last_became_active":"2024-09-17T02:54:42.151466+0000","last_became_peered":"2024-09-17T02:54:42.151466+0000","last_unstale":"2024-09-17T02:54:43.358522+0000","last_undegraded":"2024-09-17T02:54:43.358522+0000","last_fullsized":"2024-09-17T02:54:43.358522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:00.920687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359980+0000","last_change":"2024-09-17T02:54:42.157130+0000","last_active":"2024-09-17T02:54:43.359980+0000","last_peered":"2024-09-17T02:54:43.359980+0000","last_clean":"2024-09-17T02:54:43.359980+0000","last_became_active":"2024-09-17T02:54:42.156580+0000","last_became_peered":"2024-09-17T02:54:42.156580+0000","last_unstale":"2024-09-17T02:54:43.359980+0000","last_undegraded":"2024-09-17T02:54:43.359980+0000","last_fullsized":"2024-09-17T02:54:43.359980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:10.309065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358156+0000","last_change":"2024-09-17T02:54:42.149936+0000","last_active":"2024-09-17T02:54:43.358156+0000","last_peered":"2024-09-17T02:54:43.358156+0000","last_clean":"2024-09-17T02:54:43.358156+0000","last_became_active":"2024-09-17T02:54:42.148805+0000","last_became_peered":"2024-09-17T02:54:42.148805+0000","last_unstale":"2024-09-17T02:54:43.358156+0000","last_undegraded":"2024-09-17T02:54:43.358156+0000","last_fullsized":"2024-09-17T02:54:43.358156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:12.654505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358203+0000","last_change":"2024-09-17T02:54:42.156633+0000","last_active":"2024-09-17T02:54:43.358203+0000","last_peered":"2024-09-17T02:54:43.358203+0000","last_clean":"2024-09-17T02:54:43.358203+0000","last_became_active":"2024-09-17T02:54:42.156344+0000","last_became_peered":"2024-09-17T02:54:42.156344+0000","last_unstale":"2024-09-17T02:54:43.358203+0000","last_undegraded":"2024-09-17T02:54:43.358203+0000","last_fullsized":"2024-09-17T02:54:43.358203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:26.079679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138163+0000","last_change":"2024-09-17T02:54:42.141191+0000","last_active":"2024-09-17T02:54:43.138163+0000","last_peered":"2024-09-17T02:54:43.138163+0000","last_clean":"2024-09-17T02:54:43.138163+0000","last_became_active":"2024-09-17T02:54:42.140736+0000","last_became_peered":"2024-09-17T02:54:42.140736+0000","last_unstale":"2024-09-17T02:54:43.138163+0000","last_undegraded":"2024-09-17T02:54:43.138163+0000","last_fullsized":"2024-09-17T02:54:43.138163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:45.082145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156112+0000","last_change":"2024-09-17T02:54:42.144099+0000","last_active":"2024-09-17T02:54:43.156112+0000","last_peered":"2024-09-17T02:54:43.156112+0000","last_clean":"2024-09-17T02:54:43.156112+0000","last_became_active":"2024-09-17T02:54:42.143809+0000","last_became_peered":"2024-09-17T02:54:42.143809+0000","last_unstale":"2024-09-17T02:54:43.156112+0000","last_undegraded":"2024-09-17T02:54:43.156112+0000","last_fullsized":"2024-09-17T02:54:43.156112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:19.550031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359685+0000","last_change":"2024-09-17T02:54:42.156846+0000","last_active":"2024-09-17T02:54:43.359685+0000","last_peered":"2024-09-17T02:54:43.359685+0000","last_clean":"2024-09-17T02:54:43.359685+0000","last_became_active":"2024-09-17T02:54:42.156229+0000","last_became_peered":"2024-09-17T02:54:42.156229+0000","last_unstale":"2024-09-17T02:54:43.359685+0000","last_undegraded":"2024-09-17T02:54:43.359685+0000","last_fullsized":"2024-09-17T02:54:43.359685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:14.258007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358116+0000","last_change":"2024-09-17T02:54:42.147973+0000","last_active":"2024-09-17T02:54:43.358116+0000","last_peered":"2024-09-17T02:54:43.358116+0000","last_clean":"2024-09-17T02:54:43.358116+0000","last_became_active":"2024-09-17T02:54:42.147642+0000","last_became_peered":"2024-09-17T02:54:42.147642+0000","last_unstale":"2024-09-17T02:54:43.358116+0000","last_undegraded":"2024-09-17T02:54:43.358116+0000","last_fullsized":"2024-09-17T02:54:43.358116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:32.329063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358017+0000","last_change":"2024-09-17T02:54:42.148238+0000","last_active":"2024-09-17T02:54:43.358017+0000","last_peered":"2024-09-17T02:54:43.358017+0000","last_clean":"2024-09-17T02:54:43.358017+0000","last_became_active":"2024-09-17T02:54:42.147968+0000","last_became_peered":"2024-09-17T02:54:42.147968+0000","last_unstale":"2024-09-17T02:54:43.358017+0000","last_undegraded":"2024-09-17T02:54:43.358017+0000","last_fullsized":"2024-09-17T02:54:43.358017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:34.663251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358738+0000","last_change":"2024-09-17T02:54:42.153412+0000","last_active":"2024-09-17T02:54:43.358738+0000","last_peered":"2024-09-17T02:54:43.358738+0000","last_clean":"2024-09-17T02:54:43.358738+0000","last_became_active":"2024-09-17T02:54:42.153203+0000","last_became_peered":"2024-09-17T02:54:42.153203+0000","last_unstale":"2024-09-17T02:54:43.358738+0000","last_undegraded":"2024-09-17T02:54:43.358738+0000","last_fullsized":"2024-09-17T02:54:43.358738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:17.922940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137503+0000","last_change":"2024-09-17T02:54:42.143439+0000","last_active":"2024-09-17T02:54:43.137503+0000","last_peered":"2024-09-17T02:54:43.137503+0000","last_clean":"2024-09-17T02:54:43.137503+0000","last_became_active":"2024-09-17T02:54:42.141811+0000","last_became_peered":"2024-09-17T02:54:42.141811+0000","last_unstale":"2024-09-17T02:54:43.137503+0000","last_undegraded":"2024-09-17T02:54:43.137503+0000","last_fullsized":"2024-09-17T02:54:43.137503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:00.262503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.139107+0000","last_change":"2024-09-17T02:54:42.155339+0000","last_active":"2024-09-17T02:54:43.139107+0000","last_peered":"2024-09-17T02:54:43.139107+0000","last_clean":"2024-09-17T02:54:43.139107+0000","last_became_active":"2024-09-17T02:54:42.154873+0000","last_became_peered":"2024-09-17T02:54:42.154873+0000","last_unstale":"2024-09-17T02:54:43.139107+0000","last_undegraded":"2024-09-17T02:54:43.139107+0000","last_fullsized":"2024-09-17T02:54:43.139107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:05.213755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359385+0000","last_change":"2024-09-17T02:54:41.136992+0000","last_active":"2024-09-17T02:54:43.359385+0000","last_peered":"2024-09-17T02:54:43.359385+0000","last_clean":"2024-09-17T02:54:43.359385+0000","last_became_active":"2024-09-17T02:54:41.136720+0000","last_became_peered":"2024-09-17T02:54:41.136720+0000","last_unstale":"2024-09-17T02:54:43.359385+0000","last_undegraded":"2024-09-17T02:54:43.359385+0000","last_fullsized":"2024-09-17T02:54:43.359385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:03.837671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358718+0000","last_change":"2024-09-17T02:54:42.156499+0000","last_active":"2024-09-17T02:54:43.358718+0000","last_peered":"2024-09-17T02:54:43.358718+0000","last_clean":"2024-09-17T02:54:43.358718+0000","last_became_active":"2024-09-17T02:54:42.156211+0000","last_became_peered":"2024-09-17T02:54:42.156211+0000","last_unstale":"2024-09-17T02:54:43.358718+0000","last_undegraded":"2024-09-17T02:54:43.358718+0000","last_fullsized":"2024-09-17T02:54:43.358718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:40.881577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136922+0000","last_change":"2024-09-17T02:54:41.125908+0000","last_active":"2024-09-17T02:54:43.136922+0000","last_peered":"2024-09-17T02:54:43.136922+0000","last_clean":"2024-09-17T02:54:43.136922+0000","last_became_active":"2024-09-17T02:54:41.124285+0000","last_became_peered":"2024-09-17T02:54:41.124285+0000","last_unstale":"2024-09-17T02:54:43.136922+0000","last_undegraded":"2024-09-17T02:54:43.136922+0000","last_fullsized":"2024-09-17T02:54:43.136922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:26.638048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358830+0000","last_change":"2024-09-17T02:54:41.133974+0000","last_active":"2024-09-17T02:54:43.358830+0000","last_peered":"2024-09-17T02:54:43.358830+0000","last_clean":"2024-09-17T02:54:43.358830+0000","last_became_active":"2024-09-17T02:54:41.130208+0000","last_became_peered":"2024-09-17T02:54:41.130208+0000","last_unstale":"2024-09-17T02:54:43.358830+0000","last_undegraded":"2024-09-17T02:54:43.358830+0000","last_fullsized":"2024-09-17T02:54:43.358830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.121870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358442+0000","last_change":"2024-09-17T02:54:42.147110+0000","last_active":"2024-09-17T02:54:43.358442+0000","last_peered":"2024-09-17T02:54:43.358442+0000","last_clean":"2024-09-17T02:54:43.358442+0000","last_became_active":"2024-09-17T02:54:42.146853+0000","last_became_peered":"2024-09-17T02:54:42.146853+0000","last_unstale":"2024-09-17T02:54:43.358442+0000","last_undegraded":"2024-09-17T02:54:43.358442+0000","last_fullsized":"2024-09-17T02:54:43.358442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:08.683366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358321+0000","last_change":"2024-09-17T02:54:41.133392+0000","last_active":"2024-09-17T02:54:43.358321+0000","last_peered":"2024-09-17T02:54:43.358321+0000","last_clean":"2024-09-17T02:54:43.358321+0000","last_became_active":"2024-09-17T02:54:41.130773+0000","last_became_peered":"2024-09-17T02:54:41.130773+0000","last_unstale":"2024-09-17T02:54:43.358321+0000","last_undegraded":"2024-09-17T02:54:43.358321+0000","last_fullsized":"2024-09-17T02:54:43.358321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:55.515228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155934+0000","last_change":"2024-09-17T02:54:42.144622+0000","last_active":"2024-09-17T02:54:43.155934+0000","last_peered":"2024-09-17T02:54:43.155934+0000","last_clean":"2024-09-17T02:54:43.155934+0000","last_became_active":"2024-09-17T02:54:42.144372+0000","last_became_peered":"2024-09-17T02:54:42.144372+0000","last_unstale":"2024-09-17T02:54:43.155934+0000","last_undegraded":"2024-09-17T02:54:43.155934+0000","last_fullsized":"2024-09-17T02:54:43.155934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:30.258039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138441+0000","last_change":"2024-09-17T02:54:41.136164+0000","last_active":"2024-09-17T02:54:43.138441+0000","last_peered":"2024-09-17T02:54:43.138441+0000","last_clean":"2024-09-17T02:54:43.138441+0000","last_became_active":"2024-09-17T02:54:41.135870+0000","last_became_peered":"2024-09-17T02:54:41.135870+0000","last_unstale":"2024-09-17T02:54:43.138441+0000","last_undegraded":"2024-09-17T02:54:43.138441+0000","last_fullsized":"2024-09-17T02:54:43.138441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:21.739561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358283+0000","last_change":"2024-09-17T02:54:42.155081+0000","last_active":"2024-09-17T02:54:43.358283+0000","last_peered":"2024-09-17T02:54:43.358283+0000","last_clean":"2024-09-17T02:54:43.358283+0000","last_became_active":"2024-09-17T02:54:42.152288+0000","last_became_peered":"2024-09-17T02:54:42.152288+0000","last_unstale":"2024-09-17T02:54:43.358283+0000","last_undegraded":"2024-09-17T02:54:43.358283+0000","last_fullsized":"2024-09-17T02:54:43.358283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:39.172434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358934+0000","last_change":"2024-09-17T02:54:41.134782+0000","last_active":"2024-09-17T02:54:43.358934+0000","last_peered":"2024-09-17T02:54:43.358934+0000","last_clean":"2024-09-17T02:54:43.358934+0000","last_became_active":"2024-09-17T02:54:41.133444+0000","last_became_peered":"2024-09-17T02:54:41.133444+0000","last_unstale":"2024-09-17T02:54:43.358934+0000","last_undegraded":"2024-09-17T02:54:43.358934+0000","last_fullsized":"2024-09-17T02:54:43.358934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:16.840770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359426+0000","last_change":"2024-09-17T02:54:42.153615+0000","last_active":"2024-09-17T02:54:43.359426+0000","last_peered":"2024-09-17T02:54:43.359426+0000","last_clean":"2024-09-17T02:54:43.359426+0000","last_became_active":"2024-09-17T02:54:42.153338+0000","last_became_peered":"2024-09-17T02:54:42.153338+0000","last_unstale":"2024-09-17T02:54:43.359426+0000","last_undegraded":"2024-09-17T02:54:43.359426+0000","last_fullsized":"2024-09-17T02:54:43.359426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:32.477196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155969+0000","last_change":"2024-09-17T02:54:41.133126+0000","last_active":"2024-09-17T02:54:43.155969+0000","last_peered":"2024-09-17T02:54:43.155969+0000","last_clean":"2024-09-17T02:54:43.155969+0000","last_became_active":"2024-09-17T02:54:41.132866+0000","last_became_peered":"2024-09-17T02:54:41.132866+0000","last_unstale":"2024-09-17T02:54:43.155969+0000","last_undegraded":"2024-09-17T02:54:43.155969+0000","last_fullsized":"2024-09-17T02:54:43.155969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:50.250221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137048+0000","last_change":"2024-09-17T02:54:42.150450+0000","last_active":"2024-09-17T02:54:43.137048+0000","last_peered":"2024-09-17T02:54:43.137048+0000","last_clean":"2024-09-17T02:54:43.137048+0000","last_became_active":"2024-09-17T02:54:42.150186+0000","last_became_peered":"2024-09-17T02:54:42.150186+0000","last_unstale":"2024-09-17T02:54:43.137048+0000","last_undegraded":"2024-09-17T02:54:43.137048+0000","last_fullsized":"2024-09-17T02:54:43.137048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:48.341430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138150+0000","last_change":"2024-09-17T02:54:41.128843+0000","last_active":"2024-09-17T02:54:43.138150+0000","last_peered":"2024-09-17T02:54:43.138150+0000","last_clean":"2024-09-17T02:54:43.138150+0000","last_became_active":"2024-09-17T02:54:41.128490+0000","last_became_peered":"2024-09-17T02:54:41.128490+0000","last_unstale":"2024-09-17T02:54:43.138150+0000","last_undegraded":"2024-09-17T02:54:43.138150+0000","last_fullsized":"2024-09-17T02:54:43.138150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:20.538807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.135840+0000","last_change":"2024-09-17T02:54:42.146224+0000","last_active":"2024-09-17T02:54:43.135840+0000","last_peered":"2024-09-17T02:54:43.135840+0000","last_clean":"2024-09-17T02:54:43.135840+0000","last_became_active":"2024-09-17T02:54:42.145934+0000","last_became_peered":"2024-09-17T02:54:42.145934+0000","last_unstale":"2024-09-17T02:54:43.135840+0000","last_undegraded":"2024-09-17T02:54:43.135840+0000","last_fullsized":"2024-09-17T02:54:43.135840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:26.208033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359244+0000","last_change":"2024-09-17T02:54:41.126988+0000","last_active":"2024-09-17T02:54:43.359244+0000","last_peered":"2024-09-17T02:54:43.359244+0000","last_clean":"2024-09-17T02:54:43.359244+0000","last_became_active":"2024-09-17T02:54:41.126723+0000","last_became_peered":"2024-09-17T02:54:41.126723+0000","last_unstale":"2024-09-17T02:54:43.359244+0000","last_undegraded":"2024-09-17T02:54:43.359244+0000","last_fullsized":"2024-09-17T02:54:43.359244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:06.248848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359672+0000","last_change":"2024-09-17T02:54:42.146284+0000","last_active":"2024-09-17T02:54:43.359672+0000","last_peered":"2024-09-17T02:54:43.359672+0000","last_clean":"2024-09-17T02:54:43.359672+0000","last_became_active":"2024-09-17T02:54:42.146015+0000","last_became_peered":"2024-09-17T02:54:42.146015+0000","last_unstale":"2024-09-17T02:54:43.359672+0000","last_undegraded":"2024-09-17T02:54:43.359672+0000","last_fullsized":"2024-09-17T02:54:43.359672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.467098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359153+0000","last_change":"2024-09-17T02:54:41.132996+0000","last_active":"2024-09-17T02:54:43.359153+0000","last_peered":"2024-09-17T02:54:43.359153+0000","last_clean":"2024-09-17T02:54:43.359153+0000","last_became_active":"2024-09-17T02:54:41.132135+0000","last_became_peered":"2024-09-17T02:54:41.132135+0000","last_unstale":"2024-09-17T02:54:43.359153+0000","last_undegraded":"2024-09-17T02:54:43.359153+0000","last_fullsized":"2024-09-17T02:54:43.359153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:07.376228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136531+0000","last_change":"2024-09-17T02:54:42.158937+0000","last_active":"2024-09-17T02:54:43.136531+0000","last_peered":"2024-09-17T02:54:43.136531+0000","last_clean":"2024-09-17T02:54:43.136531+0000","last_became_active":"2024-09-17T02:54:42.158282+0000","last_became_peered":"2024-09-17T02:54:42.158282+0000","last_unstale":"2024-09-17T02:54:43.136531+0000","last_undegraded":"2024-09-17T02:54:43.136531+0000","last_fullsized":"2024-09-17T02:54:43.136531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:28.545537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137699+0000","last_change":"2024-09-17T02:54:41.127168+0000","last_active":"2024-09-17T02:54:43.137699+0000","last_peered":"2024-09-17T02:54:43.137699+0000","last_clean":"2024-09-17T02:54:43.137699+0000","last_became_active":"2024-09-17T02:54:41.126901+0000","last_became_peered":"2024-09-17T02:54:41.126901+0000","last_unstale":"2024-09-17T02:54:43.137699+0000","last_undegraded":"2024-09-17T02:54:43.137699+0000","last_fullsized":"2024-09-17T02:54:43.137699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:21.080985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136732+0000","last_change":"2024-09-17T02:54:42.141939+0000","last_active":"2024-09-17T02:54:43.136732+0000","last_peered":"2024-09-17T02:54:43.136732+0000","last_clean":"2024-09-17T02:54:43.136732+0000","last_became_active":"2024-09-17T02:54:42.141638+0000","last_became_peered":"2024-09-17T02:54:42.141638+0000","last_unstale":"2024-09-17T02:54:43.136732+0000","last_undegraded":"2024-09-17T02:54:43.136732+0000","last_fullsized":"2024-09-17T02:54:43.136732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:57.994378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358218+0000","last_change":"2024-09-17T02:54:41.131775+0000","last_active":"2024-09-17T02:54:43.358218+0000","last_peered":"2024-09-17T02:54:43.358218+0000","last_clean":"2024-09-17T02:54:43.358218+0000","last_became_active":"2024-09-17T02:54:41.131311+0000","last_became_peered":"2024-09-17T02:54:41.131311+0000","last_unstale":"2024-09-17T02:54:43.358218+0000","last_undegraded":"2024-09-17T02:54:43.358218+0000","last_fullsized":"2024-09-17T02:54:43.358218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:28.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136931+0000","last_change":"2024-09-17T02:54:42.157762+0000","last_active":"2024-09-17T02:54:43.136931+0000","last_peered":"2024-09-17T02:54:43.136931+0000","last_clean":"2024-09-17T02:54:43.136931+0000","last_became_active":"2024-09-17T02:54:42.157491+0000","last_became_peered":"2024-09-17T02:54:42.157491+0000","last_unstale":"2024-09-17T02:54:43.136931+0000","last_undegraded":"2024-09-17T02:54:43.136931+0000","last_fullsized":"2024-09-17T02:54:43.136931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:19.836766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137249+0000","last_change":"2024-09-17T02:54:41.124818+0000","last_active":"2024-09-17T02:54:43.137249+0000","last_peered":"2024-09-17T02:54:43.137249+0000","last_clean":"2024-09-17T02:54:43.137249+0000","last_became_active":"2024-09-17T02:54:41.124391+0000","last_became_peered":"2024-09-17T02:54:41.124391+0000","last_unstale":"2024-09-17T02:54:43.137249+0000","last_undegraded":"2024-09-17T02:54:43.137249+0000","last_fullsized":"2024-09-17T02:54:43.137249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:16.876804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137289+0000","last_change":"2024-09-17T02:54:42.159256+0000","last_active":"2024-09-17T02:54:43.137289+0000","last_peered":"2024-09-17T02:54:43.137289+0000","last_clean":"2024-09-17T02:54:43.137289+0000","last_became_active":"2024-09-17T02:54:42.158656+0000","last_became_peered":"2024-09-17T02:54:42.158656+0000","last_unstale":"2024-09-17T02:54:43.137289+0000","last_undegraded":"2024-09-17T02:54:43.137289+0000","last_fullsized":"2024-09-17T02:54:43.137289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:05.910827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358555+0000","last_change":"2024-09-17T02:54:41.136678+0000","last_active":"2024-09-17T02:54:43.358555+0000","last_peered":"2024-09-17T02:54:43.358555+0000","last_clean":"2024-09-17T02:54:43.358555+0000","last_became_active":"2024-09-17T02:54:41.136398+0000","last_became_peered":"2024-09-17T02:54:41.136398+0000","last_unstale":"2024-09-17T02:54:43.358555+0000","last_undegraded":"2024-09-17T02:54:43.358555+0000","last_fullsized":"2024-09-17T02:54:43.358555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:39.254444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136302+0000","last_change":"2024-09-17T02:54:42.152570+0000","last_active":"2024-09-17T02:54:43.136302+0000","last_peered":"2024-09-17T02:54:43.136302+0000","last_clean":"2024-09-17T02:54:43.136302+0000","last_became_active":"2024-09-17T02:54:42.151788+0000","last_became_peered":"2024-09-17T02:54:42.151788+0000","last_unstale":"2024-09-17T02:54:43.136302+0000","last_undegraded":"2024-09-17T02:54:43.136302+0000","last_fullsized":"2024-09-17T02:54:43.136302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:07.826796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155816+0000","last_change":"2024-09-17T02:54:41.129677+0000","last_active":"2024-09-17T02:54:43.155816+0000","last_peered":"2024-09-17T02:54:43.155816+0000","last_clean":"2024-09-17T02:54:43.155816+0000","last_became_active":"2024-09-17T02:54:41.128120+0000","last_became_peered":"2024-09-17T02:54:41.128120+0000","last_unstale":"2024-09-17T02:54:43.155816+0000","last_undegraded":"2024-09-17T02:54:43.155816+0000","last_fullsized":"2024-09-17T02:54:43.155816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:29.303949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358791+0000","last_change":"2024-09-17T02:54:42.151741+0000","last_active":"2024-09-17T02:54:43.358791+0000","last_peered":"2024-09-17T02:54:43.358791+0000","last_clean":"2024-09-17T02:54:43.358791+0000","last_became_active":"2024-09-17T02:54:42.150459+0000","last_became_peered":"2024-09-17T02:54:42.150459+0000","last_unstale":"2024-09-17T02:54:43.358791+0000","last_undegraded":"2024-09-17T02:54:43.358791+0000","last_fullsized":"2024-09-17T02:54:43.358791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:18.116431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358136+0000","last_change":"2024-09-17T02:54:41.135494+0000","last_active":"2024-09-17T02:54:43.358136+0000","last_peered":"2024-09-17T02:54:43.358136+0000","last_clean":"2024-09-17T02:54:43.358136+0000","last_became_active":"2024-09-17T02:54:41.135146+0000","last_became_peered":"2024-09-17T02:54:41.135146+0000","last_unstale":"2024-09-17T02:54:43.358136+0000","last_undegraded":"2024-09-17T02:54:43.358136+0000","last_fullsized":"2024-09-17T02:54:43.358136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:55.347118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138244+0000","last_change":"2024-09-17T02:54:42.153708+0000","last_active":"2024-09-17T02:54:43.138244+0000","last_peered":"2024-09-17T02:54:43.138244+0000","last_clean":"2024-09-17T02:54:43.138244+0000","last_became_active":"2024-09-17T02:54:42.153438+0000","last_became_peered":"2024-09-17T02:54:42.153438+0000","last_unstale":"2024-09-17T02:54:43.138244+0000","last_undegraded":"2024-09-17T02:54:43.138244+0000","last_fullsized":"2024-09-17T02:54:43.138244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:30.371000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136979+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:54:43.136979+0000","last_peered":"2024-09-17T02:54:43.136979+0000","last_clean":"2024-09-17T02:54:43.136979+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:54:43.136979+0000","last_undegraded":"2024-09-17T02:54:43.136979+0000","last_fullsized":"2024-09-17T02:54:43.136979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359355+0000","last_change":"2024-09-17T02:54:41.132405+0000","last_active":"2024-09-17T02:54:43.359355+0000","last_peered":"2024-09-17T02:54:43.359355+0000","last_clean":"2024-09-17T02:54:43.359355+0000","last_became_active":"2024-09-17T02:54:41.131396+0000","last_became_peered":"2024-09-17T02:54:41.131396+0000","last_unstale":"2024-09-17T02:54:43.359355+0000","last_undegraded":"2024-09-17T02:54:43.359355+0000","last_fullsized":"2024-09-17T02:54:43.359355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:52.252060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359121+0000","last_change":"2024-09-17T02:54:42.151718+0000","last_active":"2024-09-17T02:54:43.359121+0000","last_peered":"2024-09-17T02:54:43.359121+0000","last_clean":"2024-09-17T02:54:43.359121+0000","last_became_active":"2024-09-17T02:54:42.151425+0000","last_became_peered":"2024-09-17T02:54:42.151425+0000","last_unstale":"2024-09-17T02:54:43.359121+0000","last_undegraded":"2024-09-17T02:54:43.359121+0000","last_fullsized":"2024-09-17T02:54:43.359121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:50.080913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136874+0000","last_change":"2024-09-17T02:54:41.134010+0000","last_active":"2024-09-17T02:54:43.136874+0000","last_peered":"2024-09-17T02:54:43.136874+0000","last_clean":"2024-09-17T02:54:43.136874+0000","last_became_active":"2024-09-17T02:54:41.133330+0000","last_became_peered":"2024-09-17T02:54:41.133330+0000","last_unstale":"2024-09-17T02:54:43.136874+0000","last_undegraded":"2024-09-17T02:54:43.136874+0000","last_fullsized":"2024-09-17T02:54:43.136874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:35.841779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358888+0000","last_change":"2024-09-17T02:54:42.156464+0000","last_active":"2024-09-17T02:54:43.358888+0000","last_peered":"2024-09-17T02:54:43.358888+0000","last_clean":"2024-09-17T02:54:43.358888+0000","last_became_active":"2024-09-17T02:54:42.156189+0000","last_became_peered":"2024-09-17T02:54:42.156189+0000","last_unstale":"2024-09-17T02:54:43.358888+0000","last_undegraded":"2024-09-17T02:54:43.358888+0000","last_fullsized":"2024-09-17T02:54:43.358888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:25:08.347022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358348+0000","last_change":"2024-09-17T02:54:41.136814+0000","last_active":"2024-09-17T02:54:43.358348+0000","last_peered":"2024-09-17T02:54:43.358348+0000","last_clean":"2024-09-17T02:54:43.358348+0000","last_became_active":"2024-09-17T02:54:41.136504+0000","last_became_peered":"2024-09-17T02:54:41.136504+0000","last_unstale":"2024-09-17T02:54:43.358348+0000","last_undegraded":"2024-09-17T02:54:43.358348+0000","last_fullsized":"2024-09-17T02:54:43.358348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:31.500343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156157+0000","last_change":"2024-09-17T02:54:42.139120+0000","last_active":"2024-09-17T02:54:43.156157+0000","last_peered":"2024-09-17T02:54:43.156157+0000","last_clean":"2024-09-17T02:54:43.156157+0000","last_became_active":"2024-09-17T02:54:42.138859+0000","last_became_peered":"2024-09-17T02:54:42.138859+0000","last_unstale":"2024-09-17T02:54:43.156157+0000","last_undegraded":"2024-09-17T02:54:43.156157+0000","last_fullsized":"2024-09-17T02:54:43.156157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:11.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359006+0000","last_change":"2024-09-17T02:54:41.135077+0000","last_active":"2024-09-17T02:54:43.359006+0000","last_peered":"2024-09-17T02:54:43.359006+0000","last_clean":"2024-09-17T02:54:43.359006+0000","last_became_active":"2024-09-17T02:54:41.134456+0000","last_became_peered":"2024-09-17T02:54:41.134456+0000","last_unstale":"2024-09-17T02:54:43.359006+0000","last_undegraded":"2024-09-17T02:54:43.359006+0000","last_fullsized":"2024-09-17T02:54:43.359006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:14.713147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136894+0000","last_change":"2024-09-17T02:54:42.148213+0000","last_active":"2024-09-17T02:54:43.136894+0000","last_peered":"2024-09-17T02:54:43.136894+0000","last_clean":"2024-09-17T02:54:43.136894+0000","last_became_active":"2024-09-17T02:54:42.147941+0000","last_became_peered":"2024-09-17T02:54:42.147941+0000","last_unstale":"2024-09-17T02:54:43.136894+0000","last_undegraded":"2024-09-17T02:54:43.136894+0000","last_fullsized":"2024-09-17T02:54:43.136894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:28.231123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156101+0000","last_change":"2024-09-17T02:54:41.129281+0000","last_active":"2024-09-17T02:54:43.156101+0000","last_peered":"2024-09-17T02:54:43.156101+0000","last_clean":"2024-09-17T02:54:43.156101+0000","last_became_active":"2024-09-17T02:54:41.129016+0000","last_became_peered":"2024-09-17T02:54:41.129016+0000","last_unstale":"2024-09-17T02:54:43.156101+0000","last_undegraded":"2024-09-17T02:54:43.156101+0000","last_fullsized":"2024-09-17T02:54:43.156101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:35.685956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358418+0000","last_change":"2024-09-17T02:54:42.149626+0000","last_active":"2024-09-17T02:54:43.358418+0000","last_peered":"2024-09-17T02:54:43.358418+0000","last_clean":"2024-09-17T02:54:43.358418+0000","last_became_active":"2024-09-17T02:54:42.148363+0000","last_became_peered":"2024-09-17T02:54:42.148363+0000","last_unstale":"2024-09-17T02:54:43.358418+0000","last_undegraded":"2024-09-17T02:54:43.358418+0000","last_fullsized":"2024-09-17T02:54:43.358418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:43.951700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136758+0000","last_change":"2024-09-17T02:54:41.127905+0000","last_active":"2024-09-17T02:54:43.136758+0000","last_peered":"2024-09-17T02:54:43.136758+0000","last_clean":"2024-09-17T02:54:43.136758+0000","last_became_active":"2024-09-17T02:54:41.127616+0000","last_became_peered":"2024-09-17T02:54:41.127616+0000","last_unstale":"2024-09-17T02:54:43.136758+0000","last_undegraded":"2024-09-17T02:54:43.136758+0000","last_fullsized":"2024-09-17T02:54:43.136758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:13.661134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.155795+0000","last_change":"2024-09-17T02:54:42.137451+0000","last_active":"2024-09-17T02:54:43.155795+0000","last_peered":"2024-09-17T02:54:43.155795+0000","last_clean":"2024-09-17T02:54:43.155795+0000","last_became_active":"2024-09-17T02:54:42.137156+0000","last_became_peered":"2024-09-17T02:54:42.137156+0000","last_unstale":"2024-09-17T02:54:43.155795+0000","last_undegraded":"2024-09-17T02:54:43.155795+0000","last_fullsized":"2024-09-17T02:54:43.155795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:10.118647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156125+0000","last_change":"2024-09-17T02:54:41.130345+0000","last_active":"2024-09-17T02:54:43.156125+0000","last_peered":"2024-09-17T02:54:43.156125+0000","last_clean":"2024-09-17T02:54:43.156125+0000","last_became_active":"2024-09-17T02:54:41.130078+0000","last_became_peered":"2024-09-17T02:54:41.130078+0000","last_unstale":"2024-09-17T02:54:43.156125+0000","last_undegraded":"2024-09-17T02:54:43.156125+0000","last_fullsized":"2024-09-17T02:54:43.156125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:46.185877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358887+0000","last_change":"2024-09-17T02:54:42.146439+0000","last_active":"2024-09-17T02:54:43.358887+0000","last_peered":"2024-09-17T02:54:43.358887+0000","last_clean":"2024-09-17T02:54:43.358887+0000","last_became_active":"2024-09-17T02:54:42.146179+0000","last_became_peered":"2024-09-17T02:54:42.146179+0000","last_unstale":"2024-09-17T02:54:43.358887+0000","last_undegraded":"2024-09-17T02:54:43.358887+0000","last_fullsized":"2024-09-17T02:54:43.358887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:23.894676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137820+0000","last_change":"2024-09-17T02:54:41.125471+0000","last_active":"2024-09-17T02:54:43.137820+0000","last_peered":"2024-09-17T02:54:43.137820+0000","last_clean":"2024-09-17T02:54:43.137820+0000","last_became_active":"2024-09-17T02:54:41.124551+0000","last_became_peered":"2024-09-17T02:54:41.124551+0000","last_unstale":"2024-09-17T02:54:43.137820+0000","last_undegraded":"2024-09-17T02:54:43.137820+0000","last_fullsized":"2024-09-17T02:54:43.137820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:02.494243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358379+0000","last_change":"2024-09-17T02:54:42.143465+0000","last_active":"2024-09-17T02:54:43.358379+0000","last_peered":"2024-09-17T02:54:43.358379+0000","last_clean":"2024-09-17T02:54:43.358379+0000","last_became_active":"2024-09-17T02:54:42.143167+0000","last_became_peered":"2024-09-17T02:54:42.143167+0000","last_unstale":"2024-09-17T02:54:43.358379+0000","last_undegraded":"2024-09-17T02:54:43.358379+0000","last_fullsized":"2024-09-17T02:54:43.358379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:37.631386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138696+0000","last_change":"2024-09-17T02:54:41.127039+0000","last_active":"2024-09-17T02:54:43.138696+0000","last_peered":"2024-09-17T02:54:43.138696+0000","last_clean":"2024-09-17T02:54:43.138696+0000","last_became_active":"2024-09-17T02:54:41.126724+0000","last_became_peered":"2024-09-17T02:54:41.126724+0000","last_unstale":"2024-09-17T02:54:43.138696+0000","last_undegraded":"2024-09-17T02:54:43.138696+0000","last_fullsized":"2024-09-17T02:54:43.138696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:25.897861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138769+0000","last_change":"2024-09-17T02:54:42.156420+0000","last_active":"2024-09-17T02:54:43.138769+0000","last_peered":"2024-09-17T02:54:43.138769+0000","last_clean":"2024-09-17T02:54:43.138769+0000","last_became_active":"2024-09-17T02:54:42.154866+0000","last_became_peered":"2024-09-17T02:54:42.154866+0000","last_unstale":"2024-09-17T02:54:43.138769+0000","last_undegraded":"2024-09-17T02:54:43.138769+0000","last_fullsized":"2024-09-17T02:54:43.138769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:24.806778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156042+0000","last_change":"2024-09-17T02:54:41.131579+0000","last_active":"2024-09-17T02:54:43.156042+0000","last_peered":"2024-09-17T02:54:43.156042+0000","last_clean":"2024-09-17T02:54:43.156042+0000","last_became_active":"2024-09-17T02:54:41.131123+0000","last_became_peered":"2024-09-17T02:54:41.131123+0000","last_unstale":"2024-09-17T02:54:43.156042+0000","last_undegraded":"2024-09-17T02:54:43.156042+0000","last_fullsized":"2024-09-17T02:54:43.156042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:17.467321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359468+0000","last_change":"2024-09-17T02:54:42.146004+0000","last_active":"2024-09-17T02:54:43.359468+0000","last_peered":"2024-09-17T02:54:43.359468+0000","last_clean":"2024-09-17T02:54:43.359468+0000","last_became_active":"2024-09-17T02:54:42.145739+0000","last_became_peered":"2024-09-17T02:54:42.145739+0000","last_unstale":"2024-09-17T02:54:43.359468+0000","last_undegraded":"2024-09-17T02:54:43.359468+0000","last_fullsized":"2024-09-17T02:54:43.359468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:31.840015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.156307+0000","last_change":"2024-09-17T02:54:41.127869+0000","last_active":"2024-09-17T02:54:43.156307+0000","last_peered":"2024-09-17T02:54:43.156307+0000","last_clean":"2024-09-17T02:54:43.156307+0000","last_became_active":"2024-09-17T02:54:41.127552+0000","last_became_peered":"2024-09-17T02:54:41.127552+0000","last_unstale":"2024-09-17T02:54:43.156307+0000","last_undegraded":"2024-09-17T02:54:43.156307+0000","last_fullsized":"2024-09-17T02:54:43.156307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:45.759358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359868+0000","last_change":"2024-09-17T02:54:42.147352+0000","last_active":"2024-09-17T02:54:43.359868+0000","last_peered":"2024-09-17T02:54:43.359868+0000","last_clean":"2024-09-17T02:54:43.359868+0000","last_became_active":"2024-09-17T02:54:42.146704+0000","last_became_peered":"2024-09-17T02:54:42.146704+0000","last_unstale":"2024-09-17T02:54:43.359868+0000","last_undegraded":"2024-09-17T02:54:43.359868+0000","last_fullsized":"2024-09-17T02:54:43.359868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:43.443564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.136064+0000","last_change":"2024-09-17T02:54:41.126814+0000","last_active":"2024-09-17T02:54:43.136064+0000","last_peered":"2024-09-17T02:54:43.136064+0000","last_clean":"2024-09-17T02:54:43.136064+0000","last_became_active":"2024-09-17T02:54:41.126505+0000","last_became_peered":"2024-09-17T02:54:41.126505+0000","last_unstale":"2024-09-17T02:54:43.136064+0000","last_undegraded":"2024-09-17T02:54:43.136064+0000","last_fullsized":"2024-09-17T02:54:43.136064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:31.318671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137986+0000","last_change":"2024-09-17T02:54:42.149079+0000","last_active":"2024-09-17T02:54:43.137986+0000","last_peered":"2024-09-17T02:54:43.137986+0000","last_clean":"2024-09-17T02:54:43.137986+0000","last_became_active":"2024-09-17T02:54:42.148783+0000","last_became_peered":"2024-09-17T02:54:42.148783+0000","last_unstale":"2024-09-17T02:54:43.137986+0000","last_undegraded":"2024-09-17T02:54:43.137986+0000","last_fullsized":"2024-09-17T02:54:43.137986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:06.553170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358191+0000","last_change":"2024-09-17T02:54:42.158896+0000","last_active":"2024-09-17T02:54:43.358191+0000","last_peered":"2024-09-17T02:54:43.358191+0000","last_clean":"2024-09-17T02:54:43.358191+0000","last_became_active":"2024-09-17T02:54:42.157766+0000","last_became_peered":"2024-09-17T02:54:42.157766+0000","last_unstale":"2024-09-17T02:54:43.358191+0000","last_undegraded":"2024-09-17T02:54:43.358191+0000","last_fullsized":"2024-09-17T02:54:43.358191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:09.623648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.138577+0000","last_change":"2024-09-17T02:54:41.133352+0000","last_active":"2024-09-17T02:54:43.138577+0000","last_peered":"2024-09-17T02:54:43.138577+0000","last_clean":"2024-09-17T02:54:43.138577+0000","last_became_active":"2024-09-17T02:54:41.133001+0000","last_became_peered":"2024-09-17T02:54:41.133001+0000","last_unstale":"2024-09-17T02:54:43.138577+0000","last_undegraded":"2024-09-17T02:54:43.138577+0000","last_fullsized":"2024-09-17T02:54:43.138577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:25.234888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358704+0000","last_change":"2024-09-17T02:54:42.157016+0000","last_active":"2024-09-17T02:54:43.358704+0000","last_peered":"2024-09-17T02:54:43.358704+0000","last_clean":"2024-09-17T02:54:43.358704+0000","last_became_active":"2024-09-17T02:54:42.155446+0000","last_became_peered":"2024-09-17T02:54:42.155446+0000","last_unstale":"2024-09-17T02:54:43.358704+0000","last_undegraded":"2024-09-17T02:54:43.358704+0000","last_fullsized":"2024-09-17T02:54:43.358704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:10.877471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.137546+0000","last_change":"2024-09-17T02:54:41.131298+0000","last_active":"2024-09-17T02:54:43.137546+0000","last_peered":"2024-09-17T02:54:43.137546+0000","last_clean":"2024-09-17T02:54:43.137546+0000","last_became_active":"2024-09-17T02:54:41.131019+0000","last_became_peered":"2024-09-17T02:54:41.131019+0000","last_unstale":"2024-09-17T02:54:43.137546+0000","last_undegraded":"2024-09-17T02:54:43.137546+0000","last_fullsized":"2024-09-17T02:54:43.137546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:42.571738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358655+0000","last_change":"2024-09-17T02:54:42.145720+0000","last_active":"2024-09-17T02:54:43.358655+0000","last_peered":"2024-09-17T02:54:43.358655+0000","last_clean":"2024-09-17T02:54:43.358655+0000","last_became_active":"2024-09-17T02:54:42.145389+0000","last_became_peered":"2024-09-17T02:54:42.145389+0000","last_unstale":"2024-09-17T02:54:43.358655+0000","last_undegraded":"2024-09-17T02:54:43.358655+0000","last_fullsized":"2024-09-17T02:54:43.358655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:43.429332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358712+0000","last_change":"2024-09-17T02:54:41.128714+0000","last_active":"2024-09-17T02:54:43.358712+0000","last_peered":"2024-09-17T02:54:43.358712+0000","last_clean":"2024-09-17T02:54:43.358712+0000","last_became_active":"2024-09-17T02:54:41.128099+0000","last_became_peered":"2024-09-17T02:54:41.128099+0000","last_unstale":"2024-09-17T02:54:43.358712+0000","last_undegraded":"2024-09-17T02:54:43.358712+0000","last_fullsized":"2024-09-17T02:54:43.358712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:06.229882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.358452+0000","last_change":"2024-09-17T02:54:42.146900+0000","last_active":"2024-09-17T02:54:43.358452+0000","last_peered":"2024-09-17T02:54:43.358452+0000","last_clean":"2024-09-17T02:54:43.358452+0000","last_became_active":"2024-09-17T02:54:42.146654+0000","last_became_peered":"2024-09-17T02:54:42.146654+0000","last_unstale":"2024-09-17T02:54:43.358452+0000","last_undegraded":"2024-09-17T02:54:43.358452+0000","last_fullsized":"2024-09-17T02:54:43.358452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:41.114667+0000","last_clean_scrub_stamp":"2024-09-17T02:54:41.114667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:58.031273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T02:54:43.359142+0000","last_change":"2024-09-17T02:54:41.125421+0000","last_active":"2024-09-17T02:54:43.359142+0000","last_peered":"2024-09-17T02:54:43.359142+0000","last_clean":"2024-09-17T02:54:43.359142+0000","last_became_active":"2024-09-17T02:54:41.124528+0000","last_became_peered":"2024-09-17T02:54:41.124528+0000","last_unstale":"2024-09-17T02:54:43.359142+0000","last_undegraded":"2024-09-17T02:54:43.359142+0000","last_fullsized":"2024-09-17T02:54:43.359142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:40.107593+0000","last_clean_scrub_stamp":"2024-09-17T02:54:40.107593+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:02.002045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333605,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924465,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194661,"statfs":{"total":200000000,"available":199333549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:54:55.721 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:54:55.721 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T02:54:55.721 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T02:54:55.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T02:54:55.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.869+0000 7f67cb5e6640 1 -- 172.21.15.104:0/1134556997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 msgr2=0x7f67c40cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.869+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/1134556997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 0x7f67c40cde90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f67c40b4080 tx=0x7f67b402a8d0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.869+0000 7f67cb5e6640 1 -- 172.21.15.104:0/1134556997 shutdown_connections 2024-09-17T02:54:55.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.869+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/1134556997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67c40cefb0 0x7f67c40cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.869+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/1134556997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 0x7f67c40cde90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.869+0000 7f67cb5e6640 1 -- 172.21.15.104:0/1134556997 >> 172.21.15.104:0/1134556997 conn(0x7f67c40d28a0 msgr2=0x7f67c40d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:55.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.869+0000 7f67cb5e6640 1 -- 172.21.15.104:0/1134556997 shutdown_connections 2024-09-17T02:54:55.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.869+0000 7f67cb5e6640 1 -- 172.21.15.104:0/1134556997 wait complete. 2024-09-17T02:54:55.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.871+0000 7f67cb5e6640 1 Processor -- start 2024-09-17T02:54:55.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.871+0000 7f67cb5e6640 1 -- start start 2024-09-17T02:54:55.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67cb5e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 0x7f67c40cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67cb5e6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67c40cefb0 0x7f67c4166930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67cb5e6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67c40d0470 0x7f67c4160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67cb5e6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f67c40cfa80 con 0x7f67c40b7bb0 2024-09-17T02:54:55.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67cb5e6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67c40cf900 con 0x7f67c40d0470 2024-09-17T02:54:55.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67cb5e6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f67c40cfc00 con 0x7f67c40cefb0 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67c9382640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 0x7f67c40cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67c9382640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 0x7f67c40cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50650/0 (socket says 172.21.15.104:50650) 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67c9382640 1 -- 172.21.15.104:0/2099330828 learned_addr learned my addr 172.21.15.104:0/2099330828 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67c9b83640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67c40d0470 0x7f67c4160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.872+0000 7f67c8b81640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67c40cefb0 0x7f67c4166930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c9382640 1 -- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67c40cefb0 msgr2=0x7f67c4166930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c9382640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67c40cefb0 0x7f67c4166930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c9382640 1 -- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67c40d0470 msgr2=0x7f67c4160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c9382640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67c40d0470 0x7f67c4160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c9382640 1 -- 172.21.15.104:0/2099330828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c41673a0 con 0x7f67c40b7bb0 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c9382640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 0x7f67c40cc0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009be0 tx=0x7f67b4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c1ffb640 1 -- 172.21.15.104:0/2099330828 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4004d40 con 0x7f67c40b7bb0 2024-09-17T02:54:55.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c1ffb640 1 -- 172.21.15.104:0/2099330828 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67b4003e10 con 0x7f67c40b7bb0 2024-09-17T02:54:55.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67c1ffb640 1 -- 172.21.15.104:0/2099330828 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b40042a0 con 0x7f67c40b7bb0 2024-09-17T02:54:55.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c41f7040 con 0x7f67c40b7bb0 2024-09-17T02:54:55.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.873+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c41f75c0 con 0x7f67c40b7bb0 2024-09-17T02:54:55.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.874+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c40cde90 con 0x7f67c40b7bb0 2024-09-17T02:54:55.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.875+0000 7f67c1ffb640 1 -- 172.21.15.104:0/2099330828 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67b400c040 con 0x7f67c40b7bb0 2024-09-17T02:54:55.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.875+0000 7f67c1ffb640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b0078b90 0x7f67b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:55.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.875+0000 7f67c1ffb640 1 -- 172.21.15.104:0/2099330828 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f67b40bc2c0 con 0x7f67c40b7bb0 2024-09-17T02:54:55.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.876+0000 7f67c8b81640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b0078b90 0x7f67b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:55.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.876+0000 7f67c8b81640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b0078b90 0x7f67b007b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67c40b07b0 tx=0x7f67b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:55.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:55.880+0000 7f67c1ffb640 1 -- 172.21.15.104:0/2099330828 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f67c41f7040 con 0x7f67c40b7bb0 2024-09-17T02:54:56.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.092+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f67c406adb0 con 0x7f67c40b7bb0 2024-09-17T02:54:56.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.092+0000 7f67c1ffb640 1 -- 172.21.15.104:0/2099330828 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f67b4084030 con 0x7f67c40b7bb0 2024-09-17T02:54:56.092 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:56.092 INFO:teuthology.orchestra.run.smithi104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T02:54:56.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b0078b90 msgr2=0x7f67b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b0078b90 0x7f67b007b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f67c40b07b0 tx=0x7f67b8009040 comp rx=0 tx=0).stop 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 msgr2=0x7f67c40cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 0x7f67c40cc0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009be0 tx=0x7f67b4003c20 comp rx=0 tx=0).stop 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 shutdown_connections 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b0078b90 0x7f67b007b0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67c40d0470 0x7f67c4160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67c40cefb0 0x7f67c4166930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 --2- 172.21.15.104:0/2099330828 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67c40b7bb0 0x7f67c40cc0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 >> 172.21.15.104:0/2099330828 conn(0x7f67c40d28a0 msgr2=0x7f67c41649c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 shutdown_connections 2024-09-17T02:54:56.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.095+0000 7f67cb5e6640 1 -- 172.21.15.104:0/2099330828 wait complete. 2024-09-17T02:54:56.105 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T02:54:56.106 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 -- 172.21.15.104:0/1371407484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc0b65e0 msgr2=0x7f5ecc0b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/1371407484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc0b65e0 0x7f5ecc0b69f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc06dd60 tx=0x7f5ec802a4f0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 -- 172.21.15.104:0/1371407484 shutdown_connections 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/1371407484 >> v2:172.21.15.192:3300/0 conn(0x7f5ecc15fb40 0x7f5ecc162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/1371407484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc15f1f0 0x7f5ecc15f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/1371407484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc0b65e0 0x7f5ecc0b69f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 -- 172.21.15.104:0/1371407484 >> 172.21.15.104:0/1371407484 conn(0x7f5ecc069120 msgr2=0x7f5ecc069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 -- 172.21.15.104:0/1371407484 shutdown_connections 2024-09-17T02:54:56.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.220+0000 7f5ed46c5640 1 -- 172.21.15.104:0/1371407484 wait complete. 2024-09-17T02:54:56.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.221+0000 7f5ed46c5640 1 Processor -- start 2024-09-17T02:54:56.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.221+0000 7f5ed46c5640 1 -- start start 2024-09-17T02:54:56.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed46c5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0b65e0 0x7f5ecc0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed46c5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc15f1f0 0x7f5ecc14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed46c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc15fb40 0x7f5ecc159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed46c5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc163650 con 0x7f5ecc15fb40 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed46c5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc1634d0 con 0x7f5ecc15f1f0 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed46c5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc1637d0 con 0x7f5ecc0b65e0 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc15fb40 0x7f5ecc159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc15fb40 0x7f5ecc159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50662/0 (socket says 172.21.15.104:50662) 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 -- 172.21.15.104:0/17291487 learned_addr learned my addr 172.21.15.104:0/17291487 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2461640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0b65e0 0x7f5ecc0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed1c60640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc15f1f0 0x7f5ecc14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 -- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0b65e0 msgr2=0x7f5ecc0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0b65e0 0x7f5ecc0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 -- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc15f1f0 msgr2=0x7f5ecc14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc15f1f0 0x7f5ecc14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 -- 172.21.15.104:0/17291487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc159080 con 0x7f5ecc15fb40 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed1c60640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc15f1f0 0x7f5ecc14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed2c62640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc15fb40 0x7f5ecc159580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400ca80 tx=0x7f5ec400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ec2ffd640 1 -- 172.21.15.104:0/17291487 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4007d90 con 0x7f5ecc15fb40 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ec2ffd640 1 -- 172.21.15.104:0/17291487 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ec4004c30 con 0x7f5ecc15fb40 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ecc0ca7e0 con 0x7f5ecc15fb40 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.223+0000 7f5ec2ffd640 1 -- 172.21.15.104:0/17291487 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4005280 con 0x7f5ecc15fb40 2024-09-17T02:54:56.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.224+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ecc0cada0 con 0x7f5ecc15fb40 2024-09-17T02:54:56.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.224+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ecc15f600 con 0x7f5ecc15fb40 2024-09-17T02:54:56.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.225+0000 7f5ec2ffd640 1 -- 172.21.15.104:0/17291487 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ec4005420 con 0x7f5ecc15fb40 2024-09-17T02:54:56.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.226+0000 7f5ec2ffd640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5eb0078b90 0x7f5eb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.226+0000 7f5ec2ffd640 1 -- 172.21.15.104:0/17291487 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5ec409b7b0 con 0x7f5ecc15fb40 2024-09-17T02:54:56.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.226+0000 7f5ed2461640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5eb0078b90 0x7f5eb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.226+0000 7f5ed2461640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5eb0078b90 0x7f5eb007b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8033000 tx=0x7f5ec8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:56.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.230+0000 7f5ec2ffd640 1 -- 172.21.15.104:0/17291487 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ec4014070 con 0x7f5ecc15fb40 2024-09-17T02:54:56.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.439+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ecc0ca570 con 0x7f5ecc15fb40 2024-09-17T02:54:56.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.439+0000 7f5ec2ffd640 1 -- 172.21.15.104:0/17291487 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5229 (secure 0 0 0) 0x7f5ec4063520 con 0x7f5ecc15fb40 2024-09-17T02:54:56.439 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:56.439 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:54:41.483636+0000","modified":"2024-09-17T02:54:44.441267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-17T02:54:56.439 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T02:54:56.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5eb0078b90 msgr2=0x7f5eb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5eb0078b90 0x7f5eb007b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8033000 tx=0x7f5ec8004730 comp rx=0 tx=0).stop 2024-09-17T02:54:56.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc15fb40 msgr2=0x7f5ecc159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc15fb40 0x7f5ecc159580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400ca80 tx=0x7f5ec400cf40 comp rx=0 tx=0).stop 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 shutdown_connections 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5eb0078b90 0x7f5eb007b0a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ecc15f1f0 0x7f5ecc14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ecc15fb40 0x7f5ecc159580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 --2- 172.21.15.104:0/17291487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ecc0b65e0 0x7f5ecc0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 >> 172.21.15.104:0/17291487 conn(0x7f5ecc069120 msgr2=0x7f5ecc162490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 shutdown_connections 2024-09-17T02:54:56.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.441+0000 7f5ed46c5640 1 -- 172.21.15.104:0/17291487 wait complete. 2024-09-17T02:54:56.453 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:54:56.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.566+0000 7f7cace1f640 1 -- 172.21.15.104:0/1831069445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca80b6cb0 msgr2=0x7f7ca815f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.566+0000 7f7cace1f640 1 --2- 172.21.15.104:0/1831069445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca80b6cb0 0x7f7ca815f0b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c005fd0 tx=0x7f7c9c02a5d0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.566+0000 7f7cace1f640 1 -- 172.21.15.104:0/1831069445 shutdown_connections 2024-09-17T02:54:56.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.566+0000 7f7cace1f640 1 --2- 172.21.15.104:0/1831069445 >> v2:172.21.15.192:3300/0 conn(0x7f7ca81621e0 0x7f7ca815f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.566+0000 7f7cace1f640 1 --2- 172.21.15.104:0/1831069445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca80b6cb0 0x7f7ca815f0b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.566+0000 7f7cace1f640 1 -- 172.21.15.104:0/1831069445 >> 172.21.15.104:0/1831069445 conn(0x7f7ca8069120 msgr2=0x7f7ca8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:56.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.566+0000 7f7cace1f640 1 -- 172.21.15.104:0/1831069445 shutdown_connections 2024-09-17T02:54:56.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.566+0000 7f7cace1f640 1 -- 172.21.15.104:0/1831069445 wait complete. 2024-09-17T02:54:56.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.568+0000 7f7cace1f640 1 Processor -- start 2024-09-17T02:54:56.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.568+0000 7f7cace1f640 1 -- start start 2024-09-17T02:54:56.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7cace1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca81621e0 0x7f7ca8159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7cace1f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca8162cb0 0x7f7ca81e9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7cace1f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca8159d80 0x7f7ca81e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7cace1f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca815fec0 con 0x7f7ca81621e0 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7cace1f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca815fd40 con 0x7f7ca8162cb0 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7cace1f640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca8160040 con 0x7f7ca8159d80 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7ca659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca81621e0 0x7f7ca8159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7ca659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca81621e0 0x7f7ca8159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50666/0 (socket says 172.21.15.104:50666) 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.569+0000 7f7ca659c640 1 -- 172.21.15.104:0/847509700 learned_addr learned my addr 172.21.15.104:0/847509700 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7ca5d9b640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca8162cb0 0x7f7ca81e9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7ca6d9d640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca8159d80 0x7f7ca81e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7ca659c640 1 -- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca8159d80 msgr2=0x7f7ca81e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7ca659c640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca8159d80 0x7f7ca81e9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7ca659c640 1 -- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca8162cb0 msgr2=0x7f7ca81e9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7ca659c640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca8162cb0 0x7f7ca81e9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7ca659c640 1 -- 172.21.15.104:0/847509700 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca80cd050 con 0x7f7ca81621e0 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7ca659c640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca81621e0 0x7f7ca8159510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800c390 tx=0x7f7c9800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7c96ffd640 1 -- 172.21.15.104:0/847509700 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c98017070 con 0x7f7ca81621e0 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7c96ffd640 1 -- 172.21.15.104:0/847509700 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c980053c0 con 0x7f7ca81621e0 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca81f5f20 con 0x7f7ca81621e0 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7c96ffd640 1 -- 172.21.15.104:0/847509700 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c98003880 con 0x7f7ca81621e0 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.570+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca80cd2c0 con 0x7f7ca81621e0 2024-09-17T02:54:56.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.571+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca81f60f0 con 0x7f7ca81621e0 2024-09-17T02:54:56.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.572+0000 7f7c96ffd640 1 -- 172.21.15.104:0/847509700 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c9801a070 con 0x7f7ca81621e0 2024-09-17T02:54:56.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.573+0000 7f7c96ffd640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c88078bc0 0x7f7c8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.573+0000 7f7c96ffd640 1 -- 172.21.15.104:0/847509700 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7c9809a090 con 0x7f7ca81621e0 2024-09-17T02:54:56.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.573+0000 7f7ca5d9b640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c88078bc0 0x7f7c8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.573+0000 7f7ca5d9b640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c88078bc0 0x7f7c8807b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c033000 tx=0x7f7c9c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:56.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.578+0000 7f7c96ffd640 1 -- 172.21.15.104:0/847509700 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c98061f10 con 0x7f7ca81621e0 2024-09-17T02:54:56.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.786+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ca81604f0 con 0x7f7ca81621e0 2024-09-17T02:54:56.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.786+0000 7f7c96ffd640 1 -- 172.21.15.104:0/847509700 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5229 (secure 0 0 0) 0x7f7c98066940 con 0x7f7ca81621e0 2024-09-17T02:54:56.786 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:56.786 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:54:41.483636+0000","modified":"2024-09-17T02:54:44.441267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-17T02:54:56.786 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T02:54:56.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c88078bc0 msgr2=0x7f7c8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c88078bc0 0x7f7c8807b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c033000 tx=0x7f7c9c004730 comp rx=0 tx=0).stop 2024-09-17T02:54:56.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca81621e0 msgr2=0x7f7ca8159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca81621e0 0x7f7ca8159510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c9800c390 tx=0x7f7c9800c850 comp rx=0 tx=0).stop 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 shutdown_connections 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c88078bc0 0x7f7c8807b0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca8162cb0 0x7f7ca81e9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca8159d80 0x7f7ca81e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 --2- 172.21.15.104:0/847509700 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ca81621e0 0x7f7ca8159510 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 >> 172.21.15.104:0/847509700 conn(0x7f7ca8069120 msgr2=0x7f7ca80b8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.788+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 shutdown_connections 2024-09-17T02:54:56.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.789+0000 7f7cace1f640 1 -- 172.21.15.104:0/847509700 wait complete. 2024-09-17T02:54:56.799 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:54:56.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.911+0000 7f558904d640 1 -- 172.21.15.104:0/1318404674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55840b65e0 msgr2=0x7f55840b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.911+0000 7f558904d640 1 --2- 172.21.15.104:0/1318404674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55840b65e0 0x7f55840b69f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5574005fd0 tx=0x7f557402a540 comp rx=0 tx=0).stop 2024-09-17T02:54:56.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.911+0000 7f558904d640 1 -- 172.21.15.104:0/1318404674 shutdown_connections 2024-09-17T02:54:56.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.911+0000 7f558904d640 1 --2- 172.21.15.104:0/1318404674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f558415fd10 0x7f5584161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.911+0000 7f558904d640 1 --2- 172.21.15.104:0/1318404674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f55840b65e0 0x7f55840b69f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.911+0000 7f558904d640 1 -- 172.21.15.104:0/1318404674 >> 172.21.15.104:0/1318404674 conn(0x7f5584069120 msgr2=0x7f5584069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:56.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.911+0000 7f558904d640 1 -- 172.21.15.104:0/1318404674 shutdown_connections 2024-09-17T02:54:56.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.911+0000 7f558904d640 1 -- 172.21.15.104:0/1318404674 wait complete. 2024-09-17T02:54:56.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.913+0000 7f558904d640 1 Processor -- start 2024-09-17T02:54:56.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.914+0000 7f558904d640 1 -- start start 2024-09-17T02:54:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f558904d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55840b65e0 0x7f55840c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f558904d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f558415f1f0 0x7f55841587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f558904d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f558415fd10 0x7f5584149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f558904d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5584161e40 con 0x7f558415f1f0 2024-09-17T02:54:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f558904d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5584161cc0 con 0x7f55840b65e0 2024-09-17T02:54:56.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f558904d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5584161fc0 con 0x7f558415fd10 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f557a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f558415f1f0 0x7f55841587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f557a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f558415f1f0 0x7f55841587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50694/0 (socket says 172.21.15.104:50694) 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f557a59c640 1 -- 172.21.15.104:0/3657553643 learned_addr learned my addr 172.21.15.104:0/3657553643 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f558359e640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f558415fd10 0x7f5584149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f5582d9d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55840b65e0 0x7f55840c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f557a59c640 1 -- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f558415fd10 msgr2=0x7f5584149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f557a59c640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f558415fd10 0x7f5584149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f557a59c640 1 -- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55840b65e0 msgr2=0x7f55840c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f557a59c640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55840b65e0 0x7f55840c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:56.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f557a59c640 1 -- 172.21.15.104:0/3657553643 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55841593f0 con 0x7f558415f1f0 2024-09-17T02:54:56.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.915+0000 7f5582d9d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55840b65e0 0x7f55840c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:54:56.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.916+0000 7f557a59c640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f558415f1f0 0x7f55841587e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c3f0 tx=0x7f556c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:56.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.916+0000 7f557bfff640 1 -- 172.21.15.104:0/3657553643 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c017070 con 0x7f558415f1f0 2024-09-17T02:54:56.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.916+0000 7f557bfff640 1 -- 172.21.15.104:0/3657553643 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f556c0035f0 con 0x7f558415f1f0 2024-09-17T02:54:56.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.916+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55841596d0 con 0x7f558415f1f0 2024-09-17T02:54:56.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.916+0000 7f557bfff640 1 -- 172.21.15.104:0/3657553643 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c003a40 con 0x7f558415f1f0 2024-09-17T02:54:56.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.916+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55840c8940 con 0x7f558415f1f0 2024-09-17T02:54:56.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.917+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5584162520 con 0x7f558415f1f0 2024-09-17T02:54:56.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.917+0000 7f557bfff640 1 -- 172.21.15.104:0/3657553643 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f556c01a070 con 0x7f558415f1f0 2024-09-17T02:54:56.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.918+0000 7f557bfff640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5564078b90 0x7f556407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:56.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.918+0000 7f557bfff640 1 -- 172.21.15.104:0/3657553643 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f556c099e90 con 0x7f558415f1f0 2024-09-17T02:54:56.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.918+0000 7f5582d9d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5564078b90 0x7f556407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:56.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.919+0000 7f5582d9d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5564078b90 0x7f556407b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5574033000 tx=0x7f5574004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:56.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:56.922+0000 7f557bfff640 1 -- 172.21.15.104:0/3657553643 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55840b6f30 con 0x7f558415f1f0 2024-09-17T02:54:57.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.096+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5584159180 con 0x7f558415f1f0 2024-09-17T02:54:57.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.097+0000 7f557bfff640 1 -- 172.21.15.104:0/3657553643 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f556c061c60 con 0x7f558415f1f0 2024-09-17T02:54:57.097 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:57.097 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:43.133211+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:54:57.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5564078b90 msgr2=0x7f556407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5564078b90 0x7f556407b0a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5574033000 tx=0x7f5574004730 comp rx=0 tx=0).stop 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f558415f1f0 msgr2=0x7f55841587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f558415f1f0 0x7f55841587e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f556c00c3f0 tx=0x7f556c00c8b0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 shutdown_connections 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5564078b90 0x7f556407b0a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f558415fd10 0x7f5584149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f558415f1f0 0x7f55841587e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 --2- 172.21.15.104:0/3657553643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55840b65e0 0x7f55840c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 >> 172.21.15.104:0/3657553643 conn(0x7f5584069120 msgr2=0x7f55840d54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.099+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 shutdown_connections 2024-09-17T02:54:57.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.100+0000 7f558904d640 1 -- 172.21.15.104:0/3657553643 wait complete. 2024-09-17T02:54:57.110 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:54:57.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.225+0000 7f88697ed640 1 -- 172.21.15.104:0/3685591520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88640b4ce0 msgr2=0x7f88640b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.225+0000 7f88697ed640 1 --2- 172.21.15.104:0/3685591520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88640b4ce0 0x7f88640b50f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f885c005fd0 tx=0x7f885c02a8b0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.226+0000 7f88697ed640 1 -- 172.21.15.104:0/3685591520 shutdown_connections 2024-09-17T02:54:57.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.226+0000 7f88697ed640 1 --2- 172.21.15.104:0/3685591520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88640b4ce0 0x7f88640b50f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.226+0000 7f88697ed640 1 --2- 172.21.15.104:0/3685591520 >> v2:172.21.15.192:3300/0 conn(0x7f8864073580 0x7f8864073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.226+0000 7f88697ed640 1 -- 172.21.15.104:0/3685591520 >> 172.21.15.104:0/3685591520 conn(0x7f88640b3640 msgr2=0x7f88640b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:57.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.226+0000 7f88697ed640 1 -- 172.21.15.104:0/3685591520 shutdown_connections 2024-09-17T02:54:57.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.226+0000 7f88697ed640 1 -- 172.21.15.104:0/3685591520 wait complete. 2024-09-17T02:54:57.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.227+0000 7f88697ed640 1 Processor -- start 2024-09-17T02:54:57.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.227+0000 7f88697ed640 1 -- start start 2024-09-17T02:54:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88697ed640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8864073580 0x7f88641f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88697ed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88640b4ce0 0x7f886415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88697ed640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8864152ce0 0x7f88641f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88697ed640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f88640b59c0 con 0x7f88640b4ce0 2024-09-17T02:54:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88697ed640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f88640b5840 con 0x7f8864152ce0 2024-09-17T02:54:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88697ed640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f88640b5b40 con 0x7f8864073580 2024-09-17T02:54:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88640b4ce0 0x7f886415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88640b4ce0 0x7f886415b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50708/0 (socket says 172.21.15.104:50708) 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 -- 172.21.15.104:0/4137043419 learned_addr learned my addr 172.21.15.104:0/4137043419 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88637fe640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8864152ce0 0x7f88641f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f8862ffd640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8864073580 0x7f88641f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 -- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8864073580 msgr2=0x7f88641f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8864073580 0x7f88641f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 -- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8864152ce0 msgr2=0x7f88641f3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8864152ce0 0x7f88641f3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 -- 172.21.15.104:0/4137043419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88641415c0 con 0x7f88640b4ce0 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885bfff640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88640b4ce0 0x7f886415b700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f884c00e9f0 tx=0x7f884c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885b7fe640 1 -- 172.21.15.104:0/4137043419 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c00cd80 con 0x7f88640b4ce0 2024-09-17T02:54:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885b7fe640 1 -- 172.21.15.104:0/4137043419 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f884c010520 con 0x7f88640b4ce0 2024-09-17T02:54:57.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88641f78a0 con 0x7f88640b4ce0 2024-09-17T02:54:57.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f885b7fe640 1 -- 172.21.15.104:0/4137043419 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c010950 con 0x7f88640b4ce0 2024-09-17T02:54:57.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.229+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88641f7e60 con 0x7f88640b4ce0 2024-09-17T02:54:57.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.230+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88640b3a50 con 0x7f88640b4ce0 2024-09-17T02:54:57.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.231+0000 7f885b7fe640 1 -- 172.21.15.104:0/4137043419 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f884c01f020 con 0x7f88640b4ce0 2024-09-17T02:54:57.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.232+0000 7f885b7fe640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8844078b90 0x7f884407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.232+0000 7f885b7fe640 1 -- 172.21.15.104:0/4137043419 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f884c09b520 con 0x7f88640b4ce0 2024-09-17T02:54:57.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.232+0000 7f8862ffd640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8844078b90 0x7f884407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.232+0000 7f8862ffd640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8844078b90 0x7f884407b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8864073380 tx=0x7f8854009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:57.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.236+0000 7f885b7fe640 1 -- 172.21.15.104:0/4137043419 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88640b3a50 con 0x7f88640b4ce0 2024-09-17T02:54:57.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.447+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88641f7630 con 0x7f88640b4ce0 2024-09-17T02:54:57.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.447+0000 7f885b7fe640 1 -- 172.21.15.104:0/4137043419 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5229 (secure 0 0 0) 0x7f884c063970 con 0x7f88640b4ce0 2024-09-17T02:54:57.448 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:54:57.448 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:54:41.483636+0000","modified":"2024-09-17T02:54:44.441267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-17T02:54:57.448 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T02:54:57.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8844078b90 msgr2=0x7f884407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8844078b90 0x7f884407b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8864073380 tx=0x7f8854009040 comp rx=0 tx=0).stop 2024-09-17T02:54:57.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88640b4ce0 msgr2=0x7f886415b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88640b4ce0 0x7f886415b700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f884c00e9f0 tx=0x7f884c00eeb0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 shutdown_connections 2024-09-17T02:54:57.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8844078b90 0x7f884407b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8864152ce0 0x7f88641f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88640b4ce0 0x7f886415b700 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 --2- 172.21.15.104:0/4137043419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8864073580 0x7f88641f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 >> 172.21.15.104:0/4137043419 conn(0x7f88640b3640 msgr2=0x7f88640d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:57.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 shutdown_connections 2024-09-17T02:54:57.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.450+0000 7f88697ed640 1 -- 172.21.15.104:0/4137043419 wait complete. 2024-09-17T02:54:57.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T02:54:41.483636+0000', 'modified': '2024-09-17T02:54:44.441267+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4378}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4378': {'gid': 4378, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/3427020087', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 3427020087}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 3427020087}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4378, 'qdb_cluster': [4378]} 2024-09-17T02:54:57.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T02:54:57.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T02:54:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 -- 172.21.15.104:0/1771145086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100b3b00 msgr2=0x7fe8100d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 --2- 172.21.15.104:0/1771145086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100b3b00 0x7fe8100d11d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe8100d1fc0 tx=0x7fe80402a4d0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 -- 172.21.15.104:0/1771145086 shutdown_connections 2024-09-17T02:54:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 --2- 172.21.15.104:0/1771145086 >> v2:172.21.15.192:3300/0 conn(0x7fe8100d1710 0x7fe8100cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 --2- 172.21.15.104:0/1771145086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100b3b00 0x7fe8100d11d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 --2- 172.21.15.104:0/1771145086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8100b6f70 0x7fe81015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 -- 172.21.15.104:0/1771145086 >> 172.21.15.104:0/1771145086 conn(0x7fe810073df0 msgr2=0x7fe810068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:57.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 -- 172.21.15.104:0/1771145086 shutdown_connections 2024-09-17T02:54:57.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.979+0000 7fe814a4d640 1 -- 172.21.15.104:0/1771145086 wait complete. 2024-09-17T02:54:57.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.981+0000 7fe814a4d640 1 Processor -- start 2024-09-17T02:54:57.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.981+0000 7fe814a4d640 1 -- start start 2024-09-17T02:54:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.982+0000 7fe814a4d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8100b3b00 0x7fe8100cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.982+0000 7fe814a4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8100b6f70 0x7fe8101f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.982+0000 7fe814a4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100d1710 0x7fe8101f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.982+0000 7fe814a4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100d01f0 con 0x7fe8100d1710 2024-09-17T02:54:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.982+0000 7fe814a4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100d0070 con 0x7fe8100b6f70 2024-09-17T02:54:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.982+0000 7fe814a4d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe8100d0370 con 0x7fe8100b3b00 2024-09-17T02:54:57.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100d1710 0x7fe8101f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100d1710 0x7fe8101f64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50728/0 (socket says 172.21.15.104:50728) 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 -- 172.21.15.104:0/3876479892 learned_addr learned my addr 172.21.15.104:0/3876479892 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8100b6f70 0x7fe8101f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80e59c640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8100b3b00 0x7fe8100cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 -- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8100b3b00 msgr2=0x7fe8100cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8100b3b00 0x7fe8100cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 -- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8100b6f70 msgr2=0x7fe8101f90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8100b6f70 0x7fe8101f90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 -- 172.21.15.104:0/3876479892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8101f6a30 con 0x7fe8100d1710 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100d1710 0x7fe8101f64f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe808005d00 tx=0x7fe80800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:57.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe7feffd640 1 -- 172.21.15.104:0/3876479892 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808017070 con 0x7fe8100d1710 2024-09-17T02:54:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe7feffd640 1 -- 172.21.15.104:0/3876479892 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe808005330 con 0x7fe8100d1710 2024-09-17T02:54:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe814a4d640 1 -- 172.21.15.104:0/3876479892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8101f9ab0 con 0x7fe8100d1710 2024-09-17T02:54:57.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe7feffd640 1 -- 172.21.15.104:0/3876479892 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8080047a0 con 0x7fe8100d1710 2024-09-17T02:54:57.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.983+0000 7fe814a4d640 1 -- 172.21.15.104:0/3876479892 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8101f5cf0 con 0x7fe8100d1710 2024-09-17T02:54:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.985+0000 7fe7feffd640 1 -- 172.21.15.104:0/3876479892 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe808004940 con 0x7fe8100d1710 2024-09-17T02:54:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.985+0000 7fe7feffd640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078b90 0x7fe7f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.986+0000 7fe7feffd640 1 -- 172.21.15.104:0/3876479892 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe80809ad60 con 0x7fe8100d1710 2024-09-17T02:54:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.986+0000 7fe80e59c640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078b90 0x7fe7f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.986+0000 7fe80e59c640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078b90 0x7fe7f007b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe800005fd0 tx=0x7fe800009540 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.986+0000 7fe81b9c4740 1 Processor -- start 2024-09-17T02:54:57.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.987+0000 7fe81b9c4740 1 -- start start 2024-09-17T02:54:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c9b270 0x55acc606cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c723b0 0x55acc606d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc608a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55acc5fb5820 con 0x55acc5c7a590 2024-09-17T02:54:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55acc5fa4c50 con 0x55acc5c723b0 2024-09-17T02:54:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55acc5fa8a60 con 0x55acc5c9b270 2024-09-17T02:54:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc608a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc608a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50738/0 (socket says 172.21.15.104:50738) 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 -- 172.21.15.104:0/472948230 learned_addr learned my addr 172.21.15.104:0/472948230 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c723b0 0x55acc606d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 -- 172.21.15.104:0/472948230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c9b270 msgr2=0x55acc606cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80e59c640 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c9b270 0x55acc606cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c9b270 0x55acc606cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 -- 172.21.15.104:0/472948230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c723b0 msgr2=0x55acc606d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c723b0 0x55acc606d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 -- 172.21.15.104:0/472948230 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc5d06850 con 0x55acc5c7a590 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc608a400 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe8080992b0 tx=0x7fe808062380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ad75d13b6fb401 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe7effff640 1 -- 172.21.15.104:0/472948230 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808020070 con 0x55acc5c7a590 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe7effff640 1 -- 172.21.15.104:0/472948230 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe80806c4c0 con 0x55acc5c7a590 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.988+0000 7fe7effff640 1 -- 172.21.15.104:0/472948230 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808067360 con 0x55acc5c7a590 2024-09-17T02:54:57.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 -- 172.21.15.104:0/472948230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 msgr2=0x55acc608a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc608a400 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe8080992b0 tx=0x7fe808062380 comp rx=0 tx=0).stop 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 -- 172.21.15.104:0/472948230 shutdown_connections 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c723b0 0x55acc606d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc608a400 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/472948230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c9b270 0x55acc606cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 -- 172.21.15.104:0/472948230 >> 172.21.15.104:0/472948230 conn(0x55acc5c8f3c0 msgr2=0x55acc6043280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 -- 172.21.15.104:0/472948230 shutdown_connections 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.989+0000 7fe81b9c4740 1 -- 172.21.15.104:0/472948230 wait complete. 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.990+0000 7fe81b9c4740 1 -- start start 2024-09-17T02:54:57.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.990+0000 7fe81b9c4740 1 Processor -- start 2024-09-17T02:54:57.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 0x55acc607ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6097780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc605b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55acc5d15620 con 0x55acc5c7a590 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55acc5f4a5f0 con 0x55acc5c9b270 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55acc606da40 con 0x55acc5c723b0 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe81b9c4740 10 client.0 _ll_register_callbacks cb 0x55acc5f4e0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6097780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6097780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50746/0 (socket says 172.21.15.104:50746) 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 -- 172.21.15.104:0/1954795912 learned_addr learned my addr 172.21.15.104:0/1954795912 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc605b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80e59c640 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 0x55acc607ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 -- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 msgr2=0x55acc607ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:54:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 0x55acc607ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 -- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 msgr2=0x55acc605b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc605b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 -- 172.21.15.104:0/1954795912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc5d7d6b0 con 0x55acc5c7a590 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6097780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8040099c0 tx=0x7fe8040055b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38033af6581beb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe7ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.992+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/1954795912 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804041070 con 0x55acc5c7a590 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/1954795912 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8040035f0 con 0x55acc5c7a590 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1954795912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe80806c4c0 con 0x55acc5c7a590 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/1954795912 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe804035040 con 0x55acc5c7a590 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 10 client.4710 fetch_fsmap learned FSMap version 7 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1954795912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55acc60807e0 con 0x55acc5c7a590 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/1954795912 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe80806c4c0 con 0x55acc5c7a590 2024-09-17T02:54:57.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/1954795912 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fe80403a040 con 0x55acc5c7a590 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 10 client.4710 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 10 client.4710 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 20 client.4710 populate_metadata read hostname 'smithi104' 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] conn(0x55acc5c59e40 0x55acc6082bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 4 client.4710 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1954795912 --> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acc5fb7770 con 0x55acc5c59e40 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.993+0000 7fe80e59c640 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] conn(0x55acc5c59e40 0x55acc6082bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.994+0000 7fe7ed7fa640 10 client.4710 ms_handle_connect on v2:172.21.15.192:6836/3427020087 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.994+0000 7fe80e59c640 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] conn(0x55acc5c59e40 0x55acc6082bf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8209082b35ccae5b server_cookie=5d33ac5ce224d015 in_seq=0 out_seq=0 2024-09-17T02:54:57.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/1954795912 <== mds.0 v2:172.21.15.192:6836/3427020087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55acc5fb7770 con 0x55acc5c59e40 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe7ed7fa640 10 client.4710 handle_command_reply: tid=0 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 client.4710 shutdown 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1954795912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 msgr2=0x55acc6097780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6097780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8040099c0 tx=0x7fe8040055b0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1954795912 shutdown_connections 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] conn(0x55acc5c59e40 0x55acc6082bf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc605b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6097780 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1954795912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 0x55acc607ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe7ed7fa640 0 client.4710 ms_handle_reset on v2:172.21.15.192:6836/3427020087 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1954795912 >> 172.21.15.104:0/1954795912 conn(0x55acc5c8f3c0 msgr2=0x55acc6043130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1954795912 shutdown_connections 2024-09-17T02:54:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1954795912 wait complete. 2024-09-17T02:54:58.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:57.995+0000 7fe81b9c4740 20 client.4710 trim_cache size 0 max 16384 2024-09-17T02:54:58.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.013+0000 7fe81b9c4740 1 Processor -- start 2024-09-17T02:54:58.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.013+0000 7fe81b9c4740 1 -- start start 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.014+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 0x55acc607dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.014+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6043110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.014+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc6043650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.014+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe8102016f0 con 0x55acc5c7a590 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.014+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100ca150 con 0x55acc5c9b270 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.014+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe8100c91b0 con 0x55acc5c723b0 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6043110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6043110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50758/0 (socket says 172.21.15.104:50758) 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 -- 172.21.15.104:0/1386153147 learned_addr learned my addr 172.21.15.104:0/1386153147 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 -- 172.21.15.104:0/1386153147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 msgr2=0x55acc607dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:54:58.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/1386153147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 0x55acc607dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/1386153147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc6043650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 -- 172.21.15.104:0/1386153147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 msgr2=0x55acc6043650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:54:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/1386153147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc6043650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 -- 172.21.15.104:0/1386153147 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acc6040770 con 0x55acc5c7a590 2024-09-17T02:54:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/1386153147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6043110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe804009850 tx=0x7fe8040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cd89217c9819e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe7ef7fe640 1 -- 172.21.15.104:0/1386153147 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804041040 con 0x55acc5c7a590 2024-09-17T02:54:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe7ef7fe640 1 -- 172.21.15.104:0/1386153147 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe804003930 con 0x55acc5c7a590 2024-09-17T02:54:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.015+0000 7fe7ef7fe640 1 -- 172.21.15.104:0/1386153147 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804003be0 con 0x55acc5c7a590 2024-09-17T02:54:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1386153147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 msgr2=0x55acc6043110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1386153147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6043110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe804009850 tx=0x7fe8040058a0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1386153147 shutdown_connections 2024-09-17T02:54:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1386153147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc6043650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1386153147 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c7a590 0x55acc6043110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/1386153147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c723b0 0x55acc607dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1386153147 >> 172.21.15.104:0/1386153147 conn(0x55acc5c8f3c0 msgr2=0x55acc6096ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:58.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1386153147 shutdown_connections 2024-09-17T02:54:58.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.016+0000 7fe81b9c4740 1 -- 172.21.15.104:0/1386153147 wait complete. 2024-09-17T02:54:58.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.017+0000 7fe81b9c4740 1 -- start start 2024-09-17T02:54:58.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.017+0000 7fe81b9c4740 1 Processor -- start 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c723b0 0x55acc610b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c7a590 0x55acc6081320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe81b9c4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc6106d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55acc608a670 con 0x55acc5c723b0 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55acc608a1f0 con 0x55acc5c9b270 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe81b9c4740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55acc609a530 con 0x55acc5c7a590 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe81b9c4740 10 client.0 _ll_register_callbacks cb 0x7fe804009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe80e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c723b0 0x55acc610b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe80e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c723b0 0x55acc610b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50766/0 (socket says 172.21.15.104:50766) 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.018+0000 7fe80e59c640 1 -- 172.21.15.104:0/3590849823 learned_addr learned my addr 172.21.15.104:0/3590849823 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:58.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe80ed9d640 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc6106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c7a590 0x55acc6081320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe80e59c640 1 -- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c7a590 msgr2=0x55acc6081320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe80e59c640 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c7a590 0x55acc6081320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe80e59c640 1 -- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 msgr2=0x55acc6106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe80e59c640 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc6106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe80e59c640 1 -- 172.21.15.104:0/3590849823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acc6080a10 con 0x55acc5c723b0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe80e59c640 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c723b0 0x55acc610b670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55acc609ad00 tx=0x7fe800004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb95edc5d206d106 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe7ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/3590849823 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800031430 con 0x55acc5c723b0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/3590849823 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8000315d0 con 0x55acc5c723b0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 1 -- 172.21.15.104:0/3590849823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe804003930 con 0x55acc5c723b0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/3590849823 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fe80003b050 con 0x55acc5c723b0 2024-09-17T02:54:58.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 10 client.4716 fetch_fsmap learned FSMap version 7 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 1 -- 172.21.15.104:0/3590849823 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55acc6089a00 con 0x55acc5c723b0 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/3590849823 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe804003930 con 0x55acc5c723b0 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/3590849823 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fe80003e020 con 0x55acc5c723b0 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 10 client.4716 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 10 client.4716 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 20 client.4716 populate_metadata read hostname 'smithi104' 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] conn(0x55acc6068770 0x55acc6068b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 4 client.4716 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.019+0000 7fe81b9c4740 1 -- 172.21.15.104:0/3590849823 --> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] -- command(tid 0: {"prefix": "status"}) -- 0x55acc5fb3220 con 0x55acc6068770 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] conn(0x55acc6068770 0x55acc6068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe80dd9b640 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] conn(0x55acc6068770 0x55acc6068b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f32e16d3e104e0dc server_cookie=16f26f89b1283515 in_seq=0 out_seq=0 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe7ed7fa640 10 client.4716 ms_handle_connect on v2:172.21.15.192:6836/3427020087 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe7ed7fa640 1 -- 172.21.15.104:0/3590849823 <== mds.0 v2:172.21.15.192:6836/3427020087 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55acc5fb3220 con 0x55acc6068770 2024-09-17T02:54:58.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe7ed7fa640 10 client.4716 handle_command_reply: tid=0 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe81b9c4740 1 client.4716 shutdown 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe81b9c4740 1 -- 172.21.15.104:0/3590849823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c723b0 msgr2=0x55acc610b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c723b0 0x55acc610b670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55acc609ad00 tx=0x7fe800004a40 comp rx=0 tx=0).stop 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.020+0000 7fe81b9c4740 1 -- 172.21.15.104:0/3590849823 shutdown_connections 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:6836/3427020087,v1:172.21.15.192:6837/3427020087] conn(0x55acc6068770 0x55acc6068b80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55acc5c9b270 0x55acc6106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55acc5c7a590 0x55acc6081320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe81b9c4740 1 --2- 172.21.15.104:0/3590849823 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55acc5c723b0 0x55acc610b670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe7ed7fa640 0 client.4716 ms_handle_reset on v2:172.21.15.192:6836/3427020087 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe81b9c4740 1 -- 172.21.15.104:0/3590849823 >> 172.21.15.104:0/3590849823 conn(0x55acc5c8f3c0 msgr2=0x55acc607f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe81b9c4740 1 -- 172.21.15.104:0/3590849823 shutdown_connections 2024-09-17T02:54:58.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe81b9c4740 1 -- 172.21.15.104:0/3590849823 wait complete. 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe81b9c4740 20 client.4716 trim_cache size 0 max 16384 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4378, 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 15.871351332, 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 7, 2024-09-17T02:54:58.026 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 21, 2024-09-17T02:54:58.027 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 21, 2024-09-17T02:54:58.027 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 21.912803381 2024-09-17T02:54:58.027 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 -- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078b90 msgr2=0x7fe7f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078b90 0x7fe7f007b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe800005fd0 tx=0x7fe800009540 comp rx=0 tx=0).stop 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 -- 172.21.15.104:0/3876479892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100d1710 msgr2=0x7fe8101f64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100d1710 0x7fe8101f64f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe808005d00 tx=0x7fe80800dae0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 -- 172.21.15.104:0/3876479892 shutdown_connections 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078b90 0x7fe7f007b0a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8100b6f70 0x7fe8101f90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8100d1710 0x7fe8101f64f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 --2- 172.21.15.104:0/3876479892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8100b3b00 0x7fe8100cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 -- 172.21.15.104:0/3876479892 >> 172.21.15.104:0/3876479892 conn(0x7fe810073df0 msgr2=0x7fe8100d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:58.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 -- 172.21.15.104:0/3876479892 shutdown_connections 2024-09-17T02:54:58.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.021+0000 7fe814a4d640 1 -- 172.21.15.104:0/3876479892 wait complete. 2024-09-17T02:54:58.032 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T02:54:58.057 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T02:54:58.057 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T02:54:58.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.057 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:54:58.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.073 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-09-17T02:54:58.140 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-09-17T02:54:58.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:54:58.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.142 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:54:58.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.198 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-09-17T02:54:58.264 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-09-17T02:54:58.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:54:58.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.266 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:54:58.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-17T02:54:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-17T02:54:58.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:54:58.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.359 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:54:58.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.417 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-17T02:54:58.486 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-17T02:54:58.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:54:58.488 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T02:54:58.488 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T02:54:58.488 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T02:54:58.489 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:54:58.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.601+0000 7fd494520640 1 -- 172.21.15.104:0/2920039484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0cdf10 msgr2=0x7fd48c0b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.601+0000 7fd494520640 1 --2- 172.21.15.104:0/2920039484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0cdf10 0x7fd48c0b57e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009830 tx=0x7fd47c02a510 comp rx=0 tx=0).stop 2024-09-17T02:54:58.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.601+0000 7fd494520640 1 -- 172.21.15.104:0/2920039484 shutdown_connections 2024-09-17T02:54:58.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.601+0000 7fd494520640 1 --2- 172.21.15.104:0/2920039484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd48c0b5d20 0x7fd48c0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.601+0000 7fd494520640 1 --2- 172.21.15.104:0/2920039484 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0cdf10 0x7fd48c0b57e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.601+0000 7fd494520640 1 -- 172.21.15.104:0/2920039484 >> 172.21.15.104:0/2920039484 conn(0x7fd48c0b44a0 msgr2=0x7fd48c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:58.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.601+0000 7fd494520640 1 -- 172.21.15.104:0/2920039484 shutdown_connections 2024-09-17T02:54:58.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.601+0000 7fd494520640 1 -- 172.21.15.104:0/2920039484 wait complete. 2024-09-17T02:54:58.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.603+0000 7fd494520640 1 Processor -- start 2024-09-17T02:54:58.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.603+0000 7fd494520640 1 -- start start 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.604+0000 7fd494520640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd48c0b4fc0 0x7fd48c0c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.604+0000 7fd494520640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0b5d20 0x7fd48c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.604+0000 7fd494520640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd48c0cdf10 0x7fd48c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.604+0000 7fd494520640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c160f50 con 0x7fd48c0b5d20 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.604+0000 7fd494520640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c0d0210 con 0x7fd48c0cdf10 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.604+0000 7fd494520640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd48c1610d0 con 0x7fd48c0b4fc0 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.604+0000 7fd491abb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0b5d20 0x7fd48c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd491abb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0b5d20 0x7fd48c150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50776/0 (socket says 172.21.15.104:50776) 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd491abb640 1 -- 172.21.15.104:0/1280773506 learned_addr learned my addr 172.21.15.104:0/1280773506 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd4922bc640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd48c0b4fc0 0x7fd48c0c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd492abd640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd48c0cdf10 0x7fd48c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd491abb640 1 -- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd48c0b4fc0 msgr2=0x7fd48c0c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd491abb640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd48c0b4fc0 0x7fd48c0c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd491abb640 1 -- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd48c0cdf10 msgr2=0x7fd48c15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd491abb640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd48c0cdf10 0x7fd48c15fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd491abb640 1 -- 172.21.15.104:0/1280773506 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c1f6ee0 con 0x7fd48c0b5d20 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd4922bc640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd48c0b4fc0 0x7fd48c0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd491abb640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0b5d20 0x7fd48c150d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009950 tx=0x7fd47c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd482ffd640 1 -- 172.21.15.104:0/1280773506 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c031d60 con 0x7fd48c0b5d20 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd482ffd640 1 -- 172.21.15.104:0/1280773506 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd47c0330d0 con 0x7fd48c0b5d20 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48c1f7150 con 0x7fd48c0b5d20 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd482ffd640 1 -- 172.21.15.104:0/1280773506 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c033520 con 0x7fd48c0b5d20 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.605+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48c0c8600 con 0x7fd48c0b5d20 2024-09-17T02:54:58.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.606+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48c0c88c0 con 0x7fd48c0b5d20 2024-09-17T02:54:58.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.607+0000 7fd482ffd640 1 -- 172.21.15.104:0/1280773506 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd47c0035f0 con 0x7fd48c0b5d20 2024-09-17T02:54:58.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.607+0000 7fd482ffd640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd470078b90 0x7fd47007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:54:58.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.608+0000 7fd482ffd640 1 -- 172.21.15.104:0/1280773506 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd47c0bc340 con 0x7fd48c0b5d20 2024-09-17T02:54:58.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.608+0000 7fd4922bc640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd470078b90 0x7fd47007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:54:58.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.608+0000 7fd4922bc640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd470078b90 0x7fd47007b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd488000f60 tx=0x7fd488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:54:58.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.612+0000 7fd482ffd640 1 -- 172.21.15.104:0/1280773506 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd47c03f030 con 0x7fd48c0b5d20 2024-09-17T02:54:58.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.823+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd48c0cfa80 con 0x7fd48c0b5d20 2024-09-17T02:54:58.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.823+0000 7fd482ffd640 1 -- 172.21.15.104:0/1280773506 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fd47c084130 con 0x7fd48c0b5d20 2024-09-17T02:54:58.823 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:54:58.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd470078b90 msgr2=0x7fd47007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd470078b90 0x7fd47007b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd488000f60 tx=0x7fd488009040 comp rx=0 tx=0).stop 2024-09-17T02:54:58.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0b5d20 msgr2=0x7fd48c150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:54:58.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0b5d20 0x7fd48c150d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009950 tx=0x7fd47c033d60 comp rx=0 tx=0).stop 2024-09-17T02:54:58.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 shutdown_connections 2024-09-17T02:54:58.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd470078b90 0x7fd47007b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd48c0cdf10 0x7fd48c15fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd48c0b5d20 0x7fd48c150d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 --2- 172.21.15.104:0/1280773506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd48c0b4fc0 0x7fd48c0c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:54:58.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 >> 172.21.15.104:0/1280773506 conn(0x7fd48c0b44a0 msgr2=0x7fd48c0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:54:58.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 shutdown_connections 2024-09-17T02:54:58.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58.826+0000 7fd494520640 1 -- 172.21.15.104:0/1280773506 wait complete. 2024-09-17T02:54:58.837 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T02:54:58.837 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:54:58.837 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T02:54:58.837 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T02:54:58.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T02:54:58.837 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T02:54:58.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T02:54:58.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:54:58.838 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:54:58.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:58.838 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T02:54:58.854 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:54:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:54:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:54:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:54:58.854 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:54:58.855 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42800sec preferred_lft 42800sec 2024-09-17T02:54:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T02:54:58.856 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:54:58.856 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T02:54:58.857 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:54:58.857 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:54:58.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add name ceph-brx type bridge 2024-09-17T02:54:58.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr flush dev ceph-brx 2024-09-17T02:54:58.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set ceph-brx up 2024-09-17T02:54:58.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T02:54:58.857 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:54:58.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:54:59.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:54:59.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:59.070 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:54:59.095 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T02:54:59.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:59.097 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T02:54:59.158 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T02:54:59.158 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:54:59.158 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:54:59.158 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:54:59.158 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:54:59.158 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:54:59.159 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:54:59.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:54:59.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:54:59.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:54:59.159 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:54:59.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:54:59.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:54:59.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:59.458 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:54:59.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:59.474 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-09-17T02:54:59.529 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:54:59.529 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:54:59.529 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T02:54:59.529 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T02:54:59.529 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:54:59.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:54:59.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:54:59.645 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T02:54:59.646 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:54:59.646 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:54:59.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T02:54:59.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T02:54:59.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T02:54:59.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T02:54:59.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T02:54:59.646 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:54:59.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:54:59.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:54:59.775 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:54:59.776 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:54:59.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T02:54:59.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T02:54:59.776 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:54:59.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:54:59.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:54:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:54:59.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:54:59.854 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T02:54:59.883 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:54:59.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:54:59.883 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:54:59.939 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:54:59.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:54:59.939 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:55:00.082 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:55:00.083 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:55:00.083 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:00.226 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:55:00.226 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:55:00.226 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:00.226 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:00.227 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:00.236 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:55:00.236 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:55:00.236 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:00.236 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:00.237 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:00.237 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:55:00.237 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:55:00.237 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:55:00.237 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T02:55:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:55:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:55:00.237 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:55:00.238 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:55:00.239 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:55:00.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:00.239 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:55:00.264 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:00.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:00.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:00.373 INFO:teuthology.orchestra.run.smithi104.stdout:client4728 2024-09-17T02:55:00.373 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:00.373 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:00.389 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:00.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:00.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:00.495 INFO:teuthology.orchestra.run.smithi104.stdout:client4728 2024-09-17T02:55:00.495 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:00.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:00.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:00.563 INFO:teuthology.orchestra.run.smithi104.stdout:client4728 2024-09-17T02:55:00.563 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client4728/status') 2024-09-17T02:55:00.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:00.629 INFO:teuthology.orchestra.run.smithi104.stdout:instance: client.4728 (3)192.168.0.1:0/2334357773 2024-09-17T02:55:00.629 INFO:teuthology.orchestra.run.smithi104.stdout:blocklisted: false 2024-09-17T02:55:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records in 2024-09-17T02:55:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records out 2024-09-17T02:55:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:69 bytes copied, 2.1027e-05 s, 3.3 MB/s 2024-09-17T02:55:00.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:00.637 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T02:55:00.637 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T02:55:00.638 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T02:55:00.638 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:55:00.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.751+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/3386181657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7d00b7bb0 msgr2=0x7fd7d00cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:00.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.751+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/3386181657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7d00b7bb0 0x7fd7d00cde90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00098e0 tx=0x7fd7c002a4a0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.751+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/3386181657 shutdown_connections 2024-09-17T02:55:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.751+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/3386181657 >> v2:172.21.15.192:3300/0 conn(0x7fd7d00d0470 0x7fd7d00d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.751+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/3386181657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7d00b7bb0 0x7fd7d00cde90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.751+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/3386181657 >> 172.21.15.104:0/3386181657 conn(0x7fd7d00d28a0 msgr2=0x7fd7d00d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.752+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/3386181657 shutdown_connections 2024-09-17T02:55:00.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.752+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/3386181657 wait complete. 2024-09-17T02:55:00.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.753+0000 7fd7d7f4a640 1 Processor -- start 2024-09-17T02:55:00.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.754+0000 7fd7d7f4a640 1 -- start start 2024-09-17T02:55:00.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d7f4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7d00b7bb0 0x7fd7d01e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d7f4a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7d00cefb0 0x7fd7d006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d7f4a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7d00d0470 0x7fd7d01e3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d7f4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d00cfad0 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d7f4a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d00ce5e0 con 0x7fd7d00cefb0 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d7f4a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d00cfc50 con 0x7fd7d00d0470 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7d00b7bb0 0x7fd7d01e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7d00b7bb0 0x7fd7d01e1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50790/0 (socket says 172.21.15.104:50790) 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 -- 172.21.15.104:0/4136000265 learned_addr learned my addr 172.21.15.104:0/4136000265 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d54e5640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7d00cefb0 0x7fd7d006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d64e7640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7d00d0470 0x7fd7d01e3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 -- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7d00d0470 msgr2=0x7fd7d01e3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:00.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7d00d0470 0x7fd7d01e3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 -- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7d00cefb0 msgr2=0x7fd7d006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7d00cefb0 0x7fd7d006cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 -- 172.21.15.104:0/4136000265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d006d880 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.755+0000 7fd7d5ce6640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7d00b7bb0 0x7fd7d01e1f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009a00 tx=0x7fd7c00049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.756+0000 7fd7ce7fc640 1 -- 172.21.15.104:0/4136000265 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0031950 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.756+0000 7fd7ce7fc640 1 -- 172.21.15.104:0/4136000265 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7c0031c00 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.756+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d006db60 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.756+0000 7fd7ce7fc640 1 -- 172.21.15.104:0/4136000265 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00330d0 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.756+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d01f86a0 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.757+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d006e080 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.757+0000 7fd7ce7fc640 1 -- 172.21.15.104:0/4136000265 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7c0033270 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.758+0000 7fd7ce7fc640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7bc078b80 0x7fd7bc07b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:00.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.758+0000 7fd7ce7fc640 1 -- 172.21.15.104:0/4136000265 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd7c00bbdc0 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.758+0000 7fd7d54e5640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7bc078b80 0x7fd7bc07b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:00.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.759+0000 7fd7d54e5640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7bc078b80 0x7fd7bc07b090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40095f0 tx=0x7fd7c4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:00.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.762+0000 7fd7ce7fc640 1 -- 172.21.15.104:0/4136000265 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7d006e080 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.971+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd7d00cde90 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.971+0000 7fd7ce7fc640 1 -- 172.21.15.104:0/4136000265 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fd7c003f030 con 0x7fd7d00b7bb0 2024-09-17T02:55:00.971 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:55:00.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7bc078b80 msgr2=0x7fd7bc07b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:00.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7bc078b80 0x7fd7bc07b090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40095f0 tx=0x7fd7c4005f90 comp rx=0 tx=0).stop 2024-09-17T02:55:00.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7d00b7bb0 msgr2=0x7fd7d01e1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:00.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7d00b7bb0 0x7fd7d01e1f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009a00 tx=0x7fd7c00049d0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 shutdown_connections 2024-09-17T02:55:00.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7bc078b80 0x7fd7bc07b090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7d00cefb0 0x7fd7d006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7d00d0470 0x7fd7d01e3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.973+0000 7fd7d7f4a640 1 --2- 172.21.15.104:0/4136000265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7d00b7bb0 0x7fd7d01e1f20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:00.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.974+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 >> 172.21.15.104:0/4136000265 conn(0x7fd7d00d28a0 msgr2=0x7fd7d00cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:00.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.974+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 shutdown_connections 2024-09-17T02:55:00.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:00.974+0000 7fd7d7f4a640 1 -- 172.21.15.104:0/4136000265 wait complete. 2024-09-17T02:55:00.984 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T02:55:00.984 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:55:00.985 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T02:55:00.985 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T02:55:00.985 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T02:55:00.985 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T02:55:00.985 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T02:55:00.985 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:55:00.985 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T02:55:00.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:00.985 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T02:55:01.001 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:01.001 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:01.001 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:01.002 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42798sec preferred_lft 42798sec 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T02:55:01.003 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link tentative 2024-09-17T02:55:01.004 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:01.004 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:55:01.065 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T02:55:01.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:01.066 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T02:55:01.123 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T02:55:01.123 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:55:01.123 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:55:01.123 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:55:01.123 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:55:01.124 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:01.124 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:55:01.124 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:55:01.124 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:55:01.124 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:55:01.124 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:55:01.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:01.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:01.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:01.249 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:55:01.264 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T02:55:01.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:01.265 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list-id 2024-09-17T02:55:01.320 INFO:teuthology.orchestra.run.smithi104.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T02:55:01.321 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:01.321 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:55:01.321 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T02:55:01.321 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T02:55:01.321 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:55:01.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:01.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:01.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:01.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T02:55:01.462 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:01.462 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 22:f4:b7:4c:9c:d5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::20f4:b7ff:fe4c:9cd5/64 scope link 2024-09-17T02:55:01.463 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:01.465 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T02:55:01.529 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:01.529 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:01.529 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:01.529 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.529 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:01.529 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.529 INFO:teuthology.orchestra.run.smithi104.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:55:01.529 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 22:f4:b7:4c:9c:d5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T02:55:01.530 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T02:55:01.530 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.530 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::20f4:b7ff:fe4c:9cd5/64 scope link 2024-09-17T02:55:01.530 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:01.531 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T02:55:01.531 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:01.531 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:55:01.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T02:55:01.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T02:55:01.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T02:55:01.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T02:55:01.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T02:55:01.532 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:55:01.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:01.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:01.683 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:01.683 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:55:01.684 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.1 up 2024-09-17T02:55:01.684 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T02:55:01.684 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:55:01.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:01.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:01.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:01.760 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T02:55:01.775 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T02:55:01.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:01.775 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T02:55:01.830 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:55:01.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:01.830 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T02:55:01.924 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T02:55:01.924 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T02:55:01.925 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:01.935 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T02:55:01.935 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T02:55:01.936 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:01.936 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:01.936 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:01.946 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T02:55:01.946 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T02:55:01.946 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:01.946 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:01.946 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:01.947 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:55:01.947 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:55:01.947 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:55:01.947 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T02:55:01.947 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:55:01.947 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:55:01.947 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:55:01.947 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:55:01.949 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:55:01.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:01.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T02:55:01.973 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:02.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:02.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:02.070 INFO:teuthology.orchestra.run.smithi104.stdout:client4547 2024-09-17T02:55:02.070 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:02.070 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:02.086 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:02.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:02.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:02.181 INFO:teuthology.orchestra.run.smithi104.stdout:client4547 2024-09-17T02:55:02.182 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:02.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:02.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:02.237 INFO:teuthology.orchestra.run.smithi104.stdout:client4547 2024-09-17T02:55:02.238 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client4547/status') 2024-09-17T02:55:02.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:02.294 INFO:teuthology.orchestra.run.smithi104.stdout:instance: client.4547 (3)172.21.15.104:0/3198663840 2024-09-17T02:55:02.295 INFO:teuthology.orchestra.run.smithi104.stdout:blocklisted: false 2024-09-17T02:55:02.295 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records in 2024-09-17T02:55:02.295 INFO:teuthology.orchestra.run.smithi104.stderr:0+1 records out 2024-09-17T02:55:02.295 INFO:teuthology.orchestra.run.smithi104.stderr:71 bytes copied, 3.7527e-05 s, 1.9 MB/s 2024-09-17T02:55:02.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:02.302 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T02:55:02.302 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T02:55:02.302 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:02.302 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:55:02.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.414+0000 7fbba0bb0640 1 -- 172.21.15.104:0/2906302659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b2630 msgr2=0x7fbb9c0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:02.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.414+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/2906302659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b2630 0x7fbb9c0b2a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbb94005fd0 tx=0x7fbb9402a970 comp rx=0 tx=0).stop 2024-09-17T02:55:02.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.414+0000 7fbba0bb0640 1 -- 172.21.15.104:0/2906302659 shutdown_connections 2024-09-17T02:55:02.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.414+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/2906302659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b2630 0x7fbb9c0b2a40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.414+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/2906302659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb9c0b7c80 0x7fbb9c0b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.414+0000 7fbba0bb0640 1 -- 172.21.15.104:0/2906302659 >> 172.21.15.104:0/2906302659 conn(0x7fbb9c0d2970 msgr2=0x7fbb9c0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:02.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.414+0000 7fbba0bb0640 1 -- 172.21.15.104:0/2906302659 shutdown_connections 2024-09-17T02:55:02.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.414+0000 7fbba0bb0640 1 -- 172.21.15.104:0/2906302659 wait complete. 2024-09-17T02:55:02.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.416+0000 7fbba0bb0640 1 Processor -- start 2024-09-17T02:55:02.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.416+0000 7fbba0bb0640 1 -- start start 2024-09-17T02:55:02.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.417+0000 7fbba0bb0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb9c0b2630 0x7fbb9c0a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:02.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.417+0000 7fbba0bb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b7c80 0x7fbb9c1f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:02.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.417+0000 7fbba0bb0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb9c0d3490 0x7fbb9c160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:02.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.417+0000 7fbba0bb0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c0b6bd0 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.417+0000 7fbba0bb0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c0b6a50 con 0x7fbb9c0b2630 2024-09-17T02:55:02.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.417+0000 7fbba0bb0640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9c0b6d50 con 0x7fbb9c0d3490 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.417+0000 7fbb91d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b7c80 0x7fbb9c1f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.417+0000 7fbb91d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b7c80 0x7fbb9c1f71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50812/0 (socket says 172.21.15.104:50812) 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb91d9b640 1 -- 172.21.15.104:0/3781159350 learned_addr learned my addr 172.21.15.104:0/3781159350 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb9ad9d640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb9c0d3490 0x7fbb9c160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb91d9b640 1 -- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb9c0d3490 msgr2=0x7fbb9c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb91d9b640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb9c0d3490 0x7fbb9c160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb91d9b640 1 -- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb9c0b2630 msgr2=0x7fbb9c0a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb91d9b640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb9c0b2630 0x7fbb9c0a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb91d9b640 1 -- 172.21.15.104:0/3781159350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c0a0a10 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb91d9b640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b7c80 0x7fbb9c1f71c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c9a0 tx=0x7fbb8400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb937fe640 1 -- 172.21.15.104:0/3781159350 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84007bb0 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb937fe640 1 -- 172.21.15.104:0/3781159350 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb84007e40 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c1f7f30 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbb937fe640 1 -- 172.21.15.104:0/3781159350 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400f6b0 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.418+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c1f4120 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.419+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9c0b2a40 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.420+0000 7fbb937fe640 1 -- 172.21.15.104:0/3781159350 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb8400f850 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.420+0000 7fbb937fe640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb7c078bc0 0x7fbb7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:02.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.421+0000 7fbb937fe640 1 -- 172.21.15.104:0/3781159350 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbb8409b3b0 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.422+0000 7fbb9a59c640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb7c078bc0 0x7fbb7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.424+0000 7fbb9a59c640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb7c078bc0 0x7fbb7c07b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c006fd0 tx=0x7fbb8c006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:02.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.425+0000 7fbb937fe640 1 -- 172.21.15.104:0/3781159350 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbb84014030 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.631+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbb9c0ccf50 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.632+0000 7fbb937fe640 1 -- 172.21.15.104:0/3781159350 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fbb84063880 con 0x7fbb9c0b7c80 2024-09-17T02:55:02.631 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:55:02.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.633+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb7c078bc0 msgr2=0x7fbb7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:02.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.633+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb7c078bc0 0x7fbb7c07b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c006fd0 tx=0x7fbb8c006bc0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.633+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b7c80 msgr2=0x7fbb9c1f71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:02.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.633+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b7c80 0x7fbb9c1f71c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400c9a0 tx=0x7fbb8400ce60 comp rx=0 tx=0).stop 2024-09-17T02:55:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.634+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 shutdown_connections 2024-09-17T02:55:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.634+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb7c078bc0 0x7fbb7c07b0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.634+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb9c0d3490 0x7fbb9c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.634+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb9c0b7c80 0x7fbb9c1f71c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.634+0000 7fbba0bb0640 1 --2- 172.21.15.104:0/3781159350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb9c0b2630 0x7fbb9c0a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.634+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 >> 172.21.15.104:0/3781159350 conn(0x7fbb9c0d2970 msgr2=0x7fbb9c0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.634+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 shutdown_connections 2024-09-17T02:55:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:02.634+0000 7fbba0bb0640 1 -- 172.21.15.104:0/3781159350 wait complete. 2024-09-17T02:55:02.644 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T02:55:02.645 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:55:02.645 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T02:55:02.645 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T02:55:02.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:02.645 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T02:55:02.645 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T02:55:02.645 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:55:02.645 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:55:02.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:02.645 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:02.665 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42792sec preferred_lft 42792sec 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T02:55:02.666 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:02.666 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T02:55:02.667 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:02.667 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:02.667 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2024-09-17T02:55:02.667 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2024-09-17T02:55:02.667 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2024-09-17T02:55:02.667 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T02:55:02.667 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:02.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:02.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:02.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:02.953 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:55:02.978 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T02:55:02.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:02.980 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T02:55:03.055 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T02:55:03.055 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:55:03.055 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:55:03.055 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:55:03.055 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:55:03.055 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:03.056 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:03.056 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:55:03.056 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:55:03.056 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:55:03.056 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:03.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:03.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:03.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:03.331 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:55:03.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:03.347 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2024-09-17T02:55:03.404 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:03.404 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:03.404 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T02:55:03.404 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T02:55:03.404 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:03.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:03.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:03.524 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T02:55:03.524 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:03.524 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:03.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T02:55:03.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T02:55:03.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T02:55:03.525 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T02:55:03.525 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T02:55:03.525 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:03.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:03.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:03.662 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:03.662 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:03.662 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T02:55:03.662 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T02:55:03.662 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:03.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:03.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:03.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:03.740 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:03.754 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:55:03.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:03.755 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:03.810 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:55:03.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:03.810 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:55:03.915 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:55:03.915 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:55:03.915 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:04.055 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:55:04.055 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:55:04.055 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:04.055 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:04.055 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:04.064 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:55:04.064 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:55:04.064 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:04.065 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:04.065 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:04.065 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:55:04.065 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:55:04.065 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:55:04.065 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T02:55:04.065 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:55:04.065 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:55:04.066 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:55:04.066 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:55:04.067 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:55:04.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:04.068 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:04.093 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:04.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:04.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:04.190 INFO:teuthology.orchestra.run.smithi192.stdout:client4681 2024-09-17T02:55:04.190 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:04.190 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:04.208 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:04.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:04.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:04.303 INFO:teuthology.orchestra.run.smithi192.stdout:client4681 2024-09-17T02:55:04.303 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:04.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:04.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:04.359 INFO:teuthology.orchestra.run.smithi192.stdout:client4681 2024-09-17T02:55:04.359 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client4681/status') 2024-09-17T02:55:04.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:04.418 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4681 (3)192.168.0.1:0/3401629716 2024-09-17T02:55:04.418 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2024-09-17T02:55:04.419 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2024-09-17T02:55:04.419 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2024-09-17T02:55:04.419 INFO:teuthology.orchestra.run.smithi192.stderr:69 bytes copied, 2.2028e-05 s, 3.1 MB/s 2024-09-17T02:55:04.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:04.426 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T02:55:04.426 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T02:55:04.426 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T02:55:04.426 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:55:04.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.551+0000 7fa8101c3640 1 -- 172.21.15.104:0/2561453375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa808069410 msgr2=0x7fa8080d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:04.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.551+0000 7fa8101c3640 1 --2- 172.21.15.104:0/2561453375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa808069410 0x7fa8080d0810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa800005fd0 tx=0x7fa80002aa90 comp rx=0 tx=0).stop 2024-09-17T02:55:04.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.551+0000 7fa8101c3640 1 -- 172.21.15.104:0/2561453375 shutdown_connections 2024-09-17T02:55:04.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.551+0000 7fa8101c3640 1 --2- 172.21.15.104:0/2561453375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa808069410 0x7fa8080d0810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:04.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.551+0000 7fa8101c3640 1 --2- 172.21.15.104:0/2561453375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa80806f540 0x7fa8081608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:04.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.551+0000 7fa8101c3640 1 -- 172.21.15.104:0/2561453375 >> 172.21.15.104:0/2561453375 conn(0x7fa8080b3640 msgr2=0x7fa8080b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:04.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.551+0000 7fa8101c3640 1 -- 172.21.15.104:0/2561453375 shutdown_connections 2024-09-17T02:55:04.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.551+0000 7fa8101c3640 1 -- 172.21.15.104:0/2561453375 wait complete. 2024-09-17T02:55:04.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.553+0000 7fa8101c3640 1 Processor -- start 2024-09-17T02:55:04.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.553+0000 7fa8101c3640 1 -- start start 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.554+0000 7fa8101c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa80806f540 0x7fa8081f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.554+0000 7fa8101c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa80815d3b0 0x7fa8081e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.554+0000 7fa8101c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8081582f0 0x7fa8081e6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.554+0000 7fa8101c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080d0ed0 con 0x7fa80806f540 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.554+0000 7fa8101c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080d0d50 con 0x7fa8081582f0 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.554+0000 7fa8101c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa8080d1050 con 0x7fa80815d3b0 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa80806f540 0x7fa8081f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa80806f540 0x7fa8081f4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37516/0 (socket says 172.21.15.104:37516) 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 -- 172.21.15.104:0/843470867 learned_addr learned my addr 172.21.15.104:0/843470867 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80e760640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8081582f0 0x7fa8081e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:04.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80d75e640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa80815d3b0 0x7fa8081e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 -- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa80815d3b0 msgr2=0x7fa8081e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa80815d3b0 0x7fa8081e9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 -- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8081582f0 msgr2=0x7fa8081e6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8081582f0 0x7fa8081e6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 -- 172.21.15.104:0/843470867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80815ac00 con 0x7fa80806f540 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80d75e640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa80815d3b0 0x7fa8081e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80e760640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8081582f0 0x7fa8081e6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa80df5f640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa80806f540 0x7fa8081f4310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa80400e7c0 tx=0x7fa80400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa7fe7fc640 1 -- 172.21.15.104:0/843470867 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80400ccc0 con 0x7fa80806f540 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa7fe7fc640 1 -- 172.21.15.104:0/843470867 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa804010430 con 0x7fa80806f540 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa808157c10 con 0x7fa80806f540 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa7fe7fc640 1 -- 172.21.15.104:0/843470867 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804010860 con 0x7fa80806f540 2024-09-17T02:55:04.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.555+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8081f3830 con 0x7fa80806f540 2024-09-17T02:55:04.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.556+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8080d1570 con 0x7fa80806f540 2024-09-17T02:55:04.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.557+0000 7fa7fe7fc640 1 -- 172.21.15.104:0/843470867 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa804010a00 con 0x7fa80806f540 2024-09-17T02:55:04.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.558+0000 7fa7fe7fc640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7ec078bc0 0x7fa7ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:04.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.558+0000 7fa7fe7fc640 1 -- 172.21.15.104:0/843470867 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa80409b6c0 con 0x7fa80806f540 2024-09-17T02:55:04.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.558+0000 7fa80d75e640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7ec078bc0 0x7fa7ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:04.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.559+0000 7fa80d75e640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7ec078bc0 0x7fa7ec07b0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8080d0c50 tx=0x7fa7f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:04.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.562+0000 7fa7fe7fc640 1 -- 172.21.15.104:0/843470867 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa804063b90 con 0x7fa80806f540 2024-09-17T02:55:04.733 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:55:04.736 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:55:04.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.772+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa8080b4340 con 0x7fa80806f540 2024-09-17T02:55:04.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.772+0000 7fa7fe7fc640 1 -- 172.21.15.104:0/843470867 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fa804063490 con 0x7fa80806f540 2024-09-17T02:55:04.772 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:55:04.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7ec078bc0 msgr2=0x7fa7ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7ec078bc0 0x7fa7ec07b0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa8080d0c50 tx=0x7fa7f8009040 comp rx=0 tx=0).stop 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa80806f540 msgr2=0x7fa8081f4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa80806f540 0x7fa8081f4310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa80400e7c0 tx=0x7fa80400ec80 comp rx=0 tx=0).stop 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 shutdown_connections 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa7ec078bc0 0x7fa7ec07b0d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8081582f0 0x7fa8081e6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa80815d3b0 0x7fa8081e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 --2- 172.21.15.104:0/843470867 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa80806f540 0x7fa8081f4310 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 >> 172.21.15.104:0/843470867 conn(0x7fa8080b3640 msgr2=0x7fa8081565d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 shutdown_connections 2024-09-17T02:55:04.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:04.775+0000 7fa8101c3640 1 -- 172.21.15.104:0/843470867 wait complete. 2024-09-17T02:55:04.785 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T02:55:04.785 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:55:04.786 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T02:55:04.786 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T02:55:04.786 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T02:55:04.786 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T02:55:04.786 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T02:55:04.786 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:55:04.786 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T02:55:04.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:04.786 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T02:55:04.802 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:04.802 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:04.802 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:04.802 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:04.802 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:04.802 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42789sec preferred_lft 42789sec 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T02:55:04.803 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link tentative 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link tentative 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:04.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:04.805 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:55:04.868 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T02:55:04.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:04.870 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T02:55:04.927 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T02:55:04.927 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:55:04.927 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:55:04.927 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:55:04.927 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:55:04.927 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:04.928 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:04.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:55:04.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:55:04.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:55:04.928 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:05.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:05.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:05.053 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:55:05.069 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T02:55:05.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:05.069 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2024-09-17T02:55:05.124 INFO:teuthology.orchestra.run.smithi192.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T02:55:05.125 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:05.125 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:05.125 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T02:55:05.125 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T02:55:05.125 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:05.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:05.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:05.242 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T02:55:05.266 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:05.266 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:05.266 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:05.266 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:05.266 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:05.266 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:05.266 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:55:05.266 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 6e:93:a9:05:15:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T02:55:05.267 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T02:55:05.267 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:05.267 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::6c93:a9ff:fe05:1558/64 scope link 2024-09-17T02:55:05.267 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:05.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:05.268 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T02:55:05.332 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:05.332 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:05.332 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 6e:93:a9:05:15:58 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::6c93:a9ff:fe05:1558/64 scope link 2024-09-17T02:55:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:05.334 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T02:55:05.334 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:05.335 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:05.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T02:55:05.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T02:55:05.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T02:55:05.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T02:55:05.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T02:55:05.335 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:05.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:05.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:05.486 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:05.486 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:05.487 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.1 up 2024-09-17T02:55:05.487 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T02:55:05.487 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:05.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:05.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:05.562 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:05.563 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T02:55:05.577 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T02:55:05.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:05.578 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T02:55:05.634 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:55:05.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:05.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T02:55:05.728 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T02:55:05.728 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T02:55:05.729 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:05.739 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T02:55:05.739 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T02:55:05.739 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:05.739 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:05.740 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:05.744 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T02:55:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T02:55:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:55:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:55:05.745 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:55:05.746 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T02:55:05.746 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:55:05.746 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:55:05.746 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:55:05.746 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:55:05.747 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:55:05.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:05.747 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T02:55:05.771 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:05.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:05.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:05.867 INFO:teuthology.orchestra.run.smithi192.stdout:client4746 2024-09-17T02:55:05.868 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:05.868 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:05.884 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:05.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:05.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:05.980 INFO:teuthology.orchestra.run.smithi192.stdout:client4746 2024-09-17T02:55:05.980 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:06.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:06.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:06.035 INFO:teuthology.orchestra.run.smithi192.stdout:client4746 2024-09-17T02:55:06.035 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client4746/status') 2024-09-17T02:55:06.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:06.093 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4746 (3)172.21.15.192:0/3774362934 2024-09-17T02:55:06.093 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2024-09-17T02:55:06.093 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2024-09-17T02:55:06.093 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2024-09-17T02:55:06.093 INFO:teuthology.orchestra.run.smithi192.stderr:71 bytes copied, 2.358e-05 s, 3.0 MB/s 2024-09-17T02:55:06.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:06.100 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T02:55:06.154 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-17T02:55:06.154 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2024-09-17T02:55:06.154 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:06.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.278+0000 7fd959669640 1 -- 172.21.15.104:0/1897932334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540d3490 msgr2=0x7fd9540b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.278+0000 7fd959669640 1 --2- 172.21.15.104:0/1897932334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540d3490 0x7fd9540b7c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009be0 tx=0x7fd94c02a820 comp rx=0 tx=0).stop 2024-09-17T02:55:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.278+0000 7fd959669640 1 -- 172.21.15.104:0/1897932334 shutdown_connections 2024-09-17T02:55:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.278+0000 7fd959669640 1 --2- 172.21.15.104:0/1897932334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540d3490 0x7fd9540b7c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.278+0000 7fd959669640 1 -- 172.21.15.104:0/1897932334 >> 172.21.15.104:0/1897932334 conn(0x7fd9540d2970 msgr2=0x7fd9540d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.278+0000 7fd959669640 1 -- 172.21.15.104:0/1897932334 shutdown_connections 2024-09-17T02:55:06.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.278+0000 7fd959669640 1 -- 172.21.15.104:0/1897932334 wait complete. 2024-09-17T02:55:06.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.280+0000 7fd959669640 1 Processor -- start 2024-09-17T02:55:06.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.280+0000 7fd959669640 1 -- start start 2024-09-17T02:55:06.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd959669640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540d0fd0 0x7fd9541f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd959669640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9540d13e0 0x7fd954152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd959669640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540d3490 0x7fd954152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd959669640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd954168390 con 0x7fd9540d13e0 2024-09-17T02:55:06.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd959669640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540b7aa0 con 0x7fd9540d3490 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd959669640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd954168510 con 0x7fd9540d0fd0 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9540d13e0 0x7fd954152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9540d13e0 0x7fd954152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37520/0 (socket says 172.21.15.104:37520) 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd952ffd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540d0fd0 0x7fd9541f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 -- 172.21.15.104:0/3155996622 learned_addr learned my addr 172.21.15.104:0/3155996622 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9537fe640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540d3490 0x7fd954152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 -- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540d0fd0 msgr2=0x7fd9541f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540d0fd0 0x7fd9541f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 -- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540d3490 msgr2=0x7fd954152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540d3490 0x7fd954152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 -- 172.21.15.104:0/3155996622 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9540c9120 con 0x7fd9540d13e0 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.282+0000 7fd9527fc640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9540d13e0 0x7fd954152520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0013c0 tx=0x7fd93c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:06.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.283+0000 7fd94b7fe640 1 -- 172.21.15.104:0/3155996622 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c016020 con 0x7fd9540d13e0 2024-09-17T02:55:06.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.283+0000 7fd94b7fe640 1 -- 172.21.15.104:0/3155996622 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd93c012920 con 0x7fd9540d13e0 2024-09-17T02:55:06.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.283+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd954160520 con 0x7fd9540d13e0 2024-09-17T02:55:06.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.283+0000 7fd94b7fe640 1 -- 172.21.15.104:0/3155996622 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c012cf0 con 0x7fd9540d13e0 2024-09-17T02:55:06.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.283+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9540c8640 con 0x7fd9540d13e0 2024-09-17T02:55:06.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.284+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd954160290 con 0x7fd9540d13e0 2024-09-17T02:55:06.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.284+0000 7fd94b7fe640 1 -- 172.21.15.104:0/3155996622 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd93c019020 con 0x7fd9540d13e0 2024-09-17T02:55:06.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.285+0000 7fd94b7fe640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd934078bc0 0x7fd93407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.285+0000 7fd94b7fe640 1 -- 172.21.15.104:0/3155996622 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd93c09a920 con 0x7fd9540d13e0 2024-09-17T02:55:06.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.285+0000 7fd952ffd640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd934078bc0 0x7fd93407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.285+0000 7fd952ffd640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd934078bc0 0x7fd93407b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd94c033000 tx=0x7fd94c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:06.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.289+0000 7fd94b7fe640 1 -- 172.21.15.104:0/3155996622 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd93c020030 con 0x7fd9540d13e0 2024-09-17T02:55:06.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.464+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9540b7c80 con 0x7fd9540d13e0 2024-09-17T02:55:06.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.465+0000 7fd94b7fe640 1 -- 172.21.15.104:0/3155996622 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7fd93c0627b0 con 0x7fd9540d13e0 2024-09-17T02:55:06.465 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:06.465 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:43.133211+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:06.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd934078bc0 msgr2=0x7fd93407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd934078bc0 0x7fd93407b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd94c033000 tx=0x7fd94c004ab0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9540d13e0 msgr2=0x7fd954152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9540d13e0 0x7fd954152520 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd93c0013c0 tx=0x7fd93c00c940 comp rx=0 tx=0).stop 2024-09-17T02:55:06.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 shutdown_connections 2024-09-17T02:55:06.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd934078bc0 0x7fd93407b0d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9540d3490 0x7fd954152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd9540d13e0 0x7fd954152520 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 --2- 172.21.15.104:0/3155996622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9540d0fd0 0x7fd9541f9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 >> 172.21.15.104:0/3155996622 conn(0x7fd9540d2970 msgr2=0x7fd954071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:06.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 shutdown_connections 2024-09-17T02:55:06.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.467+0000 7fd959669640 1 -- 172.21.15.104:0/3155996622 wait complete. 2024-09-17T02:55:06.478 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T02:54:39.333696+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T02:54:40.447216+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T02:55:06.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T02:55:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.597+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2369889923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a40d1000 msgr2=0x7fa9a4068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.597+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2369889923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a40d1000 0x7fa9a4068d00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009830 tx=0x7fa98c02a510 comp rx=0 tx=0).stop 2024-09-17T02:55:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.597+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2369889923 shutdown_connections 2024-09-17T02:55:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.597+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2369889923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9a4069240 0x7fa9a415d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.597+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2369889923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a40d1000 0x7fa9a4068d00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.597+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2369889923 >> 172.21.15.104:0/2369889923 conn(0x7fa9a40b3560 msgr2=0x7fa9a40b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:06.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.597+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2369889923 shutdown_connections 2024-09-17T02:55:06.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.597+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2369889923 wait complete. 2024-09-17T02:55:06.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.599+0000 7fa9a93ff640 1 Processor -- start 2024-09-17T02:55:06.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.600+0000 7fa9a93ff640 1 -- start start 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a93ff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a4069240 0x7fa9a40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a93ff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9a4073560 0x7fa9a40af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a93ff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9a40d1000 0x7fa9a41352c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a93ff640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40d0c30 con 0x7fa9a4069240 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a93ff640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40d0ab0 con 0x7fa9a4073560 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a93ff640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a415db90 con 0x7fa9a40d1000 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a4069240 0x7fa9a40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a4069240 0x7fa9a40cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37546/0 (socket says 172.21.15.104:37546) 2024-09-17T02:55:06.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a2ffd640 1 -- 172.21.15.104:0/2979008274 learned_addr learned my addr 172.21.15.104:0/2979008274 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a37fe640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9a40d1000 0x7fa9a41352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a27fc640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9a4073560 0x7fa9a40af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a2ffd640 1 -- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9a40d1000 msgr2=0x7fa9a41352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a2ffd640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9a40d1000 0x7fa9a41352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a2ffd640 1 -- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9a4073560 msgr2=0x7fa9a40af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a2ffd640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9a4073560 0x7fa9a40af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.601+0000 7fa9a2ffd640 1 -- 172.21.15.104:0/2979008274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a40b0190 con 0x7fa9a4069240 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.602+0000 7fa9a2ffd640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a4069240 0x7fa9a40cdba0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c3a0 tx=0x7fa99400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.602+0000 7fa99b7fe640 1 -- 172.21.15.104:0/2979008274 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa994011790 con 0x7fa9a4069240 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.602+0000 7fa99b7fe640 1 -- 172.21.15.104:0/2979008274 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa994017070 con 0x7fa9a4069240 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.602+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a40b1160 con 0x7fa9a4069240 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.602+0000 7fa99b7fe640 1 -- 172.21.15.104:0/2979008274 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa994011cc0 con 0x7fa9a4069240 2024-09-17T02:55:06.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.602+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a40b4a20 con 0x7fa9a4069240 2024-09-17T02:55:06.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.603+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a4142ab0 con 0x7fa9a4069240 2024-09-17T02:55:06.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.604+0000 7fa99b7fe640 1 -- 172.21.15.104:0/2979008274 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa99401c460 con 0x7fa9a4069240 2024-09-17T02:55:06.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.605+0000 7fa99b7fe640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa984078b90 0x7fa98407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.605+0000 7fa99b7fe640 1 -- 172.21.15.104:0/2979008274 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa99409a980 con 0x7fa9a4069240 2024-09-17T02:55:06.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.605+0000 7fa9a27fc640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa984078b90 0x7fa98407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.606+0000 7fa9a27fc640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa984078b90 0x7fa98407b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa98c034000 tx=0x7fa98c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:06.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.610+0000 7fa99b7fe640 1 -- 172.21.15.104:0/2979008274 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9a4142ab0 con 0x7fa9a4069240 2024-09-17T02:55:06.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.789+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa9a406a480 con 0x7fa9a4069240 2024-09-17T02:55:06.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.790+0000 7fa99b7fe640 1 -- 172.21.15.104:0/2979008274 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fa9a406a480 con 0x7fa9a4069240 2024-09-17T02:55:06.790 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T02:55:06.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.793+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa984078b90 msgr2=0x7fa98407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.793+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa984078b90 0x7fa98407b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa98c034000 tx=0x7fa98c004730 comp rx=0 tx=0).stop 2024-09-17T02:55:06.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.793+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a4069240 msgr2=0x7fa9a40cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.793+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a4069240 0x7fa9a40cdba0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c3a0 tx=0x7fa99400c860 comp rx=0 tx=0).stop 2024-09-17T02:55:06.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.794+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 shutdown_connections 2024-09-17T02:55:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.794+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa984078b90 0x7fa98407b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.794+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9a4073560 0x7fa9a40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.794+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9a40d1000 0x7fa9a41352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.794+0000 7fa9a93ff640 1 --2- 172.21.15.104:0/2979008274 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9a4069240 0x7fa9a40cdba0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.794+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 >> 172.21.15.104:0/2979008274 conn(0x7fa9a40b3560 msgr2=0x7fa9a40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.794+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 shutdown_connections 2024-09-17T02:55:06.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.794+0000 7fa9a93ff640 1 -- 172.21.15.104:0/2979008274 wait complete. 2024-09-17T02:55:06.809 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T02:55:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.932+0000 7feff4971640 1 -- 172.21.15.104:0/3653085977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 msgr2=0x7feff00b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.932+0000 7feff4971640 1 --2- 172.21.15.104:0/3653085977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 0x7feff00b7c80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009860 tx=0x7fefe002a420 comp rx=0 tx=0).stop 2024-09-17T02:55:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.932+0000 7feff4971640 1 -- 172.21.15.104:0/3653085977 shutdown_connections 2024-09-17T02:55:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.932+0000 7feff4971640 1 --2- 172.21.15.104:0/3653085977 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 0x7feff00b7c80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.932+0000 7feff4971640 1 -- 172.21.15.104:0/3653085977 >> 172.21.15.104:0/3653085977 conn(0x7feff00d2970 msgr2=0x7feff00d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.932+0000 7feff4971640 1 -- 172.21.15.104:0/3653085977 shutdown_connections 2024-09-17T02:55:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.932+0000 7feff4971640 1 -- 172.21.15.104:0/3653085977 wait complete. 2024-09-17T02:55:06.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.934+0000 7feff4971640 1 Processor -- start 2024-09-17T02:55:06.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.934+0000 7feff4971640 1 -- start start 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7feff4971640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feff00d0fd0 0x7feff00c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7feff4971640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feff00d13e0 0x7feff013f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7feff4971640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 0x7feff013fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7feff4971640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feff0168300 con 0x7feff00d3490 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7feff4971640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feff0168180 con 0x7feff00d13e0 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7feff4971640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feff0168480 con 0x7feff00d0fd0 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7fefeed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 0x7feff013fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7fefeed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 0x7feff013fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37578/0 (socket says 172.21.15.104:37578) 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.935+0000 7fefeed9d640 1 -- 172.21.15.104:0/3581471815 learned_addr learned my addr 172.21.15.104:0/3581471815 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefeed9d640 1 -- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feff00d0fd0 msgr2=0x7feff00c9e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefeed9d640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feff00d0fd0 0x7feff00c9e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefeed9d640 1 -- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feff00d13e0 msgr2=0x7feff013f790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T02:55:06.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefeed9d640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feff00d13e0 0x7feff013f790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:06.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefeed9d640 1 -- 172.21.15.104:0/3581471815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff00ca3b0 con 0x7feff00d3490 2024-09-17T02:55:06.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefeed9d640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 0x7feff013fcd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fefe800cb10 tx=0x7fefe800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:06.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefe6ffd640 1 -- 172.21.15.104:0/3581471815 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8016020 con 0x7feff00d3490 2024-09-17T02:55:06.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff00cbd20 con 0x7feff00d3490 2024-09-17T02:55:06.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefe6ffd640 1 -- 172.21.15.104:0/3581471815 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefe800ad60 con 0x7feff00d3490 2024-09-17T02:55:06.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7fefe6ffd640 1 -- 172.21.15.104:0/3581471815 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8012680 con 0x7feff00d3490 2024-09-17T02:55:06.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.936+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff00cc2e0 con 0x7feff00d3490 2024-09-17T02:55:06.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.937+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff00cb840 con 0x7feff00d3490 2024-09-17T02:55:06.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.938+0000 7fefe6ffd640 1 -- 172.21.15.104:0/3581471815 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fefe8019020 con 0x7feff00d3490 2024-09-17T02:55:06.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.938+0000 7fefe6ffd640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefd0078b90 0x7fefd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:06.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.938+0000 7fefe6ffd640 1 -- 172.21.15.104:0/3581471815 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fefe809b3a0 con 0x7feff00d3490 2024-09-17T02:55:06.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.939+0000 7fefee59c640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefd0078b90 0x7fefd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:06.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.939+0000 7fefee59c640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefd0078b90 0x7fefd007b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fefe0034000 tx=0x7fefe0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:06.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:06.943+0000 7fefe6ffd640 1 -- 172.21.15.104:0/3581471815 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feff00cb840 con 0x7feff00d3490 2024-09-17T02:55:07.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.124+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7feff00b7c80 con 0x7feff00d3490 2024-09-17T02:55:07.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.124+0000 7fefe6ffd640 1 -- 172.21.15.104:0/3581471815 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fefe8020020 con 0x7feff00d3490 2024-09-17T02:55:07.124 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 32 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefd0078b90 msgr2=0x7fefd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefd0078b90 0x7fefd007b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fefe0034000 tx=0x7fefe0004730 comp rx=0 tx=0).stop 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 msgr2=0x7feff013fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 0x7feff013fcd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fefe800cb10 tx=0x7fefe800a060 comp rx=0 tx=0).stop 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 shutdown_connections 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefd0078b90 0x7fefd007b0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feff00d13e0 0x7feff013f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feff00d3490 0x7feff013fcd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 --2- 172.21.15.104:0/3581471815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feff00d0fd0 0x7feff00c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 >> 172.21.15.104:0/3581471815 conn(0x7feff00d2970 msgr2=0x7feff0159370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 shutdown_connections 2024-09-17T02:55:07.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.127+0000 7feff4971640 1 -- 172.21.15.104:0/3581471815 wait complete. 2024-09-17T02:55:07.138 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T02:55:07.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.257+0000 7f9007fda640 1 -- 172.21.15.104:0/3867933918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f900015b7f0 msgr2=0x7f900015bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.257+0000 7f9007fda640 1 --2- 172.21.15.104:0/3867933918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f900015b7f0 0x7f900015bc00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9000070910 tx=0x7f8ff802a980 comp rx=0 tx=0).stop 2024-09-17T02:55:07.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.257+0000 7f9007fda640 1 -- 172.21.15.104:0/3867933918 shutdown_connections 2024-09-17T02:55:07.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.257+0000 7f9007fda640 1 --2- 172.21.15.104:0/3867933918 >> v2:172.21.15.192:3300/0 conn(0x7f9000072470 0x7f9000072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.257+0000 7f9007fda640 1 --2- 172.21.15.104:0/3867933918 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f900015b7f0 0x7f900015bc00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.257+0000 7f9007fda640 1 -- 172.21.15.104:0/3867933918 >> 172.21.15.104:0/3867933918 conn(0x7f90000b2450 msgr2=0x7f90000b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:07.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.257+0000 7f9007fda640 1 -- 172.21.15.104:0/3867933918 shutdown_connections 2024-09-17T02:55:07.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.257+0000 7f9007fda640 1 -- 172.21.15.104:0/3867933918 wait complete. 2024-09-17T02:55:07.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.259+0000 7f9007fda640 1 Processor -- start 2024-09-17T02:55:07.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.259+0000 7f9007fda640 1 -- start start 2024-09-17T02:55:07.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9007fda640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9000072470 0x7f90000aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:07.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9007fda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9000072dc0 0x7f9000153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:07.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9007fda640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f900015b7f0 0x7f9000159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:07.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9007fda640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f900015fe30 con 0x7f9000072dc0 2024-09-17T02:55:07.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9007fda640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f90000cf4a0 con 0x7f9000072470 2024-09-17T02:55:07.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9007fda640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f900015ffb0 con 0x7f900015b7f0 2024-09-17T02:55:07.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005575640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9000072dc0 0x7f9000153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:07.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005575640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9000072dc0 0x7f9000153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37602/0 (socket says 172.21.15.104:37602) 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005575640 1 -- 172.21.15.104:0/4282467471 learned_addr learned my addr 172.21.15.104:0/4282467471 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005d76640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9000072470 0x7f90000aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9006577640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f900015b7f0 0x7f9000159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005575640 1 -- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f900015b7f0 msgr2=0x7f9000159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005575640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f900015b7f0 0x7f9000159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005575640 1 -- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9000072470 msgr2=0x7f90000aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005575640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9000072470 0x7f90000aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005575640 1 -- 172.21.15.104:0/4282467471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90001f2bf0 con 0x7f9000072dc0 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.260+0000 7f9005d76640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9000072470 0x7f90000aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.261+0000 7f9005575640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9000072dc0 0x7f9000153a20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400d740 tx=0x7f8ff400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.261+0000 7f8ffe7fc640 1 -- 172.21.15.104:0/4282467471 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4017070 con 0x7f9000072dc0 2024-09-17T02:55:07.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.261+0000 7f8ffe7fc640 1 -- 172.21.15.104:0/4282467471 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ff4009d20 con 0x7f9000072dc0 2024-09-17T02:55:07.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.261+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90001f2ed0 con 0x7f9000072dc0 2024-09-17T02:55:07.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.261+0000 7f8ffe7fc640 1 -- 172.21.15.104:0/4282467471 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40106c0 con 0x7f9000072dc0 2024-09-17T02:55:07.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.261+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90001f3490 con 0x7f9000072dc0 2024-09-17T02:55:07.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.262+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90000aaa60 con 0x7f9000072dc0 2024-09-17T02:55:07.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.263+0000 7f8ffe7fc640 1 -- 172.21.15.104:0/4282467471 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ff401a070 con 0x7f9000072dc0 2024-09-17T02:55:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.263+0000 7f8ffe7fc640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8fec078bc0 0x7f8fec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.263+0000 7f8ffe7fc640 1 -- 172.21.15.104:0/4282467471 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ff409b250 con 0x7f9000072dc0 2024-09-17T02:55:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.264+0000 7f9005d76640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8fec078bc0 0x7f8fec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:07.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.264+0000 7f9005d76640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8fec078bc0 0x7f8fec07b0d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8035000 tx=0x7f8ff8004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:07.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.267+0000 7f8ffe7fc640 1 -- 172.21.15.104:0/4282467471 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ff4063800 con 0x7f9000072dc0 2024-09-17T02:55:07.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.446+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9000160510 con 0x7f9000072dc0 2024-09-17T02:55:07.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.447+0000 7f8ffe7fc640 1 -- 172.21.15.104:0/4282467471 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f8ff4063100 con 0x7f9000072dc0 2024-09-17T02:55:07.447 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 64 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8fec078bc0 msgr2=0x7f8fec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8fec078bc0 0x7f8fec07b0d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8035000 tx=0x7f8ff8004ab0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9000072dc0 msgr2=0x7f9000153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9000072dc0 0x7f9000153a20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400d740 tx=0x7f8ff400dc00 comp rx=0 tx=0).stop 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 shutdown_connections 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8fec078bc0 0x7f8fec07b0d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f900015b7f0 0x7f9000159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9000072dc0 0x7f9000153a20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 --2- 172.21.15.104:0/4282467471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9000072470 0x7f90000aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 >> 172.21.15.104:0/4282467471 conn(0x7f90000b2450 msgr2=0x7f90000b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:07.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 shutdown_connections 2024-09-17T02:55:07.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.449+0000 7f9007fda640 1 -- 172.21.15.104:0/4282467471 wait complete. 2024-09-17T02:55:07.460 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-17T02:55:07.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.574+0000 7fc916919640 1 -- 172.21.15.104:0/2391630623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d0fd0 msgr2=0x7fc910160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.574+0000 7fc916919640 1 --2- 172.21.15.104:0/2391630623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d0fd0 0x7fc910160ec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8005fd0 tx=0x7fc8f802a540 comp rx=0 tx=0).stop 2024-09-17T02:55:07.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.574+0000 7fc916919640 1 -- 172.21.15.104:0/2391630623 shutdown_connections 2024-09-17T02:55:07.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.574+0000 7fc916919640 1 --2- 172.21.15.104:0/2391630623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d0fd0 0x7fc910160ec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.574+0000 7fc916919640 1 --2- 172.21.15.104:0/2391630623 >> v2:172.21.15.192:3300/0 conn(0x7fc9100d3490 0x7fc9100b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.574+0000 7fc916919640 1 -- 172.21.15.104:0/2391630623 >> 172.21.15.104:0/2391630623 conn(0x7fc9100d2970 msgr2=0x7fc9100d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:07.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.574+0000 7fc916919640 1 -- 172.21.15.104:0/2391630623 shutdown_connections 2024-09-17T02:55:07.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.574+0000 7fc916919640 1 -- 172.21.15.104:0/2391630623 wait complete. 2024-09-17T02:55:07.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.576+0000 7fc916919640 1 Processor -- start 2024-09-17T02:55:07.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.576+0000 7fc916919640 1 -- start start 2024-09-17T02:55:07.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc916919640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9100d0fd0 0x7fc910160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:07.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc916919640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d13e0 0x7fc9101f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:07.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc916919640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9100d3490 0x7fc9101e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:07.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc916919640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc9100b6bd0 con 0x7fc9100d0fd0 2024-09-17T02:55:07.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc916919640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc9100b6a50 con 0x7fc9100d3490 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc916919640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc9100b6d50 con 0x7fc9100d13e0 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9100d0fd0 0x7fc910160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9100d0fd0 0x7fc910160500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37604/0 (socket says 172.21.15.104:37604) 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 -- 172.21.15.104:0/4096045511 learned_addr learned my addr 172.21.15.104:0/4096045511 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90f7fe640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d13e0 0x7fc9101f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc914eb6640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9100d3490 0x7fc9101e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 -- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d13e0 msgr2=0x7fc9101f7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d13e0 0x7fc9101f7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 -- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9100d3490 msgr2=0x7fc9101e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9100d3490 0x7fc9101e86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 -- 172.21.15.104:0/4096045511 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9101f3f30 con 0x7fc9100d0fd0 2024-09-17T02:55:07.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90f7fe640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d13e0 0x7fc9101f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:07.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90ffff640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9100d0fd0 0x7fc910160500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc90000e9f0 tx=0x7fc90000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:07.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90cff9640 1 -- 172.21.15.104:0/4096045511 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90000cd80 con 0x7fc9100d0fd0 2024-09-17T02:55:07.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9101f4210 con 0x7fc9100d0fd0 2024-09-17T02:55:07.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90cff9640 1 -- 172.21.15.104:0/4096045511 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc900004020 con 0x7fc9100d0fd0 2024-09-17T02:55:07.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.578+0000 7fc90cff9640 1 -- 172.21.15.104:0/4096045511 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900004470 con 0x7fc9100d0fd0 2024-09-17T02:55:07.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.579+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91015e8c0 con 0x7fc9100d0fd0 2024-09-17T02:55:07.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.579+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9100b7c80 con 0x7fc9100d0fd0 2024-09-17T02:55:07.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.580+0000 7fc90cff9640 1 -- 172.21.15.104:0/4096045511 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9000035f0 con 0x7fc9100d0fd0 2024-09-17T02:55:07.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.581+0000 7fc90cff9640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8f0078b90 0x7fc8f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:07.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.581+0000 7fc90cff9640 1 -- 172.21.15.104:0/4096045511 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc90009bbb0 con 0x7fc9100d0fd0 2024-09-17T02:55:07.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.582+0000 7fc90f7fe640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8f0078b90 0x7fc8f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:07.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.583+0000 7fc90f7fe640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8f0078b90 0x7fc8f007b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8033000 tx=0x7fc8f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:07.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.589+0000 7fc90cff9640 1 -- 172.21.15.104:0/4096045511 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc900064080 con 0x7fc9100d0fd0 2024-09-17T02:55:07.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:07.837+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7fc9100d0900 con 0x7fc9100d0fd0 2024-09-17T02:55:08.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.209+0000 7fc90cff9640 1 -- 172.21.15.104:0/4096045511 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v40) ==== 133+0+0 (secure 0 0 0) 0x7fc900063980 con 0x7fc9100d0fd0 2024-09-17T02:55:08.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8f0078b90 msgr2=0x7fc8f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8f0078b90 0x7fc8f007b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8033000 tx=0x7fc8f8004730 comp rx=0 tx=0).stop 2024-09-17T02:55:08.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9100d0fd0 msgr2=0x7fc910160500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9100d0fd0 0x7fc910160500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc90000e9f0 tx=0x7fc90000eeb0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 shutdown_connections 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8f0078b90 0x7fc8f007b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9100d3490 0x7fc9101e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9100d13e0 0x7fc9101f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 --2- 172.21.15.104:0/4096045511 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9100d0fd0 0x7fc910160500 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 >> 172.21.15.104:0/4096045511 conn(0x7fc9100d2970 msgr2=0x7fc9100b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 shutdown_connections 2024-09-17T02:55:08.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.212+0000 7fc916919640 1 -- 172.21.15.104:0/4096045511 wait complete. 2024-09-17T02:55:08.224 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-17T02:55:08.342 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_objectstore":"memstore"} 2024-09-17T02:55:08.343 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-17T02:55:08.343 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T02:55:08.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.456+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1021991149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fa8003a00 msgr2=0x7f5fa8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.456+0000 7f5fc41c6640 1 --2- 172.21.15.104:0/1021991149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fa8003a00 0x7f5fa8003e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800c310 tx=0x7f5fa8005830 comp rx=0 tx=0).stop 2024-09-17T02:55:08.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.456+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1021991149 shutdown_connections 2024-09-17T02:55:08.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.456+0000 7f5fc41c6640 1 --2- 172.21.15.104:0/1021991149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fa8003a00 0x7f5fa8003e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.456+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1021991149 >> 172.21.15.104:0/1021991149 conn(0x7f5fbc0d2970 msgr2=0x7f5fbc0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:08.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.456+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1021991149 shutdown_connections 2024-09-17T02:55:08.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.456+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1021991149 wait complete. 2024-09-17T02:55:08.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.457+0000 7f5fc41c6640 1 Processor -- start 2024-09-17T02:55:08.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.458+0000 7f5fc41c6640 1 -- start start 2024-09-17T02:55:08.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc41c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fa8003a00 0x7f5fbc0af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:08.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc41c6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fbc1f9910 0x7f5fbc1d9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc41c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fbc1f8d00 0x7f5fbc1f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc41c6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc06d590 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc41c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc06d410 con 0x7f5fa8003a00 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc41c6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5fbc06d710 con 0x7f5fbc1f9910 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fbc1f8d00 0x7f5fbc1f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fbc1f8d00 0x7f5fbc1f9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37622/0 (socket says 172.21.15.104:37622) 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 -- 172.21.15.104:0/1244791854 learned_addr learned my addr 172.21.15.104:0/1244791854 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc1f62640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fa8003a00 0x7f5fbc0af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc1761640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fbc1f9910 0x7f5fbc1d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 -- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fbc1f9910 msgr2=0x7f5fbc1d9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fbc1f9910 0x7f5fbc1d9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 -- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fa8003a00 msgr2=0x7f5fbc0af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fa8003a00 0x7f5fbc0af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 -- 172.21.15.104:0/1244791854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc1f9650 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.459+0000 7f5fc2763640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fbc1f8d00 0x7f5fbc1f9110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc06e530 tx=0x7f5fb400d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:08.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.460+0000 7f5fb27fc640 1 -- 172.21.15.104:0/1244791854 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400f880 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.460+0000 7f5fb27fc640 1 -- 172.21.15.104:0/1244791854 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fb4017070 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.460+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc0aff40 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.460+0000 7f5fb27fc640 1 -- 172.21.15.104:0/1244791854 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400fdb0 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.460+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc0b0500 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.460+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fbc06dc70 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.461+0000 7f5fb27fc640 1 -- 172.21.15.104:0/1244791854 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fb401c460 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.462+0000 7f5fb27fc640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fa0078b90 0x7f5fa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:08.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.462+0000 7f5fb27fc640 1 -- 172.21.15.104:0/1244791854 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5fb409add0 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.462+0000 7f5fc1f62640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fa0078b90 0x7f5fa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:08.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.463+0000 7f5fc1f62640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fa0078b90 0x7f5fa007b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8033000 tx=0x7f5fb8038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:08.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.466+0000 7f5fb27fc640 1 -- 172.21.15.104:0/1244791854 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5fbc1f9650 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.640+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f5fbc0d2420 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.640+0000 7f5fb27fc640 1 -- 172.21.15.104:0/1244791854 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f5fb409c5d0 con 0x7f5fbc1f8d00 2024-09-17T02:55:08.640 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T02:55:08.640 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T02:55:08.640 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T02:55:08.640 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T02:55:08.640 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T02:55:08.640 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T02:55:08.641 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T02:55:08.642 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T02:55:08.642 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T02:55:08.642 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T02:55:08.642 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T02:55:08.642 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T02:55:08.642 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T02:55:08.642 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T02:55:08.642 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T02:55:08.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.642+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fa0078b90 msgr2=0x7f5fa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.642+0000 7f5fc41c6640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fa0078b90 0x7f5fa007b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8033000 tx=0x7f5fb8038040 comp rx=0 tx=0).stop 2024-09-17T02:55:08.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.642+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fbc1f8d00 msgr2=0x7f5fbc1f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.642+0000 7f5fc41c6640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fbc1f8d00 0x7f5fbc1f9110 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc06e530 tx=0x7f5fb400d970 comp rx=0 tx=0).stop 2024-09-17T02:55:08.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.643+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 shutdown_connections 2024-09-17T02:55:08.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.643+0000 7f5fc41c6640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fa0078b90 0x7f5fa007b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.643+0000 7f5fc41c6640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fbc1f8d00 0x7f5fbc1f9110 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.643+0000 7f5fc41c6640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fbc1f9910 0x7f5fbc1d9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.643+0000 7f5fc41c6640 1 --2- 172.21.15.104:0/1244791854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fa8003a00 0x7f5fbc0af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.643+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 >> 172.21.15.104:0/1244791854 conn(0x7f5fbc0d2970 msgr2=0x7f5fbc1e6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:08.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.643+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 shutdown_connections 2024-09-17T02:55:08.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.643+0000 7f5fc41c6640 1 -- 172.21.15.104:0/1244791854 wait complete. 2024-09-17T02:55:08.653 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T02:55:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.769+0000 7fdb5e007640 1 -- 172.21.15.104:0/1739383027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 msgr2=0x7fdb580b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.769+0000 7fdb5e007640 1 --2- 172.21.15.104:0/1739383027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 0x7fdb580b6000 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb580d23d0 tx=0x7fdb4802a5f0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.769+0000 7fdb5e007640 1 -- 172.21.15.104:0/1739383027 shutdown_connections 2024-09-17T02:55:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.769+0000 7fdb5e007640 1 --2- 172.21.15.104:0/1739383027 >> v2:172.21.15.192:3300/0 conn(0x7fdb5806f550 0x7fdb580b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.769+0000 7fdb5e007640 1 --2- 172.21.15.104:0/1739383027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 0x7fdb580b6000 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.769+0000 7fdb5e007640 1 -- 172.21.15.104:0/1739383027 >> 172.21.15.104:0/1739383027 conn(0x7fdb5806d200 msgr2=0x7fdb5806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.769+0000 7fdb5e007640 1 -- 172.21.15.104:0/1739383027 shutdown_connections 2024-09-17T02:55:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.769+0000 7fdb5e007640 1 -- 172.21.15.104:0/1739383027 wait complete. 2024-09-17T02:55:08.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.771+0000 7fdb5e007640 1 Processor -- start 2024-09-17T02:55:08.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.771+0000 7fdb5e007640 1 -- start start 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb5e007640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb5806f550 0x7fdb581e86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb5e007640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb580734f0 0x7fdb580afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb5e007640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 0x7fdb580cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb5e007640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdb580cf470 con 0x7fdb5815bd20 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb5e007640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdb580cf2f0 con 0x7fdb5806f550 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb5e007640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdb580cf5f0 con 0x7fdb580734f0 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb57fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 0x7fdb580cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb57fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 0x7fdb580cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37630/0 (socket says 172.21.15.104:37630) 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb57fff640 1 -- 172.21.15.104:0/435568411 learned_addr learned my addr 172.21.15.104:0/435568411 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:08.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb577fe640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb5806f550 0x7fdb581e86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb4ffff640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb580734f0 0x7fdb580afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb57fff640 1 -- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb580734f0 msgr2=0x7fdb580afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb57fff640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb580734f0 0x7fdb580afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb57fff640 1 -- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb5806f550 msgr2=0x7fdb581e86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb57fff640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb5806f550 0x7fdb581e86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb57fff640 1 -- 172.21.15.104:0/435568411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb581e8c20 con 0x7fdb5815bd20 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb577fe640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb5806f550 0x7fdb581e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.772+0000 7fdb4ffff640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb580734f0 0x7fdb580afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.773+0000 7fdb57fff640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 0x7fdb580cd960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c6f0 tx=0x7fdb5000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.773+0000 7fdb54ff9640 1 -- 172.21.15.104:0/435568411 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50017070 con 0x7fdb5815bd20 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.773+0000 7fdb54ff9640 1 -- 172.21.15.104:0/435568411 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb50003c90 con 0x7fdb5815bd20 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.773+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb581e8ef0 con 0x7fdb5815bd20 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.773+0000 7fdb54ff9640 1 -- 172.21.15.104:0/435568411 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50003e60 con 0x7fdb5815bd20 2024-09-17T02:55:08.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.773+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb581e94b0 con 0x7fdb5815bd20 2024-09-17T02:55:08.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.774+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb580b47f0 con 0x7fdb5815bd20 2024-09-17T02:55:08.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.775+0000 7fdb54ff9640 1 -- 172.21.15.104:0/435568411 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb5001a070 con 0x7fdb5815bd20 2024-09-17T02:55:08.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.775+0000 7fdb54ff9640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb38078b90 0x7fdb3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.775+0000 7fdb54ff9640 1 -- 172.21.15.104:0/435568411 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb5009a310 con 0x7fdb5815bd20 2024-09-17T02:55:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.775+0000 7fdb577fe640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb38078b90 0x7fdb3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:08.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.776+0000 7fdb577fe640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb38078b90 0x7fdb3807b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb48033000 tx=0x7fdb48004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:08.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.780+0000 7fdb54ff9640 1 -- 172.21.15.104:0/435568411 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdb50062750 con 0x7fdb5815bd20 2024-09-17T02:55:08.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.953+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdb58070810 con 0x7fdb5815bd20 2024-09-17T02:55:08.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.956+0000 7fdb54ff9640 1 -- 172.21.15.104:0/435568411 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7fdb50062050 con 0x7fdb5815bd20 2024-09-17T02:55:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb38078b90 msgr2=0x7fdb3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb38078b90 0x7fdb3807b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdb48033000 tx=0x7fdb48004730 comp rx=0 tx=0).stop 2024-09-17T02:55:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 msgr2=0x7fdb580cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:08.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 0x7fdb580cd960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000c6f0 tx=0x7fdb5000cbb0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 shutdown_connections 2024-09-17T02:55:08.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb38078b90 0x7fdb3807b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb5815bd20 0x7fdb580cd960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb580734f0 0x7fdb580afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 --2- 172.21.15.104:0/435568411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb5806f550 0x7fdb581e86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:08.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 >> 172.21.15.104:0/435568411 conn(0x7fdb5806d200 msgr2=0x7fdb5806ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:08.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 shutdown_connections 2024-09-17T02:55:08.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:08.959+0000 7fdb5e007640 1 -- 172.21.15.104:0/435568411 wait complete. 2024-09-17T02:55:08.969 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:55:08.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:55:09.015 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:55:09.069 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:55:09.069 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:09.069 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:09.086 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:09.086 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:09.143 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:09.144 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:09.199 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:55:09.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 -- 172.21.15.104:0/3992739246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 msgr2=0x7f60b80b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:09.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 --2- 172.21.15.104:0/3992739246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 0x7f60b80b7c80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f60b80d2500 tx=0x7f60a802a4d0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 -- 172.21.15.104:0/3992739246 shutdown_connections 2024-09-17T02:55:09.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 --2- 172.21.15.104:0/3992739246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60b80d13e0 0x7f60b8161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 --2- 172.21.15.104:0/3992739246 >> v2:172.21.15.192:3300/0 conn(0x7f60b80d0fd0 0x7f60b8160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 --2- 172.21.15.104:0/3992739246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 0x7f60b80b7c80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 -- 172.21.15.104:0/3992739246 >> 172.21.15.104:0/3992739246 conn(0x7f60b80d2970 msgr2=0x7f60b80d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:09.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 -- 172.21.15.104:0/3992739246 shutdown_connections 2024-09-17T02:55:09.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.353+0000 7f60bdca9640 1 -- 172.21.15.104:0/3992739246 wait complete. 2024-09-17T02:55:09.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.355+0000 7f60bdca9640 1 Processor -- start 2024-09-17T02:55:09.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.355+0000 7f60bdca9640 1 -- start start 2024-09-17T02:55:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60bdca9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60b80d0fd0 0x7f60b81f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60bdca9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b80d13e0 0x7f60b815a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60bdca9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 0x7f60b81f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:09.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60bdca9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f60b80b2270 con 0x7f60b80d3490 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60bdca9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60b80b20f0 con 0x7f60b80d13e0 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60bdca9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f60b80b23f0 con 0x7f60b80d0fd0 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 0x7f60b81f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 0x7f60b81f7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37648/0 (socket says 172.21.15.104:37648) 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.356+0000 7f60b7fff640 1 -- 172.21.15.104:0/172881458 learned_addr learned my addr 172.21.15.104:0/172881458 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b77fe640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60b80d0fd0 0x7f60b81f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60affff640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b80d13e0 0x7f60b815a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b7fff640 1 -- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60b80d0fd0 msgr2=0x7f60b81f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:09.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b7fff640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60b80d0fd0 0x7f60b81f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b7fff640 1 -- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b80d13e0 msgr2=0x7f60b815a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:09.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b7fff640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b80d13e0 0x7f60b815a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b7fff640 1 -- 172.21.15.104:0/172881458 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b815acc0 con 0x7f60b80d3490 2024-09-17T02:55:09.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b7fff640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 0x7f60b81f7eb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f60b000cab0 tx=0x7f60b000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:09.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b4ff9640 1 -- 172.21.15.104:0/172881458 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0007d90 con 0x7f60b80d3490 2024-09-17T02:55:09.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b4ff9640 1 -- 172.21.15.104:0/172881458 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60b000f540 con 0x7f60b80d3490 2024-09-17T02:55:09.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b8160970 con 0x7f60b80d3490 2024-09-17T02:55:09.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60b4ff9640 1 -- 172.21.15.104:0/172881458 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b000f990 con 0x7f60b80d3490 2024-09-17T02:55:09.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.357+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b8160f30 con 0x7f60b80d3490 2024-09-17T02:55:09.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.358+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b80b79f0 con 0x7f60b80d3490 2024-09-17T02:55:09.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.359+0000 7f60b4ff9640 1 -- 172.21.15.104:0/172881458 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60b000fb30 con 0x7f60b80d3490 2024-09-17T02:55:09.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.360+0000 7f60b4ff9640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6098078bc0 0x7f609807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:09.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.360+0000 7f60b4ff9640 1 -- 172.21.15.104:0/172881458 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f60b009b6f0 con 0x7f60b80d3490 2024-09-17T02:55:09.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.360+0000 7f60b77fe640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6098078bc0 0x7f609807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:09.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.361+0000 7f60b77fe640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6098078bc0 0x7f609807b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f60a8033000 tx=0x7f60a8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:09.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.364+0000 7f60b4ff9640 1 -- 172.21.15.104:0/172881458 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f60b80b79f0 con 0x7f60b80d3490 2024-09-17T02:55:09.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.548+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60b80b1d40 con 0x7f60b80d3490 2024-09-17T02:55:09.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.548+0000 7f60b4ff9640 1 -- 172.21.15.104:0/172881458 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f60b80b1d40 con 0x7f60b80d3490 2024-09-17T02:55:09.548 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:55:09.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6098078bc0 msgr2=0x7f609807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:09.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6098078bc0 0x7f609807b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f60a8033000 tx=0x7f60a8004730 comp rx=0 tx=0).stop 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 msgr2=0x7f60b81f7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 0x7f60b81f7eb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f60b000cab0 tx=0x7f60b000cf70 comp rx=0 tx=0).stop 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 shutdown_connections 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6098078bc0 0x7f609807b0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b80d13e0 0x7f60b815a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60b80d3490 0x7f60b81f7eb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 --2- 172.21.15.104:0/172881458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60b80d0fd0 0x7f60b81f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 >> 172.21.15.104:0/172881458 conn(0x7f60b80d2970 msgr2=0x7f60b8070740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 shutdown_connections 2024-09-17T02:55:09.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.551+0000 7f60bdca9640 1 -- 172.21.15.104:0/172881458 wait complete. 2024-09-17T02:55:09.565 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T02:55:09.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:09.565 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T02:55:09.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:55:09.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:09.591 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T02:55:09.665 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:09.665 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:09.685 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:09.685 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:09.743 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:09.744 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:09.802 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:55:09.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.915+0000 7f3314f2b640 1 -- 172.21.15.104:0/3705624970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3310073370 msgr2=0x7f33100b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.915+0000 7f3314f2b640 1 --2- 172.21.15.104:0/3705624970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3310073370 0x7f33100b3750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3308005fd0 tx=0x7f330802a540 comp rx=0 tx=0).stop 2024-09-17T02:55:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.915+0000 7f3314f2b640 1 -- 172.21.15.104:0/3705624970 shutdown_connections 2024-09-17T02:55:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.915+0000 7f3314f2b640 1 --2- 172.21.15.104:0/3705624970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3310073370 0x7f33100b3750 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.915+0000 7f3314f2b640 1 --2- 172.21.15.104:0/3705624970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f331006f840 0x7f3310072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.915+0000 7f3314f2b640 1 -- 172.21.15.104:0/3705624970 >> 172.21.15.104:0/3705624970 conn(0x7f33100b2450 msgr2=0x7f33100b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.915+0000 7f3314f2b640 1 -- 172.21.15.104:0/3705624970 shutdown_connections 2024-09-17T02:55:09.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.915+0000 7f3314f2b640 1 -- 172.21.15.104:0/3705624970 wait complete. 2024-09-17T02:55:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.917+0000 7f3314f2b640 1 Processor -- start 2024-09-17T02:55:09.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.917+0000 7f3314f2b640 1 -- start start 2024-09-17T02:55:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f3314f2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f331006f840 0x7f33101470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:09.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f3314f2b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3310073370 0x7f33100c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f3314f2b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33100cff70 0x7f331015d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f3314f2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f331006fdd0 con 0x7f331006f840 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f3314f2b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f331006fc50 con 0x7f3310073370 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f3314f2b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f33100b3c90 con 0x7f33100cff70 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f330e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f331006f840 0x7f33101470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f330e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f331006f840 0x7f33101470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37668/0 (socket says 172.21.15.104:37668) 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.918+0000 7f330e59c640 1 -- 172.21.15.104:0/2413759536 learned_addr learned my addr 172.21.15.104:0/2413759536 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330ed9d640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33100cff70 0x7f331015d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330dd9b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3310073370 0x7f33100c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330e59c640 1 -- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33100cff70 msgr2=0x7f331015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330e59c640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33100cff70 0x7f331015d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330e59c640 1 -- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3310073370 msgr2=0x7f33100c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330e59c640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3310073370 0x7f33100c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330e59c640 1 -- 172.21.15.104:0/2413759536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33101e6da0 con 0x7f331006f840 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330ed9d640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33100cff70 0x7f331015d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330dd9b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3310073370 0x7f33100c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f330e59c640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f331006f840 0x7f33101470f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f330000c7a0 tx=0x7f330000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f3306ffd640 1 -- 172.21.15.104:0/2413759536 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300017070 con 0x7f331006f840 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f3306ffd640 1 -- 172.21.15.104:0/2413759536 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3300005070 con 0x7f331006f840 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33101e7080 con 0x7f331006f840 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f3306ffd640 1 -- 172.21.15.104:0/2413759536 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33000054a0 con 0x7f331006f840 2024-09-17T02:55:09.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.919+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33101e7640 con 0x7f331006f840 2024-09-17T02:55:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.920+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33100b48a0 con 0x7f331006f840 2024-09-17T02:55:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.921+0000 7f3306ffd640 1 -- 172.21.15.104:0/2413759536 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f330001a070 con 0x7f331006f840 2024-09-17T02:55:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.921+0000 7f3306ffd640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f32f0078b90 0x7f32f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.921+0000 7f3306ffd640 1 -- 172.21.15.104:0/2413759536 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f330009a440 con 0x7f331006f840 2024-09-17T02:55:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.921+0000 7f330dd9b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f32f0078b90 0x7f32f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:09.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.922+0000 7f330dd9b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f32f0078b90 0x7f32f007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33101f6c30 tx=0x7f32f8005df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:09.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:09.926+0000 7f3306ffd640 1 -- 172.21.15.104:0/2413759536 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3300062880 con 0x7f331006f840 2024-09-17T02:55:10.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.108+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f33100b2fe0 con 0x7f331006f840 2024-09-17T02:55:10.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.108+0000 7f3306ffd640 1 -- 172.21.15.104:0/2413759536 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f3300062180 con 0x7f331006f840 2024-09-17T02:55:10.108 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:55:10.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f32f0078b90 msgr2=0x7f32f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:10.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f32f0078b90 0x7f32f007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33101f6c30 tx=0x7f32f8005df0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f331006f840 msgr2=0x7f33101470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:10.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f331006f840 0x7f33101470f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f330000c7a0 tx=0x7f330000cc60 comp rx=0 tx=0).stop 2024-09-17T02:55:10.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 shutdown_connections 2024-09-17T02:55:10.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f32f0078b90 0x7f32f007b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3310073370 0x7f33100c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f33100cff70 0x7f331015d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 --2- 172.21.15.104:0/2413759536 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f331006f840 0x7f33101470f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 >> 172.21.15.104:0/2413759536 conn(0x7f33100b2450 msgr2=0x7f331015a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:10.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 shutdown_connections 2024-09-17T02:55:10.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.110+0000 7f3314f2b640 1 -- 172.21.15.104:0/2413759536 wait complete. 2024-09-17T02:55:10.121 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T02:55:10.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:10.121 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T02:55:10.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:55:10.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:10.153 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T02:55:10.217 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:10.218 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:10.233 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:10.233 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:10.289 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:10.289 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:10.345 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3675372395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815f1f0 msgr2=0x7f1c2815f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3675372395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815f1f0 0x7f1c2815f600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1c2806dd60 tx=0x7f1c1c02a4d0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3675372395 shutdown_connections 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3675372395 >> v2:172.21.15.192:3300/0 conn(0x7f1c2815fb40 0x7f1c28162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3675372395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815f1f0 0x7f1c2815f600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3675372395 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c280b65e0 0x7f1c280b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3675372395 >> 172.21.15.104:0/3675372395 conn(0x7f1c28069120 msgr2=0x7f1c28069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3675372395 shutdown_connections 2024-09-17T02:55:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.498+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3675372395 wait complete. 2024-09-17T02:55:10.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.500+0000 7f1c2d2f2640 1 Processor -- start 2024-09-17T02:55:10.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.500+0000 7f1c2d2f2640 1 -- start start 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c2d2f2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c280b65e0 0x7f1c280cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c2d2f2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815f1f0 0x7f1c280ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c2d2f2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815fb40 0x7f1c2814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c2d2f2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1c28163650 con 0x7f1c2815fb40 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c2d2f2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1c281634d0 con 0x7f1c2815f1f0 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c2d2f2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1c281637d0 con 0x7f1c280b65e0 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c277fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815fb40 0x7f1c2814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c277fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815fb40 0x7f1c2814f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37694/0 (socket says 172.21.15.104:37694) 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.501+0000 7f1c277fe640 1 -- 172.21.15.104:0/3188279604 learned_addr learned my addr 172.21.15.104:0/3188279604 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:10.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c267fc640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815f1f0 0x7f1c280ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c26ffd640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c280b65e0 0x7f1c280cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c277fe640 1 -- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c280b65e0 msgr2=0x7f1c280cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c277fe640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c280b65e0 0x7f1c280cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c277fe640 1 -- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815f1f0 msgr2=0x7f1c280ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c277fe640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815f1f0 0x7f1c280ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c277fe640 1 -- 172.21.15.104:0/3188279604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c280ceb00 con 0x7f1c2815fb40 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c277fe640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815fb40 0x7f1c2814f830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000c7c0 tx=0x7f1c2000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c0f7fe640 1 -- 172.21.15.104:0/3188279604 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20004230 con 0x7f1c2815fb40 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c0f7fe640 1 -- 172.21.15.104:0/3188279604 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c200079b0 con 0x7f1c2815fb40 2024-09-17T02:55:10.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c28150690 con 0x7f1c2815fb40 2024-09-17T02:55:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c0f7fe640 1 -- 172.21.15.104:0/3188279604 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20007e40 con 0x7f1c2815fb40 2024-09-17T02:55:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.502+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c280ce1d0 con 0x7f1c2815fb40 2024-09-17T02:55:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.503+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c280cdc50 con 0x7f1c2815fb40 2024-09-17T02:55:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.504+0000 7f1c0f7fe640 1 -- 172.21.15.104:0/3188279604 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c200035f0 con 0x7f1c2815fb40 2024-09-17T02:55:10.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.504+0000 7f1c0f7fe640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c14078bc0 0x7f1c1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.504+0000 7f1c0f7fe640 1 -- 172.21.15.104:0/3188279604 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1c2009b120 con 0x7f1c2815fb40 2024-09-17T02:55:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.505+0000 7f1c26ffd640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c14078bc0 0x7f1c1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:10.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.505+0000 7f1c26ffd640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c14078bc0 0x7f1c1407b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c18005fd0 tx=0x7f1c1800a4d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:10.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.509+0000 7f1c0f7fe640 1 -- 172.21.15.104:0/3188279604 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c280cdc50 con 0x7f1c2815fb40 2024-09-17T02:55:10.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.694+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1c2815f600 con 0x7f1c2815fb40 2024-09-17T02:55:10.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.694+0000 7f1c0f7fe640 1 -- 172.21.15.104:0/3188279604 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f1c28150690 con 0x7f1c2815fb40 2024-09-17T02:55:10.694 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c14078bc0 msgr2=0x7f1c1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c14078bc0 0x7f1c1407b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1c18005fd0 tx=0x7f1c1800a4d0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815fb40 msgr2=0x7f1c2814f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815fb40 0x7f1c2814f830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000c7c0 tx=0x7f1c2000cc80 comp rx=0 tx=0).stop 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 shutdown_connections 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c14078bc0 0x7f1c1407b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815f1f0 0x7f1c280ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2815fb40 0x7f1c2814f830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 --2- 172.21.15.104:0/3188279604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c280b65e0 0x7f1c280cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 >> 172.21.15.104:0/3188279604 conn(0x7f1c28069120 msgr2=0x7f1c28161310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 shutdown_connections 2024-09-17T02:55:10.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:10.697+0000 7f1c2d2f2640 1 -- 172.21.15.104:0/3188279604 wait complete. 2024-09-17T02:55:10.707 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T02:55:10.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:10.708 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T02:55:10.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:55:10.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:10.734 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T02:55:10.789 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:10.792 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:10.813 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:10.813 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:10.871 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:10.871 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:10.928 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:55:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.042+0000 7faaf1063640 1 -- 172.21.15.104:0/2957997849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 msgr2=0x7faaec0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.042+0000 7faaf1063640 1 --2- 172.21.15.104:0/2957997849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 0x7faaec0b39c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faaec0cf770 tx=0x7faadc02a510 comp rx=0 tx=0).stop 2024-09-17T02:55:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.042+0000 7faaf1063640 1 -- 172.21.15.104:0/2957997849 shutdown_connections 2024-09-17T02:55:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.042+0000 7faaf1063640 1 --2- 172.21.15.104:0/2957997849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 0x7faaec0b39c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.042+0000 7faaf1063640 1 -- 172.21.15.104:0/2957997849 >> 172.21.15.104:0/2957997849 conn(0x7faaec0b44a0 msgr2=0x7faaec0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.042+0000 7faaf1063640 1 -- 172.21.15.104:0/2957997849 shutdown_connections 2024-09-17T02:55:11.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.042+0000 7faaf1063640 1 -- 172.21.15.104:0/2957997849 wait complete. 2024-09-17T02:55:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.044+0000 7faaf1063640 1 Processor -- start 2024-09-17T02:55:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.044+0000 7faaf1063640 1 -- start start 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faaf1063640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaec0b3f00 0x7faaec0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faaf1063640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 0x7faaec1f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faaf1063640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec0cdf10 0x7faaec157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faaf1063640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faaec168390 con 0x7faaec0b4fc0 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faaf1063640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faaec168210 con 0x7faaec0cdf10 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faaf1063640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faaec168510 con 0x7faaec0b3f00 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faae259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 0x7faaec1f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faae259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 0x7faaec1f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37716/0 (socket says 172.21.15.104:37716) 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faae259c640 1 -- 172.21.15.104:0/2773175183 learned_addr learned my addr 172.21.15.104:0/2773175183 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:11.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faaeb59e640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec0cdf10 0x7faaec157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.045+0000 7faaead9d640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaec0b3f00 0x7faaec0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae259c640 1 -- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaec0b3f00 msgr2=0x7faaec0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae259c640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaec0b3f00 0x7faaec0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae259c640 1 -- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec0cdf10 msgr2=0x7faaec157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae259c640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec0cdf10 0x7faaec157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae259c640 1 -- 172.21.15.104:0/2773175183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec1f49c0 con 0x7faaec0b4fc0 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae259c640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 0x7faaec1f3f00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faad400b3f0 tx=0x7faad400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae3fff640 1 -- 172.21.15.104:0/2773175183 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4015020 con 0x7faaec0b4fc0 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae3fff640 1 -- 172.21.15.104:0/2773175183 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faad4011920 con 0x7faaec0b4fc0 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faae3fff640 1 -- 172.21.15.104:0/2773175183 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4011d70 con 0x7faaec0b4fc0 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec1f4ca0 con 0x7faaec0b4fc0 2024-09-17T02:55:11.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.046+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec0c9e10 con 0x7faaec0b4fc0 2024-09-17T02:55:11.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.047+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec1f4730 con 0x7faaec0b4fc0 2024-09-17T02:55:11.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.048+0000 7faae3fff640 1 -- 172.21.15.104:0/2773175183 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faad4018020 con 0x7faaec0b4fc0 2024-09-17T02:55:11.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.048+0000 7faae3fff640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faacc078b90 0x7faacc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.048+0000 7faae3fff640 1 -- 172.21.15.104:0/2773175183 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faad409a7b0 con 0x7faaec0b4fc0 2024-09-17T02:55:11.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.048+0000 7faaead9d640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faacc078b90 0x7faacc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.049+0000 7faaead9d640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faacc078b90 0x7faacc07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faadc034000 tx=0x7faadc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:11.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.053+0000 7faae3fff640 1 -- 172.21.15.104:0/2773175183 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faad401f030 con 0x7faaec0b4fc0 2024-09-17T02:55:11.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.238+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faaec0b39c0 con 0x7faaec0b4fc0 2024-09-17T02:55:11.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.238+0000 7faae3fff640 1 -- 172.21.15.104:0/2773175183 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7faad4062630 con 0x7faaec0b4fc0 2024-09-17T02:55:11.238 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:55:11.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faacc078b90 msgr2=0x7faacc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faacc078b90 0x7faacc07b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faadc034000 tx=0x7faadc004730 comp rx=0 tx=0).stop 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 msgr2=0x7faaec1f3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 0x7faaec1f3f00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faad400b3f0 tx=0x7faad400b8b0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 shutdown_connections 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faacc078b90 0x7faacc07b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec0cdf10 0x7faaec157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faaec0b4fc0 0x7faaec1f3f00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 --2- 172.21.15.104:0/2773175183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faaec0b3f00 0x7faaec0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 >> 172.21.15.104:0/2773175183 conn(0x7faaec0b44a0 msgr2=0x7faaec072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 shutdown_connections 2024-09-17T02:55:11.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.241+0000 7faaf1063640 1 -- 172.21.15.104:0/2773175183 wait complete. 2024-09-17T02:55:11.251 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T02:55:11.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:11.251 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T02:55:11.283 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:55:11.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:11.283 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T02:55:11.341 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T02:55:11.341 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:11.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.454+0000 7f7d00982640 1 -- 172.21.15.104:0/2956448017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0cfa80 msgr2=0x7f7cfc0cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.454+0000 7f7d00982640 1 --2- 172.21.15.104:0/2956448017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0cfa80 0x7f7cfc0cfe90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0cf770 tx=0x7f7cf402a510 comp rx=0 tx=0).stop 2024-09-17T02:55:11.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.454+0000 7f7d00982640 1 -- 172.21.15.104:0/2956448017 shutdown_connections 2024-09-17T02:55:11.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.454+0000 7f7d00982640 1 --2- 172.21.15.104:0/2956448017 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0cfa80 0x7f7cfc0cfe90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.454+0000 7f7d00982640 1 -- 172.21.15.104:0/2956448017 >> 172.21.15.104:0/2956448017 conn(0x7f7cfc0b44a0 msgr2=0x7f7cfc0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:11.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.454+0000 7f7d00982640 1 -- 172.21.15.104:0/2956448017 shutdown_connections 2024-09-17T02:55:11.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.454+0000 7f7d00982640 1 -- 172.21.15.104:0/2956448017 wait complete. 2024-09-17T02:55:11.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.456+0000 7f7d00982640 1 Processor -- start 2024-09-17T02:55:11.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.456+0000 7f7d00982640 1 -- start start 2024-09-17T02:55:11.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.457+0000 7f7d00982640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0b4fc0 0x7f7cfc0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.457+0000 7f7d00982640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cfc0cdf10 0x7f7cfc1664f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.457+0000 7f7d00982640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cfc0cfa80 0x7f7cfc15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.457+0000 7f7d00982640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc168210 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.457+0000 7f7d00982640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc0b6080 con 0x7f7cfc0cdf10 2024-09-17T02:55:11.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.457+0000 7f7d00982640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7cfc168390 con 0x7f7cfc0cfa80 2024-09-17T02:55:11.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.457+0000 7f7cfa59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0b4fc0 0x7f7cfc0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfa59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0b4fc0 0x7f7cfc0c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37720/0 (socket says 172.21.15.104:37720) 2024-09-17T02:55:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfa59c640 1 -- 172.21.15.104:0/3389303324 learned_addr learned my addr 172.21.15.104:0/3389303324 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cf9d9b640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cfc0cdf10 0x7f7cfc1664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfad9d640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cfc0cfa80 0x7f7cfc15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfa59c640 1 -- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cfc0cfa80 msgr2=0x7f7cfc15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfa59c640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cfc0cfa80 0x7f7cfc15fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfa59c640 1 -- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cfc0cdf10 msgr2=0x7f7cfc1664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfa59c640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cfc0cdf10 0x7f7cfc1664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfa59c640 1 -- 172.21.15.104:0/3389303324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc06e430 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cf9d9b640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cfc0cdf10 0x7f7cfc1664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:11.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7cfa59c640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0b4fc0 0x7f7cfc0c8df0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00ba80 tx=0x7f7cec00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:11.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7ceaffd640 1 -- 172.21.15.104:0/3389303324 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00cba0 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7ceaffd640 1 -- 172.21.15.104:0/3389303324 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cec00ce30 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cfc06d0c0 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7ceaffd640 1 -- 172.21.15.104:0/3389303324 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec003bd0 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.458+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cfc06d680 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.459+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cfc0cfe90 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.460+0000 7f7ceaffd640 1 -- 172.21.15.104:0/3389303324 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7cec014440 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.461+0000 7f7ceaffd640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7cdc078b90 0x7f7cdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.461+0000 7f7ceaffd640 1 -- 172.21.15.104:0/3389303324 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7cec09abe0 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.461+0000 7f7cf9d9b640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7cdc078b90 0x7f7cdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.461+0000 7f7cf9d9b640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7cdc078b90 0x7f7cdc07b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc06e130 tx=0x7f7cf0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:11.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.465+0000 7f7ceaffd640 1 -- 172.21.15.104:0/3389303324 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7cec063020 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.676+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cfc0cead0 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.676+0000 7f7ceaffd640 1 -- 172.21.15.104:0/3389303324 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5229 (secure 0 0 0) 0x7f7cec062920 con 0x7f7cfc0b4fc0 2024-09-17T02:55:11.676 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:11.676 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:54:41.483636+0000","modified":"2024-09-17T02:54:44.441267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-17T02:55:11.677 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7cdc078b90 msgr2=0x7f7cdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7cdc078b90 0x7f7cdc07b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc06e130 tx=0x7f7cf0009040 comp rx=0 tx=0).stop 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0b4fc0 msgr2=0x7f7cfc0c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0b4fc0 0x7f7cfc0c8df0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00ba80 tx=0x7f7cec00bf40 comp rx=0 tx=0).stop 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 shutdown_connections 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7cdc078b90 0x7f7cdc07b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cfc0cdf10 0x7f7cfc1664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cfc0cfa80 0x7f7cfc15fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 --2- 172.21.15.104:0/3389303324 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cfc0b4fc0 0x7f7cfc0c8df0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 >> 172.21.15.104:0/3389303324 conn(0x7f7cfc0b44a0 msgr2=0x7f7cfc0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:11.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 shutdown_connections 2024-09-17T02:55:11.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.679+0000 7f7d00982640 1 -- 172.21.15.104:0/3389303324 wait complete. 2024-09-17T02:55:11.689 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:11.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.801+0000 7fdc50f6e640 1 -- 172.21.15.104:0/835330896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b4fc0 msgr2=0x7fdc4c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.801+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/835330896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b4fc0 0x7fdc4c0b39c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c009830 tx=0x7fdc3c02a510 comp rx=0 tx=0).stop 2024-09-17T02:55:11.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.801+0000 7fdc50f6e640 1 -- 172.21.15.104:0/835330896 shutdown_connections 2024-09-17T02:55:11.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.801+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/835330896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc4c0b3f00 0x7fdc4c0b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.801+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/835330896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b4fc0 0x7fdc4c0b39c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.801+0000 7fdc50f6e640 1 -- 172.21.15.104:0/835330896 >> 172.21.15.104:0/835330896 conn(0x7fdc4c0b44a0 msgr2=0x7fdc4c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:11.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.801+0000 7fdc50f6e640 1 -- 172.21.15.104:0/835330896 shutdown_connections 2024-09-17T02:55:11.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.801+0000 7fdc50f6e640 1 -- 172.21.15.104:0/835330896 wait complete. 2024-09-17T02:55:11.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.803+0000 7fdc50f6e640 1 Processor -- start 2024-09-17T02:55:11.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.803+0000 7fdc50f6e640 1 -- start start 2024-09-17T02:55:11.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc50f6e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc4c0b3f00 0x7fdc4c156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc50f6e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc4c0b4fc0 0x7fdc4c0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc50f6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b5d20 0x7fdc4c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc50f6e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c160f50 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc50f6e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c0ce160 con 0x7fdc4c0b4fc0 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc50f6e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c1610d0 con 0x7fdc4c0b3f00 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b5d20 0x7fdc4c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b5d20 0x7fdc4c0b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37730/0 (socket says 172.21.15.104:37730) 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 -- 172.21.15.104:0/3696716070 learned_addr learned my addr 172.21.15.104:0/3696716070 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 -- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc4c0b3f00 msgr2=0x7fdc4c156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc4c0b3f00 0x7fdc4c156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 -- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc4c0b4fc0 msgr2=0x7fdc4c0b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc49d9b640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc4c0b4fc0 0x7fdc4c0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc4c0b4fc0 0x7fdc4c0b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 -- 172.21.15.104:0/3696716070 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c0b1030 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc4ad9d640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b5d20 0x7fdc4c0b1ff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400caa0 tx=0x7fdc4400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc3affd640 1 -- 172.21.15.104:0/3696716070 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44016020 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc3affd640 1 -- 172.21.15.104:0/3696716070 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc4400ac30 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4c157b40 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc3affd640 1 -- 172.21.15.104:0/3696716070 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44012680 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.805+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4c158100 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.807+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4c0b57e0 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.807+0000 7fdc3affd640 1 -- 172.21.15.104:0/3696716070 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc44019020 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.808+0000 7fdc3affd640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc2c078b90 0x7fdc2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:11.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.808+0000 7fdc3affd640 1 -- 172.21.15.104:0/3696716070 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdc4409b2e0 con 0x7fdc4c0b5d20 2024-09-17T02:55:11.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.808+0000 7fdc4a59c640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc2c078b90 0x7fdc2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:11.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.809+0000 7fdc4a59c640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc2c078b90 0x7fdc2c07b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c034000 tx=0x7fdc3c0046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:11.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:11.812+0000 7fdc3affd640 1 -- 172.21.15.104:0/3696716070 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdc44020020 con 0x7fdc4c0b5d20 2024-09-17T02:55:12.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.020+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc4c0cd6a0 con 0x7fdc4c0b5d20 2024-09-17T02:55:12.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.021+0000 7fdc3affd640 1 -- 172.21.15.104:0/3696716070 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5229 (secure 0 0 0) 0x7fdc4400ae20 con 0x7fdc4c0b5d20 2024-09-17T02:55:12.021 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:12.021 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:54:41.483636+0000","modified":"2024-09-17T02:54:44.441267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-17T02:55:12.021 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T02:55:12.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc2c078b90 msgr2=0x7fdc2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc2c078b90 0x7fdc2c07b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c034000 tx=0x7fdc3c0046c0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b5d20 msgr2=0x7fdc4c0b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b5d20 0x7fdc4c0b1ff0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400caa0 tx=0x7fdc4400cf60 comp rx=0 tx=0).stop 2024-09-17T02:55:12.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 shutdown_connections 2024-09-17T02:55:12.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc2c078b90 0x7fdc2c07b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc4c0b4fc0 0x7fdc4c0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc4c0b5d20 0x7fdc4c0b1ff0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 --2- 172.21.15.104:0/3696716070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc4c0b3f00 0x7fdc4c156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 >> 172.21.15.104:0/3696716070 conn(0x7fdc4c0b44a0 msgr2=0x7fdc4c0b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:12.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 shutdown_connections 2024-09-17T02:55:12.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.023+0000 7fdc50f6e640 1 -- 172.21.15.104:0/3696716070 wait complete. 2024-09-17T02:55:12.034 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:12.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.147+0000 7f88d6027640 1 -- 172.21.15.104:0/797181514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 msgr2=0x7f88b8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.147+0000 7f88d6027640 1 --2- 172.21.15.104:0/797181514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 0x7f88b8004c10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009b20 tx=0x7f88b8005830 comp rx=0 tx=0).stop 2024-09-17T02:55:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.147+0000 7f88cffff640 1 -- 172.21.15.104:0/797181514 reap_dead start 2024-09-17T02:55:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.147+0000 7f88d6027640 1 -- 172.21.15.104:0/797181514 shutdown_connections 2024-09-17T02:55:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.147+0000 7f88d6027640 1 -- 172.21.15.104:0/797181514 >> 172.21.15.104:0/797181514 conn(0x7f88d00b44a0 msgr2=0x7f88d00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.148+0000 7f88d6027640 1 -- 172.21.15.104:0/797181514 shutdown_connections 2024-09-17T02:55:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.148+0000 7f88d6027640 1 -- 172.21.15.104:0/797181514 wait complete. 2024-09-17T02:55:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.149+0000 7f88d6027640 1 Processor -- start 2024-09-17T02:55:12.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.149+0000 7f88d6027640 1 -- start start 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88d6027640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 0x7f88d01f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88d6027640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d00c9ec0 0x7f88d00b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88d6027640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d00ca2d0 0x7f88d00b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88d6027640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f88d00cfe50 con 0x7f88b8004800 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88d6027640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f88d00cfcd0 con 0x7f88d00c9ec0 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88d6027640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f88d00cffd0 con 0x7f88d00ca2d0 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 0x7f88d01f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 0x7f88d01f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37746/0 (socket says 172.21.15.104:37746) 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 -- 172.21.15.104:0/2052710430 learned_addr learned my addr 172.21.15.104:0/2052710430 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88ceffd640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d00c9ec0 0x7f88d00b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cffff640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d00ca2d0 0x7f88d00b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 -- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d00ca2d0 msgr2=0x7f88d00b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d00ca2d0 0x7f88d00b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 -- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d00c9ec0 msgr2=0x7f88d00b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d00c9ec0 0x7f88d00b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 -- 172.21.15.104:0/2052710430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d01f7e70 con 0x7f88b8004800 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88ceffd640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d00c9ec0 0x7f88d00b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88cf7fe640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 0x7f88d01f35b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f88c00066b0 tx=0x7f88c00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88b7fff640 1 -- 172.21.15.104:0/2052710430 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0015070 con 0x7f88b8004800 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88b7fff640 1 -- 172.21.15.104:0/2052710430 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88c0011900 con 0x7f88b8004800 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d00af8b0 con 0x7f88b8004800 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88b7fff640 1 -- 172.21.15.104:0/2052710430 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011d50 con 0x7f88b8004800 2024-09-17T02:55:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.151+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d00ccaf0 con 0x7f88b8004800 2024-09-17T02:55:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.152+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d006a6f0 con 0x7f88b8004800 2024-09-17T02:55:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.153+0000 7f88b7fff640 1 -- 172.21.15.104:0/2052710430 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88c0010420 con 0x7f88b8004800 2024-09-17T02:55:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.154+0000 7f88b7fff640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f88bc078b90 0x7f88bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.154+0000 7f88b7fff640 1 -- 172.21.15.104:0/2052710430 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f88c009b920 con 0x7f88b8004800 2024-09-17T02:55:12.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.154+0000 7f88ceffd640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f88bc078b90 0x7f88bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.155+0000 7f88ceffd640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f88bc078b90 0x7f88bc07b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009b20 tx=0x7f88c402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:12.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.158+0000 7f88b7fff640 1 -- 172.21.15.104:0/2052710430 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88d006a6f0 con 0x7f88b8004800 2024-09-17T02:55:12.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.334+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88d00b57e0 con 0x7f88b8004800 2024-09-17T02:55:12.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.335+0000 7f88b7fff640 1 -- 172.21.15.104:0/2052710430 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7f88c0063f40 con 0x7f88b8004800 2024-09-17T02:55:12.334 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:12.335 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:43.133211+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f88bc078b90 msgr2=0x7f88bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f88bc078b90 0x7f88bc07b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009b20 tx=0x7f88c402d040 comp rx=0 tx=0).stop 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 msgr2=0x7f88d01f35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 0x7f88d01f35b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f88c00066b0 tx=0x7f88c00039c0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 shutdown_connections 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f88bc078b90 0x7f88bc07b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88d00c9ec0 0x7f88d00b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88d00ca2d0 0x7f88d00b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 --2- 172.21.15.104:0/2052710430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b8004800 0x7f88d01f35b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 >> 172.21.15.104:0/2052710430 conn(0x7f88d00b44a0 msgr2=0x7f88d00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:12.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 shutdown_connections 2024-09-17T02:55:12.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.337+0000 7f88d6027640 1 -- 172.21.15.104:0/2052710430 wait complete. 2024-09-17T02:55:12.348 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T02:55:12.348 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:12.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.460+0000 7ff500ed5640 1 -- 172.21.15.104:0/3770923429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc0734f0 msgr2=0x7ff4fc073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.460+0000 7ff500ed5640 1 --2- 172.21.15.104:0/3770923429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc0734f0 0x7ff4fc073900 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0d21a0 tx=0x7ff4e402a530 comp rx=0 tx=0).stop 2024-09-17T02:55:12.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.460+0000 7ff500ed5640 1 -- 172.21.15.104:0/3770923429 shutdown_connections 2024-09-17T02:55:12.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.460+0000 7ff500ed5640 1 --2- 172.21.15.104:0/3770923429 >> v2:172.21.15.192:3300/0 conn(0x7ff4fc0b0500 0x7ff4fc0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.460+0000 7ff500ed5640 1 --2- 172.21.15.104:0/3770923429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc0734f0 0x7ff4fc073900 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.460+0000 7ff500ed5640 1 -- 172.21.15.104:0/3770923429 >> 172.21.15.104:0/3770923429 conn(0x7ff4fc06d200 msgr2=0x7ff4fc06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:12.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.460+0000 7ff500ed5640 1 -- 172.21.15.104:0/3770923429 shutdown_connections 2024-09-17T02:55:12.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.460+0000 7ff500ed5640 1 -- 172.21.15.104:0/3770923429 wait complete. 2024-09-17T02:55:12.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.462+0000 7ff500ed5640 1 Processor -- start 2024-09-17T02:55:12.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.462+0000 7ff500ed5640 1 -- start start 2024-09-17T02:55:12.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff500ed5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4fc0734f0 0x7ff4fc157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff500ed5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4fc0b0500 0x7ff4fc1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff500ed5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc15c220 0x7ff4fc1f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff500ed5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b4f20 con 0x7ff4fc15c220 2024-09-17T02:55:12.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff500ed5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b1200 con 0x7ff4fc0734f0 2024-09-17T02:55:12.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff500ed5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b50a0 con 0x7ff4fc0b0500 2024-09-17T02:55:12.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc15c220 0x7ff4fc1f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc15c220 0x7ff4fc1f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37766/0 (socket says 172.21.15.104:37766) 2024-09-17T02:55:12.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 -- 172.21.15.104:0/2594728629 learned_addr learned my addr 172.21.15.104:0/2594728629 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fa59c640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4fc0734f0 0x7ff4fc157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4f1d9b640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4fc0b0500 0x7ff4fc1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 -- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4fc0b0500 msgr2=0x7ff4fc1441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4fc0b0500 0x7ff4fc1441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 -- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4fc0734f0 msgr2=0x7ff4fc157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4fc0734f0 0x7ff4fc157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 -- 172.21.15.104:0/2594728629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc157ab0 con 0x7ff4fc15c220 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4f1d9b640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4fc0b0500 0x7ff4fc1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4fad9d640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc15c220 0x7ff4fc1f2eb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400e990 tx=0x7ff4f400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4f37fe640 1 -- 172.21.15.104:0/2594728629 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4004d20 con 0x7ff4fc15c220 2024-09-17T02:55:12.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4f37fe640 1 -- 172.21.15.104:0/2594728629 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4f400cb00 con 0x7ff4fc15c220 2024-09-17T02:55:12.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4fc1f3c50 con 0x7ff4fc15c220 2024-09-17T02:55:12.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.464+0000 7ff4f37fe640 1 -- 172.21.15.104:0/2594728629 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4005020 con 0x7ff4fc15c220 2024-09-17T02:55:12.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.465+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc156a90 con 0x7ff4fc15c220 2024-09-17T02:55:12.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.465+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4fc073900 con 0x7ff4fc15c220 2024-09-17T02:55:12.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.466+0000 7ff4f37fe640 1 -- 172.21.15.104:0/2594728629 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4f40051c0 con 0x7ff4fc15c220 2024-09-17T02:55:12.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.467+0000 7ff4f37fe640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff4dc078b90 0x7ff4dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.467+0000 7ff4f37fe640 1 -- 172.21.15.104:0/2594728629 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff4f409b700 con 0x7ff4fc15c220 2024-09-17T02:55:12.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.467+0000 7ff4fa59c640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff4dc078b90 0x7ff4dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.468+0000 7ff4fa59c640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff4dc078b90 0x7ff4dc07b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0015e0 tx=0x7ff4ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:12.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.472+0000 7ff4f37fe640 1 -- 172.21.15.104:0/2594728629 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff4f4016030 con 0x7ff4fc15c220 2024-09-17T02:55:12.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.679+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4fc0d23c0 con 0x7ff4fc15c220 2024-09-17T02:55:12.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.680+0000 7ff4f37fe640 1 -- 172.21.15.104:0/2594728629 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5229 (secure 0 0 0) 0x7ff4f4063ac0 con 0x7ff4fc15c220 2024-09-17T02:55:12.679 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:12.679 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:54:41.483636+0000","modified":"2024-09-17T02:54:44.441267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-17T02:55:12.680 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T02:55:12.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff4dc078b90 msgr2=0x7ff4dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff4dc078b90 0x7ff4dc07b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0015e0 tx=0x7ff4ec009040 comp rx=0 tx=0).stop 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc15c220 msgr2=0x7ff4fc1f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc15c220 0x7ff4fc1f2eb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400e990 tx=0x7ff4f400ee50 comp rx=0 tx=0).stop 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 shutdown_connections 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff4dc078b90 0x7ff4dc07b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff4fc15c220 0x7ff4fc1f2eb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4fc0b0500 0x7ff4fc1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 --2- 172.21.15.104:0/2594728629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4fc0734f0 0x7ff4fc157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 >> 172.21.15.104:0/2594728629 conn(0x7ff4fc06d200 msgr2=0x7ff4fc155260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 shutdown_connections 2024-09-17T02:55:12.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.682+0000 7ff500ed5640 1 -- 172.21.15.104:0/2594728629 wait complete. 2024-09-17T02:55:12.693 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:12.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.808+0000 7f42364f9640 1 -- 172.21.15.104:0/4148248381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4218003a00 msgr2=0x7f4218003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.808+0000 7f42364f9640 1 --2- 172.21.15.104:0/4148248381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4218003a00 0x7f4218003e70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f42200099d0 tx=0x7f4218005830 comp rx=0 tx=0).stop 2024-09-17T02:55:12.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.808+0000 7f4234a96640 1 -- 172.21.15.104:0/4148248381 reap_dead start 2024-09-17T02:55:12.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.808+0000 7f42364f9640 1 -- 172.21.15.104:0/4148248381 shutdown_connections 2024-09-17T02:55:12.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.808+0000 7f42364f9640 1 -- 172.21.15.104:0/4148248381 >> 172.21.15.104:0/4148248381 conn(0x7f42300b2450 msgr2=0x7f42300b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:12.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.808+0000 7f42364f9640 1 -- 172.21.15.104:0/4148248381 shutdown_connections 2024-09-17T02:55:12.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.808+0000 7f42364f9640 1 -- 172.21.15.104:0/4148248381 wait complete. 2024-09-17T02:55:12.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.810+0000 7f42364f9640 1 Processor -- start 2024-09-17T02:55:12.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.810+0000 7f42364f9640 1 -- start start 2024-09-17T02:55:12.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f42364f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4218003a00 0x7f42301f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f42364f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42301e5ee0 0x7f42301e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f42364f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4230147480 0x7f4230147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f42364f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f42300d0570 con 0x7f42301e5ee0 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f42364f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f423006fe60 con 0x7f4218003a00 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f42364f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f423006e4d0 con 0x7f4230147480 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f422f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42301e5ee0 0x7f42301e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f422f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42301e5ee0 0x7f42301e62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37782/0 (socket says 172.21.15.104:37782) 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f422f7fe640 1 -- 172.21.15.104:0/817857974 learned_addr learned my addr 172.21.15.104:0/817857974 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:12.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f422ffff640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4218003a00 0x7f42301f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.811+0000 7f4234a96640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4230147480 0x7f4230147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422f7fe640 1 -- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4230147480 msgr2=0x7f4230147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422f7fe640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4230147480 0x7f4230147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422f7fe640 1 -- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4218003a00 msgr2=0x7f42301f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422f7fe640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4218003a00 0x7f42301f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422f7fe640 1 -- 172.21.15.104:0/817857974 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42301f8210 con 0x7f42301e5ee0 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f4234a96640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4230147480 0x7f4230147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422f7fe640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42301e5ee0 0x7f42301e62f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4224006680 tx=0x7f42240066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422cff9640 1 -- 172.21.15.104:0/817857974 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224015070 con 0x7f42301e5ee0 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422cff9640 1 -- 172.21.15.104:0/817857974 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4224011900 con 0x7f42301e5ee0 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42300ceaf0 con 0x7f42301e5ee0 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f422cff9640 1 -- 172.21.15.104:0/817857974 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224011d50 con 0x7f42301e5ee0 2024-09-17T02:55:12.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.812+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42300cf0b0 con 0x7f42301e5ee0 2024-09-17T02:55:12.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.813+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423015c300 con 0x7f42301e5ee0 2024-09-17T02:55:12.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.814+0000 7f422cff9640 1 -- 172.21.15.104:0/817857974 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42240103c0 con 0x7f42301e5ee0 2024-09-17T02:55:12.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.814+0000 7f422cff9640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f421c078bc0 0x7f421c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:12.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.814+0000 7f422cff9640 1 -- 172.21.15.104:0/817857974 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f422409b980 con 0x7f42301e5ee0 2024-09-17T02:55:12.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.814+0000 7f422ffff640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f421c078bc0 0x7f421c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:12.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.815+0000 7f422ffff640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f421c078bc0 0x7f421c07b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4220034000 tx=0x7f4220004840 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:12.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:12.818+0000 7f422cff9640 1 -- 172.21.15.104:0/817857974 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f423015c300 con 0x7f42301e5ee0 2024-09-17T02:55:13.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.026+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f423006e9f0 con 0x7f42301e5ee0 2024-09-17T02:55:13.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.027+0000 7f422cff9640 1 -- 172.21.15.104:0/817857974 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5229 (secure 0 0 0) 0x7f4224063770 con 0x7f42301e5ee0 2024-09-17T02:55:13.026 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:13.026 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":7,"btime":"2024-09-17T02:54:45:142990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4371,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2231373006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2231373006},{"type":"v1","addr":"172.21.15.104:6834","nonce":2231373006}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1400452781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1400452781},{"type":"v1","addr":"172.21.15.104:6835","nonce":1400452781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/4236093768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4236093768},{"type":"v1","addr":"172.21.15.192:6835","nonce":4236093768}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:54:41.483636+0000","modified":"2024-09-17T02:54:44.441267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3427020087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3427020087},{"type":"v1","addr":"172.21.15.192:6837","nonce":3427020087}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4378,"qdb_cluster":[4378]},"id":1}]} 2024-09-17T02:55:13.027 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 7 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f421c078bc0 msgr2=0x7f421c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f421c078bc0 0x7f421c07b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4220034000 tx=0x7f4220004840 comp rx=0 tx=0).stop 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42301e5ee0 msgr2=0x7f42301e62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42301e5ee0 0x7f42301e62f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4224006680 tx=0x7f42240066b0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 shutdown_connections 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f421c078bc0 0x7f421c07b0d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4230147480 0x7f4230147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42301e5ee0 0x7f42301e62f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 --2- 172.21.15.104:0/817857974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4218003a00 0x7f42301f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 >> 172.21.15.104:0/817857974 conn(0x7f42300b2450 msgr2=0x7f42300b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 shutdown_connections 2024-09-17T02:55:13.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.029+0000 7f42364f9640 1 -- 172.21.15.104:0/817857974 wait complete. 2024-09-17T02:55:13.040 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:13.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.154+0000 7fe71db19640 1 -- 172.21.15.104:0/3744263132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe704004000 msgr2=0x7fe704004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.154+0000 7fe71db19640 1 --2- 172.21.15.104:0/3744263132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe704004000 0x7fe704004800 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe700001690 tx=0x7fe704005830 comp rx=0 tx=0).stop 2024-09-17T02:55:13.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.154+0000 7fe717fff640 1 -- 172.21.15.104:0/3744263132 reap_dead start 2024-09-17T02:55:13.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.154+0000 7fe71db19640 1 -- 172.21.15.104:0/3744263132 shutdown_connections 2024-09-17T02:55:13.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.154+0000 7fe71db19640 1 -- 172.21.15.104:0/3744263132 >> 172.21.15.104:0/3744263132 conn(0x7fe718069120 msgr2=0x7fe718069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:13.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.154+0000 7fe71db19640 1 -- 172.21.15.104:0/3744263132 shutdown_connections 2024-09-17T02:55:13.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.154+0000 7fe71db19640 1 -- 172.21.15.104:0/3744263132 wait complete. 2024-09-17T02:55:13.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.155+0000 7fe71db19640 1 Processor -- start 2024-09-17T02:55:13.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.156+0000 7fe71db19640 1 -- start start 2024-09-17T02:55:13.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe71db19640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe704004000 0x7fe7181596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe71db19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7181538c0 0x7fe718156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe71db19640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe718156b60 0x7fe718159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe71db19640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe718161a90 con 0x7fe7181538c0 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe71db19640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe7180b6d10 con 0x7fe704004000 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe71db19640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe718161c10 con 0x7fe718156b60 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe70effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7181538c0 0x7fe718156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe70effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7181538c0 0x7fe718156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37802/0 (socket says 172.21.15.104:37802) 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe70effd640 1 -- 172.21.15.104:0/3707917392 learned_addr learned my addr 172.21.15.104:0/3707917392 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe7177fe640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe704004000 0x7fe7181596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe717fff640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe718156b60 0x7fe718159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe70effd640 1 -- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe718156b60 msgr2=0x7fe718159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe70effd640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe718156b60 0x7fe718159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe70effd640 1 -- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe704004000 msgr2=0x7fe7181596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe70effd640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe704004000 0x7fe7181596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe70effd640 1 -- 172.21.15.104:0/3707917392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe718156f70 con 0x7fe7181538c0 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.157+0000 7fe717fff640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe718156b60 0x7fe718159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.158+0000 7fe70effd640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7181538c0 0x7fe718156620 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe70002a910 tx=0x7fe7000063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.158+0000 7fe714ff9640 1 -- 172.21.15.104:0/3707917392 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700038070 con 0x7fe7181538c0 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.158+0000 7fe714ff9640 1 -- 172.21.15.104:0/3707917392 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe700003af0 con 0x7fe7181538c0 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.158+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7180cc5b0 con 0x7fe7181538c0 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.158+0000 7fe714ff9640 1 -- 172.21.15.104:0/3707917392 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700033420 con 0x7fe7181538c0 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.158+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe718158920 con 0x7fe7181538c0 2024-09-17T02:55:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.159+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7180cc820 con 0x7fe7181538c0 2024-09-17T02:55:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.160+0000 7fe714ff9640 1 -- 172.21.15.104:0/3707917392 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe700043020 con 0x7fe7181538c0 2024-09-17T02:55:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.160+0000 7fe714ff9640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe6f8078b90 0x7fe6f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.160+0000 7fe714ff9640 1 -- 172.21.15.104:0/3707917392 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe7000ba580 con 0x7fe7181538c0 2024-09-17T02:55:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.160+0000 7fe7177fe640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe6f8078b90 0x7fe6f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.161+0000 7fe7177fe640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe6f8078b90 0x7fe6f807b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7180d1e60 tx=0x7fe708005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:13.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.165+0000 7fe714ff9640 1 -- 172.21.15.104:0/3707917392 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe718156f70 con 0x7fe7181538c0 2024-09-17T02:55:13.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.342+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe718162170 con 0x7fe7181538c0 2024-09-17T02:55:13.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.343+0000 7fe714ff9640 1 -- 172.21.15.104:0/3707917392 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16713 (secure 0 0 0) 0x7fe700082a50 con 0x7fe7181538c0 2024-09-17T02:55:13.343 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:13.343 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":21,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:54:43.133211+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:54:39.333696+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T02:54:40.447216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:13.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe6f8078b90 msgr2=0x7fe6f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe6f8078b90 0x7fe6f807b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe7180d1e60 tx=0x7fe708005f90 comp rx=0 tx=0).stop 2024-09-17T02:55:13.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7181538c0 msgr2=0x7fe718156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7181538c0 0x7fe718156620 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe70002a910 tx=0x7fe7000063a0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 shutdown_connections 2024-09-17T02:55:13.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe6f8078b90 0x7fe6f807b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe718156b60 0x7fe718159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe7181538c0 0x7fe718156620 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 --2- 172.21.15.104:0/3707917392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe704004000 0x7fe7181596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 >> 172.21.15.104:0/3707917392 conn(0x7fe718069120 msgr2=0x7fe7180cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:13.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 shutdown_connections 2024-09-17T02:55:13.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.345+0000 7fe71db19640 1 -- 172.21.15.104:0/3707917392 wait complete. 2024-09-17T02:55:13.357 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T02:55:13.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.470+0000 7fa1a40e5640 1 -- 172.21.15.104:0/1817472501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d3490 msgr2=0x7fa19c0b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.470+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/1817472501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d3490 0x7fa19c0b7c80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa18c005fd0 tx=0x7fa18c02a9e0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.470+0000 7fa1a40e5640 1 -- 172.21.15.104:0/1817472501 shutdown_connections 2024-09-17T02:55:13.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.470+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/1817472501 >> v2:172.21.15.192:3300/0 conn(0x7fa19c0d13e0 0x7fa19c1615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.470+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/1817472501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d3490 0x7fa19c0b7c80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.470+0000 7fa1a40e5640 1 -- 172.21.15.104:0/1817472501 >> 172.21.15.104:0/1817472501 conn(0x7fa19c0d2970 msgr2=0x7fa19c0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:13.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.470+0000 7fa1a40e5640 1 -- 172.21.15.104:0/1817472501 shutdown_connections 2024-09-17T02:55:13.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.470+0000 7fa1a40e5640 1 -- 172.21.15.104:0/1817472501 wait complete. 2024-09-17T02:55:13.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.472+0000 7fa1a40e5640 1 Processor -- start 2024-09-17T02:55:13.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.472+0000 7fa1a40e5640 1 -- start start 2024-09-17T02:55:13.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.473+0000 7fa1a40e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d0fd0 0x7fa19c1f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.473+0000 7fa1a40e5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa19c0d13e0 0x7fa19c1f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.473+0000 7fa1a40e5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19c0d3490 0x7fa19c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.473+0000 7fa1a40e5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c0b6bd0 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.473+0000 7fa1a40e5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c0b6a50 con 0x7fa19c0d3490 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.473+0000 7fa1a40e5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa19c0b6d50 con 0x7fa19c0d13e0 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.473+0000 7fa1a1e81640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d0fd0 0x7fa19c1f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1e81640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d0fd0 0x7fa19c1f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37828/0 (socket says 172.21.15.104:37828) 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1e81640 1 -- 172.21.15.104:0/3026836541 learned_addr learned my addr 172.21.15.104:0/3026836541 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a2682640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19c0d3490 0x7fa19c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1680640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa19c0d13e0 0x7fa19c1f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1e81640 1 -- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa19c0d13e0 msgr2=0x7fa19c1f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1e81640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa19c0d13e0 0x7fa19c1f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1e81640 1 -- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19c0d3490 msgr2=0x7fa19c0cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1e81640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19c0d3490 0x7fa19c0cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1e81640 1 -- 172.21.15.104:0/3026836541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c1f4bf0 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1680640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa19c0d13e0 0x7fa19c1f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:13.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a1e81640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d0fd0 0x7fa19c1f46b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009bf0 tx=0x7fa18c003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:13.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa19a7fc640 1 -- 172.21.15.104:0/3026836541 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c033050 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa19a7fc640 1 -- 172.21.15.104:0/3026836541 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa18c004450 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa19a7fc640 1 -- 172.21.15.104:0/3026836541 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c004860 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19c0c9e00 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.474+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19c0ca3c0 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.475+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19c0b7c80 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.476+0000 7fa19a7fc640 1 -- 172.21.15.104:0/3026836541 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa18c036070 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.476+0000 7fa19a7fc640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa188078bc0 0x7fa18807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.477+0000 7fa19a7fc640 1 -- 172.21.15.104:0/3026836541 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa18c0bbe10 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.477+0000 7fa1a1680640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa188078bc0 0x7fa18807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.478+0000 7fa1a1680640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa188078bc0 0x7fa18807b0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa190007fd0 tx=0x7fa190009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:13.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.481+0000 7fa19a7fc640 1 -- 172.21.15.104:0/3026836541 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa19c1f4bf0 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.688+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa19c0d0900 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.687 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:55:13.688+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T02:55:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.690+0000 7fa19a7fc640 1 -- 172.21.15.104:0/3026836541 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7fa18c0842e0 con 0x7fa19c0d0fd0 2024-09-17T02:55:13.689 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa188078bc0 msgr2=0x7fa18807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa188078bc0 0x7fa18807b0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa190007fd0 tx=0x7fa190009040 comp rx=0 tx=0).stop 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d0fd0 msgr2=0x7fa19c1f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d0fd0 0x7fa19c1f46b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009bf0 tx=0x7fa18c003f70 comp rx=0 tx=0).stop 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 shutdown_connections 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa188078bc0 0x7fa18807b0d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19c0d3490 0x7fa19c0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa19c0d13e0 0x7fa19c1f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 --2- 172.21.15.104:0/3026836541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa19c0d0fd0 0x7fa19c1f46b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 >> 172.21.15.104:0/3026836541 conn(0x7fa19c0d2970 msgr2=0x7fa19c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:13.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 shutdown_connections 2024-09-17T02:55:13.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.692+0000 7fa1a40e5640 1 -- 172.21.15.104:0/3026836541 wait complete. 2024-09-17T02:55:13.697 INFO:tasks.ceph.mds.d.smithi192.stderr: -6901> 2024-09-17T02:54:47.105+0000 7efee3935640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:55:13.703 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T02:55:13.756 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 -- 172.21.15.104:0/2158215651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241630c0 msgr2=0x7f80240b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 --2- 172.21.15.104:0/2158215651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241630c0 0x7f80240b6ae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8024163b80 tx=0x7f801802a540 comp rx=0 tx=0).stop 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 -- 172.21.15.104:0/2158215651 shutdown_connections 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 --2- 172.21.15.104:0/2158215651 >> v2:172.21.15.192:3300/0 conn(0x7f80241611d0 0x7f80241615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 --2- 172.21.15.104:0/2158215651 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241630c0 0x7f80240b6ae0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 --2- 172.21.15.104:0/2158215651 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8024162cb0 0x7f80240b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 -- 172.21.15.104:0/2158215651 >> 172.21.15.104:0/2158215651 conn(0x7f8024069120 msgr2=0x7f8024069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 -- 172.21.15.104:0/2158215651 shutdown_connections 2024-09-17T02:55:13.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.819+0000 7f802aade640 1 -- 172.21.15.104:0/2158215651 wait complete. 2024-09-17T02:55:13.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.820+0000 7f802aade640 1 Processor -- start 2024-09-17T02:55:13.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.821+0000 7f802aade640 1 -- start start 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f802aade640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80241611d0 0x7f80240ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f802aade640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8024162cb0 0x7f80240ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f802aade640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80241630c0 0x7f80241f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f802aade640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f80241621b0 con 0x7f8024162cb0 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f802aade640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8024162030 con 0x7f80241630c0 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f802aade640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8024162330 con 0x7f80241611d0 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f8023fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8024162cb0 0x7f80240ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f8023fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8024162cb0 0x7f80240ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37838/0 (socket says 172.21.15.104:37838) 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f8023fff640 1 -- 172.21.15.104:0/3831465516 learned_addr learned my addr 172.21.15.104:0/3831465516 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:13.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f802887a640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80241611d0 0x7f80240ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f802907b640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80241630c0 0x7f80241f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f8023fff640 1 -- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80241611d0 msgr2=0x7f80240ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f8023fff640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80241611d0 0x7f80240ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f8023fff640 1 -- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80241630c0 msgr2=0x7f80241f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f8023fff640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80241630c0 0x7f80241f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.822+0000 7f8023fff640 1 -- 172.21.15.104:0/3831465516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80240caef0 con 0x7f8024162cb0 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.823+0000 7f8023fff640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8024162cb0 0x7f80240ca9b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8018000c00 tx=0x7f80180039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.823+0000 7f80217fa640 1 -- 172.21.15.104:0/3831465516 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801803e030 con 0x7f8024162cb0 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.823+0000 7f80217fa640 1 -- 172.21.15.104:0/3831465516 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80180047a0 con 0x7f8024162cb0 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.823+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802415bbe0 con 0x7f8024162cb0 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.823+0000 7f80217fa640 1 -- 172.21.15.104:0/3831465516 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018035040 con 0x7f8024162cb0 2024-09-17T02:55:13.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.823+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802415c1a0 con 0x7f8024162cb0 2024-09-17T02:55:13.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.824+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80241615e0 con 0x7f8024162cb0 2024-09-17T02:55:13.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.825+0000 7f80217fa640 1 -- 172.21.15.104:0/3831465516 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8018041030 con 0x7f8024162cb0 2024-09-17T02:55:13.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.825+0000 7f80217fa640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8010078b90 0x7f801007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:13.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.825+0000 7f80217fa640 1 -- 172.21.15.104:0/3831465516 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f80180bb620 con 0x7f8024162cb0 2024-09-17T02:55:13.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.825+0000 7f802887a640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8010078b90 0x7f801007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:13.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.826+0000 7f802887a640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8010078b90 0x7f801007b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8014009960 tx=0x7f8014009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:13.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:13.830+0000 7f80217fa640 1 -- 172.21.15.104:0/3831465516 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80240caef0 con 0x7f8024162cb0 2024-09-17T02:55:14.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.042+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f80240ceb70 con 0x7f8024162cb0 2024-09-17T02:55:14.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.693+0000 7f80217fa640 1 -- 172.21.15.104:0/3831465516 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f80180833b0 con 0x7f8024162cb0 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8010078b90 msgr2=0x7f801007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8010078b90 0x7f801007b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8014009960 tx=0x7f8014009060 comp rx=0 tx=0).stop 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8024162cb0 msgr2=0x7f80240ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8024162cb0 0x7f80240ca9b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8018000c00 tx=0x7f80180039e0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 shutdown_connections 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8010078b90 0x7f801007b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80241630c0 0x7f80241f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8024162cb0 0x7f80240ca9b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 --2- 172.21.15.104:0/3831465516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80241611d0 0x7f80240ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 >> 172.21.15.104:0/3831465516 conn(0x7f8024069120 msgr2=0x7f80240b8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:14.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 shutdown_connections 2024-09-17T02:55:14.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.697+0000 7f802aade640 1 -- 172.21.15.104:0/3831465516 wait complete. 2024-09-17T02:55:14.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T02:55:14.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.832+0000 7f4fa95ad640 1 -- 172.21.15.104:0/1248216727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fa40d0c70 msgr2=0x7f4fa40d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:14.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.832+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/1248216727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fa40d0c70 0x7f4fa40d1080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009830 tx=0x7f4f9802a510 comp rx=0 tx=0).stop 2024-09-17T02:55:14.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.832+0000 7f4fa95ad640 1 -- 172.21.15.104:0/1248216727 shutdown_connections 2024-09-17T02:55:14.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.832+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/1248216727 >> v2:172.21.15.192:3300/0 conn(0x7f4fa4068d00 0x7f4fa4069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.832+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/1248216727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fa40d0c70 0x7f4fa40d1080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.832+0000 7f4fa95ad640 1 -- 172.21.15.104:0/1248216727 >> 172.21.15.104:0/1248216727 conn(0x7f4fa40b3c70 msgr2=0x7f4fa40d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:14.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.832+0000 7f4fa95ad640 1 -- 172.21.15.104:0/1248216727 shutdown_connections 2024-09-17T02:55:14.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.832+0000 7f4fa95ad640 1 -- 172.21.15.104:0/1248216727 wait complete. 2024-09-17T02:55:14.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.834+0000 7f4fa95ad640 1 Processor -- start 2024-09-17T02:55:14.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.834+0000 7f4fa95ad640 1 -- start start 2024-09-17T02:55:14.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa95ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fa4068d00 0x7f4fa415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:14.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa95ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fa40d0c70 0x7f4fa415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:14.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa95ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa4160c10 0x7f4fa4132ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa95ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa406f850 con 0x7f4fa40d0c70 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa95ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa406f6d0 con 0x7f4fa4160c10 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa95ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa406f9d0 con 0x7f4fa4068d00 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fa40d0c70 0x7f4fa415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fa40d0c70 0x7f4fa415f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54370/0 (socket says 172.21.15.104:54370) 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 -- 172.21.15.104:0/4030200809 learned_addr learned my addr 172.21.15.104:0/4030200809 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa37fe640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa4160c10 0x7f4fa4132ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa2ffd640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fa4068d00 0x7f4fa415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 -- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fa4068d00 msgr2=0x7f4fa415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fa4068d00 0x7f4fa415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 -- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa4160c10 msgr2=0x7f4fa4132ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa4160c10 0x7f4fa4132ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:14.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 -- 172.21.15.104:0/4030200809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa415fb70 con 0x7f4fa40d0c70 2024-09-17T02:55:14.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa27fc640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fa40d0c70 0x7f4fa415f2b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4f9802ab00 tx=0x7f4f98033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:14.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4f8b7fe640 1 -- 172.21.15.104:0/4030200809 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98005c90 con 0x7f4fa40d0c70 2024-09-17T02:55:14.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4f8b7fe640 1 -- 172.21.15.104:0/4030200809 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f98031e50 con 0x7f4fa40d0c70 2024-09-17T02:55:14.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.836+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa415fe50 con 0x7f4fa40d0c70 2024-09-17T02:55:14.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.837+0000 7f4f8b7fe640 1 -- 172.21.15.104:0/4030200809 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98005260 con 0x7f4fa40d0c70 2024-09-17T02:55:14.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.837+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa4160410 con 0x7f4fa40d0c70 2024-09-17T02:55:14.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.838+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa40d2450 con 0x7f4fa40d0c70 2024-09-17T02:55:14.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.838+0000 7f4f8b7fe640 1 -- 172.21.15.104:0/4030200809 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f98005400 con 0x7f4fa40d0c70 2024-09-17T02:55:14.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.839+0000 7f4f8b7fe640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:14.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.839+0000 7f4f8b7fe640 1 -- 172.21.15.104:0/4030200809 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f4f980bbcd0 con 0x7f4fa40d0c70 2024-09-17T02:55:14.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.839+0000 7f4fa2ffd640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:14.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.840+0000 7f4fa2ffd640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f94002200 tx=0x7f4f940019f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:14.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:14.843+0000 7f4f8b7fe640 1 -- 172.21.15.104:0/4030200809 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4fa40d2450 con 0x7f4fa40d0c70 2024-09-17T02:55:15.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.016+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4fa406fec0 con 0x7f4fa40d0c70 2024-09-17T02:55:15.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.696+0000 7f4f8b7fe640 1 -- 172.21.15.104:0/4030200809 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f4f9803f030 con 0x7f4fa40d0c70 2024-09-17T02:55:15.696 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T02:55:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 msgr2=0x7f4f9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f94002200 tx=0x7f4f940019f0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fa40d0c70 msgr2=0x7f4fa415f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fa40d0c70 0x7f4fa415f2b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4f9802ab00 tx=0x7f4f98033c20 comp rx=0 tx=0).stop 2024-09-17T02:55:15.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 shutdown_connections 2024-09-17T02:55:15.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fa4160c10 0x7f4fa4132ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fa40d0c70 0x7f4fa415f2b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 --2- 172.21.15.104:0/4030200809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fa4068d00 0x7f4fa415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 >> 172.21.15.104:0/4030200809 conn(0x7f4fa40b3c70 msgr2=0x7f4fa4142c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:15.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 shutdown_connections 2024-09-17T02:55:15.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.700+0000 7f4fa95ad640 1 -- 172.21.15.104:0/4030200809 wait complete. 2024-09-17T02:55:15.712 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T02:55:15.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.831+0000 7fe127b2b640 1 -- 172.21.15.104:0/2280660581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1200d2390 msgr2=0x7fe1201561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:15.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.831+0000 7fe127b2b640 1 --2- 172.21.15.104:0/2280660581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1200d2390 0x7fe1201561a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe110005fd0 tx=0x7fe11002a5d0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.831+0000 7fe127b2b640 1 -- 172.21.15.104:0/2280660581 shutdown_connections 2024-09-17T02:55:15.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.831+0000 7fe127b2b640 1 --2- 172.21.15.104:0/2280660581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1200d2390 0x7fe1201561a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.831+0000 7fe127b2b640 1 -- 172.21.15.104:0/2280660581 >> 172.21.15.104:0/2280660581 conn(0x7fe120068ee0 msgr2=0x7fe1200692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:15.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.831+0000 7fe127b2b640 1 -- 172.21.15.104:0/2280660581 shutdown_connections 2024-09-17T02:55:15.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.831+0000 7fe127b2b640 1 -- 172.21.15.104:0/2280660581 wait complete. 2024-09-17T02:55:15.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.833+0000 7fe127b2b640 1 Processor -- start 2024-09-17T02:55:15.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.833+0000 7fe127b2b640 1 -- start start 2024-09-17T02:55:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe127b2b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe120155d90 0x7fe12006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe127b2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12015f7f0 0x7fe12006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe127b2b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1201f39b0 0x7fe1201f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:15.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe127b2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe120070f50 con 0x7fe12015f7f0 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe127b2b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe120070dd0 con 0x7fe1201f39b0 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe127b2b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe1200710d0 con 0x7fe120155d90 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1250c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12015f7f0 0x7fe12006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1250c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12015f7f0 0x7fe12006d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54388/0 (socket says 172.21.15.104:54388) 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1250c6640 1 -- 172.21.15.104:0/1792675163 learned_addr learned my addr 172.21.15.104:0/1792675163 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1258c7640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe120155d90 0x7fe12006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1260c8640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1201f39b0 0x7fe1201f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1250c6640 1 -- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe120155d90 msgr2=0x7fe12006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1250c6640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe120155d90 0x7fe12006cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1250c6640 1 -- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1201f39b0 msgr2=0x7fe1201f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1250c6640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1201f39b0 0x7fe1201f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.834+0000 7fe1250c6640 1 -- 172.21.15.104:0/1792675163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1200ab010 con 0x7fe12015f7f0 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.835+0000 7fe1250c6640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12015f7f0 0x7fe12006d320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe110034040 tx=0x7fe1100038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.835+0000 7fe1167fc640 1 -- 172.21.15.104:0/1792675163 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11003e030 con 0x7fe12015f7f0 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.835+0000 7fe1167fc640 1 -- 172.21.15.104:0/1792675163 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe110003ca0 con 0x7fe12015f7f0 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.835+0000 7fe1167fc640 1 -- 172.21.15.104:0/1792675163 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110035040 con 0x7fe12015f7f0 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.835+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe120157920 con 0x7fe12015f7f0 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.835+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe120156be0 con 0x7fe12015f7f0 2024-09-17T02:55:15.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.836+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe12015ba70 con 0x7fe12015f7f0 2024-09-17T02:55:15.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.837+0000 7fe1167fc640 1 -- 172.21.15.104:0/1792675163 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe110041030 con 0x7fe12015f7f0 2024-09-17T02:55:15.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.837+0000 7fe1167fc640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe104078b90 0x7fe10407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:15.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.837+0000 7fe1167fc640 1 -- 172.21.15.104:0/1792675163 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7fe1100bb2e0 con 0x7fe12015f7f0 2024-09-17T02:55:15.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.837+0000 7fe1258c7640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe104078b90 0x7fe10407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:15.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.838+0000 7fe1258c7640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe104078b90 0x7fe10407b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe11c007dc0 tx=0x7fe11c0072f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:15.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:15.842+0000 7fe1167fc640 1 -- 172.21.15.104:0/1792675163 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1200ab010 con 0x7fe12015f7f0 2024-09-17T02:55:16.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.016+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe12006e670 con 0x7fe12015f7f0 2024-09-17T02:55:16.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.702+0000 7fe1167fc640 1 -- 172.21.15.104:0/1792675163 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7fe110083880 con 0x7fe12015f7f0 2024-09-17T02:55:16.702 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T02:55:16.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.706+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe104078b90 msgr2=0x7fe10407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.706+0000 7fe127b2b640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe104078b90 0x7fe10407b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe11c007dc0 tx=0x7fe11c0072f0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.706+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12015f7f0 msgr2=0x7fe12006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.706+0000 7fe127b2b640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12015f7f0 0x7fe12006d320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe110034040 tx=0x7fe1100038a0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.707+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 shutdown_connections 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.707+0000 7fe127b2b640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe104078b90 0x7fe10407b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.707+0000 7fe127b2b640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1201f39b0 0x7fe1201f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.707+0000 7fe127b2b640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe12015f7f0 0x7fe12006d320 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe110034040 tx=0x7fe1100038a0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.707+0000 7fe127b2b640 1 --2- 172.21.15.104:0/1792675163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe120155d90 0x7fe12006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.707+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 >> 172.21.15.104:0/1792675163 conn(0x7fe120068ee0 msgr2=0x7fe1200d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.708+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 shutdown_connections 2024-09-17T02:55:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.708+0000 7fe127b2b640 1 -- 172.21.15.104:0/1792675163 wait complete. 2024-09-17T02:55:16.722 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T02:55:16.722 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T02:55:16.722 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T02:55:16.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:55:16.722 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T02:55:16.722 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T02:55:16.723 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T02:55:16.723 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:55:16.723 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T02:55:16.723 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T02:55:16.723 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T02:55:16.723 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:55:16.724 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T02:55:16.724 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T02:55:16.724 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T02:55:16.724 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:55:16.735 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T02:55:16.735 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T02:55:16.736 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T02:55:16.736 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T02:55:16.737 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T02:55:16.738 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T02:55:16.738 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T02:55:16.739 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T02:55:16.778 INFO:tasks.ceph.mds.a:Started 2024-09-17T02:55:16.778 DEBUG:teuthology.parallel:result is None 2024-09-17T02:55:16.779 INFO:tasks.ceph.mds.c:Started 2024-09-17T02:55:16.780 DEBUG:teuthology.parallel:result is None 2024-09-17T02:55:16.781 INFO:tasks.ceph.mds.b:Started 2024-09-17T02:55:16.781 DEBUG:teuthology.parallel:result is None 2024-09-17T02:55:16.781 INFO:tasks.ceph.mds.d:Started 2024-09-17T02:55:16.782 DEBUG:teuthology.parallel:result is None 2024-09-17T02:55:16.782 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T02:55:16.875 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T02:55:16.875 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T02:55:16.875 INFO:tasks.ceph.mds.b.smithi192.stderr:2024-09-17T02:55:16.875+0000 7f705c90f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T02:55:16.876 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:55:16.876 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T02:55:16.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.910+0000 7f0a952de640 1 -- 172.21.15.104:0/3984623645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a900b6f70 msgr2=0x7f0a9015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:16.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.910+0000 7f0a952de640 1 --2- 172.21.15.104:0/3984623645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a900b6f70 0x7f0a9015ef90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009830 tx=0x7f0a8002a530 comp rx=0 tx=0).stop 2024-09-17T02:55:16.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.910+0000 7f0a952de640 1 -- 172.21.15.104:0/3984623645 shutdown_connections 2024-09-17T02:55:16.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.910+0000 7f0a952de640 1 --2- 172.21.15.104:0/3984623645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a900b6f70 0x7f0a9015ef90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.910+0000 7f0a952de640 1 -- 172.21.15.104:0/3984623645 >> 172.21.15.104:0/3984623645 conn(0x7f0a90073df0 msgr2=0x7f0a90068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:16.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.910+0000 7f0a952de640 1 -- 172.21.15.104:0/3984623645 shutdown_connections 2024-09-17T02:55:16.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.910+0000 7f0a952de640 1 -- 172.21.15.104:0/3984623645 wait complete. 2024-09-17T02:55:16.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.912+0000 7f0a952de640 1 Processor -- start 2024-09-17T02:55:16.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.912+0000 7f0a952de640 1 -- start start 2024-09-17T02:55:16.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.913+0000 7f0a952de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a900b3b00 0x7f0a9015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:16.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.913+0000 7f0a952de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a900b6f70 0x7f0a9014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:16.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.913+0000 7f0a952de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a900d18e0 0x7f0a901f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.913+0000 7f0a952de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a900d3fc0 con 0x7f0a900b3b00 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.913+0000 7f0a952de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a900d3e40 con 0x7f0a900d18e0 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.913+0000 7f0a952de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0a900d4140 con 0x7f0a900b6f70 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a900b3b00 0x7f0a9015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a900b3b00 0x7f0a9015a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54424/0 (socket says 172.21.15.104:54424) 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 -- 172.21.15.104:0/35406740 learned_addr learned my addr 172.21.15.104:0/35406740 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8f7fe640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a900d18e0 0x7f0a901f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8e7fc640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a900b6f70 0x7f0a9014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 -- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a900b6f70 msgr2=0x7f0a9014ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a900b6f70 0x7f0a9014ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 -- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a900d18e0 msgr2=0x7f0a901f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:16.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a900d18e0 0x7f0a901f60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:16.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 -- 172.21.15.104:0/35406740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a901590d0 con 0x7f0a900b3b00 2024-09-17T02:55:16.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a8effd640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a900b3b00 0x7f0a9015a170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009950 tx=0x7f0a80033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:16.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a777fe640 1 -- 172.21.15.104:0/35406740 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80031b50 con 0x7f0a900b3b00 2024-09-17T02:55:16.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a901593b0 con 0x7f0a900b3b00 2024-09-17T02:55:16.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a777fe640 1 -- 172.21.15.104:0/35406740 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a80031de0 con 0x7f0a900b3b00 2024-09-17T02:55:16.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a90159970 con 0x7f0a900b3b00 2024-09-17T02:55:16.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.914+0000 7f0a777fe640 1 -- 172.21.15.104:0/35406740 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80048060 con 0x7f0a900b3b00 2024-09-17T02:55:16.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.916+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a900d4630 con 0x7f0a900b3b00 2024-09-17T02:55:16.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.916+0000 7f0a777fe640 1 -- 172.21.15.104:0/35406740 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a80005220 con 0x7f0a900b3b00 2024-09-17T02:55:16.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.916+0000 7f0a777fe640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a7c078b90 0x7f0a7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:16.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.917+0000 7f0a777fe640 1 -- 172.21.15.104:0/35406740 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f0a800bbf80 con 0x7f0a900b3b00 2024-09-17T02:55:16.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.917+0000 7f0a8e7fc640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a7c078b90 0x7f0a7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:16.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.917+0000 7f0a8e7fc640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a7c078b90 0x7f0a7c07b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a84007fd0 tx=0x7f0a84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:16.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:16.921+0000 7f0a777fe640 1 -- 172.21.15.104:0/35406740 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a8003f030 con 0x7f0a900b3b00 2024-09-17T02:55:17.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.107+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0a900d3900 con 0x7f0a900b3b00 2024-09-17T02:55:17.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.717+0000 7f0a777fe640 1 -- 172.21.15.104:0/35406740 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f0a80084640 con 0x7f0a900b3b00 2024-09-17T02:55:17.717 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T02:55:17.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.719+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a7c078b90 msgr2=0x7f0a7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:17.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.719+0000 7f0a952de640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a7c078b90 0x7f0a7c07b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a84007fd0 tx=0x7f0a84009040 comp rx=0 tx=0).stop 2024-09-17T02:55:17.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.719+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a900b3b00 msgr2=0x7f0a9015a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.719+0000 7f0a952de640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a900b3b00 0x7f0a9015a170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009950 tx=0x7f0a80033ba0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.720+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 shutdown_connections 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.720+0000 7f0a952de640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a7c078b90 0x7f0a7c07b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.720+0000 7f0a952de640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a900d18e0 0x7f0a901f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.720+0000 7f0a952de640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a900b6f70 0x7f0a9014ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.720+0000 7f0a952de640 1 --2- 172.21.15.104:0/35406740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a900b3b00 0x7f0a9015a170 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.720+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 >> 172.21.15.104:0/35406740 conn(0x7f0a90073df0 msgr2=0x7f0a90068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.720+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 shutdown_connections 2024-09-17T02:55:17.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.720+0000 7f0a952de640 1 -- 172.21.15.104:0/35406740 wait complete. 2024-09-17T02:55:17.732 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T02:55:17.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.849+0000 7f0a2afcf640 1 -- 172.21.15.104:0/699771159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 msgr2=0x7f0a241608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:17.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.849+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/699771159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 0x7f0a241608a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0a14005fd0 tx=0x7f0a1402aa90 comp rx=0 tx=0).stop 2024-09-17T02:55:17.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.849+0000 7f0a2afcf640 1 -- 172.21.15.104:0/699771159 shutdown_connections 2024-09-17T02:55:17.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.849+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/699771159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a24069410 0x7f0a240d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.849+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/699771159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 0x7f0a241608a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.849+0000 7f0a2afcf640 1 -- 172.21.15.104:0/699771159 >> 172.21.15.104:0/699771159 conn(0x7f0a240b3640 msgr2=0x7f0a240b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:17.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.849+0000 7f0a2afcf640 1 -- 172.21.15.104:0/699771159 shutdown_connections 2024-09-17T02:55:17.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.849+0000 7f0a2afcf640 1 -- 172.21.15.104:0/699771159 wait complete. 2024-09-17T02:55:17.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.851+0000 7f0a2afcf640 1 Processor -- start 2024-09-17T02:55:17.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.851+0000 7f0a2afcf640 1 -- start start 2024-09-17T02:55:17.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.852+0000 7f0a2afcf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 0x7f0a240af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:17.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.852+0000 7f0a2afcf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2415d3b0 0x7f0a24146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:17.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.852+0000 7f0a2afcf640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a240afcb0 0x7f0a2415f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:17.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.852+0000 7f0a2afcf640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a240d0ed0 con 0x7f0a2406f540 2024-09-17T02:55:17.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.852+0000 7f0a2afcf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a240d0d50 con 0x7f0a2415d3b0 2024-09-17T02:55:17.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.852+0000 7f0a2afcf640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0a240d1050 con 0x7f0a240afcb0 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 0x7f0a240af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 0x7f0a240af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54442/0 (socket says 172.21.15.104:54442) 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 -- 172.21.15.104:0/3323824045 learned_addr learned my addr 172.21.15.104:0/3323824045 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a2956c640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a240afcb0 0x7f0a2415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a23fff640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2415d3b0 0x7f0a24146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 -- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a240afcb0 msgr2=0x7f0a2415f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a240afcb0 0x7f0a2415f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 -- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2415d3b0 msgr2=0x7f0a24146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2415d3b0 0x7f0a24146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 -- 172.21.15.104:0/3323824045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a24155720 con 0x7f0a2406f540 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a28d6b640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 0x7f0a240af450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009bf0 tx=0x7f0a14003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:17.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a217fa640 1 -- 172.21.15.104:0/3323824045 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14044070 con 0x7f0a2406f540 2024-09-17T02:55:17.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a217fa640 1 -- 172.21.15.104:0/3323824045 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a14004250 con 0x7f0a2406f540 2024-09-17T02:55:17.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a24153a60 con 0x7f0a2406f540 2024-09-17T02:55:17.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a217fa640 1 -- 172.21.15.104:0/3323824045 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14004680 con 0x7f0a2406f540 2024-09-17T02:55:17.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.853+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a240b4a40 con 0x7f0a2406f540 2024-09-17T02:55:17.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.854+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a240b27a0 con 0x7f0a2406f540 2024-09-17T02:55:17.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.855+0000 7f0a217fa640 1 -- 172.21.15.104:0/3323824045 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a14047070 con 0x7f0a2406f540 2024-09-17T02:55:17.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.856+0000 7f0a217fa640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a04078b90 0x7f0a0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:17.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.856+0000 7f0a217fa640 1 -- 172.21.15.104:0/3323824045 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f0a140bb960 con 0x7f0a2406f540 2024-09-17T02:55:17.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.856+0000 7f0a23fff640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a04078b90 0x7f0a0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:17.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.857+0000 7f0a23fff640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a04078b90 0x7f0a0407b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a241601d0 tx=0x7f0a0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:17.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:17.861+0000 7f0a217fa640 1 -- 172.21.15.104:0/3323824045 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a240b27a0 con 0x7f0a2406f540 2024-09-17T02:55:18.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.101+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0a240b0f70 con 0x7f0a2406f540 2024-09-17T02:55:18.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.102+0000 7f0a217fa640 1 -- 172.21.15.104:0/3323824045 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+6645 (secure 0 0 0) 0x7f0a240b0f70 con 0x7f0a2406f540 2024-09-17T02:55:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T02:55:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T02:55:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T02:55:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T02:55:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T02:55:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:55:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:55:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:55:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T02:55:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T02:55:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:55:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:55:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:55:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T02:55:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T02:55:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:55:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-mds", 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBf7+hmiDW7ERAAjn6XW1M6ks6h0U95QoaZvA==", 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T02:55:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBf7+hmpj27ERAAovnT6DPx/tQJUDlDC2jfFQ==", 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-osd", 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBf7+hmlkS7ERAAcgR5Vhpz1bnCI4VmUQ/GqA==", 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T02:55:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBf7+hmOku7ERAA80DMQpA8tbMXBfPqCq/KGw==", 2024-09-17T02:55:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T02:55:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T02:55:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBf7+hmNlK7ERAAUNB+qn5nRxrp96yzF2xCiQ==", 2024-09-17T02:55:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T02:55:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBf7+hmSlm7ERAAfHIy+b41RfPY8j2OqR01/g==", 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:55:18.123 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:55:18.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a04078b90 msgr2=0x7f0a0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a04078b90 0x7f0a0407b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0a241601d0 tx=0x7f0a0c009040 comp rx=0 tx=0).stop 2024-09-17T02:55:18.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 msgr2=0x7f0a240af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 0x7f0a240af450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009bf0 tx=0x7f0a14003f10 comp rx=0 tx=0).stop 2024-09-17T02:55:18.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 shutdown_connections 2024-09-17T02:55:18.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a04078b90 0x7f0a0407b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2415d3b0 0x7f0a24146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a240afcb0 0x7f0a2415f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 --2- 172.21.15.104:0/3323824045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a2406f540 0x7f0a240af450 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 >> 172.21.15.104:0/3323824045 conn(0x7f0a240b3640 msgr2=0x7f0a24075eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:18.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 shutdown_connections 2024-09-17T02:55:18.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.104+0000 7f0a2afcf640 1 -- 172.21.15.104:0/3323824045 wait complete. 2024-09-17T02:55:18.126 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T02:55:18.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.241+0000 7f159cf7b640 1 -- 172.21.15.104:0/359450700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15980b4fc0 msgr2=0x7f15980b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.241+0000 7f159cf7b640 1 --2- 172.21.15.104:0/359450700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15980b4fc0 0x7f15980b39c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1588005fd0 tx=0x7f158802a5d0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.241+0000 7f159cf7b640 1 -- 172.21.15.104:0/359450700 shutdown_connections 2024-09-17T02:55:18.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.241+0000 7f159cf7b640 1 --2- 172.21.15.104:0/359450700 >> v2:172.21.15.192:3300/0 conn(0x7f15980cdf10 0x7f15980cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.241+0000 7f159cf7b640 1 --2- 172.21.15.104:0/359450700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15980b4fc0 0x7f15980b39c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.241+0000 7f159cf7b640 1 -- 172.21.15.104:0/359450700 >> 172.21.15.104:0/359450700 conn(0x7f15980b44a0 msgr2=0x7f15980b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:18.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.241+0000 7f159cf7b640 1 -- 172.21.15.104:0/359450700 shutdown_connections 2024-09-17T02:55:18.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.241+0000 7f159cf7b640 1 -- 172.21.15.104:0/359450700 wait complete. 2024-09-17T02:55:18.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.243+0000 7f159cf7b640 1 Processor -- start 2024-09-17T02:55:18.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.243+0000 7f159cf7b640 1 -- start start 2024-09-17T02:55:18.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.244+0000 7f159cf7b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15980b3f00 0x7f1598153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:18.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.244+0000 7f159cf7b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15980b4fc0 0x7f15980cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:18.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.244+0000 7f159cf7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15980cdf10 0x7f15980cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:18.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.244+0000 7f159cf7b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f15980d0210 con 0x7f15980cdf10 2024-09-17T02:55:18.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.244+0000 7f159cf7b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1598160f50 con 0x7f15980b4fc0 2024-09-17T02:55:18.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.244+0000 7f159cf7b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f15980af7a0 con 0x7f15980b3f00 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15980cdf10 0x7f15980cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15980cdf10 0x7f15980cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54458/0 (socket says 172.21.15.104:54458) 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 -- 172.21.15.104:0/924871837 learned_addr learned my addr 172.21.15.104:0/924871837 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f159659c640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15980b3f00 0x7f1598153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1595d9b640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15980b4fc0 0x7f15980cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 -- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15980b3f00 msgr2=0x7f1598153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15980b3f00 0x7f1598153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 -- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15980b4fc0 msgr2=0x7f15980cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15980b4fc0 0x7f15980cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 -- 172.21.15.104:0/924871837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1598154380 con 0x7f15980cdf10 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1596d9d640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15980cdf10 0x7f15980cbce0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f159000ea10 tx=0x7f159000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1586ffd640 1 -- 172.21.15.104:0/924871837 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159000cde0 con 0x7f15980cdf10 2024-09-17T02:55:18.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1586ffd640 1 -- 172.21.15.104:0/924871837 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1590004c10 con 0x7f15980cdf10 2024-09-17T02:55:18.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f1586ffd640 1 -- 172.21.15.104:0/924871837 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590005020 con 0x7f15980cdf10 2024-09-17T02:55:18.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15980cc480 con 0x7f15980cdf10 2024-09-17T02:55:18.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.245+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15980b28b0 con 0x7f15980cdf10 2024-09-17T02:55:18.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.247+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15980b39c0 con 0x7f15980cdf10 2024-09-17T02:55:18.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.247+0000 7f1586ffd640 1 -- 172.21.15.104:0/924871837 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f15900051c0 con 0x7f15980cdf10 2024-09-17T02:55:18.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.247+0000 7f1586ffd640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1578078b90 0x7f157807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:18.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.248+0000 7f1586ffd640 1 -- 172.21.15.104:0/924871837 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f159009b620 con 0x7f15980cdf10 2024-09-17T02:55:18.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.248+0000 7f159659c640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1578078b90 0x7f157807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:18.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.248+0000 7f159659c640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1578078b90 0x7f157807b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1588033000 tx=0x7f1588004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:18.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.252+0000 7f1586ffd640 1 -- 172.21.15.104:0/924871837 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1598154380 con 0x7f15980cdf10 2024-09-17T02:55:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.493+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f15980cead0 con 0x7f15980cdf10 2024-09-17T02:55:18.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.495+0000 7f1586ffd640 1 -- 172.21.15.104:0/924871837 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v19) ==== 90+0+0 (secure 0 0 0) 0x7f15900637f0 con 0x7f15980cdf10 2024-09-17T02:55:18.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1578078b90 msgr2=0x7f157807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1578078b90 0x7f157807b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1588033000 tx=0x7f1588004730 comp rx=0 tx=0).stop 2024-09-17T02:55:18.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15980cdf10 msgr2=0x7f15980cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15980cdf10 0x7f15980cbce0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f159000ea10 tx=0x7f159000eed0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 shutdown_connections 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1578078b90 0x7f157807b0a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15980b4fc0 0x7f15980cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f15980cdf10 0x7f15980cbce0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 --2- 172.21.15.104:0/924871837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15980b3f00 0x7f1598153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 >> 172.21.15.104:0/924871837 conn(0x7f15980b44a0 msgr2=0x7f15980b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 shutdown_connections 2024-09-17T02:55:18.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.499+0000 7f159cf7b640 1 -- 172.21.15.104:0/924871837 wait complete. 2024-09-17T02:55:18.509 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T02:55:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.623+0000 7fa6fae30640 1 -- 172.21.15.104:0/3105105457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40b6cc0 msgr2=0x7fa6f40cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.623+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3105105457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40b6cc0 0x7fa6f40cf870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4073b50 tx=0x7fa6ec02aa30 comp rx=0 tx=0).stop 2024-09-17T02:55:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.623+0000 7fa6fae30640 1 -- 172.21.15.104:0/3105105457 shutdown_connections 2024-09-17T02:55:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.623+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3105105457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40b6cc0 0x7fa6f40cf870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.623+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3105105457 >> v2:172.21.15.192:3300/0 conn(0x7fa6f40d3400 0x7fa6f40cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.623+0000 7fa6fae30640 1 -- 172.21.15.104:0/3105105457 >> 172.21.15.104:0/3105105457 conn(0x7fa6f40d28e0 msgr2=0x7fa6f40d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.623+0000 7fa6fae30640 1 -- 172.21.15.104:0/3105105457 shutdown_connections 2024-09-17T02:55:18.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.623+0000 7fa6fae30640 1 -- 172.21.15.104:0/3105105457 wait complete. 2024-09-17T02:55:18.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.625+0000 7fa6fae30640 1 Processor -- start 2024-09-17T02:55:18.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.625+0000 7fa6fae30640 1 -- start start 2024-09-17T02:55:18.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6fae30640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40b6cc0 0x7fa6f414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:18.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6fae30640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf460 0x7fa6f415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:18.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6fae30640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40d3400 0x7fa6f415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:18.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6fae30640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f40cdc80 con 0x7fa6f40d3400 2024-09-17T02:55:18.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6fae30640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f40cdb00 con 0x7fa6f40cf460 2024-09-17T02:55:18.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6fae30640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f40cde00 con 0x7fa6f40b6cc0 2024-09-17T02:55:18.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6f93cd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40d3400 0x7fa6f415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:18.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6f93cd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40d3400 0x7fa6f415a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54482/0 (socket says 172.21.15.104:54482) 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6f93cd640 1 -- 172.21.15.104:0/3715120247 learned_addr learned my addr 172.21.15.104:0/3715120247 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.626+0000 7fa6f3fff640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf460 0x7fa6f415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f8bcc640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40b6cc0 0x7fa6f414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f93cd640 1 -- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40b6cc0 msgr2=0x7fa6f414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f93cd640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40b6cc0 0x7fa6f414eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f93cd640 1 -- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf460 msgr2=0x7fa6f415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f93cd640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf460 0x7fa6f415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f93cd640 1 -- 172.21.15.104:0/3715120247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f41f3bf0 con 0x7fa6f40d3400 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f93cd640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40d3400 0x7fa6f415a570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec02b020 tx=0x7fa6ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f17fa640 1 -- 172.21.15.104:0/3715120247 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec033050 con 0x7fa6f40d3400 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f17fa640 1 -- 172.21.15.104:0/3715120247 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6ec004450 con 0x7fa6f40d3400 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f41f3ed0 con 0x7fa6f40d3400 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6f17fa640 1 -- 172.21.15.104:0/3715120247 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec038450 con 0x7fa6f40d3400 2024-09-17T02:55:18.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.627+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f41f4490 con 0x7fa6f40d3400 2024-09-17T02:55:18.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.628+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f40ce2d0 con 0x7fa6f40d3400 2024-09-17T02:55:18.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.629+0000 7fa6f17fa640 1 -- 172.21.15.104:0/3715120247 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6ec036070 con 0x7fa6f40d3400 2024-09-17T02:55:18.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.629+0000 7fa6f17fa640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa6e0078b90 0x7fa6e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:18.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.629+0000 7fa6f17fa640 1 -- 172.21.15.104:0/3715120247 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fa6ec0bbd90 con 0x7fa6f40d3400 2024-09-17T02:55:18.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.630+0000 7fa6f8bcc640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa6e0078b90 0x7fa6e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:18.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.630+0000 7fa6f8bcc640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa6e0078b90 0x7fa6e007b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400bb30 tx=0x7fa6e400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:18.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.634+0000 7fa6f17fa640 1 -- 172.21.15.104:0/3715120247 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6ec083f60 con 0x7fa6f40d3400 2024-09-17T02:55:18.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.882+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fa6f40b4ce0 con 0x7fa6f40d3400 2024-09-17T02:55:18.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.885+0000 7fa6f17fa640 1 -- 172.21.15.104:0/3715120247 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v20) ==== 90+0+0 (secure 0 0 0) 0x7fa6ec088990 con 0x7fa6f40d3400 2024-09-17T02:55:18.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa6e0078b90 msgr2=0x7fa6e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa6e0078b90 0x7fa6e007b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400bb30 tx=0x7fa6e400b2e0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40d3400 msgr2=0x7fa6f415a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40d3400 0x7fa6f415a570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec02b020 tx=0x7fa6ec003f10 comp rx=0 tx=0).stop 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 shutdown_connections 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa6e0078b90 0x7fa6e007b0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6f40cf460 0x7fa6f415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6f40d3400 0x7fa6f415a570 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 --2- 172.21.15.104:0/3715120247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6f40b6cc0 0x7fa6f414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 >> 172.21.15.104:0/3715120247 conn(0x7fa6f40d28e0 msgr2=0x7fa6f415f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 shutdown_connections 2024-09-17T02:55:18.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:18.887+0000 7fa6fae30640 1 -- 172.21.15.104:0/3715120247 wait complete. 2024-09-17T02:55:18.897 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T02:55:19.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/1414983011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 msgr2=0x7fb5e80b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/1414983011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 0x7fb5e80b0910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8074020 tx=0x7fb5e002a560 comp rx=0 tx=0).stop 2024-09-17T02:55:19.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/1414983011 shutdown_connections 2024-09-17T02:55:19.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/1414983011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 0x7fb5e80b0910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/1414983011 >> v2:172.21.15.192:3300/0 conn(0x7fb5e80734f0 0x7fb5e8073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/1414983011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e815c220 0x7fb5e806f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/1414983011 >> 172.21.15.104:0/1414983011 conn(0x7fb5e806d200 msgr2=0x7fb5e806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:19.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/1414983011 shutdown_connections 2024-09-17T02:55:19.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.013+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/1414983011 wait complete. 2024-09-17T02:55:19.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.015+0000 7fb5ed1a8640 1 Processor -- start 2024-09-17T02:55:19.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.015+0000 7fb5ed1a8640 1 -- start start 2024-09-17T02:55:19.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5ed1a8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e80734f0 0x7fb5e8148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5ed1a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 0x7fb5e81e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5ed1a8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e815c220 0x7fb5e81ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5ed1a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80b11e0 con 0x7fb5e80b0500 2024-09-17T02:55:19.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5ed1a8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80b1060 con 0x7fb5e815c220 2024-09-17T02:55:19.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5ed1a8640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e815f6f0 con 0x7fb5e80734f0 2024-09-17T02:55:19.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5e659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 0x7fb5e81e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5e659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 0x7fb5e81e9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54504/0 (socket says 172.21.15.104:54504) 2024-09-17T02:55:19.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5e659c640 1 -- 172.21.15.104:0/2896265538 learned_addr learned my addr 172.21.15.104:0/2896265538 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:19.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5e759e640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e815c220 0x7fb5e81ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.016+0000 7fb5e6d9d640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e80734f0 0x7fb5e8148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5e659c640 1 -- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e80734f0 msgr2=0x7fb5e8148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5e659c640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e80734f0 0x7fb5e8148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5e659c640 1 -- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e815c220 msgr2=0x7fb5e81ea0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5e659c640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e815c220 0x7fb5e81ea0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5e659c640 1 -- 172.21.15.104:0/2896265538 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e81588e0 con 0x7fb5e80b0500 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5e659c640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 0x7fb5e81e9b70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00c920 tx=0x7fb5dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5cf7fe640 1 -- 172.21.15.104:0/2896265538 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc007bb0 con 0x7fb5e80b0500 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5cf7fe640 1 -- 172.21.15.104:0/2896265538 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5dc007e40 con 0x7fb5e80b0500 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e8158bc0 con 0x7fb5e80b0500 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5cf7fe640 1 -- 172.21.15.104:0/2896265538 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc005260 con 0x7fb5e80b0500 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.017+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e8159180 con 0x7fb5e80b0500 2024-09-17T02:55:19.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.018+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e80b0910 con 0x7fb5e80b0500 2024-09-17T02:55:19.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.019+0000 7fb5cf7fe640 1 -- 172.21.15.104:0/2896265538 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5dc005400 con 0x7fb5e80b0500 2024-09-17T02:55:19.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.019+0000 7fb5cf7fe640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5d4078b90 0x7fb5d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.019+0000 7fb5cf7fe640 1 -- 172.21.15.104:0/2896265538 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fb5dc09ad40 con 0x7fb5e80b0500 2024-09-17T02:55:19.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.020+0000 7fb5e6d9d640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5d4078b90 0x7fb5d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.020+0000 7fb5e6d9d640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5d4078b90 0x7fb5d407b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8005c40 tx=0x7fb5d800a530 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:19.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.024+0000 7fb5cf7fe640 1 -- 172.21.15.104:0/2896265538 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5dc014030 con 0x7fb5e80b0500 2024-09-17T02:55:19.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.264+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fb5e80d0f30 con 0x7fb5e80b0500 2024-09-17T02:55:19.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.273+0000 7fb5cf7fe640 1 -- 172.21.15.104:0/2896265538 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v21) ==== 90+0+0 (secure 0 0 0) 0x7fb5dc062e80 con 0x7fb5e80b0500 2024-09-17T02:55:19.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.276+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5d4078b90 msgr2=0x7fb5d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.276+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5d4078b90 0x7fb5d407b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8005c40 tx=0x7fb5d800a530 comp rx=0 tx=0).stop 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.276+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 msgr2=0x7fb5e81e9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.276+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 0x7fb5e81e9b70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00c920 tx=0x7fb5dc00cde0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.277+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 shutdown_connections 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.277+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5d4078b90 0x7fb5d407b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.277+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e815c220 0x7fb5e81ea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.277+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5e80b0500 0x7fb5e81e9b70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.277+0000 7fb5ed1a8640 1 --2- 172.21.15.104:0/2896265538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e80734f0 0x7fb5e8148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.277+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 >> 172.21.15.104:0/2896265538 conn(0x7fb5e806d200 msgr2=0x7fb5e8068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.277+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 shutdown_connections 2024-09-17T02:55:19.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.277+0000 7fb5ed1a8640 1 -- 172.21.15.104:0/2896265538 wait complete. 2024-09-17T02:55:19.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T02:55:19.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.402+0000 7f2c7268c640 1 -- 172.21.15.104:0/3440305342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c54004d40 msgr2=0x7f2c54005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.402+0000 7f2c7268c640 1 --2- 172.21.15.104:0/3440305342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c54004d40 0x7f2c54005150 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009ed0 tx=0x7f2c54005830 comp rx=0 tx=0).stop 2024-09-17T02:55:19.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.402+0000 7f2c70c29640 1 -- 172.21.15.104:0/3440305342 reap_dead start 2024-09-17T02:55:19.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.402+0000 7f2c7268c640 1 -- 172.21.15.104:0/3440305342 shutdown_connections 2024-09-17T02:55:19.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.402+0000 7f2c7268c640 1 -- 172.21.15.104:0/3440305342 >> 172.21.15.104:0/3440305342 conn(0x7f2c6c0d28a0 msgr2=0x7f2c6c0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:19.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.403+0000 7f2c7268c640 1 -- 172.21.15.104:0/3440305342 shutdown_connections 2024-09-17T02:55:19.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.403+0000 7f2c7268c640 1 -- 172.21.15.104:0/3440305342 wait complete. 2024-09-17T02:55:19.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.404+0000 7f2c7268c640 1 Processor -- start 2024-09-17T02:55:19.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.405+0000 7f2c7268c640 1 -- start start 2024-09-17T02:55:19.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c7268c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1d52f0 0x7f2c6c1d4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c7268c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c1d0c00 0x7f2c6c09c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c7268c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c1e37b0 0x7f2c6c1e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c7268c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0cf3c0 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c7268c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0ce5e0 con 0x7f2c6c1d0c00 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c7268c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c0cf540 con 0x7f2c6c1d52f0 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c1e37b0 0x7f2c6c1e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c1e37b0 0x7f2c6c1e3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54536/0 (socket says 172.21.15.104:54536) 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 -- 172.21.15.104:0/2318306178 learned_addr learned my addr 172.21.15.104:0/2318306178 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c6b7fe640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c1d0c00 0x7f2c6c09c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c6bfff640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1d52f0 0x7f2c6c1d4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 -- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1d52f0 msgr2=0x7f2c6c1d4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1d52f0 0x7f2c6c1d4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 -- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c1d0c00 msgr2=0x7f2c6c09c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c1d0c00 0x7f2c6c09c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 -- 172.21.15.104:0/2318306178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c1e4100 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c6bfff640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1d52f0 0x7f2c6c1d4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:19.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.406+0000 7f2c70c29640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c1e37b0 0x7f2c6c1e3bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009ed0 tx=0x7f2c64033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:19.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.407+0000 7f2c68ff9640 1 -- 172.21.15.104:0/2318306178 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64043070 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.407+0000 7f2c68ff9640 1 -- 172.21.15.104:0/2318306178 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c64033d20 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.407+0000 7f2c68ff9640 1 -- 172.21.15.104:0/2318306178 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64038040 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.407+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c1cfe40 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.407+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c1d0400 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.408+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c0cfa70 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.408+0000 7f2c68ff9640 1 -- 172.21.15.104:0/2318306178 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c64046070 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.409+0000 7f2c68ff9640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.409+0000 7f2c68ff9640 1 -- 172.21.15.104:0/2318306178 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f2c640ba6b0 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.409+0000 7f2c6bfff640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.410+0000 7f2c6bfff640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009cc0 tx=0x7f2c5c005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:19.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.413+0000 7f2c68ff9640 1 -- 172.21.15.104:0/2318306178 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c6c1e4100 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.658+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f2c6c0ce860 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.661+0000 7f2c68ff9640 1 -- 172.21.15.104:0/2318306178 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v22) ==== 90+0+0 (secure 0 0 0) 0x7f2c640827f0 con 0x7f2c6c1e37b0 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 msgr2=0x7f2c5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009cc0 tx=0x7f2c5c005f30 comp rx=0 tx=0).stop 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c1e37b0 msgr2=0x7f2c6c1e3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c1e37b0 0x7f2c6c1e3bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009ed0 tx=0x7f2c64033c30 comp rx=0 tx=0).stop 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 shutdown_connections 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c1d0c00 0x7f2c6c09c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c1e37b0 0x7f2c6c1e3bc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 --2- 172.21.15.104:0/2318306178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1d52f0 0x7f2c6c1d4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 >> 172.21.15.104:0/2318306178 conn(0x7f2c6c0d28a0 msgr2=0x7f2c6c1e4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:19.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 shutdown_connections 2024-09-17T02:55:19.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.663+0000 7f2c7268c640 1 -- 172.21.15.104:0/2318306178 wait complete. 2024-09-17T02:55:19.673 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T02:55:19.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.789+0000 7fcfa9494640 1 -- 172.21.15.104:0/3560987742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 msgr2=0x7fcf8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.789+0000 7fcfa9494640 1 --2- 172.21.15.104:0/3560987742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 0x7fcf8c00b9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcf94001690 tx=0x7fcf8c005830 comp rx=0 tx=0).stop 2024-09-17T02:55:19.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.789+0000 7fcfa9494640 1 -- 172.21.15.104:0/3560987742 shutdown_connections 2024-09-17T02:55:19.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.789+0000 7fcfa9494640 1 --2- 172.21.15.104:0/3560987742 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 0x7fcf8c00b9c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.789+0000 7fcfa9494640 1 -- 172.21.15.104:0/3560987742 >> 172.21.15.104:0/3560987742 conn(0x7fcfa40b3640 msgr2=0x7fcfa40b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:19.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.789+0000 7fcfa9494640 1 -- 172.21.15.104:0/3560987742 shutdown_connections 2024-09-17T02:55:19.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.789+0000 7fcfa9494640 1 -- 172.21.15.104:0/3560987742 wait complete. 2024-09-17T02:55:19.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.791+0000 7fcfa9494640 1 Processor -- start 2024-09-17T02:55:19.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.791+0000 7fcfa9494640 1 -- start start 2024-09-17T02:55:19.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa9494640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 0x7fcfa4148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa9494640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa41492f0 0x7fcfa414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa9494640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfa4157df0 0x7fcfa4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa9494640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa406f540 con 0x7fcf8c005350 2024-09-17T02:55:19.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa9494640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4073bf0 con 0x7fcfa41492f0 2024-09-17T02:55:19.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa9494640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa406f6c0 con 0x7fcfa4157df0 2024-09-17T02:55:19.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 0x7fcfa4148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 0x7fcfa4148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54552/0 (socket says 172.21.15.104:54552) 2024-09-17T02:55:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 -- 172.21.15.104:0/3897286207 learned_addr learned my addr 172.21.15.104:0/3897286207 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa37fe640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfa4157df0 0x7fcfa4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa27fc640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa41492f0 0x7fcfa414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 -- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfa4157df0 msgr2=0x7fcfa4158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfa4157df0 0x7fcfa4158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 -- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa41492f0 msgr2=0x7fcfa414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:19.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa41492f0 0x7fcfa414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:19.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 -- 172.21.15.104:0/3897286207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa4158740 con 0x7fcf8c005350 2024-09-17T02:55:19.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.792+0000 7fcfa2ffd640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 0x7fcfa4148c60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00e700 tx=0x7fcf9c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:19.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.793+0000 7fcf8b7fe640 1 -- 172.21.15.104:0/3897286207 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00a950 con 0x7fcf8c005350 2024-09-17T02:55:19.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.793+0000 7fcf8b7fe640 1 -- 172.21.15.104:0/3897286207 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf9c00aaf0 con 0x7fcf8c005350 2024-09-17T02:55:19.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.793+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa414ae60 con 0x7fcf8c005350 2024-09-17T02:55:19.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.793+0000 7fcf8b7fe640 1 -- 172.21.15.104:0/3897286207 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c018420 con 0x7fcf8c005350 2024-09-17T02:55:19.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.793+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa414dee0 con 0x7fcf8c005350 2024-09-17T02:55:19.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.794+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa4071400 con 0x7fcf8c005350 2024-09-17T02:55:19.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.794+0000 7fcf8b7fe640 1 -- 172.21.15.104:0/3897286207 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf9c021440 con 0x7fcf8c005350 2024-09-17T02:55:19.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.795+0000 7fcf8b7fe640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcf90078bc0 0x7fcf9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:19.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.795+0000 7fcf8b7fe640 1 -- 172.21.15.104:0/3897286207 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fcf9c09c750 con 0x7fcf8c005350 2024-09-17T02:55:19.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.795+0000 7fcfa27fc640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcf90078bc0 0x7fcf9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:19.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.796+0000 7fcfa27fc640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcf90078bc0 0x7fcf9007b0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40d13c0 tx=0x7fcf98009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:19.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:19.799+0000 7fcf8b7fe640 1 -- 172.21.15.104:0/3897286207 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcfa4071400 con 0x7fcf8c005350 2024-09-17T02:55:20.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.040+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fcfa406fc20 con 0x7fcf8c005350 2024-09-17T02:55:20.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.043+0000 7fcf8b7fe640 1 -- 172.21.15.104:0/3897286207 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v23) ==== 97+0+0 (secure 0 0 0) 0x7fcfa4158740 con 0x7fcf8c005350 2024-09-17T02:55:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcf90078bc0 msgr2=0x7fcf9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcf90078bc0 0x7fcf9007b0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40d13c0 tx=0x7fcf98009500 comp rx=0 tx=0).stop 2024-09-17T02:55:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 msgr2=0x7fcfa4148c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 0x7fcfa4148c60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00e700 tx=0x7fcf9c00ebc0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 shutdown_connections 2024-09-17T02:55:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcf90078bc0 0x7fcf9007b0d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa41492f0 0x7fcfa414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfa4157df0 0x7fcfa4158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 --2- 172.21.15.104:0/3897286207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcf8c005350 0x7fcfa4148c60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 >> 172.21.15.104:0/3897286207 conn(0x7fcfa40b3640 msgr2=0x7fcfa40b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 shutdown_connections 2024-09-17T02:55:20.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.046+0000 7fcfa9494640 1 -- 172.21.15.104:0/3897286207 wait complete. 2024-09-17T02:55:20.056 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T02:55:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.170+0000 7f1dc91e4640 1 -- 172.21.15.104:0/856416674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 msgr2=0x7f1dc40b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.170+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/856416674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 0x7f1dc40b69f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1db4005fd0 tx=0x7f1db402a540 comp rx=0 tx=0).stop 2024-09-17T02:55:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.170+0000 7f1dc91e4640 1 -- 172.21.15.104:0/856416674 shutdown_connections 2024-09-17T02:55:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.170+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/856416674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc415f1f0 0x7f1dc415f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.170+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/856416674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 0x7f1dc40b69f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.170+0000 7f1dc91e4640 1 -- 172.21.15.104:0/856416674 >> 172.21.15.104:0/856416674 conn(0x7f1dc4069120 msgr2=0x7f1dc4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.170+0000 7f1dc91e4640 1 -- 172.21.15.104:0/856416674 shutdown_connections 2024-09-17T02:55:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.170+0000 7f1dc91e4640 1 -- 172.21.15.104:0/856416674 wait complete. 2024-09-17T02:55:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.172+0000 7f1dc91e4640 1 Processor -- start 2024-09-17T02:55:20.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.172+0000 7f1dc91e4640 1 -- start start 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc91e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 0x7f1dc40cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc91e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc415f1f0 0x7f1dc40c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc91e4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc415fb40 0x7f1dc4153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc91e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc4163490 con 0x7f1dc40b65e0 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc91e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc41625a0 con 0x7f1dc415f1f0 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc91e4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc4163610 con 0x7f1dc415fb40 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 0x7f1dc40cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 0x7f1dc40cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54568/0 (socket says 172.21.15.104:54568) 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 -- 172.21.15.104:0/242541376 learned_addr learned my addr 172.21.15.104:0/242541376 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dba59c640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc415f1f0 0x7f1dc40c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc359e640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc415fb40 0x7f1dc4153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 -- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc415fb40 msgr2=0x7f1dc4153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc415fb40 0x7f1dc4153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 -- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc415f1f0 msgr2=0x7f1dc40c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc415f1f0 0x7f1dc40c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 -- 172.21.15.104:0/242541376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc40c9510 con 0x7f1dc40b65e0 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc2d9d640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 0x7f1dc40cca00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1db4034040 tx=0x7f1db40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dbbfff640 1 -- 172.21.15.104:0/242541376 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db403e030 con 0x7f1dc40b65e0 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dbbfff640 1 -- 172.21.15.104:0/242541376 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1db4003d90 con 0x7f1dc40b65e0 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc40cea30 con 0x7f1dc40b65e0 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.174+0000 7f1dbbfff640 1 -- 172.21.15.104:0/242541376 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4035040 con 0x7f1dc40b65e0 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.175+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc40cbf20 con 0x7f1dc40b65e0 2024-09-17T02:55:20.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.175+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc4163ae0 con 0x7f1dc40b65e0 2024-09-17T02:55:20.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.176+0000 7f1dbbfff640 1 -- 172.21.15.104:0/242541376 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1db4041030 con 0x7f1dc40b65e0 2024-09-17T02:55:20.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.177+0000 7f1dbbfff640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1da4078bc0 0x7f1da407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.177+0000 7f1dbbfff640 1 -- 172.21.15.104:0/242541376 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f1db40bb480 con 0x7f1dc40b65e0 2024-09-17T02:55:20.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.177+0000 7f1dba59c640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1da4078bc0 0x7f1da407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.177+0000 7f1dba59c640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1da4078bc0 0x7f1da407b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40ceca0 tx=0x7f1dac00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:20.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.181+0000 7f1dbbfff640 1 -- 172.21.15.104:0/242541376 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1db40835d0 con 0x7f1dc40b65e0 2024-09-17T02:55:20.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.423+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f1dc40cecf0 con 0x7f1dc40b65e0 2024-09-17T02:55:20.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.426+0000 7f1dbbfff640 1 -- 172.21.15.104:0/242541376 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v24) ==== 90+0+0 (secure 0 0 0) 0x7f1db4088000 con 0x7f1dc40b65e0 2024-09-17T02:55:20.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1da4078bc0 msgr2=0x7f1da407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1da4078bc0 0x7f1da407b0d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40ceca0 tx=0x7f1dac00b2e0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 msgr2=0x7f1dc40cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 0x7f1dc40cca00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1db4034040 tx=0x7f1db40038a0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 shutdown_connections 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1da4078bc0 0x7f1da407b0d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1dc415f1f0 0x7f1dc40c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1dc415fb40 0x7f1dc4153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 --2- 172.21.15.104:0/242541376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1dc40b65e0 0x7f1dc40cca00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 >> 172.21.15.104:0/242541376 conn(0x7f1dc4069120 msgr2=0x7f1dc40d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 shutdown_connections 2024-09-17T02:55:20.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.429+0000 7f1dc91e4640 1 -- 172.21.15.104:0/242541376 wait complete. 2024-09-17T02:55:20.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T02:55:20.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.553+0000 7fae2c957640 1 -- 172.21.15.104:0/34446015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae280cdf10 msgr2=0x7fae280b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.553+0000 7fae2c957640 1 --2- 172.21.15.104:0/34446015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae280cdf10 0x7fae280b57e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fae10009830 tx=0x7fae1002a510 comp rx=0 tx=0).stop 2024-09-17T02:55:20.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.553+0000 7fae2c957640 1 -- 172.21.15.104:0/34446015 shutdown_connections 2024-09-17T02:55:20.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.553+0000 7fae2c957640 1 --2- 172.21.15.104:0/34446015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae280b5d20 0x7fae280cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.553+0000 7fae2c957640 1 --2- 172.21.15.104:0/34446015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae280cdf10 0x7fae280b57e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.553+0000 7fae2c957640 1 -- 172.21.15.104:0/34446015 >> 172.21.15.104:0/34446015 conn(0x7fae280b44a0 msgr2=0x7fae280b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:20.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.553+0000 7fae2c957640 1 -- 172.21.15.104:0/34446015 shutdown_connections 2024-09-17T02:55:20.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.553+0000 7fae2c957640 1 -- 172.21.15.104:0/34446015 wait complete. 2024-09-17T02:55:20.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.555+0000 7fae2c957640 1 Processor -- start 2024-09-17T02:55:20.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.555+0000 7fae2c957640 1 -- start start 2024-09-17T02:55:20.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae2c957640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae280b4fc0 0x7fae280c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae2c957640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae280b5d20 0x7fae280b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae2c957640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae280cdf10 0x7fae28159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae2c957640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fae28160f50 con 0x7fae280b5d20 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae2c957640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae280d0210 con 0x7fae280cdf10 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae2c957640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fae281610d0 con 0x7fae280b4fc0 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae1dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae280b5d20 0x7fae280b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae1dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae280b5d20 0x7fae280b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54574/0 (socket says 172.21.15.104:54574) 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae1dd9b640 1 -- 172.21.15.104:0/1565038879 learned_addr learned my addr 172.21.15.104:0/1565038879 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae2659c640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae280b4fc0 0x7fae280c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae26d9d640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae280cdf10 0x7fae28159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae1dd9b640 1 -- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae280b4fc0 msgr2=0x7fae280c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae1dd9b640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae280b4fc0 0x7fae280c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae1dd9b640 1 -- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae280cdf10 msgr2=0x7fae28159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.556+0000 7fae1dd9b640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae280cdf10 0x7fae28159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.557+0000 7fae1dd9b640 1 -- 172.21.15.104:0/1565038879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae280b2a60 con 0x7fae280b5d20 2024-09-17T02:55:20.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.557+0000 7fae1dd9b640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae280b5d20 0x7fae280b2520 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fae10009950 tx=0x7fae10033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:20.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.557+0000 7fae1f7fe640 1 -- 172.21.15.104:0/1565038879 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10005c90 con 0x7fae280b5d20 2024-09-17T02:55:20.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.557+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae281f4e50 con 0x7fae280b5d20 2024-09-17T02:55:20.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.557+0000 7fae1f7fe640 1 -- 172.21.15.104:0/1565038879 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae10031e50 con 0x7fae280b5d20 2024-09-17T02:55:20.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.557+0000 7fae1f7fe640 1 -- 172.21.15.104:0/1565038879 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10005260 con 0x7fae280b5d20 2024-09-17T02:55:20.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.557+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae281f4890 con 0x7fae280b5d20 2024-09-17T02:55:20.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.558+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae280cfa80 con 0x7fae280b5d20 2024-09-17T02:55:20.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.559+0000 7fae1f7fe640 1 -- 172.21.15.104:0/1565038879 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae10005400 con 0x7fae280b5d20 2024-09-17T02:55:20.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.559+0000 7fae1f7fe640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae08078b90 0x7fae0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.559+0000 7fae1f7fe640 1 -- 172.21.15.104:0/1565038879 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fae100bb9a0 con 0x7fae280b5d20 2024-09-17T02:55:20.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.559+0000 7fae2659c640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae08078b90 0x7fae0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.560+0000 7fae2659c640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae08078b90 0x7fae0807b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae18007fd0 tx=0x7fae18001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:20.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.564+0000 7fae1f7fe640 1 -- 172.21.15.104:0/1565038879 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae1003f030 con 0x7fae280b5d20 2024-09-17T02:55:20.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.741+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fae280b3ca0 con 0x7fae280b5d20 2024-09-17T02:55:20.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.741+0000 7fae1f7fe640 1 -- 172.21.15.104:0/1565038879 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7fae10083af0 con 0x7fae280b5d20 2024-09-17T02:55:20.740 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:20.740 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T02:55:20.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:20.740 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T02:55:20.741 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T02:55:20.741 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:20.741 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T02:55:20.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.743+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae08078b90 msgr2=0x7fae0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.743+0000 7fae2c957640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae08078b90 0x7fae0807b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fae18007fd0 tx=0x7fae18001370 comp rx=0 tx=0).stop 2024-09-17T02:55:20.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.743+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae280b5d20 msgr2=0x7fae280b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.743+0000 7fae2c957640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae280b5d20 0x7fae280b2520 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fae10009950 tx=0x7fae10033c20 comp rx=0 tx=0).stop 2024-09-17T02:55:20.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.744+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 shutdown_connections 2024-09-17T02:55:20.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.744+0000 7fae2c957640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae08078b90 0x7fae0807b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.744+0000 7fae2c957640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae280cdf10 0x7fae28159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.744+0000 7fae2c957640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae280b5d20 0x7fae280b2520 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.744+0000 7fae2c957640 1 --2- 172.21.15.104:0/1565038879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae280b4fc0 0x7fae280c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.744+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 >> 172.21.15.104:0/1565038879 conn(0x7fae280b44a0 msgr2=0x7fae280b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:20.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.744+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 shutdown_connections 2024-09-17T02:55:20.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.744+0000 7fae2c957640 1 -- 172.21.15.104:0/1565038879 wait complete. 2024-09-17T02:55:20.753 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T02:55:20.754 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T02:55:20.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.873+0000 7f6152e94640 1 -- 172.21.15.104:0/1329800589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c15f3f0 msgr2=0x7f614c0d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.873+0000 7f6152e94640 1 --2- 172.21.15.104:0/1329800589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c15f3f0 0x7f614c0d2a00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f613c009830 tx=0x7f613c02a480 comp rx=0 tx=0).stop 2024-09-17T02:55:20.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.873+0000 7f6152e94640 1 -- 172.21.15.104:0/1329800589 shutdown_connections 2024-09-17T02:55:20.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.873+0000 7f6152e94640 1 --2- 172.21.15.104:0/1329800589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f614c0d2f40 0x7f614c0cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.873+0000 7f6152e94640 1 --2- 172.21.15.104:0/1329800589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c15f3f0 0x7f614c0d2a00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.873+0000 7f6152e94640 1 -- 172.21.15.104:0/1329800589 >> 172.21.15.104:0/1329800589 conn(0x7f614c0d4c20 msgr2=0x7f614c0d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:20.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.873+0000 7f6152e94640 1 -- 172.21.15.104:0/1329800589 shutdown_connections 2024-09-17T02:55:20.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.873+0000 7f6152e94640 1 -- 172.21.15.104:0/1329800589 wait complete. 2024-09-17T02:55:20.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.874+0000 7f6152e94640 1 Processor -- start 2024-09-17T02:55:20.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.874+0000 7f6152e94640 1 -- start start 2024-09-17T02:55:20.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6152e94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c0cfd90 0x7f614c0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6152e94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c0d2f40 0x7f614c0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6152e94640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f614c15f3f0 0x7f614c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6152e94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f614c0d0e00 con 0x7f614c0cfd90 2024-09-17T02:55:20.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6152e94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f614c0d0c80 con 0x7f614c0d2f40 2024-09-17T02:55:20.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6152e94640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f614c0b3810 con 0x7f614c15f3f0 2024-09-17T02:55:20.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6150c30640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c0cfd90 0x7f614c0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6150c30640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c0cfd90 0x7f614c0caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54586/0 (socket says 172.21.15.104:54586) 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6150c30640 1 -- 172.21.15.104:0/4236680354 learned_addr learned my addr 172.21.15.104:0/4236680354 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f614bfff640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c0d2f40 0x7f614c0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6150c30640 1 -- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f614c15f3f0 msgr2=0x7f614c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6151431640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f614c15f3f0 0x7f614c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6150c30640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f614c15f3f0 0x7f614c15a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6150c30640 1 -- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c0d2f40 msgr2=0x7f614c0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6150c30640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c0d2f40 0x7f614c0cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f6150c30640 1 -- 172.21.15.104:0/4236680354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c1f6b30 con 0x7f614c0cfd90 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.876+0000 7f614bfff640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c0d2f40 0x7f614c0cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.877+0000 7f6150c30640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c0cfd90 0x7f614c0caef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f613c009950 tx=0x7f613c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.877+0000 7f61497fa640 1 -- 172.21.15.104:0/4236680354 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c031d60 con 0x7f614c0cfd90 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.877+0000 7f61497fa640 1 -- 172.21.15.104:0/4236680354 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f613c033e10 con 0x7f614c0cfd90 2024-09-17T02:55:20.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.877+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c1f5fb0 con 0x7f614c0cfd90 2024-09-17T02:55:20.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.877+0000 7f61497fa640 1 -- 172.21.15.104:0/4236680354 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c005260 con 0x7f614c0cfd90 2024-09-17T02:55:20.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.877+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c1f6570 con 0x7f614c0cfd90 2024-09-17T02:55:20.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.878+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c0b3ca0 con 0x7f614c0cfd90 2024-09-17T02:55:20.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.879+0000 7f61497fa640 1 -- 172.21.15.104:0/4236680354 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f613c005400 con 0x7f614c0cfd90 2024-09-17T02:55:20.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.879+0000 7f61497fa640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6138078b90 0x7f613807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:20.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.879+0000 7f61497fa640 1 -- 172.21.15.104:0/4236680354 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f613c0bbc80 con 0x7f614c0cfd90 2024-09-17T02:55:20.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.879+0000 7f614bfff640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6138078b90 0x7f613807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:20.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.880+0000 7f614bfff640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6138078b90 0x7f613807b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f614c0cdad0 tx=0x7f6140005d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:20.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:20.884+0000 7f61497fa640 1 -- 172.21.15.104:0/4236680354 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f613c03f030 con 0x7f614c0cfd90 2024-09-17T02:55:21.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.057+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f614c06af60 con 0x7f614c0cfd90 2024-09-17T02:55:21.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.735+0000 7f61497fa640 1 -- 172.21.15.104:0/4236680354 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f613c0844a0 con 0x7f614c0cfd90 2024-09-17T02:55:21.734 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6138078b90 msgr2=0x7f613807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6138078b90 0x7f613807b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f614c0cdad0 tx=0x7f6140005d10 comp rx=0 tx=0).stop 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c0cfd90 msgr2=0x7f614c0caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c0cfd90 0x7f614c0caef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f613c009950 tx=0x7f613c033c20 comp rx=0 tx=0).stop 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 shutdown_connections 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6138078b90 0x7f613807b0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c0d2f40 0x7f614c0cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f614c15f3f0 0x7f614c15a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 --2- 172.21.15.104:0/4236680354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f614c0cfd90 0x7f614c0caef0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 >> 172.21.15.104:0/4236680354 conn(0x7f614c0d4c20 msgr2=0x7f614c15c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 shutdown_connections 2024-09-17T02:55:21.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.738+0000 7f6152e94640 1 -- 172.21.15.104:0/4236680354 wait complete. 2024-09-17T02:55:21.752 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T02:55:21.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.879+0000 7f607bfba640 1 -- 172.21.15.104:0/445599395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 msgr2=0x7f607415ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:21.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.879+0000 7f607bfba640 1 --2- 172.21.15.104:0/445599395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 0x7f607415ef90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6064005fd0 tx=0x7f606402a540 comp rx=0 tx=0).stop 2024-09-17T02:55:21.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.879+0000 7f607bfba640 1 -- 172.21.15.104:0/445599395 shutdown_connections 2024-09-17T02:55:21.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.879+0000 7f607bfba640 1 --2- 172.21.15.104:0/445599395 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 0x7f607415ef90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:21.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.879+0000 7f607bfba640 1 -- 172.21.15.104:0/445599395 >> 172.21.15.104:0/445599395 conn(0x7f6074073df0 msgr2=0x7f6074068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:21.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.879+0000 7f607bfba640 1 -- 172.21.15.104:0/445599395 shutdown_connections 2024-09-17T02:55:21.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.879+0000 7f607bfba640 1 -- 172.21.15.104:0/445599395 wait complete. 2024-09-17T02:55:21.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.881+0000 7f607bfba640 1 Processor -- start 2024-09-17T02:55:21.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.881+0000 7f607bfba640 1 -- start start 2024-09-17T02:55:21.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.882+0000 7f607bfba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60740b3b00 0x7f60740b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:21.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.882+0000 7f607bfba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60740b6f70 0x7f60740ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:21.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.882+0000 7f607bfba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 0x7f6074161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:21.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.882+0000 7f607bfba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f60740d3fc0 con 0x7f60740d18e0 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.882+0000 7f607bfba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60740d3e40 con 0x7f60740b3b00 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.882+0000 7f607bfba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f60740d4140 con 0x7f60740b6f70 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 0x7f6074161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 0x7f6074161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54610/0 (socket says 172.21.15.104:54610) 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 -- 172.21.15.104:0/3973730307 learned_addr learned my addr 172.21.15.104:0/3973730307 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f6079d56640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60740b3b00 0x7f60740b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f6079555640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60740b6f70 0x7f60740ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 -- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60740b6f70 msgr2=0x7f60740ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60740b6f70 0x7f60740ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 -- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60740b3b00 msgr2=0x7f60740b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:21.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60740b3b00 0x7f60740b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:21.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 -- 172.21.15.104:0/3973730307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60740abea0 con 0x7f60740d18e0 2024-09-17T02:55:21.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607a557640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 0x7f6074161100 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f607000c390 tx=0x7f607000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:21.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f606a7fc640 1 -- 172.21.15.104:0/3973730307 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070017070 con 0x7f60740d18e0 2024-09-17T02:55:21.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f606a7fc640 1 -- 172.21.15.104:0/3973730307 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60700035f0 con 0x7f60740d18e0 2024-09-17T02:55:21.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60741f6ae0 con 0x7f60740d18e0 2024-09-17T02:55:21.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f606a7fc640 1 -- 172.21.15.104:0/3973730307 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070003a40 con 0x7f60740d18e0 2024-09-17T02:55:21.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.883+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60741f70a0 con 0x7f60740d18e0 2024-09-17T02:55:21.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.884+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607415ef90 con 0x7f60740d18e0 2024-09-17T02:55:21.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.885+0000 7f606a7fc640 1 -- 172.21.15.104:0/3973730307 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f607001a070 con 0x7f60740d18e0 2024-09-17T02:55:21.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.886+0000 7f606a7fc640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6058078bc0 0x7f605807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:21.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.886+0000 7f606a7fc640 1 -- 172.21.15.104:0/3973730307 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f6070099dc0 con 0x7f60740d18e0 2024-09-17T02:55:21.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.886+0000 7f6079d56640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6058078bc0 0x7f605807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:21.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.887+0000 7f6079d56640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6058078bc0 0x7f605807b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f606c009f20 tx=0x7f606c0094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:21.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:21.890+0000 7f606a7fc640 1 -- 172.21.15.104:0/3973730307 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f60700623e0 con 0x7f60740d18e0 2024-09-17T02:55:22.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.064+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f607406ae20 con 0x7f60740d18e0 2024-09-17T02:55:22.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.738+0000 7f606a7fc640 1 -- 172.21.15.104:0/3973730307 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f6070061ce0 con 0x7f60740d18e0 2024-09-17T02:55:22.737 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T02:55:22.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.740+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6058078bc0 msgr2=0x7f605807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:22.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.740+0000 7f607bfba640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6058078bc0 0x7f605807b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f606c009f20 tx=0x7f606c0094d0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.740+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 msgr2=0x7f6074161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:22.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.740+0000 7f607bfba640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 0x7f6074161100 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f607000c390 tx=0x7f607000c850 comp rx=0 tx=0).stop 2024-09-17T02:55:22.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.741+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 shutdown_connections 2024-09-17T02:55:22.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.741+0000 7f607bfba640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6058078bc0 0x7f605807b0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.741+0000 7f607bfba640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f60740d18e0 0x7f6074161100 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.741+0000 7f607bfba640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60740b6f70 0x7f60740ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.741+0000 7f607bfba640 1 --2- 172.21.15.104:0/3973730307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60740b3b00 0x7f60740b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.741+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 >> 172.21.15.104:0/3973730307 conn(0x7f6074073df0 msgr2=0x7f60740d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:22.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.741+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 shutdown_connections 2024-09-17T02:55:22.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.741+0000 7f607bfba640 1 -- 172.21.15.104:0/3973730307 wait complete. 2024-09-17T02:55:22.762 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T02:55:22.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.884+0000 7f0984357640 1 -- 172.21.15.104:0/2271050535 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0b7c80 msgr2=0x7f097c0b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:22.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.884+0000 7f0984357640 1 --2- 172.21.15.104:0/2271050535 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0b7c80 0x7f097c0b20f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0970005fd0 tx=0x7f097002a4a0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.884+0000 7f0984357640 1 -- 172.21.15.104:0/2271050535 shutdown_connections 2024-09-17T02:55:22.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.884+0000 7f0984357640 1 --2- 172.21.15.104:0/2271050535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c0b2630 0x7f097c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.884+0000 7f0984357640 1 --2- 172.21.15.104:0/2271050535 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0b7c80 0x7f097c0b20f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.884+0000 7f0984357640 1 -- 172.21.15.104:0/2271050535 >> 172.21.15.104:0/2271050535 conn(0x7f097c0d2970 msgr2=0x7f097c0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:22.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.884+0000 7f0984357640 1 -- 172.21.15.104:0/2271050535 shutdown_connections 2024-09-17T02:55:22.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.884+0000 7f0984357640 1 -- 172.21.15.104:0/2271050535 wait complete. 2024-09-17T02:55:22.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.886+0000 7f0984357640 1 Processor -- start 2024-09-17T02:55:22.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.886+0000 7f0984357640 1 -- start start 2024-09-17T02:55:22.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.887+0000 7f0984357640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c0b2630 0x7f097c15fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:22.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.887+0000 7f0984357640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c0b7c80 0x7f097c0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:22.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.887+0000 7f0984357640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0d3490 0x7f097c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:22.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.887+0000 7f0984357640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f097c0b6bd0 con 0x7f097c0d3490 2024-09-17T02:55:22.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.887+0000 7f0984357640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f097c0b6a50 con 0x7f097c0b2630 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.887+0000 7f0984357640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f097c0b6d50 con 0x7f097c0b7c80 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.887+0000 7f09828f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0d3490 0x7f097c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09828f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0d3490 0x7f097c0c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54622/0 (socket says 172.21.15.104:54622) 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09828f4640 1 -- 172.21.15.104:0/1425551970 learned_addr learned my addr 172.21.15.104:0/1425551970 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09820f3640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c0b2630 0x7f097c15fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09818f2640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c0b7c80 0x7f097c0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09828f4640 1 -- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c0b7c80 msgr2=0x7f097c0c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09828f4640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c0b7c80 0x7f097c0c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09828f4640 1 -- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c0b2630 msgr2=0x7f097c15fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09828f4640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c0b2630 0x7f097c15fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09828f4640 1 -- 172.21.15.104:0/1425551970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c0cbac0 con 0x7f097c0d3490 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09820f3640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c0b2630 0x7f097c15fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:22.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f09828f4640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0d3490 0x7f097c0c9e80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f097400c770 tx=0x7f097400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f097affd640 1 -- 172.21.15.104:0/1425551970 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974007bb0 con 0x7f097c0d3490 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f097affd640 1 -- 172.21.15.104:0/1425551970 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0974007e40 con 0x7f097c0d3490 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f097affd640 1 -- 172.21.15.104:0/1425551970 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974005280 con 0x7f097c0d3490 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097c0cbda0 con 0x7f097c0d3490 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.888+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097c0cc360 con 0x7f097c0d3490 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.889+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f097c0cb830 con 0x7f097c0d3490 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.890+0000 7f097affd640 1 -- 172.21.15.104:0/1425551970 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0974005420 con 0x7f097c0d3490 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.890+0000 7f097affd640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0968078b90 0x7f096807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.891+0000 7f097affd640 1 -- 172.21.15.104:0/1425551970 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f097409b020 con 0x7f097c0d3490 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.891+0000 7f09820f3640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0968078b90 0x7f096807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:22.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.891+0000 7f09820f3640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0968078b90 0x7f096807b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f096c009fc0 tx=0x7f096c009550 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:22.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:22.895+0000 7f097affd640 1 -- 172.21.15.104:0/1425551970 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0974014030 con 0x7f097c0d3490 2024-09-17T02:55:23.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.105+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f097c0b2a40 con 0x7f097c0d3490 2024-09-17T02:55:23.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.760+0000 7f097affd640 1 -- 172.21.15.104:0/1425551970 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f0974063550 con 0x7f097c0d3490 2024-09-17T02:55:23.761 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T02:55:23.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0968078b90 msgr2=0x7f096807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:23.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0968078b90 0x7f096807b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f096c009fc0 tx=0x7f096c009550 comp rx=0 tx=0).stop 2024-09-17T02:55:23.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0d3490 msgr2=0x7f097c0c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:23.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0d3490 0x7f097c0c9e80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f097400c770 tx=0x7f097400cc30 comp rx=0 tx=0).stop 2024-09-17T02:55:23.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 shutdown_connections 2024-09-17T02:55:23.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0968078b90 0x7f096807b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f097c0d3490 0x7f097c0c9e80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c0b7c80 0x7f097c0c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 --2- 172.21.15.104:0/1425551970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c0b2630 0x7f097c15fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.768+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 >> 172.21.15.104:0/1425551970 conn(0x7f097c0d2970 msgr2=0x7f097c15cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:23.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.769+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 shutdown_connections 2024-09-17T02:55:23.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.769+0000 7f0984357640 1 -- 172.21.15.104:0/1425551970 wait complete. 2024-09-17T02:55:23.785 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 -- 172.21.15.104:0/285190134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 msgr2=0x7f84b80b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/285190134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 0x7f84b80b65a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f84b8163b80 tx=0x7f84a802a560 comp rx=0 tx=0).stop 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 -- 172.21.15.104:0/285190134 shutdown_connections 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/285190134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84b81611d0 0x7f84b81615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/285190134 >> v2:172.21.15.192:3300/0 conn(0x7f84b81630c0 0x7f84b80b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/285190134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 0x7f84b80b65a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 -- 172.21.15.104:0/285190134 >> 172.21.15.104:0/285190134 conn(0x7f84b8069120 msgr2=0x7f84b8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 -- 172.21.15.104:0/285190134 shutdown_connections 2024-09-17T02:55:23.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.900+0000 7f84bc8d3640 1 -- 172.21.15.104:0/285190134 wait complete. 2024-09-17T02:55:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.902+0000 7f84bc8d3640 1 Processor -- start 2024-09-17T02:55:23.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.902+0000 7f84bc8d3640 1 -- start start 2024-09-17T02:55:23.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84bc8d3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b81611d0 0x7f84b81f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:23.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84bc8d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 0x7f84b81f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:23.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84bc8d3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84b81630c0 0x7f84b815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:23.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84bc8d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8162230 con 0x7f84b8162cb0 2024-09-17T02:55:23.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84bc8d3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f84b81620b0 con 0x7f84b81611d0 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84bc8d3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f84b81623b0 con 0x7f84b81630c0 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84b5d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 0x7f84b81f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84b5d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 0x7f84b81f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54642/0 (socket says 172.21.15.104:54642) 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84b5d9b640 1 -- 172.21.15.104:0/2812963254 learned_addr learned my addr 172.21.15.104:0/2812963254 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84b659c640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b81611d0 0x7f84b81f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.903+0000 7f84b6d9d640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84b81630c0 0x7f84b815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84b5d9b640 1 -- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84b81630c0 msgr2=0x7f84b815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84b5d9b640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84b81630c0 0x7f84b815ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84b5d9b640 1 -- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b81611d0 msgr2=0x7f84b81f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84b5d9b640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b81611d0 0x7f84b81f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:23.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84b5d9b640 1 -- 172.21.15.104:0/2812963254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b80ce210 con 0x7f84b8162cb0 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84b659c640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b81611d0 0x7f84b81f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84b6d9d640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84b81630c0 0x7f84b815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84b5d9b640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 0x7f84b81f6a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00b410 tx=0x7f84ac009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84a6ffd640 1 -- 172.21.15.104:0/2812963254 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac015020 con 0x7f84b8162cb0 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84a6ffd640 1 -- 172.21.15.104:0/2812963254 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84ac011940 con 0x7f84b8162cb0 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84a6ffd640 1 -- 172.21.15.104:0/2812963254 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011d90 con 0x7f84b8162cb0 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b80ce4f0 con 0x7f84b8162cb0 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.904+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b80cc080 con 0x7f84b8162cb0 2024-09-17T02:55:23.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.905+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b81615e0 con 0x7f84b8162cb0 2024-09-17T02:55:23.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.906+0000 7f84a6ffd640 1 -- 172.21.15.104:0/2812963254 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84ac018020 con 0x7f84b8162cb0 2024-09-17T02:55:23.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.906+0000 7f84a6ffd640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8498078b90 0x7f849807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:23.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.906+0000 7f84a6ffd640 1 -- 172.21.15.104:0/2812963254 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f84ac09ac80 con 0x7f84b8162cb0 2024-09-17T02:55:23.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.906+0000 7f84b659c640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8498078b90 0x7f849807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:23.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.907+0000 7f84b659c640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8498078b90 0x7f849807b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84a8034000 tx=0x7f84a8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:23.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:23.911+0000 7f84a6ffd640 1 -- 172.21.15.104:0/2812963254 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84ac01f020 con 0x7f84b8162cb0 2024-09-17T02:55:24.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.084+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84b80ba610 con 0x7f84b8162cb0 2024-09-17T02:55:24.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.086+0000 7f84a6ffd640 1 -- 172.21.15.104:0/2812963254 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16790 (secure 0 0 0) 0x7f84ac0630c0 con 0x7f84b8162cb0 2024-09-17T02:55:24.084 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:24.084 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":31,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:23.106321+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:21.060997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:22.068496+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8498078b90 msgr2=0x7f849807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8498078b90 0x7f849807b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84a8034000 tx=0x7f84a8004730 comp rx=0 tx=0).stop 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 msgr2=0x7f84b81f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 0x7f84b81f6a00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00b410 tx=0x7f84ac009f90 comp rx=0 tx=0).stop 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 shutdown_connections 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8498078b90 0x7f849807b0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84b81630c0 0x7f84b815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84b8162cb0 0x7f84b81f6a00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 --2- 172.21.15.104:0/2812963254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b81611d0 0x7f84b81f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 >> 172.21.15.104:0/2812963254 conn(0x7f84b8069120 msgr2=0x7f84b8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:24.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 shutdown_connections 2024-09-17T02:55:24.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.088+0000 7f84bc8d3640 1 -- 172.21.15.104:0/2812963254 wait complete. 2024-09-17T02:55:24.098 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:24.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.213+0000 7f7d7a55e640 1 -- 172.21.15.104:0/467914880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d5c005270 msgr2=0x7f7d5c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.213+0000 7f7d7a55e640 1 --2- 172.21.15.104:0/467914880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d5c005270 0x7f7d5c00b9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c005fd0 tx=0x7f7d5c005830 comp rx=0 tx=0).stop 2024-09-17T02:55:24.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.213+0000 7f7d7a55e640 1 -- 172.21.15.104:0/467914880 shutdown_connections 2024-09-17T02:55:24.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.213+0000 7f7d7a55e640 1 --2- 172.21.15.104:0/467914880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d5c005270 0x7f7d5c00b9c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.213+0000 7f7d7a55e640 1 -- 172.21.15.104:0/467914880 >> 172.21.15.104:0/467914880 conn(0x7f7d740b44a0 msgr2=0x7f7d740b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:24.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.213+0000 7f7d7a55e640 1 -- 172.21.15.104:0/467914880 shutdown_connections 2024-09-17T02:55:24.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.213+0000 7f7d7a55e640 1 -- 172.21.15.104:0/467914880 wait complete. 2024-09-17T02:55:24.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.215+0000 7f7d7a55e640 1 Processor -- start 2024-09-17T02:55:24.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.215+0000 7f7d7a55e640 1 -- start start 2024-09-17T02:55:24.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d7a55e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d5c005270 0x7f7d740c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d7a55e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d740b5fb0 0x7f7d740b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d7a55e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d741f7ce0 0x7f7d740b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d7a55e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7d740d02d0 con 0x7f7d740b5fb0 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d7a55e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7d740d0150 con 0x7f7d741f7ce0 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d7a55e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7d740b39c0 con 0x7f7d5c005270 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d740b5fb0 0x7f7d740b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d740b5fb0 0x7f7d740b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59166/0 (socket says 172.21.15.104:59166) 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 -- 172.21.15.104:0/4046339583 learned_addr learned my addr 172.21.15.104:0/4046339583 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d78afb640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d741f7ce0 0x7f7d740b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d73fff640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d5c005270 0x7f7d740c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 -- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d5c005270 msgr2=0x7f7d740c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d5c005270 0x7f7d740c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 -- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d741f7ce0 msgr2=0x7f7d740b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d741f7ce0 0x7f7d740b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 -- 172.21.15.104:0/4046339583 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d740cc9a0 con 0x7f7d740b5fb0 2024-09-17T02:55:24.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d737fe640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d740b5fb0 0x7f7d740b18e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800e5c0 tx=0x7f7d6800ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:24.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d70ff9640 1 -- 172.21.15.104:0/4046339583 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68015070 con 0x7f7d740b5fb0 2024-09-17T02:55:24.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d70ff9640 1 -- 172.21.15.104:0/4046339583 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d68010980 con 0x7f7d740b5fb0 2024-09-17T02:55:24.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d741f7200 con 0x7f7d740b5fb0 2024-09-17T02:55:24.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.217+0000 7f7d70ff9640 1 -- 172.21.15.104:0/4046339583 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68010db0 con 0x7f7d740b5fb0 2024-09-17T02:55:24.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.218+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d74158fb0 con 0x7f7d740b5fb0 2024-09-17T02:55:24.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.218+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d740b3eb0 con 0x7f7d740b5fb0 2024-09-17T02:55:24.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.219+0000 7f7d70ff9640 1 -- 172.21.15.104:0/4046339583 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d68018070 con 0x7f7d740b5fb0 2024-09-17T02:55:24.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.220+0000 7f7d70ff9640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7d60078b90 0x7f7d6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.220+0000 7f7d70ff9640 1 -- 172.21.15.104:0/4046339583 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f7d6809b130 con 0x7f7d740b5fb0 2024-09-17T02:55:24.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.220+0000 7f7d73fff640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7d60078b90 0x7f7d6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.220+0000 7f7d73fff640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7d60078b90 0x7f7d6007b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d64006500 tx=0x7f7d64006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:24.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.224+0000 7f7d70ff9640 1 -- 172.21.15.104:0/4046339583 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7d68063570 con 0x7f7d740b5fb0 2024-09-17T02:55:24.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.400+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d74159270 con 0x7f7d740b5fb0 2024-09-17T02:55:24.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.401+0000 7f7d70ff9640 1 -- 172.21.15.104:0/4046339583 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16790 (secure 0 0 0) 0x7f7d68062e70 con 0x7f7d740b5fb0 2024-09-17T02:55:24.400 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:24.400 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":31,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:23.106321+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:21.060997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:22.068496+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:24.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7d60078b90 msgr2=0x7f7d6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7d60078b90 0x7f7d6007b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d64006500 tx=0x7f7d64006b70 comp rx=0 tx=0).stop 2024-09-17T02:55:24.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d740b5fb0 msgr2=0x7f7d740b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d740b5fb0 0x7f7d740b18e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800e5c0 tx=0x7f7d6800ea80 comp rx=0 tx=0).stop 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 shutdown_connections 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7d60078b90 0x7f7d6007b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d741f7ce0 0x7f7d740b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7d740b5fb0 0x7f7d740b18e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 --2- 172.21.15.104:0/4046339583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d5c005270 0x7f7d740c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.403+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 >> 172.21.15.104:0/4046339583 conn(0x7f7d740b44a0 msgr2=0x7f7d740b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.404+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 shutdown_connections 2024-09-17T02:55:24.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.404+0000 7f7d7a55e640 1 -- 172.21.15.104:0/4046339583 wait complete. 2024-09-17T02:55:24.414 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T02:55:24.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.531+0000 7f768bd19640 1 -- 172.21.15.104:0/902554532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f768415faf0 msgr2=0x7f76840b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.531+0000 7f768bd19640 1 --2- 172.21.15.104:0/902554532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f768415faf0 0x7f76840b65e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7674009830 tx=0x7f767402a410 comp rx=0 tx=0).stop 2024-09-17T02:55:24.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.531+0000 7f768bd19640 1 -- 172.21.15.104:0/902554532 shutdown_connections 2024-09-17T02:55:24.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.531+0000 7f768bd19640 1 --2- 172.21.15.104:0/902554532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76840b6b20 0x7f76840d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.531+0000 7f768bd19640 1 --2- 172.21.15.104:0/902554532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f768415faf0 0x7f76840b65e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.531+0000 7f768bd19640 1 -- 172.21.15.104:0/902554532 >> 172.21.15.104:0/902554532 conn(0x7f7684069120 msgr2=0x7f7684069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:24.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.531+0000 7f768bd19640 1 -- 172.21.15.104:0/902554532 shutdown_connections 2024-09-17T02:55:24.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.531+0000 7f768bd19640 1 -- 172.21.15.104:0/902554532 wait complete. 2024-09-17T02:55:24.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.533+0000 7f768bd19640 1 Processor -- start 2024-09-17T02:55:24.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.533+0000 7f768bd19640 1 -- start start 2024-09-17T02:55:24.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f768bd19640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76840b6b20 0x7f76841f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f768bd19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f768415f6e0 0x7f768415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f768bd19640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f768415faf0 0x7f76841f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f768bd19640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f76840d3ac0 con 0x7f768415f6e0 2024-09-17T02:55:24.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f768bd19640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76840d3940 con 0x7f76840b6b20 2024-09-17T02:55:24.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f768bd19640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f76840d3c40 con 0x7f768415faf0 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f76892b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f768415f6e0 0x7f768415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f76892b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f768415f6e0 0x7f768415e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59176/0 (socket says 172.21.15.104:59176) 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f76892b4640 1 -- 172.21.15.104:0/3090737469 learned_addr learned my addr 172.21.15.104:0/3090737469 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f768a2b6640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f768415faf0 0x7f76841f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.534+0000 7f7689ab5640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76840b6b20 0x7f76841f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f76892b4640 1 -- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f768415faf0 msgr2=0x7f76841f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f76892b4640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f768415faf0 0x7f76841f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f76892b4640 1 -- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76840b6b20 msgr2=0x7f76841f97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f76892b4640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76840b6b20 0x7f76841f97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f76892b4640 1 -- 172.21.15.104:0/3090737469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76841f9d30 con 0x7f768415f6e0 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f768a2b6640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f768415faf0 0x7f76841f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f76892b4640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f768415f6e0 0x7f768415e520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7674009950 tx=0x7f7674003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f767a7fc640 1 -- 172.21.15.104:0/3090737469 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767403f030 con 0x7f768415f6e0 2024-09-17T02:55:24.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f767a7fc640 1 -- 172.21.15.104:0/3090737469 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7674004510 con 0x7f768415f6e0 2024-09-17T02:55:24.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768415ea60 con 0x7f768415f6e0 2024-09-17T02:55:24.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f767a7fc640 1 -- 172.21.15.104:0/3090737469 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674037040 con 0x7f768415f6e0 2024-09-17T02:55:24.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.535+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76841fa240 con 0x7f768415f6e0 2024-09-17T02:55:24.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.536+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f768406e4d0 con 0x7f768415f6e0 2024-09-17T02:55:24.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.537+0000 7f767a7fc640 1 -- 172.21.15.104:0/3090737469 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7674042070 con 0x7f768415f6e0 2024-09-17T02:55:24.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.537+0000 7f767a7fc640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7668078b90 0x7f766807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.537+0000 7f767a7fc640 1 -- 172.21.15.104:0/3090737469 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f76740ba9f0 con 0x7f768415f6e0 2024-09-17T02:55:24.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.538+0000 7f7689ab5640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7668078b90 0x7f766807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.538+0000 7f7689ab5640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7668078b90 0x7f766807b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7680002230 tx=0x7f7680009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:24.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.542+0000 7f767a7fc640 1 -- 172.21.15.104:0/3090737469 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f768406e4d0 con 0x7f768415f6e0 2024-09-17T02:55:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.749+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f76841f6200 con 0x7f768415f6e0 2024-09-17T02:55:24.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.761+0000 7f767a7fc640 1 -- 172.21.15.104:0/3090737469 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f7674049070 con 0x7f768415f6e0 2024-09-17T02:55:24.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7668078b90 msgr2=0x7f766807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7668078b90 0x7f766807b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7680002230 tx=0x7f7680009040 comp rx=0 tx=0).stop 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f768415f6e0 msgr2=0x7f768415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f768415f6e0 0x7f768415e520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7674009950 tx=0x7f7674003b60 comp rx=0 tx=0).stop 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 shutdown_connections 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7668078b90 0x7f766807b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f768415faf0 0x7f76841f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f768415f6e0 0x7f768415e520 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 --2- 172.21.15.104:0/3090737469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76840b6b20 0x7f76841f97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 >> 172.21.15.104:0/3090737469 conn(0x7f7684069120 msgr2=0x7f76840b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 shutdown_connections 2024-09-17T02:55:24.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.763+0000 7f768bd19640 1 -- 172.21.15.104:0/3090737469 wait complete. 2024-09-17T02:55:24.774 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T02:55:24.774 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T02:55:24.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 -- 172.21.15.104:0/2156482630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b6f70 msgr2=0x7f0a3415ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 --2- 172.21.15.104:0/2156482630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b6f70 0x7f0a3415ef90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0a340d1fc0 tx=0x7f0a2402a4d0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 -- 172.21.15.104:0/2156482630 shutdown_connections 2024-09-17T02:55:24.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 --2- 172.21.15.104:0/2156482630 >> v2:172.21.15.192:3300/0 conn(0x7f0a340d1710 0x7f0a340cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 --2- 172.21.15.104:0/2156482630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a340b3b00 0x7f0a340d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 --2- 172.21.15.104:0/2156482630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b6f70 0x7f0a3415ef90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 -- 172.21.15.104:0/2156482630 >> 172.21.15.104:0/2156482630 conn(0x7f0a34073df0 msgr2=0x7f0a34068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:24.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 -- 172.21.15.104:0/2156482630 shutdown_connections 2024-09-17T02:55:24.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.891+0000 7f0a39783640 1 -- 172.21.15.104:0/2156482630 wait complete. 2024-09-17T02:55:24.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.892+0000 7f0a39783640 1 Processor -- start 2024-09-17T02:55:24.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.893+0000 7f0a39783640 1 -- start start 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a39783640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b3b00 0x7f0a3414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a39783640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a340b6f70 0x7f0a340c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a39783640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a340d1710 0x7f0a340ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a39783640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a340d01f0 con 0x7f0a340b3b00 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a39783640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a340d0070 con 0x7f0a340b6f70 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a39783640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0a340d0370 con 0x7f0a340d1710 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b3b00 0x7f0a3414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b3b00 0x7f0a3414fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59202/0 (socket says 172.21.15.104:59202) 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 -- 172.21.15.104:0/248733703 learned_addr learned my addr 172.21.15.104:0/248733703 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:24.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a2a7fc640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a340b6f70 0x7f0a340c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a337fe640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a340d1710 0x7f0a340ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 -- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a340d1710 msgr2=0x7f0a340ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a340d1710 0x7f0a340ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 -- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a340b6f70 msgr2=0x7f0a340c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a340b6f70 0x7f0a340c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 -- 172.21.15.104:0/248733703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a340cd0d0 con 0x7f0a340b3b00 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a2a7fc640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a340b6f70 0x7f0a340c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.894+0000 7f0a32ffd640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b3b00 0x7f0a3414fda0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0a24034040 tx=0x7f0a240039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.895+0000 7f0a2bfff640 1 -- 172.21.15.104:0/248733703 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2403e030 con 0x7f0a340b3b00 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.895+0000 7f0a2bfff640 1 -- 172.21.15.104:0/248733703 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a240047a0 con 0x7f0a340b3b00 2024-09-17T02:55:24.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.895+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a340cd3b0 con 0x7f0a340b3b00 2024-09-17T02:55:24.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.895+0000 7f0a2bfff640 1 -- 172.21.15.104:0/248733703 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24035040 con 0x7f0a340b3b00 2024-09-17T02:55:24.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.895+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a340c9540 con 0x7f0a340b3b00 2024-09-17T02:55:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.896+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3415ef90 con 0x7f0a340b3b00 2024-09-17T02:55:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.897+0000 7f0a2bfff640 1 -- 172.21.15.104:0/248733703 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a24041030 con 0x7f0a340b3b00 2024-09-17T02:55:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.897+0000 7f0a2bfff640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a14078b90 0x7f0a1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.897+0000 7f0a2bfff640 1 -- 172.21.15.104:0/248733703 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0a240bb620 con 0x7f0a340b3b00 2024-09-17T02:55:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.897+0000 7f0a2a7fc640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a14078b90 0x7f0a1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:24.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.898+0000 7f0a2a7fc640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a14078b90 0x7f0a1407b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0a340cefd0 tx=0x7f0a1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:24.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:24.902+0000 7f0a2bfff640 1 -- 172.21.15.104:0/248733703 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a24083a60 con 0x7f0a340b3b00 2024-09-17T02:55:25.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.112+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0a3406d3d0 con 0x7f0a340b3b00 2024-09-17T02:55:25.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.771+0000 7f0a2bfff640 1 -- 172.21.15.104:0/248733703 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f0a24083360 con 0x7f0a340b3b00 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a14078b90 msgr2=0x7f0a1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a14078b90 0x7f0a1407b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0a340cefd0 tx=0x7f0a1c008040 comp rx=0 tx=0).stop 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b3b00 msgr2=0x7f0a3414fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b3b00 0x7f0a3414fda0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0a24034040 tx=0x7f0a240039e0 comp rx=0 tx=0).stop 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 shutdown_connections 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a14078b90 0x7f0a1407b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a340b6f70 0x7f0a340c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a340d1710 0x7f0a340ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 --2- 172.21.15.104:0/248733703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a340b3b00 0x7f0a3414fda0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 >> 172.21.15.104:0/248733703 conn(0x7f0a34073df0 msgr2=0x7f0a340d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 shutdown_connections 2024-09-17T02:55:25.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.774+0000 7f0a39783640 1 -- 172.21.15.104:0/248733703 wait complete. 2024-09-17T02:55:25.786 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T02:55:25.786 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:25.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.905+0000 7fb1f5816640 1 -- 172.21.15.104:0/2626228019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 msgr2=0x7fb1dc0040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:25.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.905+0000 7fb1f5816640 1 --2- 172.21.15.104:0/2626228019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 0x7fb1dc0040b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0001830 tx=0x7fb1dc005830 comp rx=0 tx=0).stop 2024-09-17T02:55:25.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.905+0000 7fb1ef7fe640 1 -- 172.21.15.104:0/2626228019 reap_dead start 2024-09-17T02:55:25.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.905+0000 7fb1f5816640 1 -- 172.21.15.104:0/2626228019 shutdown_connections 2024-09-17T02:55:25.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.905+0000 7fb1f5816640 1 -- 172.21.15.104:0/2626228019 >> 172.21.15.104:0/2626228019 conn(0x7fb1f0073df0 msgr2=0x7fb1f0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:25.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.905+0000 7fb1f5816640 1 -- 172.21.15.104:0/2626228019 shutdown_connections 2024-09-17T02:55:25.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.905+0000 7fb1f5816640 1 -- 172.21.15.104:0/2626228019 wait complete. 2024-09-17T02:55:25.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.907+0000 7fb1f5816640 1 Processor -- start 2024-09-17T02:55:25.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.907+0000 7fb1f5816640 1 -- start start 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1f5816640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 0x7fb1f01f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1f5816640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f0149910 0x7fb1f00b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1f5816640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f00b5de0 0x7fb1f00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1f5816640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f015f4e0 con 0x7fb1dc003c60 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1f5816640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f015f360 con 0x7fb1f00b5de0 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1f5816640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f00d3c00 con 0x7fb1f0149910 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1eeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 0x7fb1f01f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1eeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 0x7fb1f01f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59206/0 (socket says 172.21.15.104:59206) 2024-09-17T02:55:25.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1eeffd640 1 -- 172.21.15.104:0/4077560667 learned_addr learned my addr 172.21.15.104:0/4077560667 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1ef7fe640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f00b5de0 0x7fb1f00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.908+0000 7fb1e67fc640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f0149910 0x7fb1f00b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1eeffd640 1 -- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f0149910 msgr2=0x7fb1f00b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1eeffd640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f0149910 0x7fb1f00b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1eeffd640 1 -- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f00b5de0 msgr2=0x7fb1f00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1eeffd640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f00b5de0 0x7fb1f00cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1eeffd640 1 -- 172.21.15.104:0/4077560667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f01f9fc0 con 0x7fb1dc003c60 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1eeffd640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 0x7fb1f01f9a80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb1e002aa50 tx=0x7fb1e00060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1ecff9640 1 -- 172.21.15.104:0/4077560667 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0003a00 con 0x7fb1dc003c60 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1ecff9640 1 -- 172.21.15.104:0/4077560667 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1e0003c90 con 0x7fb1dc003c60 2024-09-17T02:55:25.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1ecff9640 1 -- 172.21.15.104:0/4077560667 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e0003e60 con 0x7fb1dc003c60 2024-09-17T02:55:25.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f01f6140 con 0x7fb1dc003c60 2024-09-17T02:55:25.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.909+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f01f6700 con 0x7fb1dc003c60 2024-09-17T02:55:25.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.910+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f00d4160 con 0x7fb1dc003c60 2024-09-17T02:55:25.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.911+0000 7fb1ecff9640 1 -- 172.21.15.104:0/4077560667 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1e0045020 con 0x7fb1dc003c60 2024-09-17T02:55:25.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.911+0000 7fb1ecff9640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1d0078b90 0x7fb1d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:25.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.911+0000 7fb1ecff9640 1 -- 172.21.15.104:0/4077560667 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb1e00babc0 con 0x7fb1dc003c60 2024-09-17T02:55:25.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.912+0000 7fb1e67fc640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1d0078b90 0x7fb1d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:25.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.912+0000 7fb1e67fc640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1d0078b90 0x7fb1d007b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00c88b0 tx=0x7fb1d8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:25.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:25.916+0000 7fb1ecff9640 1 -- 172.21.15.104:0/4077560667 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1f01f9fc0 con 0x7fb1dc003c60 2024-09-17T02:55:26.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.125+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1f00d03b0 con 0x7fb1dc003c60 2024-09-17T02:55:26.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.126+0000 7fb1ecff9640 1 -- 172.21.15.104:0/4077560667 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5232 (secure 0 0 0) 0x7fb1e00830c0 con 0x7fb1dc003c60 2024-09-17T02:55:26.125 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:26.126 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:23.106277+0000","modified":"2024-09-17T02:55:25.113008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/477751550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":477751550},{"type":"v1","addr":"172.21.15.104:6835","nonce":477751550}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-09-17T02:55:26.126 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-09-17T02:55:26.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1d0078b90 msgr2=0x7fb1d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1d0078b90 0x7fb1d007b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00c88b0 tx=0x7fb1d8005f90 comp rx=0 tx=0).stop 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 msgr2=0x7fb1f01f9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 0x7fb1f01f9a80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb1e002aa50 tx=0x7fb1e00060e0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 shutdown_connections 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1d0078b90 0x7fb1d007b0a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f00b5de0 0x7fb1f00cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f0149910 0x7fb1f00b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 --2- 172.21.15.104:0/4077560667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1dc003c60 0x7fb1f01f9a80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 >> 172.21.15.104:0/4077560667 conn(0x7fb1f0073df0 msgr2=0x7fb1f00b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 shutdown_connections 2024-09-17T02:55:26.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.128+0000 7fb1f5816640 1 -- 172.21.15.104:0/4077560667 wait complete. 2024-09-17T02:55:26.138 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:26.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.252+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2864369644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eac0b6f70 msgr2=0x7f6eac15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.252+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2864369644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eac0b6f70 0x7f6eac15ef90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c005fd0 tx=0x7f6e9c02a5d0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.252+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2864369644 shutdown_connections 2024-09-17T02:55:26.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.252+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2864369644 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eac0d18e0 0x7f6eac0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.252+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2864369644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eac0b6f70 0x7f6eac15ef90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.252+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2864369644 >> 172.21.15.104:0/2864369644 conn(0x7f6eac073df0 msgr2=0x7f6eac068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:26.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.252+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2864369644 shutdown_connections 2024-09-17T02:55:26.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.252+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2864369644 wait complete. 2024-09-17T02:55:26.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.253+0000 7f6eb16e5640 1 Processor -- start 2024-09-17T02:55:26.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.254+0000 7f6eb16e5640 1 -- start start 2024-09-17T02:55:26.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6eb16e5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eac0b3b00 0x7f6eac1f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6eb16e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eac0b6f70 0x7f6eac14ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6eb16e5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eac0d18e0 0x7f6eac160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6eb16e5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac0d3e40 con 0x7f6eac0b6f70 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6eb16e5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac0d3cc0 con 0x7f6eac0d18e0 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6eb16e5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6eac0d3fc0 con 0x7f6eac0b3b00 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6ea27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eac0b6f70 0x7f6eac14ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6ea27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eac0b6f70 0x7f6eac14ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59208/0 (socket says 172.21.15.104:59208) 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6ea27fc640 1 -- 172.21.15.104:0/2321244024 learned_addr learned my addr 172.21.15.104:0/2321244024 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6eab7fe640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eac0d18e0 0x7f6eac160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6eaaffd640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eac0b3b00 0x7f6eac1f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6ea27fc640 1 -- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eac0b3b00 msgr2=0x7f6eac1f65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6ea27fc640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eac0b3b00 0x7f6eac1f65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6ea27fc640 1 -- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eac0d18e0 msgr2=0x7f6eac160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6ea27fc640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eac0d18e0 0x7f6eac160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.255+0000 7f6ea27fc640 1 -- 172.21.15.104:0/2321244024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eac1f6b20 con 0x7f6eac0b6f70 2024-09-17T02:55:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.256+0000 7f6ea27fc640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eac0b6f70 0x7f6eac14ff10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400c430 tx=0x7f6e9400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.256+0000 7f6ea3fff640 1 -- 172.21.15.104:0/2321244024 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94017070 con 0x7f6eac0b6f70 2024-09-17T02:55:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.256+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eac150450 con 0x7f6eac0b6f70 2024-09-17T02:55:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.256+0000 7f6ea3fff640 1 -- 172.21.15.104:0/2321244024 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e940053c0 con 0x7f6eac0b6f70 2024-09-17T02:55:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.256+0000 7f6ea3fff640 1 -- 172.21.15.104:0/2321244024 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94003850 con 0x7f6eac0b6f70 2024-09-17T02:55:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.256+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eac15fbd0 con 0x7f6eac0b6f70 2024-09-17T02:55:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.257+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eac1605d0 con 0x7f6eac0b6f70 2024-09-17T02:55:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.257+0000 7f6ea3fff640 1 -- 172.21.15.104:0/2321244024 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e9401a070 con 0x7f6eac0b6f70 2024-09-17T02:55:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.258+0000 7f6ea3fff640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.258+0000 7f6ea3fff640 1 -- 172.21.15.104:0/2321244024 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6e9409a220 con 0x7f6eac0b6f70 2024-09-17T02:55:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.258+0000 7f6eaaffd640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.259+0000 7f6eaaffd640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c033000 tx=0x7f6e9c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.262+0000 7f6ea3fff640 1 -- 172.21.15.104:0/2321244024 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6eac1f6b20 con 0x7f6eac0b6f70 2024-09-17T02:55:26.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.438+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6eac0d5480 con 0x7f6eac0b6f70 2024-09-17T02:55:26.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.439+0000 7f6ea3fff640 1 -- 172.21.15.104:0/2321244024 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16777 (secure 0 0 0) 0x7f6e940625e0 con 0x7f6eac0b6f70 2024-09-17T02:55:26.437 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:26.438 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":32,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:24.751623+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:21.060997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:22.068496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e8c078b90 msgr2=0x7f6e8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c033000 tx=0x7f6e9c004730 comp rx=0 tx=0).stop 2024-09-17T02:55:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eac0b6f70 msgr2=0x7f6eac14ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eac0b6f70 0x7f6eac14ff10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400c430 tx=0x7f6e9400c8f0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 shutdown_connections 2024-09-17T02:55:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e8c078b90 0x7f6e8c07b0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eac0d18e0 0x7f6eac160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eac0b6f70 0x7f6eac14ff10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 --2- 172.21.15.104:0/2321244024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eac0b3b00 0x7f6eac1f65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 >> 172.21.15.104:0/2321244024 conn(0x7f6eac073df0 msgr2=0x7f6eac068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 shutdown_connections 2024-09-17T02:55:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.441+0000 7f6eb16e5640 1 -- 172.21.15.104:0/2321244024 wait complete. 2024-09-17T02:55:26.451 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:55:26.452 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:55:26.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.566+0000 7f4755615640 1 -- 172.21.15.104:0/4055773929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47500b3b00 msgr2=0x7f47500d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.566+0000 7f4755615640 1 --2- 172.21.15.104:0/4055773929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47500b3b00 0x7f47500d11d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4744009830 tx=0x7f474402a480 comp rx=0 tx=0).stop 2024-09-17T02:55:26.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.566+0000 7f4755615640 1 -- 172.21.15.104:0/4055773929 shutdown_connections 2024-09-17T02:55:26.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.566+0000 7f4755615640 1 --2- 172.21.15.104:0/4055773929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47500b3b00 0x7f47500d11d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.566+0000 7f4755615640 1 --2- 172.21.15.104:0/4055773929 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47500b6f70 0x7f475015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.566+0000 7f4755615640 1 -- 172.21.15.104:0/4055773929 >> 172.21.15.104:0/4055773929 conn(0x7f4750073df0 msgr2=0x7f4750068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:26.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.566+0000 7f4755615640 1 -- 172.21.15.104:0/4055773929 shutdown_connections 2024-09-17T02:55:26.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.566+0000 7f4755615640 1 -- 172.21.15.104:0/4055773929 wait complete. 2024-09-17T02:55:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.568+0000 7f4755615640 1 Processor -- start 2024-09-17T02:55:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.568+0000 7f4755615640 1 -- start start 2024-09-17T02:55:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f4755615640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47500b3b00 0x7f4750160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f4755615640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47500b6f70 0x7f475014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f4755615640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47500d1710 0x7f4750161a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f4755615640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f47500d01b0 con 0x7f47500b6f70 2024-09-17T02:55:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f4755615640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f47500d0030 con 0x7f47500b3b00 2024-09-17T02:55:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f4755615640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f47500d0330 con 0x7f47500d1710 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f474e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47500b6f70 0x7f475014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f474e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47500b6f70 0x7f475014ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59218/0 (socket says 172.21.15.104:59218) 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.569+0000 7f474e7fc640 1 -- 172.21.15.104:0/2277626037 learned_addr learned my addr 172.21.15.104:0/2277626037 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f474effd640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47500b3b00 0x7f4750160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f474f7fe640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47500d1710 0x7f4750161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f474e7fc640 1 -- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47500d1710 msgr2=0x7f4750161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f474e7fc640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47500d1710 0x7f4750161a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f474e7fc640 1 -- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47500b3b00 msgr2=0x7f4750160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f474e7fc640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47500b3b00 0x7f4750160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f474e7fc640 1 -- 172.21.15.104:0/2277626037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47500c8220 con 0x7f47500b6f70 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f474e7fc640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47500b6f70 0x7f475014ee90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4744009950 tx=0x7f4744033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f47377fe640 1 -- 172.21.15.104:0/2277626037 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744031d60 con 0x7f47500b6f70 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f47377fe640 1 -- 172.21.15.104:0/2277626037 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4744033e10 con 0x7f47500b6f70 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4750160dc0 con 0x7f47500b6f70 2024-09-17T02:55:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f47377fe640 1 -- 172.21.15.104:0/2277626037 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4744033310 con 0x7f47500b6f70 2024-09-17T02:55:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.570+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47500c84c0 con 0x7f47500b6f70 2024-09-17T02:55:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.571+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47500d4880 con 0x7f47500b6f70 2024-09-17T02:55:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.572+0000 7f47377fe640 1 -- 172.21.15.104:0/2277626037 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47440334b0 con 0x7f47500b6f70 2024-09-17T02:55:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.573+0000 7f47377fe640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f473c078bc0 0x7f473c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.573+0000 7f47377fe640 1 -- 172.21.15.104:0/2277626037 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f47440bc140 con 0x7f47500b6f70 2024-09-17T02:55:26.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.573+0000 7f474effd640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f473c078bc0 0x7f473c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.573+0000 7f474effd640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f473c078bc0 0x7f473c07b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4740009b30 tx=0x7f4740005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.577+0000 7f47377fe640 1 -- 172.21.15.104:0/2277626037 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f47500d4880 con 0x7f47500b6f70 2024-09-17T02:55:26.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.748+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47500d2120 con 0x7f473c078bc0 2024-09-17T02:55:26.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.753+0000 7f47377fe640 1 -- 172.21.15.104:0/2277626037 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236272 (secure 0 0 0) 0x7f47500d2120 con 0x7f473c078bc0 2024-09-17T02:55:26.754 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:26.755 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:55:26.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f473c078bc0 msgr2=0x7f473c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f473c078bc0 0x7f473c07b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4740009b30 tx=0x7f4740005f90 comp rx=0 tx=0).stop 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47500b6f70 msgr2=0x7f475014ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47500b6f70 0x7f475014ee90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4744009950 tx=0x7f4744033c20 comp rx=0 tx=0).stop 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 shutdown_connections 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f473c078bc0 0x7f473c07b0d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47500d1710 0x7f4750161a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f47500b6f70 0x7f475014ee90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 --2- 172.21.15.104:0/2277626037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47500b3b00 0x7f4750160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 >> 172.21.15.104:0/2277626037 conn(0x7f4750073df0 msgr2=0x7f475015e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 shutdown_connections 2024-09-17T02:55:26.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.756+0000 7f4755615640 1 -- 172.21.15.104:0/2277626037 wait complete. 2024-09-17T02:55:26.767 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-17T02:55:25.629832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2039,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560460,"statfs":{"total":1600000000,"available":1597911440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000837"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T02:55:17.728259+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:55:17.728259+0000","last_peered":"2024-09-17T02:55:17.728259+0000","last_clean":"2024-09-17T02:55:17.728259+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:55:17.728259+0000","last_undegraded":"2024-09-17T02:55:17.728259+0000","last_fullsized":"2024-09-17T02:55:17.728259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:55:26.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:55:26.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.921+0000 7fdce0789640 1 -- 172.21.15.104:0/631506316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 msgr2=0x7fdcd815bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.921+0000 7fdce0789640 1 --2- 172.21.15.104:0/631506316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 0x7fdcd815bc00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4009830 tx=0x7fdcd402a480 comp rx=0 tx=0).stop 2024-09-17T02:55:26.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.921+0000 7fdce0789640 1 -- 172.21.15.104:0/631506316 shutdown_connections 2024-09-17T02:55:26.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.921+0000 7fdce0789640 1 --2- 172.21.15.104:0/631506316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 0x7fdcd815bc00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.921+0000 7fdce0789640 1 -- 172.21.15.104:0/631506316 >> 172.21.15.104:0/631506316 conn(0x7fdcd80b2450 msgr2=0x7fdcd80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:26.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.921+0000 7fdce0789640 1 -- 172.21.15.104:0/631506316 shutdown_connections 2024-09-17T02:55:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.921+0000 7fdce0789640 1 -- 172.21.15.104:0/631506316 wait complete. 2024-09-17T02:55:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.923+0000 7fdce0789640 1 Processor -- start 2024-09-17T02:55:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.923+0000 7fdce0789640 1 -- start start 2024-09-17T02:55:26.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdce0789640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd8072470 0x7fdcd81f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdce0789640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd8072f90 0x7fdcd80aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdce0789640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 0x7fdcd8156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdce0789640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd80cede0 con 0x7fdcd815b7f0 2024-09-17T02:55:26.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdce0789640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd80cec60 con 0x7fdcd8072470 2024-09-17T02:55:26.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdce0789640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd80cef60 con 0x7fdcd8072f90 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdcded26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 0x7fdcd8156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdcded26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 0x7fdcd8156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59242/0 (socket says 172.21.15.104:59242) 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.924+0000 7fdcded26640 1 -- 172.21.15.104:0/3321103388 learned_addr learned my addr 172.21.15.104:0/3321103388 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcde525640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd8072470 0x7fdcd81f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcddd24640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd8072f90 0x7fdcd80aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcded26640 1 -- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd8072f90 msgr2=0x7fdcd80aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcded26640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd8072f90 0x7fdcd80aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcded26640 1 -- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd8072470 msgr2=0x7fdcd81f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcded26640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd8072470 0x7fdcd81f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcded26640 1 -- 172.21.15.104:0/3321103388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd81f7780 con 0x7fdcd815b7f0 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcddd24640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd8072f90 0x7fdcd80aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcded26640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 0x7fdcd8156310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000caa0 tx=0x7fdcd000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcceffd640 1 -- 172.21.15.104:0/3321103388 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0016020 con 0x7fdcd815b7f0 2024-09-17T02:55:26.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcceffd640 1 -- 172.21.15.104:0/3321103388 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcd000acf0 con 0x7fdcd815b7f0 2024-09-17T02:55:26.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdcceffd640 1 -- 172.21.15.104:0/3321103388 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0012680 con 0x7fdcd815b7f0 2024-09-17T02:55:26.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd81f7a60 con 0x7fdcd815b7f0 2024-09-17T02:55:26.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.925+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd81f8020 con 0x7fdcd815b7f0 2024-09-17T02:55:26.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.926+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd80af290 con 0x7fdcd815b7f0 2024-09-17T02:55:26.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.927+0000 7fdcceffd640 1 -- 172.21.15.104:0/3321103388 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdcd0019020 con 0x7fdcd815b7f0 2024-09-17T02:55:26.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.927+0000 7fdcceffd640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdcbc078b90 0x7fdcbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:26.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.927+0000 7fdcceffd640 1 -- 172.21.15.104:0/3321103388 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fdcd009b180 con 0x7fdcd815b7f0 2024-09-17T02:55:26.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.928+0000 7fdcde525640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdcbc078b90 0x7fdcbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:26.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.928+0000 7fdcde525640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdcbc078b90 0x7fdcbc07b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4034000 tx=0x7fdcd4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:26.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:26.932+0000 7fdcceffd640 1 -- 172.21.15.104:0/3321103388 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdcd0020020 con 0x7fdcd815b7f0 2024-09-17T02:55:27.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.102+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdcd81f7530 con 0x7fdcbc078b90 2024-09-17T02:55:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.107+0000 7fdcceffd640 1 -- 172.21.15.104:0/3321103388 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236272 (secure 0 0 0) 0x7fdcd81f7530 con 0x7fdcbc078b90 2024-09-17T02:55:27.108 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:27.110 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdcbc078b90 msgr2=0x7fdcbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdcbc078b90 0x7fdcbc07b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4034000 tx=0x7fdcd4004730 comp rx=0 tx=0).stop 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 msgr2=0x7fdcd8156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 0x7fdcd8156310 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000caa0 tx=0x7fdcd000cf60 comp rx=0 tx=0).stop 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 shutdown_connections 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdcbc078b90 0x7fdcbc07b0a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdcd815b7f0 0x7fdcd8156310 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcd8072f90 0x7fdcd80aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 --2- 172.21.15.104:0/3321103388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcd8072470 0x7fdcd81f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 >> 172.21.15.104:0/3321103388 conn(0x7fdcd80b2450 msgr2=0x7fdcd8159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:27.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 shutdown_connections 2024-09-17T02:55:27.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.110+0000 7fdce0789640 1 -- 172.21.15.104:0/3321103388 wait complete. 2024-09-17T02:55:27.119 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-17T02:55:25.629832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2039,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560460,"statfs":{"total":1600000000,"available":1597911440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000837"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T02:55:17.728259+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:55:17.728259+0000","last_peered":"2024-09-17T02:55:17.728259+0000","last_clean":"2024-09-17T02:55:17.728259+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:55:17.728259+0000","last_undegraded":"2024-09-17T02:55:17.728259+0000","last_fullsized":"2024-09-17T02:55:17.728259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:55:27.123 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:55:27.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.272+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3457134749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40cfa40 msgr2=0x7f08b40b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.272+0000 7f08b9c0e640 1 --2- 172.21.15.104:0/3457134749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40cfa40 0x7f08b40b63c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f08ac005fd0 tx=0x7f08ac02a820 comp rx=0 tx=0).stop 2024-09-17T02:55:27.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.272+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3457134749 shutdown_connections 2024-09-17T02:55:27.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.272+0000 7f08b9c0e640 1 --2- 172.21.15.104:0/3457134749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40cfa40 0x7f08b40b63c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.272+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3457134749 >> 172.21.15.104:0/3457134749 conn(0x7f08b40d28e0 msgr2=0x7f08b40d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:27.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.272+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3457134749 shutdown_connections 2024-09-17T02:55:27.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.272+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3457134749 wait complete. 2024-09-17T02:55:27.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.274+0000 7f08b9c0e640 1 Processor -- start 2024-09-17T02:55:27.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.274+0000 7f08b9c0e640 1 -- start start 2024-09-17T02:55:27.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b9c0e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b40cf630 0x7f08b40c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:27.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b9c0e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b40cfa40 0x7f08b40ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:27.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b9c0e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40d3400 0x7f08b41516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:27.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b9c0e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f08b40b6a80 con 0x7f08b40d3400 2024-09-17T02:55:27.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b9c0e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f08b40b6900 con 0x7f08b40cf630 2024-09-17T02:55:27.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b9c0e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f08b40b6c00 con 0x7f08b40cfa40 2024-09-17T02:55:27.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40d3400 0x7f08b41516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:27.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40d3400 0x7f08b41516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59266/0 (socket says 172.21.15.104:59266) 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.275+0000 7f08b3fff640 1 -- 172.21.15.104:0/3125177332 learned_addr learned my addr 172.21.15.104:0/3125177332 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b37fe640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b40cf630 0x7f08b40c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b2ffd640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b40cfa40 0x7f08b40ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b3fff640 1 -- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b40cfa40 msgr2=0x7f08b40ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b3fff640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b40cfa40 0x7f08b40ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b3fff640 1 -- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b40cf630 msgr2=0x7f08b40c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b3fff640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b40cf630 0x7f08b40c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b3fff640 1 -- 172.21.15.104:0/3125177332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b40c6540 con 0x7f08b40d3400 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b3fff640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40d3400 0x7f08b41516b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009b30 tx=0x7f08ac032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f089bfff640 1 -- 172.21.15.104:0/3125177332 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac037040 con 0x7f08b40d3400 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f089bfff640 1 -- 172.21.15.104:0/3125177332 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08ac042070 con 0x7f08b40d3400 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b40c6820 con 0x7f08b40d3400 2024-09-17T02:55:27.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f089bfff640 1 -- 172.21.15.104:0/3125177332 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac0042a0 con 0x7f08b40d3400 2024-09-17T02:55:27.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.276+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b40c6de0 con 0x7f08b40d3400 2024-09-17T02:55:27.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.277+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b40cef20 con 0x7f08b40d3400 2024-09-17T02:55:27.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.278+0000 7f089bfff640 1 -- 172.21.15.104:0/3125177332 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f08ac004440 con 0x7f08b40d3400 2024-09-17T02:55:27.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.278+0000 7f089bfff640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08a0078bc0 0x7f08a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:27.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.279+0000 7f089bfff640 1 -- 172.21.15.104:0/3125177332 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f08ac0bba40 con 0x7f08b40d3400 2024-09-17T02:55:27.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.279+0000 7f08b37fe640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08a0078bc0 0x7f08a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:27.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.279+0000 7f08b37fe640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08a0078bc0 0x7f08a007b0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f08a40016f0 tx=0x7f08a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:27.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.283+0000 7f089bfff640 1 -- 172.21.15.104:0/3125177332 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08ac083f10 con 0x7f08b40d3400 2024-09-17T02:55:27.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.452+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08b40b7e50 con 0x7f08a0078bc0 2024-09-17T02:55:27.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.456+0000 7f089bfff640 1 -- 172.21.15.104:0/3125177332 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236272 (secure 0 0 0) 0x7f08b40b7e50 con 0x7f08a0078bc0 2024-09-17T02:55:27.457 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:27.458 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08a0078bc0 msgr2=0x7f08a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08a0078bc0 0x7f08a007b0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f08a40016f0 tx=0x7f08a4009040 comp rx=0 tx=0).stop 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40d3400 msgr2=0x7f08b41516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40d3400 0x7f08b41516b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009b30 tx=0x7f08ac032c90 comp rx=0 tx=0).stop 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 shutdown_connections 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08a0078bc0 0x7f08a007b0d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08b40d3400 0x7f08b41516b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08b40cfa40 0x7f08b40ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 --2- 172.21.15.104:0/3125177332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08b40cf630 0x7f08b40c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 >> 172.21.15.104:0/3125177332 conn(0x7f08b40d28e0 msgr2=0x7f08b40d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:27.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.459+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 shutdown_connections 2024-09-17T02:55:27.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.460+0000 7f08b9c0e640 1 -- 172.21.15.104:0/3125177332 wait complete. 2024-09-17T02:55:27.469 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-17T02:55:25.629832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2039,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560460,"statfs":{"total":1600000000,"available":1597911440,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000837"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:22.735612+0000","last_change":"2024-09-17T02:55:22.735612+0000","last_active":"2024-09-17T02:55:22.735612+0000","last_peered":"2024-09-17T02:55:22.735612+0000","last_clean":"2024-09-17T02:55:22.735612+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:22.735612+0000","last_undegraded":"2024-09-17T02:55:22.735612+0000","last_fullsized":"2024-09-17T02:55:22.735612+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T02:55:21.729380+0000","last_change":"2024-09-17T02:55:21.729380+0000","last_active":"2024-09-17T02:55:21.729380+0000","last_peered":"2024-09-17T02:55:21.729380+0000","last_clean":"2024-09-17T02:55:21.729380+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:55:21.729380+0000","last_undegraded":"2024-09-17T02:55:21.729380+0000","last_fullsized":"2024-09-17T02:55:21.729380+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-17T02:55:17.728259+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:55:17.728259+0000","last_peered":"2024-09-17T02:55:17.728259+0000","last_clean":"2024-09-17T02:55:17.728259+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:55:17.728259+0000","last_undegraded":"2024-09-17T02:55:17.728259+0000","last_fullsized":"2024-09-17T02:55:17.728259+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.473 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-17T02:55:27.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-17T02:55:27.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.476 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-17T02:55:27.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-17T02:55:27.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-17T02:55:27.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-17T02:55:27.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.481 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-17T02:55:27.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.483 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-17T02:55:27.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-17T02:55:27.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-17T02:55:27.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.487 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.488 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-17T02:55:27.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.490 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-17T02:55:27.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.490 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-17T02:55:27.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.490 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-17T02:55:27.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:22.735612+0000', 'last_change': '2024-09-17T02:55:22.735612+0000', 'last_active': '2024-09-17T02:55:22.735612+0000', 'last_peered': '2024-09-17T02:55:22.735612+0000', 'last_clean': '2024-09-17T02:55:22.735612+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:22.735612+0000', 'last_undegraded': '2024-09-17T02:55:22.735612+0000', 'last_fullsized': '2024-09-17T02:55:22.735612+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:22.735612+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.490 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-17T02:55:27.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T02:55:21.729380+0000', 'last_change': '2024-09-17T02:55:21.729380+0000', 'last_active': '2024-09-17T02:55:21.729380+0000', 'last_peered': '2024-09-17T02:55:21.729380+0000', 'last_clean': '2024-09-17T02:55:21.729380+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:55:21.729380+0000', 'last_undegraded': '2024-09-17T02:55:21.729380+0000', 'last_fullsized': '2024-09-17T02:55:21.729380+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'last_clean_scrub_stamp': '2024-09-17T02:55:21.729380+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T02:55:27.491 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T02:55:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.624+0000 7f6e8db4a640 1 -- 172.21.15.104:0/245196159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e70004d40 msgr2=0x7f6e700051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.624+0000 7f6e8db4a640 1 --2- 172.21.15.104:0/245196159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e70004d40 0x7f6e700051f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e80001d90 tx=0x7f6e70005830 comp rx=0 tx=0).stop 2024-09-17T02:55:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.624+0000 7f6e87fff640 1 -- 172.21.15.104:0/245196159 reap_dead start 2024-09-17T02:55:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.624+0000 7f6e8db4a640 1 -- 172.21.15.104:0/245196159 shutdown_connections 2024-09-17T02:55:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.624+0000 7f6e8db4a640 1 -- 172.21.15.104:0/245196159 >> 172.21.15.104:0/245196159 conn(0x7f6e88069120 msgr2=0x7f6e88069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:27.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.624+0000 7f6e8db4a640 1 -- 172.21.15.104:0/245196159 shutdown_connections 2024-09-17T02:55:27.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.624+0000 7f6e8db4a640 1 -- 172.21.15.104:0/245196159 wait complete. 2024-09-17T02:55:27.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.626+0000 7f6e8db4a640 1 Processor -- start 2024-09-17T02:55:27.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.626+0000 7f6e8db4a640 1 -- start start 2024-09-17T02:55:27.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.627+0000 7f6e8db4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e88154110 0x7f6e881587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:27.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.627+0000 7f6e8db4a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e881538e0 0x7f6e88155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.627+0000 7f6e8db4a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8815c280 0x7f6e8815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.627+0000 7f6e8db4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6e88161a90 con 0x7f6e88154110 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.627+0000 7f6e8db4a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e880b6d40 con 0x7f6e8815c280 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.627+0000 7f6e8db4a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6e88161c10 con 0x7f6e881538e0 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e88154110 0x7f6e881587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e88154110 0x7f6e881587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59280/0 (socket says 172.21.15.104:59280) 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 -- 172.21.15.104:0/2552386674 learned_addr learned my addr 172.21.15.104:0/2552386674 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e86ffd640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e881538e0 0x7f6e88155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e87fff640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8815c280 0x7f6e8815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 -- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e881538e0 msgr2=0x7f6e88155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e881538e0 0x7f6e88155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 -- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8815c280 msgr2=0x7f6e8815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8815c280 0x7f6e8815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 -- 172.21.15.104:0/2552386674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e88159230 con 0x7f6e88154110 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e877fe640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e88154110 0x7f6e881587a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6e78011ae0 tx=0x7f6e78009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e6ffff640 1 -- 172.21.15.104:0/2552386674 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7801e070 con 0x7f6e88154110 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e6ffff640 1 -- 172.21.15.104:0/2552386674 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e7800fc10 con 0x7f6e88154110 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e6ffff640 1 -- 172.21.15.104:0/2552386674 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78019410 con 0x7f6e88154110 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8815cbd0 con 0x7f6e88154110 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.628+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8815bb30 con 0x7f6e88154110 2024-09-17T02:55:27.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.629+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8815f600 con 0x7f6e88154110 2024-09-17T02:55:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.630+0000 7f6e6ffff640 1 -- 172.21.15.104:0/2552386674 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e78021070 con 0x7f6e88154110 2024-09-17T02:55:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.631+0000 7f6e6ffff640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e74078b90 0x7f6e7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.631+0000 7f6e6ffff640 1 -- 172.21.15.104:0/2552386674 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6e7809b460 con 0x7f6e88154110 2024-09-17T02:55:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.631+0000 7f6e86ffd640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e74078b90 0x7f6e7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:27.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.631+0000 7f6e86ffd640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e74078b90 0x7f6e7407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c000fb0 tx=0x7f6e7c006910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:27.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.635+0000 7f6e6ffff640 1 -- 172.21.15.104:0/2552386674 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e78063370 con 0x7f6e88154110 2024-09-17T02:55:27.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.878+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6e880d1f80 con 0x7f6e88154110 2024-09-17T02:55:27.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.878+0000 7f6e6ffff640 1 -- 172.21.15.104:0/2552386674 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1048 (secure 0 0 0) 0x7f6e78067da0 con 0x7f6e88154110 2024-09-17T02:55:27.877 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:27.877 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":64,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1726541670,"num_in_osds":8,"osd_in_since":1726541667,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":2294652,"bytes_avail":1597705348,"bytes_total":1600000000,"write_bytes_sec":2432,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4917}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T02:54:23.298888+0000","services":{}},"progress_events":{}} 2024-09-17T02:55:27.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e74078b90 msgr2=0x7f6e7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e74078b90 0x7f6e7407b0a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c000fb0 tx=0x7f6e7c006910 comp rx=0 tx=0).stop 2024-09-17T02:55:27.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e88154110 msgr2=0x7f6e881587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:27.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e88154110 0x7f6e881587a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6e78011ae0 tx=0x7f6e78009e60 comp rx=0 tx=0).stop 2024-09-17T02:55:27.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 shutdown_connections 2024-09-17T02:55:27.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e74078b90 0x7f6e7407b0a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e8815c280 0x7f6e8815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e881538e0 0x7f6e88155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 --2- 172.21.15.104:0/2552386674 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e88154110 0x7f6e881587a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:27.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.880+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 >> 172.21.15.104:0/2552386674 conn(0x7f6e88069120 msgr2=0x7f6e880d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:27.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.881+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 shutdown_connections 2024-09-17T02:55:27.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:27.881+0000 7f6e8db4a640 1 -- 172.21.15.104:0/2552386674 wait complete. 2024-09-17T02:55:27.890 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T02:55:27.890 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:55:28.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.004+0000 7f739c5f1640 1 -- 172.21.15.104:0/2917164429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380004800 msgr2=0x7f7380004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:28.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.004+0000 7f739c5f1640 1 --2- 172.21.15.104:0/2917164429 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7380004800 0x7f7380004c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7384009b20 tx=0x7f7380005830 comp rx=0 tx=0).stop 2024-09-17T02:55:28.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.004+0000 7f739ab8e640 1 -- 172.21.15.104:0/2917164429 reap_dead start 2024-09-17T02:55:28.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.004+0000 7f739c5f1640 1 -- 172.21.15.104:0/2917164429 shutdown_connections 2024-09-17T02:55:28.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.004+0000 7f739c5f1640 1 -- 172.21.15.104:0/2917164429 >> 172.21.15.104:0/2917164429 conn(0x7f73940d2970 msgr2=0x7f73940d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:28.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.004+0000 7f739c5f1640 1 -- 172.21.15.104:0/2917164429 shutdown_connections 2024-09-17T02:55:28.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.004+0000 7f739c5f1640 1 -- 172.21.15.104:0/2917164429 wait complete. 2024-09-17T02:55:28.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.006+0000 7f739c5f1640 1 Processor -- start 2024-09-17T02:55:28.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.006+0000 7f739c5f1640 1 -- start start 2024-09-17T02:55:28.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739c5f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7380004800 0x7f739414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:28.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739c5f1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7394150770 0x7f739414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:28.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739c5f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f739409fdf0 0x7f73940a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:28.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739c5f1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f73940b2270 con 0x7f739409fdf0 2024-09-17T02:55:28.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739c5f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73940b20f0 con 0x7f7380004800 2024-09-17T02:55:28.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739c5f1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f73940b23f0 con 0x7f7394150770 2024-09-17T02:55:28.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739ab8e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f739409fdf0 0x7f73940a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:28.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739ab8e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f739409fdf0 0x7f73940a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59308/0 (socket says 172.21.15.104:59308) 2024-09-17T02:55:28.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739ab8e640 1 -- 172.21.15.104:0/399447851 learned_addr learned my addr 172.21.15.104:0/399447851 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:28.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f739a38d640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7380004800 0x7f739414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:28.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.007+0000 7f7399b8c640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7394150770 0x7f739414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:28.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f739ab8e640 1 -- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7394150770 msgr2=0x7f739414cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:28.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f739ab8e640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7394150770 0x7f739414cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:28.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f739ab8e640 1 -- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7380004800 msgr2=0x7f739414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:28.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f739ab8e640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7380004800 0x7f739414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:28.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f739ab8e640 1 -- 172.21.15.104:0/399447851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739414e4a0 con 0x7f739409fdf0 2024-09-17T02:55:28.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f739ab8e640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f739409fdf0 0x7f73940a0200 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f738c000f80 tx=0x7f738c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:28.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f738affd640 1 -- 172.21.15.104:0/399447851 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c00c940 con 0x7f739409fdf0 2024-09-17T02:55:28.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f738affd640 1 -- 172.21.15.104:0/399447851 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f738c018070 con 0x7f739409fdf0 2024-09-17T02:55:28.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739414e780 con 0x7f739409fdf0 2024-09-17T02:55:28.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f738affd640 1 -- 172.21.15.104:0/399447851 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c00ce70 con 0x7f739409fdf0 2024-09-17T02:55:28.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.008+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f739414ed40 con 0x7f739409fdf0 2024-09-17T02:55:28.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.009+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f739414e210 con 0x7f739409fdf0 2024-09-17T02:55:28.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.010+0000 7f738affd640 1 -- 172.21.15.104:0/399447851 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f738c01d460 con 0x7f739409fdf0 2024-09-17T02:55:28.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.010+0000 7f738affd640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7378078bc0 0x7f737807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:28.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.010+0000 7f738affd640 1 -- 172.21.15.104:0/399447851 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f738c09aef0 con 0x7f739409fdf0 2024-09-17T02:55:28.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.010+0000 7f739a38d640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7378078bc0 0x7f737807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:28.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.011+0000 7f739a38d640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7378078bc0 0x7f737807b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7390006fd0 tx=0x7f7390006d70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:28.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.014+0000 7f738affd640 1 -- 172.21.15.104:0/399447851 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f738c062d70 con 0x7f739409fdf0 2024-09-17T02:55:28.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.186+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7394071750 con 0x7f7378078bc0 2024-09-17T02:55:28.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.191+0000 7f738affd640 1 -- 172.21.15.104:0/399447851 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247479 (secure 0 0 0) 0x7f7394071750 con 0x7f7378078bc0 2024-09-17T02:55:28.193 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:28.194 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:55:28.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7378078bc0 msgr2=0x7f737807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:28.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7378078bc0 0x7f737807b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7390006fd0 tx=0x7f7390006d70 comp rx=0 tx=0).stop 2024-09-17T02:55:28.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f739409fdf0 msgr2=0x7f73940a0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:28.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f739409fdf0 0x7f73940a0200 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f738c000f80 tx=0x7f738c00ed10 comp rx=0 tx=0).stop 2024-09-17T02:55:28.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 shutdown_connections 2024-09-17T02:55:28.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7378078bc0 0x7f737807b0d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:28.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f739409fdf0 0x7f73940a0200 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:28.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7394150770 0x7f739414cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:28.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 --2- 172.21.15.104:0/399447851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7380004800 0x7f739414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:28.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 >> 172.21.15.104:0/399447851 conn(0x7f73940d2970 msgr2=0x7f73940b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:28.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 shutdown_connections 2024-09-17T02:55:28.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:28.194+0000 7f739c5f1640 1 -- 172.21.15.104:0/399447851 wait complete. 2024-09-17T02:55:28.204 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-17T02:55:27.630199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560259,"statfs":{"total":1600000000,"available":1597705348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.893302"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755331+0000","last_change":"2024-09-17T02:55:23.763234+0000","last_active":"2024-09-17T02:55:24.755331+0000","last_peered":"2024-09-17T02:55:24.755331+0000","last_clean":"2024-09-17T02:55:24.755331+0000","last_became_active":"2024-09-17T02:55:23.762966+0000","last_became_peered":"2024-09-17T02:55:23.762966+0000","last_unstale":"2024-09-17T02:55:24.755331+0000","last_undegraded":"2024-09-17T02:55:24.755331+0000","last_fullsized":"2024-09-17T02:55:24.755331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:02.176065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754342+0000","last_change":"2024-09-17T02:55:23.760759+0000","last_active":"2024-09-17T02:55:24.754342+0000","last_peered":"2024-09-17T02:55:24.754342+0000","last_clean":"2024-09-17T02:55:24.754342+0000","last_became_active":"2024-09-17T02:55:23.760524+0000","last_became_peered":"2024-09-17T02:55:23.760524+0000","last_unstale":"2024-09-17T02:55:24.754342+0000","last_undegraded":"2024-09-17T02:55:24.754342+0000","last_fullsized":"2024-09-17T02:55:24.754342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:57.412346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559618+0000","last_change":"2024-09-17T02:55:23.765984+0000","last_active":"2024-09-17T02:55:25.559618+0000","last_peered":"2024-09-17T02:55:25.559618+0000","last_clean":"2024-09-17T02:55:25.559618+0000","last_became_active":"2024-09-17T02:55:23.765355+0000","last_became_peered":"2024-09-17T02:55:23.765355+0000","last_unstale":"2024-09-17T02:55:25.559618+0000","last_undegraded":"2024-09-17T02:55:25.559618+0000","last_fullsized":"2024-09-17T02:55:25.559618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:35.668921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773709+0000","last_change":"2024-09-17T02:55:23.772155+0000","last_active":"2024-09-17T02:55:24.773709+0000","last_peered":"2024-09-17T02:55:24.773709+0000","last_clean":"2024-09-17T02:55:24.773709+0000","last_became_active":"2024-09-17T02:55:23.771617+0000","last_became_peered":"2024-09-17T02:55:23.771617+0000","last_unstale":"2024-09-17T02:55:24.773709+0000","last_undegraded":"2024-09-17T02:55:24.773709+0000","last_fullsized":"2024-09-17T02:55:24.773709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:10.857877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558368+0000","last_change":"2024-09-17T02:55:23.758526+0000","last_active":"2024-09-17T02:55:25.558368+0000","last_peered":"2024-09-17T02:55:25.558368+0000","last_clean":"2024-09-17T02:55:25.558368+0000","last_became_active":"2024-09-17T02:55:23.758246+0000","last_became_peered":"2024-09-17T02:55:23.758246+0000","last_unstale":"2024-09-17T02:55:25.558368+0000","last_undegraded":"2024-09-17T02:55:25.558368+0000","last_fullsized":"2024-09-17T02:55:25.558368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:01.477698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754475+0000","last_change":"2024-09-17T02:55:23.758648+0000","last_active":"2024-09-17T02:55:24.754475+0000","last_peered":"2024-09-17T02:55:24.754475+0000","last_clean":"2024-09-17T02:55:24.754475+0000","last_became_active":"2024-09-17T02:55:23.758384+0000","last_became_peered":"2024-09-17T02:55:23.758384+0000","last_unstale":"2024-09-17T02:55:24.754475+0000","last_undegraded":"2024-09-17T02:55:24.754475+0000","last_fullsized":"2024-09-17T02:55:24.754475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:35.038069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558767+0000","last_change":"2024-09-17T02:55:23.761435+0000","last_active":"2024-09-17T02:55:25.558767+0000","last_peered":"2024-09-17T02:55:25.558767+0000","last_clean":"2024-09-17T02:55:25.558767+0000","last_became_active":"2024-09-17T02:55:23.760429+0000","last_became_peered":"2024-09-17T02:55:23.760429+0000","last_unstale":"2024-09-17T02:55:25.558767+0000","last_undegraded":"2024-09-17T02:55:25.558767+0000","last_fullsized":"2024-09-17T02:55:25.558767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:25.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558642+0000","last_change":"2024-09-17T02:55:23.759213+0000","last_active":"2024-09-17T02:55:25.558642+0000","last_peered":"2024-09-17T02:55:25.558642+0000","last_clean":"2024-09-17T02:55:25.558642+0000","last_became_active":"2024-09-17T02:55:23.758779+0000","last_became_peered":"2024-09-17T02:55:23.758779+0000","last_unstale":"2024-09-17T02:55:25.558642+0000","last_undegraded":"2024-09-17T02:55:25.558642+0000","last_fullsized":"2024-09-17T02:55:25.558642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:26.394839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756460+0000","last_change":"2024-09-17T02:55:23.771692+0000","last_active":"2024-09-17T02:55:24.756460+0000","last_peered":"2024-09-17T02:55:24.756460+0000","last_clean":"2024-09-17T02:55:24.756460+0000","last_became_active":"2024-09-17T02:55:23.771426+0000","last_became_peered":"2024-09-17T02:55:23.771426+0000","last_unstale":"2024-09-17T02:55:24.756460+0000","last_undegraded":"2024-09-17T02:55:24.756460+0000","last_fullsized":"2024-09-17T02:55:24.756460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:49.620990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773826+0000","last_change":"2024-09-17T02:55:23.769000+0000","last_active":"2024-09-17T02:55:24.773826+0000","last_peered":"2024-09-17T02:55:24.773826+0000","last_clean":"2024-09-17T02:55:24.773826+0000","last_became_active":"2024-09-17T02:55:23.768726+0000","last_became_peered":"2024-09-17T02:55:23.768726+0000","last_unstale":"2024-09-17T02:55:24.773826+0000","last_undegraded":"2024-09-17T02:55:24.773826+0000","last_fullsized":"2024-09-17T02:55:24.773826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:18.547878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559121+0000","last_change":"2024-09-17T02:55:23.767751+0000","last_active":"2024-09-17T02:55:25.559121+0000","last_peered":"2024-09-17T02:55:25.559121+0000","last_clean":"2024-09-17T02:55:25.559121+0000","last_became_active":"2024-09-17T02:55:23.767129+0000","last_became_peered":"2024-09-17T02:55:23.767129+0000","last_unstale":"2024-09-17T02:55:25.559121+0000","last_undegraded":"2024-09-17T02:55:25.559121+0000","last_fullsized":"2024-09-17T02:55:25.559121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:40.364033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559229+0000","last_change":"2024-09-17T02:55:23.763423+0000","last_active":"2024-09-17T02:55:25.559229+0000","last_peered":"2024-09-17T02:55:25.559229+0000","last_clean":"2024-09-17T02:55:25.559229+0000","last_became_active":"2024-09-17T02:55:23.761248+0000","last_became_peered":"2024-09-17T02:55:23.761248+0000","last_unstale":"2024-09-17T02:55:25.559229+0000","last_undegraded":"2024-09-17T02:55:25.559229+0000","last_fullsized":"2024-09-17T02:55:25.559229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:00.363448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558253+0000","last_change":"2024-09-17T02:55:23.765375+0000","last_active":"2024-09-17T02:55:25.558253+0000","last_peered":"2024-09-17T02:55:25.558253+0000","last_clean":"2024-09-17T02:55:25.558253+0000","last_became_active":"2024-09-17T02:55:23.765081+0000","last_became_peered":"2024-09-17T02:55:23.765081+0000","last_unstale":"2024-09-17T02:55:25.558253+0000","last_undegraded":"2024-09-17T02:55:25.558253+0000","last_fullsized":"2024-09-17T02:55:25.558253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:16.933974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754591+0000","last_change":"2024-09-17T02:55:23.762299+0000","last_active":"2024-09-17T02:55:24.754591+0000","last_peered":"2024-09-17T02:55:24.754591+0000","last_clean":"2024-09-17T02:55:24.754591+0000","last_became_active":"2024-09-17T02:55:23.761465+0000","last_became_peered":"2024-09-17T02:55:23.761465+0000","last_unstale":"2024-09-17T02:55:24.754591+0000","last_undegraded":"2024-09-17T02:55:24.754591+0000","last_fullsized":"2024-09-17T02:55:24.754591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:12.524729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558993+0000","last_change":"2024-09-17T02:55:23.760775+0000","last_active":"2024-09-17T02:55:25.558993+0000","last_peered":"2024-09-17T02:55:25.558993+0000","last_clean":"2024-09-17T02:55:25.558993+0000","last_became_active":"2024-09-17T02:55:23.760412+0000","last_became_peered":"2024-09-17T02:55:23.760412+0000","last_unstale":"2024-09-17T02:55:25.558993+0000","last_undegraded":"2024-09-17T02:55:25.558993+0000","last_fullsized":"2024-09-17T02:55:25.558993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:18.733155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559354+0000","last_change":"2024-09-17T02:55:23.769123+0000","last_active":"2024-09-17T02:55:25.559354+0000","last_peered":"2024-09-17T02:55:25.559354+0000","last_clean":"2024-09-17T02:55:25.559354+0000","last_became_active":"2024-09-17T02:55:23.767486+0000","last_became_peered":"2024-09-17T02:55:23.767486+0000","last_unstale":"2024-09-17T02:55:25.559354+0000","last_undegraded":"2024-09-17T02:55:25.559354+0000","last_fullsized":"2024-09-17T02:55:25.559354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:00.502421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559360+0000","last_change":"2024-09-17T02:55:23.761764+0000","last_active":"2024-09-17T02:55:25.559360+0000","last_peered":"2024-09-17T02:55:25.559360+0000","last_clean":"2024-09-17T02:55:25.559360+0000","last_became_active":"2024-09-17T02:55:23.761074+0000","last_became_peered":"2024-09-17T02:55:23.761074+0000","last_unstale":"2024-09-17T02:55:25.559360+0000","last_undegraded":"2024-09-17T02:55:25.559360+0000","last_fullsized":"2024-09-17T02:55:25.559360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:59.588033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754467+0000","last_change":"2024-09-17T02:55:23.766439+0000","last_active":"2024-09-17T02:55:24.754467+0000","last_peered":"2024-09-17T02:55:24.754467+0000","last_clean":"2024-09-17T02:55:24.754467+0000","last_became_active":"2024-09-17T02:55:23.766146+0000","last_became_peered":"2024-09-17T02:55:23.766146+0000","last_unstale":"2024-09-17T02:55:24.754467+0000","last_undegraded":"2024-09-17T02:55:24.754467+0000","last_fullsized":"2024-09-17T02:55:24.754467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:53.110155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754305+0000","last_change":"2024-09-17T02:55:23.772590+0000","last_active":"2024-09-17T02:55:24.754305+0000","last_peered":"2024-09-17T02:55:24.754305+0000","last_clean":"2024-09-17T02:55:24.754305+0000","last_became_active":"2024-09-17T02:55:23.771951+0000","last_became_peered":"2024-09-17T02:55:23.771951+0000","last_unstale":"2024-09-17T02:55:24.754305+0000","last_undegraded":"2024-09-17T02:55:24.754305+0000","last_fullsized":"2024-09-17T02:55:24.754305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:32.000614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558522+0000","last_change":"2024-09-17T02:55:23.763843+0000","last_active":"2024-09-17T02:55:25.558522+0000","last_peered":"2024-09-17T02:55:25.558522+0000","last_clean":"2024-09-17T02:55:25.558522+0000","last_became_active":"2024-09-17T02:55:23.763579+0000","last_became_peered":"2024-09-17T02:55:23.763579+0000","last_unstale":"2024-09-17T02:55:25.558522+0000","last_undegraded":"2024-09-17T02:55:25.558522+0000","last_fullsized":"2024-09-17T02:55:25.558522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:49.074744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755783+0000","last_change":"2024-09-17T02:55:23.769159+0000","last_active":"2024-09-17T02:55:24.755783+0000","last_peered":"2024-09-17T02:55:24.755783+0000","last_clean":"2024-09-17T02:55:24.755783+0000","last_became_active":"2024-09-17T02:55:23.768395+0000","last_became_peered":"2024-09-17T02:55:23.768395+0000","last_unstale":"2024-09-17T02:55:24.755783+0000","last_undegraded":"2024-09-17T02:55:24.755783+0000","last_fullsized":"2024-09-17T02:55:24.755783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:15.198371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756319+0000","last_change":"2024-09-17T02:55:23.770819+0000","last_active":"2024-09-17T02:55:24.756319+0000","last_peered":"2024-09-17T02:55:24.756319+0000","last_clean":"2024-09-17T02:55:24.756319+0000","last_became_active":"2024-09-17T02:55:23.770265+0000","last_became_peered":"2024-09-17T02:55:23.770265+0000","last_unstale":"2024-09-17T02:55:24.756319+0000","last_undegraded":"2024-09-17T02:55:24.756319+0000","last_fullsized":"2024-09-17T02:55:24.756319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:55.998783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772269+0000","last_change":"2024-09-17T02:55:23.759110+0000","last_active":"2024-09-17T02:55:24.772269+0000","last_peered":"2024-09-17T02:55:24.772269+0000","last_clean":"2024-09-17T02:55:24.772269+0000","last_became_active":"2024-09-17T02:55:23.758829+0000","last_became_peered":"2024-09-17T02:55:23.758829+0000","last_unstale":"2024-09-17T02:55:24.772269+0000","last_undegraded":"2024-09-17T02:55:24.772269+0000","last_fullsized":"2024-09-17T02:55:24.772269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:21.562671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558908+0000","last_change":"2024-09-17T02:55:23.758915+0000","last_active":"2024-09-17T02:55:25.558908+0000","last_peered":"2024-09-17T02:55:25.558908+0000","last_clean":"2024-09-17T02:55:25.558908+0000","last_became_active":"2024-09-17T02:55:23.758627+0000","last_became_peered":"2024-09-17T02:55:23.758627+0000","last_unstale":"2024-09-17T02:55:25.558908+0000","last_undegraded":"2024-09-17T02:55:25.558908+0000","last_fullsized":"2024-09-17T02:55:25.558908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:14.451425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773550+0000","last_change":"2024-09-17T02:55:23.767294+0000","last_active":"2024-09-17T02:55:24.773550+0000","last_peered":"2024-09-17T02:55:24.773550+0000","last_clean":"2024-09-17T02:55:24.773550+0000","last_became_active":"2024-09-17T02:55:23.767059+0000","last_became_peered":"2024-09-17T02:55:23.767059+0000","last_unstale":"2024-09-17T02:55:24.773550+0000","last_undegraded":"2024-09-17T02:55:24.773550+0000","last_fullsized":"2024-09-17T02:55:24.773550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:17.235523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754698+0000","last_change":"2024-09-17T02:55:23.767445+0000","last_active":"2024-09-17T02:55:24.754698+0000","last_peered":"2024-09-17T02:55:24.754698+0000","last_clean":"2024-09-17T02:55:24.754698+0000","last_became_active":"2024-09-17T02:55:23.767130+0000","last_became_peered":"2024-09-17T02:55:23.767130+0000","last_unstale":"2024-09-17T02:55:24.754698+0000","last_undegraded":"2024-09-17T02:55:24.754698+0000","last_fullsized":"2024-09-17T02:55:24.754698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:21.133046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773952+0000","last_change":"2024-09-17T02:55:23.770868+0000","last_active":"2024-09-17T02:55:24.773952+0000","last_peered":"2024-09-17T02:55:24.773952+0000","last_clean":"2024-09-17T02:55:24.773952+0000","last_became_active":"2024-09-17T02:55:23.770549+0000","last_became_peered":"2024-09-17T02:55:23.770549+0000","last_unstale":"2024-09-17T02:55:24.773952+0000","last_undegraded":"2024-09-17T02:55:24.773952+0000","last_fullsized":"2024-09-17T02:55:24.773952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:41.450816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558544+0000","last_change":"2024-09-17T02:55:23.762508+0000","last_active":"2024-09-17T02:55:25.558544+0000","last_peered":"2024-09-17T02:55:25.558544+0000","last_clean":"2024-09-17T02:55:25.558544+0000","last_became_active":"2024-09-17T02:55:23.762010+0000","last_became_peered":"2024-09-17T02:55:23.762010+0000","last_unstale":"2024-09-17T02:55:25.558544+0000","last_undegraded":"2024-09-17T02:55:25.558544+0000","last_fullsized":"2024-09-17T02:55:25.558544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:02.694407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756626+0000","last_change":"2024-09-17T02:55:23.770254+0000","last_active":"2024-09-17T02:55:24.756626+0000","last_peered":"2024-09-17T02:55:24.756626+0000","last_clean":"2024-09-17T02:55:24.756626+0000","last_became_active":"2024-09-17T02:55:23.768106+0000","last_became_peered":"2024-09-17T02:55:23.768106+0000","last_unstale":"2024-09-17T02:55:24.756626+0000","last_undegraded":"2024-09-17T02:55:24.756626+0000","last_fullsized":"2024-09-17T02:55:24.756626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:13.944953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559040+0000","last_change":"2024-09-17T02:55:23.766090+0000","last_active":"2024-09-17T02:55:25.559040+0000","last_peered":"2024-09-17T02:55:25.559040+0000","last_clean":"2024-09-17T02:55:25.559040+0000","last_became_active":"2024-09-17T02:55:23.765302+0000","last_became_peered":"2024-09-17T02:55:23.765302+0000","last_unstale":"2024-09-17T02:55:25.559040+0000","last_undegraded":"2024-09-17T02:55:25.559040+0000","last_fullsized":"2024-09-17T02:55:25.559040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:13.256977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755624+0000","last_change":"2024-09-17T02:55:23.762259+0000","last_active":"2024-09-17T02:55:24.755624+0000","last_peered":"2024-09-17T02:55:24.755624+0000","last_clean":"2024-09-17T02:55:24.755624+0000","last_became_active":"2024-09-17T02:55:23.761979+0000","last_became_peered":"2024-09-17T02:55:23.761979+0000","last_unstale":"2024-09-17T02:55:24.755624+0000","last_undegraded":"2024-09-17T02:55:24.755624+0000","last_fullsized":"2024-09-17T02:55:24.755624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:27.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559596+0000","last_change":"2024-09-17T02:55:23.772516+0000","last_active":"2024-09-17T02:55:25.559596+0000","last_peered":"2024-09-17T02:55:25.559596+0000","last_clean":"2024-09-17T02:55:25.559596+0000","last_became_active":"2024-09-17T02:55:23.772242+0000","last_became_peered":"2024-09-17T02:55:23.772242+0000","last_unstale":"2024-09-17T02:55:25.559596+0000","last_undegraded":"2024-09-17T02:55:25.559596+0000","last_fullsized":"2024-09-17T02:55:25.559596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:24.036995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772438+0000","last_change":"2024-09-17T02:55:23.765811+0000","last_active":"2024-09-17T02:55:24.772438+0000","last_peered":"2024-09-17T02:55:24.772438+0000","last_clean":"2024-09-17T02:55:24.772438+0000","last_became_active":"2024-09-17T02:55:23.765540+0000","last_became_peered":"2024-09-17T02:55:23.765540+0000","last_unstale":"2024-09-17T02:55:24.772438+0000","last_undegraded":"2024-09-17T02:55:24.772438+0000","last_fullsized":"2024-09-17T02:55:24.772438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:42.713792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755246+0000","last_change":"2024-09-17T02:55:22.750235+0000","last_active":"2024-09-17T02:55:24.755246+0000","last_peered":"2024-09-17T02:55:24.755246+0000","last_clean":"2024-09-17T02:55:24.755246+0000","last_became_active":"2024-09-17T02:55:22.749957+0000","last_became_peered":"2024-09-17T02:55:22.749957+0000","last_unstale":"2024-09-17T02:55:24.755246+0000","last_undegraded":"2024-09-17T02:55:24.755246+0000","last_fullsized":"2024-09-17T02:55:24.755246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:06.172642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755103+0000","last_change":"2024-09-17T02:55:23.771814+0000","last_active":"2024-09-17T02:55:24.755103+0000","last_peered":"2024-09-17T02:55:24.755103+0000","last_clean":"2024-09-17T02:55:24.755103+0000","last_became_active":"2024-09-17T02:55:23.771560+0000","last_became_peered":"2024-09-17T02:55:23.771560+0000","last_unstale":"2024-09-17T02:55:24.755103+0000","last_undegraded":"2024-09-17T02:55:24.755103+0000","last_fullsized":"2024-09-17T02:55:24.755103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:46.482658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772223+0000","last_change":"2024-09-17T02:55:22.749000+0000","last_active":"2024-09-17T02:55:24.772223+0000","last_peered":"2024-09-17T02:55:24.772223+0000","last_clean":"2024-09-17T02:55:24.772223+0000","last_became_active":"2024-09-17T02:55:22.748475+0000","last_became_peered":"2024-09-17T02:55:22.748475+0000","last_unstale":"2024-09-17T02:55:24.772223+0000","last_undegraded":"2024-09-17T02:55:24.772223+0000","last_fullsized":"2024-09-17T02:55:24.772223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:50.894439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756087+0000","last_change":"2024-09-17T02:55:23.769955+0000","last_active":"2024-09-17T02:55:24.756087+0000","last_peered":"2024-09-17T02:55:24.756087+0000","last_clean":"2024-09-17T02:55:24.756087+0000","last_became_active":"2024-09-17T02:55:23.768750+0000","last_became_peered":"2024-09-17T02:55:23.768750+0000","last_unstale":"2024-09-17T02:55:24.756087+0000","last_undegraded":"2024-09-17T02:55:24.756087+0000","last_fullsized":"2024-09-17T02:55:24.756087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:25.986239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754608+0000","last_change":"2024-09-17T02:55:22.754155+0000","last_active":"2024-09-17T02:55:24.754608+0000","last_peered":"2024-09-17T02:55:24.754608+0000","last_clean":"2024-09-17T02:55:24.754608+0000","last_became_active":"2024-09-17T02:55:22.753863+0000","last_became_peered":"2024-09-17T02:55:22.753863+0000","last_unstale":"2024-09-17T02:55:24.754608+0000","last_undegraded":"2024-09-17T02:55:24.754608+0000","last_fullsized":"2024-09-17T02:55:24.754608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:31.440074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773690+0000","last_change":"2024-09-17T02:55:23.775061+0000","last_active":"2024-09-17T02:55:24.773690+0000","last_peered":"2024-09-17T02:55:24.773690+0000","last_clean":"2024-09-17T02:55:24.773690+0000","last_became_active":"2024-09-17T02:55:23.774691+0000","last_became_peered":"2024-09-17T02:55:23.774691+0000","last_unstale":"2024-09-17T02:55:24.773690+0000","last_undegraded":"2024-09-17T02:55:24.773690+0000","last_fullsized":"2024-09-17T02:55:24.773690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:22.422215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558406+0000","last_change":"2024-09-17T02:55:22.756798+0000","last_active":"2024-09-17T02:55:25.558406+0000","last_peered":"2024-09-17T02:55:25.558406+0000","last_clean":"2024-09-17T02:55:25.558406+0000","last_became_active":"2024-09-17T02:55:22.756479+0000","last_became_peered":"2024-09-17T02:55:22.756479+0000","last_unstale":"2024-09-17T02:55:25.558406+0000","last_undegraded":"2024-09-17T02:55:25.558406+0000","last_fullsized":"2024-09-17T02:55:25.558406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:34.456378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559118+0000","last_change":"2024-09-17T02:55:23.770625+0000","last_active":"2024-09-17T02:55:25.559118+0000","last_peered":"2024-09-17T02:55:25.559118+0000","last_clean":"2024-09-17T02:55:25.559118+0000","last_became_active":"2024-09-17T02:55:23.770365+0000","last_became_peered":"2024-09-17T02:55:23.770365+0000","last_unstale":"2024-09-17T02:55:25.559118+0000","last_undegraded":"2024-09-17T02:55:25.559118+0000","last_fullsized":"2024-09-17T02:55:25.559118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:48.468603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756000+0000","last_change":"2024-09-17T02:55:22.748420+0000","last_active":"2024-09-17T02:55:24.756000+0000","last_peered":"2024-09-17T02:55:24.756000+0000","last_clean":"2024-09-17T02:55:24.756000+0000","last_became_active":"2024-09-17T02:55:22.747791+0000","last_became_peered":"2024-09-17T02:55:22.747791+0000","last_unstale":"2024-09-17T02:55:24.756000+0000","last_undegraded":"2024-09-17T02:55:24.756000+0000","last_fullsized":"2024-09-17T02:55:24.756000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:56.555993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559466+0000","last_change":"2024-09-17T02:55:23.764167+0000","last_active":"2024-09-17T02:55:25.559466+0000","last_peered":"2024-09-17T02:55:25.559466+0000","last_clean":"2024-09-17T02:55:25.559466+0000","last_became_active":"2024-09-17T02:55:23.762655+0000","last_became_peered":"2024-09-17T02:55:23.762655+0000","last_unstale":"2024-09-17T02:55:25.559466+0000","last_undegraded":"2024-09-17T02:55:25.559466+0000","last_fullsized":"2024-09-17T02:55:25.559466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:58.430021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755915+0000","last_change":"2024-09-17T02:55:22.744832+0000","last_active":"2024-09-17T02:55:24.755915+0000","last_peered":"2024-09-17T02:55:24.755915+0000","last_clean":"2024-09-17T02:55:24.755915+0000","last_became_active":"2024-09-17T02:55:22.744521+0000","last_became_peered":"2024-09-17T02:55:22.744521+0000","last_unstale":"2024-09-17T02:55:24.755915+0000","last_undegraded":"2024-09-17T02:55:24.755915+0000","last_fullsized":"2024-09-17T02:55:24.755915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:51.741944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756304+0000","last_change":"2024-09-17T02:55:23.773801+0000","last_active":"2024-09-17T02:55:24.756304+0000","last_peered":"2024-09-17T02:55:24.756304+0000","last_clean":"2024-09-17T02:55:24.756304+0000","last_became_active":"2024-09-17T02:55:23.771876+0000","last_became_peered":"2024-09-17T02:55:23.771876+0000","last_unstale":"2024-09-17T02:55:24.756304+0000","last_undegraded":"2024-09-17T02:55:24.756304+0000","last_fullsized":"2024-09-17T02:55:24.756304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:47.225435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754655+0000","last_change":"2024-09-17T02:55:22.750835+0000","last_active":"2024-09-17T02:55:24.754655+0000","last_peered":"2024-09-17T02:55:24.754655+0000","last_clean":"2024-09-17T02:55:24.754655+0000","last_became_active":"2024-09-17T02:55:22.750538+0000","last_became_peered":"2024-09-17T02:55:22.750538+0000","last_unstale":"2024-09-17T02:55:24.754655+0000","last_undegraded":"2024-09-17T02:55:24.754655+0000","last_fullsized":"2024-09-17T02:55:24.754655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:40.139589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773947+0000","last_change":"2024-09-17T02:55:23.771875+0000","last_active":"2024-09-17T02:55:24.773947+0000","last_peered":"2024-09-17T02:55:24.773947+0000","last_clean":"2024-09-17T02:55:24.773947+0000","last_became_active":"2024-09-17T02:55:23.771137+0000","last_became_peered":"2024-09-17T02:55:23.771137+0000","last_unstale":"2024-09-17T02:55:24.773947+0000","last_undegraded":"2024-09-17T02:55:24.773947+0000","last_fullsized":"2024-09-17T02:55:24.773947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:23.231203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756757+0000","last_change":"2024-09-17T02:55:22.746242+0000","last_active":"2024-09-17T02:55:24.756757+0000","last_peered":"2024-09-17T02:55:24.756757+0000","last_clean":"2024-09-17T02:55:24.756757+0000","last_became_active":"2024-09-17T02:55:22.742782+0000","last_became_peered":"2024-09-17T02:55:22.742782+0000","last_unstale":"2024-09-17T02:55:24.756757+0000","last_undegraded":"2024-09-17T02:55:24.756757+0000","last_fullsized":"2024-09-17T02:55:24.756757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:18.286213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559923+0000","last_change":"2024-09-17T02:55:23.759031+0000","last_active":"2024-09-17T02:55:25.559923+0000","last_peered":"2024-09-17T02:55:25.559923+0000","last_clean":"2024-09-17T02:55:25.559923+0000","last_became_active":"2024-09-17T02:55:23.758744+0000","last_became_peered":"2024-09-17T02:55:23.758744+0000","last_unstale":"2024-09-17T02:55:25.559923+0000","last_undegraded":"2024-09-17T02:55:25.559923+0000","last_fullsized":"2024-09-17T02:55:25.559923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:10.565881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755011+0000","last_change":"2024-09-17T02:55:22.753163+0000","last_active":"2024-09-17T02:55:24.755011+0000","last_peered":"2024-09-17T02:55:24.755011+0000","last_clean":"2024-09-17T02:55:24.755011+0000","last_became_active":"2024-09-17T02:55:22.752758+0000","last_became_peered":"2024-09-17T02:55:22.752758+0000","last_unstale":"2024-09-17T02:55:24.755011+0000","last_undegraded":"2024-09-17T02:55:24.755011+0000","last_fullsized":"2024-09-17T02:55:24.755011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:19.694851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754908+0000","last_change":"2024-09-17T02:55:23.764980+0000","last_active":"2024-09-17T02:55:24.754908+0000","last_peered":"2024-09-17T02:55:24.754908+0000","last_clean":"2024-09-17T02:55:24.754908+0000","last_became_active":"2024-09-17T02:55:23.764693+0000","last_became_peered":"2024-09-17T02:55:23.764693+0000","last_unstale":"2024-09-17T02:55:24.754908+0000","last_undegraded":"2024-09-17T02:55:24.754908+0000","last_fullsized":"2024-09-17T02:55:24.754908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:28.863692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772284+0000","last_change":"2024-09-17T02:55:22.749862+0000","last_active":"2024-09-17T02:55:24.772284+0000","last_peered":"2024-09-17T02:55:24.772284+0000","last_clean":"2024-09-17T02:55:24.772284+0000","last_became_active":"2024-09-17T02:55:22.749534+0000","last_became_peered":"2024-09-17T02:55:22.749534+0000","last_unstale":"2024-09-17T02:55:24.772284+0000","last_undegraded":"2024-09-17T02:55:24.772284+0000","last_fullsized":"2024-09-17T02:55:24.772284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:34.487448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754823+0000","last_change":"2024-09-17T02:55:23.767158+0000","last_active":"2024-09-17T02:55:24.754823+0000","last_peered":"2024-09-17T02:55:24.754823+0000","last_clean":"2024-09-17T02:55:24.754823+0000","last_became_active":"2024-09-17T02:55:23.766896+0000","last_became_peered":"2024-09-17T02:55:23.766896+0000","last_unstale":"2024-09-17T02:55:24.754823+0000","last_undegraded":"2024-09-17T02:55:24.754823+0000","last_fullsized":"2024-09-17T02:55:24.754823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:35.634249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559755+0000","last_change":"2024-09-17T02:55:22.750458+0000","last_active":"2024-09-17T02:55:25.559755+0000","last_peered":"2024-09-17T02:55:25.559755+0000","last_clean":"2024-09-17T02:55:25.559755+0000","last_became_active":"2024-09-17T02:55:22.750203+0000","last_became_peered":"2024-09-17T02:55:22.750203+0000","last_unstale":"2024-09-17T02:55:25.559755+0000","last_undegraded":"2024-09-17T02:55:25.559755+0000","last_fullsized":"2024-09-17T02:55:25.559755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:14.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559229+0000","last_change":"2024-09-17T02:55:23.766337+0000","last_active":"2024-09-17T02:55:25.559229+0000","last_peered":"2024-09-17T02:55:25.559229+0000","last_clean":"2024-09-17T02:55:25.559229+0000","last_became_active":"2024-09-17T02:55:23.765725+0000","last_became_peered":"2024-09-17T02:55:23.765725+0000","last_unstale":"2024-09-17T02:55:25.559229+0000","last_undegraded":"2024-09-17T02:55:25.559229+0000","last_fullsized":"2024-09-17T02:55:25.559229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:40.204842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754712+0000","last_change":"2024-09-17T02:55:22.756302+0000","last_active":"2024-09-17T02:55:24.754712+0000","last_peered":"2024-09-17T02:55:24.754712+0000","last_clean":"2024-09-17T02:55:24.754712+0000","last_became_active":"2024-09-17T02:55:22.755624+0000","last_became_peered":"2024-09-17T02:55:22.755624+0000","last_unstale":"2024-09-17T02:55:24.754712+0000","last_undegraded":"2024-09-17T02:55:24.754712+0000","last_fullsized":"2024-09-17T02:55:24.754712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:39.696474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773717+0000","last_change":"2024-09-17T02:55:23.763282+0000","last_active":"2024-09-17T02:55:24.773717+0000","last_peered":"2024-09-17T02:55:24.773717+0000","last_clean":"2024-09-17T02:55:24.773717+0000","last_became_active":"2024-09-17T02:55:23.763055+0000","last_became_peered":"2024-09-17T02:55:23.763055+0000","last_unstale":"2024-09-17T02:55:24.773717+0000","last_undegraded":"2024-09-17T02:55:24.773717+0000","last_fullsized":"2024-09-17T02:55:24.773717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:03.864798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756872+0000","last_change":"2024-09-17T02:55:22.747579+0000","last_active":"2024-09-17T02:55:24.756872+0000","last_peered":"2024-09-17T02:55:24.756872+0000","last_clean":"2024-09-17T02:55:24.756872+0000","last_became_active":"2024-09-17T02:55:22.746875+0000","last_became_peered":"2024-09-17T02:55:22.746875+0000","last_unstale":"2024-09-17T02:55:24.756872+0000","last_undegraded":"2024-09-17T02:55:24.756872+0000","last_fullsized":"2024-09-17T02:55:24.756872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:45.101018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754426+0000","last_change":"2024-09-17T02:55:23.759402+0000","last_active":"2024-09-17T02:55:24.754426+0000","last_peered":"2024-09-17T02:55:24.754426+0000","last_clean":"2024-09-17T02:55:24.754426+0000","last_became_active":"2024-09-17T02:55:23.759135+0000","last_became_peered":"2024-09-17T02:55:23.759135+0000","last_unstale":"2024-09-17T02:55:24.754426+0000","last_undegraded":"2024-09-17T02:55:24.754426+0000","last_fullsized":"2024-09-17T02:55:24.754426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:35.143041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773868+0000","last_change":"2024-09-17T02:55:22.753234+0000","last_active":"2024-09-17T02:55:24.773868+0000","last_peered":"2024-09-17T02:55:24.773868+0000","last_clean":"2024-09-17T02:55:24.773868+0000","last_became_active":"2024-09-17T02:55:22.751979+0000","last_became_peered":"2024-09-17T02:55:22.751979+0000","last_unstale":"2024-09-17T02:55:24.773868+0000","last_undegraded":"2024-09-17T02:55:24.773868+0000","last_fullsized":"2024-09-17T02:55:24.773868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:19.514624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559406+0000","last_change":"2024-09-17T02:55:23.771479+0000","last_active":"2024-09-17T02:55:25.559406+0000","last_peered":"2024-09-17T02:55:25.559406+0000","last_clean":"2024-09-17T02:55:25.559406+0000","last_became_active":"2024-09-17T02:55:23.771167+0000","last_became_peered":"2024-09-17T02:55:23.771167+0000","last_unstale":"2024-09-17T02:55:25.559406+0000","last_undegraded":"2024-09-17T02:55:25.559406+0000","last_fullsized":"2024-09-17T02:55:25.559406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:44.673611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754687+0000","last_change":"2024-09-17T02:55:22.756237+0000","last_active":"2024-09-17T02:55:24.754687+0000","last_peered":"2024-09-17T02:55:24.754687+0000","last_clean":"2024-09-17T02:55:24.754687+0000","last_became_active":"2024-09-17T02:55:22.755726+0000","last_became_peered":"2024-09-17T02:55:22.755726+0000","last_unstale":"2024-09-17T02:55:24.754687+0000","last_undegraded":"2024-09-17T02:55:24.754687+0000","last_fullsized":"2024-09-17T02:55:24.754687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:45.057688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755320+0000","last_change":"2024-09-17T02:55:23.770587+0000","last_active":"2024-09-17T02:55:24.755320+0000","last_peered":"2024-09-17T02:55:24.755320+0000","last_clean":"2024-09-17T02:55:24.755320+0000","last_became_active":"2024-09-17T02:55:23.769667+0000","last_became_peered":"2024-09-17T02:55:23.769667+0000","last_unstale":"2024-09-17T02:55:24.755320+0000","last_undegraded":"2024-09-17T02:55:24.755320+0000","last_fullsized":"2024-09-17T02:55:24.755320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:25.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754111+0000","last_change":"2024-09-17T02:55:22.754865+0000","last_active":"2024-09-17T02:55:24.754111+0000","last_peered":"2024-09-17T02:55:24.754111+0000","last_clean":"2024-09-17T02:55:24.754111+0000","last_became_active":"2024-09-17T02:55:22.754358+0000","last_became_peered":"2024-09-17T02:55:22.754358+0000","last_unstale":"2024-09-17T02:55:24.754111+0000","last_undegraded":"2024-09-17T02:55:24.754111+0000","last_fullsized":"2024-09-17T02:55:24.754111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:53.006548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756642+0000","last_change":"2024-09-17T02:55:23.772190+0000","last_active":"2024-09-17T02:55:24.756642+0000","last_peered":"2024-09-17T02:55:24.756642+0000","last_clean":"2024-09-17T02:55:24.756642+0000","last_became_active":"2024-09-17T02:55:23.771514+0000","last_became_peered":"2024-09-17T02:55:23.771514+0000","last_unstale":"2024-09-17T02:55:24.756642+0000","last_undegraded":"2024-09-17T02:55:24.756642+0000","last_fullsized":"2024-09-17T02:55:24.756642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:53.860339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.774267+0000","last_change":"2024-09-17T02:55:22.758079+0000","last_active":"2024-09-17T02:55:24.774267+0000","last_peered":"2024-09-17T02:55:24.774267+0000","last_clean":"2024-09-17T02:55:24.774267+0000","last_became_active":"2024-09-17T02:55:22.757729+0000","last_became_peered":"2024-09-17T02:55:22.757729+0000","last_unstale":"2024-09-17T02:55:24.774267+0000","last_undegraded":"2024-09-17T02:55:24.774267+0000","last_fullsized":"2024-09-17T02:55:24.774267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:46.211281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558649+0000","last_change":"2024-09-17T02:55:23.767197+0000","last_active":"2024-09-17T02:55:25.558649+0000","last_peered":"2024-09-17T02:55:25.558649+0000","last_clean":"2024-09-17T02:55:25.558649+0000","last_became_active":"2024-09-17T02:55:23.766914+0000","last_became_peered":"2024-09-17T02:55:23.766914+0000","last_unstale":"2024-09-17T02:55:25.558649+0000","last_undegraded":"2024-09-17T02:55:25.558649+0000","last_fullsized":"2024-09-17T02:55:25.558649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:09.803305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.757001+0000","last_change":"2024-09-17T02:55:22.747869+0000","last_active":"2024-09-17T02:55:24.757001+0000","last_peered":"2024-09-17T02:55:24.757001+0000","last_clean":"2024-09-17T02:55:24.757001+0000","last_became_active":"2024-09-17T02:55:22.747212+0000","last_became_peered":"2024-09-17T02:55:22.747212+0000","last_unstale":"2024-09-17T02:55:24.757001+0000","last_undegraded":"2024-09-17T02:55:24.757001+0000","last_fullsized":"2024-09-17T02:55:24.757001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:29.794581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773636+0000","last_change":"2024-09-17T02:55:23.771679+0000","last_active":"2024-09-17T02:55:24.773636+0000","last_peered":"2024-09-17T02:55:24.773636+0000","last_clean":"2024-09-17T02:55:24.773636+0000","last_became_active":"2024-09-17T02:55:23.771362+0000","last_became_peered":"2024-09-17T02:55:23.771362+0000","last_unstale":"2024-09-17T02:55:24.773636+0000","last_undegraded":"2024-09-17T02:55:24.773636+0000","last_fullsized":"2024-09-17T02:55:24.773636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:13.072653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756226+0000","last_change":"2024-09-17T02:55:22.751139+0000","last_active":"2024-09-17T02:55:24.756226+0000","last_peered":"2024-09-17T02:55:24.756226+0000","last_clean":"2024-09-17T02:55:24.756226+0000","last_became_active":"2024-09-17T02:55:22.750883+0000","last_became_peered":"2024-09-17T02:55:22.750883+0000","last_unstale":"2024-09-17T02:55:24.756226+0000","last_undegraded":"2024-09-17T02:55:24.756226+0000","last_fullsized":"2024-09-17T02:55:24.756226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:21.432244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558185+0000","last_change":"2024-09-17T02:55:23.771109+0000","last_active":"2024-09-17T02:55:25.558185+0000","last_peered":"2024-09-17T02:55:25.558185+0000","last_clean":"2024-09-17T02:55:25.558185+0000","last_became_active":"2024-09-17T02:55:23.770844+0000","last_became_peered":"2024-09-17T02:55:23.770844+0000","last_unstale":"2024-09-17T02:55:25.558185+0000","last_undegraded":"2024-09-17T02:55:25.558185+0000","last_fullsized":"2024-09-17T02:55:25.558185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:10.686281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756454+0000","last_change":"2024-09-17T02:55:22.749101+0000","last_active":"2024-09-17T02:55:24.756454+0000","last_peered":"2024-09-17T02:55:24.756454+0000","last_clean":"2024-09-17T02:55:24.756454+0000","last_became_active":"2024-09-17T02:55:22.748824+0000","last_became_peered":"2024-09-17T02:55:22.748824+0000","last_unstale":"2024-09-17T02:55:24.756454+0000","last_undegraded":"2024-09-17T02:55:24.756454+0000","last_fullsized":"2024-09-17T02:55:24.756454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:30.488979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558372+0000","last_change":"2024-09-17T02:55:23.768637+0000","last_active":"2024-09-17T02:55:25.558372+0000","last_peered":"2024-09-17T02:55:25.558372+0000","last_clean":"2024-09-17T02:55:25.558372+0000","last_became_active":"2024-09-17T02:55:23.768305+0000","last_became_peered":"2024-09-17T02:55:23.768305+0000","last_unstale":"2024-09-17T02:55:25.558372+0000","last_undegraded":"2024-09-17T02:55:25.558372+0000","last_fullsized":"2024-09-17T02:55:25.558372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:46.107723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772408+0000","last_change":"2024-09-17T02:55:22.755605+0000","last_active":"2024-09-17T02:55:24.772408+0000","last_peered":"2024-09-17T02:55:24.772408+0000","last_clean":"2024-09-17T02:55:24.772408+0000","last_became_active":"2024-09-17T02:55:22.754980+0000","last_became_peered":"2024-09-17T02:55:22.754980+0000","last_unstale":"2024-09-17T02:55:24.772408+0000","last_undegraded":"2024-09-17T02:55:24.772408+0000","last_fullsized":"2024-09-17T02:55:24.772408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:42.403963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558502+0000","last_change":"2024-09-17T02:55:23.761050+0000","last_active":"2024-09-17T02:55:25.558502+0000","last_peered":"2024-09-17T02:55:25.558502+0000","last_clean":"2024-09-17T02:55:25.558502+0000","last_became_active":"2024-09-17T02:55:23.760440+0000","last_became_peered":"2024-09-17T02:55:23.760440+0000","last_unstale":"2024-09-17T02:55:25.558502+0000","last_undegraded":"2024-09-17T02:55:25.558502+0000","last_fullsized":"2024-09-17T02:55:25.558502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:58.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754906+0000","last_change":"2024-09-17T02:55:22.752090+0000","last_active":"2024-09-17T02:55:24.754906+0000","last_peered":"2024-09-17T02:55:24.754906+0000","last_clean":"2024-09-17T02:55:24.754906+0000","last_became_active":"2024-09-17T02:55:22.751796+0000","last_became_peered":"2024-09-17T02:55:22.751796+0000","last_unstale":"2024-09-17T02:55:24.754906+0000","last_undegraded":"2024-09-17T02:55:24.754906+0000","last_fullsized":"2024-09-17T02:55:24.754906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:11.117273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558331+0000","last_change":"2024-09-17T02:55:23.757567+0000","last_active":"2024-09-17T02:55:25.558331+0000","last_peered":"2024-09-17T02:55:25.558331+0000","last_clean":"2024-09-17T02:55:25.558331+0000","last_became_active":"2024-09-17T02:55:23.757306+0000","last_became_peered":"2024-09-17T02:55:23.757306+0000","last_unstale":"2024-09-17T02:55:25.558331+0000","last_undegraded":"2024-09-17T02:55:25.558331+0000","last_fullsized":"2024-09-17T02:55:25.558331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:07.388755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.757133+0000","last_change":"2024-09-17T02:55:22.752995+0000","last_active":"2024-09-17T02:55:24.757133+0000","last_peered":"2024-09-17T02:55:24.757133+0000","last_clean":"2024-09-17T02:55:24.757133+0000","last_became_active":"2024-09-17T02:55:22.752575+0000","last_became_peered":"2024-09-17T02:55:22.752575+0000","last_unstale":"2024-09-17T02:55:24.757133+0000","last_undegraded":"2024-09-17T02:55:24.757133+0000","last_fullsized":"2024-09-17T02:55:24.757133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:46.053363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559292+0000","last_change":"2024-09-17T02:55:23.768517+0000","last_active":"2024-09-17T02:55:25.559292+0000","last_peered":"2024-09-17T02:55:25.559292+0000","last_clean":"2024-09-17T02:55:25.559292+0000","last_became_active":"2024-09-17T02:55:23.768218+0000","last_became_peered":"2024-09-17T02:55:23.768218+0000","last_unstale":"2024-09-17T02:55:25.559292+0000","last_undegraded":"2024-09-17T02:55:25.559292+0000","last_fullsized":"2024-09-17T02:55:25.559292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:01.933326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558904+0000","last_change":"2024-09-17T02:55:22.751249+0000","last_active":"2024-09-17T02:55:25.558904+0000","last_peered":"2024-09-17T02:55:25.558904+0000","last_clean":"2024-09-17T02:55:25.558904+0000","last_became_active":"2024-09-17T02:55:22.750980+0000","last_became_peered":"2024-09-17T02:55:22.750980+0000","last_unstale":"2024-09-17T02:55:25.558904+0000","last_undegraded":"2024-09-17T02:55:25.558904+0000","last_fullsized":"2024-09-17T02:55:25.558904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:45.143320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558716+0000","last_change":"2024-09-17T02:55:23.763197+0000","last_active":"2024-09-17T02:55:25.558716+0000","last_peered":"2024-09-17T02:55:25.558716+0000","last_clean":"2024-09-17T02:55:25.558716+0000","last_became_active":"2024-09-17T02:55:23.762903+0000","last_became_peered":"2024-09-17T02:55:23.762903+0000","last_unstale":"2024-09-17T02:55:25.558716+0000","last_undegraded":"2024-09-17T02:55:25.558716+0000","last_fullsized":"2024-09-17T02:55:25.558716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:36.327921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773757+0000","last_change":"2024-09-17T02:55:22.754011+0000","last_active":"2024-09-17T02:55:24.773757+0000","last_peered":"2024-09-17T02:55:24.773757+0000","last_clean":"2024-09-17T02:55:24.773757+0000","last_became_active":"2024-09-17T02:55:22.753344+0000","last_became_peered":"2024-09-17T02:55:22.753344+0000","last_unstale":"2024-09-17T02:55:24.773757+0000","last_undegraded":"2024-09-17T02:55:24.773757+0000","last_fullsized":"2024-09-17T02:55:24.773757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:31.935237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559692+0000","last_change":"2024-09-17T02:55:23.767827+0000","last_active":"2024-09-17T02:55:25.559692+0000","last_peered":"2024-09-17T02:55:25.559692+0000","last_clean":"2024-09-17T02:55:25.559692+0000","last_became_active":"2024-09-17T02:55:23.767537+0000","last_became_peered":"2024-09-17T02:55:23.767537+0000","last_unstale":"2024-09-17T02:55:25.559692+0000","last_undegraded":"2024-09-17T02:55:25.559692+0000","last_fullsized":"2024-09-17T02:55:25.559692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:45.189128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773218+0000","last_change":"2024-09-17T02:55:22.755274+0000","last_active":"2024-09-17T02:55:24.773218+0000","last_peered":"2024-09-17T02:55:24.773218+0000","last_clean":"2024-09-17T02:55:24.773218+0000","last_became_active":"2024-09-17T02:55:22.754605+0000","last_became_peered":"2024-09-17T02:55:22.754605+0000","last_unstale":"2024-09-17T02:55:24.773218+0000","last_undegraded":"2024-09-17T02:55:24.773218+0000","last_fullsized":"2024-09-17T02:55:24.773218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:17.583183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772112+0000","last_change":"2024-09-17T02:55:23.772072+0000","last_active":"2024-09-17T02:55:24.772112+0000","last_peered":"2024-09-17T02:55:24.772112+0000","last_clean":"2024-09-17T02:55:24.772112+0000","last_became_active":"2024-09-17T02:55:23.771792+0000","last_became_peered":"2024-09-17T02:55:23.771792+0000","last_unstale":"2024-09-17T02:55:24.772112+0000","last_undegraded":"2024-09-17T02:55:24.772112+0000","last_fullsized":"2024-09-17T02:55:24.772112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:02.726215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773966+0000","last_change":"2024-09-17T02:55:22.758159+0000","last_active":"2024-09-17T02:55:24.773966+0000","last_peered":"2024-09-17T02:55:24.773966+0000","last_clean":"2024-09-17T02:55:24.773966+0000","last_became_active":"2024-09-17T02:55:22.757877+0000","last_became_peered":"2024-09-17T02:55:22.757877+0000","last_unstale":"2024-09-17T02:55:24.773966+0000","last_undegraded":"2024-09-17T02:55:24.773966+0000","last_fullsized":"2024-09-17T02:55:24.773966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:13.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755596+0000","last_change":"2024-09-17T02:55:23.756674+0000","last_active":"2024-09-17T02:55:24.755596+0000","last_peered":"2024-09-17T02:55:24.755596+0000","last_clean":"2024-09-17T02:55:24.755596+0000","last_became_active":"2024-09-17T02:55:23.756350+0000","last_became_peered":"2024-09-17T02:55:23.756350+0000","last_unstale":"2024-09-17T02:55:24.755596+0000","last_undegraded":"2024-09-17T02:55:24.755596+0000","last_fullsized":"2024-09-17T02:55:24.755596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:24.003131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772479+0000","last_change":"2024-09-17T02:55:22.751846+0000","last_active":"2024-09-17T02:55:24.772479+0000","last_peered":"2024-09-17T02:55:24.772479+0000","last_clean":"2024-09-17T02:55:24.772479+0000","last_became_active":"2024-09-17T02:55:22.751551+0000","last_became_peered":"2024-09-17T02:55:22.751551+0000","last_unstale":"2024-09-17T02:55:24.772479+0000","last_undegraded":"2024-09-17T02:55:24.772479+0000","last_fullsized":"2024-09-17T02:55:24.772479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:30.114661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772271+0000","last_change":"2024-09-17T02:55:23.758052+0000","last_active":"2024-09-17T02:55:24.772271+0000","last_peered":"2024-09-17T02:55:24.772271+0000","last_clean":"2024-09-17T02:55:24.772271+0000","last_became_active":"2024-09-17T02:55:23.757775+0000","last_became_peered":"2024-09-17T02:55:23.757775+0000","last_unstale":"2024-09-17T02:55:24.772271+0000","last_undegraded":"2024-09-17T02:55:24.772271+0000","last_fullsized":"2024-09-17T02:55:24.772271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:27.874282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.774050+0000","last_change":"2024-09-17T02:55:22.752619+0000","last_active":"2024-09-17T02:55:24.774050+0000","last_peered":"2024-09-17T02:55:24.774050+0000","last_clean":"2024-09-17T02:55:24.774050+0000","last_became_active":"2024-09-17T02:55:22.752322+0000","last_became_peered":"2024-09-17T02:55:22.752322+0000","last_unstale":"2024-09-17T02:55:24.774050+0000","last_undegraded":"2024-09-17T02:55:24.774050+0000","last_fullsized":"2024-09-17T02:55:24.774050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.632318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754460+0000","last_change":"2024-09-17T02:55:23.773078+0000","last_active":"2024-09-17T02:55:24.754460+0000","last_peered":"2024-09-17T02:55:24.754460+0000","last_clean":"2024-09-17T02:55:24.754460+0000","last_became_active":"2024-09-17T02:55:23.772301+0000","last_became_peered":"2024-09-17T02:55:23.772301+0000","last_unstale":"2024-09-17T02:55:24.754460+0000","last_undegraded":"2024-09-17T02:55:24.754460+0000","last_fullsized":"2024-09-17T02:55:24.754460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:03.618274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756061+0000","last_change":"2024-09-17T02:55:22.753104+0000","last_active":"2024-09-17T02:55:24.756061+0000","last_peered":"2024-09-17T02:55:24.756061+0000","last_clean":"2024-09-17T02:55:24.756061+0000","last_became_active":"2024-09-17T02:55:22.752824+0000","last_became_peered":"2024-09-17T02:55:22.752824+0000","last_unstale":"2024-09-17T02:55:24.756061+0000","last_undegraded":"2024-09-17T02:55:24.756061+0000","last_fullsized":"2024-09-17T02:55:24.756061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.061844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755770+0000","last_change":"2024-09-17T02:55:23.770697+0000","last_active":"2024-09-17T02:55:24.755770+0000","last_peered":"2024-09-17T02:55:24.755770+0000","last_clean":"2024-09-17T02:55:24.755770+0000","last_became_active":"2024-09-17T02:55:23.770287+0000","last_became_peered":"2024-09-17T02:55:23.770287+0000","last_unstale":"2024-09-17T02:55:24.755770+0000","last_undegraded":"2024-09-17T02:55:24.755770+0000","last_fullsized":"2024-09-17T02:55:24.755770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:29.327645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754879+0000","last_change":"2024-09-17T02:55:22.752551+0000","last_active":"2024-09-17T02:55:24.754879+0000","last_peered":"2024-09-17T02:55:24.754879+0000","last_clean":"2024-09-17T02:55:24.754879+0000","last_became_active":"2024-09-17T02:55:22.751727+0000","last_became_peered":"2024-09-17T02:55:22.751727+0000","last_unstale":"2024-09-17T02:55:24.754879+0000","last_undegraded":"2024-09-17T02:55:24.754879+0000","last_fullsized":"2024-09-17T02:55:24.754879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:17.772265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559548+0000","last_change":"2024-09-17T02:55:23.773412+0000","last_active":"2024-09-17T02:55:25.559548+0000","last_peered":"2024-09-17T02:55:25.559548+0000","last_clean":"2024-09-17T02:55:25.559548+0000","last_became_active":"2024-09-17T02:55:23.773129+0000","last_became_peered":"2024-09-17T02:55:23.773129+0000","last_unstale":"2024-09-17T02:55:25.559548+0000","last_undegraded":"2024-09-17T02:55:25.559548+0000","last_fullsized":"2024-09-17T02:55:25.559548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:41.718052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755056+0000","last_change":"2024-09-17T02:55:22.745769+0000","last_active":"2024-09-17T02:55:24.755056+0000","last_peered":"2024-09-17T02:55:24.755056+0000","last_clean":"2024-09-17T02:55:24.755056+0000","last_became_active":"2024-09-17T02:55:22.745478+0000","last_became_peered":"2024-09-17T02:55:22.745478+0000","last_unstale":"2024-09-17T02:55:24.755056+0000","last_undegraded":"2024-09-17T02:55:24.755056+0000","last_fullsized":"2024-09-17T02:55:24.755056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:45.632009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558985+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:55:25.558985+0000","last_peered":"2024-09-17T02:55:25.558985+0000","last_clean":"2024-09-17T02:55:25.558985+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:55:25.558985+0000","last_undegraded":"2024-09-17T02:55:25.558985+0000","last_fullsized":"2024-09-17T02:55:25.558985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860747,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860691,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861259,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859729,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861293,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859729,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270995,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:55:28.730 INFO:tasks.ceph.mds.c.smithi104.stderr:2024-09-17T02:55:28.731+0000 7fecd0151640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:55:31.209 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:55:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.338+0000 7f500024d640 1 -- 172.21.15.104:0/1427515861 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 msgr2=0x7f4ff80b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.338+0000 7f500024d640 1 --2- 172.21.15.104:0/1427515861 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 0x7f4ff80b39c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80cf770 tx=0x7f4ff402a5c0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.338+0000 7f500024d640 1 -- 172.21.15.104:0/1427515861 shutdown_connections 2024-09-17T02:55:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.338+0000 7f500024d640 1 --2- 172.21.15.104:0/1427515861 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 0x7f4ff80b39c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.338+0000 7f500024d640 1 -- 172.21.15.104:0/1427515861 >> 172.21.15.104:0/1427515861 conn(0x7f4ff80b44a0 msgr2=0x7f4ff80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.338+0000 7f500024d640 1 -- 172.21.15.104:0/1427515861 shutdown_connections 2024-09-17T02:55:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.338+0000 7f500024d640 1 -- 172.21.15.104:0/1427515861 wait complete. 2024-09-17T02:55:31.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.340+0000 7f500024d640 1 Processor -- start 2024-09-17T02:55:31.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.340+0000 7f500024d640 1 -- start start 2024-09-17T02:55:31.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f500024d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ff80b3f00 0x7f4ff80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f500024d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 0x7f4ff8071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f500024d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ff80cdf10 0x7f4ff80c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f500024d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8168210 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f500024d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8168390 con 0x7f4ff80b3f00 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f500024d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff8168510 con 0x7f4ff80cdf10 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffd7e8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 0x7f4ff8071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffd7e8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 0x7f4ff8071e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59322/0 (socket says 172.21.15.104:59322) 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffd7e8640 1 -- 172.21.15.104:0/4075179855 learned_addr learned my addr 172.21.15.104:0/4075179855 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffdfe9640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ff80b3f00 0x7f4ff80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffe7ea640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ff80cdf10 0x7f4ff80c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:31.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffd7e8640 1 -- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ff80cdf10 msgr2=0x7f4ff80c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffd7e8640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ff80cdf10 0x7f4ff80c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffd7e8640 1 -- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ff80b3f00 msgr2=0x7f4ff80718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffd7e8640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ff80b3f00 0x7f4ff80718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.341+0000 7f4ffd7e8640 1 -- 172.21.15.104:0/4075179855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff8156480 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.342+0000 7f4ffd7e8640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 0x7f4ff8071e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c370 tx=0x7f4fe800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.342+0000 7f4fee7fc640 1 -- 172.21.15.104:0/4075179855 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8017070 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.342+0000 7f4fee7fc640 1 -- 172.21.15.104:0/4075179855 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fe80035f0 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.342+0000 7f4fee7fc640 1 -- 172.21.15.104:0/4075179855 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8003a40 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.342+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff81f43c0 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.342+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff80c6840 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.343+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff80b39c0 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.344+0000 7f4fee7fc640 1 -- 172.21.15.104:0/4075179855 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fe801a070 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.344+0000 7f4fee7fc640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4fdc078bc0 0x7f4fdc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:31.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.344+0000 7f4fee7fc640 1 -- 172.21.15.104:0/4075179855 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4fe8099f90 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.345+0000 7f4ffdfe9640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4fdc078bc0 0x7f4fdc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:31.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.345+0000 7f4ffdfe9640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4fdc078bc0 0x7f4fdc07b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4034000 tx=0x7f4ff4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:31.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.349+0000 7f4fee7fc640 1 -- 172.21.15.104:0/4075179855 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4fe8061d80 con 0x7f4ff80b4fc0 2024-09-17T02:55:31.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.521+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ff80d18a0 con 0x7f4fdc078bc0 2024-09-17T02:55:31.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.526+0000 7f4fee7fc640 1 -- 172.21.15.104:0/4075179855 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247479 (secure 0 0 0) 0x7f4ff4004460 con 0x7f4fdc078bc0 2024-09-17T02:55:31.527 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:31.528 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:55:31.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4fdc078bc0 msgr2=0x7f4fdc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4fdc078bc0 0x7f4fdc07b0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4034000 tx=0x7f4ff4004730 comp rx=0 tx=0).stop 2024-09-17T02:55:31.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 msgr2=0x7f4ff8071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 0x7f4ff8071e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c370 tx=0x7f4fe800c830 comp rx=0 tx=0).stop 2024-09-17T02:55:31.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 shutdown_connections 2024-09-17T02:55:31.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4fdc078bc0 0x7f4fdc07b0d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ff80cdf10 0x7f4ff80c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ff80b4fc0 0x7f4ff8071e00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 --2- 172.21.15.104:0/4075179855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ff80b3f00 0x7f4ff80718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 >> 172.21.15.104:0/4075179855 conn(0x7f4ff80b44a0 msgr2=0x7f4ff80d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:31.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 shutdown_connections 2024-09-17T02:55:31.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.529+0000 7f500024d640 1 -- 172.21.15.104:0/4075179855 wait complete. 2024-09-17T02:55:31.539 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-17T02:55:29.630755+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560259,"statfs":{"total":1600000000,"available":1597705348,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.891043"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755331+0000","last_change":"2024-09-17T02:55:23.763234+0000","last_active":"2024-09-17T02:55:24.755331+0000","last_peered":"2024-09-17T02:55:24.755331+0000","last_clean":"2024-09-17T02:55:24.755331+0000","last_became_active":"2024-09-17T02:55:23.762966+0000","last_became_peered":"2024-09-17T02:55:23.762966+0000","last_unstale":"2024-09-17T02:55:24.755331+0000","last_undegraded":"2024-09-17T02:55:24.755331+0000","last_fullsized":"2024-09-17T02:55:24.755331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:02.176065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754342+0000","last_change":"2024-09-17T02:55:23.760759+0000","last_active":"2024-09-17T02:55:24.754342+0000","last_peered":"2024-09-17T02:55:24.754342+0000","last_clean":"2024-09-17T02:55:24.754342+0000","last_became_active":"2024-09-17T02:55:23.760524+0000","last_became_peered":"2024-09-17T02:55:23.760524+0000","last_unstale":"2024-09-17T02:55:24.754342+0000","last_undegraded":"2024-09-17T02:55:24.754342+0000","last_fullsized":"2024-09-17T02:55:24.754342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:57.412346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559618+0000","last_change":"2024-09-17T02:55:23.765984+0000","last_active":"2024-09-17T02:55:25.559618+0000","last_peered":"2024-09-17T02:55:25.559618+0000","last_clean":"2024-09-17T02:55:25.559618+0000","last_became_active":"2024-09-17T02:55:23.765355+0000","last_became_peered":"2024-09-17T02:55:23.765355+0000","last_unstale":"2024-09-17T02:55:25.559618+0000","last_undegraded":"2024-09-17T02:55:25.559618+0000","last_fullsized":"2024-09-17T02:55:25.559618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:35.668921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773709+0000","last_change":"2024-09-17T02:55:23.772155+0000","last_active":"2024-09-17T02:55:24.773709+0000","last_peered":"2024-09-17T02:55:24.773709+0000","last_clean":"2024-09-17T02:55:24.773709+0000","last_became_active":"2024-09-17T02:55:23.771617+0000","last_became_peered":"2024-09-17T02:55:23.771617+0000","last_unstale":"2024-09-17T02:55:24.773709+0000","last_undegraded":"2024-09-17T02:55:24.773709+0000","last_fullsized":"2024-09-17T02:55:24.773709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:10.857877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558368+0000","last_change":"2024-09-17T02:55:23.758526+0000","last_active":"2024-09-17T02:55:25.558368+0000","last_peered":"2024-09-17T02:55:25.558368+0000","last_clean":"2024-09-17T02:55:25.558368+0000","last_became_active":"2024-09-17T02:55:23.758246+0000","last_became_peered":"2024-09-17T02:55:23.758246+0000","last_unstale":"2024-09-17T02:55:25.558368+0000","last_undegraded":"2024-09-17T02:55:25.558368+0000","last_fullsized":"2024-09-17T02:55:25.558368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:01.477698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754475+0000","last_change":"2024-09-17T02:55:23.758648+0000","last_active":"2024-09-17T02:55:24.754475+0000","last_peered":"2024-09-17T02:55:24.754475+0000","last_clean":"2024-09-17T02:55:24.754475+0000","last_became_active":"2024-09-17T02:55:23.758384+0000","last_became_peered":"2024-09-17T02:55:23.758384+0000","last_unstale":"2024-09-17T02:55:24.754475+0000","last_undegraded":"2024-09-17T02:55:24.754475+0000","last_fullsized":"2024-09-17T02:55:24.754475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:35.038069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558767+0000","last_change":"2024-09-17T02:55:23.761435+0000","last_active":"2024-09-17T02:55:25.558767+0000","last_peered":"2024-09-17T02:55:25.558767+0000","last_clean":"2024-09-17T02:55:25.558767+0000","last_became_active":"2024-09-17T02:55:23.760429+0000","last_became_peered":"2024-09-17T02:55:23.760429+0000","last_unstale":"2024-09-17T02:55:25.558767+0000","last_undegraded":"2024-09-17T02:55:25.558767+0000","last_fullsized":"2024-09-17T02:55:25.558767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:38:25.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558642+0000","last_change":"2024-09-17T02:55:23.759213+0000","last_active":"2024-09-17T02:55:25.558642+0000","last_peered":"2024-09-17T02:55:25.558642+0000","last_clean":"2024-09-17T02:55:25.558642+0000","last_became_active":"2024-09-17T02:55:23.758779+0000","last_became_peered":"2024-09-17T02:55:23.758779+0000","last_unstale":"2024-09-17T02:55:25.558642+0000","last_undegraded":"2024-09-17T02:55:25.558642+0000","last_fullsized":"2024-09-17T02:55:25.558642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:26.394839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756460+0000","last_change":"2024-09-17T02:55:23.771692+0000","last_active":"2024-09-17T02:55:24.756460+0000","last_peered":"2024-09-17T02:55:24.756460+0000","last_clean":"2024-09-17T02:55:24.756460+0000","last_became_active":"2024-09-17T02:55:23.771426+0000","last_became_peered":"2024-09-17T02:55:23.771426+0000","last_unstale":"2024-09-17T02:55:24.756460+0000","last_undegraded":"2024-09-17T02:55:24.756460+0000","last_fullsized":"2024-09-17T02:55:24.756460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:49.620990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773826+0000","last_change":"2024-09-17T02:55:23.769000+0000","last_active":"2024-09-17T02:55:24.773826+0000","last_peered":"2024-09-17T02:55:24.773826+0000","last_clean":"2024-09-17T02:55:24.773826+0000","last_became_active":"2024-09-17T02:55:23.768726+0000","last_became_peered":"2024-09-17T02:55:23.768726+0000","last_unstale":"2024-09-17T02:55:24.773826+0000","last_undegraded":"2024-09-17T02:55:24.773826+0000","last_fullsized":"2024-09-17T02:55:24.773826+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:18.547878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559121+0000","last_change":"2024-09-17T02:55:23.767751+0000","last_active":"2024-09-17T02:55:25.559121+0000","last_peered":"2024-09-17T02:55:25.559121+0000","last_clean":"2024-09-17T02:55:25.559121+0000","last_became_active":"2024-09-17T02:55:23.767129+0000","last_became_peered":"2024-09-17T02:55:23.767129+0000","last_unstale":"2024-09-17T02:55:25.559121+0000","last_undegraded":"2024-09-17T02:55:25.559121+0000","last_fullsized":"2024-09-17T02:55:25.559121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:40.364033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559229+0000","last_change":"2024-09-17T02:55:23.763423+0000","last_active":"2024-09-17T02:55:25.559229+0000","last_peered":"2024-09-17T02:55:25.559229+0000","last_clean":"2024-09-17T02:55:25.559229+0000","last_became_active":"2024-09-17T02:55:23.761248+0000","last_became_peered":"2024-09-17T02:55:23.761248+0000","last_unstale":"2024-09-17T02:55:25.559229+0000","last_undegraded":"2024-09-17T02:55:25.559229+0000","last_fullsized":"2024-09-17T02:55:25.559229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:00.363448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558253+0000","last_change":"2024-09-17T02:55:23.765375+0000","last_active":"2024-09-17T02:55:25.558253+0000","last_peered":"2024-09-17T02:55:25.558253+0000","last_clean":"2024-09-17T02:55:25.558253+0000","last_became_active":"2024-09-17T02:55:23.765081+0000","last_became_peered":"2024-09-17T02:55:23.765081+0000","last_unstale":"2024-09-17T02:55:25.558253+0000","last_undegraded":"2024-09-17T02:55:25.558253+0000","last_fullsized":"2024-09-17T02:55:25.558253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:16.933974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754591+0000","last_change":"2024-09-17T02:55:23.762299+0000","last_active":"2024-09-17T02:55:24.754591+0000","last_peered":"2024-09-17T02:55:24.754591+0000","last_clean":"2024-09-17T02:55:24.754591+0000","last_became_active":"2024-09-17T02:55:23.761465+0000","last_became_peered":"2024-09-17T02:55:23.761465+0000","last_unstale":"2024-09-17T02:55:24.754591+0000","last_undegraded":"2024-09-17T02:55:24.754591+0000","last_fullsized":"2024-09-17T02:55:24.754591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:12.524729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558993+0000","last_change":"2024-09-17T02:55:23.760775+0000","last_active":"2024-09-17T02:55:25.558993+0000","last_peered":"2024-09-17T02:55:25.558993+0000","last_clean":"2024-09-17T02:55:25.558993+0000","last_became_active":"2024-09-17T02:55:23.760412+0000","last_became_peered":"2024-09-17T02:55:23.760412+0000","last_unstale":"2024-09-17T02:55:25.558993+0000","last_undegraded":"2024-09-17T02:55:25.558993+0000","last_fullsized":"2024-09-17T02:55:25.558993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:18.733155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559354+0000","last_change":"2024-09-17T02:55:23.769123+0000","last_active":"2024-09-17T02:55:25.559354+0000","last_peered":"2024-09-17T02:55:25.559354+0000","last_clean":"2024-09-17T02:55:25.559354+0000","last_became_active":"2024-09-17T02:55:23.767486+0000","last_became_peered":"2024-09-17T02:55:23.767486+0000","last_unstale":"2024-09-17T02:55:25.559354+0000","last_undegraded":"2024-09-17T02:55:25.559354+0000","last_fullsized":"2024-09-17T02:55:25.559354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:00.502421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559360+0000","last_change":"2024-09-17T02:55:23.761764+0000","last_active":"2024-09-17T02:55:25.559360+0000","last_peered":"2024-09-17T02:55:25.559360+0000","last_clean":"2024-09-17T02:55:25.559360+0000","last_became_active":"2024-09-17T02:55:23.761074+0000","last_became_peered":"2024-09-17T02:55:23.761074+0000","last_unstale":"2024-09-17T02:55:25.559360+0000","last_undegraded":"2024-09-17T02:55:25.559360+0000","last_fullsized":"2024-09-17T02:55:25.559360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:59.588033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754467+0000","last_change":"2024-09-17T02:55:23.766439+0000","last_active":"2024-09-17T02:55:24.754467+0000","last_peered":"2024-09-17T02:55:24.754467+0000","last_clean":"2024-09-17T02:55:24.754467+0000","last_became_active":"2024-09-17T02:55:23.766146+0000","last_became_peered":"2024-09-17T02:55:23.766146+0000","last_unstale":"2024-09-17T02:55:24.754467+0000","last_undegraded":"2024-09-17T02:55:24.754467+0000","last_fullsized":"2024-09-17T02:55:24.754467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:53.110155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754305+0000","last_change":"2024-09-17T02:55:23.772590+0000","last_active":"2024-09-17T02:55:24.754305+0000","last_peered":"2024-09-17T02:55:24.754305+0000","last_clean":"2024-09-17T02:55:24.754305+0000","last_became_active":"2024-09-17T02:55:23.771951+0000","last_became_peered":"2024-09-17T02:55:23.771951+0000","last_unstale":"2024-09-17T02:55:24.754305+0000","last_undegraded":"2024-09-17T02:55:24.754305+0000","last_fullsized":"2024-09-17T02:55:24.754305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:32.000614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558522+0000","last_change":"2024-09-17T02:55:23.763843+0000","last_active":"2024-09-17T02:55:25.558522+0000","last_peered":"2024-09-17T02:55:25.558522+0000","last_clean":"2024-09-17T02:55:25.558522+0000","last_became_active":"2024-09-17T02:55:23.763579+0000","last_became_peered":"2024-09-17T02:55:23.763579+0000","last_unstale":"2024-09-17T02:55:25.558522+0000","last_undegraded":"2024-09-17T02:55:25.558522+0000","last_fullsized":"2024-09-17T02:55:25.558522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:49.074744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755783+0000","last_change":"2024-09-17T02:55:23.769159+0000","last_active":"2024-09-17T02:55:24.755783+0000","last_peered":"2024-09-17T02:55:24.755783+0000","last_clean":"2024-09-17T02:55:24.755783+0000","last_became_active":"2024-09-17T02:55:23.768395+0000","last_became_peered":"2024-09-17T02:55:23.768395+0000","last_unstale":"2024-09-17T02:55:24.755783+0000","last_undegraded":"2024-09-17T02:55:24.755783+0000","last_fullsized":"2024-09-17T02:55:24.755783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:15.198371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756319+0000","last_change":"2024-09-17T02:55:23.770819+0000","last_active":"2024-09-17T02:55:24.756319+0000","last_peered":"2024-09-17T02:55:24.756319+0000","last_clean":"2024-09-17T02:55:24.756319+0000","last_became_active":"2024-09-17T02:55:23.770265+0000","last_became_peered":"2024-09-17T02:55:23.770265+0000","last_unstale":"2024-09-17T02:55:24.756319+0000","last_undegraded":"2024-09-17T02:55:24.756319+0000","last_fullsized":"2024-09-17T02:55:24.756319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:55.998783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772269+0000","last_change":"2024-09-17T02:55:23.759110+0000","last_active":"2024-09-17T02:55:24.772269+0000","last_peered":"2024-09-17T02:55:24.772269+0000","last_clean":"2024-09-17T02:55:24.772269+0000","last_became_active":"2024-09-17T02:55:23.758829+0000","last_became_peered":"2024-09-17T02:55:23.758829+0000","last_unstale":"2024-09-17T02:55:24.772269+0000","last_undegraded":"2024-09-17T02:55:24.772269+0000","last_fullsized":"2024-09-17T02:55:24.772269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:21.562671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558908+0000","last_change":"2024-09-17T02:55:23.758915+0000","last_active":"2024-09-17T02:55:25.558908+0000","last_peered":"2024-09-17T02:55:25.558908+0000","last_clean":"2024-09-17T02:55:25.558908+0000","last_became_active":"2024-09-17T02:55:23.758627+0000","last_became_peered":"2024-09-17T02:55:23.758627+0000","last_unstale":"2024-09-17T02:55:25.558908+0000","last_undegraded":"2024-09-17T02:55:25.558908+0000","last_fullsized":"2024-09-17T02:55:25.558908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:14.451425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773550+0000","last_change":"2024-09-17T02:55:23.767294+0000","last_active":"2024-09-17T02:55:24.773550+0000","last_peered":"2024-09-17T02:55:24.773550+0000","last_clean":"2024-09-17T02:55:24.773550+0000","last_became_active":"2024-09-17T02:55:23.767059+0000","last_became_peered":"2024-09-17T02:55:23.767059+0000","last_unstale":"2024-09-17T02:55:24.773550+0000","last_undegraded":"2024-09-17T02:55:24.773550+0000","last_fullsized":"2024-09-17T02:55:24.773550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:17.235523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754698+0000","last_change":"2024-09-17T02:55:23.767445+0000","last_active":"2024-09-17T02:55:24.754698+0000","last_peered":"2024-09-17T02:55:24.754698+0000","last_clean":"2024-09-17T02:55:24.754698+0000","last_became_active":"2024-09-17T02:55:23.767130+0000","last_became_peered":"2024-09-17T02:55:23.767130+0000","last_unstale":"2024-09-17T02:55:24.754698+0000","last_undegraded":"2024-09-17T02:55:24.754698+0000","last_fullsized":"2024-09-17T02:55:24.754698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:21.133046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773952+0000","last_change":"2024-09-17T02:55:23.770868+0000","last_active":"2024-09-17T02:55:24.773952+0000","last_peered":"2024-09-17T02:55:24.773952+0000","last_clean":"2024-09-17T02:55:24.773952+0000","last_became_active":"2024-09-17T02:55:23.770549+0000","last_became_peered":"2024-09-17T02:55:23.770549+0000","last_unstale":"2024-09-17T02:55:24.773952+0000","last_undegraded":"2024-09-17T02:55:24.773952+0000","last_fullsized":"2024-09-17T02:55:24.773952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:41.450816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558544+0000","last_change":"2024-09-17T02:55:23.762508+0000","last_active":"2024-09-17T02:55:25.558544+0000","last_peered":"2024-09-17T02:55:25.558544+0000","last_clean":"2024-09-17T02:55:25.558544+0000","last_became_active":"2024-09-17T02:55:23.762010+0000","last_became_peered":"2024-09-17T02:55:23.762010+0000","last_unstale":"2024-09-17T02:55:25.558544+0000","last_undegraded":"2024-09-17T02:55:25.558544+0000","last_fullsized":"2024-09-17T02:55:25.558544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:02.694407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756626+0000","last_change":"2024-09-17T02:55:23.770254+0000","last_active":"2024-09-17T02:55:24.756626+0000","last_peered":"2024-09-17T02:55:24.756626+0000","last_clean":"2024-09-17T02:55:24.756626+0000","last_became_active":"2024-09-17T02:55:23.768106+0000","last_became_peered":"2024-09-17T02:55:23.768106+0000","last_unstale":"2024-09-17T02:55:24.756626+0000","last_undegraded":"2024-09-17T02:55:24.756626+0000","last_fullsized":"2024-09-17T02:55:24.756626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:13.944953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559040+0000","last_change":"2024-09-17T02:55:23.766090+0000","last_active":"2024-09-17T02:55:25.559040+0000","last_peered":"2024-09-17T02:55:25.559040+0000","last_clean":"2024-09-17T02:55:25.559040+0000","last_became_active":"2024-09-17T02:55:23.765302+0000","last_became_peered":"2024-09-17T02:55:23.765302+0000","last_unstale":"2024-09-17T02:55:25.559040+0000","last_undegraded":"2024-09-17T02:55:25.559040+0000","last_fullsized":"2024-09-17T02:55:25.559040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:13.256977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755624+0000","last_change":"2024-09-17T02:55:23.762259+0000","last_active":"2024-09-17T02:55:24.755624+0000","last_peered":"2024-09-17T02:55:24.755624+0000","last_clean":"2024-09-17T02:55:24.755624+0000","last_became_active":"2024-09-17T02:55:23.761979+0000","last_became_peered":"2024-09-17T02:55:23.761979+0000","last_unstale":"2024-09-17T02:55:24.755624+0000","last_undegraded":"2024-09-17T02:55:24.755624+0000","last_fullsized":"2024-09-17T02:55:24.755624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:27.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559596+0000","last_change":"2024-09-17T02:55:23.772516+0000","last_active":"2024-09-17T02:55:25.559596+0000","last_peered":"2024-09-17T02:55:25.559596+0000","last_clean":"2024-09-17T02:55:25.559596+0000","last_became_active":"2024-09-17T02:55:23.772242+0000","last_became_peered":"2024-09-17T02:55:23.772242+0000","last_unstale":"2024-09-17T02:55:25.559596+0000","last_undegraded":"2024-09-17T02:55:25.559596+0000","last_fullsized":"2024-09-17T02:55:25.559596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:24.036995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772438+0000","last_change":"2024-09-17T02:55:23.765811+0000","last_active":"2024-09-17T02:55:24.772438+0000","last_peered":"2024-09-17T02:55:24.772438+0000","last_clean":"2024-09-17T02:55:24.772438+0000","last_became_active":"2024-09-17T02:55:23.765540+0000","last_became_peered":"2024-09-17T02:55:23.765540+0000","last_unstale":"2024-09-17T02:55:24.772438+0000","last_undegraded":"2024-09-17T02:55:24.772438+0000","last_fullsized":"2024-09-17T02:55:24.772438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:42.713792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755246+0000","last_change":"2024-09-17T02:55:22.750235+0000","last_active":"2024-09-17T02:55:24.755246+0000","last_peered":"2024-09-17T02:55:24.755246+0000","last_clean":"2024-09-17T02:55:24.755246+0000","last_became_active":"2024-09-17T02:55:22.749957+0000","last_became_peered":"2024-09-17T02:55:22.749957+0000","last_unstale":"2024-09-17T02:55:24.755246+0000","last_undegraded":"2024-09-17T02:55:24.755246+0000","last_fullsized":"2024-09-17T02:55:24.755246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:06.172642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755103+0000","last_change":"2024-09-17T02:55:23.771814+0000","last_active":"2024-09-17T02:55:24.755103+0000","last_peered":"2024-09-17T02:55:24.755103+0000","last_clean":"2024-09-17T02:55:24.755103+0000","last_became_active":"2024-09-17T02:55:23.771560+0000","last_became_peered":"2024-09-17T02:55:23.771560+0000","last_unstale":"2024-09-17T02:55:24.755103+0000","last_undegraded":"2024-09-17T02:55:24.755103+0000","last_fullsized":"2024-09-17T02:55:24.755103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:46.482658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772223+0000","last_change":"2024-09-17T02:55:22.749000+0000","last_active":"2024-09-17T02:55:24.772223+0000","last_peered":"2024-09-17T02:55:24.772223+0000","last_clean":"2024-09-17T02:55:24.772223+0000","last_became_active":"2024-09-17T02:55:22.748475+0000","last_became_peered":"2024-09-17T02:55:22.748475+0000","last_unstale":"2024-09-17T02:55:24.772223+0000","last_undegraded":"2024-09-17T02:55:24.772223+0000","last_fullsized":"2024-09-17T02:55:24.772223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:50.894439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756087+0000","last_change":"2024-09-17T02:55:23.769955+0000","last_active":"2024-09-17T02:55:24.756087+0000","last_peered":"2024-09-17T02:55:24.756087+0000","last_clean":"2024-09-17T02:55:24.756087+0000","last_became_active":"2024-09-17T02:55:23.768750+0000","last_became_peered":"2024-09-17T02:55:23.768750+0000","last_unstale":"2024-09-17T02:55:24.756087+0000","last_undegraded":"2024-09-17T02:55:24.756087+0000","last_fullsized":"2024-09-17T02:55:24.756087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:25.986239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754608+0000","last_change":"2024-09-17T02:55:22.754155+0000","last_active":"2024-09-17T02:55:24.754608+0000","last_peered":"2024-09-17T02:55:24.754608+0000","last_clean":"2024-09-17T02:55:24.754608+0000","last_became_active":"2024-09-17T02:55:22.753863+0000","last_became_peered":"2024-09-17T02:55:22.753863+0000","last_unstale":"2024-09-17T02:55:24.754608+0000","last_undegraded":"2024-09-17T02:55:24.754608+0000","last_fullsized":"2024-09-17T02:55:24.754608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:31.440074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773690+0000","last_change":"2024-09-17T02:55:23.775061+0000","last_active":"2024-09-17T02:55:24.773690+0000","last_peered":"2024-09-17T02:55:24.773690+0000","last_clean":"2024-09-17T02:55:24.773690+0000","last_became_active":"2024-09-17T02:55:23.774691+0000","last_became_peered":"2024-09-17T02:55:23.774691+0000","last_unstale":"2024-09-17T02:55:24.773690+0000","last_undegraded":"2024-09-17T02:55:24.773690+0000","last_fullsized":"2024-09-17T02:55:24.773690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:22.422215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558406+0000","last_change":"2024-09-17T02:55:22.756798+0000","last_active":"2024-09-17T02:55:25.558406+0000","last_peered":"2024-09-17T02:55:25.558406+0000","last_clean":"2024-09-17T02:55:25.558406+0000","last_became_active":"2024-09-17T02:55:22.756479+0000","last_became_peered":"2024-09-17T02:55:22.756479+0000","last_unstale":"2024-09-17T02:55:25.558406+0000","last_undegraded":"2024-09-17T02:55:25.558406+0000","last_fullsized":"2024-09-17T02:55:25.558406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:34.456378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559118+0000","last_change":"2024-09-17T02:55:23.770625+0000","last_active":"2024-09-17T02:55:25.559118+0000","last_peered":"2024-09-17T02:55:25.559118+0000","last_clean":"2024-09-17T02:55:25.559118+0000","last_became_active":"2024-09-17T02:55:23.770365+0000","last_became_peered":"2024-09-17T02:55:23.770365+0000","last_unstale":"2024-09-17T02:55:25.559118+0000","last_undegraded":"2024-09-17T02:55:25.559118+0000","last_fullsized":"2024-09-17T02:55:25.559118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:57:48.468603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756000+0000","last_change":"2024-09-17T02:55:22.748420+0000","last_active":"2024-09-17T02:55:24.756000+0000","last_peered":"2024-09-17T02:55:24.756000+0000","last_clean":"2024-09-17T02:55:24.756000+0000","last_became_active":"2024-09-17T02:55:22.747791+0000","last_became_peered":"2024-09-17T02:55:22.747791+0000","last_unstale":"2024-09-17T02:55:24.756000+0000","last_undegraded":"2024-09-17T02:55:24.756000+0000","last_fullsized":"2024-09-17T02:55:24.756000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:56.555993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559466+0000","last_change":"2024-09-17T02:55:23.764167+0000","last_active":"2024-09-17T02:55:25.559466+0000","last_peered":"2024-09-17T02:55:25.559466+0000","last_clean":"2024-09-17T02:55:25.559466+0000","last_became_active":"2024-09-17T02:55:23.762655+0000","last_became_peered":"2024-09-17T02:55:23.762655+0000","last_unstale":"2024-09-17T02:55:25.559466+0000","last_undegraded":"2024-09-17T02:55:25.559466+0000","last_fullsized":"2024-09-17T02:55:25.559466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:58.430021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755915+0000","last_change":"2024-09-17T02:55:22.744832+0000","last_active":"2024-09-17T02:55:24.755915+0000","last_peered":"2024-09-17T02:55:24.755915+0000","last_clean":"2024-09-17T02:55:24.755915+0000","last_became_active":"2024-09-17T02:55:22.744521+0000","last_became_peered":"2024-09-17T02:55:22.744521+0000","last_unstale":"2024-09-17T02:55:24.755915+0000","last_undegraded":"2024-09-17T02:55:24.755915+0000","last_fullsized":"2024-09-17T02:55:24.755915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:51.741944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756304+0000","last_change":"2024-09-17T02:55:23.773801+0000","last_active":"2024-09-17T02:55:24.756304+0000","last_peered":"2024-09-17T02:55:24.756304+0000","last_clean":"2024-09-17T02:55:24.756304+0000","last_became_active":"2024-09-17T02:55:23.771876+0000","last_became_peered":"2024-09-17T02:55:23.771876+0000","last_unstale":"2024-09-17T02:55:24.756304+0000","last_undegraded":"2024-09-17T02:55:24.756304+0000","last_fullsized":"2024-09-17T02:55:24.756304+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:47.225435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754655+0000","last_change":"2024-09-17T02:55:22.750835+0000","last_active":"2024-09-17T02:55:24.754655+0000","last_peered":"2024-09-17T02:55:24.754655+0000","last_clean":"2024-09-17T02:55:24.754655+0000","last_became_active":"2024-09-17T02:55:22.750538+0000","last_became_peered":"2024-09-17T02:55:22.750538+0000","last_unstale":"2024-09-17T02:55:24.754655+0000","last_undegraded":"2024-09-17T02:55:24.754655+0000","last_fullsized":"2024-09-17T02:55:24.754655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:40.139589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773947+0000","last_change":"2024-09-17T02:55:23.771875+0000","last_active":"2024-09-17T02:55:24.773947+0000","last_peered":"2024-09-17T02:55:24.773947+0000","last_clean":"2024-09-17T02:55:24.773947+0000","last_became_active":"2024-09-17T02:55:23.771137+0000","last_became_peered":"2024-09-17T02:55:23.771137+0000","last_unstale":"2024-09-17T02:55:24.773947+0000","last_undegraded":"2024-09-17T02:55:24.773947+0000","last_fullsized":"2024-09-17T02:55:24.773947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:23.231203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756757+0000","last_change":"2024-09-17T02:55:22.746242+0000","last_active":"2024-09-17T02:55:24.756757+0000","last_peered":"2024-09-17T02:55:24.756757+0000","last_clean":"2024-09-17T02:55:24.756757+0000","last_became_active":"2024-09-17T02:55:22.742782+0000","last_became_peered":"2024-09-17T02:55:22.742782+0000","last_unstale":"2024-09-17T02:55:24.756757+0000","last_undegraded":"2024-09-17T02:55:24.756757+0000","last_fullsized":"2024-09-17T02:55:24.756757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:18.286213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559923+0000","last_change":"2024-09-17T02:55:23.759031+0000","last_active":"2024-09-17T02:55:25.559923+0000","last_peered":"2024-09-17T02:55:25.559923+0000","last_clean":"2024-09-17T02:55:25.559923+0000","last_became_active":"2024-09-17T02:55:23.758744+0000","last_became_peered":"2024-09-17T02:55:23.758744+0000","last_unstale":"2024-09-17T02:55:25.559923+0000","last_undegraded":"2024-09-17T02:55:25.559923+0000","last_fullsized":"2024-09-17T02:55:25.559923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:10.565881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755011+0000","last_change":"2024-09-17T02:55:22.753163+0000","last_active":"2024-09-17T02:55:24.755011+0000","last_peered":"2024-09-17T02:55:24.755011+0000","last_clean":"2024-09-17T02:55:24.755011+0000","last_became_active":"2024-09-17T02:55:22.752758+0000","last_became_peered":"2024-09-17T02:55:22.752758+0000","last_unstale":"2024-09-17T02:55:24.755011+0000","last_undegraded":"2024-09-17T02:55:24.755011+0000","last_fullsized":"2024-09-17T02:55:24.755011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:19.694851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754908+0000","last_change":"2024-09-17T02:55:23.764980+0000","last_active":"2024-09-17T02:55:24.754908+0000","last_peered":"2024-09-17T02:55:24.754908+0000","last_clean":"2024-09-17T02:55:24.754908+0000","last_became_active":"2024-09-17T02:55:23.764693+0000","last_became_peered":"2024-09-17T02:55:23.764693+0000","last_unstale":"2024-09-17T02:55:24.754908+0000","last_undegraded":"2024-09-17T02:55:24.754908+0000","last_fullsized":"2024-09-17T02:55:24.754908+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:28.863692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772284+0000","last_change":"2024-09-17T02:55:22.749862+0000","last_active":"2024-09-17T02:55:24.772284+0000","last_peered":"2024-09-17T02:55:24.772284+0000","last_clean":"2024-09-17T02:55:24.772284+0000","last_became_active":"2024-09-17T02:55:22.749534+0000","last_became_peered":"2024-09-17T02:55:22.749534+0000","last_unstale":"2024-09-17T02:55:24.772284+0000","last_undegraded":"2024-09-17T02:55:24.772284+0000","last_fullsized":"2024-09-17T02:55:24.772284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:34.487448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754823+0000","last_change":"2024-09-17T02:55:23.767158+0000","last_active":"2024-09-17T02:55:24.754823+0000","last_peered":"2024-09-17T02:55:24.754823+0000","last_clean":"2024-09-17T02:55:24.754823+0000","last_became_active":"2024-09-17T02:55:23.766896+0000","last_became_peered":"2024-09-17T02:55:23.766896+0000","last_unstale":"2024-09-17T02:55:24.754823+0000","last_undegraded":"2024-09-17T02:55:24.754823+0000","last_fullsized":"2024-09-17T02:55:24.754823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:35.634249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559755+0000","last_change":"2024-09-17T02:55:22.750458+0000","last_active":"2024-09-17T02:55:25.559755+0000","last_peered":"2024-09-17T02:55:25.559755+0000","last_clean":"2024-09-17T02:55:25.559755+0000","last_became_active":"2024-09-17T02:55:22.750203+0000","last_became_peered":"2024-09-17T02:55:22.750203+0000","last_unstale":"2024-09-17T02:55:25.559755+0000","last_undegraded":"2024-09-17T02:55:25.559755+0000","last_fullsized":"2024-09-17T02:55:25.559755+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:14.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559229+0000","last_change":"2024-09-17T02:55:23.766337+0000","last_active":"2024-09-17T02:55:25.559229+0000","last_peered":"2024-09-17T02:55:25.559229+0000","last_clean":"2024-09-17T02:55:25.559229+0000","last_became_active":"2024-09-17T02:55:23.765725+0000","last_became_peered":"2024-09-17T02:55:23.765725+0000","last_unstale":"2024-09-17T02:55:25.559229+0000","last_undegraded":"2024-09-17T02:55:25.559229+0000","last_fullsized":"2024-09-17T02:55:25.559229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:40.204842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754712+0000","last_change":"2024-09-17T02:55:22.756302+0000","last_active":"2024-09-17T02:55:24.754712+0000","last_peered":"2024-09-17T02:55:24.754712+0000","last_clean":"2024-09-17T02:55:24.754712+0000","last_became_active":"2024-09-17T02:55:22.755624+0000","last_became_peered":"2024-09-17T02:55:22.755624+0000","last_unstale":"2024-09-17T02:55:24.754712+0000","last_undegraded":"2024-09-17T02:55:24.754712+0000","last_fullsized":"2024-09-17T02:55:24.754712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:39.696474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773717+0000","last_change":"2024-09-17T02:55:23.763282+0000","last_active":"2024-09-17T02:55:24.773717+0000","last_peered":"2024-09-17T02:55:24.773717+0000","last_clean":"2024-09-17T02:55:24.773717+0000","last_became_active":"2024-09-17T02:55:23.763055+0000","last_became_peered":"2024-09-17T02:55:23.763055+0000","last_unstale":"2024-09-17T02:55:24.773717+0000","last_undegraded":"2024-09-17T02:55:24.773717+0000","last_fullsized":"2024-09-17T02:55:24.773717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:03.864798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756872+0000","last_change":"2024-09-17T02:55:22.747579+0000","last_active":"2024-09-17T02:55:24.756872+0000","last_peered":"2024-09-17T02:55:24.756872+0000","last_clean":"2024-09-17T02:55:24.756872+0000","last_became_active":"2024-09-17T02:55:22.746875+0000","last_became_peered":"2024-09-17T02:55:22.746875+0000","last_unstale":"2024-09-17T02:55:24.756872+0000","last_undegraded":"2024-09-17T02:55:24.756872+0000","last_fullsized":"2024-09-17T02:55:24.756872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:45.101018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754426+0000","last_change":"2024-09-17T02:55:23.759402+0000","last_active":"2024-09-17T02:55:24.754426+0000","last_peered":"2024-09-17T02:55:24.754426+0000","last_clean":"2024-09-17T02:55:24.754426+0000","last_became_active":"2024-09-17T02:55:23.759135+0000","last_became_peered":"2024-09-17T02:55:23.759135+0000","last_unstale":"2024-09-17T02:55:24.754426+0000","last_undegraded":"2024-09-17T02:55:24.754426+0000","last_fullsized":"2024-09-17T02:55:24.754426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:35.143041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773868+0000","last_change":"2024-09-17T02:55:22.753234+0000","last_active":"2024-09-17T02:55:24.773868+0000","last_peered":"2024-09-17T02:55:24.773868+0000","last_clean":"2024-09-17T02:55:24.773868+0000","last_became_active":"2024-09-17T02:55:22.751979+0000","last_became_peered":"2024-09-17T02:55:22.751979+0000","last_unstale":"2024-09-17T02:55:24.773868+0000","last_undegraded":"2024-09-17T02:55:24.773868+0000","last_fullsized":"2024-09-17T02:55:24.773868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:19.514624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559406+0000","last_change":"2024-09-17T02:55:23.771479+0000","last_active":"2024-09-17T02:55:25.559406+0000","last_peered":"2024-09-17T02:55:25.559406+0000","last_clean":"2024-09-17T02:55:25.559406+0000","last_became_active":"2024-09-17T02:55:23.771167+0000","last_became_peered":"2024-09-17T02:55:23.771167+0000","last_unstale":"2024-09-17T02:55:25.559406+0000","last_undegraded":"2024-09-17T02:55:25.559406+0000","last_fullsized":"2024-09-17T02:55:25.559406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:44.673611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754687+0000","last_change":"2024-09-17T02:55:22.756237+0000","last_active":"2024-09-17T02:55:24.754687+0000","last_peered":"2024-09-17T02:55:24.754687+0000","last_clean":"2024-09-17T02:55:24.754687+0000","last_became_active":"2024-09-17T02:55:22.755726+0000","last_became_peered":"2024-09-17T02:55:22.755726+0000","last_unstale":"2024-09-17T02:55:24.754687+0000","last_undegraded":"2024-09-17T02:55:24.754687+0000","last_fullsized":"2024-09-17T02:55:24.754687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:45.057688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755320+0000","last_change":"2024-09-17T02:55:23.770587+0000","last_active":"2024-09-17T02:55:24.755320+0000","last_peered":"2024-09-17T02:55:24.755320+0000","last_clean":"2024-09-17T02:55:24.755320+0000","last_became_active":"2024-09-17T02:55:23.769667+0000","last_became_peered":"2024-09-17T02:55:23.769667+0000","last_unstale":"2024-09-17T02:55:24.755320+0000","last_undegraded":"2024-09-17T02:55:24.755320+0000","last_fullsized":"2024-09-17T02:55:24.755320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:25.113230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754111+0000","last_change":"2024-09-17T02:55:22.754865+0000","last_active":"2024-09-17T02:55:24.754111+0000","last_peered":"2024-09-17T02:55:24.754111+0000","last_clean":"2024-09-17T02:55:24.754111+0000","last_became_active":"2024-09-17T02:55:22.754358+0000","last_became_peered":"2024-09-17T02:55:22.754358+0000","last_unstale":"2024-09-17T02:55:24.754111+0000","last_undegraded":"2024-09-17T02:55:24.754111+0000","last_fullsized":"2024-09-17T02:55:24.754111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:53.006548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756642+0000","last_change":"2024-09-17T02:55:23.772190+0000","last_active":"2024-09-17T02:55:24.756642+0000","last_peered":"2024-09-17T02:55:24.756642+0000","last_clean":"2024-09-17T02:55:24.756642+0000","last_became_active":"2024-09-17T02:55:23.771514+0000","last_became_peered":"2024-09-17T02:55:23.771514+0000","last_unstale":"2024-09-17T02:55:24.756642+0000","last_undegraded":"2024-09-17T02:55:24.756642+0000","last_fullsized":"2024-09-17T02:55:24.756642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:53.860339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.774267+0000","last_change":"2024-09-17T02:55:22.758079+0000","last_active":"2024-09-17T02:55:24.774267+0000","last_peered":"2024-09-17T02:55:24.774267+0000","last_clean":"2024-09-17T02:55:24.774267+0000","last_became_active":"2024-09-17T02:55:22.757729+0000","last_became_peered":"2024-09-17T02:55:22.757729+0000","last_unstale":"2024-09-17T02:55:24.774267+0000","last_undegraded":"2024-09-17T02:55:24.774267+0000","last_fullsized":"2024-09-17T02:55:24.774267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:46.211281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558649+0000","last_change":"2024-09-17T02:55:23.767197+0000","last_active":"2024-09-17T02:55:25.558649+0000","last_peered":"2024-09-17T02:55:25.558649+0000","last_clean":"2024-09-17T02:55:25.558649+0000","last_became_active":"2024-09-17T02:55:23.766914+0000","last_became_peered":"2024-09-17T02:55:23.766914+0000","last_unstale":"2024-09-17T02:55:25.558649+0000","last_undegraded":"2024-09-17T02:55:25.558649+0000","last_fullsized":"2024-09-17T02:55:25.558649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:09.803305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.757001+0000","last_change":"2024-09-17T02:55:22.747869+0000","last_active":"2024-09-17T02:55:24.757001+0000","last_peered":"2024-09-17T02:55:24.757001+0000","last_clean":"2024-09-17T02:55:24.757001+0000","last_became_active":"2024-09-17T02:55:22.747212+0000","last_became_peered":"2024-09-17T02:55:22.747212+0000","last_unstale":"2024-09-17T02:55:24.757001+0000","last_undegraded":"2024-09-17T02:55:24.757001+0000","last_fullsized":"2024-09-17T02:55:24.757001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:29.794581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773636+0000","last_change":"2024-09-17T02:55:23.771679+0000","last_active":"2024-09-17T02:55:24.773636+0000","last_peered":"2024-09-17T02:55:24.773636+0000","last_clean":"2024-09-17T02:55:24.773636+0000","last_became_active":"2024-09-17T02:55:23.771362+0000","last_became_peered":"2024-09-17T02:55:23.771362+0000","last_unstale":"2024-09-17T02:55:24.773636+0000","last_undegraded":"2024-09-17T02:55:24.773636+0000","last_fullsized":"2024-09-17T02:55:24.773636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:13.072653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756226+0000","last_change":"2024-09-17T02:55:22.751139+0000","last_active":"2024-09-17T02:55:24.756226+0000","last_peered":"2024-09-17T02:55:24.756226+0000","last_clean":"2024-09-17T02:55:24.756226+0000","last_became_active":"2024-09-17T02:55:22.750883+0000","last_became_peered":"2024-09-17T02:55:22.750883+0000","last_unstale":"2024-09-17T02:55:24.756226+0000","last_undegraded":"2024-09-17T02:55:24.756226+0000","last_fullsized":"2024-09-17T02:55:24.756226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:21.432244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558185+0000","last_change":"2024-09-17T02:55:23.771109+0000","last_active":"2024-09-17T02:55:25.558185+0000","last_peered":"2024-09-17T02:55:25.558185+0000","last_clean":"2024-09-17T02:55:25.558185+0000","last_became_active":"2024-09-17T02:55:23.770844+0000","last_became_peered":"2024-09-17T02:55:23.770844+0000","last_unstale":"2024-09-17T02:55:25.558185+0000","last_undegraded":"2024-09-17T02:55:25.558185+0000","last_fullsized":"2024-09-17T02:55:25.558185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:10.686281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756454+0000","last_change":"2024-09-17T02:55:22.749101+0000","last_active":"2024-09-17T02:55:24.756454+0000","last_peered":"2024-09-17T02:55:24.756454+0000","last_clean":"2024-09-17T02:55:24.756454+0000","last_became_active":"2024-09-17T02:55:22.748824+0000","last_became_peered":"2024-09-17T02:55:22.748824+0000","last_unstale":"2024-09-17T02:55:24.756454+0000","last_undegraded":"2024-09-17T02:55:24.756454+0000","last_fullsized":"2024-09-17T02:55:24.756454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:30.488979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558372+0000","last_change":"2024-09-17T02:55:23.768637+0000","last_active":"2024-09-17T02:55:25.558372+0000","last_peered":"2024-09-17T02:55:25.558372+0000","last_clean":"2024-09-17T02:55:25.558372+0000","last_became_active":"2024-09-17T02:55:23.768305+0000","last_became_peered":"2024-09-17T02:55:23.768305+0000","last_unstale":"2024-09-17T02:55:25.558372+0000","last_undegraded":"2024-09-17T02:55:25.558372+0000","last_fullsized":"2024-09-17T02:55:25.558372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:46.107723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772408+0000","last_change":"2024-09-17T02:55:22.755605+0000","last_active":"2024-09-17T02:55:24.772408+0000","last_peered":"2024-09-17T02:55:24.772408+0000","last_clean":"2024-09-17T02:55:24.772408+0000","last_became_active":"2024-09-17T02:55:22.754980+0000","last_became_peered":"2024-09-17T02:55:22.754980+0000","last_unstale":"2024-09-17T02:55:24.772408+0000","last_undegraded":"2024-09-17T02:55:24.772408+0000","last_fullsized":"2024-09-17T02:55:24.772408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:42.403963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558502+0000","last_change":"2024-09-17T02:55:23.761050+0000","last_active":"2024-09-17T02:55:25.558502+0000","last_peered":"2024-09-17T02:55:25.558502+0000","last_clean":"2024-09-17T02:55:25.558502+0000","last_became_active":"2024-09-17T02:55:23.760440+0000","last_became_peered":"2024-09-17T02:55:23.760440+0000","last_unstale":"2024-09-17T02:55:25.558502+0000","last_undegraded":"2024-09-17T02:55:25.558502+0000","last_fullsized":"2024-09-17T02:55:25.558502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:58.965191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754906+0000","last_change":"2024-09-17T02:55:22.752090+0000","last_active":"2024-09-17T02:55:24.754906+0000","last_peered":"2024-09-17T02:55:24.754906+0000","last_clean":"2024-09-17T02:55:24.754906+0000","last_became_active":"2024-09-17T02:55:22.751796+0000","last_became_peered":"2024-09-17T02:55:22.751796+0000","last_unstale":"2024-09-17T02:55:24.754906+0000","last_undegraded":"2024-09-17T02:55:24.754906+0000","last_fullsized":"2024-09-17T02:55:24.754906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:11.117273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558331+0000","last_change":"2024-09-17T02:55:23.757567+0000","last_active":"2024-09-17T02:55:25.558331+0000","last_peered":"2024-09-17T02:55:25.558331+0000","last_clean":"2024-09-17T02:55:25.558331+0000","last_became_active":"2024-09-17T02:55:23.757306+0000","last_became_peered":"2024-09-17T02:55:23.757306+0000","last_unstale":"2024-09-17T02:55:25.558331+0000","last_undegraded":"2024-09-17T02:55:25.558331+0000","last_fullsized":"2024-09-17T02:55:25.558331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:07.388755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.757133+0000","last_change":"2024-09-17T02:55:22.752995+0000","last_active":"2024-09-17T02:55:24.757133+0000","last_peered":"2024-09-17T02:55:24.757133+0000","last_clean":"2024-09-17T02:55:24.757133+0000","last_became_active":"2024-09-17T02:55:22.752575+0000","last_became_peered":"2024-09-17T02:55:22.752575+0000","last_unstale":"2024-09-17T02:55:24.757133+0000","last_undegraded":"2024-09-17T02:55:24.757133+0000","last_fullsized":"2024-09-17T02:55:24.757133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:46.053363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559292+0000","last_change":"2024-09-17T02:55:23.768517+0000","last_active":"2024-09-17T02:55:25.559292+0000","last_peered":"2024-09-17T02:55:25.559292+0000","last_clean":"2024-09-17T02:55:25.559292+0000","last_became_active":"2024-09-17T02:55:23.768218+0000","last_became_peered":"2024-09-17T02:55:23.768218+0000","last_unstale":"2024-09-17T02:55:25.559292+0000","last_undegraded":"2024-09-17T02:55:25.559292+0000","last_fullsized":"2024-09-17T02:55:25.559292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:01.933326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558904+0000","last_change":"2024-09-17T02:55:22.751249+0000","last_active":"2024-09-17T02:55:25.558904+0000","last_peered":"2024-09-17T02:55:25.558904+0000","last_clean":"2024-09-17T02:55:25.558904+0000","last_became_active":"2024-09-17T02:55:22.750980+0000","last_became_peered":"2024-09-17T02:55:22.750980+0000","last_unstale":"2024-09-17T02:55:25.558904+0000","last_undegraded":"2024-09-17T02:55:25.558904+0000","last_fullsized":"2024-09-17T02:55:25.558904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:45.143320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558716+0000","last_change":"2024-09-17T02:55:23.763197+0000","last_active":"2024-09-17T02:55:25.558716+0000","last_peered":"2024-09-17T02:55:25.558716+0000","last_clean":"2024-09-17T02:55:25.558716+0000","last_became_active":"2024-09-17T02:55:23.762903+0000","last_became_peered":"2024-09-17T02:55:23.762903+0000","last_unstale":"2024-09-17T02:55:25.558716+0000","last_undegraded":"2024-09-17T02:55:25.558716+0000","last_fullsized":"2024-09-17T02:55:25.558716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:36.327921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773757+0000","last_change":"2024-09-17T02:55:22.754011+0000","last_active":"2024-09-17T02:55:24.773757+0000","last_peered":"2024-09-17T02:55:24.773757+0000","last_clean":"2024-09-17T02:55:24.773757+0000","last_became_active":"2024-09-17T02:55:22.753344+0000","last_became_peered":"2024-09-17T02:55:22.753344+0000","last_unstale":"2024-09-17T02:55:24.773757+0000","last_undegraded":"2024-09-17T02:55:24.773757+0000","last_fullsized":"2024-09-17T02:55:24.773757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:31.935237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559692+0000","last_change":"2024-09-17T02:55:23.767827+0000","last_active":"2024-09-17T02:55:25.559692+0000","last_peered":"2024-09-17T02:55:25.559692+0000","last_clean":"2024-09-17T02:55:25.559692+0000","last_became_active":"2024-09-17T02:55:23.767537+0000","last_became_peered":"2024-09-17T02:55:23.767537+0000","last_unstale":"2024-09-17T02:55:25.559692+0000","last_undegraded":"2024-09-17T02:55:25.559692+0000","last_fullsized":"2024-09-17T02:55:25.559692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:45.189128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773218+0000","last_change":"2024-09-17T02:55:22.755274+0000","last_active":"2024-09-17T02:55:24.773218+0000","last_peered":"2024-09-17T02:55:24.773218+0000","last_clean":"2024-09-17T02:55:24.773218+0000","last_became_active":"2024-09-17T02:55:22.754605+0000","last_became_peered":"2024-09-17T02:55:22.754605+0000","last_unstale":"2024-09-17T02:55:24.773218+0000","last_undegraded":"2024-09-17T02:55:24.773218+0000","last_fullsized":"2024-09-17T02:55:24.773218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:17.583183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772112+0000","last_change":"2024-09-17T02:55:23.772072+0000","last_active":"2024-09-17T02:55:24.772112+0000","last_peered":"2024-09-17T02:55:24.772112+0000","last_clean":"2024-09-17T02:55:24.772112+0000","last_became_active":"2024-09-17T02:55:23.771792+0000","last_became_peered":"2024-09-17T02:55:23.771792+0000","last_unstale":"2024-09-17T02:55:24.772112+0000","last_undegraded":"2024-09-17T02:55:24.772112+0000","last_fullsized":"2024-09-17T02:55:24.772112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:02.726215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.773966+0000","last_change":"2024-09-17T02:55:22.758159+0000","last_active":"2024-09-17T02:55:24.773966+0000","last_peered":"2024-09-17T02:55:24.773966+0000","last_clean":"2024-09-17T02:55:24.773966+0000","last_became_active":"2024-09-17T02:55:22.757877+0000","last_became_peered":"2024-09-17T02:55:22.757877+0000","last_unstale":"2024-09-17T02:55:24.773966+0000","last_undegraded":"2024-09-17T02:55:24.773966+0000","last_fullsized":"2024-09-17T02:55:24.773966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:13.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755596+0000","last_change":"2024-09-17T02:55:23.756674+0000","last_active":"2024-09-17T02:55:24.755596+0000","last_peered":"2024-09-17T02:55:24.755596+0000","last_clean":"2024-09-17T02:55:24.755596+0000","last_became_active":"2024-09-17T02:55:23.756350+0000","last_became_peered":"2024-09-17T02:55:23.756350+0000","last_unstale":"2024-09-17T02:55:24.755596+0000","last_undegraded":"2024-09-17T02:55:24.755596+0000","last_fullsized":"2024-09-17T02:55:24.755596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:24.003131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772479+0000","last_change":"2024-09-17T02:55:22.751846+0000","last_active":"2024-09-17T02:55:24.772479+0000","last_peered":"2024-09-17T02:55:24.772479+0000","last_clean":"2024-09-17T02:55:24.772479+0000","last_became_active":"2024-09-17T02:55:22.751551+0000","last_became_peered":"2024-09-17T02:55:22.751551+0000","last_unstale":"2024-09-17T02:55:24.772479+0000","last_undegraded":"2024-09-17T02:55:24.772479+0000","last_fullsized":"2024-09-17T02:55:24.772479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:30.114661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.772271+0000","last_change":"2024-09-17T02:55:23.758052+0000","last_active":"2024-09-17T02:55:24.772271+0000","last_peered":"2024-09-17T02:55:24.772271+0000","last_clean":"2024-09-17T02:55:24.772271+0000","last_became_active":"2024-09-17T02:55:23.757775+0000","last_became_peered":"2024-09-17T02:55:23.757775+0000","last_unstale":"2024-09-17T02:55:24.772271+0000","last_undegraded":"2024-09-17T02:55:24.772271+0000","last_fullsized":"2024-09-17T02:55:24.772271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:27.874282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.774050+0000","last_change":"2024-09-17T02:55:22.752619+0000","last_active":"2024-09-17T02:55:24.774050+0000","last_peered":"2024-09-17T02:55:24.774050+0000","last_clean":"2024-09-17T02:55:24.774050+0000","last_became_active":"2024-09-17T02:55:22.752322+0000","last_became_peered":"2024-09-17T02:55:22.752322+0000","last_unstale":"2024-09-17T02:55:24.774050+0000","last_undegraded":"2024-09-17T02:55:24.774050+0000","last_fullsized":"2024-09-17T02:55:24.774050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:44.632318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754460+0000","last_change":"2024-09-17T02:55:23.773078+0000","last_active":"2024-09-17T02:55:24.754460+0000","last_peered":"2024-09-17T02:55:24.754460+0000","last_clean":"2024-09-17T02:55:24.754460+0000","last_became_active":"2024-09-17T02:55:23.772301+0000","last_became_peered":"2024-09-17T02:55:23.772301+0000","last_unstale":"2024-09-17T02:55:24.754460+0000","last_undegraded":"2024-09-17T02:55:24.754460+0000","last_fullsized":"2024-09-17T02:55:24.754460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:03.618274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.756061+0000","last_change":"2024-09-17T02:55:22.753104+0000","last_active":"2024-09-17T02:55:24.756061+0000","last_peered":"2024-09-17T02:55:24.756061+0000","last_clean":"2024-09-17T02:55:24.756061+0000","last_became_active":"2024-09-17T02:55:22.752824+0000","last_became_peered":"2024-09-17T02:55:22.752824+0000","last_unstale":"2024-09-17T02:55:24.756061+0000","last_undegraded":"2024-09-17T02:55:24.756061+0000","last_fullsized":"2024-09-17T02:55:24.756061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:40.061844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755770+0000","last_change":"2024-09-17T02:55:23.770697+0000","last_active":"2024-09-17T02:55:24.755770+0000","last_peered":"2024-09-17T02:55:24.755770+0000","last_clean":"2024-09-17T02:55:24.755770+0000","last_became_active":"2024-09-17T02:55:23.770287+0000","last_became_peered":"2024-09-17T02:55:23.770287+0000","last_unstale":"2024-09-17T02:55:24.755770+0000","last_undegraded":"2024-09-17T02:55:24.755770+0000","last_fullsized":"2024-09-17T02:55:24.755770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:29.327645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.754879+0000","last_change":"2024-09-17T02:55:22.752551+0000","last_active":"2024-09-17T02:55:24.754879+0000","last_peered":"2024-09-17T02:55:24.754879+0000","last_clean":"2024-09-17T02:55:24.754879+0000","last_became_active":"2024-09-17T02:55:22.751727+0000","last_became_peered":"2024-09-17T02:55:22.751727+0000","last_unstale":"2024-09-17T02:55:24.754879+0000","last_undegraded":"2024-09-17T02:55:24.754879+0000","last_fullsized":"2024-09-17T02:55:24.754879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:17.772265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.559548+0000","last_change":"2024-09-17T02:55:23.773412+0000","last_active":"2024-09-17T02:55:25.559548+0000","last_peered":"2024-09-17T02:55:25.559548+0000","last_clean":"2024-09-17T02:55:25.559548+0000","last_became_active":"2024-09-17T02:55:23.773129+0000","last_became_peered":"2024-09-17T02:55:23.773129+0000","last_unstale":"2024-09-17T02:55:25.559548+0000","last_undegraded":"2024-09-17T02:55:25.559548+0000","last_fullsized":"2024-09-17T02:55:25.559548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:22.735612+0000","last_clean_scrub_stamp":"2024-09-17T02:55:22.735612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:41.718052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:24.755056+0000","last_change":"2024-09-17T02:55:22.745769+0000","last_active":"2024-09-17T02:55:24.755056+0000","last_peered":"2024-09-17T02:55:24.755056+0000","last_clean":"2024-09-17T02:55:24.755056+0000","last_became_active":"2024-09-17T02:55:22.745478+0000","last_became_peered":"2024-09-17T02:55:22.745478+0000","last_unstale":"2024-09-17T02:55:24.755056+0000","last_undegraded":"2024-09-17T02:55:24.755056+0000","last_fullsized":"2024-09-17T02:55:24.755056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:21.729380+0000","last_clean_scrub_stamp":"2024-09-17T02:55:21.729380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:45.632009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T02:55:25.558985+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:55:25.558985+0000","last_peered":"2024-09-17T02:55:25.558985+0000","last_clean":"2024-09-17T02:55:25.558985+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:55:25.558985+0000","last_undegraded":"2024-09-17T02:55:25.558985+0000","last_fullsized":"2024-09-17T02:55:25.558985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860747,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860691,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861259,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859729,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861293,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859729,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270995,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:55:31.604 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:55:31.605 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T02:55:31.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.726+0000 7fe29124a640 1 -- 172.21.15.104:0/1221813284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 msgr2=0x7fe28c160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.726+0000 7fe29124a640 1 --2- 172.21.15.104:0/1221813284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 0x7fe28c160e50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe28c070650 tx=0x7fe27c02a560 comp rx=0 tx=0).stop 2024-09-17T02:55:31.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.726+0000 7fe29124a640 1 -- 172.21.15.104:0/1221813284 shutdown_connections 2024-09-17T02:55:31.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.726+0000 7fe29124a640 1 --2- 172.21.15.104:0/1221813284 >> v2:172.21.15.192:3300/0 conn(0x7fe28c1618d0 0x7fe28c0b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.726+0000 7fe29124a640 1 --2- 172.21.15.104:0/1221813284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe28c0d1400 0x7fe28c161390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.726+0000 7fe29124a640 1 --2- 172.21.15.104:0/1221813284 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 0x7fe28c160e50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.727+0000 7fe29124a640 1 -- 172.21.15.104:0/1221813284 >> 172.21.15.104:0/1221813284 conn(0x7fe28c0b44a0 msgr2=0x7fe28c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:31.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.727+0000 7fe29124a640 1 -- 172.21.15.104:0/1221813284 shutdown_connections 2024-09-17T02:55:31.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.727+0000 7fe29124a640 1 -- 172.21.15.104:0/1221813284 wait complete. 2024-09-17T02:55:31.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.729+0000 7fe29124a640 1 Processor -- start 2024-09-17T02:55:31.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.729+0000 7fe29124a640 1 -- start start 2024-09-17T02:55:31.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe29124a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 0x7fe28c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe29124a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe28c0d1400 0x7fe28c1f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe29124a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe28c1618d0 0x7fe28c0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe29124a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c0b2840 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe29124a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c0b26c0 con 0x7fe28c1618d0 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe29124a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe28c0b29c0 con 0x7fe28c0d1400 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 0x7fe28c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 0x7fe28c153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59334/0 (socket says 172.21.15.104:59334) 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28ad9d640 1 -- 172.21.15.104:0/780366179 learned_addr learned my addr 172.21.15.104:0/780366179 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28a59c640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe28c0d1400 0x7fe28c1f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28b59e640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe28c1618d0 0x7fe28c0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28ad9d640 1 -- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe28c0d1400 msgr2=0x7fe28c1f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28ad9d640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe28c0d1400 0x7fe28c1f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28ad9d640 1 -- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe28c1618d0 msgr2=0x7fe28c0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28ad9d640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe28c1618d0 0x7fe28c0cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.730+0000 7fe28ad9d640 1 -- 172.21.15.104:0/780366179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c1f8060 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.731+0000 7fe28ad9d640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 0x7fe28c153eb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0099c0 tx=0x7fe27c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:31.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.731+0000 7fe2737fe640 1 -- 172.21.15.104:0/780366179 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c03e030 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.731+0000 7fe2737fe640 1 -- 172.21.15.104:0/780366179 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe27c0047a0 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.731+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c1f8340 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.731+0000 7fe2737fe640 1 -- 172.21.15.104:0/780366179 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c035040 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.731+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c15eea0 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.732+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c0b2ee0 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.733+0000 7fe2737fe640 1 -- 172.21.15.104:0/780366179 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe27c041030 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.733+0000 7fe2737fe640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe278078bc0 0x7fe27807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:31.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.733+0000 7fe2737fe640 1 -- 172.21.15.104:0/780366179 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe27c0bb4b0 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.733+0000 7fe28a59c640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe278078bc0 0x7fe27807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:31.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.734+0000 7fe28a59c640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe278078bc0 0x7fe27807b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0a0750 tx=0x7fe280005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:31.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.738+0000 7fe2737fe640 1 -- 172.21.15.104:0/780366179 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe27c083900 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.987+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe28c0d0920 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.989+0000 7fe2737fe640 1 -- 172.21.15.104:0/780366179 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7fe27c083200 con 0x7fe28c0d0ff0 2024-09-17T02:55:31.988 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T02:55:31.988 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T02:55:31.988 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T02:55:31.988 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T02:55:31.988 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T02:55:31.988 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T02:55:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe278078bc0 msgr2=0x7fe27807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe278078bc0 0x7fe27807b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0a0750 tx=0x7fe280005c90 comp rx=0 tx=0).stop 2024-09-17T02:55:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 msgr2=0x7fe28c153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 0x7fe28c153eb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0099c0 tx=0x7fe27c0039e0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 shutdown_connections 2024-09-17T02:55:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe278078bc0 0x7fe27807b0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe28c1618d0 0x7fe28c0cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe28c0d1400 0x7fe28c1f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 --2- 172.21.15.104:0/780366179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe28c0d0ff0 0x7fe28c153eb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.991+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 >> 172.21.15.104:0/780366179 conn(0x7fe28c0b44a0 msgr2=0x7fe28c1e9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.992+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 shutdown_connections 2024-09-17T02:55:31.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:31.992+0000 7fe29124a640 1 -- 172.21.15.104:0/780366179 wait complete. 2024-09-17T02:55:32.001 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:32.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.115+0000 7fbf4555e640 1 -- 172.21.15.104:0/2044478299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400d18e0 msgr2=0x7fbf4015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.115+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2044478299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400d18e0 0x7fbf4015ef90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009830 tx=0x7fbf3402a510 comp rx=0 tx=0).stop 2024-09-17T02:55:32.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.115+0000 7fbf4555e640 1 -- 172.21.15.104:0/2044478299 shutdown_connections 2024-09-17T02:55:32.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.115+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2044478299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf400b3b00 0x7fbf400d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.115+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2044478299 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400d18e0 0x7fbf4015ef90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.115+0000 7fbf4555e640 1 -- 172.21.15.104:0/2044478299 >> 172.21.15.104:0/2044478299 conn(0x7fbf40073df0 msgr2=0x7fbf40068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:32.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.115+0000 7fbf4555e640 1 -- 172.21.15.104:0/2044478299 shutdown_connections 2024-09-17T02:55:32.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.115+0000 7fbf4555e640 1 -- 172.21.15.104:0/2044478299 wait complete. 2024-09-17T02:55:32.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.117+0000 7fbf4555e640 1 Processor -- start 2024-09-17T02:55:32.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.117+0000 7fbf4555e640 1 -- start start 2024-09-17T02:55:32.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf4555e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf400b3b00 0x7fbf401f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf4555e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400b6f70 0x7fbf400c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf4555e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400d18e0 0x7fbf4015f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf4555e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf400d3e40 con 0x7fbf400b6f70 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf4555e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbf400d3cc0 con 0x7fbf400d18e0 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf4555e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbf400d3fc0 con 0x7fbf400b3b00 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400b6f70 0x7fbf400c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400b6f70 0x7fbf400c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59358/0 (socket says 172.21.15.104:59358) 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3e7fc640 1 -- 172.21.15.104:0/2750057386 learned_addr learned my addr 172.21.15.104:0/2750057386 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3f7fe640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400d18e0 0x7fbf4015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3effd640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf400b3b00 0x7fbf401f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3e7fc640 1 -- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf400b3b00 msgr2=0x7fbf401f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3e7fc640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf400b3b00 0x7fbf401f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3e7fc640 1 -- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400d18e0 msgr2=0x7fbf4015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3e7fc640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400d18e0 0x7fbf4015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.118+0000 7fbf3e7fc640 1 -- 172.21.15.104:0/2750057386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf401f6180 con 0x7fbf400b6f70 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.119+0000 7fbf3e7fc640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400b6f70 0x7fbf400c9ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009950 tx=0x7fbf34033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.119+0000 7fbf277fe640 1 -- 172.21.15.104:0/2750057386 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34031d60 con 0x7fbf400b6f70 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.119+0000 7fbf277fe640 1 -- 172.21.15.104:0/2750057386 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf34033e10 con 0x7fbf400b6f70 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.119+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf401f6690 con 0x7fbf400b6f70 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.119+0000 7fbf277fe640 1 -- 172.21.15.104:0/2750057386 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34005260 con 0x7fbf400b6f70 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.119+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf400c96d0 con 0x7fbf400b6f70 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.120+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf400d44b0 con 0x7fbf400b6f70 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.120+0000 7fbf277fe640 1 -- 172.21.15.104:0/2750057386 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf34005400 con 0x7fbf400b6f70 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.121+0000 7fbf277fe640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf2c078bc0 0x7fbf2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.121+0000 7fbf277fe640 1 -- 172.21.15.104:0/2750057386 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fbf340bbfe0 con 0x7fbf400b6f70 2024-09-17T02:55:32.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.121+0000 7fbf3effd640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf2c078bc0 0x7fbf2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.122+0000 7fbf3effd640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf2c078bc0 0x7fbf2c07b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000f60 tx=0x7fbf30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:32.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.125+0000 7fbf277fe640 1 -- 172.21.15.104:0/2750057386 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf3403f030 con 0x7fbf400b6f70 2024-09-17T02:55:32.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.332+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf401f6420 con 0x7fbf400b6f70 2024-09-17T02:55:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.333+0000 7fbf277fe640 1 -- 172.21.15.104:0/2750057386 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5232 (secure 0 0 0) 0x7fbf34083dd0 con 0x7fbf400b6f70 2024-09-17T02:55:32.332 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:32.332 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:23.106277+0000","modified":"2024-09-17T02:55:25.113008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/477751550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":477751550},{"type":"v1","addr":"172.21.15.104:6835","nonce":477751550}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-09-17T02:55:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-09-17T02:55:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf2c078bc0 msgr2=0x7fbf2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf2c078bc0 0x7fbf2c07b0d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000f60 tx=0x7fbf30009040 comp rx=0 tx=0).stop 2024-09-17T02:55:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400b6f70 msgr2=0x7fbf400c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400b6f70 0x7fbf400c9ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009950 tx=0x7fbf34033c20 comp rx=0 tx=0).stop 2024-09-17T02:55:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 shutdown_connections 2024-09-17T02:55:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf2c078bc0 0x7fbf2c07b0d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400d18e0 0x7fbf4015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf400b6f70 0x7fbf400c9ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 --2- 172.21.15.104:0/2750057386 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf400b3b00 0x7fbf401f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 >> 172.21.15.104:0/2750057386 conn(0x7fbf40073df0 msgr2=0x7fbf40068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:32.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 shutdown_connections 2024-09-17T02:55:32.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.335+0000 7fbf4555e640 1 -- 172.21.15.104:0/2750057386 wait complete. 2024-09-17T02:55:32.748 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T02:55:23.106277+0000', 'modified': '2024-09-17T02:55:25.113008+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4917}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4917': {'gid': 4917, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/477751550', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6833', 'nonce': 477751550}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 477751550}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4917, 'qdb_cluster': [4917]} 2024-09-17T02:55:32.748 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T02:55:32.749 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T02:55:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.866+0000 7fee22264640 1 -- 172.21.15.104:0/3238764787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0cdf10 msgr2=0x7fee1c0cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.866+0000 7fee22264640 1 --2- 172.21.15.104:0/3238764787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0cdf10 0x7fee1c0cfa80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fee14005fd0 tx=0x7fee1402aa90 comp rx=0 tx=0).stop 2024-09-17T02:55:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.866+0000 7fee22264640 1 -- 172.21.15.104:0/3238764787 shutdown_connections 2024-09-17T02:55:32.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.866+0000 7fee22264640 1 --2- 172.21.15.104:0/3238764787 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0cdf10 0x7fee1c0cfa80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.866+0000 7fee22264640 1 --2- 172.21.15.104:0/3238764787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee1c0b4fc0 0x7fee1c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.866+0000 7fee22264640 1 -- 172.21.15.104:0/3238764787 >> 172.21.15.104:0/3238764787 conn(0x7fee1c0b44a0 msgr2=0x7fee1c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.866+0000 7fee22264640 1 -- 172.21.15.104:0/3238764787 shutdown_connections 2024-09-17T02:55:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.866+0000 7fee22264640 1 -- 172.21.15.104:0/3238764787 wait complete. 2024-09-17T02:55:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.868+0000 7fee22264640 1 Processor -- start 2024-09-17T02:55:32.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.868+0000 7fee22264640 1 -- start start 2024-09-17T02:55:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.869+0000 7fee22264640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0b3f00 0x7fee1c1605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.869+0000 7fee22264640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee1c0b4fc0 0x7fee1c15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.869+0000 7fee22264640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c0cdf10 0x7fee1c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.869+0000 7fee22264640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c160f50 con 0x7fee1c0b3f00 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.869+0000 7fee22264640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c0d0210 con 0x7fee1c0cdf10 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.869+0000 7fee22264640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c1610d0 con 0x7fee1c0b4fc0 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0b3f00 0x7fee1c1605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0b3f00 0x7fee1c1605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59390/0 (socket says 172.21.15.104:59390) 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 -- 172.21.15.104:0/2278444365 learned_addr learned my addr 172.21.15.104:0/2278444365 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee20801640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c0cdf10 0x7fee1c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee1c0b4fc0 0x7fee1c15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 -- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee1c0b4fc0 msgr2=0x7fee1c15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee1c0b4fc0 0x7fee1c15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 -- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c0cdf10 msgr2=0x7fee1c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c0cdf10 0x7fee1c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 -- 172.21.15.104:0/2278444365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c15fd50 con 0x7fee1c0b3f00 2024-09-17T02:55:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee1bfff640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0b3f00 0x7fee1c1605b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00e7c0 tx=0x7fee0c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee18ff9640 1 -- 172.21.15.104:0/2278444365 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00ccc0 con 0x7fee1c0b3f00 2024-09-17T02:55:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee18ff9640 1 -- 172.21.15.104:0/2278444365 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee0c010430 con 0x7fee1c0b3f00 2024-09-17T02:55:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee22264640 1 -- 172.21.15.104:0/2278444365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1c1f60c0 con 0x7fee1c0b3f00 2024-09-17T02:55:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee18ff9640 1 -- 172.21.15.104:0/2278444365 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c010860 con 0x7fee1c0b3f00 2024-09-17T02:55:32.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.870+0000 7fee22264640 1 -- 172.21.15.104:0/2278444365 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee1c1f6680 con 0x7fee1c0b3f00 2024-09-17T02:55:32.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.872+0000 7fee18ff9640 1 -- 172.21.15.104:0/2278444365 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee0c010a00 con 0x7fee1c0b3f00 2024-09-17T02:55:32.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.873+0000 7fee18ff9640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fee08078b90 0x7fee0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.873+0000 7fee18ff9640 1 -- 172.21.15.104:0/2278444365 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fee0c09b610 con 0x7fee1c0b3f00 2024-09-17T02:55:32.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.873+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fee08078b90 0x7fee0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.873+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fee08078b90 0x7fee0807b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0b8170 tx=0x7fee10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:32.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.873+0000 7fee291cf740 1 Processor -- start 2024-09-17T02:55:32.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.874+0000 7fee291cf740 1 -- start start 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee291cf740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd76f270 0x5595ddb40fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee291cf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb41500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee291cf740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddb5e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee291cf740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5595dda89820 con 0x5595dd74e590 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee291cf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5595dda78c50 con 0x5595dd7463b0 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee291cf740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5595dda7ca60 con 0x5595dd76f270 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddb5e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddb5e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59392/0 (socket says 172.21.15.104:59392) 2024-09-17T02:55:32.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 -- 172.21.15.104:0/33123816 learned_addr learned my addr 172.21.15.104:0/33123816 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee1bfff640 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd76f270 0x5595ddb40fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb41500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 -- 172.21.15.104:0/33123816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd76f270 msgr2=0x5595ddb40fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd76f270 0x5595ddb40fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 -- 172.21.15.104:0/33123816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 msgr2=0x5595ddb41500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb41500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 -- 172.21.15.104:0/33123816 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595dd7da850 con 0x5595dd74e590 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.875+0000 7fee20801640 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddb5e400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fee1402b080 tx=0x7fee14004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d4b8353fc1ab85 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee01ffb640 1 -- 172.21.15.104:0/33123816 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1402ece0 con 0x5595dd74e590 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee01ffb640 1 -- 172.21.15.104:0/33123816 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee14045070 con 0x5595dd74e590 2024-09-17T02:55:32.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee01ffb640 1 -- 172.21.15.104:0/33123816 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14003bd0 con 0x5595dd74e590 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 -- 172.21.15.104:0/33123816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 msgr2=0x5595ddb5e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddb5e400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fee1402b080 tx=0x7fee14004ab0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 -- 172.21.15.104:0/33123816 shutdown_connections 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb41500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddb5e400 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 --2- 172.21.15.104:0/33123816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd76f270 0x5595ddb40fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 -- 172.21.15.104:0/33123816 >> 172.21.15.104:0/33123816 conn(0x5595dd7633c0 msgr2=0x5595ddb17280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 -- 172.21.15.104:0/33123816 shutdown_connections 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.876+0000 7fee291cf740 1 -- 172.21.15.104:0/33123816 wait complete. 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.877+0000 7fee291cf740 1 -- start start 2024-09-17T02:55:32.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.878+0000 7fee291cf740 1 Processor -- start 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee291cf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb55c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee291cf740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd74e590 0x5595ddb2f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee291cf740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb5e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee291cf740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5595dd7e9620 con 0x5595dd76f270 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee291cf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5595dda1e5f0 con 0x5595dd7463b0 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee291cf740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5595ddb41a40 con 0x5595dd74e590 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee291cf740 10 client.0 _ll_register_callbacks cb 0x5595dda220a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb5e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb5e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59408/0 (socket says 172.21.15.104:59408) 2024-09-17T02:55:32.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 -- 172.21.15.104:0/1321124720 learned_addr learned my addr 172.21.15.104:0/1321124720 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd74e590 0x5595ddb2f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee1bfff640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb55c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 -- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd74e590 msgr2=0x5595ddb2f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd74e590 0x5595ddb2f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 -- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 msgr2=0x5595ddb55c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb55c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 -- 172.21.15.104:0/1321124720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595dd8516b0 con 0x5595dd76f270 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee1bfff640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb55c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd74e590 0x5595ddb2f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee20801640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb5e370 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fee14042040 tx=0x7fee14003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6e3aa7d5e250f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:32.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fedfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fedfaffd640 1 -- 172.21.15.104:0/1321124720 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14004450 con 0x5595dd76f270 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fedfaffd640 1 -- 172.21.15.104:0/1321124720 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fee140045f0 con 0x5595dd76f270 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.879+0000 7fee291cf740 1 -- 172.21.15.104:0/1321124720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee14045070 con 0x5595dd76f270 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fedfaffd640 1 -- 172.21.15.104:0/1321124720 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fee1405c050 con 0x5595dd76f270 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee291cf740 10 client.5091 fetch_fsmap learned FSMap version 14 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee291cf740 1 -- 172.21.15.104:0/1321124720 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5595ddb2fbf0 con 0x5595dd76f270 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fedfaffd640 1 -- 172.21.15.104:0/1321124720 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee14045070 con 0x5595dd76f270 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fedfaffd640 1 -- 172.21.15.104:0/1321124720 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fee1405f020 con 0x5595dd76f270 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee291cf740 10 client.5091 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T02:55:32.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee291cf740 10 client.5091 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee291cf740 20 client.5091 populate_metadata read hostname 'smithi104' 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee291cf740 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] conn(0x5595dd72de40 0x5595ddb56390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee291cf740 4 client.5091 mds_command: new command op to 4917 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee291cf740 1 -- 172.21.15.104:0/1321124720 --> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595dda8b770 con 0x5595dd72de40 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee1bfff640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] conn(0x5595dd72de40 0x5595ddb56390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fedfaffd640 10 client.5091 ms_handle_connect on v2:172.21.15.104:6833/477751550 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.880+0000 7fee1bfff640 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] conn(0x5595dd72de40 0x5595ddb56390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f9eaed31757957 server_cookie=dc07d7fb9dcdd508 in_seq=0 out_seq=0 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.881+0000 7fedfaffd640 1 -- 172.21.15.104:0/1321124720 <== mds.0 v2:172.21.15.104:6833/477751550 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595dda8b770 con 0x5595dd72de40 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.881+0000 7fedfaffd640 10 client.5091 handle_command_reply: tid=0 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.881+0000 7fee291cf740 1 client.5091 shutdown 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 -- 172.21.15.104:0/1321124720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 msgr2=0x5595ddb5e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb5e370 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fee14042040 tx=0x7fee14003c20 comp rx=0 tx=0).stop 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 -- 172.21.15.104:0/1321124720 shutdown_connections 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] conn(0x5595dd72de40 0x5595ddb56390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb5e370 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd74e590 0x5595ddb2f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fedfaffd640 0 client.5091 ms_handle_reset on v2:172.21.15.104:6833/477751550 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 --2- 172.21.15.104:0/1321124720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd7463b0 0x5595ddb55c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 -- 172.21.15.104:0/1321124720 >> 172.21.15.104:0/1321124720 conn(0x5595dd7633c0 msgr2=0x5595ddb11910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 -- 172.21.15.104:0/1321124720 shutdown_connections 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 1 -- 172.21.15.104:0/1321124720 wait complete. 2024-09-17T02:55:32.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.882+0000 7fee291cf740 20 client.5091 trim_cache size 0 max 16384 2024-09-17T02:55:32.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.900+0000 7fee291cf740 1 Processor -- start 2024-09-17T02:55:32.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.900+0000 7fee291cf740 1 -- start start 2024-09-17T02:55:32.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee291cf740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 0x5595ddb3e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee291cf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd74e590 0x5595ddb10550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee291cf740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb10a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee291cf740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c06cde0 con 0x5595dd76f270 2024-09-17T02:55:32.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee291cf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c1f98a0 con 0x5595dd74e590 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee291cf740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fee1c1f9ef0 con 0x5595dd7463b0 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee20801640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb10a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee20801640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb10a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59416/0 (socket says 172.21.15.104:59416) 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee20801640 1 -- 172.21.15.104:0/304089590 learned_addr learned my addr 172.21.15.104:0/304089590 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd74e590 0x5595ddb10550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee1bfff640 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 0x5595ddb3e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee20801640 1 -- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 msgr2=0x5595ddb3e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee20801640 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 0x5595ddb3e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee20801640 1 -- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd74e590 msgr2=0x5595ddb10550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee20801640 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd74e590 0x5595ddb10550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee20801640 1 -- 172.21.15.104:0/304089590 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595ddb52550 con 0x5595dd76f270 2024-09-17T02:55:32.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.901+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd74e590 0x5595ddb10550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee20801640 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb10a90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fee14009a60 tx=0x7fee14003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58139b13fe0770b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee017fa640 1 -- 172.21.15.104:0/304089590 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14004250 con 0x5595dd76f270 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee017fa640 1 -- 172.21.15.104:0/304089590 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee14045040 con 0x5595dd76f270 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee017fa640 1 -- 172.21.15.104:0/304089590 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee140047a0 con 0x5595dd76f270 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee291cf740 1 -- 172.21.15.104:0/304089590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 msgr2=0x5595ddb10a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee291cf740 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb10a90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fee14009a60 tx=0x7fee14003ec0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee291cf740 1 -- 172.21.15.104:0/304089590 shutdown_connections 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee291cf740 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd74e590 0x5595ddb10550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee291cf740 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd76f270 0x5595ddb10a90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee291cf740 1 --2- 172.21.15.104:0/304089590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 0x5595ddb3e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.902+0000 7fee291cf740 1 -- 172.21.15.104:0/304089590 >> 172.21.15.104:0/304089590 conn(0x5595dd7633c0 msgr2=0x5595ddb54380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.903+0000 7fee291cf740 1 -- 172.21.15.104:0/304089590 shutdown_connections 2024-09-17T02:55:32.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.903+0000 7fee291cf740 1 -- 172.21.15.104:0/304089590 wait complete. 2024-09-17T02:55:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.903+0000 7fee291cf740 1 -- start start 2024-09-17T02:55:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.904+0000 7fee291cf740 1 Processor -- start 2024-09-17T02:55:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee291cf740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 0x5595ddb553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee291cf740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddbda000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee291cf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd76f270 0x5595ddbda540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee291cf740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5595ddb53c00 con 0x5595dd74e590 2024-09-17T02:55:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee291cf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5595ddb6edf0 con 0x5595dd76f270 2024-09-17T02:55:32.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee291cf740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x5595ddb584e0 con 0x5595dd7463b0 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee291cf740 10 client.0 _ll_register_callbacks cb 0x7fee10001320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddbda000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddbda000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59424/0 (socket says 172.21.15.104:59424) 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 -- 172.21.15.104:0/3924864940 learned_addr learned my addr 172.21.15.104:0/3924864940 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1bfff640 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 0x5595ddb553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee20801640 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd76f270 0x5595ddbda540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 -- 172.21.15.104:0/3924864940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 msgr2=0x5595ddb553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 0x5595ddb553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 -- 172.21.15.104:0/3924864940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd76f270 msgr2=0x5595ddbda540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd76f270 0x5595ddbda540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 -- 172.21.15.104:0/3924864940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595ddbdefb0 con 0x5595dd74e590 2024-09-17T02:55:32.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fee1b7fe640 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddbda000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee10000f60 tx=0x7fee10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59a9070369a6b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.905+0000 7fedfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fedfaffd640 1 -- 172.21.15.104:0/3924864940 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1000ed90 con 0x5595dd74e590 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fedfaffd640 1 -- 172.21.15.104:0/3924864940 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fee10010040 con 0x5595dd74e590 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 1 -- 172.21.15.104:0/3924864940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee14045040 con 0x5595dd74e590 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fedfaffd640 1 -- 172.21.15.104:0/3924864940 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fee10030050 con 0x5595dd74e590 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 10 client.5097 fetch_fsmap learned FSMap version 14 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 1 -- 172.21.15.104:0/3924864940 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5595ddb3ddb0 con 0x5595dd74e590 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fedfaffd640 1 -- 172.21.15.104:0/3924864940 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee14045040 con 0x5595dd74e590 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fedfaffd640 1 -- 172.21.15.104:0/3924864940 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fee10033020 con 0x5595dd74e590 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 10 client.5097 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 10 client.5097 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 20 client.5097 populate_metadata read hostname 'smithi104' 2024-09-17T02:55:32.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] conn(0x5595ddb67f10 0x5595ddb7d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 4 client.5097 mds_command: new command op to 4917 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee291cf740 1 -- 172.21.15.104:0/3924864940 --> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] -- command(tid 0: {"prefix": "status"}) -- 0x5595dda87220 con 0x5595ddb67f10 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.906+0000 7fee1bfff640 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] conn(0x5595ddb67f10 0x5595ddb7d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fedfaffd640 10 client.5097 ms_handle_connect on v2:172.21.15.104:6833/477751550 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee1bfff640 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] conn(0x5595ddb67f10 0x5595ddb7d600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b27d17919b3b08d5 server_cookie=f6bf6329c314f761 in_seq=0 out_seq=0 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fedfaffd640 1 -- 172.21.15.104:0/3924864940 <== mds.0 v2:172.21.15.104:6833/477751550 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5595dda87220 con 0x5595ddb67f10 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fedfaffd640 10 client.5097 handle_command_reply: tid=0 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 client.5097 shutdown 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 -- 172.21.15.104:0/3924864940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 msgr2=0x5595ddbda000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddbda000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fee10000f60 tx=0x7fee10000ed0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 -- 172.21.15.104:0/3924864940 shutdown_connections 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.104:6833/477751550,v1:172.21.15.104:6835/477751550] conn(0x5595ddb67f10 0x5595ddb7d600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5595dd76f270 0x5595ddbda540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x5595dd74e590 0x5595ddbda000 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 --2- 172.21.15.104:0/3924864940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5595dd7463b0 0x5595ddb553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fedfaffd640 0 client.5097 ms_handle_reset on v2:172.21.15.104:6833/477751550 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 -- 172.21.15.104:0/3924864940 >> 172.21.15.104:0/3924864940 conn(0x5595dd7633c0 msgr2=0x5595ddb18230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 -- 172.21.15.104:0/3924864940 shutdown_connections 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 1 -- 172.21.15.104:0/3924864940 wait complete. 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.907+0000 7fee291cf740 20 client.5097 trim_cache size 0 max 16384 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:55:32.912 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4917, 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.1463878520000002, 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 14, 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 32, 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 32, 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 16.028619680999999 2024-09-17T02:55:32.913 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:55:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 -- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fee08078b90 msgr2=0x7fee0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fee08078b90 0x7fee0807b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0b8170 tx=0x7fee10009040 comp rx=0 tx=0).stop 2024-09-17T02:55:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 -- 172.21.15.104:0/2278444365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0b3f00 msgr2=0x7fee1c1605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0b3f00 0x7fee1c1605b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00e7c0 tx=0x7fee0c00ec80 comp rx=0 tx=0).stop 2024-09-17T02:55:32.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 -- 172.21.15.104:0/2278444365 shutdown_connections 2024-09-17T02:55:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fee08078b90 0x7fee0807b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c0cdf10 0x7fee1c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee1c0b4fc0 0x7fee1c15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 --2- 172.21.15.104:0/2278444365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fee1c0b3f00 0x7fee1c1605b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 -- 172.21.15.104:0/2278444365 >> 172.21.15.104:0/2278444365 conn(0x7fee1c0b44a0 msgr2=0x7fee1c15c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 -- 172.21.15.104:0/2278444365 shutdown_connections 2024-09-17T02:55:32.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:32.908+0000 7fee22264640 1 -- 172.21.15.104:0/2278444365 wait complete. 2024-09-17T02:55:32.918 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:55:33.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.031+0000 7fde6e2d3640 1 -- 172.21.15.104:0/2030624122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde680734f0 msgr2=0x7fde68073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:33.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.031+0000 7fde6e2d3640 1 --2- 172.21.15.104:0/2030624122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde680734f0 0x7fde68073900 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fde50009830 tx=0x7fde5002a5c0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.031+0000 7fde6e2d3640 1 -- 172.21.15.104:0/2030624122 shutdown_connections 2024-09-17T02:55:33.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.031+0000 7fde6e2d3640 1 --2- 172.21.15.104:0/2030624122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde680734f0 0x7fde68073900 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.031+0000 7fde6e2d3640 1 -- 172.21.15.104:0/2030624122 >> 172.21.15.104:0/2030624122 conn(0x7fde6806d200 msgr2=0x7fde6806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:33.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.031+0000 7fde6e2d3640 1 -- 172.21.15.104:0/2030624122 shutdown_connections 2024-09-17T02:55:33.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.031+0000 7fde6e2d3640 1 -- 172.21.15.104:0/2030624122 wait complete. 2024-09-17T02:55:33.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.033+0000 7fde6e2d3640 1 Processor -- start 2024-09-17T02:55:33.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.033+0000 7fde6e2d3640 1 -- start start 2024-09-17T02:55:33.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6e2d3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde680734f0 0x7fde6814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:33.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6e2d3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde680b0500 0x7fde6815f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:33.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6e2d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde6815c220 0x7fde6815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:33.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6e2d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fde680b60b0 con 0x7fde6815c220 2024-09-17T02:55:33.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6e2d3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fde680b5f30 con 0x7fde680b0500 2024-09-17T02:55:33.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6e2d3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fde680b6230 con 0x7fde680734f0 2024-09-17T02:55:33.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6c870640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde6815c220 0x7fde6815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6c870640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde6815c220 0x7fde6815fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:59448/0 (socket says 172.21.15.104:59448) 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.034+0000 7fde6c870640 1 -- 172.21.15.104:0/3064855436 learned_addr learned my addr 172.21.15.104:0/3064855436 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde5ffff640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde680b0500 0x7fde6815f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde67fff640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde680734f0 0x7fde6814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde6c870640 1 -- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde680734f0 msgr2=0x7fde6814ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde6c870640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde680734f0 0x7fde6814ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde6c870640 1 -- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde680b0500 msgr2=0x7fde6815f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde6c870640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde680b0500 0x7fde6815f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde6c870640 1 -- 172.21.15.104:0/3064855436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6815d230 con 0x7fde6815c220 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde5ffff640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde680b0500 0x7fde6815f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde6c870640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde6815c220 0x7fde6815fb10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fde6000c700 tx=0x7fde6000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde657fa640 1 -- 172.21.15.104:0/3064855436 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60003b70 con 0x7fde6815c220 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde657fa640 1 -- 172.21.15.104:0/3064855436 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde60003d10 con 0x7fde6815c220 2024-09-17T02:55:33.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde680b2e60 con 0x7fde6815c220 2024-09-17T02:55:33.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde657fa640 1 -- 172.21.15.104:0/3064855436 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6000aab0 con 0x7fde6815c220 2024-09-17T02:55:33.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.035+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde680b3420 con 0x7fde6815c220 2024-09-17T02:55:33.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.036+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde6815d400 con 0x7fde6815c220 2024-09-17T02:55:33.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.037+0000 7fde657fa640 1 -- 172.21.15.104:0/3064855436 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde6000ac50 con 0x7fde6815c220 2024-09-17T02:55:33.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.037+0000 7fde657fa640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde48078b90 0x7fde4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:33.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.038+0000 7fde657fa640 1 -- 172.21.15.104:0/3064855436 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fde6009aad0 con 0x7fde6815c220 2024-09-17T02:55:33.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.038+0000 7fde67fff640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde48078b90 0x7fde4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:33.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.038+0000 7fde67fff640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde48078b90 0x7fde4807b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde580046b0 tx=0x7fde58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:33.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.042+0000 7fde657fa640 1 -- 172.21.15.104:0/3064855436 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde60062fa0 con 0x7fde6815c220 2024-09-17T02:55:33.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.249+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fde680b2bd0 con 0x7fde6815c220 2024-09-17T02:55:33.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.250+0000 7fde657fa640 1 -- 172.21.15.104:0/3064855436 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7fde600628a0 con 0x7fde6815c220 2024-09-17T02:55:33.249 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:55:33.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde48078b90 msgr2=0x7fde4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde48078b90 0x7fde4807b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde580046b0 tx=0x7fde58009040 comp rx=0 tx=0).stop 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde6815c220 msgr2=0x7fde6815fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde6815c220 0x7fde6815fb10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fde6000c700 tx=0x7fde6000cbc0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 shutdown_connections 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde48078b90 0x7fde4807b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde680b0500 0x7fde6815f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde6815c220 0x7fde6815fb10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 --2- 172.21.15.104:0/3064855436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde680734f0 0x7fde6814ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 >> 172.21.15.104:0/3064855436 conn(0x7fde6806d200 msgr2=0x7fde680b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 shutdown_connections 2024-09-17T02:55:33.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33.252+0000 7fde6e2d3640 1 -- 172.21.15.104:0/3064855436 wait complete. 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:55:33.262 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:55:33.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:33.263 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T02:55:33.279 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:33.279 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:33.279 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:33.279 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:33.280 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42766sec preferred_lft 42766sec 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T02:55:33.281 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:33.282 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:55:33.282 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T02:55:33.282 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T02:55:33.282 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:33.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:33.282 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:55:33.343 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T02:55:33.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:33.345 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T02:55:33.400 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T02:55:33.400 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:55:33.401 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:55:33.401 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:55:33.401 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:55:33.401 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:33.401 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:55:33.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:55:33.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:55:33.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:55:33.401 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:55:33.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:33.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:33.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:33.526 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:55:33.542 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T02:55:33.542 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T02:55:33.543 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:55:33.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:33.543 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T02:55:33.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:33.608 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T02:55:33.662 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:55:33.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:33.663 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:55:33.718 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:55:33.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:33.718 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:55:33.817 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:55:33.817 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:55:33.817 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:33.828 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:55:33.828 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:55:33.828 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:33.828 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:33.828 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:33.833 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:55:33.833 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:55:33.833 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:55:33.833 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:33.833 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:33.833 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:55:33.833 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:55:33.834 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:55:33.834 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T02:55:33.834 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:55:33.834 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:55:33.834 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:55:33.834 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:55:33.836 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:55:33.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:33.836 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:55:33.862 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:33.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:33.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:33.966 INFO:teuthology.orchestra.run.smithi104.stdout:client4948 2024-09-17T02:55:33.967 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:33.967 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:33.986 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 -- 172.21.15.104:0/3624132222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 msgr2=0x7f80900ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 --2- 172.21.15.104:0/3624132222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 0x7f80900ae8b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8090162a20 tx=0x7f808c02a560 comp rx=0 tx=0).stop 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 -- 172.21.15.104:0/3624132222 shutdown_connections 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 --2- 172.21.15.104:0/3624132222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80900b6010 0x7f8090072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 --2- 172.21.15.104:0/3624132222 >> v2:172.21.15.192:3300/0 conn(0x7f80900b56c0 0x7f80900b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 --2- 172.21.15.104:0/3624132222 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 0x7f80900ae8b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 -- 172.21.15.104:0/3624132222 >> 172.21.15.104:0/3624132222 conn(0x7f809006eb90 msgr2=0x7f809006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 -- 172.21.15.104:0/3624132222 shutdown_connections 2024-09-17T02:55:34.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.140+0000 7f8097aec640 1 -- 172.21.15.104:0/3624132222 wait complete. 2024-09-17T02:55:34.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.142+0000 7f8097aec640 1 Processor -- start 2024-09-17T02:55:34.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.142+0000 7f8097aec640 1 -- start start 2024-09-17T02:55:34.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8097aec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80900b56c0 0x7f809013d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8097aec640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80900b6010 0x7f8090146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8097aec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 0x7f80901473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8097aec640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f80900768c0 con 0x7f80901483e0 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8097aec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8090148df0 con 0x7f80900b56c0 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8097aec640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8090073230 con 0x7f80900b6010 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 0x7f80901473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 0x7f80901473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44788/0 (socket says 172.21.15.104:44788) 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 -- 172.21.15.104:0/3753972697 learned_addr learned my addr 172.21.15.104:0/3753972697 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8095087640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80900b6010 0x7f8090146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8095888640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80900b56c0 0x7f809013d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 -- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80900b6010 msgr2=0x7f8090146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:34.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80900b6010 0x7f8090146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 -- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80900b56c0 msgr2=0x7f809013d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80900b56c0 0x7f809013d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 -- 172.21.15.104:0/3753972697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809015fca0 con 0x7f80901483e0 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8095888640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80900b56c0 0x7f809013d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.143+0000 7f8096089640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 0x7f80901473d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f808800cab0 tx=0x7f808800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.144+0000 7f80867fc640 1 -- 172.21.15.104:0/3753972697 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088007d90 con 0x7f80901483e0 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.144+0000 7f80867fc640 1 -- 172.21.15.104:0/3753972697 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f808800f540 con 0x7f80901483e0 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.144+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809015ff80 con 0x7f80901483e0 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.144+0000 7f80867fc640 1 -- 172.21.15.104:0/3753972697 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808800f990 con 0x7f80901483e0 2024-09-17T02:55:34.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.144+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8090160540 con 0x7f80901483e0 2024-09-17T02:55:34.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.145+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8090072cf0 con 0x7f80901483e0 2024-09-17T02:55:34.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.145+0000 7f80867fc640 1 -- 172.21.15.104:0/3753972697 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f808800fb30 con 0x7f80901483e0 2024-09-17T02:55:34.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.146+0000 7f80867fc640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8074078b90 0x7f807407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:34.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.146+0000 7f80867fc640 1 -- 172.21.15.104:0/3753972697 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f808809b6f0 con 0x7f80901483e0 2024-09-17T02:55:34.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.146+0000 7f8095888640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8074078b90 0x7f807407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:34.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.147+0000 7f8095888640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8074078b90 0x7f807407b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f808c033000 tx=0x7f808c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:34.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.150+0000 7f80867fc640 1 -- 172.21.15.104:0/3753972697 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8088014070 con 0x7f80901483e0 2024-09-17T02:55:34.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.361+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f80900cd860 con 0x7f80901483e0 2024-09-17T02:55:34.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.361+0000 7f80867fc640 1 -- 172.21.15.104:0/3753972697 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f808800fe20 con 0x7f80901483e0 2024-09-17T02:55:34.360 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:55:34.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8074078b90 msgr2=0x7f807407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:34.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8074078b90 0x7f807407b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f808c033000 tx=0x7f808c004730 comp rx=0 tx=0).stop 2024-09-17T02:55:34.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 msgr2=0x7f80901473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:34.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 0x7f80901473d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f808800cab0 tx=0x7f808800cf70 comp rx=0 tx=0).stop 2024-09-17T02:55:34.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 shutdown_connections 2024-09-17T02:55:34.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8074078b90 0x7f807407b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80901483e0 0x7f80901473d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80900b6010 0x7f8090146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 --2- 172.21.15.104:0/3753972697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80900b56c0 0x7f809013d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:34.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 >> 172.21.15.104:0/3753972697 conn(0x7f809006eb90 msgr2=0x7f8090146720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:34.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 shutdown_connections 2024-09-17T02:55:34.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:34.363+0000 7f8097aec640 1 -- 172.21.15.104:0/3753972697 wait complete. 2024-09-17T02:55:34.373 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:55:34.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:55:34.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T02:55:34.373 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T02:55:34.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:34.374 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:55:34.374 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:55:34.374 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:55:34.374 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:55:34.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:34.374 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T02:55:34.395 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:55:34.395 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:55:34.395 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:55:34.396 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42760sec preferred_lft 42760sec 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:55:34.397 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T02:55:34.398 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:55:34.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:34.399 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:55:34.464 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T02:55:34.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:34.466 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T02:55:34.524 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T02:55:34.525 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:55:34.525 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:55:34.525 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:55:34.525 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:55:34.525 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:55:34.526 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:55:34.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:55:34.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:55:34.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:55:34.526 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:55:34.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:34.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:34.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:34.658 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:55:34.674 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T02:55:34.674 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T02:55:34.674 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:55:34.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:34.675 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T02:55:34.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:34.740 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:34.794 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:55:34.796 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:55:34.796 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:55:34.797 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:34.797 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:55:34.853 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:55:34.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:34.853 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:55:34.985 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:55:34.985 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:55:34.985 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:34.996 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:55:34.996 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:55:34.996 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:34.996 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:34.997 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:35.002 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:55:35.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:55:35.002 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:55:35.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:55:35.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:55:35.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:55:35.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:55:35.002 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:55:35.003 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T02:55:35.003 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:55:35.003 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:55:35.003 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:55:35.003 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:55:35.004 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:55:35.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:35.004 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:35.028 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:35.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:35.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:55:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:35.126 INFO:teuthology.orchestra.run.smithi192.stdout:client5115 2024-09-17T02:55:35.126 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:35.126 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:35.142 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:35.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.264+0000 7efd8b04d640 1 -- 172.21.15.104:0/3573415637 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 msgr2=0x7efd840b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.264+0000 7efd8b04d640 1 --2- 172.21.15.104:0/3573415637 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 0x7efd840b57e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efd840d3a70 tx=0x7efd7802a560 comp rx=0 tx=0).stop 2024-09-17T02:55:35.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.264+0000 7efd8b04d640 1 -- 172.21.15.104:0/3573415637 shutdown_connections 2024-09-17T02:55:35.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.264+0000 7efd8b04d640 1 --2- 172.21.15.104:0/3573415637 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 0x7efd840b57e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.264+0000 7efd8b04d640 1 --2- 172.21.15.104:0/3573415637 >> v2:172.21.15.192:3300/0 conn(0x7efd840b4fc0 0x7efd840b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.264+0000 7efd8b04d640 1 -- 172.21.15.104:0/3573415637 >> 172.21.15.104:0/3573415637 conn(0x7efd840b44a0 msgr2=0x7efd840b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:35.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.264+0000 7efd8b04d640 1 -- 172.21.15.104:0/3573415637 shutdown_connections 2024-09-17T02:55:35.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.264+0000 7efd8b04d640 1 -- 172.21.15.104:0/3573415637 wait complete. 2024-09-17T02:55:35.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.266+0000 7efd8b04d640 1 Processor -- start 2024-09-17T02:55:35.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.266+0000 7efd8b04d640 1 -- start start 2024-09-17T02:55:35.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd8b04d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 0x7efd841f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:35.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd8b04d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd840b4fc0 0x7efd840b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:35.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd8b04d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd840b5d20 0x7efd8415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:35.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd8b04d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7efd840ce120 con 0x7efd840b3f00 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd8b04d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd840d0320 con 0x7efd840b4fc0 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd8b04d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efd840ca6c0 con 0x7efd840b5d20 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd88de9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 0x7efd841f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd88de9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 0x7efd841f6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44802/0 (socket says 172.21.15.104:44802) 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd88de9640 1 -- 172.21.15.104:0/2621957824 learned_addr learned my addr 172.21.15.104:0/2621957824 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd83fff640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd840b4fc0 0x7efd840b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.267+0000 7efd895ea640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd840b5d20 0x7efd8415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd88de9640 1 -- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd840b5d20 msgr2=0x7efd8415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd88de9640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd840b5d20 0x7efd8415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd88de9640 1 -- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd840b4fc0 msgr2=0x7efd840b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd88de9640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd840b4fc0 0x7efd840b63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd88de9640 1 -- 172.21.15.104:0/2621957824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd841f7120 con 0x7efd840b3f00 2024-09-17T02:55:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd88de9640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 0x7efd841f6be0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efd7400d6d0 tx=0x7efd7400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd817fa640 1 -- 172.21.15.104:0/2621957824 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74017070 con 0x7efd840b3f00 2024-09-17T02:55:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd817fa640 1 -- 172.21.15.104:0/2621957824 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd74005330 con 0x7efd840b3f00 2024-09-17T02:55:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd817fa640 1 -- 172.21.15.104:0/2621957824 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74009820 con 0x7efd840b3f00 2024-09-17T02:55:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8406d080 con 0x7efd840b3f00 2024-09-17T02:55:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.268+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8406d640 con 0x7efd840b3f00 2024-09-17T02:55:35.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.269+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd840b57e0 con 0x7efd840b3f00 2024-09-17T02:55:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.270+0000 7efd817fa640 1 -- 172.21.15.104:0/2621957824 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd74009bd0 con 0x7efd840b3f00 2024-09-17T02:55:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.270+0000 7efd817fa640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efd70078bc0 0x7efd7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.270+0000 7efd817fa640 1 -- 172.21.15.104:0/2621957824 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7efd7409aed0 con 0x7efd840b3f00 2024-09-17T02:55:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.271+0000 7efd83fff640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efd70078bc0 0x7efd7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:35.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.271+0000 7efd83fff640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efd70078bc0 0x7efd7007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd78033000 tx=0x7efd78004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:35.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.275+0000 7efd817fa640 1 -- 172.21.15.104:0/2621957824 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efd841f7120 con 0x7efd840b3f00 2024-09-17T02:55:35.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.484+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd840cead0 con 0x7efd840b3f00 2024-09-17T02:55:35.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.484+0000 7efd817fa640 1 -- 172.21.15.104:0/2621957824 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5232 (secure 0 0 0) 0x7efd74062de0 con 0x7efd840b3f00 2024-09-17T02:55:35.483 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:35.483 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:23.106277+0000","modified":"2024-09-17T02:55:25.113008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/477751550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":477751550},{"type":"v1","addr":"172.21.15.104:6835","nonce":477751550}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-09-17T02:55:35.483 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-09-17T02:55:35.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efd70078bc0 msgr2=0x7efd7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efd70078bc0 0x7efd7007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd78033000 tx=0x7efd78004730 comp rx=0 tx=0).stop 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 msgr2=0x7efd841f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 0x7efd841f6be0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efd7400d6d0 tx=0x7efd7400db90 comp rx=0 tx=0).stop 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 shutdown_connections 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efd70078bc0 0x7efd7007b0d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd840b4fc0 0x7efd840b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd840b5d20 0x7efd8415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 --2- 172.21.15.104:0/2621957824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efd840b3f00 0x7efd841f6be0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 >> 172.21.15.104:0/2621957824 conn(0x7efd840b44a0 msgr2=0x7efd840b6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 shutdown_connections 2024-09-17T02:55:35.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.487+0000 7efd8b04d640 1 -- 172.21.15.104:0/2621957824 wait complete. 2024-09-17T02:55:35.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T02:55:35.621 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":4917,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.852968758999999,"mdsmap_epoch":14,"osdmap_epoch":32,"osdmap_epoch_barrier":32,"uptime":18.735203231} 2024-09-17T02:55:35.621 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 4917, "mdsmap_epoch": 14, "osdmap_epoch": 32, "osdmap_epoch_barrier": 32, "rank_uptime": 11.852968759, "state": "up:active", "uptime": 18.735203231, "want_state": "up:active", "whoami": 0 } 2024-09-17T02:55:35.622 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 -- 172.21.15.104:0/3046149448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b3f00 msgr2=0x7fce800b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 --2- 172.21.15.104:0/3046149448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b3f00 0x7fce800b57e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce80074630 tx=0x7fce7002a560 comp rx=0 tx=0).stop 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 -- 172.21.15.104:0/3046149448 shutdown_connections 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 --2- 172.21.15.104:0/3046149448 >> v2:172.21.15.192:3300/0 conn(0x7fce800b5d20 0x7fce800cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 --2- 172.21.15.104:0/3046149448 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b3f00 0x7fce800b57e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 --2- 172.21.15.104:0/3046149448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce800b4fc0 0x7fce800b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 -- 172.21.15.104:0/3046149448 >> 172.21.15.104:0/3046149448 conn(0x7fce800b44a0 msgr2=0x7fce800b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 -- 172.21.15.104:0/3046149448 shutdown_connections 2024-09-17T02:55:35.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.734+0000 7fce86fe4640 1 -- 172.21.15.104:0/3046149448 wait complete. 2024-09-17T02:55:35.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.736+0000 7fce86fe4640 1 Processor -- start 2024-09-17T02:55:35.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.736+0000 7fce86fe4640 1 -- start start 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce86fe4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce800b3f00 0x7fce800cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce86fe4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce800b4fc0 0x7fce800c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce86fe4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b5d20 0x7fce800afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce86fe4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fce800cdf10 con 0x7fce800b5d20 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce86fe4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce800d02f0 con 0x7fce800b4fc0 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce86fe4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fce800ce090 con 0x7fce800b3f00 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce85581640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b5d20 0x7fce800afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce85581640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b5d20 0x7fce800afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44818/0 (socket says 172.21.15.104:44818) 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce85581640 1 -- 172.21.15.104:0/140488467 learned_addr learned my addr 172.21.15.104:0/140488467 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:35.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce84d80640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce800b3f00 0x7fce800cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce77fff640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce800b4fc0 0x7fce800c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.737+0000 7fce85581640 1 -- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce800b3f00 msgr2=0x7fce800cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce85581640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce800b3f00 0x7fce800cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce85581640 1 -- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce800b4fc0 msgr2=0x7fce800c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce85581640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce800b4fc0 0x7fce800c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce85581640 1 -- 172.21.15.104:0/140488467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce801f4520 con 0x7fce800b5d20 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce85581640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b5d20 0x7fce800afcd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fce7800d9e0 tx=0x7fce7800dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce757fa640 1 -- 172.21.15.104:0/140488467 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78017070 con 0x7fce800b5d20 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce757fa640 1 -- 172.21.15.104:0/140488467 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce7800be50 con 0x7fce800b5d20 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce757fa640 1 -- 172.21.15.104:0/140488467 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce780106c0 con 0x7fce800b5d20 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce801f4800 con 0x7fce800b5d20 2024-09-17T02:55:35.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.738+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce801f4dc0 con 0x7fce800b5d20 2024-09-17T02:55:35.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.739+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce80071750 con 0x7fce800b5d20 2024-09-17T02:55:35.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.740+0000 7fce757fa640 1 -- 172.21.15.104:0/140488467 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce7801a070 con 0x7fce800b5d20 2024-09-17T02:55:35.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.740+0000 7fce757fa640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce6c078b90 0x7fce6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:35.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.741+0000 7fce84d80640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce6c078b90 0x7fce6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:35.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.741+0000 7fce757fa640 1 -- 172.21.15.104:0/140488467 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fce7809b120 con 0x7fce800b5d20 2024-09-17T02:55:35.740 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.741+0000 7fce84d80640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce6c078b90 0x7fce6c07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce7c005fd0 tx=0x7fce7c00b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:35.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.745+0000 7fce757fa640 1 -- 172.21.15.104:0/140488467 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce80071750 con 0x7fce800b5d20 2024-09-17T02:55:35.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.987+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7fce800b39c0 con 0x7fce800b5d20 2024-09-17T02:55:35.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.988+0000 7fce757fa640 1 -- 172.21.15.104:0/140488467 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1620 (secure 0 0 0) 0x7fce78062f10 con 0x7fce800b5d20 2024-09-17T02:55:35.986 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "stats": { 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "total_bytes": 1600000000, 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "total_avail_bytes": 1597705348, 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "total_used_bytes": 2294652, 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "total_used_raw_bytes": 2294652, 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "total_used_raw_ratio": 0.0014341574860736728, 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "num_osds": 8, 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "num_per_pool_osds": 0, 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "num_per_pool_omap_osds": 0 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:35.987 INFO:teuthology.orchestra.run.smithi104.stdout: "stats_by_class": { 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "hdd": { 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "total_bytes": 1600000000, 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "total_avail_bytes": 1597705348, 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "total_used_bytes": 2294652, 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "total_used_raw_bytes": 2294652, 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "total_used_raw_ratio": 0.0014341574860736728 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "name": ".mgr", 2024-09-17T02:55:35.988 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 1, 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: "stats": { 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: "stored": 590368, 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: "objects": 2, 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: "kb_used": 577, 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: "bytes_used": 590368, 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: "percent_used": 0.00052959454478695989, 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: "max_avail": 557082176 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:35.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "name": "cephfs_metadata", 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 4, 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "stats": { 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "stored": 2410, 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "objects": 22, 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "kb_used": 3, 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "bytes_used": 2410, 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "percent_used": 2.1630514766002307e-06, 2024-09-17T02:55:35.990 INFO:teuthology.orchestra.run.smithi104.stdout: "max_avail": 557082176 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "name": "cephfs_data", 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5, 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "stats": { 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "stored": 0, 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "objects": 0, 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "kb_used": 0, 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "bytes_used": 0, 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "percent_used": 0, 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: "max_avail": 557082176 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:35.991 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:35.992 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:55:35.992 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce6c078b90 msgr2=0x7fce6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce6c078b90 0x7fce6c07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fce7c005fd0 tx=0x7fce7c00b260 comp rx=0 tx=0).stop 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b5d20 msgr2=0x7fce800afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b5d20 0x7fce800afcd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fce7800d9e0 tx=0x7fce7800dea0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 shutdown_connections 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce6c078b90 0x7fce6c07b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce800b4fc0 0x7fce800c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce800b5d20 0x7fce800afcd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 --2- 172.21.15.104:0/140488467 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce800b3f00 0x7fce800cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 >> 172.21.15.104:0/140488467 conn(0x7fce800b44a0 msgr2=0x7fce8015f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:35.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 shutdown_connections 2024-09-17T02:55:35.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:35.990+0000 7fce86fe4640 1 -- 172.21.15.104:0/140488467 wait complete. 2024-09-17T02:55:36.000 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T02:55:36.000 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T02:55:36.000 DEBUG:teuthology.orchestra.run.smithi104:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-17T02:55:36.000 DEBUG:teuthology.orchestra.run.smithi104:> os.fchmod(fd, 0O666) 2024-09-17T02:55:36.000 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(fd) 2024-09-17T02:55:36.000 DEBUG:teuthology.orchestra.run.smithi104:> os.close(fd) 2024-09-17T02:55:36.000 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T02:55:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:36.079 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:36.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:36.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:36.174 INFO:teuthology.orchestra.run.smithi104.stdout:client4948 2024-09-17T02:55:36.175 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client4948/osdmap') 2024-09-17T02:55:36.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:36.232 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 32 barrier 32 flags 0x588000 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:osd0 (1)172.21.15.104:6801 100% (exists, up) 100% -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:osd1 (1)172.21.15.104:6809 100% (exists, up) 100% -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:osd2 (1)172.21.15.104:6825 100% (exists, up) 100% -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:osd3 (1)172.21.15.104:6817 100% (exists, up) 100% -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:osd4 (1)172.21.15.192:6819 100% (exists, up) 100% -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:osd5 (1)172.21.15.192:6803 100% (exists, up) 100% -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:osd6 (1)172.21.15.192:6811 100% (exists, up) 100% -1 2024-09-17T02:55:36.233 INFO:teuthology.orchestra.run.smithi104.stdout:osd7 (1)172.21.15.192:6827 100% (exists, up) 100% -1 2024-09-17T02:55:36.234 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records in 2024-09-17T02:55:36.234 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records out 2024-09-17T02:55:36.234 INFO:teuthology.orchestra.run.smithi104.stderr:799 bytes copied, 3.1768e-05 s, 25.2 MB/s 2024-09-17T02:55:36.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:36.240 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-17T02:55:36.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.354+0000 7fc359ebd640 1 -- 172.21.15.104:0/2929709106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc33c004800 msgr2=0x7fc33c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:36.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.354+0000 7fc359ebd640 1 --2- 172.21.15.104:0/2929709106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc33c004800 0x7fc33c004c10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc348009b20 tx=0x7fc33c005830 comp rx=0 tx=0).stop 2024-09-17T02:55:36.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.354+0000 7fc353fff640 1 -- 172.21.15.104:0/2929709106 reap_dead start 2024-09-17T02:55:36.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.354+0000 7fc359ebd640 1 -- 172.21.15.104:0/2929709106 shutdown_connections 2024-09-17T02:55:36.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.354+0000 7fc359ebd640 1 -- 172.21.15.104:0/2929709106 >> 172.21.15.104:0/2929709106 conn(0x7fc3540b44a0 msgr2=0x7fc3540b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:36.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.354+0000 7fc359ebd640 1 -- 172.21.15.104:0/2929709106 shutdown_connections 2024-09-17T02:55:36.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.355+0000 7fc359ebd640 1 -- 172.21.15.104:0/2929709106 wait complete. 2024-09-17T02:55:36.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.356+0000 7fc359ebd640 1 Processor -- start 2024-09-17T02:55:36.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.356+0000 7fc359ebd640 1 -- start start 2024-09-17T02:55:36.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc359ebd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc33c004800 0x7fc35415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc359ebd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc354160550 0x7fc354160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc359ebd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3540cbad0 0x7fc3540cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc359ebd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc3540cfe50 con 0x7fc3540cbad0 2024-09-17T02:55:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc359ebd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc3540cfcd0 con 0x7fc33c004800 2024-09-17T02:55:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc359ebd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc3540cffd0 con 0x7fc354160550 2024-09-17T02:55:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3540cbad0 0x7fc3540cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3540cbad0 0x7fc3540cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44836/0 (socket says 172.21.15.104:44836) 2024-09-17T02:55:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 -- 172.21.15.104:0/951809465 learned_addr learned my addr 172.21.15.104:0/951809465 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc352ffd640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc354160550 0x7fc354160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc3537fe640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc33c004800 0x7fc35415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 -- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc354160550 msgr2=0x7fc354160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc354160550 0x7fc354160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 -- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc33c004800 msgr2=0x7fc35415be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:36.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc33c004800 0x7fc35415be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 -- 172.21.15.104:0/951809465 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3540cc420 con 0x7fc3540cbad0 2024-09-17T02:55:36.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc3537fe640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc33c004800 0x7fc35415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:36.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc353fff640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3540cbad0 0x7fc3540cbee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc3540c98d0 tx=0x7fc34c010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:36.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc33bfff640 1 -- 172.21.15.104:0/951809465 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c003970 con 0x7fc3540cbad0 2024-09-17T02:55:36.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc33bfff640 1 -- 172.21.15.104:0/951809465 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc34c015070 con 0x7fc3540cbad0 2024-09-17T02:55:36.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc33bfff640 1 -- 172.21.15.104:0/951809465 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c004030 con 0x7fc3540cbad0 2024-09-17T02:55:36.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.358+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3540b0d40 con 0x7fc3540cbad0 2024-09-17T02:55:36.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.359+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3541f3e30 con 0x7fc3540cbad0 2024-09-17T02:55:36.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.360+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3540b0f10 con 0x7fc3540cbad0 2024-09-17T02:55:36.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.360+0000 7fc33bfff640 1 -- 172.21.15.104:0/951809465 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc34c0041d0 con 0x7fc3540cbad0 2024-09-17T02:55:36.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.361+0000 7fc33bfff640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc340078b90 0x7fc34007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:36.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.361+0000 7fc33bfff640 1 -- 172.21.15.104:0/951809465 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc34c09b7c0 con 0x7fc3540cbad0 2024-09-17T02:55:36.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.361+0000 7fc3537fe640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc340078b90 0x7fc34007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:36.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.362+0000 7fc3537fe640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc340078b90 0x7fc34007b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc344001eb0 tx=0x7fc344001720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.366+0000 7fc33bfff640 1 -- 172.21.15.104:0/951809465 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc3540cc420 con 0x7fc3540cbad0 2024-09-17T02:55:36.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.548+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7fc3540b57e0 con 0x7fc3540cbad0 2024-09-17T02:55:36.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.802+0000 7fc33bfff640 1 -- 172.21.15.104:0/951809465 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v33) ==== 93+0+0 (secure 0 0 0) 0x7fc34c0635b0 con 0x7fc3540cbad0 2024-09-17T02:55:36.801 INFO:teuthology.orchestra.run.smithi104.stderr:pauserd,pausewr is set 2024-09-17T02:55:36.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.804+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc340078b90 msgr2=0x7fc34007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:36.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc340078b90 0x7fc34007b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc344001eb0 tx=0x7fc344001720 comp rx=0 tx=0).stop 2024-09-17T02:55:36.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3540cbad0 msgr2=0x7fc3540cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:36.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3540cbad0 0x7fc3540cbee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc3540c98d0 tx=0x7fc34c010f40 comp rx=0 tx=0).stop 2024-09-17T02:55:36.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 shutdown_connections 2024-09-17T02:55:36.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc340078b90 0x7fc34007b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc3540cbad0 0x7fc3540cbee0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc354160550 0x7fc354160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 --2- 172.21.15.104:0/951809465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc33c004800 0x7fc35415be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 >> 172.21.15.104:0/951809465 conn(0x7fc3540b44a0 msgr2=0x7fc3540c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:36.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 shutdown_connections 2024-09-17T02:55:36.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.805+0000 7fc359ebd640 1 -- 172.21.15.104:0/951809465 wait complete. 2024-09-17T02:55:36.815 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-17T02:55:36.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.929+0000 7f52da139640 1 -- 172.21.15.104:0/1126393414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 msgr2=0x7f52d4160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:36.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.929+0000 7f52da139640 1 --2- 172.21.15.104:0/1126393414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 0x7f52d4160ec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f52c8005fd0 tx=0x7f52c802a540 comp rx=0 tx=0).stop 2024-09-17T02:55:36.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.929+0000 7f52da139640 1 -- 172.21.15.104:0/1126393414 shutdown_connections 2024-09-17T02:55:36.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.929+0000 7f52da139640 1 --2- 172.21.15.104:0/1126393414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 0x7f52d4160ec0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.929+0000 7f52da139640 1 --2- 172.21.15.104:0/1126393414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d40d3490 0x7f52d40b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.929+0000 7f52da139640 1 -- 172.21.15.104:0/1126393414 >> 172.21.15.104:0/1126393414 conn(0x7f52d40d2970 msgr2=0x7f52d40d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:36.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.929+0000 7f52da139640 1 -- 172.21.15.104:0/1126393414 shutdown_connections 2024-09-17T02:55:36.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.929+0000 7f52da139640 1 -- 172.21.15.104:0/1126393414 wait complete. 2024-09-17T02:55:36.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.931+0000 7f52da139640 1 Processor -- start 2024-09-17T02:55:36.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.931+0000 7f52da139640 1 -- start start 2024-09-17T02:55:36.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52da139640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 0x7f52d415ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52da139640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d40d13e0 0x7f52d4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52da139640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d40d3490 0x7f52d41f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52da139640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f52d40b6bd0 con 0x7f52d40d0fd0 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52da139640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f52d40b6a50 con 0x7f52d40d3490 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52da139640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f52d40b6d50 con 0x7f52d40d13e0 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 0x7f52d415ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 0x7f52d415ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44842/0 (socket says 172.21.15.104:44842) 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 -- 172.21.15.104:0/2131641246 learned_addr learned my addr 172.21.15.104:0/2131641246 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d2ffd640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d40d13e0 0x7f52d4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d3fff640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d40d3490 0x7f52d41f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 -- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d40d13e0 msgr2=0x7f52d4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:36.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d40d13e0 0x7f52d4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 -- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d40d3490 msgr2=0x7f52d41f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d40d3490 0x7f52d41f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 -- 172.21.15.104:0/2131641246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d415a4e0 con 0x7f52d40d0fd0 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d3fff640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d40d3490 0x7f52d41f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52d37fe640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 0x7f52d415ba70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d770 tx=0x7f52c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52bbfff640 1 -- 172.21.15.104:0/2131641246 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4017070 con 0x7f52d40d0fd0 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52bbfff640 1 -- 172.21.15.104:0/2131641246 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52c4009d20 con 0x7f52d40d0fd0 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d41f4d00 con 0x7f52d40d0fd0 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.933+0000 7f52bbfff640 1 -- 172.21.15.104:0/2131641246 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c40106c0 con 0x7f52d40d0fd0 2024-09-17T02:55:36.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.934+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d40c76d0 con 0x7f52d40d0fd0 2024-09-17T02:55:36.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.935+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d40b7c80 con 0x7f52d40d0fd0 2024-09-17T02:55:36.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.935+0000 7f52bbfff640 1 -- 172.21.15.104:0/2131641246 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52c401a070 con 0x7f52d40d0fd0 2024-09-17T02:55:36.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.936+0000 7f52bbfff640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f52c0078b90 0x7f52c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:36.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.936+0000 7f52bbfff640 1 -- 172.21.15.104:0/2131641246 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f52c409ad70 con 0x7f52d40d0fd0 2024-09-17T02:55:36.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.936+0000 7f52d2ffd640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f52c0078b90 0x7f52c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:36.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.936+0000 7f52bbfff640 1 -- 172.21.15.104:0/2131641246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=34+}) -- 0x7f52c0080770 con 0x7f52d40d0fd0 2024-09-17T02:55:36.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.937+0000 7f52d2ffd640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f52c0078b90 0x7f52c007b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52c8033000 tx=0x7f52c8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:36.941+0000 7f52bbfff640 1 -- 172.21.15.104:0/2131641246 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f52c4062c80 con 0x7f52d40d0fd0 2024-09-17T02:55:37.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.125+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7f52d40d3030 con 0x7f52d40d0fd0 2024-09-17T02:55:37.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.813+0000 7f52bbfff640 1 -- 172.21.15.104:0/2131641246 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v34) ==== 97+0+0 (secure 0 0 0) 0x7f52c40676b0 con 0x7f52d40d0fd0 2024-09-17T02:55:37.812 INFO:teuthology.orchestra.run.smithi104.stderr:pauserd,pausewr is unset 2024-09-17T02:55:37.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f52c0078b90 msgr2=0x7f52c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f52c0078b90 0x7f52c007b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52c8033000 tx=0x7f52c8004730 comp rx=0 tx=0).stop 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 msgr2=0x7f52d415ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 0x7f52d415ba70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f52c400d770 tx=0x7f52c400dc30 comp rx=0 tx=0).stop 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 shutdown_connections 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f52c0078b90 0x7f52c007b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52d40d3490 0x7f52d41f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52d40d13e0 0x7f52d4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 --2- 172.21.15.104:0/2131641246 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f52d40d0fd0 0x7f52d415ba70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 >> 172.21.15.104:0/2131641246 conn(0x7f52d40d2970 msgr2=0x7f52d40af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 shutdown_connections 2024-09-17T02:55:37.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.816+0000 7f52da139640 1 -- 172.21.15.104:0/2131641246 wait complete. 2024-09-17T02:55:37.829 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 -- 172.21.15.104:0/23685470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 msgr2=0x7f7bbc073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 --2- 172.21.15.104:0/23685470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 0x7f7bbc073900 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc072420 tx=0x7f7bac02a560 comp rx=0 tx=0).stop 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 -- 172.21.15.104:0/23685470 shutdown_connections 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 --2- 172.21.15.104:0/23685470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bbc0b0500 0x7f7bbc0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 --2- 172.21.15.104:0/23685470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 0x7f7bbc073900 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 --2- 172.21.15.104:0/23685470 >> v2:172.21.15.192:3300/0 conn(0x7f7bbc15c220 0x7f7bbc06f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 -- 172.21.15.104:0/23685470 >> 172.21.15.104:0/23685470 conn(0x7f7bbc06d200 msgr2=0x7f7bbc06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 -- 172.21.15.104:0/23685470 shutdown_connections 2024-09-17T02:55:37.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.945+0000 7f7bc409b640 1 -- 172.21.15.104:0/23685470 wait complete. 2024-09-17T02:55:37.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.947+0000 7f7bc409b640 1 Processor -- start 2024-09-17T02:55:37.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.947+0000 7f7bc409b640 1 -- start start 2024-09-17T02:55:37.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc409b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 0x7f7bbc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:37.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc409b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bbc0b0500 0x7f7bbc069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:37.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc409b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bbc15c220 0x7f7bbc145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:37.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc409b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc0b11e0 con 0x7f7bbc0734f0 2024-09-17T02:55:37.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc409b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc0b1060 con 0x7f7bbc15c220 2024-09-17T02:55:37.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc409b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7bbc15f6f0 con 0x7f7bbc0b0500 2024-09-17T02:55:37.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 0x7f7bbc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:37.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 0x7f7bbc068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44872/0 (socket says 172.21.15.104:44872) 2024-09-17T02:55:37.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 -- 172.21.15.104:0/3606656171 learned_addr learned my addr 172.21.15.104:0/3606656171 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:37.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1636640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bbc0b0500 0x7f7bbc069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:37.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc2638640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bbc15c220 0x7f7bbc145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:37.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 -- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bbc0b0500 msgr2=0x7f7bbc069240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:37.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bbc0b0500 0x7f7bbc069240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 -- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bbc15c220 msgr2=0x7f7bbc145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:37.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bbc15c220 0x7f7bbc145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:37.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 -- 172.21.15.104:0/3606656171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc1f9da0 con 0x7f7bbc0734f0 2024-09-17T02:55:37.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.948+0000 7f7bc1e37640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 0x7f7bbc068d00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c970 tx=0x7f7bb800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:37.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.949+0000 7f7bb27fc640 1 -- 172.21.15.104:0/3606656171 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8007bb0 con 0x7f7bbc0734f0 2024-09-17T02:55:37.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.949+0000 7f7bb27fc640 1 -- 172.21.15.104:0/3606656171 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bb8007e40 con 0x7f7bbc0734f0 2024-09-17T02:55:37.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.949+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bbc1fa080 con 0x7f7bbc0734f0 2024-09-17T02:55:37.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.949+0000 7f7bb27fc640 1 -- 172.21.15.104:0/3606656171 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8005280 con 0x7f7bbc0734f0 2024-09-17T02:55:37.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.949+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bbc1fa640 con 0x7f7bbc0734f0 2024-09-17T02:55:37.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.950+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bbc0b0910 con 0x7f7bbc0734f0 2024-09-17T02:55:37.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.950+0000 7f7bb27fc640 1 -- 172.21.15.104:0/3606656171 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bb8005420 con 0x7f7bbc0734f0 2024-09-17T02:55:37.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.951+0000 7f7bb27fc640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ba0078bc0 0x7f7ba007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:37.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.951+0000 7f7bb27fc640 1 -- 172.21.15.104:0/3606656171 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7bb809b1b0 con 0x7f7bbc0734f0 2024-09-17T02:55:37.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.951+0000 7f7bc1636640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ba0078bc0 0x7f7ba007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:37.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.952+0000 7f7bc1636640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ba0078bc0 0x7f7ba007b0d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7bac033000 tx=0x7f7bac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:37.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:37.955+0000 7f7bb27fc640 1 -- 172.21.15.104:0/3606656171 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7bb8014030 con 0x7f7bbc0734f0 2024-09-17T02:55:38.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.131+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bbc070810 con 0x7f7bbc0734f0 2024-09-17T02:55:38.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.132+0000 7f7bb27fc640 1 -- 172.21.15.104:0/3606656171 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16777 (secure 0 0 0) 0x7f7bb8063740 con 0x7f7bbc0734f0 2024-09-17T02:55:38.131 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:38.131 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:37.802965+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:21.060997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:22.068496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:38.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ba0078bc0 msgr2=0x7f7ba007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:38.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ba0078bc0 0x7f7ba007b0d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7bac033000 tx=0x7f7bac004730 comp rx=0 tx=0).stop 2024-09-17T02:55:38.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 msgr2=0x7f7bbc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:38.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 0x7f7bbc068d00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c970 tx=0x7f7bb800ce30 comp rx=0 tx=0).stop 2024-09-17T02:55:38.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 shutdown_connections 2024-09-17T02:55:38.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ba0078bc0 0x7f7ba007b0d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bbc15c220 0x7f7bbc145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bbc0b0500 0x7f7bbc069240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 --2- 172.21.15.104:0/3606656171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7bbc0734f0 0x7f7bbc068d00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 >> 172.21.15.104:0/3606656171 conn(0x7f7bbc06d200 msgr2=0x7f7bbc15ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:38.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 shutdown_connections 2024-09-17T02:55:38.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.134+0000 7f7bc409b640 1 -- 172.21.15.104:0/3606656171 wait complete. 2024-09-17T02:55:38.145 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T02:55:38.145 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T02:55:38.145 DEBUG:teuthology.orchestra.run.smithi104:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-17T02:55:38.145 DEBUG:teuthology.orchestra.run.smithi104:> os.fchmod(fd, 0O666) 2024-09-17T02:55:38.145 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(fd) 2024-09-17T02:55:38.145 DEBUG:teuthology.orchestra.run.smithi104:> os.close(fd) 2024-09-17T02:55:38.145 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T02:55:38.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:38.221 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:38.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:38.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:38.317 INFO:teuthology.orchestra.run.smithi104.stdout:client4948 2024-09-17T02:55:38.317 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client4948/osdmap') 2024-09-17T02:55:38.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 32 barrier 32 flags 0x588000 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:osd0 (1)172.21.15.104:6801 100% (exists, up) 100% -1 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:osd1 (1)172.21.15.104:6809 100% (exists, up) 100% -1 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:osd2 (1)172.21.15.104:6825 100% (exists, up) 100% -1 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:osd3 (1)172.21.15.104:6817 100% (exists, up) 100% -1 2024-09-17T02:55:38.375 INFO:teuthology.orchestra.run.smithi104.stdout:osd4 (1)172.21.15.192:6819 100% (exists, up) 100% -1 2024-09-17T02:55:38.376 INFO:teuthology.orchestra.run.smithi104.stdout:osd5 (1)172.21.15.192:6803 100% (exists, up) 100% -1 2024-09-17T02:55:38.376 INFO:teuthology.orchestra.run.smithi104.stdout:osd6 (1)172.21.15.192:6811 100% (exists, up) 100% -1 2024-09-17T02:55:38.376 INFO:teuthology.orchestra.run.smithi104.stdout:osd7 (1)172.21.15.192:6827 100% (exists, up) 100% -1 2024-09-17T02:55:38.376 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records in 2024-09-17T02:55:38.376 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records out 2024-09-17T02:55:38.376 INFO:teuthology.orchestra.run.smithi104.stderr:799 bytes copied, 3.3903e-05 s, 23.6 MB/s 2024-09-17T02:55:38.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:38.382 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:38.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.496+0000 7f96f60f9640 1 -- 172.21.15.104:0/2317983743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f006fad0 msgr2=0x7f96f00cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:38.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.496+0000 7f96f60f9640 1 --2- 172.21.15.104:0/2317983743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f006fad0 0x7f96f00cd170 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009830 tx=0x7f96e402a480 comp rx=0 tx=0).stop 2024-09-17T02:55:38.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.496+0000 7f96f60f9640 1 -- 172.21.15.104:0/2317983743 shutdown_connections 2024-09-17T02:55:38.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.496+0000 7f96f60f9640 1 --2- 172.21.15.104:0/2317983743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00cd6b0 0x7f96f0156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.496+0000 7f96f60f9640 1 --2- 172.21.15.104:0/2317983743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f006fad0 0x7f96f00cd170 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.496+0000 7f96f60f9640 1 -- 172.21.15.104:0/2317983743 >> 172.21.15.104:0/2317983743 conn(0x7f96f00b2450 msgr2=0x7f96f00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:38.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.496+0000 7f96f60f9640 1 -- 172.21.15.104:0/2317983743 shutdown_connections 2024-09-17T02:55:38.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.496+0000 7f96f60f9640 1 -- 172.21.15.104:0/2317983743 wait complete. 2024-09-17T02:55:38.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.498+0000 7f96f60f9640 1 Processor -- start 2024-09-17T02:55:38.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.498+0000 7f96f60f9640 1 -- start start 2024-09-17T02:55:38.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.499+0000 7f96f60f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f006fad0 0x7f96f00af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:38.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.499+0000 7f96f60f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00744d0 0x7f96f0141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:38.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.499+0000 7f96f60f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f00cd6b0 0x7f96f01429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:38.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.499+0000 7f96f60f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f96f01572d0 con 0x7f96f006fad0 2024-09-17T02:55:38.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.499+0000 7f96f60f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f96f0157150 con 0x7f96f00cd6b0 2024-09-17T02:55:38.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.499+0000 7f96f60f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f96f0157450 con 0x7f96f00744d0 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f006fad0 0x7f96f00af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f006fad0 0x7f96f00af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44886/0 (socket says 172.21.15.104:44886) 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 -- 172.21.15.104:0/3566338025 learned_addr learned my addr 172.21.15.104:0/3566338025 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96eeffd640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00744d0 0x7f96f0141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96effff640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f00cd6b0 0x7f96f01429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 -- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00744d0 msgr2=0x7f96f0141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00744d0 0x7f96f0141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 -- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f00cd6b0 msgr2=0x7f96f01429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:38.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f00cd6b0 0x7f96f01429c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 -- 172.21.15.104:0/3566338025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f01e90d0 con 0x7f96f006fad0 2024-09-17T02:55:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96ef7fe640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f006fad0 0x7f96f00af000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f96e000c3a0 tx=0x7f96e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96d7fff640 1 -- 172.21.15.104:0/3566338025 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0017070 con 0x7f96f006fad0 2024-09-17T02:55:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96d7fff640 1 -- 172.21.15.104:0/3566338025 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96e00053c0 con 0x7f96f006fad0 2024-09-17T02:55:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f01e93b0 con 0x7f96f006fad0 2024-09-17T02:55:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96d7fff640 1 -- 172.21.15.104:0/3566338025 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0003850 con 0x7f96f006fad0 2024-09-17T02:55:38.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.500+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f0142020 con 0x7f96f006fad0 2024-09-17T02:55:38.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.501+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f00cd170 con 0x7f96f006fad0 2024-09-17T02:55:38.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.502+0000 7f96d7fff640 1 -- 172.21.15.104:0/3566338025 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96e001a070 con 0x7f96f006fad0 2024-09-17T02:55:38.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.503+0000 7f96d7fff640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96dc078b90 0x7f96dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:38.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.503+0000 7f96d7fff640 1 -- 172.21.15.104:0/3566338025 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f96e0099f70 con 0x7f96f006fad0 2024-09-17T02:55:38.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.503+0000 7f96eeffd640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96dc078b90 0x7f96dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:38.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.503+0000 7f96eeffd640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96dc078b90 0x7f96dc07b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96e4034000 tx=0x7f96e4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:38.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.507+0000 7f96d7fff640 1 -- 172.21.15.104:0/3566338025 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f96f00cdac0 con 0x7f96f006fad0 2024-09-17T02:55:38.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.715+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96f015de10 con 0x7f96f006fad0 2024-09-17T02:55:38.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.716+0000 7f96d7fff640 1 -- 172.21.15.104:0/3566338025 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5232 (secure 0 0 0) 0x7f96e0061df0 con 0x7f96f006fad0 2024-09-17T02:55:38.715 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:38.715 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:23.106277+0000","modified":"2024-09-17T02:55:25.113008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/477751550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":477751550},{"type":"v1","addr":"172.21.15.104:6835","nonce":477751550}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-09-17T02:55:38.715 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96dc078b90 msgr2=0x7f96dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96dc078b90 0x7f96dc07b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96e4034000 tx=0x7f96e4004730 comp rx=0 tx=0).stop 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f006fad0 msgr2=0x7f96f00af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f006fad0 0x7f96f00af000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f96e000c3a0 tx=0x7f96e000c860 comp rx=0 tx=0).stop 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 shutdown_connections 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96dc078b90 0x7f96dc07b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96f00cd6b0 0x7f96f01429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f00744d0 0x7f96f0141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 --2- 172.21.15.104:0/3566338025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f006fad0 0x7f96f00af000 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:38.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 >> 172.21.15.104:0/3566338025 conn(0x7f96f00b2450 msgr2=0x7f96f015d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:38.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 shutdown_connections 2024-09-17T02:55:38.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38.718+0000 7f96f60f9640 1 -- 172.21.15.104:0/3566338025 wait complete. 2024-09-17T02:55:38.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 34 2024-09-17T02:55:38.854 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-17T02:55:38.854 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T02:55:38.855 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T02:55:38.855 DEBUG:teuthology.orchestra.run.smithi104:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-17T02:55:38.855 DEBUG:teuthology.orchestra.run.smithi104:> os.fchmod(fd, 0O666) 2024-09-17T02:55:38.855 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(fd) 2024-09-17T02:55:38.855 DEBUG:teuthology.orchestra.run.smithi104:> os.close(fd) 2024-09-17T02:55:38.855 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T02:55:38.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:38.931 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:39.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:39.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:39.027 INFO:teuthology.orchestra.run.smithi104.stdout:client4948 2024-09-17T02:55:39.027 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client4948/osdmap') 2024-09-17T02:55:39.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:39.085 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 34 barrier 34 flags 0x588000 2024-09-17T02:55:39.085 INFO:teuthology.orchestra.run.smithi104.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:39.085 INFO:teuthology.orchestra.run.smithi104.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:osd0 (1)172.21.15.104:6801 100% (exists, up) 100% -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:osd1 (1)172.21.15.104:6809 100% (exists, up) 100% -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:osd2 (1)172.21.15.104:6825 100% (exists, up) 100% -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:osd3 (1)172.21.15.104:6817 100% (exists, up) 100% -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:osd4 (1)172.21.15.192:6819 100% (exists, up) 100% -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:osd5 (1)172.21.15.192:6803 100% (exists, up) 100% -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:osd6 (1)172.21.15.192:6811 100% (exists, up) 100% -1 2024-09-17T02:55:39.086 INFO:teuthology.orchestra.run.smithi104.stdout:osd7 (1)172.21.15.192:6827 100% (exists, up) 100% -1 2024-09-17T02:55:39.087 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records in 2024-09-17T02:55:39.087 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records out 2024-09-17T02:55:39.087 INFO:teuthology.orchestra.run.smithi104.stderr:799 bytes copied, 3.5548e-05 s, 22.5 MB/s 2024-09-17T02:55:39.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:39.092 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:55:39.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:55:39.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:39.147 INFO:teuthology.orchestra.run.smithi104.stdout:client4948 2024-09-17T02:55:39.147 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client4948/osdmap') 2024-09-17T02:55:39.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:55:39.204 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 34 barrier 34 flags 0x588000 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:osd0 (1)172.21.15.104:6801 100% (exists, up) 100% -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:osd1 (1)172.21.15.104:6809 100% (exists, up) 100% -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:osd2 (1)172.21.15.104:6825 100% (exists, up) 100% -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:osd3 (1)172.21.15.104:6817 100% (exists, up) 100% -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:osd4 (1)172.21.15.192:6819 100% (exists, up) 100% -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:osd5 (1)172.21.15.192:6803 100% (exists, up) 100% -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:osd6 (1)172.21.15.192:6811 100% (exists, up) 100% -1 2024-09-17T02:55:39.205 INFO:teuthology.orchestra.run.smithi104.stdout:osd7 (1)172.21.15.192:6827 100% (exists, up) 100% -1 2024-09-17T02:55:39.206 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records in 2024-09-17T02:55:39.206 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records out 2024-09-17T02:55:39.206 INFO:teuthology.orchestra.run.smithi104.stderr:799 bytes copied, 3.2659e-05 s, 24.5 MB/s 2024-09-17T02:55:39.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:55:39.212 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T02:55:39.212 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:55:39.213 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:55:39.256 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:55:39.301 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:55:39.302 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:55:39.302 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:39.302 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:39.318 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:39.319 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:39.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:55:39.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.528+0000 7faad51ad640 1 -- 172.21.15.104:0/3567924311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00cdf10 msgr2=0x7faad00b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:39.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.528+0000 7faad51ad640 1 --2- 172.21.15.104:0/3567924311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00cdf10 0x7faad00b57e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faad00c98b0 tx=0x7faab802a5f0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.529+0000 7faad51ad640 1 -- 172.21.15.104:0/3567924311 shutdown_connections 2024-09-17T02:55:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.529+0000 7faad51ad640 1 --2- 172.21.15.104:0/3567924311 >> v2:172.21.15.192:3300/0 conn(0x7faad00b5d20 0x7faad00cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.529+0000 7faad51ad640 1 --2- 172.21.15.104:0/3567924311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00cdf10 0x7faad00b57e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.529+0000 7faad51ad640 1 -- 172.21.15.104:0/3567924311 >> 172.21.15.104:0/3567924311 conn(0x7faad00b44a0 msgr2=0x7faad00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.529+0000 7faad51ad640 1 -- 172.21.15.104:0/3567924311 shutdown_connections 2024-09-17T02:55:39.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.529+0000 7faad51ad640 1 -- 172.21.15.104:0/3567924311 wait complete. 2024-09-17T02:55:39.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.530+0000 7faad51ad640 1 Processor -- start 2024-09-17T02:55:39.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.531+0000 7faad51ad640 1 -- start start 2024-09-17T02:55:39.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faad51ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4fc0 0x7faad0150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faad51ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00b5d20 0x7faad0150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faad51ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00cdf10 0x7faad0150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faad51ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faad00d18c0 con 0x7faad00b5d20 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faad51ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faad00d01d0 con 0x7faad00cdf10 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faad51ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faad0160f50 con 0x7faad00b4fc0 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faac659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00b5d20 0x7faad0150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faac659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00b5d20 0x7faad0150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44910/0 (socket says 172.21.15.104:44910) 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faac659c640 1 -- 172.21.15.104:0/2821430525 learned_addr learned my addr 172.21.15.104:0/2821430525 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faacf59e640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00cdf10 0x7faad0150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faaced9d640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4fc0 0x7faad0150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faac659c640 1 -- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4fc0 msgr2=0x7faad0150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:39.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faac659c640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4fc0 0x7faad0150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faac659c640 1 -- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00cdf10 msgr2=0x7faad0150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faac659c640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00cdf10 0x7faad0150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faac659c640 1 -- 172.21.15.104:0/2821430525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad00c9ce0 con 0x7faad00b5d20 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.532+0000 7faacf59e640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00cdf10 0x7faad0150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.533+0000 7faac659c640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00b5d20 0x7faad0150840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faab8034040 tx=0x7faab80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.533+0000 7faac7fff640 1 -- 172.21.15.104:0/2821430525 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab803e030 con 0x7faad00b5d20 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.533+0000 7faac7fff640 1 -- 172.21.15.104:0/2821430525 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab80047a0 con 0x7faad00b5d20 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.533+0000 7faac7fff640 1 -- 172.21.15.104:0/2821430525 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8035040 con 0x7faad00b5d20 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.533+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad00c9fc0 con 0x7faad00b5d20 2024-09-17T02:55:39.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.533+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad00ca580 con 0x7faad00b5d20 2024-09-17T02:55:39.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.534+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad00cfa80 con 0x7faad00b5d20 2024-09-17T02:55:39.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.535+0000 7faac7fff640 1 -- 172.21.15.104:0/2821430525 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faab8041030 con 0x7faad00b5d20 2024-09-17T02:55:39.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.535+0000 7faac7fff640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faab0078b90 0x7faab007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:39.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.535+0000 7faac7fff640 1 -- 172.21.15.104:0/2821430525 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7faab80bb550 con 0x7faad00b5d20 2024-09-17T02:55:39.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.535+0000 7faaced9d640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faab0078b90 0x7faab007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:39.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.536+0000 7faaced9d640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faab0078b90 0x7faab007b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faac0007fd0 tx=0x7faac0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:39.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.539+0000 7faac7fff640 1 -- 172.21.15.104:0/2821430525 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faab8083990 con 0x7faad00b5d20 2024-09-17T02:55:39.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.725+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faad0160cc0 con 0x7faad00b5d20 2024-09-17T02:55:39.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.726+0000 7faac7fff640 1 -- 172.21.15.104:0/2821430525 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7faab8083290 con 0x7faad00b5d20 2024-09-17T02:55:39.724 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:55:39.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faab0078b90 msgr2=0x7faab007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:39.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faab0078b90 0x7faab007b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faac0007fd0 tx=0x7faac0009040 comp rx=0 tx=0).stop 2024-09-17T02:55:39.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00b5d20 msgr2=0x7faad0150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:39.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00b5d20 0x7faad0150840 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faab8034040 tx=0x7faab80039e0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 shutdown_connections 2024-09-17T02:55:39.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faab0078b90 0x7faab007b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faad00cdf10 0x7faad0150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faad00b5d20 0x7faad0150840 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 --2- 172.21.15.104:0/2821430525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faad00b4fc0 0x7faad0150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:39.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 >> 172.21.15.104:0/2821430525 conn(0x7faad00b44a0 msgr2=0x7faad00b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:39.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 shutdown_connections 2024-09-17T02:55:39.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:39.728+0000 7faad51ad640 1 -- 172.21.15.104:0/2821430525 wait complete. 2024-09-17T02:55:39.738 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T02:55:39.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:39.738 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T02:55:39.792 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:55:39.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:39.792 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T02:55:39.813 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:55:39.814 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:39.814 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:39.831 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:39.831 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:39.889 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:55:40.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.005+0000 7f40c9094640 1 -- 172.21.15.104:0/2822625996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 msgr2=0x7f40b0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.005+0000 7f40c9094640 1 --2- 172.21.15.104:0/2822625996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 0x7f40b0004c10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f40ac001690 tx=0x7f40b0005830 comp rx=0 tx=0).stop 2024-09-17T02:55:40.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.005+0000 7f40c9094640 1 -- 172.21.15.104:0/2822625996 shutdown_connections 2024-09-17T02:55:40.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.005+0000 7f40c9094640 1 --2- 172.21.15.104:0/2822625996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 0x7f40b0004c10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.005+0000 7f40c9094640 1 -- 172.21.15.104:0/2822625996 >> 172.21.15.104:0/2822625996 conn(0x7f40c40b44a0 msgr2=0x7f40c40b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:40.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.005+0000 7f40c9094640 1 -- 172.21.15.104:0/2822625996 shutdown_connections 2024-09-17T02:55:40.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.005+0000 7f40c9094640 1 -- 172.21.15.104:0/2822625996 wait complete. 2024-09-17T02:55:40.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.007+0000 7f40c9094640 1 Processor -- start 2024-09-17T02:55:40.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.007+0000 7f40c9094640 1 -- start start 2024-09-17T02:55:40.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.008+0000 7f40c9094640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 0x7f40c415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.008+0000 7f40c9094640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c40b1110 0x7f40c415fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.008+0000 7f40c9094640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c41600f0 0x7f40c40af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.008+0000 7f40c9094640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f40c40b57e0 con 0x7f40b0004800 2024-09-17T02:55:40.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.008+0000 7f40c9094640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f40c40b3ce0 con 0x7f40c41600f0 2024-09-17T02:55:40.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.008+0000 7f40c9094640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f40c40b5960 con 0x7f40c40b1110 2024-09-17T02:55:40.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 0x7f40c415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 0x7f40c415cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44934/0 (socket says 172.21.15.104:44934) 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 -- 172.21.15.104:0/1786702159 learned_addr learned my addr 172.21.15.104:0/1786702159 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40ba59c640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c40b1110 0x7f40c415fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c359e640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c41600f0 0x7f40c40af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 -- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c40b1110 msgr2=0x7f40c415fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c40b1110 0x7f40c415fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 -- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c41600f0 msgr2=0x7f40c40af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c41600f0 0x7f40c40af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 -- 172.21.15.104:0/1786702159 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c4160500 con 0x7f40b0004800 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c2d9d640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 0x7f40c415cb80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f40b4011b10 tx=0x7f40b4011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40bbfff640 1 -- 172.21.15.104:0/1786702159 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b400fc20 con 0x7f40b0004800 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40bbfff640 1 -- 172.21.15.104:0/1786702159 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40b400fdc0 con 0x7f40b0004800 2024-09-17T02:55:40.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c40b2130 con 0x7f40b0004800 2024-09-17T02:55:40.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40bbfff640 1 -- 172.21.15.104:0/1786702159 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4004280 con 0x7f40b0004800 2024-09-17T02:55:40.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.009+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c41f7620 con 0x7f40b0004800 2024-09-17T02:55:40.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.010+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c40b5ec0 con 0x7f40b0004800 2024-09-17T02:55:40.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.011+0000 7f40bbfff640 1 -- 172.21.15.104:0/1786702159 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40b40035f0 con 0x7f40b0004800 2024-09-17T02:55:40.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.011+0000 7f40bbfff640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a4078b90 0x7f40a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.012+0000 7f40bbfff640 1 -- 172.21.15.104:0/1786702159 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f40b409b6d0 con 0x7f40b0004800 2024-09-17T02:55:40.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.012+0000 7f40ba59c640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a4078b90 0x7f40a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.012+0000 7f40ba59c640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a4078b90 0x7f40a407b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f40ac032000 tx=0x7f40ac02c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:40.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.016+0000 7f40bbfff640 1 -- 172.21.15.104:0/1786702159 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40c4160500 con 0x7f40b0004800 2024-09-17T02:55:40.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.201+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f40c40cead0 con 0x7f40b0004800 2024-09-17T02:55:40.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.202+0000 7f40bbfff640 1 -- 172.21.15.104:0/1786702159 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f40b4063550 con 0x7f40b0004800 2024-09-17T02:55:40.200 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a4078b90 msgr2=0x7f40a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a4078b90 0x7f40a407b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f40ac032000 tx=0x7f40ac02c040 comp rx=0 tx=0).stop 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 msgr2=0x7f40c415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 0x7f40c415cb80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f40b4011b10 tx=0x7f40b4011f10 comp rx=0 tx=0).stop 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 shutdown_connections 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a4078b90 0x7f40a407b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c41600f0 0x7f40c40af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c40b1110 0x7f40c415fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 --2- 172.21.15.104:0/1786702159 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40b0004800 0x7f40c415cb80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 >> 172.21.15.104:0/1786702159 conn(0x7f40c40b44a0 msgr2=0x7f40c40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 shutdown_connections 2024-09-17T02:55:40.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.204+0000 7f40c9094640 1 -- 172.21.15.104:0/1786702159 wait complete. 2024-09-17T02:55:40.213 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T02:55:40.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:40.214 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T02:55:40.243 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:55:40.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:55:40.243 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T02:55:40.300 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:55:40.300 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:40.300 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:40.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:55:40.317 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:55:40.317 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:40.317 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:40.356 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:55:40.356 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:40.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.469+0000 7f751a87e640 1 -- 172.21.15.104:0/1776271480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140d0470 msgr2=0x7f75140d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.469+0000 7f751a87e640 1 --2- 172.21.15.104:0/1776271480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140d0470 0x7f75140d0880 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7508005fd0 tx=0x7f750802a4b0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.469+0000 7f751a87e640 1 -- 172.21.15.104:0/1776271480 shutdown_connections 2024-09-17T02:55:40.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.469+0000 7f751a87e640 1 --2- 172.21.15.104:0/1776271480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140d0470 0x7f75140d0880 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.469+0000 7f751a87e640 1 -- 172.21.15.104:0/1776271480 >> 172.21.15.104:0/1776271480 conn(0x7f75140d28a0 msgr2=0x7f75140d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:40.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.470+0000 7f751a87e640 1 -- 172.21.15.104:0/1776271480 shutdown_connections 2024-09-17T02:55:40.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.470+0000 7f751a87e640 1 -- 172.21.15.104:0/1776271480 wait complete. 2024-09-17T02:55:40.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.471+0000 7f751a87e640 1 Processor -- start 2024-09-17T02:55:40.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.471+0000 7f751a87e640 1 -- start start 2024-09-17T02:55:40.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f751a87e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140b7bb0 0x7f75140afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f751a87e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75140cefb0 0x7f751415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f751a87e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75140d0470 0x7f751415f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f751a87e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f75140cfc50 con 0x7f75140b7bb0 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f751a87e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f75140cfad0 con 0x7f75140d0470 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f751a87e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f75140cfdd0 con 0x7f75140cefb0 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140b7bb0 0x7f75140afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140b7bb0 0x7f75140afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44940/0 (socket says 172.21.15.104:44940) 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 -- 172.21.15.104:0/3472843315 learned_addr learned my addr 172.21.15.104:0/3472843315 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f75137fe640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75140cefb0 0x7f751415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7518e1b640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75140d0470 0x7f751415f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 -- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75140cefb0 msgr2=0x7f751415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75140cefb0 0x7f751415a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 -- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75140d0470 msgr2=0x7f751415f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75140d0470 0x7f751415f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 -- 172.21.15.104:0/3472843315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751415e8d0 con 0x7f75140b7bb0 2024-09-17T02:55:40.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7513fff640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140b7bb0 0x7f75140afc80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f750400c390 tx=0x7f750400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:40.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7510ff9640 1 -- 172.21.15.104:0/3472843315 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504017070 con 0x7f75140b7bb0 2024-09-17T02:55:40.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f7510ff9640 1 -- 172.21.15.104:0/3472843315 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75040035f0 con 0x7f75140b7bb0 2024-09-17T02:55:40.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.473+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751415ebb0 con 0x7f75140b7bb0 2024-09-17T02:55:40.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.474+0000 7f7510ff9640 1 -- 172.21.15.104:0/3472843315 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504003a40 con 0x7f75140b7bb0 2024-09-17T02:55:40.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.474+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751415abf0 con 0x7f75140b7bb0 2024-09-17T02:55:40.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.475+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751406a700 con 0x7f75140b7bb0 2024-09-17T02:55:40.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.475+0000 7f7510ff9640 1 -- 172.21.15.104:0/3472843315 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f750401a070 con 0x7f75140b7bb0 2024-09-17T02:55:40.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.476+0000 7f7510ff9640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7500078bc0 0x7f750007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.476+0000 7f7510ff9640 1 -- 172.21.15.104:0/3472843315 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7504099f30 con 0x7f75140b7bb0 2024-09-17T02:55:40.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.476+0000 7f75137fe640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7500078bc0 0x7f750007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.477+0000 7f75137fe640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7500078bc0 0x7f750007b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7508033000 tx=0x7f7508004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:40.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.481+0000 7f7510ff9640 1 -- 172.21.15.104:0/3472843315 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f751406a700 con 0x7f75140b7bb0 2024-09-17T02:55:40.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.690+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75140d0880 con 0x7f75140b7bb0 2024-09-17T02:55:40.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.690+0000 7f7510ff9640 1 -- 172.21.15.104:0/3472843315 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5232 (secure 0 0 0) 0x7f7504061d20 con 0x7f75140b7bb0 2024-09-17T02:55:40.689 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:40.689 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:23.106277+0000","modified":"2024-09-17T02:55:25.113008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/477751550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":477751550},{"type":"v1","addr":"172.21.15.104:6835","nonce":477751550}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-09-17T02:55:40.690 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-09-17T02:55:40.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.692+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7500078bc0 msgr2=0x7f750007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.692+0000 7f751a87e640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7500078bc0 0x7f750007b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7508033000 tx=0x7f7508004730 comp rx=0 tx=0).stop 2024-09-17T02:55:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.692+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140b7bb0 msgr2=0x7f75140afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.692+0000 7f751a87e640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140b7bb0 0x7f75140afc80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f750400c390 tx=0x7f750400c850 comp rx=0 tx=0).stop 2024-09-17T02:55:40.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.693+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 shutdown_connections 2024-09-17T02:55:40.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.693+0000 7f751a87e640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7500078bc0 0x7f750007b0d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.693+0000 7f751a87e640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75140d0470 0x7f751415f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.693+0000 7f751a87e640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75140cefb0 0x7f751415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.693+0000 7f751a87e640 1 --2- 172.21.15.104:0/3472843315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75140b7bb0 0x7f75140afc80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.693+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 >> 172.21.15.104:0/3472843315 conn(0x7f75140d28a0 msgr2=0x7f7514163d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:40.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.693+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 shutdown_connections 2024-09-17T02:55:40.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.693+0000 7f751a87e640 1 -- 172.21.15.104:0/3472843315 wait complete. 2024-09-17T02:55:40.702 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:40.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.820+0000 7fe9782d5640 1 -- 172.21.15.104:0/1140868789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006f840 msgr2=0x7fe970072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.820+0000 7fe9782d5640 1 --2- 172.21.15.104:0/1140868789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006f840 0x7fe970072e30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe960009830 tx=0x7fe96002a480 comp rx=0 tx=0).stop 2024-09-17T02:55:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.820+0000 7fe9782d5640 1 -- 172.21.15.104:0/1140868789 shutdown_connections 2024-09-17T02:55:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.820+0000 7fe9782d5640 1 --2- 172.21.15.104:0/1140868789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe970073370 0x7fe9700b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.820+0000 7fe9782d5640 1 --2- 172.21.15.104:0/1140868789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe97006f840 0x7fe970072e30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.820+0000 7fe9782d5640 1 -- 172.21.15.104:0/1140868789 >> 172.21.15.104:0/1140868789 conn(0x7fe9700b2450 msgr2=0x7fe9700b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:40.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.820+0000 7fe9782d5640 1 -- 172.21.15.104:0/1140868789 shutdown_connections 2024-09-17T02:55:40.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.820+0000 7fe9782d5640 1 -- 172.21.15.104:0/1140868789 wait complete. 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.822+0000 7fe9782d5640 1 Processor -- start 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.822+0000 7fe9782d5640 1 -- start start 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe9782d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe97006f840 0x7fe97014bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe9782d5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe970073370 0x7fe97014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe9782d5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9700cff70 0x7fe970155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe9782d5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9700b3c90 con 0x7fe97006f840 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe9782d5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe97006fe60 con 0x7fe970073370 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe9782d5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe9700b3e10 con 0x7fe9700cff70 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe976071640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe97006f840 0x7fe97014bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe976071640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe97006f840 0x7fe97014bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44948/0 (socket says 172.21.15.104:44948) 2024-09-17T02:55:40.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe976071640 1 -- 172.21.15.104:0/2874512438 learned_addr learned my addr 172.21.15.104:0/2874512438 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe975870640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe970073370 0x7fe97014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.823+0000 7fe976872640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9700cff70 0x7fe970155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe976071640 1 -- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9700cff70 msgr2=0x7fe970155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe976071640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9700cff70 0x7fe970155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe976071640 1 -- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe970073370 msgr2=0x7fe97014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe976071640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe970073370 0x7fe97014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe976071640 1 -- 172.21.15.104:0/2874512438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9701532d0 con 0x7fe97006f840 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe976872640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9700cff70 0x7fe970155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe976071640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe97006f840 0x7fe97014bce0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00e710 tx=0x7fe96c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:40.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe966ffd640 1 -- 172.21.15.104:0/2874512438 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c001a70 con 0x7fe97006f840 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe966ffd640 1 -- 172.21.15.104:0/2874512438 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe96c001d00 con 0x7fe97006f840 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9701535b0 con 0x7fe97006f840 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe966ffd640 1 -- 172.21.15.104:0/2874512438 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0116b0 con 0x7fe97006f840 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.824+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe970153b70 con 0x7fe97006f840 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.825+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe970072e30 con 0x7fe97006f840 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.826+0000 7fe966ffd640 1 -- 172.21.15.104:0/2874512438 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe96c011850 con 0x7fe97006f840 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.826+0000 7fe966ffd640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe954078bc0 0x7fe95407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.826+0000 7fe966ffd640 1 -- 172.21.15.104:0/2874512438 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe96c09d3f0 con 0x7fe97006f840 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.826+0000 7fe975870640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe954078bc0 0x7fe95407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:40.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.827+0000 7fe975870640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe954078bc0 0x7fe95407b0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe960034000 tx=0x7fe960004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:40.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:40.831+0000 7fe966ffd640 1 -- 172.21.15.104:0/2874512438 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe96c016030 con 0x7fe97006f840 2024-09-17T02:55:41.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.038+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9700b2fe0 con 0x7fe97006f840 2024-09-17T02:55:41.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.038+0000 7fe966ffd640 1 -- 172.21.15.104:0/2874512438 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5232 (secure 0 0 0) 0x7fe96c065830 con 0x7fe97006f840 2024-09-17T02:55:41.037 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:41.037 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:23.106277+0000","modified":"2024-09-17T02:55:25.113008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/477751550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":477751550},{"type":"v1","addr":"172.21.15.104:6835","nonce":477751550}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-09-17T02:55:41.037 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe954078bc0 msgr2=0x7fe95407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe954078bc0 0x7fe95407b0d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe960034000 tx=0x7fe960004730 comp rx=0 tx=0).stop 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe97006f840 msgr2=0x7fe97014bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe97006f840 0x7fe97014bce0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00e710 tx=0x7fe96c00ebd0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 shutdown_connections 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe954078bc0 0x7fe95407b0d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe970073370 0x7fe97014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9700cff70 0x7fe970155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 --2- 172.21.15.104:0/2874512438 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe97006f840 0x7fe97014bce0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 >> 172.21.15.104:0/2874512438 conn(0x7fe9700b2450 msgr2=0x7fe970075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:41.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 shutdown_connections 2024-09-17T02:55:41.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.041+0000 7fe9782d5640 1 -- 172.21.15.104:0/2874512438 wait complete. 2024-09-17T02:55:41.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:41.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.164+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/1144678890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b600053a0 msgr2=0x7f4b6000ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.164+0000 7f4b7ccf9640 1 --2- 172.21.15.104:0/1144678890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b600053a0 0x7f4b6000ba50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4b70005fd0 tx=0x7f4b60005830 comp rx=0 tx=0).stop 2024-09-17T02:55:41.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.165+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/1144678890 shutdown_connections 2024-09-17T02:55:41.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.165+0000 7f4b7ccf9640 1 --2- 172.21.15.104:0/1144678890 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b600053a0 0x7f4b6000ba50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.165+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/1144678890 >> 172.21.15.104:0/1144678890 conn(0x7f4b780d28a0 msgr2=0x7f4b780d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:41.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.165+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/1144678890 shutdown_connections 2024-09-17T02:55:41.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.165+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/1144678890 wait complete. 2024-09-17T02:55:41.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.166+0000 7f4b7ccf9640 1 Processor -- start 2024-09-17T02:55:41.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.167+0000 7f4b7ccf9640 1 -- start start 2024-09-17T02:55:41.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b7ccf9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b600053a0 0x7f4b781e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b7ccf9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b781df4f0 0x7f4b781f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b7ccf9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b781dc710 0x7f4b781e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b7ccf9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4b780ce010 con 0x7f4b781dc710 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b7ccf9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4b780cde90 con 0x7f4b600053a0 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b7ccf9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4b780ce190 con 0x7f4b781df4f0 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b781dc710 0x7f4b781e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b781dc710 0x7f4b781e77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44964/0 (socket says 172.21.15.104:44964) 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 -- 172.21.15.104:0/4245773505 learned_addr learned my addr 172.21.15.104:0/4245773505 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b7659c640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b600053a0 0x7f4b781e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b75d9b640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b781df4f0 0x7f4b781f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 -- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b781df4f0 msgr2=0x7f4b781f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b781df4f0 0x7f4b781f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 -- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b600053a0 msgr2=0x7f4b781e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b600053a0 0x7f4b781e2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 -- 172.21.15.104:0/4245773505 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b781e5b70 con 0x7f4b781dc710 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b7659c640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b600053a0 0x7f4b781e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b76d9d640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b781dc710 0x7f4b781e77e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4b7002aec0 tx=0x7f4b70033a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.168+0000 7f4b66ffd640 1 -- 172.21.15.104:0/4245773505 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70038040 con 0x7f4b781dc710 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.169+0000 7f4b66ffd640 1 -- 172.21.15.104:0/4245773505 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b70043070 con 0x7f4b781dc710 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.169+0000 7f4b66ffd640 1 -- 172.21.15.104:0/4245773505 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70009200 con 0x7f4b781dc710 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.169+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b781e2fb0 con 0x7f4b781dc710 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.169+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b781e62c0 con 0x7f4b781dc710 2024-09-17T02:55:41.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.169+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b780d09f0 con 0x7f4b781dc710 2024-09-17T02:55:41.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.170+0000 7f4b66ffd640 1 -- 172.21.15.104:0/4245773505 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b7003b070 con 0x7f4b781dc710 2024-09-17T02:55:41.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.171+0000 7f4b66ffd640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4b58078b90 0x7f4b5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.171+0000 7f4b66ffd640 1 -- 172.21.15.104:0/4245773505 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4b700bb9e0 con 0x7f4b781dc710 2024-09-17T02:55:41.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.171+0000 7f4b7659c640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4b58078b90 0x7f4b5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.172+0000 7f4b7659c640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4b58078b90 0x7f4b5807b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b68006fd0 tx=0x7f4b68006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:41.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.175+0000 7f4b66ffd640 1 -- 172.21.15.104:0/4245773505 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4b70083eb0 con 0x7f4b781dc710 2024-09-17T02:55:41.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.350+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b781e5d40 con 0x7f4b781dc710 2024-09-17T02:55:41.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.351+0000 7f4b66ffd640 1 -- 172.21.15.104:0/4245773505 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16777 (secure 0 0 0) 0x7f4b700837b0 con 0x7f4b781dc710 2024-09-17T02:55:41.350 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:41.350 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:37.802965+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:21.060997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:22.068496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:41.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4b58078b90 msgr2=0x7f4b5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4b58078b90 0x7f4b5807b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b68006fd0 tx=0x7f4b68006bc0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b781dc710 msgr2=0x7f4b781e77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b781dc710 0x7f4b781e77e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4b7002aec0 tx=0x7f4b70033a80 comp rx=0 tx=0).stop 2024-09-17T02:55:41.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 shutdown_connections 2024-09-17T02:55:41.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4b58078b90 0x7f4b5807b0a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4b781dc710 0x7f4b781e77e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b781df4f0 0x7f4b781f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 --2- 172.21.15.104:0/4245773505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b600053a0 0x7f4b781e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 >> 172.21.15.104:0/4245773505 conn(0x7f4b780d28a0 msgr2=0x7f4b780b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:41.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 shutdown_connections 2024-09-17T02:55:41.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.353+0000 7f4b7ccf9640 1 -- 172.21.15.104:0/4245773505 wait complete. 2024-09-17T02:55:41.364 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T02:55:41.364 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.478+0000 7fb015a84640 1 -- 172.21.15.104:0/3407304611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faff8004d40 msgr2=0x7faff8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.478+0000 7fb015a84640 1 --2- 172.21.15.104:0/3407304611 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faff8004d40 0x7faff8005190 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb0100d2870 tx=0x7faff8005830 comp rx=0 tx=0).stop 2024-09-17T02:55:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.478+0000 7fb00ffff640 1 -- 172.21.15.104:0/3407304611 reap_dead start 2024-09-17T02:55:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.478+0000 7fb015a84640 1 -- 172.21.15.104:0/3407304611 shutdown_connections 2024-09-17T02:55:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.478+0000 7fb015a84640 1 -- 172.21.15.104:0/3407304611 >> 172.21.15.104:0/3407304611 conn(0x7fb0100d28a0 msgr2=0x7fb0100d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:41.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.478+0000 7fb015a84640 1 -- 172.21.15.104:0/3407304611 shutdown_connections 2024-09-17T02:55:41.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.478+0000 7fb015a84640 1 -- 172.21.15.104:0/3407304611 wait complete. 2024-09-17T02:55:41.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.480+0000 7fb015a84640 1 Processor -- start 2024-09-17T02:55:41.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.480+0000 7fb015a84640 1 -- start start 2024-09-17T02:55:41.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.481+0000 7fb015a84640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0101ce800 0x7fb01009c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.481+0000 7fb015a84640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0101e1e70 0x7fb0101f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.481+0000 7fb015a84640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb010070700 0x7fb010070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.481+0000 7fb015a84640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb0100cfc50 con 0x7fb010070700 2024-09-17T02:55:41.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.481+0000 7fb015a84640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0100cfad0 con 0x7fb0101ce800 2024-09-17T02:55:41.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.481+0000 7fb015a84640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb0100cfdd0 con 0x7fb0101e1e70 2024-09-17T02:55:41.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb010070700 0x7fb010070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb010070700 0x7fb010070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44974/0 (socket says 172.21.15.104:44974) 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 -- 172.21.15.104:0/213929775 learned_addr learned my addr 172.21.15.104:0/213929775 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00f7fe640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0101ce800 0x7fb01009c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00effd640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0101e1e70 0x7fb0101f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 -- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0101e1e70 msgr2=0x7fb0101f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0101e1e70 0x7fb0101f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 -- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0101ce800 msgr2=0x7fb01009c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0101ce800 0x7fb01009c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 -- 172.21.15.104:0/213929775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb010071050 con 0x7fb010070700 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb00ffff640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb010070700 0x7fb010070b10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c700 tx=0x7fb008003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7faff7fff640 1 -- 172.21.15.104:0/213929775 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008039070 con 0x7fb010070700 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7faff7fff640 1 -- 172.21.15.104:0/213929775 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb00802ba70 con 0x7fb010070700 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0101d18b0 con 0x7fb010070700 2024-09-17T02:55:41.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7faff7fff640 1 -- 172.21.15.104:0/213929775 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008002030 con 0x7fb010070700 2024-09-17T02:55:41.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.482+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0101f6cf0 con 0x7fb010070700 2024-09-17T02:55:41.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.483+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0100d0c00 con 0x7fb010070700 2024-09-17T02:55:41.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.484+0000 7faff7fff640 1 -- 172.21.15.104:0/213929775 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb00803c020 con 0x7fb010070700 2024-09-17T02:55:41.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.484+0000 7faff7fff640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faffc078b90 0x7faffc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.484+0000 7faff7fff640 1 -- 172.21.15.104:0/213929775 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb0080ba9d0 con 0x7fb010070700 2024-09-17T02:55:41.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.485+0000 7fb00f7fe640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faffc078b90 0x7faffc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.485+0000 7fb00f7fe640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faffc078b90 0x7faffc07b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb0100d1360 tx=0x7fb000005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:41.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.489+0000 7faff7fff640 1 -- 172.21.15.104:0/213929775 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb010071050 con 0x7fb010070700 2024-09-17T02:55:41.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.697+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0100b2880 con 0x7fb010070700 2024-09-17T02:55:41.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.698+0000 7faff7fff640 1 -- 172.21.15.104:0/213929775 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5232 (secure 0 0 0) 0x7fb008083100 con 0x7fb010070700 2024-09-17T02:55:41.696 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:41.697 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:23.106277+0000","modified":"2024-09-17T02:55:25.113008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/477751550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":477751550},{"type":"v1","addr":"172.21.15.104:6835","nonce":477751550}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-09-17T02:55:41.697 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faffc078b90 msgr2=0x7faffc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faffc078b90 0x7faffc07b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb0100d1360 tx=0x7fb000005f30 comp rx=0 tx=0).stop 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb010070700 msgr2=0x7fb010070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb010070700 0x7fb010070b10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c700 tx=0x7fb008003c80 comp rx=0 tx=0).stop 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 shutdown_connections 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faffc078b90 0x7faffc07b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb010070700 0x7fb010070b10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0101e1e70 0x7fb0101f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 --2- 172.21.15.104:0/213929775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0101ce800 0x7fb01009c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 >> 172.21.15.104:0/213929775 conn(0x7fb0100d28a0 msgr2=0x7fb0100b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:41.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 shutdown_connections 2024-09-17T02:55:41.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.700+0000 7fb015a84640 1 -- 172.21.15.104:0/213929775 wait complete. 2024-09-17T02:55:41.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:41.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.825+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/1686394981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd18073c70 msgr2=0x7fcd1815c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.825+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/1686394981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd18073c70 0x7fcd1815c470 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcd18159c80 tx=0x7fcd1002a4a0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.825+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/1686394981 shutdown_connections 2024-09-17T02:55:41.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.825+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/1686394981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd18073c70 0x7fcd1815c470 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.825+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/1686394981 >> v2:172.21.15.192:3300/0 conn(0x7fcd18152cd0 0x7fcd180b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.825+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/1686394981 >> 172.21.15.104:0/1686394981 conn(0x7fcd180b35d0 msgr2=0x7fcd180b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:41.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.825+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/1686394981 shutdown_connections 2024-09-17T02:55:41.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.825+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/1686394981 wait complete. 2024-09-17T02:55:41.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.827+0000 7fcd1f5cc640 1 Processor -- start 2024-09-17T02:55:41.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.827+0000 7fcd1f5cc640 1 -- start start 2024-09-17T02:55:41.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.828+0000 7fcd1f5cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd18152cd0 0x7fcd18141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.828+0000 7fcd1f5cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd1815c060 0x7fcd181f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.828+0000 7fcd1f5cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd181f77a0 0x7fcd18068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.828+0000 7fcd1f5cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1806f790 con 0x7fcd181f77a0 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.828+0000 7fcd1f5cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1806f610 con 0x7fcd18152cd0 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.828+0000 7fcd1f5cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1806f910 con 0x7fcd1815c060 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd181f77a0 0x7fcd18068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd181f77a0 0x7fcd18068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44998/0 (socket says 172.21.15.104:44998) 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 -- 172.21.15.104:0/3505793063 learned_addr learned my addr 172.21.15.104:0/3505793063 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1d368640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd18152cd0 0x7fcd18141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1cb67640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd1815c060 0x7fcd181f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 -- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd1815c060 msgr2=0x7fcd181f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd1815c060 0x7fcd181f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 -- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd18152cd0 msgr2=0x7fcd18141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:41.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd18152cd0 0x7fcd18141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:41.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 -- 172.21.15.104:0/3505793063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd18141890 con 0x7fcd181f77a0 2024-09-17T02:55:41.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1db69640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd181f77a0 0x7fcd18068d00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcd10034040 tx=0x7fcd10003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:41.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd15ffb640 1 -- 172.21.15.104:0/3505793063 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1003e030 con 0x7fcd181f77a0 2024-09-17T02:55:41.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd15ffb640 1 -- 172.21.15.104:0/3505793063 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd10003e40 con 0x7fcd181f77a0 2024-09-17T02:55:41.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd181f7fb0 con 0x7fcd181f77a0 2024-09-17T02:55:41.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.829+0000 7fcd15ffb640 1 -- 172.21.15.104:0/3505793063 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10035040 con 0x7fcd181f77a0 2024-09-17T02:55:41.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.830+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd181f41a0 con 0x7fcd181f77a0 2024-09-17T02:55:41.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.831+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1806fe50 con 0x7fcd181f77a0 2024-09-17T02:55:41.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.831+0000 7fcd15ffb640 1 -- 172.21.15.104:0/3505793063 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd10041030 con 0x7fcd181f77a0 2024-09-17T02:55:41.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.832+0000 7fcd15ffb640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd04078b90 0x7fcd0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:41.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.832+0000 7fcd15ffb640 1 -- 172.21.15.104:0/3505793063 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcd100bb750 con 0x7fcd181f77a0 2024-09-17T02:55:41.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.832+0000 7fcd1d368640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd04078b90 0x7fcd0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:41.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.833+0000 7fcd1d368640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd04078b90 0x7fcd0407b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd08004630 tx=0x7fcd0800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:41.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:41.836+0000 7fcd15ffb640 1 -- 172.21.15.104:0/3505793063 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcd100835d0 con 0x7fcd181f77a0 2024-09-17T02:55:42.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.046+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd1814ca50 con 0x7fcd181f77a0 2024-09-17T02:55:42.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.047+0000 7fcd15ffb640 1 -- 172.21.15.104:0/3505793063 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5232 (secure 0 0 0) 0x7fcd10088000 con 0x7fcd181f77a0 2024-09-17T02:55:42.046 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:42.046 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":14,"btime":"2024-09-17T02:55:25:765287+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:23.106277+0000","modified":"2024-09-17T02:55:25.113008+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/477751550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":477751550},{"type":"v1","addr":"172.21.15.104:6835","nonce":477751550}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-09-17T02:55:42.046 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 14 2024-09-17T02:55:42.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd04078b90 msgr2=0x7fcd0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd04078b90 0x7fcd0407b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcd08004630 tx=0x7fcd0800b2e0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd181f77a0 msgr2=0x7fcd18068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd181f77a0 0x7fcd18068d00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcd10034040 tx=0x7fcd10003910 comp rx=0 tx=0).stop 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 shutdown_connections 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcd04078b90 0x7fcd0407b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcd181f77a0 0x7fcd18068d00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd1815c060 0x7fcd181f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 --2- 172.21.15.104:0/3505793063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd18152cd0 0x7fcd18141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.049+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 >> 172.21.15.104:0/3505793063 conn(0x7fcd180b35d0 msgr2=0x7fcd18073560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.050+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 shutdown_connections 2024-09-17T02:55:42.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.050+0000 7fcd1f5cc640 1 -- 172.21.15.104:0/3505793063 wait complete. 2024-09-17T02:55:42.059 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:42.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.172+0000 7eff42bc6640 1 -- 172.21.15.104:0/163109295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 msgr2=0x7eff3c0cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.172+0000 7eff42bc6640 1 --2- 172.21.15.104:0/163109295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 0x7eff3c0cf370 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0750a0 tx=0x7eff3802a560 comp rx=0 tx=0).stop 2024-09-17T02:55:42.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.172+0000 7eff42bc6640 1 -- 172.21.15.104:0/163109295 shutdown_connections 2024-09-17T02:55:42.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.172+0000 7eff42bc6640 1 --2- 172.21.15.104:0/163109295 >> v2:172.21.15.192:3300/0 conn(0x7eff3c0cf8b0 0x7eff3c0b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.172+0000 7eff42bc6640 1 --2- 172.21.15.104:0/163109295 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 0x7eff3c0cf370 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.172+0000 7eff42bc6640 1 -- 172.21.15.104:0/163109295 >> 172.21.15.104:0/163109295 conn(0x7eff3c0d2960 msgr2=0x7eff3c0d2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:42.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.173+0000 7eff42bc6640 1 -- 172.21.15.104:0/163109295 shutdown_connections 2024-09-17T02:55:42.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.173+0000 7eff42bc6640 1 -- 172.21.15.104:0/163109295 wait complete. 2024-09-17T02:55:42.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.174+0000 7eff42bc6640 1 Processor -- start 2024-09-17T02:55:42.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.174+0000 7eff42bc6640 1 -- start start 2024-09-17T02:55:42.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff42bc6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3c0b5cf0 0x7eff3c1f9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff42bc6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 0x7eff3c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff42bc6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3c0cf8b0 0x7eff3c1e9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff42bc6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c0b7af0 con 0x7eff3c0b7560 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff42bc6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7eff3c0b7970 con 0x7eff3c0cf8b0 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff42bc6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7eff3c0ce480 con 0x7eff3c0b5cf0 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 0x7eff3c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 0x7eff3c153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45016/0 (socket says 172.21.15.104:45016) 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 -- 172.21.15.104:0/1767390247 learned_addr learned my addr 172.21.15.104:0/1767390247 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 -- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3c0b5cf0 msgr2=0x7eff3c1f9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3c0b5cf0 0x7eff3c1f9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 -- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3c0cf8b0 msgr2=0x7eff3c1e9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff41163640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3c0cf8b0 0x7eff3c1e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3c0cf8b0 0x7eff3c1e9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 -- 172.21.15.104:0/1767390247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3c1fa2c0 con 0x7eff3c0b7560 2024-09-17T02:55:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.176+0000 7eff33fff640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 0x7eff3c153fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00d6a0 tx=0x7eff2c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.177+0000 7eff317fa640 1 -- 172.21.15.104:0/1767390247 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c017070 con 0x7eff3c0b7560 2024-09-17T02:55:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.177+0000 7eff317fa640 1 -- 172.21.15.104:0/1767390247 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff2c005310 con 0x7eff3c0b7560 2024-09-17T02:55:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.177+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3c1544e0 con 0x7eff3c0b7560 2024-09-17T02:55:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.177+0000 7eff317fa640 1 -- 172.21.15.104:0/1767390247 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c009820 con 0x7eff3c0b7560 2024-09-17T02:55:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.177+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3c0b9a60 con 0x7eff3c0b7560 2024-09-17T02:55:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.178+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff3c0b5ab0 con 0x7eff3c0b7560 2024-09-17T02:55:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.178+0000 7eff317fa640 1 -- 172.21.15.104:0/1767390247 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff2c0099c0 con 0x7eff3c0b7560 2024-09-17T02:55:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.179+0000 7eff317fa640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff28078b90 0x7eff2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.179+0000 7eff317fa640 1 -- 172.21.15.104:0/1767390247 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7eff2c09ae30 con 0x7eff3c0b7560 2024-09-17T02:55:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.179+0000 7eff40962640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff28078b90 0x7eff2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.180+0000 7eff40962640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff28078b90 0x7eff2807b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff38034000 tx=0x7eff380046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:42.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.184+0000 7eff317fa640 1 -- 172.21.15.104:0/1767390247 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff3c1544e0 con 0x7eff3c0b7560 2024-09-17T02:55:42.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.358+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff3c0b97b0 con 0x7eff3c0b7560 2024-09-17T02:55:42.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.359+0000 7eff317fa640 1 -- 172.21.15.104:0/1767390247 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16777 (secure 0 0 0) 0x7eff3c1fa2c0 con 0x7eff3c0b7560 2024-09-17T02:55:42.358 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:42.358 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:37.802965+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:21.060997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:22.068496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:42.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff28078b90 msgr2=0x7eff2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff28078b90 0x7eff2807b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff38034000 tx=0x7eff380046c0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 msgr2=0x7eff3c153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 0x7eff3c153fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00d6a0 tx=0x7eff2c00db60 comp rx=0 tx=0).stop 2024-09-17T02:55:42.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 shutdown_connections 2024-09-17T02:55:42.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff28078b90 0x7eff2807b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3c0cf8b0 0x7eff3c1e9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3c0b7560 0x7eff3c153fa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 --2- 172.21.15.104:0/1767390247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3c0b5cf0 0x7eff3c1f9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 >> 172.21.15.104:0/1767390247 conn(0x7eff3c0d2960 msgr2=0x7eff3c09d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:42.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 shutdown_connections 2024-09-17T02:55:42.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.361+0000 7eff42bc6640 1 -- 172.21.15.104:0/1767390247 wait complete. 2024-09-17T02:55:42.372 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T02:55:42.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.488+0000 7f42ab48c640 1 -- 172.21.15.104:0/4175102421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a40b0500 msgr2=0x7f42a40b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.488+0000 7f42ab48c640 1 --2- 172.21.15.104:0/4175102421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a40b0500 0x7f42a40b0910 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f42a40ce050 tx=0x7f429c02a5f0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.488+0000 7f42ab48c640 1 -- 172.21.15.104:0/4175102421 shutdown_connections 2024-09-17T02:55:42.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.488+0000 7f42ab48c640 1 --2- 172.21.15.104:0/4175102421 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a40b0500 0x7f42a40b0910 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.488+0000 7f42ab48c640 1 --2- 172.21.15.104:0/4175102421 >> v2:172.21.15.192:3300/0 conn(0x7f42a40734f0 0x7f42a4073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.488+0000 7f42ab48c640 1 -- 172.21.15.104:0/4175102421 >> 172.21.15.104:0/4175102421 conn(0x7f42a406d200 msgr2=0x7f42a406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:42.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.488+0000 7f42ab48c640 1 -- 172.21.15.104:0/4175102421 shutdown_connections 2024-09-17T02:55:42.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.488+0000 7f42ab48c640 1 -- 172.21.15.104:0/4175102421 wait complete. 2024-09-17T02:55:42.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.489+0000 7f42ab48c640 1 Processor -- start 2024-09-17T02:55:42.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.490+0000 7f42ab48c640 1 -- start start 2024-09-17T02:55:42.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42ab48c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a40734f0 0x7f42a413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42ab48c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42a40b0500 0x7f42a4142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42ab48c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a415c220 0x7f42a41f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42ab48c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f42a40b4f20 con 0x7f42a415c220 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42ab48c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f42a40b1200 con 0x7f42a40734f0 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42ab48c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f42a40b50a0 con 0x7f42a40b0500 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a415c220 0x7f42a41f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a415c220 0x7f42a41f7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45028/0 (socket says 172.21.15.104:45028) 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 -- 172.21.15.104:0/482654873 learned_addr learned my addr 172.21.15.104:0/482654873 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9228640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a40734f0 0x7f42a413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a8a27640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42a40b0500 0x7f42a4142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 -- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42a40b0500 msgr2=0x7f42a4142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42a40b0500 0x7f42a4142640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 -- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a40734f0 msgr2=0x7f42a413fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a40734f0 0x7f42a413fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 -- 172.21.15.104:0/482654873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a4140320 con 0x7f42a415c220 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a9a29640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a415c220 0x7f42a41f7d20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f429c034040 tx=0x7f429c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.491+0000 7f42a1ffb640 1 -- 172.21.15.104:0/482654873 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c03e030 con 0x7f42a415c220 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.492+0000 7f42a1ffb640 1 -- 172.21.15.104:0/482654873 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f429c003dd0 con 0x7f42a415c220 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.492+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a41f7540 con 0x7f42a415c220 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.492+0000 7f42a1ffb640 1 -- 172.21.15.104:0/482654873 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c035040 con 0x7f42a415c220 2024-09-17T02:55:42.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.492+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a41433c0 con 0x7f42a415c220 2024-09-17T02:55:42.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.493+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a4142e50 con 0x7f42a415c220 2024-09-17T02:55:42.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.494+0000 7f42a1ffb640 1 -- 172.21.15.104:0/482654873 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f429c041030 con 0x7f42a415c220 2024-09-17T02:55:42.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.494+0000 7f42a1ffb640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4290078b90 0x7f429007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.494+0000 7f42a1ffb640 1 -- 172.21.15.104:0/482654873 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f429c0bb440 con 0x7f42a415c220 2024-09-17T02:55:42.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.494+0000 7f42a9228640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4290078b90 0x7f429007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.495+0000 7f42a9228640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4290078b90 0x7f429007b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4294001e20 tx=0x7f4294009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:42.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.498+0000 7f42a1ffb640 1 -- 172.21.15.104:0/482654873 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42a4140320 con 0x7f42a415c220 2024-09-17T02:55:42.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.706+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f42a4073900 con 0x7f42a415c220 2024-09-17T02:55:42.705 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:55:42.707+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T02:55:42.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.709+0000 7f42a1ffb640 1 -- 172.21.15.104:0/482654873 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7f429c083230 con 0x7f42a415c220 2024-09-17T02:55:42.707 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4290078b90 msgr2=0x7f429007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4290078b90 0x7f429007b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4294001e20 tx=0x7f4294009040 comp rx=0 tx=0).stop 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a415c220 msgr2=0x7f42a41f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a415c220 0x7f42a41f7d20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f429c034040 tx=0x7f429c0038a0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 shutdown_connections 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4290078b90 0x7f429007b0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42a415c220 0x7f42a41f7d20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42a40b0500 0x7f42a4142640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 --2- 172.21.15.104:0/482654873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a40734f0 0x7f42a413fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 >> 172.21.15.104:0/482654873 conn(0x7f42a406d200 msgr2=0x7f42a4155ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:42.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 shutdown_connections 2024-09-17T02:55:42.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.711+0000 7f42ab48c640 1 -- 172.21.15.104:0/482654873 wait complete. 2024-09-17T02:55:42.714 INFO:tasks.ceph.mds.c.smithi104.stderr: -5544> 2024-09-17T02:55:28.731+0000 7fecd0151640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:55:42.725 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T02:55:42.772 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:55:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.844+0000 7f9b27157640 1 -- 172.21.15.104:0/3485066042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200cdf10 msgr2=0x7f9b200b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.844+0000 7f9b27157640 1 --2- 172.21.15.104:0/3485066042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200cdf10 0x7f9b200b57e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009830 tx=0x7f9b1402a510 comp rx=0 tx=0).stop 2024-09-17T02:55:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.844+0000 7f9b27157640 1 -- 172.21.15.104:0/3485066042 shutdown_connections 2024-09-17T02:55:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.844+0000 7f9b27157640 1 --2- 172.21.15.104:0/3485066042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b200b5d20 0x7f9b200cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.844+0000 7f9b27157640 1 --2- 172.21.15.104:0/3485066042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200cdf10 0x7f9b200b57e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.844+0000 7f9b27157640 1 -- 172.21.15.104:0/3485066042 >> 172.21.15.104:0/3485066042 conn(0x7f9b200b44a0 msgr2=0x7f9b200b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.844+0000 7f9b27157640 1 -- 172.21.15.104:0/3485066042 shutdown_connections 2024-09-17T02:55:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.844+0000 7f9b27157640 1 -- 172.21.15.104:0/3485066042 wait complete. 2024-09-17T02:55:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.846+0000 7f9b27157640 1 Processor -- start 2024-09-17T02:55:42.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.846+0000 7f9b27157640 1 -- start start 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b27157640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200b4fc0 0x7f9b20152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b27157640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b200b5d20 0x7f9b200b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b27157640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b200cdf10 0x7f9b2015fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b27157640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20160f50 con 0x7f9b200b4fc0 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b27157640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9b200d0210 con 0x7f9b200cdf10 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b27157640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9b201610d0 con 0x7f9b200b5d20 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b24ef3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200b4fc0 0x7f9b20152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b24ef3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200b4fc0 0x7f9b20152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45058/0 (socket says 172.21.15.104:45058) 2024-09-17T02:55:42.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b24ef3640 1 -- 172.21.15.104:0/2726366288 learned_addr learned my addr 172.21.15.104:0/2726366288 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b256f4640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b200cdf10 0x7f9b2015fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.847+0000 7f9b1ffff640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b200b5d20 0x7f9b200b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b24ef3640 1 -- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b200b5d20 msgr2=0x7f9b200b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b24ef3640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b200b5d20 0x7f9b200b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b24ef3640 1 -- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b200cdf10 msgr2=0x7f9b2015fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b24ef3640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b200cdf10 0x7f9b2015fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b24ef3640 1 -- 172.21.15.104:0/2726366288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b200b33a0 con 0x7f9b200b4fc0 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b24ef3640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200b4fc0 0x7f9b20152ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000c3f0 tx=0x7f9b1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b1d7fa640 1 -- 172.21.15.104:0/2726366288 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10017070 con 0x7f9b200b4fc0 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b1d7fa640 1 -- 172.21.15.104:0/2726366288 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b100035f0 con 0x7f9b200b4fc0 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b201f7100 con 0x7f9b200b4fc0 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b1d7fa640 1 -- 172.21.15.104:0/2726366288 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10003a40 con 0x7f9b200b4fc0 2024-09-17T02:55:42.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.848+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b201f76c0 con 0x7f9b200b4fc0 2024-09-17T02:55:42.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.849+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b200cfa80 con 0x7f9b200b4fc0 2024-09-17T02:55:42.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.850+0000 7f9b1d7fa640 1 -- 172.21.15.104:0/2726366288 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b1001a070 con 0x7f9b200b4fc0 2024-09-17T02:55:42.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.851+0000 7f9b1d7fa640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b0c078bc0 0x7f9b0c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:42.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.851+0000 7f9b1d7fa640 1 -- 172.21.15.104:0/2726366288 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f9b10099fe0 con 0x7f9b200b4fc0 2024-09-17T02:55:42.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.851+0000 7f9b1ffff640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b0c078bc0 0x7f9b0c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:42.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.851+0000 7f9b1ffff640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b0c078bc0 0x7f9b0c07b0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b14034000 tx=0x7f9b14004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:42.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:42.855+0000 7f9b1d7fa640 1 -- 172.21.15.104:0/2726366288 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b10061d70 con 0x7f9b200b4fc0 2024-09-17T02:55:43.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.065+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9b200cead0 con 0x7f9b200b4fc0 2024-09-17T02:55:43.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.710+0000 7f9b1d7fa640 1 -- 172.21.15.104:0/2726366288 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f9b100667a0 con 0x7f9b200b4fc0 2024-09-17T02:55:43.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b0c078bc0 msgr2=0x7f9b0c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:43.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b0c078bc0 0x7f9b0c07b0d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9b14034000 tx=0x7f9b14004730 comp rx=0 tx=0).stop 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200b4fc0 msgr2=0x7f9b20152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200b4fc0 0x7f9b20152ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000c3f0 tx=0x7f9b1000c8b0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 shutdown_connections 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b0c078bc0 0x7f9b0c07b0d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b200cdf10 0x7f9b2015fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b200b5d20 0x7f9b200b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 --2- 172.21.15.104:0/2726366288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b200b4fc0 0x7f9b20152ea0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 >> 172.21.15.104:0/2726366288 conn(0x7f9b200b44a0 msgr2=0x7f9b200b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 shutdown_connections 2024-09-17T02:55:43.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.713+0000 7f9b27157640 1 -- 172.21.15.104:0/2726366288 wait complete. 2024-09-17T02:55:43.724 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T02:55:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.846+0000 7f01b79da640 1 -- 172.21.15.104:0/225982852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 msgr2=0x7f01b00b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.846+0000 7f01b79da640 1 --2- 172.21.15.104:0/225982852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 0x7f01b00b29a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f01b00736e0 tx=0x7f01a002a560 comp rx=0 tx=0).stop 2024-09-17T02:55:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.846+0000 7f01b79da640 1 -- 172.21.15.104:0/225982852 shutdown_connections 2024-09-17T02:55:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.846+0000 7f01b79da640 1 --2- 172.21.15.104:0/225982852 >> v2:172.21.15.192:3300/0 conn(0x7f01b00d0840 0x7f01b00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.846+0000 7f01b79da640 1 --2- 172.21.15.104:0/225982852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 0x7f01b00b29a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.846+0000 7f01b79da640 1 -- 172.21.15.104:0/225982852 >> 172.21.15.104:0/225982852 conn(0x7f01b009ba40 msgr2=0x7f01b009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.846+0000 7f01b79da640 1 -- 172.21.15.104:0/225982852 shutdown_connections 2024-09-17T02:55:43.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.846+0000 7f01b79da640 1 -- 172.21.15.104:0/225982852 wait complete. 2024-09-17T02:55:43.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.848+0000 7f01b79da640 1 Processor -- start 2024-09-17T02:55:43.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.848+0000 7f01b79da640 1 -- start start 2024-09-17T02:55:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b79da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 0x7f01b00b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b79da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01b00d0840 0x7f01b0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b79da640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01b00d2660 0x7f01b01f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b79da640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f01b00cdfe0 con 0x7f01b00b3c90 2024-09-17T02:55:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b79da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f01b00cde60 con 0x7f01b00d0840 2024-09-17T02:55:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b79da640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f01b00ce160 con 0x7f01b00d2660 2024-09-17T02:55:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5776640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 0x7f01b00b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:43.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5776640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 0x7f01b00b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45068/0 (socket says 172.21.15.104:45068) 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5776640 1 -- 172.21.15.104:0/300560294 learned_addr learned my addr 172.21.15.104:0/300560294 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b4f75640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01b00d0840 0x7f01b0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5f77640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01b00d2660 0x7f01b01f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5776640 1 -- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01b00d2660 msgr2=0x7f01b01f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5776640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01b00d2660 0x7f01b01f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5776640 1 -- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01b00d0840 msgr2=0x7f01b0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5776640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01b00d0840 0x7f01b0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b5776640 1 -- 172.21.15.104:0/300560294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b00b2740 con 0x7f01b00b3c90 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.849+0000 7f01b4f75640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01b00d0840 0x7f01b0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:43.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.850+0000 7f01b5776640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 0x7f01b00b2200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f01a0000c00 tx=0x7f01a00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.850+0000 7f01adffb640 1 -- 172.21.15.104:0/300560294 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a003e030 con 0x7f01b00b3c90 2024-09-17T02:55:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.850+0000 7f01adffb640 1 -- 172.21.15.104:0/300560294 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01a00047a0 con 0x7f01b00b3c90 2024-09-17T02:55:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.850+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b0156ea0 con 0x7f01b00b3c90 2024-09-17T02:55:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.850+0000 7f01adffb640 1 -- 172.21.15.104:0/300560294 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0035040 con 0x7f01b00b3c90 2024-09-17T02:55:43.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.850+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b01594a0 con 0x7f01b00b3c90 2024-09-17T02:55:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.851+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b00ce6b0 con 0x7f01b00b3c90 2024-09-17T02:55:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.852+0000 7f01adffb640 1 -- 172.21.15.104:0/300560294 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01a0041030 con 0x7f01b00b3c90 2024-09-17T02:55:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.852+0000 7f01adffb640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f019c078bc0 0x7f019c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.852+0000 7f01adffb640 1 -- 172.21.15.104:0/300560294 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f01a00bb610 con 0x7f01b00b3c90 2024-09-17T02:55:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.852+0000 7f01b4f75640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f019c078bc0 0x7f019c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:43.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.853+0000 7f01b4f75640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f019c078bc0 0x7f019c07b0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01b015f160 tx=0x7f01a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:43.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:43.857+0000 7f01adffb640 1 -- 172.21.15.104:0/300560294 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01b00b2740 con 0x7f01b00b3c90 2024-09-17T02:55:44.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.032+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f01b0070bd0 con 0x7f01b00b3c90 2024-09-17T02:55:44.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.833+0000 7f01adffb640 1 -- 172.21.15.104:0/300560294 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f01a0083a90 con 0x7f01b00b3c90 2024-09-17T02:55:44.833 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f019c078bc0 msgr2=0x7f019c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f019c078bc0 0x7f019c07b0d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01b015f160 tx=0x7f01a4008040 comp rx=0 tx=0).stop 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 msgr2=0x7f01b00b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 0x7f01b00b2200 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f01a0000c00 tx=0x7f01a00039e0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 shutdown_connections 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f019c078bc0 0x7f019c07b0d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01b00d0840 0x7f01b0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01b00d2660 0x7f01b01f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 --2- 172.21.15.104:0/300560294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01b00b3c90 0x7f01b00b2200 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 >> 172.21.15.104:0/300560294 conn(0x7f01b009ba40 msgr2=0x7f01b00c8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 shutdown_connections 2024-09-17T02:55:44.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.836+0000 7f01b79da640 1 -- 172.21.15.104:0/300560294 wait complete. 2024-09-17T02:55:44.850 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T02:55:44.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.975+0000 7f424d769640 1 -- 172.21.15.104:0/4189450501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4248074d60 msgr2=0x7f424815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:44.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.975+0000 7f424d769640 1 --2- 172.21.15.104:0/4189450501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4248074d60 0x7f424815bf50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4238009830 tx=0x7f423802a510 comp rx=0 tx=0).stop 2024-09-17T02:55:44.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.975+0000 7f424d769640 1 -- 172.21.15.104:0/4189450501 shutdown_connections 2024-09-17T02:55:44.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.975+0000 7f424d769640 1 --2- 172.21.15.104:0/4189450501 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42480766b0 0x7f42480b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.975+0000 7f424d769640 1 --2- 172.21.15.104:0/4189450501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4248074d60 0x7f424815bf50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.975+0000 7f424d769640 1 -- 172.21.15.104:0/4189450501 >> 172.21.15.104:0/4189450501 conn(0x7f4248074240 msgr2=0x7f4248074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:44.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.975+0000 7f424d769640 1 -- 172.21.15.104:0/4189450501 shutdown_connections 2024-09-17T02:55:44.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.975+0000 7f424d769640 1 -- 172.21.15.104:0/4189450501 wait complete. 2024-09-17T02:55:44.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.977+0000 7f424d769640 1 Processor -- start 2024-09-17T02:55:44.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.977+0000 7f424d769640 1 -- start start 2024-09-17T02:55:44.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.978+0000 7f424d769640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4248074d60 0x7f42480aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:44.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.978+0000 7f424d769640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42480766b0 0x7f42480d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:44.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.978+0000 7f424d769640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42480b4600 0x7f42480d1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:44.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.978+0000 7f424d769640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4248160140 con 0x7f42480766b0 2024-09-17T02:55:44.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.978+0000 7f424d769640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f424815e920 con 0x7f4248074d60 2024-09-17T02:55:44.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.978+0000 7f424d769640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f42481602c0 con 0x7f42480b4600 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42480766b0 0x7f42480d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42480766b0 0x7f42480d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45290/0 (socket says 172.21.15.104:45290) 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 -- 172.21.15.104:0/3653491875 learned_addr learned my addr 172.21.15.104:0/3653491875 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f4246ffd640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4248074d60 0x7f42480aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f42477fe640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42480b4600 0x7f42480d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 -- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42480b4600 msgr2=0x7f42480d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42480b4600 0x7f42480d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 -- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4248074d60 msgr2=0x7f42480aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4248074d60 0x7f42480aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 -- 172.21.15.104:0/3653491875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42480aefc0 con 0x7f42480766b0 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f42477fe640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42480b4600 0x7f42480d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423ffff640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42480766b0 0x7f42480d1110 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f423000d6a0 tx=0x7f423000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:44.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423f7fe640 1 -- 172.21.15.104:0/3653491875 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230017070 con 0x7f42480766b0 2024-09-17T02:55:44.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423f7fe640 1 -- 172.21.15.104:0/3653491875 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4230009b10 con 0x7f42480766b0 2024-09-17T02:55:44.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42481457b0 con 0x7f42480766b0 2024-09-17T02:55:44.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f423f7fe640 1 -- 172.21.15.104:0/3653491875 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230010460 con 0x7f42480766b0 2024-09-17T02:55:44.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.979+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4248145d70 con 0x7f42480766b0 2024-09-17T02:55:44.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.980+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42480b61b0 con 0x7f42480766b0 2024-09-17T02:55:44.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.981+0000 7f423f7fe640 1 -- 172.21.15.104:0/3653491875 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f423001a070 con 0x7f42480766b0 2024-09-17T02:55:44.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.981+0000 7f423f7fe640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4228078b90 0x7f422807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:44.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.982+0000 7f423f7fe640 1 -- 172.21.15.104:0/3653491875 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f423009abc0 con 0x7f42480766b0 2024-09-17T02:55:44.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.982+0000 7f4246ffd640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4228078b90 0x7f422807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:44.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.982+0000 7f4246ffd640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4228078b90 0x7f422807b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4238034000 tx=0x7f4238004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:44.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:44.986+0000 7f423f7fe640 1 -- 172.21.15.104:0/3653491875 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42480b61b0 con 0x7f42480766b0 2024-09-17T02:55:45.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.159+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42481f8530 con 0x7f42480766b0 2024-09-17T02:55:45.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.839+0000 7f423f7fe640 1 -- 172.21.15.104:0/3653491875 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f4230062ba0 con 0x7f42480766b0 2024-09-17T02:55:45.838 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T02:55:45.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.842+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4228078b90 msgr2=0x7f422807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.842+0000 7f424d769640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4228078b90 0x7f422807b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4238034000 tx=0x7f4238004730 comp rx=0 tx=0).stop 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.842+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42480766b0 msgr2=0x7f42480d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.842+0000 7f424d769640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42480766b0 0x7f42480d1110 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f423000d6a0 tx=0x7f423000db60 comp rx=0 tx=0).stop 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.843+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 shutdown_connections 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.843+0000 7f424d769640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4228078b90 0x7f422807b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.843+0000 7f424d769640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42480b4600 0x7f42480d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.843+0000 7f424d769640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42480766b0 0x7f42480d1110 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.843+0000 7f424d769640 1 --2- 172.21.15.104:0/3653491875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4248074d60 0x7f42480aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.843+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 >> 172.21.15.104:0/3653491875 conn(0x7f4248074240 msgr2=0x7f424806eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.843+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 shutdown_connections 2024-09-17T02:55:45.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.843+0000 7f424d769640 1 -- 172.21.15.104:0/3653491875 wait complete. 2024-09-17T02:55:45.856 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T02:55:45.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.974+0000 7fdbd80be640 1 -- 172.21.15.104:0/898125140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbb8003a50 msgr2=0x7fdbb8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:45.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.974+0000 7fdbd80be640 1 --2- 172.21.15.104:0/898125140 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbb8003a50 0x7fdbb8003ec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009b50 tx=0x7fdbb8005830 comp rx=0 tx=0).stop 2024-09-17T02:55:45.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.974+0000 7fdbd665b640 1 -- 172.21.15.104:0/898125140 reap_dead start 2024-09-17T02:55:45.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.974+0000 7fdbd80be640 1 -- 172.21.15.104:0/898125140 shutdown_connections 2024-09-17T02:55:45.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.974+0000 7fdbd80be640 1 -- 172.21.15.104:0/898125140 >> 172.21.15.104:0/898125140 conn(0x7fdbd006eb90 msgr2=0x7fdbd006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:45.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.974+0000 7fdbd80be640 1 -- 172.21.15.104:0/898125140 shutdown_connections 2024-09-17T02:55:45.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.974+0000 7fdbd80be640 1 -- 172.21.15.104:0/898125140 wait complete. 2024-09-17T02:55:45.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.976+0000 7fdbd80be640 1 Processor -- start 2024-09-17T02:55:45.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.976+0000 7fdbd80be640 1 -- start start 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.977+0000 7fdbd80be640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb8003a50 0x7fdbd0155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.977+0000 7fdbd80be640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd013f3c0 0x7fdbd01577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.977+0000 7fdbd80be640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd013f7d0 0x7fdbd0157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.977+0000 7fdbd80be640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd00cd770 con 0x7fdbd013f3c0 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.977+0000 7fdbd80be640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd015d0c0 con 0x7fdbb8003a50 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd80be640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd00cd8f0 con 0x7fdbd013f7d0 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd013f3c0 0x7fdbd01577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd013f3c0 0x7fdbd01577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45310/0 (socket says 172.21.15.104:45310) 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 -- 172.21.15.104:0/2679044678 learned_addr learned my addr 172.21.15.104:0/2679044678 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5e5a640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb8003a50 0x7fdbd0155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd665b640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd013f7d0 0x7fdbd0157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:45.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 -- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd013f7d0 msgr2=0x7fdbd0157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd013f7d0 0x7fdbd0157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 -- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb8003a50 msgr2=0x7fdbd0155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb8003a50 0x7fdbd0155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 -- 172.21.15.104:0/2679044678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd0140110 con 0x7fdbd013f3c0 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd665b640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd013f7d0 0x7fdbd0157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd5659640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd013f3c0 0x7fdbd01577f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4011850 tx=0x7fdbc4011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbce7fc640 1 -- 172.21.15.104:0/2679044678 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4004460 con 0x7fdbd013f3c0 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbce7fc640 1 -- 172.21.15.104:0/2679044678 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbc4016070 con 0x7fdbd013f3c0 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd013fe30 con 0x7fdbd013f3c0 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbce7fc640 1 -- 172.21.15.104:0/2679044678 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400fd30 con 0x7fdbd013f3c0 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.978+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd014b8b0 con 0x7fdbd013f3c0 2024-09-17T02:55:45.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.979+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd0156200 con 0x7fdbd013f3c0 2024-09-17T02:55:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.980+0000 7fdbce7fc640 1 -- 172.21.15.104:0/2679044678 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbc4018030 con 0x7fdbd013f3c0 2024-09-17T02:55:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.981+0000 7fdbce7fc640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.981+0000 7fdbce7fc640 1 -- 172.21.15.104:0/2679044678 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fdbc409b900 con 0x7fdbd013f3c0 2024-09-17T02:55:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.981+0000 7fdbd5e5a640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:45.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.981+0000 7fdbd5e5a640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0035000 tx=0x7fdbc002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:45.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:45.984+0000 7fdbce7fc640 1 -- 172.21.15.104:0/2679044678 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbc4063bf0 con 0x7fdbd013f3c0 2024-09-17T02:55:46.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.158+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7fdbd015ac80 con 0x7fdbd013f3c0 2024-09-17T02:55:46.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.163+0000 7fdbce7fc640 1 -- 172.21.15.104:0/2679044678 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v25) ==== 71+0+0 (secure 0 0 0) 0x7fdbc4068620 con 0x7fdbd013f3c0 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbbc078b90 msgr2=0x7fdbbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0035000 tx=0x7fdbc002d040 comp rx=0 tx=0).stop 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd013f3c0 msgr2=0x7fdbd01577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd013f3c0 0x7fdbd01577f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4011850 tx=0x7fdbc4011d10 comp rx=0 tx=0).stop 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 shutdown_connections 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbbc078b90 0x7fdbbc07b0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbd013f7d0 0x7fdbd0157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbd013f3c0 0x7fdbd01577f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 --2- 172.21.15.104:0/2679044678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb8003a50 0x7fdbd0155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 >> 172.21.15.104:0/2679044678 conn(0x7fdbd006eb90 msgr2=0x7fdbd00b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:46.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 shutdown_connections 2024-09-17T02:55:46.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.165+0000 7fdbd80be640 1 -- 172.21.15.104:0/2679044678 wait complete. 2024-09-17T02:55:46.176 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-17T02:55:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.288+0000 7f39572ec640 1 -- 172.21.15.104:0/4027637065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f395015b7f0 msgr2=0x7f395015bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.288+0000 7f39572ec640 1 --2- 172.21.15.104:0/4027637065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f395015b7f0 0x7f395015bc00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f395006ecb0 tx=0x7f394c02aa00 comp rx=0 tx=0).stop 2024-09-17T02:55:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.288+0000 7f39572ec640 1 -- 172.21.15.104:0/4027637065 shutdown_connections 2024-09-17T02:55:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.288+0000 7f39572ec640 1 --2- 172.21.15.104:0/4027637065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3950072470 0x7f3950072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.288+0000 7f39572ec640 1 --2- 172.21.15.104:0/4027637065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f395015b7f0 0x7f395015bc00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.288+0000 7f39572ec640 1 -- 172.21.15.104:0/4027637065 >> 172.21.15.104:0/4027637065 conn(0x7f39500b2450 msgr2=0x7f39500b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:46.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.288+0000 7f39572ec640 1 -- 172.21.15.104:0/4027637065 shutdown_connections 2024-09-17T02:55:46.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.288+0000 7f39572ec640 1 -- 172.21.15.104:0/4027637065 wait complete. 2024-09-17T02:55:46.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.290+0000 7f39572ec640 1 Processor -- start 2024-09-17T02:55:46.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.290+0000 7f39572ec640 1 -- start start 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f39572ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3950072470 0x7f39500ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f39572ec640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3950072dc0 0x7f3950149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f39572ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395015b7f0 0x7f395006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f39572ec640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f395015fe30 con 0x7f3950072470 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f39572ec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39500cf4a0 con 0x7f395015b7f0 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f39572ec640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f395015ffb0 con 0x7f3950072dc0 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955088640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3950072470 0x7f39500ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955088640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3950072470 0x7f39500ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45326/0 (socket says 172.21.15.104:45326) 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955088640 1 -- 172.21.15.104:0/202503056 learned_addr learned my addr 172.21.15.104:0/202503056 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3954887640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3950072dc0 0x7f3950149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955889640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395015b7f0 0x7f395006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:46.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955088640 1 -- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3950072dc0 msgr2=0x7f3950149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955088640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3950072dc0 0x7f3950149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955088640 1 -- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395015b7f0 msgr2=0x7f395006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955088640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395015b7f0 0x7f395006ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.291+0000 7f3955088640 1 -- 172.21.15.104:0/202503056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3950147eb0 con 0x7f3950072470 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.292+0000 7f3955088640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3950072470 0x7f39500ae030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f394c02aff0 tx=0x7f394c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.292+0000 7f3945ffb640 1 -- 172.21.15.104:0/202503056 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c033050 con 0x7f3950072470 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.292+0000 7f3945ffb640 1 -- 172.21.15.104:0/202503056 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f394c0044f0 con 0x7f3950072470 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.292+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3950148190 con 0x7f3950072470 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.292+0000 7f3945ffb640 1 -- 172.21.15.104:0/202503056 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c038450 con 0x7f3950072470 2024-09-17T02:55:46.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.292+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395014a5a0 con 0x7f3950072470 2024-09-17T02:55:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.293+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3950148360 con 0x7f3950072470 2024-09-17T02:55:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.294+0000 7f3945ffb640 1 -- 172.21.15.104:0/202503056 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f394c036070 con 0x7f3950072470 2024-09-17T02:55:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.294+0000 7f3945ffb640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3934078bc0 0x7f393407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.294+0000 7f3945ffb640 1 -- 172.21.15.104:0/202503056 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f394c0bbee0 con 0x7f3950072470 2024-09-17T02:55:46.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.295+0000 7f3954887640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3934078bc0 0x7f393407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:46.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.295+0000 7f3954887640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3934078bc0 0x7f393407b0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39400058c0 tx=0x7f3940005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:46.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.299+0000 7f3945ffb640 1 -- 172.21.15.104:0/202503056 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3950147eb0 con 0x7f3950072470 2024-09-17T02:55:46.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.547+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7f39501604f0 con 0x7f3950072470 2024-09-17T02:55:46.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.840+0000 7f3945ffb640 1 -- 172.21.15.104:0/202503056 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v76) ==== 130+0+0 (secure 0 0 0) 0x7f394c0846b0 con 0x7f3950072470 2024-09-17T02:55:46.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.842+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3934078bc0 msgr2=0x7f393407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.842+0000 7f39572ec640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3934078bc0 0x7f393407b0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39400058c0 tx=0x7f3940005850 comp rx=0 tx=0).stop 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.842+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3950072470 msgr2=0x7f39500ae030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.842+0000 7f39572ec640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3950072470 0x7f39500ae030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f394c02aff0 tx=0x7f394c003f90 comp rx=0 tx=0).stop 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.843+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 shutdown_connections 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.843+0000 7f39572ec640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3934078bc0 0x7f393407b0d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.843+0000 7f39572ec640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f395015b7f0 0x7f395006ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.843+0000 7f39572ec640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3950072dc0 0x7f3950149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.843+0000 7f39572ec640 1 --2- 172.21.15.104:0/202503056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3950072470 0x7f39500ae030 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.843+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 >> 172.21.15.104:0/202503056 conn(0x7f39500b2450 msgr2=0x7f39500b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.843+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 shutdown_connections 2024-09-17T02:55:46.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.843+0000 7f39572ec640 1 -- 172.21.15.104:0/202503056 wait complete. 2024-09-17T02:55:46.859 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-17T02:55:46.859 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-17T02:55:46.859 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:46.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 -- 172.21.15.104:0/3939237520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 msgr2=0x7f5d8815f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 --2- 172.21.15.104:0/3939237520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 0x7f5d8815f690 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5d8806a1e0 tx=0x7f5d7802a580 comp rx=0 tx=0).stop 2024-09-17T02:55:46.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 -- 172.21.15.104:0/3939237520 shutdown_connections 2024-09-17T02:55:46.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 --2- 172.21.15.104:0/3939237520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 0x7f5d8815f690 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 --2- 172.21.15.104:0/3939237520 >> v2:172.21.15.192:3300/0 conn(0x7f5d8806fa80 0x7f5d88073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 --2- 172.21.15.104:0/3939237520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d88152ce0 0x7f5d8806f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 -- 172.21.15.104:0/3939237520 >> 172.21.15.104:0/3939237520 conn(0x7f5d880b3640 msgr2=0x7f5d880b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 -- 172.21.15.104:0/3939237520 shutdown_connections 2024-09-17T02:55:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.970+0000 7f5d8df19640 1 -- 172.21.15.104:0/3939237520 wait complete. 2024-09-17T02:55:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.972+0000 7f5d8df19640 1 Processor -- start 2024-09-17T02:55:46.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.972+0000 7f5d8df19640 1 -- start start 2024-09-17T02:55:46.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.973+0000 7f5d8df19640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8806fa80 0x7f5d8813d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:46.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.973+0000 7f5d8df19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 0x7f5d8815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:46.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.973+0000 7f5d8df19640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d88152ce0 0x7f5d8815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:46.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.973+0000 7f5d8df19640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8815ff60 con 0x7f5d88073ac0 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.973+0000 7f5d8df19640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8815fde0 con 0x7f5d8806fa80 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.973+0000 7f5d8df19640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5d881600e0 con 0x7f5d88152ce0 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 0x7f5d8815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 0x7f5d8815ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45332/0 (socket says 172.21.15.104:45332) 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 -- 172.21.15.104:0/2816197255 learned_addr learned my addr 172.21.15.104:0/2816197255 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d877fe640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8806fa80 0x7f5d8813d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d87fff640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d88152ce0 0x7f5d8815b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 -- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d88152ce0 msgr2=0x7f5d8815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d88152ce0 0x7f5d8815b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 -- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8806fa80 msgr2=0x7f5d8813d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8806fa80 0x7f5d8813d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 -- 172.21.15.104:0/2816197255 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d88155320 con 0x7f5d88073ac0 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d87fff640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d88152ce0 0x7f5d8815b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:46.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d86ffd640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 0x7f5d8815ab70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000b410 tx=0x7f5d70009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:46.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d7ffff640 1 -- 172.21.15.104:0/2816197255 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70015020 con 0x7f5d88073ac0 2024-09-17T02:55:46.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d7ffff640 1 -- 172.21.15.104:0/2816197255 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d70011920 con 0x7f5d88073ac0 2024-09-17T02:55:46.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d88155600 con 0x7f5d88073ac0 2024-09-17T02:55:46.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d7ffff640 1 -- 172.21.15.104:0/2816197255 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70011d70 con 0x7f5d88073ac0 2024-09-17T02:55:46.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.974+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d881668b0 con 0x7f5d88073ac0 2024-09-17T02:55:46.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.975+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8815f690 con 0x7f5d88073ac0 2024-09-17T02:55:46.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.976+0000 7f5d7ffff640 1 -- 172.21.15.104:0/2816197255 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d70018020 con 0x7f5d88073ac0 2024-09-17T02:55:46.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.977+0000 7f5d7ffff640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d68078b90 0x7f5d6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:46.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.977+0000 7f5d7ffff640 1 -- 172.21.15.104:0/2816197255 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f5d7009a8d0 con 0x7f5d88073ac0 2024-09-17T02:55:46.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.977+0000 7f5d877fe640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d68078b90 0x7f5d6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:46.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.978+0000 7f5d877fe640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d68078b90 0x7f5d6807b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d88073380 tx=0x7f5d8000a590 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:46.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:46.981+0000 7f5d7ffff640 1 -- 172.21.15.104:0/2816197255 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5d7001f020 con 0x7f5d88073ac0 2024-09-17T02:55:47.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.155+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d880d2570 con 0x7f5d88073ac0 2024-09-17T02:55:47.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.156+0000 7f5d7ffff640 1 -- 172.21.15.104:0/2816197255 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13080 (secure 0 0 0) 0x7f5d70063010 con 0x7f5d88073ac0 2024-09-17T02:55:47.156 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:47.156 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":37,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:45.834925+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/477751550":"2024-09-18T02:55:42.707265+0000","172.21.15.104:6833/477751550":"2024-09-18T02:55:42.707265+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:47.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d68078b90 msgr2=0x7f5d6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d68078b90 0x7f5d6807b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d88073380 tx=0x7f5d8000a590 comp rx=0 tx=0).stop 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 msgr2=0x7f5d8815ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 0x7f5d8815ab70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000b410 tx=0x7f5d70009f90 comp rx=0 tx=0).stop 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 shutdown_connections 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d68078b90 0x7f5d6807b0a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d88152ce0 0x7f5d8815b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d88073ac0 0x7f5d8815ab70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 --2- 172.21.15.104:0/2816197255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8806fa80 0x7f5d8813d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 >> 172.21.15.104:0/2816197255 conn(0x7f5d880b3640 msgr2=0x7f5d8815e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.158+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 shutdown_connections 2024-09-17T02:55:47.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.159+0000 7f5d8df19640 1 -- 172.21.15.104:0/2816197255 wait complete. 2024-09-17T02:55:47.169 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T02:55:47.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T02:55:47.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.285+0000 7f1ae32fa640 1 -- 172.21.15.104:0/1876038441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc161170 msgr2=0x7f1adc161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.285+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/1876038441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc161170 0x7f1adc161580 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0743d0 tx=0x7f1acc02a530 comp rx=0 tx=0).stop 2024-09-17T02:55:47.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.285+0000 7f1ae32fa640 1 -- 172.21.15.104:0/1876038441 shutdown_connections 2024-09-17T02:55:47.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.285+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/1876038441 >> v2:172.21.15.192:3300/0 conn(0x7f1adc161ac0 0x7f1adc0b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.285+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/1876038441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc161170 0x7f1adc161580 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.285+0000 7f1ae32fa640 1 -- 172.21.15.104:0/1876038441 >> 172.21.15.104:0/1876038441 conn(0x7f1adc0b4400 msgr2=0x7f1adc0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:47.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.285+0000 7f1ae32fa640 1 -- 172.21.15.104:0/1876038441 shutdown_connections 2024-09-17T02:55:47.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.285+0000 7f1ae32fa640 1 -- 172.21.15.104:0/1876038441 wait complete. 2024-09-17T02:55:47.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.287+0000 7f1ae32fa640 1 Processor -- start 2024-09-17T02:55:47.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.287+0000 7f1ae32fa640 1 -- start start 2024-09-17T02:55:47.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae32fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc0b7c00 0x7f1adc0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:47.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae32fa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1adc161170 0x7f1adc151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:47.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae32fa640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1adc161ac0 0x7f1adc15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:47.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae32fa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc0b52b0 con 0x7f1adc0b7c00 2024-09-17T02:55:47.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae32fa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1adc0b5130 con 0x7f1adc161170 2024-09-17T02:55:47.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae32fa640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1adc0b6d20 con 0x7f1adc161ac0 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae1096640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc0b7c00 0x7f1adc0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae1096640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc0b7c00 0x7f1adc0cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45360/0 (socket says 172.21.15.104:45360) 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.288+0000 7f1ae1096640 1 -- 172.21.15.104:0/631358902 learned_addr learned my addr 172.21.15.104:0/631358902 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae0895640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1adc161170 0x7f1adc151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae1897640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1adc161ac0 0x7f1adc15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae1096640 1 -- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1adc161ac0 msgr2=0x7f1adc15b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae1096640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1adc161ac0 0x7f1adc15b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae1096640 1 -- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1adc161170 msgr2=0x7f1adc151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae1096640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1adc161170 0x7f1adc151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae1096640 1 -- 172.21.15.104:0/631358902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1adc15eec0 con 0x7f1adc0b7c00 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae1096640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc0b7c00 0x7f1adc0cf840 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c430 tx=0x7f1ad800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ad1ffb640 1 -- 172.21.15.104:0/631358902 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8017070 con 0x7f1adc0b7c00 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ad1ffb640 1 -- 172.21.15.104:0/631358902 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ad80035f0 con 0x7f1adc0b7c00 2024-09-17T02:55:47.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ad1ffb640 1 -- 172.21.15.104:0/631358902 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8003a40 con 0x7f1adc0b7c00 2024-09-17T02:55:47.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1adc15f1a0 con 0x7f1adc0b7c00 2024-09-17T02:55:47.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.289+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1adc15f760 con 0x7f1adc0b7c00 2024-09-17T02:55:47.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.290+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1adc161580 con 0x7f1adc0b7c00 2024-09-17T02:55:47.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.291+0000 7f1ad1ffb640 1 -- 172.21.15.104:0/631358902 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ad801a070 con 0x7f1adc0b7c00 2024-09-17T02:55:47.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.291+0000 7f1ad1ffb640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ac0078bc0 0x7f1ac007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:47.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.291+0000 7f1ad1ffb640 1 -- 172.21.15.104:0/631358902 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f1ad8099ca0 con 0x7f1adc0b7c00 2024-09-17T02:55:47.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.292+0000 7f1ae0895640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ac0078bc0 0x7f1ac007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:47.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.292+0000 7f1ae0895640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ac0078bc0 0x7f1ac007b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1acc034000 tx=0x7f1acc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:47.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.296+0000 7f1ad1ffb640 1 -- 172.21.15.104:0/631358902 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1ad80623e0 con 0x7f1adc0b7c00 2024-09-17T02:55:47.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.470+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1adc0b2280 con 0x7f1adc0b7c00 2024-09-17T02:55:47.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.471+0000 7f1ad1ffb640 1 -- 172.21.15.104:0/631358902 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f1ad8061ce0 con 0x7f1adc0b7c00 2024-09-17T02:55:47.471 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T02:55:47.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ac0078bc0 msgr2=0x7f1ac007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ac0078bc0 0x7f1ac007b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1acc034000 tx=0x7f1acc004730 comp rx=0 tx=0).stop 2024-09-17T02:55:47.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc0b7c00 msgr2=0x7f1adc0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc0b7c00 0x7f1adc0cf840 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1ad800c430 tx=0x7f1ad800c8f0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 shutdown_connections 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ac0078bc0 0x7f1ac007b0d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1adc161170 0x7f1adc151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1adc161ac0 0x7f1adc15b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 --2- 172.21.15.104:0/631358902 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1adc0b7c00 0x7f1adc0cf840 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 >> 172.21.15.104:0/631358902 conn(0x7f1adc0b4400 msgr2=0x7f1adc152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.473+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 shutdown_connections 2024-09-17T02:55:47.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.474+0000 7f1ae32fa640 1 -- 172.21.15.104:0/631358902 wait complete. 2024-09-17T02:55:47.485 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-17T02:55:47.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.597+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/86179938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 msgr2=0x7f1d540cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.597+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/86179938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 0x7f1d540cfa80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1d540a0a60 tx=0x7f1d4c02aa30 comp rx=0 tx=0).stop 2024-09-17T02:55:47.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.597+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/86179938 shutdown_connections 2024-09-17T02:55:47.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.597+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/86179938 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 0x7f1d540cfa80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.597+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/86179938 >> v2:172.21.15.192:3300/0 conn(0x7f1d540cdf10 0x7f1d540b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.597+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/86179938 >> 172.21.15.104:0/86179938 conn(0x7f1d540b44a0 msgr2=0x7f1d540b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:47.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.597+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/86179938 shutdown_connections 2024-09-17T02:55:47.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.597+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/86179938 wait complete. 2024-09-17T02:55:47.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.599+0000 7f1d5c7ad640 1 Processor -- start 2024-09-17T02:55:47.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.599+0000 7f1d5c7ad640 1 -- start start 2024-09-17T02:55:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d5c7ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d540b4fc0 0x7f1d54151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d5c7ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 0x7f1d540b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d5c7ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d540cdf10 0x7f1d540b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d5c7ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1d540d18c0 con 0x7f1d540b5d20 2024-09-17T02:55:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d5c7ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1d540d01d0 con 0x7f1d540b4fc0 2024-09-17T02:55:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d5c7ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1d54160f50 con 0x7f1d540cdf10 2024-09-17T02:55:47.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d59d48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 0x7f1d540b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d59d48640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 0x7f1d540b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45378/0 (socket says 172.21.15.104:45378) 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d59d48640 1 -- 172.21.15.104:0/1208255772 learned_addr learned my addr 172.21.15.104:0/1208255772 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d5ad4a640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d540cdf10 0x7f1d540b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.600+0000 7f1d5a549640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d540b4fc0 0x7f1d54151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d59d48640 1 -- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d540cdf10 msgr2=0x7f1d540b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d59d48640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d540cdf10 0x7f1d540b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d59d48640 1 -- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d540b4fc0 msgr2=0x7f1d54151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d59d48640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d540b4fc0 0x7f1d54151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d59d48640 1 -- 172.21.15.104:0/1208255772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5406ce80 con 0x7f1d540b5d20 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d59d48640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 0x7f1d540b18e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c7d0 tx=0x7f1d4400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d4affd640 1 -- 172.21.15.104:0/1208255772 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44007bb0 con 0x7f1d540b5d20 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d4affd640 1 -- 172.21.15.104:0/1208255772 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d44005020 con 0x7f1d540b5d20 2024-09-17T02:55:47.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d541f6380 con 0x7f1d540b5d20 2024-09-17T02:55:47.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d4affd640 1 -- 172.21.15.104:0/1208255772 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44007e60 con 0x7f1d540b5d20 2024-09-17T02:55:47.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.601+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d541f6940 con 0x7f1d540b5d20 2024-09-17T02:55:47.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.602+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d540cfa80 con 0x7f1d540b5d20 2024-09-17T02:55:47.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.603+0000 7f1d4affd640 1 -- 172.21.15.104:0/1208255772 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d44005470 con 0x7f1d540b5d20 2024-09-17T02:55:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.603+0000 7f1d4affd640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1d38078bc0 0x7f1d3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.603+0000 7f1d4affd640 1 -- 172.21.15.104:0/1208255772 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f1d4409ade0 con 0x7f1d540b5d20 2024-09-17T02:55:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.603+0000 7f1d5a549640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1d38078bc0 0x7f1d3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:47.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.604+0000 7f1d5a549640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1d38078bc0 0x7f1d3807b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d50006fd0 tx=0x7f1d50009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:47.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.607+0000 7f1d4affd640 1 -- 172.21.15.104:0/1208255772 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1d44014030 con 0x7f1d540b5d20 2024-09-17T02:55:47.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:47.849+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7f1d541f6110 con 0x7f1d540b5d20 2024-09-17T02:55:48.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.847+0000 7f1d4affd640 1 -- 172.21.15.104:0/1208255772 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v78) ==== 145+0+0 (secure 0 0 0) 0x7f1d44062f60 con 0x7f1d540b5d20 2024-09-17T02:55:48.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1d38078bc0 msgr2=0x7f1d3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:48.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1d38078bc0 0x7f1d3807b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d50006fd0 tx=0x7f1d50009060 comp rx=0 tx=0).stop 2024-09-17T02:55:48.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 msgr2=0x7f1d540b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:48.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 0x7f1d540b18e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c7d0 tx=0x7f1d4400cc90 comp rx=0 tx=0).stop 2024-09-17T02:55:48.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 shutdown_connections 2024-09-17T02:55:48.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1d38078bc0 0x7f1d3807b0d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:48.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d540cdf10 0x7f1d540b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:48.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1d540b5d20 0x7f1d540b18e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:48.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 --2- 172.21.15.104:0/1208255772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d540b4fc0 0x7f1d54151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:48.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 >> 172.21.15.104:0/1208255772 conn(0x7f1d540b44a0 msgr2=0x7f1d540b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:48.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 shutdown_connections 2024-09-17T02:55:48.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:48.851+0000 7f1d5c7ad640 1 -- 172.21.15.104:0/1208255772 wait complete. 2024-09-17T02:55:48.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-17T02:55:48.988 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_objectstore":"memstore"} 2024-09-17T02:55:48.989 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-17T02:55:48.989 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T02:55:49.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.102+0000 7f713056e640 1 -- 172.21.15.104:0/3181372318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 msgr2=0x7f71280d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.102+0000 7f713056e640 1 --2- 172.21.15.104:0/3181372318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 0x7f71280d1c40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f71280d1750 tx=0x7f712402a4d0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.102+0000 7f713056e640 1 -- 172.21.15.104:0/3181372318 shutdown_connections 2024-09-17T02:55:49.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.102+0000 7f713056e640 1 --2- 172.21.15.104:0/3181372318 >> v2:172.21.15.192:3300/0 conn(0x7f712806fc60 0x7f712815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.102+0000 7f713056e640 1 --2- 172.21.15.104:0/3181372318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 0x7f71280d1c40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.102+0000 7f713056e640 1 -- 172.21.15.104:0/3181372318 >> 172.21.15.104:0/3181372318 conn(0x7f712806d200 msgr2=0x7f712806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:49.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.102+0000 7f713056e640 1 -- 172.21.15.104:0/3181372318 shutdown_connections 2024-09-17T02:55:49.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.102+0000 7f713056e640 1 -- 172.21.15.104:0/3181372318 wait complete. 2024-09-17T02:55:49.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.104+0000 7f713056e640 1 Processor -- start 2024-09-17T02:55:49.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.104+0000 7f713056e640 1 -- start start 2024-09-17T02:55:49.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f713056e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712806fc60 0x7f71281f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f713056e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71280d2180 0x7f71281f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f713056e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 0x7f71280c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f713056e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7128074770 con 0x7f71281610a0 2024-09-17T02:55:49.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f713056e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7128161720 con 0x7f712806fc60 2024-09-17T02:55:49.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f713056e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f712815d2d0 con 0x7f71280d2180 2024-09-17T02:55:49.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f712eb0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 0x7f71280c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f712eb0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 0x7f71280c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45388/0 (socket says 172.21.15.104:45388) 2024-09-17T02:55:49.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f712eb0b640 1 -- 172.21.15.104:0/162161766 learned_addr learned my addr 172.21.15.104:0/162161766 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:49.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.105+0000 7f712e30a640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712806fc60 0x7f71281f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f712db09640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71280d2180 0x7f71281f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f712eb0b640 1 -- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71280d2180 msgr2=0x7f71281f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f712eb0b640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71280d2180 0x7f71281f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f712eb0b640 1 -- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712806fc60 msgr2=0x7f71281f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f712eb0b640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712806fc60 0x7f71281f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f712eb0b640 1 -- 172.21.15.104:0/162161766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71281f4660 con 0x7f71281610a0 2024-09-17T02:55:49.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f712db09640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71280d2180 0x7f71281f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:49.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f712eb0b640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 0x7f71280c8080 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f712000b9a0 tx=0x7f712000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:49.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f711effd640 1 -- 172.21.15.104:0/162161766 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120019070 con 0x7f71281610a0 2024-09-17T02:55:49.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f711effd640 1 -- 172.21.15.104:0/162161766 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f712000ccb0 con 0x7f71281610a0 2024-09-17T02:55:49.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71280c6d40 con 0x7f71281610a0 2024-09-17T02:55:49.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f711effd640 1 -- 172.21.15.104:0/162161766 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71200146a0 con 0x7f71281610a0 2024-09-17T02:55:49.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.106+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71280c7300 con 0x7f71281610a0 2024-09-17T02:55:49.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.107+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f712815d800 con 0x7f71281610a0 2024-09-17T02:55:49.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.108+0000 7f711effd640 1 -- 172.21.15.104:0/162161766 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f712001c070 con 0x7f71281610a0 2024-09-17T02:55:49.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.108+0000 7f711effd640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f710c078b90 0x7f710c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.108+0000 7f711effd640 1 -- 172.21.15.104:0/162161766 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f712009a740 con 0x7f71281610a0 2024-09-17T02:55:49.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.109+0000 7f712e30a640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f710c078b90 0x7f710c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.109+0000 7f712e30a640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f710c078b90 0x7f710c07b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7124033000 tx=0x7f7124004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:49.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.113+0000 7f711effd640 1 -- 172.21.15.104:0/162161766 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71281f4660 con 0x7f71281610a0 2024-09-17T02:55:49.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.285+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f712806e4d0 con 0x7f71281610a0 2024-09-17T02:55:49.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.285+0000 7f711effd640 1 -- 172.21.15.104:0/162161766 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v25) ==== 59+0+1472 (secure 0 0 0) 0x7f7120062e80 con 0x7f71281610a0 2024-09-17T02:55:49.285 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T02:55:49.285 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T02:55:49.285 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T02:55:49.285 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T02:55:49.285 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T02:55:49.286 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T02:55:49.287 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T02:55:49.287 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T02:55:49.287 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T02:55:49.287 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T02:55:49.287 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T02:55:49.287 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T02:55:49.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f710c078b90 msgr2=0x7f710c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f710c078b90 0x7f710c07b0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7124033000 tx=0x7f7124004730 comp rx=0 tx=0).stop 2024-09-17T02:55:49.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 msgr2=0x7f71280c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 0x7f71280c8080 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f712000b9a0 tx=0x7f712000be60 comp rx=0 tx=0).stop 2024-09-17T02:55:49.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 shutdown_connections 2024-09-17T02:55:49.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f710c078b90 0x7f710c07b0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71281610a0 0x7f71280c8080 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71280d2180 0x7f71281f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 --2- 172.21.15.104:0/162161766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712806fc60 0x7f71281f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 >> 172.21.15.104:0/162161766 conn(0x7f712806d200 msgr2=0x7f7128070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:49.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 shutdown_connections 2024-09-17T02:55:49.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.287+0000 7f713056e640 1 -- 172.21.15.104:0/162161766 wait complete. 2024-09-17T02:55:49.298 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T02:55:49.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.414+0000 7f2d04bba640 1 -- 172.21.15.104:0/2195463539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 msgr2=0x7f2cec00ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.414+0000 7f2d04bba640 1 --2- 172.21.15.104:0/2195463539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 0x7f2cec00ba50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8001dc0 tx=0x7f2cec005830 comp rx=0 tx=0).stop 2024-09-17T02:55:49.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.414+0000 7f2d04bba640 1 -- 172.21.15.104:0/2195463539 shutdown_connections 2024-09-17T02:55:49.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.414+0000 7f2d04bba640 1 --2- 172.21.15.104:0/2195463539 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 0x7f2cec00ba50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.414+0000 7f2d04bba640 1 -- 172.21.15.104:0/2195463539 >> 172.21.15.104:0/2195463539 conn(0x7f2d000d2970 msgr2=0x7f2d000d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:49.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.414+0000 7f2d04bba640 1 -- 172.21.15.104:0/2195463539 shutdown_connections 2024-09-17T02:55:49.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.414+0000 7f2d04bba640 1 -- 172.21.15.104:0/2195463539 wait complete. 2024-09-17T02:55:49.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.416+0000 7f2d04bba640 1 Processor -- start 2024-09-17T02:55:49.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.416+0000 7f2d04bba640 1 -- start start 2024-09-17T02:55:49.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2d04bba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 0x7f2d000b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2d04bba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0015bbc0 0x7f2d000b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2d04bba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d001f5d30 0x7f2d001f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2d04bba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2d00160ec0 con 0x7f2cec0053a0 2024-09-17T02:55:49.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2d04bba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2d000b7fa0 con 0x7f2d001f5d30 2024-09-17T02:55:49.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2d04bba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2d00161040 con 0x7f2d0015bbc0 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2cfe59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 0x7f2d000b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2cfe59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 0x7f2d000b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45418/0 (socket says 172.21.15.104:45418) 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2cfe59c640 1 -- 172.21.15.104:0/375956508 learned_addr learned my addr 172.21.15.104:0/375956508 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2cfed9d640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d001f5d30 0x7f2d001f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.417+0000 7f2cf7fff640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0015bbc0 0x7f2d000b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cfe59c640 1 -- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0015bbc0 msgr2=0x7f2d000b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cfe59c640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0015bbc0 0x7f2d000b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cfe59c640 1 -- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d001f5d30 msgr2=0x7f2d001f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cfe59c640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d001f5d30 0x7f2d001f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cfe59c640 1 -- 172.21.15.104:0/375956508 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0015ab20 con 0x7f2cec0053a0 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cfe59c640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 0x7f2d000b23b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0005f60 tx=0x7f2cf0011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:49.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cf6ffd640 1 -- 172.21.15.104:0/375956508 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf001f070 con 0x7f2cec0053a0 2024-09-17T02:55:49.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cf6ffd640 1 -- 172.21.15.104:0/375956508 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cf000fe40 con 0x7f2cec0053a0 2024-09-17T02:55:49.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0015ae00 con 0x7f2cec0053a0 2024-09-17T02:55:49.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2cf6ffd640 1 -- 172.21.15.104:0/375956508 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00126b0 con 0x7f2cec0053a0 2024-09-17T02:55:49.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.418+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0015b3c0 con 0x7f2cec0053a0 2024-09-17T02:55:49.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.419+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d000ccff0 con 0x7f2cec0053a0 2024-09-17T02:55:49.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.420+0000 7f2cf6ffd640 1 -- 172.21.15.104:0/375956508 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2cf0022070 con 0x7f2cec0053a0 2024-09-17T02:55:49.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.420+0000 7f2cf6ffd640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ce0078bc0 0x7f2ce007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.420+0000 7f2cf6ffd640 1 -- 172.21.15.104:0/375956508 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2cf009b420 con 0x7f2cec0053a0 2024-09-17T02:55:49.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.420+0000 7f2cf7fff640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ce0078bc0 0x7f2ce007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.421+0000 7f2cf7fff640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ce0078bc0 0x7f2ce007b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d000cfcb0 tx=0x7f2ce8006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:49.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.425+0000 7f2cf6ffd640 1 -- 172.21.15.104:0/375956508 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2d000ccff0 con 0x7f2cec0053a0 2024-09-17T02:55:49.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.598+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2d001615a0 con 0x7f2cec0053a0 2024-09-17T02:55:49.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.602+0000 7f2cf6ffd640 1 -- 172.21.15.104:0/375956508 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f2cf00635a0 con 0x7f2cec0053a0 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ce0078bc0 msgr2=0x7f2ce007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ce0078bc0 0x7f2ce007b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d000cfcb0 tx=0x7f2ce8006040 comp rx=0 tx=0).stop 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 msgr2=0x7f2d000b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 0x7f2d000b23b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0005f60 tx=0x7f2cf0011cb0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 shutdown_connections 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ce0078bc0 0x7f2ce007b0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d001f5d30 0x7f2d001f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0015bbc0 0x7f2d000b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 --2- 172.21.15.104:0/375956508 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2cec0053a0 0x7f2d000b23b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 >> 172.21.15.104:0/375956508 conn(0x7f2d000d2970 msgr2=0x7f2d00160310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:49.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 shutdown_connections 2024-09-17T02:55:49.606 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.605+0000 7f2d04bba640 1 -- 172.21.15.104:0/375956508 wait complete. 2024-09-17T02:55:49.615 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:55:49.616 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:55:49.659 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:55:49.718 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:55:49.718 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:49.718 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:49.734 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:55:49.735 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:49.735 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:49.753 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:55:49.754 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:55:49.754 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:49.790 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:55:49.790 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:55:49.790 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:55:49.812 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:55:49.812 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T02:55:49.812 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.942+0000 7fa406084640 1 -- 172.21.15.104:0/4137274014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 msgr2=0x7fa4000ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.942+0000 7fa406084640 1 --2- 172.21.15.104:0/4137274014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 0x7fa4000ce280 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa40006ecb0 tx=0x7fa3f802a970 comp rx=0 tx=0).stop 2024-09-17T02:55:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.942+0000 7fa406084640 1 -- 172.21.15.104:0/4137274014 shutdown_connections 2024-09-17T02:55:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.942+0000 7fa406084640 1 --2- 172.21.15.104:0/4137274014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 0x7fa4000ce280 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.942+0000 7fa406084640 1 --2- 172.21.15.104:0/4137274014 >> v2:172.21.15.192:3300/0 conn(0x7fa40015b7f0 0x7fa40015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.942+0000 7fa406084640 1 -- 172.21.15.104:0/4137274014 >> 172.21.15.104:0/4137274014 conn(0x7fa4000b2450 msgr2=0x7fa4000b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.942+0000 7fa406084640 1 -- 172.21.15.104:0/4137274014 shutdown_connections 2024-09-17T02:55:49.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.942+0000 7fa406084640 1 -- 172.21.15.104:0/4137274014 wait complete. 2024-09-17T02:55:49.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.944+0000 7fa406084640 1 Processor -- start 2024-09-17T02:55:49.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.944+0000 7fa406084640 1 -- start start 2024-09-17T02:55:49.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa406084640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa400072470 0x7fa40006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa406084640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 0x7fa4000ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa406084640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa40015b7f0 0x7fa400151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa406084640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4000ceb90 con 0x7fa400072f90 2024-09-17T02:55:49.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa406084640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4000cea10 con 0x7fa40015b7f0 2024-09-17T02:55:49.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa406084640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa4000ced10 con 0x7fa400072470 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa3feffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 0x7fa4000ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa3feffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 0x7fa4000ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45438/0 (socket says 172.21.15.104:45438) 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa3feffd640 1 -- 172.21.15.104:0/3422656067 learned_addr learned my addr 172.21.15.104:0/3422656067 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa3fffff640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa40015b7f0 0x7fa400151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.945+0000 7fa3ff7fe640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa400072470 0x7fa40006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3feffd640 1 -- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa400072470 msgr2=0x7fa40006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3feffd640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa400072470 0x7fa40006f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3feffd640 1 -- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa40015b7f0 msgr2=0x7fa400151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3feffd640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa40015b7f0 0x7fa400151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3feffd640 1 -- 172.21.15.104:0/3422656067 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40015d5c0 con 0x7fa400072f90 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3feffd640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 0x7fa4000ae9c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400b3f0 tx=0x7fa3f400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:49.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3e7fff640 1 -- 172.21.15.104:0/3422656067 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4015020 con 0x7fa400072f90 2024-09-17T02:55:49.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3e7fff640 1 -- 172.21.15.104:0/3422656067 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3f4011920 con 0x7fa400072f90 2024-09-17T02:55:49.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40015c730 con 0x7fa400072f90 2024-09-17T02:55:49.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa3e7fff640 1 -- 172.21.15.104:0/3422656067 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4011d70 con 0x7fa400072f90 2024-09-17T02:55:49.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.946+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40015ccf0 con 0x7fa400072f90 2024-09-17T02:55:49.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.947+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4000ce280 con 0x7fa400072f90 2024-09-17T02:55:49.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.948+0000 7fa3e7fff640 1 -- 172.21.15.104:0/3422656067 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3f4018020 con 0x7fa400072f90 2024-09-17T02:55:49.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.948+0000 7fa3e7fff640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:49.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.949+0000 7fa3e7fff640 1 -- 172.21.15.104:0/3422656067 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa3f409a870 con 0x7fa400072f90 2024-09-17T02:55:49.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.949+0000 7fa3ff7fe640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:49.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.949+0000 7fa3ff7fe640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0005fd0 tx=0x7fa3f000a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:49.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:49.953+0000 7fa3e7fff640 1 -- 172.21.15.104:0/3422656067 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3f401f020 con 0x7fa400072f90 2024-09-17T02:55:50.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.162+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4000b0b40 con 0x7fa400072f90 2024-09-17T02:55:50.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.162+0000 7fa3e7fff640 1 -- 172.21.15.104:0/3422656067 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3923 (secure 0 0 0) 0x7fa3f4062970 con 0x7fa400072f90 2024-09-17T02:55:50.162 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:50.162 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":16,"btime":"2024-09-17T02:55:43:709343+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2912820611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2912820611},{"type":"v1","addr":"172.21.15.104:6834","nonce":2912820611}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4783,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1407778973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1407778973},{"type":"v1","addr":"172.21.15.192:6836","nonce":1407778973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4786,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4093115199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4093115199},{"type":"v1","addr":"172.21.15.192:6837","nonce":4093115199}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/2215041186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":2215041186},{"type":"v1","addr":"172.21.15.104:6835","nonce":2215041186}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-09-17T02:55:50.162 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 16 2024-09-17T02:55:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa3ec078b90 msgr2=0x7fa3ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0005fd0 tx=0x7fa3f000a250 comp rx=0 tx=0).stop 2024-09-17T02:55:50.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 msgr2=0x7fa4000ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 0x7fa4000ae9c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa3f400b3f0 tx=0x7fa3f400b8b0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 shutdown_connections 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa3ec078b90 0x7fa3ec07b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa40015b7f0 0x7fa400151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa400072f90 0x7fa4000ae9c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 --2- 172.21.15.104:0/3422656067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa400072470 0x7fa40006f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.164+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 >> 172.21.15.104:0/3422656067 conn(0x7fa4000b2450 msgr2=0x7fa400072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.165+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 shutdown_connections 2024-09-17T02:55:50.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.165+0000 7fa406084640 1 -- 172.21.15.104:0/3422656067 wait complete. 2024-09-17T02:55:50.177 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T02:55:50.177 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T02:55:50.177 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T02:55:50.177 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:55:50.177 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T02:55:50.177 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T02:55:50.177 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T02:55:50.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:55:50.178 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T02:55:50.178 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T02:55:50.178 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T02:55:50.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:55:50.178 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T02:55:50.178 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T02:55:50.179 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T02:55:50.179 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:55:50.186 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T02:55:50.186 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T02:55:50.188 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T02:55:50.188 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T02:55:50.190 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T02:55:50.190 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T02:55:50.191 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T02:55:50.191 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T02:55:50.230 INFO:tasks.ceph.mds.a:Started 2024-09-17T02:55:50.231 DEBUG:teuthology.parallel:result is None 2024-09-17T02:55:50.232 INFO:tasks.ceph.mds.c:Started 2024-09-17T02:55:50.232 DEBUG:teuthology.parallel:result is None 2024-09-17T02:55:50.233 INFO:tasks.ceph.mds.d:Started 2024-09-17T02:55:50.233 DEBUG:teuthology.parallel:result is None 2024-09-17T02:55:50.233 INFO:tasks.ceph.mds.b:Started 2024-09-17T02:55:50.234 DEBUG:teuthology.parallel:result is None 2024-09-17T02:55:50.234 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T02:55:50.318 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T02:55:50.319 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:55:50.328 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T02:55:50.329 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T02:55:50.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.354+0000 7fae761c3640 1 -- 172.21.15.104:0/2907868272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae70152ce0 msgr2=0x7fae7006f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:50.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.354+0000 7fae761c3640 1 --2- 172.21.15.104:0/2907868272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae70152ce0 0x7fae7006f540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae60009830 tx=0x7fae6002a510 comp rx=0 tx=0).stop 2024-09-17T02:55:50.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.354+0000 7fae761c3640 1 -- 172.21.15.104:0/2907868272 shutdown_connections 2024-09-17T02:55:50.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.354+0000 7fae761c3640 1 --2- 172.21.15.104:0/2907868272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae7006fa80 0x7fae70073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.354+0000 7fae761c3640 1 --2- 172.21.15.104:0/2907868272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae70152ce0 0x7fae7006f540 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.354+0000 7fae761c3640 1 -- 172.21.15.104:0/2907868272 >> 172.21.15.104:0/2907868272 conn(0x7fae700b3640 msgr2=0x7fae700b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:50.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.354+0000 7fae761c3640 1 -- 172.21.15.104:0/2907868272 shutdown_connections 2024-09-17T02:55:50.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.354+0000 7fae761c3640 1 -- 172.21.15.104:0/2907868272 wait complete. 2024-09-17T02:55:50.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.356+0000 7fae761c3640 1 Processor -- start 2024-09-17T02:55:50.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.356+0000 7fae761c3640 1 -- start start 2024-09-17T02:55:50.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae761c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae7006fa80 0x7fae701f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:50.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae761c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae70073ac0 0x7fae701489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:50.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae761c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae70152ce0 0x7fae70146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:50.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae761c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fae7015fda0 con 0x7fae7006fa80 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae761c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fae700b5fe0 con 0x7fae70152ce0 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae761c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fae7015ff20 con 0x7fae70073ac0 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae6f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae7006fa80 0x7fae701f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae6f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae7006fa80 0x7fae701f2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45486/0 (socket says 172.21.15.104:45486) 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.357+0000 7fae6f7fe640 1 -- 172.21.15.104:0/1230931056 learned_addr learned my addr 172.21.15.104:0/1230931056 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae67fff640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae70073ac0 0x7fae701489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6ffff640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae70152ce0 0x7fae70146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6f7fe640 1 -- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae70073ac0 msgr2=0x7fae701489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6f7fe640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae70073ac0 0x7fae701489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6f7fe640 1 -- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae70152ce0 msgr2=0x7fae70146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6f7fe640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae70152ce0 0x7fae70146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6f7fe640 1 -- 172.21.15.104:0/1230931056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae70155880 con 0x7fae7006fa80 2024-09-17T02:55:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6f7fe640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae7006fa80 0x7fae701f2270 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fae60009950 tx=0x7fae60033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6cff9640 1 -- 172.21.15.104:0/1230931056 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae60005c90 con 0x7fae7006fa80 2024-09-17T02:55:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6cff9640 1 -- 172.21.15.104:0/1230931056 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae60031e50 con 0x7fae7006fa80 2024-09-17T02:55:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae70147c20 con 0x7fae7006fa80 2024-09-17T02:55:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae6cff9640 1 -- 172.21.15.104:0/1230931056 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae60005260 con 0x7fae7006fa80 2024-09-17T02:55:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.358+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae701481e0 con 0x7fae7006fa80 2024-09-17T02:55:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.359+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae700ce950 con 0x7fae7006fa80 2024-09-17T02:55:50.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.360+0000 7fae6cff9640 1 -- 172.21.15.104:0/1230931056 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae60005400 con 0x7fae7006fa80 2024-09-17T02:55:50.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.360+0000 7fae6cff9640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae50078b90 0x7fae5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:50.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.361+0000 7fae6cff9640 1 -- 172.21.15.104:0/1230931056 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fae600bbac0 con 0x7fae7006fa80 2024-09-17T02:55:50.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.361+0000 7fae67fff640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae50078b90 0x7fae5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:50.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.361+0000 7fae67fff640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae50078b90 0x7fae5007b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae700d1790 tx=0x7fae58005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:50.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.365+0000 7fae6cff9640 1 -- 172.21.15.104:0/1230931056 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae700ce950 con 0x7fae7006fa80 2024-09-17T02:55:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:50.549+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fae70160410 con 0x7fae7006fa80 2024-09-17T02:55:51.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.630+0000 7fae6cff9640 1 -- 172.21.15.104:0/1230931056 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) ==== 97+0+0 (secure 0 0 0) 0x7fae6003f030 con 0x7fae7006fa80 2024-09-17T02:55:51.630 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae50078b90 msgr2=0x7fae5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae50078b90 0x7fae5007b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fae700d1790 tx=0x7fae58005f90 comp rx=0 tx=0).stop 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae7006fa80 msgr2=0x7fae701f2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae7006fa80 0x7fae701f2270 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fae60009950 tx=0x7fae60033c20 comp rx=0 tx=0).stop 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 shutdown_connections 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fae50078b90 0x7fae5007b0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae70152ce0 0x7fae70146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae70073ac0 0x7fae701489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 --2- 172.21.15.104:0/1230931056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fae7006fa80 0x7fae701f2270 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 >> 172.21.15.104:0/1230931056 conn(0x7fae700b3640 msgr2=0x7fae7015d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:51.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 shutdown_connections 2024-09-17T02:55:51.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.633+0000 7fae761c3640 1 -- 172.21.15.104:0/1230931056 wait complete. 2024-09-17T02:55:51.646 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T02:55:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.765+0000 7fe85c319640 1 -- 172.21.15.104:0/3307513404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe840004d40 msgr2=0x7fe8400051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.765+0000 7fe85c319640 1 --2- 172.21.15.104:0/3307513404 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe840004d40 0x7fe8400051f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe8540748c0 tx=0x7fe840005830 comp rx=0 tx=0).stop 2024-09-17T02:55:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.765+0000 7fe85a8b6640 1 -- 172.21.15.104:0/3307513404 reap_dead start 2024-09-17T02:55:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.765+0000 7fe85c319640 1 -- 172.21.15.104:0/3307513404 shutdown_connections 2024-09-17T02:55:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.765+0000 7fe85c319640 1 -- 172.21.15.104:0/3307513404 >> 172.21.15.104:0/3307513404 conn(0x7fe8540b2450 msgr2=0x7fe8540b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.765+0000 7fe85c319640 1 -- 172.21.15.104:0/3307513404 shutdown_connections 2024-09-17T02:55:51.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.765+0000 7fe85c319640 1 -- 172.21.15.104:0/3307513404 wait complete. 2024-09-17T02:55:51.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.767+0000 7fe85c319640 1 Processor -- start 2024-09-17T02:55:51.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.767+0000 7fe85c319640 1 -- start start 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85c319640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe840004d40 0x7fe8541f3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85c319640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe85414d1a0 0x7fe85415e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85c319640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe85414d5b0 0x7fe85415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85c319640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe8540ce990 con 0x7fe85414d5b0 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85c319640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe85415bec0 con 0x7fe85414d1a0 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85c319640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe8540ceb10 con 0x7fe840004d40 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a8b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe85414d5b0 0x7fe85415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a8b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe85414d5b0 0x7fe85415e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45510/0 (socket says 172.21.15.104:45510) 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a8b6640 1 -- 172.21.15.104:0/2157305909 learned_addr learned my addr 172.21.15.104:0/2157305909 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a0b5640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe840004d40 0x7fe8541f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe8598b4640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe85414d1a0 0x7fe85415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a8b6640 1 -- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe840004d40 msgr2=0x7fe8541f3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:51.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a8b6640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe840004d40 0x7fe8541f3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a8b6640 1 -- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe85414d1a0 msgr2=0x7fe85415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a8b6640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe85414d1a0 0x7fe85415e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a8b6640 1 -- 172.21.15.104:0/2157305909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85414eab0 con 0x7fe85414d5b0 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.768+0000 7fe85a0b5640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe840004d40 0x7fe8541f3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.769+0000 7fe85a8b6640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe85414d5b0 0x7fe85415e9d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe84c02b410 tx=0x7fe84c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.769+0000 7fe84affd640 1 -- 172.21.15.104:0/2157305909 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c039070 con 0x7fe85414d5b0 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.769+0000 7fe84affd640 1 -- 172.21.15.104:0/2157305909 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe84c02ba50 con 0x7fe85414d5b0 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.769+0000 7fe84affd640 1 -- 172.21.15.104:0/2157305909 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c006180 con 0x7fe85414d5b0 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.769+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8541501c0 con 0x7fe85414d5b0 2024-09-17T02:55:51.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.769+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe854150780 con 0x7fe85414d5b0 2024-09-17T02:55:51.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.770+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85414e820 con 0x7fe85414d5b0 2024-09-17T02:55:51.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.770+0000 7fe84affd640 1 -- 172.21.15.104:0/2157305909 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe84c03c020 con 0x7fe85414d5b0 2024-09-17T02:55:51.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.771+0000 7fe84affd640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe838078b90 0x7fe83807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:51.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.771+0000 7fe84affd640 1 -- 172.21.15.104:0/2157305909 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7fe84c0b9e90 con 0x7fe85414d5b0 2024-09-17T02:55:51.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.771+0000 7fe85a0b5640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe838078b90 0x7fe83807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:51.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.772+0000 7fe85a0b5640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe838078b90 0x7fe83807b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe850009c50 tx=0x7fe850005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:51.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:51.775+0000 7fe84affd640 1 -- 172.21.15.104:0/2157305909 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe84c045030 con 0x7fe85414d5b0 2024-09-17T02:55:52.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.018+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe85415f330 con 0x7fe85414d5b0 2024-09-17T02:55:52.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.019+0000 7fe84affd640 1 -- 172.21.15.104:0/2157305909 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) ==== 80+0+5304 (secure 0 0 0) 0x7fe85415f330 con 0x7fe85414d5b0 2024-09-17T02:55:52.018 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T02:55:52.020 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:52.021 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T02:55:52.022 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.023 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T02:55:52.024 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.025 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T02:55:52.026 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.027 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T02:55:52.028 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:55:52.029 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.030 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:55:52.031 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:55:52.032 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:55:52.032 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:55:52.032 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.032 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.032 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:55:52.032 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:55:52.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe838078b90 msgr2=0x7fe83807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe838078b90 0x7fe83807b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe850009c50 tx=0x7fe850005f90 comp rx=0 tx=0).stop 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe85414d5b0 msgr2=0x7fe85415e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe85414d5b0 0x7fe85415e9d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe84c02b410 tx=0x7fe84c003ba0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 shutdown_connections 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe838078b90 0x7fe83807b0a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe85414d1a0 0x7fe85415e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe85414d5b0 0x7fe85415e9d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 --2- 172.21.15.104:0/2157305909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe840004d40 0x7fe8541f3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 >> 172.21.15.104:0/2157305909 conn(0x7fe8540b2450 msgr2=0x7fe8540b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 shutdown_connections 2024-09-17T02:55:52.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.021+0000 7fe85c319640 1 -- 172.21.15.104:0/2157305909 wait complete. 2024-09-17T02:55:52.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T02:55:52.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.147+0000 7f162b59b640 1 -- 172.21.15.104:0/1885624012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f160c0039e0 msgr2=0x7f160c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.147+0000 7f162b59b640 1 --2- 172.21.15.104:0/1885624012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f160c0039e0 0x7f160c003e30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f161c00c6e0 tx=0x7f160c005830 comp rx=0 tx=0).stop 2024-09-17T02:55:52.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.147+0000 7f1629b38640 1 -- 172.21.15.104:0/1885624012 reap_dead start 2024-09-17T02:55:52.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.147+0000 7f162b59b640 1 -- 172.21.15.104:0/1885624012 shutdown_connections 2024-09-17T02:55:52.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.147+0000 7f162b59b640 1 -- 172.21.15.104:0/1885624012 >> 172.21.15.104:0/1885624012 conn(0x7f16240b2450 msgr2=0x7f16240b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:52.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.147+0000 7f162b59b640 1 -- 172.21.15.104:0/1885624012 shutdown_connections 2024-09-17T02:55:52.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.147+0000 7f162b59b640 1 -- 172.21.15.104:0/1885624012 wait complete. 2024-09-17T02:55:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.149+0000 7f162b59b640 1 Processor -- start 2024-09-17T02:55:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.149+0000 7f162b59b640 1 -- start start 2024-09-17T02:55:52.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f162b59b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f160c0039e0 0x7f162415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:52.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f162b59b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f162415bd80 0x7f16240ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:52.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f162b59b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f162415fca0 0x7f16240aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:52.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f162b59b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f16240cda00 con 0x7f162415bd80 2024-09-17T02:55:52.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f162b59b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16240cd880 con 0x7f160c0039e0 2024-09-17T02:55:52.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f162b59b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1624156a00 con 0x7f162415fca0 2024-09-17T02:55:52.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f1628b36640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f162415bd80 0x7f16240ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:52.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f1628b36640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f162415bd80 0x7f16240ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45530/0 (socket says 172.21.15.104:45530) 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f1628b36640 1 -- 172.21.15.104:0/3323180887 learned_addr learned my addr 172.21.15.104:0/3323180887 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.150+0000 7f1629b38640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f162415fca0 0x7f16240aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1629337640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f160c0039e0 0x7f162415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1628b36640 1 -- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f162415fca0 msgr2=0x7f16240aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1628b36640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f162415fca0 0x7f16240aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1628b36640 1 -- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f160c0039e0 msgr2=0x7f162415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1628b36640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f160c0039e0 0x7f162415adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1628b36640 1 -- 172.21.15.104:0/3323180887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16241f60a0 con 0x7f162415bd80 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1629b38640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f162415fca0 0x7f16240aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1629337640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f160c0039e0 0x7f162415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1628b36640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f162415bd80 0x7f16240ae8b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1618001eb0 tx=0x7f161800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:52.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1621ffb640 1 -- 172.21.15.104:0/3323180887 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180035f0 con 0x7f162415bd80 2024-09-17T02:55:52.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1621ffb640 1 -- 172.21.15.104:0/3323180887 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1618016070 con 0x7f162415bd80 2024-09-17T02:55:52.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16241f6510 con 0x7f162415bd80 2024-09-17T02:55:52.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f1621ffb640 1 -- 172.21.15.104:0/3323180887 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618003ae0 con 0x7f162415bd80 2024-09-17T02:55:52.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.151+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16240d0d70 con 0x7f162415bd80 2024-09-17T02:55:52.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.152+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16240cd170 con 0x7f162415bd80 2024-09-17T02:55:52.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.153+0000 7f1621ffb640 1 -- 172.21.15.104:0/3323180887 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1618003c80 con 0x7f162415bd80 2024-09-17T02:55:52.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.153+0000 7f1621ffb640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1610078b90 0x7f161007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:52.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.153+0000 7f1621ffb640 1 -- 172.21.15.104:0/3323180887 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f161809ae70 con 0x7f162415bd80 2024-09-17T02:55:52.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.154+0000 7f1629337640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1610078b90 0x7f161007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:52.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.154+0000 7f1629337640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1610078b90 0x7f161007b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f161c032000 tx=0x7f161c003760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:52.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.158+0000 7f1621ffb640 1 -- 172.21.15.104:0/3323180887 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1618063720 con 0x7f162415bd80 2024-09-17T02:55:52.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.334+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f16241f6270 con 0x7f162415bd80 2024-09-17T02:55:52.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.334+0000 7f1621ffb640 1 -- 172.21.15.104:0/3323180887 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) ==== 84+0+65 (secure 0 0 0) 0x7f1618063020 con 0x7f162415bd80 2024-09-17T02:55:52.334 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:52.334 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T02:55:52.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:55:52.334 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T02:55:52.334 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T02:55:52.334 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:55:52.334 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T02:55:52.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1610078b90 msgr2=0x7f161007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1610078b90 0x7f161007b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f161c032000 tx=0x7f161c003760 comp rx=0 tx=0).stop 2024-09-17T02:55:52.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f162415bd80 msgr2=0x7f16240ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f162415bd80 0x7f16240ae8b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1618001eb0 tx=0x7f161800eaf0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 shutdown_connections 2024-09-17T02:55:52.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1610078b90 0x7f161007b0a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f162415fca0 0x7f16240aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f162415bd80 0x7f16240ae8b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 --2- 172.21.15.104:0/3323180887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f160c0039e0 0x7f162415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 >> 172.21.15.104:0/3323180887 conn(0x7f16240b2450 msgr2=0x7f1624160440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:52.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 shutdown_connections 2024-09-17T02:55:52.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.336+0000 7f162b59b640 1 -- 172.21.15.104:0/3323180887 wait complete. 2024-09-17T02:55:52.347 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T02:55:52.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T02:55:52.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.464+0000 7f01d0a8b640 1 -- 172.21.15.104:0/1269370736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01cc0b81a0 msgr2=0x7f01cc0b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.464+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/1269370736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01cc0b81a0 0x7f01cc0b3960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01bc005fd0 tx=0x7f01bc02a7a0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.464+0000 7f01d0a8b640 1 -- 172.21.15.104:0/1269370736 shutdown_connections 2024-09-17T02:55:52.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.464+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/1269370736 >> v2:172.21.15.192:3300/0 conn(0x7f01cc0b7200 0x7f01cc0b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.464+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/1269370736 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01cc0b81a0 0x7f01cc0b3960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.464+0000 7f01d0a8b640 1 -- 172.21.15.104:0/1269370736 >> 172.21.15.104:0/1269370736 conn(0x7f01cc0d29c0 msgr2=0x7f01cc0d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.464+0000 7f01d0a8b640 1 -- 172.21.15.104:0/1269370736 shutdown_connections 2024-09-17T02:55:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.464+0000 7f01d0a8b640 1 -- 172.21.15.104:0/1269370736 wait complete. 2024-09-17T02:55:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.466+0000 7f01d0a8b640 1 Processor -- start 2024-09-17T02:55:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.466+0000 7f01d0a8b640 1 -- start start 2024-09-17T02:55:52.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.467+0000 7f01d0a8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01cc0b3ea0 0x7f01cc0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:52.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.467+0000 7f01d0a8b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01cc0b7200 0x7f01cc15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:52.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.467+0000 7f01d0a8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01cc0b81a0 0x7f01cc15e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:52.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.467+0000 7f01d0a8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc0b32e0 con 0x7f01cc0b81a0 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.467+0000 7f01d0a8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc0b3160 con 0x7f01cc0b3ea0 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.467+0000 7f01d0a8b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f01cc0b3460 con 0x7f01cc0b7200 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.467+0000 7f01cad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01cc0b81a0 0x7f01cc15e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01cad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01cc0b81a0 0x7f01cc15e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45542/0 (socket says 172.21.15.104:45542) 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01cad9d640 1 -- 172.21.15.104:0/3540272655 learned_addr learned my addr 172.21.15.104:0/3540272655 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01c9d9b640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01cc0b7200 0x7f01cc15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01ca59c640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01cc0b3ea0 0x7f01cc0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01cad9d640 1 -- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01cc0b7200 msgr2=0x7f01cc15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01cad9d640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01cc0b7200 0x7f01cc15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01cad9d640 1 -- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01cc0b3ea0 msgr2=0x7f01cc0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01cad9d640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01cc0b3ea0 0x7f01cc0cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01cad9d640 1 -- 172.21.15.104:0/3540272655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc0cce70 con 0x7f01cc0b81a0 2024-09-17T02:55:52.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01cad9d640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01cc0b81a0 0x7f01cc15e810 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f01c400e770 tx=0x7f01c400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01baffd640 1 -- 172.21.15.104:0/3540272655 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c400ccc0 con 0x7f01cc0b81a0 2024-09-17T02:55:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc15c600 con 0x7f01cc0b81a0 2024-09-17T02:55:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01baffd640 1 -- 172.21.15.104:0/3540272655 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01c400ee80 con 0x7f01cc0b81a0 2024-09-17T02:55:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01baffd640 1 -- 172.21.15.104:0/3540272655 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4005280 con 0x7f01cc0b81a0 2024-09-17T02:55:52.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.468+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc1570a0 con 0x7f01cc0b81a0 2024-09-17T02:55:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.469+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01cc0b3960 con 0x7f01cc0b81a0 2024-09-17T02:55:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.470+0000 7f01baffd640 1 -- 172.21.15.104:0/3540272655 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01c4005420 con 0x7f01cc0b81a0 2024-09-17T02:55:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.470+0000 7f01baffd640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01ac078b90 0x7f01ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.470+0000 7f01baffd640 1 -- 172.21.15.104:0/3540272655 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f01c409b320 con 0x7f01cc0b81a0 2024-09-17T02:55:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.471+0000 7f01ca59c640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01ac078b90 0x7f01ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:52.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.471+0000 7f01ca59c640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01ac078b90 0x7f01ac07b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01bc033000 tx=0x7f01bc004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:52.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.475+0000 7f01baffd640 1 -- 172.21.15.104:0/3540272655 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01c40633c0 con 0x7f01cc0b81a0 2024-09-17T02:55:52.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:52.647+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f01cc0b12a0 con 0x7f01cc0b81a0 2024-09-17T02:55:53.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.633+0000 7f01baffd640 1 -- 172.21.15.104:0/3540272655 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) ==== 138+0+0 (secure 0 0 0) 0x7f01c4067df0 con 0x7f01cc0b81a0 2024-09-17T02:55:53.633 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T02:55:53.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01ac078b90 msgr2=0x7f01ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:53.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01ac078b90 0x7f01ac07b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01bc033000 tx=0x7f01bc004ab0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01cc0b81a0 msgr2=0x7f01cc15e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:53.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01cc0b81a0 0x7f01cc15e810 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f01c400e770 tx=0x7f01c400ec30 comp rx=0 tx=0).stop 2024-09-17T02:55:53.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 shutdown_connections 2024-09-17T02:55:53.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01ac078b90 0x7f01ac07b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01cc0b81a0 0x7f01cc15e810 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01cc0b7200 0x7f01cc15fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 --2- 172.21.15.104:0/3540272655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01cc0b3ea0 0x7f01cc0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.636+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 >> 172.21.15.104:0/3540272655 conn(0x7f01cc0d29c0 msgr2=0x7f01cc0af7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:53.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.637+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 shutdown_connections 2024-09-17T02:55:53.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.637+0000 7f01d0a8b640 1 -- 172.21.15.104:0/3540272655 wait complete. 2024-09-17T02:55:53.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T02:55:53.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.773+0000 7f40cd901640 1 -- 172.21.15.104:0/1033514024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c80b6cf0 msgr2=0x7f40c80d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:53.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.773+0000 7f40cd901640 1 --2- 172.21.15.104:0/1033514024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c80b6cf0 0x7f40c80d2fd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f40c0005fd0 tx=0x7f40c002aa10 comp rx=0 tx=0).stop 2024-09-17T02:55:53.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.773+0000 7f40cd901640 1 -- 172.21.15.104:0/1033514024 shutdown_connections 2024-09-17T02:55:53.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.773+0000 7f40cd901640 1 --2- 172.21.15.104:0/1033514024 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c80b6cf0 0x7f40c80d2fd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.773+0000 7f40cd901640 1 --2- 172.21.15.104:0/1033514024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c815f6e0 0x7f40c80d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.773+0000 7f40cd901640 1 -- 172.21.15.104:0/1033514024 >> 172.21.15.104:0/1033514024 conn(0x7f40c8069120 msgr2=0x7f40c8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:53.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.774+0000 7f40cd901640 1 -- 172.21.15.104:0/1033514024 shutdown_connections 2024-09-17T02:55:53.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.774+0000 7f40cd901640 1 -- 172.21.15.104:0/1033514024 wait complete. 2024-09-17T02:55:53.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.775+0000 7f40cd901640 1 Processor -- start 2024-09-17T02:55:53.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.775+0000 7f40cd901640 1 -- start start 2024-09-17T02:55:53.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40cd901640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c815f6e0 0x7f40c8158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40cd901640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c815faf0 0x7f40c81f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40cd901640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c8159060 0x7f40c81f9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40cd901640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f40c80d3a90 con 0x7f40c815f6e0 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40cd901640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f40c80d3910 con 0x7f40c815faf0 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40cd901640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f40c80d3c10 con 0x7f40c8159060 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c815f6e0 0x7f40c8158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c815f6e0 0x7f40c8158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45550/0 (socket says 172.21.15.104:45550) 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 -- 172.21.15.104:0/1425593496 learned_addr learned my addr 172.21.15.104:0/1425593496 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c77fe640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c8159060 0x7f40c81f9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40bffff640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c815faf0 0x7f40c81f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:53.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 -- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c8159060 msgr2=0x7f40c81f9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c8159060 0x7f40c81f9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 -- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c815faf0 msgr2=0x7f40c81f95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c815faf0 0x7f40c81f95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 -- 172.21.15.104:0/1425593496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c81f5d40 con 0x7f40c815f6e0 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c6ffd640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c815f6e0 0x7f40c8158b20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f40b800d750 tx=0x7f40b800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c4ff9640 1 -- 172.21.15.104:0/1425593496 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b8017070 con 0x7f40c815f6e0 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c4ff9640 1 -- 172.21.15.104:0/1425593496 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40b8004310 con 0x7f40c815f6e0 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40c4ff9640 1 -- 172.21.15.104:0/1425593496 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b800de60 con 0x7f40c815f6e0 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c81f6000 con 0x7f40c815f6e0 2024-09-17T02:55:53.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.777+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c81f65c0 con 0x7f40c815f6e0 2024-09-17T02:55:53.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.778+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c80b7bc0 con 0x7f40c815f6e0 2024-09-17T02:55:53.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.779+0000 7f40c4ff9640 1 -- 172.21.15.104:0/1425593496 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f40b8009c30 con 0x7f40c815f6e0 2024-09-17T02:55:53.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.780+0000 7f40c4ff9640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a8078b90 0x7f40a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:53.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.780+0000 7f40c4ff9640 1 -- 172.21.15.104:0/1425593496 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5227+0+0 (secure 0 0 0) 0x7f40b809b3a0 con 0x7f40c815f6e0 2024-09-17T02:55:53.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.780+0000 7f40bffff640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a8078b90 0x7f40a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:53.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.781+0000 7f40bffff640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a8078b90 0x7f40a807b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40c814d6e0 tx=0x7f40b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:53.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.784+0000 7f40c4ff9640 1 -- 172.21.15.104:0/1425593496 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f40c80b7bc0 con 0x7f40c815f6e0 2024-09-17T02:55:53.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:53.958+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f40c80d10c0 con 0x7f40c815f6e0 2024-09-17T02:55:54.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.641+0000 7f40c4ff9640 1 -- 172.21.15.104:0/1425593496 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) ==== 170+0+0 (secure 0 0 0) 0x7f40c80d10c0 con 0x7f40c815f6e0 2024-09-17T02:55:54.641 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T02:55:54.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a8078b90 msgr2=0x7f40a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:54.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a8078b90 0x7f40a807b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40c814d6e0 tx=0x7f40b0009040 comp rx=0 tx=0).stop 2024-09-17T02:55:54.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c815f6e0 msgr2=0x7f40c8158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:54.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c815f6e0 0x7f40c8158b20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f40b800d750 tx=0x7f40b800dc10 comp rx=0 tx=0).stop 2024-09-17T02:55:54.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 shutdown_connections 2024-09-17T02:55:54.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f40a8078b90 0x7f40a807b0a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40c815faf0 0x7f40c81f95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40c8159060 0x7f40c81f9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 --2- 172.21.15.104:0/1425593496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40c815f6e0 0x7f40c8158b20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.643+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 >> 172.21.15.104:0/1425593496 conn(0x7f40c8069120 msgr2=0x7f40c80ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:54.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.644+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 shutdown_connections 2024-09-17T02:55:54.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.645+0000 7f40cd901640 1 -- 172.21.15.104:0/1425593496 wait complete. 2024-09-17T02:55:54.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T02:55:54.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.785+0000 7fbea156e640 1 -- 172.21.15.104:0/2040843142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c160390 msgr2=0x7fbe9c0cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:54.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.785+0000 7fbea156e640 1 --2- 172.21.15.104:0/2040843142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c160390 0x7fbe9c0cfa50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0b0be0 tx=0x7fbe8c02a5f0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.785+0000 7fbea156e640 1 -- 172.21.15.104:0/2040843142 shutdown_connections 2024-09-17T02:55:54.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.785+0000 7fbea156e640 1 --2- 172.21.15.104:0/2040843142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c160390 0x7fbe9c0cfa50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.785+0000 7fbea156e640 1 --2- 172.21.15.104:0/2040843142 >> v2:172.21.15.192:3300/0 conn(0x7fbe9c15ff80 0x7fbe9c0cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.785+0000 7fbea156e640 1 -- 172.21.15.104:0/2040843142 >> 172.21.15.104:0/2040843142 conn(0x7fbe9c0d0f90 msgr2=0x7fbe9c0d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.785+0000 7fbea156e640 1 -- 172.21.15.104:0/2040843142 shutdown_connections 2024-09-17T02:55:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.785+0000 7fbea156e640 1 -- 172.21.15.104:0/2040843142 wait complete. 2024-09-17T02:55:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.787+0000 7fbea156e640 1 Processor -- start 2024-09-17T02:55:54.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.787+0000 7fbea156e640 1 -- start start 2024-09-17T02:55:54.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.788+0000 7fbea156e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe9c073720 0x7fbe9c1f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:54.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.788+0000 7fbea156e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c15ff80 0x7fbe9c1f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:54.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.788+0000 7fbea156e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9c160390 0x7fbe9c0c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.788+0000 7fbea156e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c0d0320 con 0x7fbe9c15ff80 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.788+0000 7fbea156e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c0d01a0 con 0x7fbe9c073720 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.788+0000 7fbea156e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9c0d04a0 con 0x7fbe9c160390 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c15ff80 0x7fbe9c1f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c15ff80 0x7fbe9c1f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45420/0 (socket says 172.21.15.104:45420) 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 -- 172.21.15.104:0/1178486208 learned_addr learned my addr 172.21.15.104:0/1178486208 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9affd640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe9c073720 0x7fbe9c1f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9b7fe640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9c160390 0x7fbe9c0c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 -- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9c160390 msgr2=0x7fbe9c0c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9c160390 0x7fbe9c0c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 -- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe9c073720 msgr2=0x7fbe9c1f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe9c073720 0x7fbe9c1f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 -- 172.21.15.104:0/1178486208 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c0cc9e0 con 0x7fbe9c15ff80 2024-09-17T02:55:54.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe9a7fc640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c15ff80 0x7fbe9c1f6ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400d6d0 tx=0x7fbe8400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:54.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe937fe640 1 -- 172.21.15.104:0/1178486208 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84017070 con 0x7fbe9c15ff80 2024-09-17T02:55:54.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe937fe640 1 -- 172.21.15.104:0/1178486208 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe84004310 con 0x7fbe9c15ff80 2024-09-17T02:55:54.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c0cccc0 con 0x7fbe9c15ff80 2024-09-17T02:55:54.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbe937fe640 1 -- 172.21.15.104:0/1178486208 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84009a80 con 0x7fbe9c15ff80 2024-09-17T02:55:54.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.789+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c0c78a0 con 0x7fbe9c15ff80 2024-09-17T02:55:54.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.790+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9c0ccf00 con 0x7fbe9c15ff80 2024-09-17T02:55:54.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.792+0000 7fbe937fe640 1 -- 172.21.15.104:0/1178486208 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe840035f0 con 0x7fbe9c15ff80 2024-09-17T02:55:54.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.792+0000 7fbe937fe640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe7c078b90 0x7fbe7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:54.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.792+0000 7fbe937fe640 1 -- 172.21.15.104:0/1178486208 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5609+0+0 (secure 0 0 0) 0x7fbe8409b2a0 con 0x7fbe9c15ff80 2024-09-17T02:55:54.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.793+0000 7fbe9affd640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe7c078b90 0x7fbe7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:54.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.793+0000 7fbe9affd640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe7c078b90 0x7fbe7c07b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbe94001e20 tx=0x7fbe94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:54.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:54.796+0000 7fbe937fe640 1 -- 172.21.15.104:0/1178486208 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbe84063260 con 0x7fbe9c15ff80 2024-09-17T02:55:55.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.004+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbe9c1f3d00 con 0x7fbe9c15ff80 2024-09-17T02:55:55.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.650+0000 7fbe937fe640 1 -- 172.21.15.104:0/1178486208 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) ==== 172+0+0 (secure 0 0 0) 0x7fbe84068e20 con 0x7fbe9c15ff80 2024-09-17T02:55:55.657 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 6 and data pool 7 2024-09-17T02:55:55.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.663+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe7c078b90 msgr2=0x7fbe7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:55.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.663+0000 7fbea156e640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe7c078b90 0x7fbe7c07b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbe94001e20 tx=0x7fbe94009040 comp rx=0 tx=0).stop 2024-09-17T02:55:55.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.663+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c15ff80 msgr2=0x7fbe9c1f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:55.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.663+0000 7fbea156e640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c15ff80 0x7fbe9c1f6ad0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400d6d0 tx=0x7fbe8400db90 comp rx=0 tx=0).stop 2024-09-17T02:55:55.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.666+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 shutdown_connections 2024-09-17T02:55:55.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.666+0000 7fbea156e640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe7c078b90 0x7fbe7c07b0a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.666+0000 7fbea156e640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe9c160390 0x7fbe9c0c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.666+0000 7fbea156e640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe9c15ff80 0x7fbe9c1f6ad0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.666+0000 7fbea156e640 1 --2- 172.21.15.104:0/1178486208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe9c073720 0x7fbe9c1f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.666+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 >> 172.21.15.104:0/1178486208 conn(0x7fbe9c0d0f90 msgr2=0x7fbe9c06fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:55.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.667+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 shutdown_connections 2024-09-17T02:55:55.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.667+0000 7fbea156e640 1 -- 172.21.15.104:0/1178486208 wait complete. 2024-09-17T02:55:55.680 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:55.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.794+0000 7f6eeaee6640 1 -- 172.21.15.104:0/1221750514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b4fc0 msgr2=0x7f6ee40b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:55.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.794+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/1221750514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b4fc0 0x7f6ee40b39c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40c98b0 tx=0x7f6ee002a5f0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.794+0000 7f6eeaee6640 1 -- 172.21.15.104:0/1221750514 shutdown_connections 2024-09-17T02:55:55.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.794+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/1221750514 >> v2:172.21.15.192:3300/0 conn(0x7f6ee40cdf10 0x7f6ee40cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.794+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/1221750514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b4fc0 0x7f6ee40b39c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.794+0000 7f6eeaee6640 1 -- 172.21.15.104:0/1221750514 >> 172.21.15.104:0/1221750514 conn(0x7f6ee40b44a0 msgr2=0x7f6ee40b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:55.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.794+0000 7f6eeaee6640 1 -- 172.21.15.104:0/1221750514 shutdown_connections 2024-09-17T02:55:55.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.794+0000 7f6eeaee6640 1 -- 172.21.15.104:0/1221750514 wait complete. 2024-09-17T02:55:55.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.796+0000 7f6eeaee6640 1 Processor -- start 2024-09-17T02:55:55.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.796+0000 7f6eeaee6640 1 -- start start 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6eeaee6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b3f00 0x7f6ee40a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6eeaee6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee40b4fc0 0x7f6ee415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6eeaee6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee40cdf10 0x7f6ee40b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6eeaee6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee40d18c0 con 0x7f6ee40b3f00 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6eeaee6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee40d01d0 con 0x7f6ee40cdf10 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6eeaee6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee4160f50 con 0x7f6ee40b4fc0 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b3f00 0x7f6ee40a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b3f00 0x7f6ee40a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45440/0 (socket says 172.21.15.104:45440) 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 -- 172.21.15.104:0/465712392 learned_addr learned my addr 172.21.15.104:0/465712392 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6edbfff640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee40b4fc0 0x7f6ee415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee9483640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee40cdf10 0x7f6ee40b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 -- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee40b4fc0 msgr2=0x7f6ee415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee40b4fc0 0x7f6ee415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 -- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee40cdf10 msgr2=0x7f6ee40b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee40cdf10 0x7f6ee40b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 -- 172.21.15.104:0/465712392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee415ebc0 con 0x7f6ee40b3f00 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6edbfff640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee40b4fc0 0x7f6ee415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ee8c82640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b3f00 0x7f6ee40a03e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00099c0 tx=0x7f6ee00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ed97fa640 1 -- 172.21.15.104:0/465712392 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee003e030 con 0x7f6ee40b3f00 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ed97fa640 1 -- 172.21.15.104:0/465712392 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ee00047a0 con 0x7f6ee40b3f00 2024-09-17T02:55:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6ed97fa640 1 -- 172.21.15.104:0/465712392 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0035040 con 0x7f6ee40b3f00 2024-09-17T02:55:55.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee40ccd10 con 0x7f6ee40b3f00 2024-09-17T02:55:55.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.798+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee40ca620 con 0x7f6ee40b3f00 2024-09-17T02:55:55.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.799+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee40b39c0 con 0x7f6ee40b3f00 2024-09-17T02:55:55.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.801+0000 7f6ed97fa640 1 -- 172.21.15.104:0/465712392 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ee0041030 con 0x7f6ee40b3f00 2024-09-17T02:55:55.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.801+0000 7f6ed97fa640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078bc0 0x7f6ed007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:55.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.801+0000 7f6ed97fa640 1 -- 172.21.15.104:0/465712392 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f6ee00bb930 con 0x7f6ee40b3f00 2024-09-17T02:55:55.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.802+0000 7f6edbfff640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078bc0 0x7f6ed007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:55.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.802+0000 7f6edbfff640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078bc0 0x7f6ed007b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40cb950 tx=0x7f6ed4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.805+0000 7f6ed97fa640 1 -- 172.21.15.104:0/465712392 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ee0083e50 con 0x7f6ee40b3f00 2024-09-17T02:55:55.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.978+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ee40cead0 con 0x7f6ee40b3f00 2024-09-17T02:55:55.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.979+0000 7f6ed97fa640 1 -- 172.21.15.104:0/465712392 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16734 (secure 0 0 0) 0x7f6ee0083750 con 0x7f6ee40b3f00 2024-09-17T02:55:55.979 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:55.980 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":45,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:55.006690+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:52.652619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:53.964016+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:55.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.981+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078bc0 msgr2=0x7f6ed007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:55.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.981+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078bc0 0x7f6ed007b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40cb950 tx=0x7f6ed4009040 comp rx=0 tx=0).stop 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.981+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b3f00 msgr2=0x7f6ee40a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.981+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b3f00 0x7f6ee40a03e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00099c0 tx=0x7f6ee00039e0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.982+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 shutdown_connections 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.982+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078bc0 0x7f6ed007b0d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.982+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ee40cdf10 0x7f6ee40b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.982+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ee40b4fc0 0x7f6ee415b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.982+0000 7f6eeaee6640 1 --2- 172.21.15.104:0/465712392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ee40b3f00 0x7f6ee40a03e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.982+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 >> 172.21.15.104:0/465712392 conn(0x7f6ee40b44a0 msgr2=0x7f6ee415d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.982+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 shutdown_connections 2024-09-17T02:55:55.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:55.982+0000 7f6eeaee6640 1 -- 172.21.15.104:0/465712392 wait complete. 2024-09-17T02:55:55.993 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 -- 172.21.15.104:0/4262735555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800cd3f0 msgr2=0x7fc1800cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 --2- 172.21.15.104:0/4262735555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800cd3f0 0x7fc1800cd800 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc180069f10 tx=0x7fc17802a980 comp rx=0 tx=0).stop 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 -- 172.21.15.104:0/4262735555 shutdown_connections 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 --2- 172.21.15.104:0/4262735555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800cd3f0 0x7fc1800cd800 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 --2- 172.21.15.104:0/4262735555 >> v2:172.21.15.192:3300/0 conn(0x7fc1800cf460 0x7fc1800cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 --2- 172.21.15.104:0/4262735555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1800d3400 0x7fc1800cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 -- 172.21.15.104:0/4262735555 >> 172.21.15.104:0/4262735555 conn(0x7fc1800d28e0 msgr2=0x7fc1800d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 -- 172.21.15.104:0/4262735555 shutdown_connections 2024-09-17T02:55:56.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.105+0000 7fc184f01640 1 -- 172.21.15.104:0/4262735555 wait complete. 2024-09-17T02:55:56.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.107+0000 7fc184f01640 1 Processor -- start 2024-09-17T02:55:56.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.107+0000 7fc184f01640 1 -- start start 2024-09-17T02:55:56.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc184f01640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1800cd3f0 0x7fc18009f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc184f01640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1800cf460 0x7fc1801f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc184f01640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800d3400 0x7fc18014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc184f01640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc1800cdec0 con 0x7fc1800d3400 2024-09-17T02:55:56.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc184f01640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc1800cdd40 con 0x7fc1800cd3f0 2024-09-17T02:55:56.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc184f01640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc1800ce040 con 0x7fc1800cf460 2024-09-17T02:55:56.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800d3400 0x7fc18014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800d3400 0x7fc18014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45454/0 (socket says 172.21.15.104:45454) 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17ed9d640 1 -- 172.21.15.104:0/2579520455 learned_addr learned my addr 172.21.15.104:0/2579520455 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17e59c640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1800cd3f0 0x7fc18009f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17dd9b640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1800cf460 0x7fc1801f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17ed9d640 1 -- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1800cf460 msgr2=0x7fc1801f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17ed9d640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1800cf460 0x7fc1801f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17ed9d640 1 -- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1800cd3f0 msgr2=0x7fc18009f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17ed9d640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1800cd3f0 0x7fc18009f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.108+0000 7fc17ed9d640 1 -- 172.21.15.104:0/2579520455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1801f7c80 con 0x7fc1800d3400 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.109+0000 7fc17e59c640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1800cd3f0 0x7fc18009f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.109+0000 7fc17ed9d640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800d3400 0x7fc18014b420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc178033040 tx=0x7fc178003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.109+0000 7fc16effd640 1 -- 172.21.15.104:0/2579520455 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc178034040 con 0x7fc1800d3400 2024-09-17T02:55:56.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.109+0000 7fc16effd640 1 -- 172.21.15.104:0/2579520455 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc178004540 con 0x7fc1800d3400 2024-09-17T02:55:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.109+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1801f3950 con 0x7fc1800d3400 2024-09-17T02:55:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.109+0000 7fc16effd640 1 -- 172.21.15.104:0/2579520455 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc178045480 con 0x7fc1800d3400 2024-09-17T02:55:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.109+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18014e9c0 con 0x7fc1800d3400 2024-09-17T02:55:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.110+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18014e450 con 0x7fc1800d3400 2024-09-17T02:55:56.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.110+0000 7fc16effd640 1 -- 172.21.15.104:0/2579520455 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc178037020 con 0x7fc1800d3400 2024-09-17T02:55:56.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.111+0000 7fc16effd640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc160078b90 0x7fc16007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.111+0000 7fc16effd640 1 -- 172.21.15.104:0/2579520455 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fc1780bc480 con 0x7fc1800d3400 2024-09-17T02:55:56.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.111+0000 7fc17e59c640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc160078b90 0x7fc16007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.112+0000 7fc17e59c640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc160078b90 0x7fc16007b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc170009bd0 tx=0x7fc170005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:56.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.115+0000 7fc16effd640 1 -- 172.21.15.104:0/2579520455 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc178084950 con 0x7fc1800d3400 2024-09-17T02:55:56.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.291+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1801f3b20 con 0x7fc1800d3400 2024-09-17T02:55:56.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.292+0000 7fc16effd640 1 -- 172.21.15.104:0/2579520455 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16734 (secure 0 0 0) 0x7fc178084250 con 0x7fc1800d3400 2024-09-17T02:55:56.292 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:56.292 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":45,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:55.006690+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:52.652619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:53.964016+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc160078b90 msgr2=0x7fc16007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc160078b90 0x7fc16007b0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc170009bd0 tx=0x7fc170005f30 comp rx=0 tx=0).stop 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800d3400 msgr2=0x7fc18014b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800d3400 0x7fc18014b420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc178033040 tx=0x7fc178003f10 comp rx=0 tx=0).stop 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 shutdown_connections 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc160078b90 0x7fc16007b0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1800d3400 0x7fc18014b420 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1800cf460 0x7fc1801f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 --2- 172.21.15.104:0/2579520455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1800cd3f0 0x7fc18009f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 >> 172.21.15.104:0/2579520455 conn(0x7fc1800d28e0 msgr2=0x7fc1800b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:56.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 shutdown_connections 2024-09-17T02:55:56.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.294+0000 7fc184f01640 1 -- 172.21.15.104:0/2579520455 wait complete. 2024-09-17T02:55:56.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T02:55:56.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.420+0000 7fa7bd920640 1 -- 172.21.15.104:0/898395214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80b7c80 msgr2=0x7fa7b80b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.420+0000 7fa7bd920640 1 --2- 172.21.15.104:0/898395214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80b7c80 0x7fa7b80b20f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0005fd0 tx=0x7fa7a002a540 comp rx=0 tx=0).stop 2024-09-17T02:55:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.420+0000 7fa7bd920640 1 -- 172.21.15.104:0/898395214 shutdown_connections 2024-09-17T02:55:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.420+0000 7fa7bd920640 1 --2- 172.21.15.104:0/898395214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7b80b2630 0x7fa7b80b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.420+0000 7fa7bd920640 1 --2- 172.21.15.104:0/898395214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80b7c80 0x7fa7b80b20f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.420+0000 7fa7bd920640 1 -- 172.21.15.104:0/898395214 >> 172.21.15.104:0/898395214 conn(0x7fa7b80d2970 msgr2=0x7fa7b80d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.421+0000 7fa7bd920640 1 -- 172.21.15.104:0/898395214 shutdown_connections 2024-09-17T02:55:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.421+0000 7fa7bd920640 1 -- 172.21.15.104:0/898395214 wait complete. 2024-09-17T02:55:56.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.422+0000 7fa7bd920640 1 Processor -- start 2024-09-17T02:55:56.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.422+0000 7fa7bd920640 1 -- start start 2024-09-17T02:55:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7bd920640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7b80b2630 0x7fa7b815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7bd920640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7b80b7c80 0x7fa7b81f9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7bd920640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80d3490 0x7fa7b81f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7bd920640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b80b6bd0 con 0x7fa7b80d3490 2024-09-17T02:55:56.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7bd920640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b80b6a50 con 0x7fa7b80b7c80 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7bd920640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b80b6d50 con 0x7fa7b80b2630 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80d3490 0x7fa7b81f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80d3490 0x7fa7b81f9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45480/0 (socket says 172.21.15.104:45480) 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 -- 172.21.15.104:0/2957816223 learned_addr learned my addr 172.21.15.104:0/2957816223 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7affff640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7b80b7c80 0x7fa7b81f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b6ffd640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7b80b2630 0x7fa7b815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 -- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7b80b2630 msgr2=0x7fa7b815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7b80b2630 0x7fa7b815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 -- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7b80b7c80 msgr2=0x7fa7b81f9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7b80b7c80 0x7fa7b81f9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 -- 172.21.15.104:0/2957816223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b80c9940 con 0x7fa7b80d3490 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7affff640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7b80b7c80 0x7fa7b81f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:56.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b77fe640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80d3490 0x7fa7b81f9b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000ea70 tx=0x7fa7b000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b4ff9640 1 -- 172.21.15.104:0/2957816223 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000ce40 con 0x7fa7b80d3490 2024-09-17T02:55:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b4ff9640 1 -- 172.21.15.104:0/2957816223 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7b0004c10 con 0x7fa7b80d3490 2024-09-17T02:55:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b80c9c20 con 0x7fa7b80d3490 2024-09-17T02:55:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7b4ff9640 1 -- 172.21.15.104:0/2957816223 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0005020 con 0x7fa7b80d3490 2024-09-17T02:55:56.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.424+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b80cce00 con 0x7fa7b80d3490 2024-09-17T02:55:56.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.425+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b80b2a40 con 0x7fa7b80d3490 2024-09-17T02:55:56.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.426+0000 7fa7b4ff9640 1 -- 172.21.15.104:0/2957816223 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa7b00051c0 con 0x7fa7b80d3490 2024-09-17T02:55:56.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.427+0000 7fa7b4ff9640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa798078b90 0x7fa79807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.427+0000 7fa7b4ff9640 1 -- 172.21.15.104:0/2957816223 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa7b009bb70 con 0x7fa7b80d3490 2024-09-17T02:55:56.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.427+0000 7fa7b6ffd640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa798078b90 0x7fa79807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.427+0000 7fa7b6ffd640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa798078b90 0x7fa79807b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8001720 tx=0x7fa7a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:56.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.431+0000 7fa7b4ff9640 1 -- 172.21.15.104:0/2957816223 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa7b0063fb0 con 0x7fa7b80d3490 2024-09-17T02:55:56.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.641+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa7b815e950 con 0x7fa7b80d3490 2024-09-17T02:55:56.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.655+0000 7fa7b4ff9640 1 -- 172.21.15.104:0/2957816223 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7fa7b00638b0 con 0x7fa7b80d3490 2024-09-17T02:55:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa798078b90 msgr2=0x7fa79807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa798078b90 0x7fa79807b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8001720 tx=0x7fa7a8009040 comp rx=0 tx=0).stop 2024-09-17T02:55:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80d3490 msgr2=0x7fa7b81f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80d3490 0x7fa7b81f9b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000ea70 tx=0x7fa7b000ef30 comp rx=0 tx=0).stop 2024-09-17T02:55:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 shutdown_connections 2024-09-17T02:55:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa798078b90 0x7fa79807b0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7b80b7c80 0x7fa7b81f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7b80d3490 0x7fa7b81f9b70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 --2- 172.21.15.104:0/2957816223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7b80b2630 0x7fa7b815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 >> 172.21.15.104:0/2957816223 conn(0x7fa7b80d2970 msgr2=0x7fa7b80cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 shutdown_connections 2024-09-17T02:55:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.657+0000 7fa7bd920640 1 -- 172.21.15.104:0/2957816223 wait complete. 2024-09-17T02:55:56.668 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T02:55:56.669 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T02:55:56.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.786+0000 7f349cc27640 1 -- 172.21.15.104:0/1070971694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3480004d40 msgr2=0x7f34800051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.786+0000 7f349cc27640 1 --2- 172.21.15.104:0/1070971694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3480004d40 0x7f34800051f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3490001690 tx=0x7f3480005830 comp rx=0 tx=0).stop 2024-09-17T02:55:56.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.786+0000 7f3496d9d640 1 -- 172.21.15.104:0/1070971694 reap_dead start 2024-09-17T02:55:56.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.786+0000 7f349cc27640 1 -- 172.21.15.104:0/1070971694 shutdown_connections 2024-09-17T02:55:56.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.786+0000 7f349cc27640 1 -- 172.21.15.104:0/1070971694 >> 172.21.15.104:0/1070971694 conn(0x7f34980b3640 msgr2=0x7f34980b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:56.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.786+0000 7f349cc27640 1 -- 172.21.15.104:0/1070971694 shutdown_connections 2024-09-17T02:55:56.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.786+0000 7f349cc27640 1 -- 172.21.15.104:0/1070971694 wait complete. 2024-09-17T02:55:56.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.788+0000 7f349cc27640 1 Processor -- start 2024-09-17T02:55:56.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.788+0000 7f349cc27640 1 -- start start 2024-09-17T02:55:56.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f349cc27640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3480004d40 0x7f34981413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f349cc27640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34981e57a0 0x7f34980cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f349cc27640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34980d0240 0x7f34981f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f349cc27640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3498073d20 con 0x7f34981e57a0 2024-09-17T02:55:56.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f349cc27640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3498073ba0 con 0x7f34980d0240 2024-09-17T02:55:56.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f349cc27640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f34980b5800 con 0x7f3480004d40 2024-09-17T02:55:56.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f3495d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34981e57a0 0x7f34980cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f3495d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34981e57a0 0x7f34980cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45506/0 (socket says 172.21.15.104:45506) 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f3495d9b640 1 -- 172.21.15.104:0/801008409 learned_addr learned my addr 172.21.15.104:0/801008409 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f3496d9d640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34980d0240 0x7f34981f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f349659c640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3480004d40 0x7f34981413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f3495d9b640 1 -- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3480004d40 msgr2=0x7f34981413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f3495d9b640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3480004d40 0x7f34981413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f3495d9b640 1 -- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34980d0240 msgr2=0x7f34981f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.789+0000 7f3495d9b640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34980d0240 0x7f34981f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.790+0000 7f3495d9b640 1 -- 172.21.15.104:0/801008409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34980d0650 con 0x7f34981e57a0 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.790+0000 7f349659c640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3480004d40 0x7f34981413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.790+0000 7f3495d9b640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34981e57a0 0x7f34980cfd00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f348c009e00 tx=0x7f348c011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.790+0000 7f3486ffd640 1 -- 172.21.15.104:0/801008409 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c01b070 con 0x7f34981e57a0 2024-09-17T02:55:56.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.790+0000 7f3486ffd640 1 -- 172.21.15.104:0/801008409 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f348c00fe70 con 0x7f34981e57a0 2024-09-17T02:55:56.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.790+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34981f28c0 con 0x7f34981e57a0 2024-09-17T02:55:56.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.790+0000 7f3486ffd640 1 -- 172.21.15.104:0/801008409 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348c004290 con 0x7f34981e57a0 2024-09-17T02:55:56.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.790+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34981f2e80 con 0x7f34981e57a0 2024-09-17T02:55:56.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.791+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34980b5d60 con 0x7f34981e57a0 2024-09-17T02:55:56.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.792+0000 7f3486ffd640 1 -- 172.21.15.104:0/801008409 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f348c01e070 con 0x7f34981e57a0 2024-09-17T02:55:56.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.792+0000 7f3486ffd640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3478078bc0 0x7f347807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:56.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.792+0000 7f3486ffd640 1 -- 172.21.15.104:0/801008409 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f348c09e3a0 con 0x7f34981e57a0 2024-09-17T02:55:56.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.793+0000 7f349659c640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3478078bc0 0x7f347807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:56.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.793+0000 7f349659c640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3478078bc0 0x7f347807b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3488001330 tx=0x7f3488006c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:56.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:56.796+0000 7f3486ffd640 1 -- 172.21.15.104:0/801008409 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34980d0650 con 0x7f34981e57a0 2024-09-17T02:55:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.006+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f34981e5f10 con 0x7f34981e57a0 2024-09-17T02:55:57.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.662+0000 7f3486ffd640 1 -- 172.21.15.104:0/801008409 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f348c066270 con 0x7f34981e57a0 2024-09-17T02:55:57.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3478078bc0 msgr2=0x7f347807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:57.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3478078bc0 0x7f347807b0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3488001330 tx=0x7f3488006c50 comp rx=0 tx=0).stop 2024-09-17T02:55:57.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34981e57a0 msgr2=0x7f34980cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34981e57a0 0x7f34980cfd00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f348c009e00 tx=0x7f348c011eb0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 shutdown_connections 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3478078bc0 0x7f347807b0d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34980d0240 0x7f34981f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34981e57a0 0x7f34980cfd00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 --2- 172.21.15.104:0/801008409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3480004d40 0x7f34981413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 >> 172.21.15.104:0/801008409 conn(0x7f34980b3640 msgr2=0x7f34980d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 shutdown_connections 2024-09-17T02:55:57.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.665+0000 7f349cc27640 1 -- 172.21.15.104:0/801008409 wait complete. 2024-09-17T02:55:57.677 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T02:55:57.678 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:57.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.796+0000 7fe4bf720640 1 -- 172.21.15.104:0/4241740041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 msgr2=0x7fe4b815bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:57.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.796+0000 7fe4bf720640 1 --2- 172.21.15.104:0/4241740041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 0x7fe4b815bc00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe4b806ecb0 tx=0x7fe4a802a950 comp rx=0 tx=0).stop 2024-09-17T02:55:57.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.796+0000 7fe4bf720640 1 -- 172.21.15.104:0/4241740041 shutdown_connections 2024-09-17T02:55:57.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.796+0000 7fe4bf720640 1 --2- 172.21.15.104:0/4241740041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4b8072470 0x7fe4b8072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.796+0000 7fe4bf720640 1 --2- 172.21.15.104:0/4241740041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 0x7fe4b815bc00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.796+0000 7fe4bf720640 1 -- 172.21.15.104:0/4241740041 >> 172.21.15.104:0/4241740041 conn(0x7fe4b80b2450 msgr2=0x7fe4b80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.796+0000 7fe4bf720640 1 -- 172.21.15.104:0/4241740041 shutdown_connections 2024-09-17T02:55:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.796+0000 7fe4bf720640 1 -- 172.21.15.104:0/4241740041 wait complete. 2024-09-17T02:55:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.798+0000 7fe4bf720640 1 Processor -- start 2024-09-17T02:55:57.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.798+0000 7fe4bf720640 1 -- start start 2024-09-17T02:55:57.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bf720640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4b8072470 0x7fe4b815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bf720640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4b8072dc0 0x7fe4b80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bf720640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 0x7fe4b80b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bf720640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b815fe30 con 0x7fe4b815b7f0 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bf720640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b80cf4a0 con 0x7fe4b8072dc0 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bf720640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b815ffb0 con 0x7fe4b8072470 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bdcbd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 0x7fe4b80b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bdcbd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 0x7fe4b80b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45534/0 (socket says 172.21.15.104:45534) 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bdcbd640 1 -- 172.21.15.104:0/3443944863 learned_addr learned my addr 172.21.15.104:0/3443944863 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bd4bc640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4b8072470 0x7fe4b815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.799+0000 7fe4bccbb640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4b8072dc0 0x7fe4b80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:57.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4bdcbd640 1 -- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4b8072470 msgr2=0x7fe4b815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4bdcbd640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4b8072470 0x7fe4b815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4bdcbd640 1 -- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4b8072dc0 msgr2=0x7fe4b80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4bdcbd640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4b8072dc0 0x7fe4b80ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4bdcbd640 1 -- 172.21.15.104:0/3443944863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b81f95e0 con 0x7fe4b815b7f0 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4bdcbd640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 0x7fe4b80b48c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000b440 tx=0x7fe4b000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4b5ffb640 1 -- 172.21.15.104:0/3443944863 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0015020 con 0x7fe4b815b7f0 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4b5ffb640 1 -- 172.21.15.104:0/3443944863 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4b0011940 con 0x7fe4b815b7f0 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b81f98c0 con 0x7fe4b815b7f0 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4b5ffb640 1 -- 172.21.15.104:0/3443944863 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0011d90 con 0x7fe4b815b7f0 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.800+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b81f9e80 con 0x7fe4b815b7f0 2024-09-17T02:55:57.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.801+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b8160530 con 0x7fe4b815b7f0 2024-09-17T02:55:57.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.802+0000 7fe4b5ffb640 1 -- 172.21.15.104:0/3443944863 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4b0018020 con 0x7fe4b815b7f0 2024-09-17T02:55:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.802+0000 7fe4b5ffb640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.803+0000 7fe4b5ffb640 1 -- 172.21.15.104:0/3443944863 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe4b009a980 con 0x7fe4b815b7f0 2024-09-17T02:55:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.803+0000 7fe4bd4bc640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:57.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.803+0000 7fe4bd4bc640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe4a4078b90 0x7fe4a407b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8035000 tx=0x7fe4a8004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:57.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:57.807+0000 7fe4b5ffb640 1 -- 172.21.15.104:0/3443944863 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe4b001f020 con 0x7fe4b815b7f0 2024-09-17T02:55:58.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.014+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4b8156c60 con 0x7fe4b815b7f0 2024-09-17T02:55:58.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.015+0000 7fe4b5ffb640 1 -- 172.21.15.104:0/3443944863 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7fe4b0062890 con 0x7fe4b815b7f0 2024-09-17T02:55:58.014 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:58.014 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:55:58.014 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:55:58.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe4a4078b90 msgr2=0x7fe4a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe4a4078b90 0x7fe4a407b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8035000 tx=0x7fe4a8004ab0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 msgr2=0x7fe4b80b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 0x7fe4b80b48c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000b440 tx=0x7fe4b000b900 comp rx=0 tx=0).stop 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 shutdown_connections 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4b8072dc0 0x7fe4b80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe4b815b7f0 0x7fe4b80b48c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 --2- 172.21.15.104:0/3443944863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4b8072470 0x7fe4b815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 >> 172.21.15.104:0/3443944863 conn(0x7fe4b80b2450 msgr2=0x7fe4b80cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 shutdown_connections 2024-09-17T02:55:58.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.017+0000 7fe4bf720640 1 -- 172.21.15.104:0/3443944863 wait complete. 2024-09-17T02:55:58.028 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:55:58.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.141+0000 7f414863f640 1 -- 172.21.15.104:0/2033113973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 msgr2=0x7f41400b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.141+0000 7f414863f640 1 --2- 172.21.15.104:0/2033113973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 0x7f41400b57e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f41400cf770 tx=0x7f413002a530 comp rx=0 tx=0).stop 2024-09-17T02:55:58.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.141+0000 7f414863f640 1 -- 172.21.15.104:0/2033113973 shutdown_connections 2024-09-17T02:55:58.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.141+0000 7f414863f640 1 --2- 172.21.15.104:0/2033113973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 0x7f41400b57e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.141+0000 7f414863f640 1 -- 172.21.15.104:0/2033113973 >> 172.21.15.104:0/2033113973 conn(0x7f41400b44a0 msgr2=0x7f41400b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:58.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.141+0000 7f414863f640 1 -- 172.21.15.104:0/2033113973 shutdown_connections 2024-09-17T02:55:58.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.141+0000 7f414863f640 1 -- 172.21.15.104:0/2033113973 wait complete. 2024-09-17T02:55:58.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.143+0000 7f414863f640 1 Processor -- start 2024-09-17T02:55:58.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.143+0000 7f414863f640 1 -- start start 2024-09-17T02:55:58.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f414863f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41400b4fc0 0x7f41401549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f414863f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41400b5d20 0x7f4140154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f414863f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 0x7f41400ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f414863f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4140168390 con 0x7f41400b4fc0 2024-09-17T02:55:58.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f414863f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4140168210 con 0x7f41400cdf10 2024-09-17T02:55:58.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f414863f640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4140168510 con 0x7f41400b5d20 2024-09-17T02:55:58.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f41463db640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41400b4fc0 0x7f41401549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f41463db640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41400b4fc0 0x7f41401549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45540/0 (socket says 172.21.15.104:45540) 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f41463db640 1 -- 172.21.15.104:0/630950576 learned_addr learned my addr 172.21.15.104:0/630950576 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f4145bda640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41400b5d20 0x7f4140154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.144+0000 7f4146bdc640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 0x7f41400ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f41463db640 1 -- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41400b5d20 msgr2=0x7f4140154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f41463db640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41400b5d20 0x7f4140154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f41463db640 1 -- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 msgr2=0x7f41400ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f41463db640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 0x7f41400ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f41463db640 1 -- 172.21.15.104:0/630950576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41400c92f0 con 0x7f41400b4fc0 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f4145bda640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41400b5d20 0x7f4140154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f4146bdc640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 0x7f41400ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f41463db640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41400b4fc0 0x7f41401549f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f413c001220 tx=0x7f413c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:58.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f4136ffd640 1 -- 172.21.15.104:0/630950576 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c016020 con 0x7f41400b4fc0 2024-09-17T02:55:58.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41400c8250 con 0x7f41400b4fc0 2024-09-17T02:55:58.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f4136ffd640 1 -- 172.21.15.104:0/630950576 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f413c012920 con 0x7f41400b4fc0 2024-09-17T02:55:58.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f4136ffd640 1 -- 172.21.15.104:0/630950576 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c012d70 con 0x7f41400b4fc0 2024-09-17T02:55:58.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.145+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41400c8810 con 0x7f41400b4fc0 2024-09-17T02:55:58.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.146+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41400b57e0 con 0x7f41400b4fc0 2024-09-17T02:55:58.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.147+0000 7f4136ffd640 1 -- 172.21.15.104:0/630950576 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f413c019020 con 0x7f41400b4fc0 2024-09-17T02:55:58.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.147+0000 7f4136ffd640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4124078b90 0x7f412407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.147+0000 7f4136ffd640 1 -- 172.21.15.104:0/630950576 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f413c09ae90 con 0x7f41400b4fc0 2024-09-17T02:55:58.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.147+0000 7f4145bda640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4124078b90 0x7f412407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.148+0000 7f4145bda640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4124078b90 0x7f412407b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4130034000 tx=0x7f4130004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:58.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.152+0000 7f4136ffd640 1 -- 172.21.15.104:0/630950576 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f413c020020 con 0x7f41400b4fc0 2024-09-17T02:55:58.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.325+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41400cead0 con 0x7f41400b4fc0 2024-09-17T02:55:58.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.326+0000 7f4136ffd640 1 -- 172.21.15.104:0/630950576 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16721 (secure 0 0 0) 0x7f413c0632e0 con 0x7f41400b4fc0 2024-09-17T02:55:58.326 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:58.326 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":46,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:55:56.643966+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:52.652619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:53.964016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:55:58.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4124078b90 msgr2=0x7f412407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4124078b90 0x7f412407b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4130034000 tx=0x7f4130004730 comp rx=0 tx=0).stop 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41400b4fc0 msgr2=0x7f41401549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41400b4fc0 0x7f41401549f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f413c001220 tx=0x7f413c00c940 comp rx=0 tx=0).stop 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 shutdown_connections 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4124078b90 0x7f412407b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41400cdf10 0x7f41400ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41400b5d20 0x7f4140154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 --2- 172.21.15.104:0/630950576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41400b4fc0 0x7f41401549f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 >> 172.21.15.104:0/630950576 conn(0x7f41400b44a0 msgr2=0x7f41400b7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 shutdown_connections 2024-09-17T02:55:58.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.329+0000 7f414863f640 1 -- 172.21.15.104:0/630950576 wait complete. 2024-09-17T02:55:58.340 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:55:58.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:55:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.453+0000 7fc0a647e640 1 -- 172.21.15.104:0/1757855114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 msgr2=0x7fc08c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.453+0000 7fc0a647e640 1 --2- 172.21.15.104:0/1757855114 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 0x7fc08c004800 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c310 tx=0x7fc08c005830 comp rx=0 tx=0).stop 2024-09-17T02:55:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.453+0000 7fc0a4a1b640 1 -- 172.21.15.104:0/1757855114 reap_dead start 2024-09-17T02:55:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.453+0000 7fc0a647e640 1 -- 172.21.15.104:0/1757855114 shutdown_connections 2024-09-17T02:55:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.453+0000 7fc0a647e640 1 -- 172.21.15.104:0/1757855114 >> 172.21.15.104:0/1757855114 conn(0x7fc0a00d28a0 msgr2=0x7fc0a00d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.453+0000 7fc0a647e640 1 -- 172.21.15.104:0/1757855114 shutdown_connections 2024-09-17T02:55:58.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.453+0000 7fc0a647e640 1 -- 172.21.15.104:0/1757855114 wait complete. 2024-09-17T02:55:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.454+0000 7fc0a647e640 1 Processor -- start 2024-09-17T02:55:58.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.455+0000 7fc0a647e640 1 -- start start 2024-09-17T02:55:58.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc0a647e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 0x7fc0a01e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc0a647e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0a01d8420 0x7fc0a01d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc0a647e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a00b17e0 0x7fc0a00b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc0a647e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a00cde90 con 0x7fc08c0040b0 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc0a647e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a00cfd90 con 0x7fc0a00b17e0 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc0a647e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a00ce010 con 0x7fc0a01d8420 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 0x7fc0a01e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 0x7fc0a01e92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45552/0 (socket says 172.21.15.104:45552) 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 -- 172.21.15.104:0/1857842289 learned_addr learned my addr 172.21.15.104:0/1857842289 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 -- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0a01d8420 msgr2=0x7fc0a01d4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0a01d8420 0x7fc0a01d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 -- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a00b17e0 msgr2=0x7fc0a00b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a00b17e0 0x7fc0a00b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 -- 172.21.15.104:0/1857842289 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a00b2130 con 0x7fc08c0040b0 2024-09-17T02:55:58.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09ffff640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 0x7fc0a01e92e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc09000b5d0 tx=0x7fc09000ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:58.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.456+0000 7fc09d7fa640 1 -- 172.21.15.104:0/1857842289 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc090010ae0 con 0x7fc08c0040b0 2024-09-17T02:55:58.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.457+0000 7fc09d7fa640 1 -- 172.21.15.104:0/1857842289 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc090015070 con 0x7fc08c0040b0 2024-09-17T02:55:58.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.457+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a01d6270 con 0x7fc08c0040b0 2024-09-17T02:55:58.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.457+0000 7fc09d7fa640 1 -- 172.21.15.104:0/1857842289 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09001a470 con 0x7fc08c0040b0 2024-09-17T02:55:58.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.457+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a01d6830 con 0x7fc08c0040b0 2024-09-17T02:55:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.458+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a006a700 con 0x7fc08c0040b0 2024-09-17T02:55:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.458+0000 7fc09d7fa640 1 -- 172.21.15.104:0/1857842289 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc09001a610 con 0x7fc08c0040b0 2024-09-17T02:55:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.459+0000 7fc09d7fa640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc080078bc0 0x7fc08007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.459+0000 7fc09d7fa640 1 -- 172.21.15.104:0/1857842289 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fc09009b950 con 0x7fc08c0040b0 2024-09-17T02:55:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.459+0000 7fc097fff640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc080078bc0 0x7fc08007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.460+0000 7fc097fff640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc080078bc0 0x7fc08007b0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc088033000 tx=0x7fc0a00d3870 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:58.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.463+0000 7fc09d7fa640 1 -- 172.21.15.104:0/1857842289 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0a00b2130 con 0x7fc08c0040b0 2024-09-17T02:55:58.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.633+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0a00ce5a0 con 0x7fc080078bc0 2024-09-17T02:55:58.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.638+0000 7fc09d7fa640 1 -- 172.21.15.104:0/1857842289 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247474 (secure 0 0 0) 0x7fc0a00ce5a0 con 0x7fc080078bc0 2024-09-17T02:55:58.640 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:58.641 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:55:58.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc080078bc0 msgr2=0x7fc08007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc080078bc0 0x7fc08007b0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc088033000 tx=0x7fc0a00d3870 comp rx=0 tx=0).stop 2024-09-17T02:55:58.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 msgr2=0x7fc0a01e92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 0x7fc0a01e92e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc09000b5d0 tx=0x7fc09000ba90 comp rx=0 tx=0).stop 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 shutdown_connections 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc080078bc0 0x7fc08007b0d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a00b17e0 0x7fc0a00b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0a01d8420 0x7fc0a01d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 --2- 172.21.15.104:0/1857842289 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc08c0040b0 0x7fc0a01e92e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 >> 172.21.15.104:0/1857842289 conn(0x7fc0a00d28a0 msgr2=0x7fc0a01e8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 shutdown_connections 2024-09-17T02:55:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.641+0000 7fc0a647e640 1 -- 172.21.15.104:0/1857842289 wait complete. 2024-09-17T02:55:58.652 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-17T02:55:57.637445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559680,"statfs":{"total":1600000000,"available":1597113148,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002065"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659236+0000","last_change":"2024-09-17T02:55:55.658450+0000","last_active":"2024-09-17T02:55:55.659236+0000","last_peered":"2024-09-17T02:55:55.659236+0000","last_clean":"2024-09-17T02:55:55.659236+0000","last_became_active":"2024-09-17T02:55:55.658187+0000","last_became_peered":"2024-09-17T02:55:55.658187+0000","last_unstale":"2024-09-17T02:55:55.659236+0000","last_undegraded":"2024-09-17T02:55:55.659236+0000","last_fullsized":"2024-09-17T02:55:55.659236+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:19.963772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.663864+0000","last_change":"2024-09-17T02:55:55.663530+0000","last_active":"2024-09-17T02:55:55.663864+0000","last_peered":"2024-09-17T02:55:55.663864+0000","last_clean":"2024-09-17T02:55:55.663864+0000","last_became_active":"2024-09-17T02:55:55.663201+0000","last_became_peered":"2024-09-17T02:55:55.663201+0000","last_unstale":"2024-09-17T02:55:55.663864+0000","last_undegraded":"2024-09-17T02:55:55.663864+0000","last_fullsized":"2024-09-17T02:55:55.663864+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:57.411828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659822+0000","last_change":"2024-09-17T02:55:55.659447+0000","last_active":"2024-09-17T02:55:55.659822+0000","last_peered":"2024-09-17T02:55:55.659822+0000","last_clean":"2024-09-17T02:55:55.659822+0000","last_became_active":"2024-09-17T02:55:55.658603+0000","last_became_peered":"2024-09-17T02:55:55.658603+0000","last_unstale":"2024-09-17T02:55:55.659822+0000","last_undegraded":"2024-09-17T02:55:55.659822+0000","last_fullsized":"2024-09-17T02:55:55.659822+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:36.241365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657665+0000","last_change":"2024-09-17T02:55:55.657462+0000","last_active":"2024-09-17T02:55:55.657665+0000","last_peered":"2024-09-17T02:55:55.657665+0000","last_clean":"2024-09-17T02:55:55.657665+0000","last_became_active":"2024-09-17T02:55:55.655976+0000","last_became_peered":"2024-09-17T02:55:55.655976+0000","last_unstale":"2024-09-17T02:55:55.657665+0000","last_undegraded":"2024-09-17T02:55:55.657665+0000","last_fullsized":"2024-09-17T02:55:55.657665+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:03.042709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.655913+0000","last_change":"2024-09-17T02:55:55.654352+0000","last_active":"2024-09-17T02:55:55.655913+0000","last_peered":"2024-09-17T02:55:55.655913+0000","last_clean":"2024-09-17T02:55:55.655913+0000","last_became_active":"2024-09-17T02:55:55.654086+0000","last_became_peered":"2024-09-17T02:55:55.654086+0000","last_unstale":"2024-09-17T02:55:55.655913+0000","last_undegraded":"2024-09-17T02:55:55.655913+0000","last_fullsized":"2024-09-17T02:55:55.655913+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:31.433502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665229+0000","last_change":"2024-09-17T02:55:55.665026+0000","last_active":"2024-09-17T02:55:55.665229+0000","last_peered":"2024-09-17T02:55:55.665229+0000","last_clean":"2024-09-17T02:55:55.665229+0000","last_became_active":"2024-09-17T02:55:55.660649+0000","last_became_peered":"2024-09-17T02:55:55.660649+0000","last_unstale":"2024-09-17T02:55:55.665229+0000","last_undegraded":"2024-09-17T02:55:55.665229+0000","last_fullsized":"2024-09-17T02:55:55.665229+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:10.479621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659260+0000","last_change":"2024-09-17T02:55:55.658971+0000","last_active":"2024-09-17T02:55:55.659260+0000","last_peered":"2024-09-17T02:55:55.659260+0000","last_clean":"2024-09-17T02:55:55.659260+0000","last_became_active":"2024-09-17T02:55:55.658733+0000","last_became_peered":"2024-09-17T02:55:55.658733+0000","last_unstale":"2024-09-17T02:55:55.659260+0000","last_undegraded":"2024-09-17T02:55:55.659260+0000","last_fullsized":"2024-09-17T02:55:55.659260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:06.005248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659620+0000","last_change":"2024-09-17T02:55:55.659433+0000","last_active":"2024-09-17T02:55:55.659620+0000","last_peered":"2024-09-17T02:55:55.659620+0000","last_clean":"2024-09-17T02:55:55.659620+0000","last_became_active":"2024-09-17T02:55:55.658833+0000","last_became_peered":"2024-09-17T02:55:55.658833+0000","last_unstale":"2024-09-17T02:55:55.659620+0000","last_undegraded":"2024-09-17T02:55:55.659620+0000","last_fullsized":"2024-09-17T02:55:55.659620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:27.595071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.666532+0000","last_change":"2024-09-17T02:55:55.666264+0000","last_active":"2024-09-17T02:55:55.666532+0000","last_peered":"2024-09-17T02:55:55.666532+0000","last_clean":"2024-09-17T02:55:55.666532+0000","last_became_active":"2024-09-17T02:55:55.665688+0000","last_became_peered":"2024-09-17T02:55:55.665688+0000","last_unstale":"2024-09-17T02:55:55.666532+0000","last_undegraded":"2024-09-17T02:55:55.666532+0000","last_fullsized":"2024-09-17T02:55:55.666532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:31.504974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657210+0000","last_change":"2024-09-17T02:55:55.657007+0000","last_active":"2024-09-17T02:55:55.657210+0000","last_peered":"2024-09-17T02:55:55.657210+0000","last_clean":"2024-09-17T02:55:55.657210+0000","last_became_active":"2024-09-17T02:55:55.656694+0000","last_became_peered":"2024-09-17T02:55:55.656694+0000","last_unstale":"2024-09-17T02:55:55.657210+0000","last_undegraded":"2024-09-17T02:55:55.657210+0000","last_fullsized":"2024-09-17T02:55:55.657210+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:36.156729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.660940+0000","last_change":"2024-09-17T02:55:55.660727+0000","last_active":"2024-09-17T02:55:55.660940+0000","last_peered":"2024-09-17T02:55:55.660940+0000","last_clean":"2024-09-17T02:55:55.660940+0000","last_became_active":"2024-09-17T02:55:55.660455+0000","last_became_peered":"2024-09-17T02:55:55.660455+0000","last_unstale":"2024-09-17T02:55:55.660940+0000","last_undegraded":"2024-09-17T02:55:55.660940+0000","last_fullsized":"2024-09-17T02:55:55.660940+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:42.649857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661209+0000","last_change":"2024-09-17T02:55:55.660871+0000","last_active":"2024-09-17T02:55:55.661209+0000","last_peered":"2024-09-17T02:55:55.661209+0000","last_clean":"2024-09-17T02:55:55.661209+0000","last_became_active":"2024-09-17T02:55:55.659510+0000","last_became_peered":"2024-09-17T02:55:55.659510+0000","last_unstale":"2024-09-17T02:55:55.661209+0000","last_undegraded":"2024-09-17T02:55:55.661209+0000","last_fullsized":"2024-09-17T02:55:55.661209+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:54.829751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659736+0000","last_change":"2024-09-17T02:55:55.657914+0000","last_active":"2024-09-17T02:55:55.659736+0000","last_peered":"2024-09-17T02:55:55.659736+0000","last_clean":"2024-09-17T02:55:55.659736+0000","last_became_active":"2024-09-17T02:55:55.657632+0000","last_became_peered":"2024-09-17T02:55:55.657632+0000","last_unstale":"2024-09-17T02:55:55.659736+0000","last_undegraded":"2024-09-17T02:55:55.659736+0000","last_fullsized":"2024-09-17T02:55:55.659736+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:07.911943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.668948+0000","last_change":"2024-09-17T02:55:55.666664+0000","last_active":"2024-09-17T02:55:55.668948+0000","last_peered":"2024-09-17T02:55:55.668948+0000","last_clean":"2024-09-17T02:55:55.668948+0000","last_became_active":"2024-09-17T02:55:55.666017+0000","last_became_peered":"2024-09-17T02:55:55.666017+0000","last_unstale":"2024-09-17T02:55:55.668948+0000","last_undegraded":"2024-09-17T02:55:55.668948+0000","last_fullsized":"2024-09-17T02:55:55.668948+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:54.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654589+0000","last_change":"2024-09-17T02:55:55.654160+0000","last_active":"2024-09-17T02:55:55.654589+0000","last_peered":"2024-09-17T02:55:55.654589+0000","last_clean":"2024-09-17T02:55:55.654589+0000","last_became_active":"2024-09-17T02:55:55.653900+0000","last_became_peered":"2024-09-17T02:55:55.653900+0000","last_unstale":"2024-09-17T02:55:55.654589+0000","last_undegraded":"2024-09-17T02:55:55.654589+0000","last_fullsized":"2024-09-17T02:55:55.654589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:22.520838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654444+0000","last_change":"2024-09-17T02:55:55.653961+0000","last_active":"2024-09-17T02:55:55.654444+0000","last_peered":"2024-09-17T02:55:55.654444+0000","last_clean":"2024-09-17T02:55:55.654444+0000","last_became_active":"2024-09-17T02:55:55.653239+0000","last_became_peered":"2024-09-17T02:55:55.653239+0000","last_unstale":"2024-09-17T02:55:55.654444+0000","last_undegraded":"2024-09-17T02:55:55.654444+0000","last_fullsized":"2024-09-17T02:55:55.654444+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:09.425347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.663023+0000","last_change":"2024-09-17T02:55:55.662832+0000","last_active":"2024-09-17T02:55:55.663023+0000","last_peered":"2024-09-17T02:55:55.663023+0000","last_clean":"2024-09-17T02:55:55.663023+0000","last_became_active":"2024-09-17T02:55:55.662154+0000","last_became_peered":"2024-09-17T02:55:55.662154+0000","last_unstale":"2024-09-17T02:55:55.663023+0000","last_undegraded":"2024-09-17T02:55:55.663023+0000","last_fullsized":"2024-09-17T02:55:55.663023+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:08.813895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.663695+0000","last_change":"2024-09-17T02:55:55.663477+0000","last_active":"2024-09-17T02:55:55.663695+0000","last_peered":"2024-09-17T02:55:55.663695+0000","last_clean":"2024-09-17T02:55:55.663695+0000","last_became_active":"2024-09-17T02:55:55.663211+0000","last_became_peered":"2024-09-17T02:55:55.663211+0000","last_unstale":"2024-09-17T02:55:55.663695+0000","last_undegraded":"2024-09-17T02:55:55.663695+0000","last_fullsized":"2024-09-17T02:55:55.663695+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:57.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.653811+0000","last_change":"2024-09-17T02:55:55.653067+0000","last_active":"2024-09-17T02:55:55.653811+0000","last_peered":"2024-09-17T02:55:55.653811+0000","last_clean":"2024-09-17T02:55:55.653811+0000","last_became_active":"2024-09-17T02:55:55.652776+0000","last_became_peered":"2024-09-17T02:55:55.652776+0000","last_unstale":"2024-09-17T02:55:55.653811+0000","last_undegraded":"2024-09-17T02:55:55.653811+0000","last_fullsized":"2024-09-17T02:55:55.653811+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:09.559069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.655673+0000","last_change":"2024-09-17T02:55:55.655405+0000","last_active":"2024-09-17T02:55:55.655673+0000","last_peered":"2024-09-17T02:55:55.655673+0000","last_clean":"2024-09-17T02:55:55.655673+0000","last_became_active":"2024-09-17T02:55:55.655130+0000","last_became_peered":"2024-09-17T02:55:55.655130+0000","last_unstale":"2024-09-17T02:55:55.655673+0000","last_undegraded":"2024-09-17T02:55:55.655673+0000","last_fullsized":"2024-09-17T02:55:55.655673+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:45.180632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661425+0000","last_change":"2024-09-17T02:55:55.661234+0000","last_active":"2024-09-17T02:55:55.661425+0000","last_peered":"2024-09-17T02:55:55.661425+0000","last_clean":"2024-09-17T02:55:55.661425+0000","last_became_active":"2024-09-17T02:55:55.659746+0000","last_became_peered":"2024-09-17T02:55:55.659746+0000","last_unstale":"2024-09-17T02:55:55.661425+0000","last_undegraded":"2024-09-17T02:55:55.661425+0000","last_fullsized":"2024-09-17T02:55:55.661425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:42.822280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.656420+0000","last_change":"2024-09-17T02:55:55.656203+0000","last_active":"2024-09-17T02:55:55.656420+0000","last_peered":"2024-09-17T02:55:55.656420+0000","last_clean":"2024-09-17T02:55:55.656420+0000","last_became_active":"2024-09-17T02:55:55.655901+0000","last_became_peered":"2024-09-17T02:55:55.655901+0000","last_unstale":"2024-09-17T02:55:55.656420+0000","last_undegraded":"2024-09-17T02:55:55.656420+0000","last_fullsized":"2024-09-17T02:55:55.656420+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:50.061958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657208+0000","last_change":"2024-09-17T02:55:55.656999+0000","last_active":"2024-09-17T02:55:55.657208+0000","last_peered":"2024-09-17T02:55:55.657208+0000","last_clean":"2024-09-17T02:55:55.657208+0000","last_became_active":"2024-09-17T02:55:55.656079+0000","last_became_peered":"2024-09-17T02:55:55.656079+0000","last_unstale":"2024-09-17T02:55:55.657208+0000","last_undegraded":"2024-09-17T02:55:55.657208+0000","last_fullsized":"2024-09-17T02:55:55.657208+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:18.478477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.660069+0000","last_change":"2024-09-17T02:55:55.657510+0000","last_active":"2024-09-17T02:55:55.660069+0000","last_peered":"2024-09-17T02:55:55.660069+0000","last_clean":"2024-09-17T02:55:55.660069+0000","last_became_active":"2024-09-17T02:55:55.656140+0000","last_became_peered":"2024-09-17T02:55:55.656140+0000","last_unstale":"2024-09-17T02:55:55.660069+0000","last_undegraded":"2024-09-17T02:55:55.660069+0000","last_fullsized":"2024-09-17T02:55:55.660069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:30.195457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665736+0000","last_change":"2024-09-17T02:55:55.665539+0000","last_active":"2024-09-17T02:55:55.665736+0000","last_peered":"2024-09-17T02:55:55.665736+0000","last_clean":"2024-09-17T02:55:55.665736+0000","last_became_active":"2024-09-17T02:55:55.664994+0000","last_became_peered":"2024-09-17T02:55:55.664994+0000","last_unstale":"2024-09-17T02:55:55.665736+0000","last_undegraded":"2024-09-17T02:55:55.665736+0000","last_fullsized":"2024-09-17T02:55:55.665736+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:32.258529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.655622+0000","last_change":"2024-09-17T02:55:55.654896+0000","last_active":"2024-09-17T02:55:55.655622+0000","last_peered":"2024-09-17T02:55:55.655622+0000","last_clean":"2024-09-17T02:55:55.655622+0000","last_became_active":"2024-09-17T02:55:55.654338+0000","last_became_peered":"2024-09-17T02:55:55.654338+0000","last_unstale":"2024-09-17T02:55:55.655622+0000","last_undegraded":"2024-09-17T02:55:55.655622+0000","last_fullsized":"2024-09-17T02:55:55.655622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:59.260716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662694+0000","last_change":"2024-09-17T02:55:55.662446+0000","last_active":"2024-09-17T02:55:55.662694+0000","last_peered":"2024-09-17T02:55:55.662694+0000","last_clean":"2024-09-17T02:55:55.662694+0000","last_became_active":"2024-09-17T02:55:55.661752+0000","last_became_peered":"2024-09-17T02:55:55.661752+0000","last_unstale":"2024-09-17T02:55:55.662694+0000","last_undegraded":"2024-09-17T02:55:55.662694+0000","last_fullsized":"2024-09-17T02:55:55.662694+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:17.317734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.656747+0000","last_change":"2024-09-17T02:55:55.656530+0000","last_active":"2024-09-17T02:55:55.656747+0000","last_peered":"2024-09-17T02:55:55.656747+0000","last_clean":"2024-09-17T02:55:55.656747+0000","last_became_active":"2024-09-17T02:55:55.656261+0000","last_became_peered":"2024-09-17T02:55:55.656261+0000","last_unstale":"2024-09-17T02:55:55.656747+0000","last_undegraded":"2024-09-17T02:55:55.656747+0000","last_fullsized":"2024-09-17T02:55:55.656747+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:49.187176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665428+0000","last_change":"2024-09-17T02:55:55.665164+0000","last_active":"2024-09-17T02:55:55.665428+0000","last_peered":"2024-09-17T02:55:55.665428+0000","last_clean":"2024-09-17T02:55:55.665428+0000","last_became_active":"2024-09-17T02:55:55.664554+0000","last_became_peered":"2024-09-17T02:55:55.664554+0000","last_unstale":"2024-09-17T02:55:55.665428+0000","last_undegraded":"2024-09-17T02:55:55.665428+0000","last_fullsized":"2024-09-17T02:55:55.665428+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:31.775313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659579+0000","last_change":"2024-09-17T02:55:55.659365+0000","last_active":"2024-09-17T02:55:55.659579+0000","last_peered":"2024-09-17T02:55:55.659579+0000","last_clean":"2024-09-17T02:55:55.659579+0000","last_became_active":"2024-09-17T02:55:55.658024+0000","last_became_peered":"2024-09-17T02:55:55.658024+0000","last_unstale":"2024-09-17T02:55:55.659579+0000","last_undegraded":"2024-09-17T02:55:55.659579+0000","last_fullsized":"2024-09-17T02:55:55.659579+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:38.516399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661208+0000","last_change":"2024-09-17T02:55:55.660933+0000","last_active":"2024-09-17T02:55:55.661208+0000","last_peered":"2024-09-17T02:55:55.661208+0000","last_clean":"2024-09-17T02:55:55.661208+0000","last_became_active":"2024-09-17T02:55:55.659347+0000","last_became_peered":"2024-09-17T02:55:55.659347+0000","last_unstale":"2024-09-17T02:55:55.661208+0000","last_undegraded":"2024-09-17T02:55:55.661208+0000","last_fullsized":"2024-09-17T02:55:55.661208+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:07.293933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662313+0000","last_change":"2024-09-17T02:55:55.662053+0000","last_active":"2024-09-17T02:55:55.662313+0000","last_peered":"2024-09-17T02:55:55.662313+0000","last_clean":"2024-09-17T02:55:55.662313+0000","last_became_active":"2024-09-17T02:55:55.661804+0000","last_became_peered":"2024-09-17T02:55:55.661804+0000","last_unstale":"2024-09-17T02:55:55.662313+0000","last_undegraded":"2024-09-17T02:55:55.662313+0000","last_fullsized":"2024-09-17T02:55:55.662313+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:08.616062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.666478+0000","last_change":"2024-09-17T02:55:55.665728+0000","last_active":"2024-09-17T02:55:55.666478+0000","last_peered":"2024-09-17T02:55:55.666478+0000","last_clean":"2024-09-17T02:55:55.666478+0000","last_became_active":"2024-09-17T02:55:55.665305+0000","last_became_peered":"2024-09-17T02:55:55.665305+0000","last_unstale":"2024-09-17T02:55:55.666478+0000","last_undegraded":"2024-09-17T02:55:55.666478+0000","last_fullsized":"2024-09-17T02:55:55.666478+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:21.999422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.670263+0000","last_change":"2024-09-17T02:55:54.650606+0000","last_active":"2024-09-17T02:55:55.670263+0000","last_peered":"2024-09-17T02:55:55.670263+0000","last_clean":"2024-09-17T02:55:55.670263+0000","last_became_active":"2024-09-17T02:55:54.650317+0000","last_became_peered":"2024-09-17T02:55:54.650317+0000","last_unstale":"2024-09-17T02:55:55.670263+0000","last_undegraded":"2024-09-17T02:55:55.670263+0000","last_fullsized":"2024-09-17T02:55:55.670263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:57.514511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.656872+0000","last_change":"2024-09-17T02:55:55.656613+0000","last_active":"2024-09-17T02:55:55.656872+0000","last_peered":"2024-09-17T02:55:55.656872+0000","last_clean":"2024-09-17T02:55:55.656872+0000","last_became_active":"2024-09-17T02:55:55.655619+0000","last_became_peered":"2024-09-17T02:55:55.655619+0000","last_unstale":"2024-09-17T02:55:55.656872+0000","last_undegraded":"2024-09-17T02:55:55.656872+0000","last_fullsized":"2024-09-17T02:55:55.656872+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:49.487506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669101+0000","last_change":"2024-09-17T02:55:54.654816+0000","last_active":"2024-09-17T02:55:55.669101+0000","last_peered":"2024-09-17T02:55:55.669101+0000","last_clean":"2024-09-17T02:55:55.669101+0000","last_became_active":"2024-09-17T02:55:54.654443+0000","last_became_peered":"2024-09-17T02:55:54.654443+0000","last_unstale":"2024-09-17T02:55:55.669101+0000","last_undegraded":"2024-09-17T02:55:55.669101+0000","last_fullsized":"2024-09-17T02:55:55.669101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:13.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662210+0000","last_change":"2024-09-17T02:55:55.662013+0000","last_active":"2024-09-17T02:55:55.662210+0000","last_peered":"2024-09-17T02:55:55.662210+0000","last_clean":"2024-09-17T02:55:55.662210+0000","last_became_active":"2024-09-17T02:55:55.661584+0000","last_became_peered":"2024-09-17T02:55:55.661584+0000","last_unstale":"2024-09-17T02:55:55.662210+0000","last_undegraded":"2024-09-17T02:55:55.662210+0000","last_fullsized":"2024-09-17T02:55:55.662210+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:06.169832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669737+0000","last_change":"2024-09-17T02:55:54.659660+0000","last_active":"2024-09-17T02:55:55.669737+0000","last_peered":"2024-09-17T02:55:55.669737+0000","last_clean":"2024-09-17T02:55:55.669737+0000","last_became_active":"2024-09-17T02:55:54.659258+0000","last_became_peered":"2024-09-17T02:55:54.659258+0000","last_unstale":"2024-09-17T02:55:55.669737+0000","last_undegraded":"2024-09-17T02:55:55.669737+0000","last_fullsized":"2024-09-17T02:55:55.669737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:14.176235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.667344+0000","last_change":"2024-09-17T02:55:55.666932+0000","last_active":"2024-09-17T02:55:55.667344+0000","last_peered":"2024-09-17T02:55:55.667344+0000","last_clean":"2024-09-17T02:55:55.667344+0000","last_became_active":"2024-09-17T02:55:55.666086+0000","last_became_peered":"2024-09-17T02:55:55.666086+0000","last_unstale":"2024-09-17T02:55:55.667344+0000","last_undegraded":"2024-09-17T02:55:55.667344+0000","last_fullsized":"2024-09-17T02:55:55.667344+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:15.637180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.668937+0000","last_change":"2024-09-17T02:55:54.654121+0000","last_active":"2024-09-17T02:55:55.668937+0000","last_peered":"2024-09-17T02:55:55.668937+0000","last_clean":"2024-09-17T02:55:55.668937+0000","last_became_active":"2024-09-17T02:55:54.653015+0000","last_became_peered":"2024-09-17T02:55:54.653015+0000","last_unstale":"2024-09-17T02:55:55.668937+0000","last_undegraded":"2024-09-17T02:55:55.668937+0000","last_fullsized":"2024-09-17T02:55:55.668937+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:21.423135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659294+0000","last_change":"2024-09-17T02:55:55.659023+0000","last_active":"2024-09-17T02:55:55.659294+0000","last_peered":"2024-09-17T02:55:55.659294+0000","last_clean":"2024-09-17T02:55:55.659294+0000","last_became_active":"2024-09-17T02:55:55.658192+0000","last_became_peered":"2024-09-17T02:55:55.658192+0000","last_unstale":"2024-09-17T02:55:55.659294+0000","last_undegraded":"2024-09-17T02:55:55.659294+0000","last_fullsized":"2024-09-17T02:55:55.659294+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:44.826641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.666625+0000","last_change":"2024-09-17T02:55:54.649784+0000","last_active":"2024-09-17T02:55:55.666625+0000","last_peered":"2024-09-17T02:55:55.666625+0000","last_clean":"2024-09-17T02:55:55.666625+0000","last_became_active":"2024-09-17T02:55:54.649524+0000","last_became_peered":"2024-09-17T02:55:54.649524+0000","last_unstale":"2024-09-17T02:55:55.666625+0000","last_undegraded":"2024-09-17T02:55:55.666625+0000","last_fullsized":"2024-09-17T02:55:55.666625+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:29.020586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.653701+0000","last_change":"2024-09-17T02:55:55.653478+0000","last_active":"2024-09-17T02:55:55.653701+0000","last_peered":"2024-09-17T02:55:55.653701+0000","last_clean":"2024-09-17T02:55:55.653701+0000","last_became_active":"2024-09-17T02:55:55.653226+0000","last_became_peered":"2024-09-17T02:55:55.653226+0000","last_unstale":"2024-09-17T02:55:55.653701+0000","last_undegraded":"2024-09-17T02:55:55.653701+0000","last_fullsized":"2024-09-17T02:55:55.653701+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:58.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669356+0000","last_change":"2024-09-17T02:55:54.658795+0000","last_active":"2024-09-17T02:55:55.669356+0000","last_peered":"2024-09-17T02:55:55.669356+0000","last_clean":"2024-09-17T02:55:55.669356+0000","last_became_active":"2024-09-17T02:55:54.658336+0000","last_became_peered":"2024-09-17T02:55:54.658336+0000","last_unstale":"2024-09-17T02:55:55.669356+0000","last_undegraded":"2024-09-17T02:55:55.669356+0000","last_fullsized":"2024-09-17T02:55:55.669356+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:26.815623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665287+0000","last_change":"2024-09-17T02:55:55.664356+0000","last_active":"2024-09-17T02:55:55.665287+0000","last_peered":"2024-09-17T02:55:55.665287+0000","last_clean":"2024-09-17T02:55:55.665287+0000","last_became_active":"2024-09-17T02:55:55.663807+0000","last_became_peered":"2024-09-17T02:55:55.663807+0000","last_unstale":"2024-09-17T02:55:55.665287+0000","last_undegraded":"2024-09-17T02:55:55.665287+0000","last_fullsized":"2024-09-17T02:55:55.665287+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:25.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.648275+0000","last_change":"2024-09-17T02:55:54.658180+0000","last_active":"2024-09-17T02:55:55.648275+0000","last_peered":"2024-09-17T02:55:55.648275+0000","last_clean":"2024-09-17T02:55:55.648275+0000","last_became_active":"2024-09-17T02:55:54.657832+0000","last_became_peered":"2024-09-17T02:55:54.657832+0000","last_unstale":"2024-09-17T02:55:55.648275+0000","last_undegraded":"2024-09-17T02:55:55.648275+0000","last_fullsized":"2024-09-17T02:55:55.648275+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:39.621996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657374+0000","last_change":"2024-09-17T02:55:55.656436+0000","last_active":"2024-09-17T02:55:55.657374+0000","last_peered":"2024-09-17T02:55:55.657374+0000","last_clean":"2024-09-17T02:55:55.657374+0000","last_became_active":"2024-09-17T02:55:55.655678+0000","last_became_peered":"2024-09-17T02:55:55.655678+0000","last_unstale":"2024-09-17T02:55:55.657374+0000","last_undegraded":"2024-09-17T02:55:55.657374+0000","last_fullsized":"2024-09-17T02:55:55.657374+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:47.809642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.649870+0000","last_change":"2024-09-17T02:55:54.648200+0000","last_active":"2024-09-17T02:55:55.649870+0000","last_peered":"2024-09-17T02:55:55.649870+0000","last_clean":"2024-09-17T02:55:55.649870+0000","last_became_active":"2024-09-17T02:55:54.647923+0000","last_became_peered":"2024-09-17T02:55:54.647923+0000","last_unstale":"2024-09-17T02:55:55.649870+0000","last_undegraded":"2024-09-17T02:55:55.649870+0000","last_fullsized":"2024-09-17T02:55:55.649870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:07.656016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.664642+0000","last_change":"2024-09-17T02:55:55.664207+0000","last_active":"2024-09-17T02:55:55.664642+0000","last_peered":"2024-09-17T02:55:55.664642+0000","last_clean":"2024-09-17T02:55:55.664642+0000","last_became_active":"2024-09-17T02:55:55.663936+0000","last_became_peered":"2024-09-17T02:55:55.663936+0000","last_unstale":"2024-09-17T02:55:55.664642+0000","last_undegraded":"2024-09-17T02:55:55.664642+0000","last_fullsized":"2024-09-17T02:55:55.664642+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:50.194820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654492+0000","last_change":"2024-09-17T02:55:54.655459+0000","last_active":"2024-09-17T02:55:55.654492+0000","last_peered":"2024-09-17T02:55:55.654492+0000","last_clean":"2024-09-17T02:55:55.654492+0000","last_became_active":"2024-09-17T02:55:54.654635+0000","last_became_peered":"2024-09-17T02:55:54.654635+0000","last_unstale":"2024-09-17T02:55:55.654492+0000","last_undegraded":"2024-09-17T02:55:55.654492+0000","last_fullsized":"2024-09-17T02:55:55.654492+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:22.385860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.658014+0000","last_change":"2024-09-17T02:55:55.657672+0000","last_active":"2024-09-17T02:55:55.658014+0000","last_peered":"2024-09-17T02:55:55.658014+0000","last_clean":"2024-09-17T02:55:55.658014+0000","last_became_active":"2024-09-17T02:55:55.657320+0000","last_became_peered":"2024-09-17T02:55:55.657320+0000","last_unstale":"2024-09-17T02:55:55.658014+0000","last_undegraded":"2024-09-17T02:55:55.658014+0000","last_fullsized":"2024-09-17T02:55:55.658014+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:51.520290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.650933+0000","last_change":"2024-09-17T02:55:54.649461+0000","last_active":"2024-09-17T02:55:55.650933+0000","last_peered":"2024-09-17T02:55:55.650933+0000","last_clean":"2024-09-17T02:55:55.650933+0000","last_became_active":"2024-09-17T02:55:54.648766+0000","last_became_peered":"2024-09-17T02:55:54.648766+0000","last_unstale":"2024-09-17T02:55:55.650933+0000","last_undegraded":"2024-09-17T02:55:55.650933+0000","last_fullsized":"2024-09-17T02:55:55.650933+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:47.418418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662471+0000","last_change":"2024-09-17T02:55:55.662247+0000","last_active":"2024-09-17T02:55:55.662471+0000","last_peered":"2024-09-17T02:55:55.662471+0000","last_clean":"2024-09-17T02:55:55.662471+0000","last_became_active":"2024-09-17T02:55:55.660196+0000","last_became_peered":"2024-09-17T02:55:55.660196+0000","last_unstale":"2024-09-17T02:55:55.662471+0000","last_undegraded":"2024-09-17T02:55:55.662471+0000","last_fullsized":"2024-09-17T02:55:55.662471+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:47.990157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.668961+0000","last_change":"2024-09-17T02:55:54.651961+0000","last_active":"2024-09-17T02:55:55.668961+0000","last_peered":"2024-09-17T02:55:55.668961+0000","last_clean":"2024-09-17T02:55:55.668961+0000","last_became_active":"2024-09-17T02:55:54.651696+0000","last_became_peered":"2024-09-17T02:55:54.651696+0000","last_unstale":"2024-09-17T02:55:55.668961+0000","last_undegraded":"2024-09-17T02:55:55.668961+0000","last_fullsized":"2024-09-17T02:55:55.668961+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:58.404833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665417+0000","last_change":"2024-09-17T02:55:55.665087+0000","last_active":"2024-09-17T02:55:55.665417+0000","last_peered":"2024-09-17T02:55:55.665417+0000","last_clean":"2024-09-17T02:55:55.665417+0000","last_became_active":"2024-09-17T02:55:55.664311+0000","last_became_peered":"2024-09-17T02:55:55.664311+0000","last_unstale":"2024-09-17T02:55:55.665417+0000","last_undegraded":"2024-09-17T02:55:55.665417+0000","last_fullsized":"2024-09-17T02:55:55.665417+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.981315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.670884+0000","last_change":"2024-09-17T02:55:54.657613+0000","last_active":"2024-09-17T02:55:55.670884+0000","last_peered":"2024-09-17T02:55:55.670884+0000","last_clean":"2024-09-17T02:55:55.670884+0000","last_became_active":"2024-09-17T02:55:54.657125+0000","last_became_peered":"2024-09-17T02:55:54.657125+0000","last_unstale":"2024-09-17T02:55:55.670884+0000","last_undegraded":"2024-09-17T02:55:55.670884+0000","last_fullsized":"2024-09-17T02:55:55.670884+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:48.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654600+0000","last_change":"2024-09-17T02:55:55.654317+0000","last_active":"2024-09-17T02:55:55.654600+0000","last_peered":"2024-09-17T02:55:55.654600+0000","last_clean":"2024-09-17T02:55:55.654600+0000","last_became_active":"2024-09-17T02:55:55.653642+0000","last_became_peered":"2024-09-17T02:55:55.653642+0000","last_unstale":"2024-09-17T02:55:55.654600+0000","last_undegraded":"2024-09-17T02:55:55.654600+0000","last_fullsized":"2024-09-17T02:55:55.654600+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:16.907625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669868+0000","last_change":"2024-09-17T02:55:54.648509+0000","last_active":"2024-09-17T02:55:55.669868+0000","last_peered":"2024-09-17T02:55:55.669868+0000","last_clean":"2024-09-17T02:55:55.669868+0000","last_became_active":"2024-09-17T02:55:54.648235+0000","last_became_peered":"2024-09-17T02:55:54.648235+0000","last_unstale":"2024-09-17T02:55:55.669868+0000","last_undegraded":"2024-09-17T02:55:55.669868+0000","last_fullsized":"2024-09-17T02:55:55.669868+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:44.253221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654630+0000","last_change":"2024-09-17T02:55:55.654402+0000","last_active":"2024-09-17T02:55:55.654630+0000","last_peered":"2024-09-17T02:55:55.654630+0000","last_clean":"2024-09-17T02:55:55.654630+0000","last_became_active":"2024-09-17T02:55:55.654134+0000","last_became_peered":"2024-09-17T02:55:55.654134+0000","last_unstale":"2024-09-17T02:55:55.654630+0000","last_undegraded":"2024-09-17T02:55:55.654630+0000","last_fullsized":"2024-09-17T02:55:55.654630+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:09.397605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651476+0000","last_change":"2024-09-17T02:55:54.654542+0000","last_active":"2024-09-17T02:55:55.651476+0000","last_peered":"2024-09-17T02:55:55.651476+0000","last_clean":"2024-09-17T02:55:55.651476+0000","last_became_active":"2024-09-17T02:55:54.653485+0000","last_became_peered":"2024-09-17T02:55:54.653485+0000","last_unstale":"2024-09-17T02:55:55.651476+0000","last_undegraded":"2024-09-17T02:55:55.651476+0000","last_fullsized":"2024-09-17T02:55:55.651476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:39.446902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659361+0000","last_change":"2024-09-17T02:55:55.659112+0000","last_active":"2024-09-17T02:55:55.659361+0000","last_peered":"2024-09-17T02:55:55.659361+0000","last_clean":"2024-09-17T02:55:55.659361+0000","last_became_active":"2024-09-17T02:55:55.658723+0000","last_became_peered":"2024-09-17T02:55:55.658723+0000","last_unstale":"2024-09-17T02:55:55.659361+0000","last_undegraded":"2024-09-17T02:55:55.659361+0000","last_fullsized":"2024-09-17T02:55:55.659361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.404464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651742+0000","last_change":"2024-09-17T02:55:54.652906+0000","last_active":"2024-09-17T02:55:55.651742+0000","last_peered":"2024-09-17T02:55:55.651742+0000","last_clean":"2024-09-17T02:55:55.651742+0000","last_became_active":"2024-09-17T02:55:54.650807+0000","last_became_peered":"2024-09-17T02:55:54.650807+0000","last_unstale":"2024-09-17T02:55:55.651742+0000","last_undegraded":"2024-09-17T02:55:55.651742+0000","last_fullsized":"2024-09-17T02:55:55.651742+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:05.759917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661857+0000","last_change":"2024-09-17T02:55:55.661615+0000","last_active":"2024-09-17T02:55:55.661857+0000","last_peered":"2024-09-17T02:55:55.661857+0000","last_clean":"2024-09-17T02:55:55.661857+0000","last_became_active":"2024-09-17T02:55:55.661332+0000","last_became_peered":"2024-09-17T02:55:55.661332+0000","last_unstale":"2024-09-17T02:55:55.661857+0000","last_undegraded":"2024-09-17T02:55:55.661857+0000","last_fullsized":"2024-09-17T02:55:55.661857+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:25.615602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.673479+0000","last_change":"2024-09-17T02:55:54.658944+0000","last_active":"2024-09-17T02:55:55.673479+0000","last_peered":"2024-09-17T02:55:55.673479+0000","last_clean":"2024-09-17T02:55:55.673479+0000","last_became_active":"2024-09-17T02:55:54.658662+0000","last_became_peered":"2024-09-17T02:55:54.658662+0000","last_unstale":"2024-09-17T02:55:55.673479+0000","last_undegraded":"2024-09-17T02:55:55.673479+0000","last_fullsized":"2024-09-17T02:55:55.673479+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:08.600797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.650845+0000","last_change":"2024-09-17T02:55:55.650552+0000","last_active":"2024-09-17T02:55:55.650845+0000","last_peered":"2024-09-17T02:55:55.650845+0000","last_clean":"2024-09-17T02:55:55.650845+0000","last_became_active":"2024-09-17T02:55:55.650251+0000","last_became_peered":"2024-09-17T02:55:55.650251+0000","last_unstale":"2024-09-17T02:55:55.650845+0000","last_undegraded":"2024-09-17T02:55:55.650845+0000","last_fullsized":"2024-09-17T02:55:55.650845+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:44.516714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669446+0000","last_change":"2024-09-17T02:55:54.653827+0000","last_active":"2024-09-17T02:55:55.669446+0000","last_peered":"2024-09-17T02:55:55.669446+0000","last_clean":"2024-09-17T02:55:55.669446+0000","last_became_active":"2024-09-17T02:55:54.653517+0000","last_became_peered":"2024-09-17T02:55:54.653517+0000","last_unstale":"2024-09-17T02:55:55.669446+0000","last_undegraded":"2024-09-17T02:55:55.669446+0000","last_fullsized":"2024-09-17T02:55:55.669446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:00.259716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.652567+0000","last_change":"2024-09-17T02:55:55.652034+0000","last_active":"2024-09-17T02:55:55.652567+0000","last_peered":"2024-09-17T02:55:55.652567+0000","last_clean":"2024-09-17T02:55:55.652567+0000","last_became_active":"2024-09-17T02:55:55.651724+0000","last_became_peered":"2024-09-17T02:55:55.651724+0000","last_unstale":"2024-09-17T02:55:55.652567+0000","last_undegraded":"2024-09-17T02:55:55.652567+0000","last_fullsized":"2024-09-17T02:55:55.652567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:14.138279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669817+0000","last_change":"2024-09-17T02:55:54.657477+0000","last_active":"2024-09-17T02:55:55.669817+0000","last_peered":"2024-09-17T02:55:55.669817+0000","last_clean":"2024-09-17T02:55:55.669817+0000","last_became_active":"2024-09-17T02:55:54.657167+0000","last_became_peered":"2024-09-17T02:55:54.657167+0000","last_unstale":"2024-09-17T02:55:55.669817+0000","last_undegraded":"2024-09-17T02:55:55.669817+0000","last_fullsized":"2024-09-17T02:55:55.669817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:22.237312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657073+0000","last_change":"2024-09-17T02:55:55.656874+0000","last_active":"2024-09-17T02:55:55.657073+0000","last_peered":"2024-09-17T02:55:55.657073+0000","last_clean":"2024-09-17T02:55:55.657073+0000","last_became_active":"2024-09-17T02:55:55.654545+0000","last_became_peered":"2024-09-17T02:55:55.654545+0000","last_unstale":"2024-09-17T02:55:55.657073+0000","last_undegraded":"2024-09-17T02:55:55.657073+0000","last_fullsized":"2024-09-17T02:55:55.657073+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:57.870944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.664841+0000","last_change":"2024-09-17T02:55:54.657870+0000","last_active":"2024-09-17T02:55:55.664841+0000","last_peered":"2024-09-17T02:55:55.664841+0000","last_clean":"2024-09-17T02:55:55.664841+0000","last_became_active":"2024-09-17T02:55:54.657569+0000","last_became_peered":"2024-09-17T02:55:54.657569+0000","last_unstale":"2024-09-17T02:55:55.664841+0000","last_undegraded":"2024-09-17T02:55:55.664841+0000","last_fullsized":"2024-09-17T02:55:55.664841+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:06.725260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.655361+0000","last_change":"2024-09-17T02:55:55.655172+0000","last_active":"2024-09-17T02:55:55.655361+0000","last_peered":"2024-09-17T02:55:55.655361+0000","last_clean":"2024-09-17T02:55:55.655361+0000","last_became_active":"2024-09-17T02:55:55.654921+0000","last_became_peered":"2024-09-17T02:55:55.654921+0000","last_unstale":"2024-09-17T02:55:55.655361+0000","last_undegraded":"2024-09-17T02:55:55.655361+0000","last_fullsized":"2024-09-17T02:55:55.655361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:12.829877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651965+0000","last_change":"2024-09-17T02:55:54.653216+0000","last_active":"2024-09-17T02:55:55.651965+0000","last_peered":"2024-09-17T02:55:55.651965+0000","last_clean":"2024-09-17T02:55:55.651965+0000","last_became_active":"2024-09-17T02:55:54.651513+0000","last_became_peered":"2024-09-17T02:55:54.651513+0000","last_unstale":"2024-09-17T02:55:55.651965+0000","last_undegraded":"2024-09-17T02:55:55.651965+0000","last_fullsized":"2024-09-17T02:55:55.651965+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:17.838615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662031+0000","last_change":"2024-09-17T02:55:55.661694+0000","last_active":"2024-09-17T02:55:55.662031+0000","last_peered":"2024-09-17T02:55:55.662031+0000","last_clean":"2024-09-17T02:55:55.662031+0000","last_became_active":"2024-09-17T02:55:55.659865+0000","last_became_peered":"2024-09-17T02:55:55.659865+0000","last_unstale":"2024-09-17T02:55:55.662031+0000","last_undegraded":"2024-09-17T02:55:55.662031+0000","last_fullsized":"2024-09-17T02:55:55.662031+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:29.290748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669262+0000","last_change":"2024-09-17T02:55:54.652252+0000","last_active":"2024-09-17T02:55:55.669262+0000","last_peered":"2024-09-17T02:55:55.669262+0000","last_clean":"2024-09-17T02:55:55.669262+0000","last_became_active":"2024-09-17T02:55:54.651964+0000","last_became_peered":"2024-09-17T02:55:54.651964+0000","last_unstale":"2024-09-17T02:55:55.669262+0000","last_undegraded":"2024-09-17T02:55:55.669262+0000","last_fullsized":"2024-09-17T02:55:55.669262+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:29.295148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.666451+0000","last_change":"2024-09-17T02:55:55.666181+0000","last_active":"2024-09-17T02:55:55.666451+0000","last_peered":"2024-09-17T02:55:55.666451+0000","last_clean":"2024-09-17T02:55:55.666451+0000","last_became_active":"2024-09-17T02:55:55.665638+0000","last_became_peered":"2024-09-17T02:55:55.665638+0000","last_unstale":"2024-09-17T02:55:55.666451+0000","last_undegraded":"2024-09-17T02:55:55.666451+0000","last_fullsized":"2024-09-17T02:55:55.666451+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:36.509037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.648535+0000","last_change":"2024-09-17T02:55:54.654010+0000","last_active":"2024-09-17T02:55:55.648535+0000","last_peered":"2024-09-17T02:55:55.648535+0000","last_clean":"2024-09-17T02:55:55.648535+0000","last_became_active":"2024-09-17T02:55:54.653447+0000","last_became_peered":"2024-09-17T02:55:54.653447+0000","last_unstale":"2024-09-17T02:55:55.648535+0000","last_undegraded":"2024-09-17T02:55:55.648535+0000","last_fullsized":"2024-09-17T02:55:55.648535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:09.464992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.663901+0000","last_change":"2024-09-17T02:55:55.659057+0000","last_active":"2024-09-17T02:55:55.663901+0000","last_peered":"2024-09-17T02:55:55.663901+0000","last_clean":"2024-09-17T02:55:55.663901+0000","last_became_active":"2024-09-17T02:55:55.658670+0000","last_became_peered":"2024-09-17T02:55:55.658670+0000","last_unstale":"2024-09-17T02:55:55.663901+0000","last_undegraded":"2024-09-17T02:55:55.663901+0000","last_fullsized":"2024-09-17T02:55:55.663901+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:10.256785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.650078+0000","last_change":"2024-09-17T02:55:54.649987+0000","last_active":"2024-09-17T02:55:55.650078+0000","last_peered":"2024-09-17T02:55:55.650078+0000","last_clean":"2024-09-17T02:55:55.650078+0000","last_became_active":"2024-09-17T02:55:54.649713+0000","last_became_peered":"2024-09-17T02:55:54.649713+0000","last_unstale":"2024-09-17T02:55:55.650078+0000","last_undegraded":"2024-09-17T02:55:55.650078+0000","last_fullsized":"2024-09-17T02:55:55.650078+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:33.747849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665259+0000","last_change":"2024-09-17T02:55:55.664062+0000","last_active":"2024-09-17T02:55:55.665259+0000","last_peered":"2024-09-17T02:55:55.665259+0000","last_clean":"2024-09-17T02:55:55.665259+0000","last_became_active":"2024-09-17T02:55:55.663475+0000","last_became_peered":"2024-09-17T02:55:55.663475+0000","last_unstale":"2024-09-17T02:55:55.665259+0000","last_undegraded":"2024-09-17T02:55:55.665259+0000","last_fullsized":"2024-09-17T02:55:55.665259+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:44.718318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.652008+0000","last_change":"2024-09-17T02:55:54.655568+0000","last_active":"2024-09-17T02:55:55.652008+0000","last_peered":"2024-09-17T02:55:55.652008+0000","last_clean":"2024-09-17T02:55:55.652008+0000","last_became_active":"2024-09-17T02:55:54.653853+0000","last_became_peered":"2024-09-17T02:55:54.653853+0000","last_unstale":"2024-09-17T02:55:55.652008+0000","last_undegraded":"2024-09-17T02:55:55.652008+0000","last_fullsized":"2024-09-17T02:55:55.652008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:03.304425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.656749+0000","last_change":"2024-09-17T02:55:55.654901+0000","last_active":"2024-09-17T02:55:55.656749+0000","last_peered":"2024-09-17T02:55:55.656749+0000","last_clean":"2024-09-17T02:55:55.656749+0000","last_became_active":"2024-09-17T02:55:55.653823+0000","last_became_peered":"2024-09-17T02:55:55.653823+0000","last_unstale":"2024-09-17T02:55:55.656749+0000","last_undegraded":"2024-09-17T02:55:55.656749+0000","last_fullsized":"2024-09-17T02:55:55.656749+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:29.425056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.652799+0000","last_change":"2024-09-17T02:55:54.657351+0000","last_active":"2024-09-17T02:55:55.652799+0000","last_peered":"2024-09-17T02:55:55.652799+0000","last_clean":"2024-09-17T02:55:55.652799+0000","last_became_active":"2024-09-17T02:55:54.657052+0000","last_became_peered":"2024-09-17T02:55:54.657052+0000","last_unstale":"2024-09-17T02:55:55.652799+0000","last_undegraded":"2024-09-17T02:55:55.652799+0000","last_fullsized":"2024-09-17T02:55:55.652799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:56.584447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.660716+0000","last_change":"2024-09-17T02:55:55.660517+0000","last_active":"2024-09-17T02:55:55.660716+0000","last_peered":"2024-09-17T02:55:55.660716+0000","last_clean":"2024-09-17T02:55:55.660716+0000","last_became_active":"2024-09-17T02:55:55.660248+0000","last_became_peered":"2024-09-17T02:55:55.660248+0000","last_unstale":"2024-09-17T02:55:55.660716+0000","last_undegraded":"2024-09-17T02:55:55.660716+0000","last_fullsized":"2024-09-17T02:55:55.660716+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:34.432499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651561+0000","last_change":"2024-09-17T02:55:54.651840+0000","last_active":"2024-09-17T02:55:55.651561+0000","last_peered":"2024-09-17T02:55:55.651561+0000","last_clean":"2024-09-17T02:55:55.651561+0000","last_became_active":"2024-09-17T02:55:54.651560+0000","last_became_peered":"2024-09-17T02:55:54.651560+0000","last_unstale":"2024-09-17T02:55:55.651561+0000","last_undegraded":"2024-09-17T02:55:55.651561+0000","last_fullsized":"2024-09-17T02:55:55.651561+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:10.745370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661132+0000","last_change":"2024-09-17T02:55:55.660559+0000","last_active":"2024-09-17T02:55:55.661132+0000","last_peered":"2024-09-17T02:55:55.661132+0000","last_clean":"2024-09-17T02:55:55.661132+0000","last_became_active":"2024-09-17T02:55:55.660277+0000","last_became_peered":"2024-09-17T02:55:55.660277+0000","last_unstale":"2024-09-17T02:55:55.661132+0000","last_undegraded":"2024-09-17T02:55:55.661132+0000","last_fullsized":"2024-09-17T02:55:55.661132+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:27.352157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662357+0000","last_change":"2024-09-17T02:55:54.655140+0000","last_active":"2024-09-17T02:55:55.662357+0000","last_peered":"2024-09-17T02:55:55.662357+0000","last_clean":"2024-09-17T02:55:55.662357+0000","last_became_active":"2024-09-17T02:55:54.654787+0000","last_became_peered":"2024-09-17T02:55:54.654787+0000","last_unstale":"2024-09-17T02:55:55.662357+0000","last_undegraded":"2024-09-17T02:55:55.662357+0000","last_fullsized":"2024-09-17T02:55:55.662357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:45.383302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662446+0000","last_change":"2024-09-17T02:55:55.662243+0000","last_active":"2024-09-17T02:55:55.662446+0000","last_peered":"2024-09-17T02:55:55.662446+0000","last_clean":"2024-09-17T02:55:55.662446+0000","last_became_active":"2024-09-17T02:55:55.661981+0000","last_became_peered":"2024-09-17T02:55:55.661981+0000","last_unstale":"2024-09-17T02:55:55.662446+0000","last_undegraded":"2024-09-17T02:55:55.662446+0000","last_fullsized":"2024-09-17T02:55:55.662446+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:06.887638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.652744+0000","last_change":"2024-09-17T02:55:54.656176+0000","last_active":"2024-09-17T02:55:55.652744+0000","last_peered":"2024-09-17T02:55:55.652744+0000","last_clean":"2024-09-17T02:55:55.652744+0000","last_became_active":"2024-09-17T02:55:54.655299+0000","last_became_peered":"2024-09-17T02:55:54.655299+0000","last_unstale":"2024-09-17T02:55:55.652744+0000","last_undegraded":"2024-09-17T02:55:55.652744+0000","last_fullsized":"2024-09-17T02:55:55.652744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:02.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.664925+0000","last_change":"2024-09-17T02:55:55.661527+0000","last_active":"2024-09-17T02:55:55.664925+0000","last_peered":"2024-09-17T02:55:55.664925+0000","last_clean":"2024-09-17T02:55:55.664925+0000","last_became_active":"2024-09-17T02:55:55.660160+0000","last_became_peered":"2024-09-17T02:55:55.660160+0000","last_unstale":"2024-09-17T02:55:55.664925+0000","last_undegraded":"2024-09-17T02:55:55.664925+0000","last_fullsized":"2024-09-17T02:55:55.664925+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:40.468567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659101+0000","last_change":"2024-09-17T02:55:54.654173+0000","last_active":"2024-09-17T02:55:55.659101+0000","last_peered":"2024-09-17T02:55:55.659101+0000","last_clean":"2024-09-17T02:55:55.659101+0000","last_became_active":"2024-09-17T02:55:54.653894+0000","last_became_peered":"2024-09-17T02:55:54.653894+0000","last_unstale":"2024-09-17T02:55:55.659101+0000","last_undegraded":"2024-09-17T02:55:55.659101+0000","last_fullsized":"2024-09-17T02:55:55.659101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:09.199302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665999+0000","last_change":"2024-09-17T02:55:55.665347+0000","last_active":"2024-09-17T02:55:55.665999+0000","last_peered":"2024-09-17T02:55:55.665999+0000","last_clean":"2024-09-17T02:55:55.665999+0000","last_became_active":"2024-09-17T02:55:55.665050+0000","last_became_peered":"2024-09-17T02:55:55.665050+0000","last_unstale":"2024-09-17T02:55:55.665999+0000","last_undegraded":"2024-09-17T02:55:55.665999+0000","last_fullsized":"2024-09-17T02:55:55.665999+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:30.743093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.658207+0000","last_change":"2024-09-17T02:55:54.650487+0000","last_active":"2024-09-17T02:55:55.658207+0000","last_peered":"2024-09-17T02:55:55.658207+0000","last_clean":"2024-09-17T02:55:55.658207+0000","last_became_active":"2024-09-17T02:55:54.650213+0000","last_became_peered":"2024-09-17T02:55:54.650213+0000","last_unstale":"2024-09-17T02:55:55.658207+0000","last_undegraded":"2024-09-17T02:55:55.658207+0000","last_fullsized":"2024-09-17T02:55:55.658207+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:03.353700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657272+0000","last_change":"2024-09-17T02:55:55.657035+0000","last_active":"2024-09-17T02:55:55.657272+0000","last_peered":"2024-09-17T02:55:55.657272+0000","last_clean":"2024-09-17T02:55:55.657272+0000","last_became_active":"2024-09-17T02:55:55.656665+0000","last_became_peered":"2024-09-17T02:55:55.656665+0000","last_unstale":"2024-09-17T02:55:55.657272+0000","last_undegraded":"2024-09-17T02:55:55.657272+0000","last_fullsized":"2024-09-17T02:55:55.657272+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:18.008952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.650809+0000","last_change":"2024-09-17T02:55:54.648103+0000","last_active":"2024-09-17T02:55:55.650809+0000","last_peered":"2024-09-17T02:55:55.650809+0000","last_clean":"2024-09-17T02:55:55.650809+0000","last_became_active":"2024-09-17T02:55:54.647833+0000","last_became_peered":"2024-09-17T02:55:54.647833+0000","last_unstale":"2024-09-17T02:55:55.650809+0000","last_undegraded":"2024-09-17T02:55:55.650809+0000","last_fullsized":"2024-09-17T02:55:55.650809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:28.690230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659339+0000","last_change":"2024-09-17T02:55:55.659114+0000","last_active":"2024-09-17T02:55:55.659339+0000","last_peered":"2024-09-17T02:55:55.659339+0000","last_clean":"2024-09-17T02:55:55.659339+0000","last_became_active":"2024-09-17T02:55:55.658478+0000","last_became_peered":"2024-09-17T02:55:55.658478+0000","last_unstale":"2024-09-17T02:55:55.659339+0000","last_undegraded":"2024-09-17T02:55:55.659339+0000","last_fullsized":"2024-09-17T02:55:55.659339+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:45.292611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669200+0000","last_change":"2024-09-17T02:55:54.658975+0000","last_active":"2024-09-17T02:55:55.669200+0000","last_peered":"2024-09-17T02:55:55.669200+0000","last_clean":"2024-09-17T02:55:55.669200+0000","last_became_active":"2024-09-17T02:55:54.658367+0000","last_became_peered":"2024-09-17T02:55:54.658367+0000","last_unstale":"2024-09-17T02:55:55.669200+0000","last_undegraded":"2024-09-17T02:55:55.669200+0000","last_fullsized":"2024-09-17T02:55:55.669200+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:59.888899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":154,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651648+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:55:55.651648+0000","last_peered":"2024-09-17T02:55:55.651648+0000","last_clean":"2024-09-17T02:55:55.651648+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:55:55.651648+0000","last_undegraded":"2024-09-17T02:55:55.651648+0000","last_fullsized":"2024-09-17T02:55:55.651648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199196880,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195104,"statfs":{"total":200000000,"available":199786666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195104,"statfs":{"total":200000000,"available":199787268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785726,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195104,"statfs":{"total":200000000,"available":199786700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785704,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195104,"statfs":{"total":200000000,"available":199787268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199196936,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:55:58.657 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:55:58.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.806+0000 7f71f8cd3640 1 -- 172.21.15.104:0/2040994339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71e0005350 msgr2=0x7f71e000b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.806+0000 7f71f8cd3640 1 --2- 172.21.15.104:0/2040994339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71e0005350 0x7f71e000b9e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f71ec005fd0 tx=0x7f71e0005830 comp rx=0 tx=0).stop 2024-09-17T02:55:58.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.806+0000 7f71f8cd3640 1 -- 172.21.15.104:0/2040994339 shutdown_connections 2024-09-17T02:55:58.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.806+0000 7f71f8cd3640 1 --2- 172.21.15.104:0/2040994339 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71e0005350 0x7f71e000b9e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.806+0000 7f71f8cd3640 1 -- 172.21.15.104:0/2040994339 >> 172.21.15.104:0/2040994339 conn(0x7f71f40b44a0 msgr2=0x7f71f40b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:58.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.806+0000 7f71f8cd3640 1 -- 172.21.15.104:0/2040994339 shutdown_connections 2024-09-17T02:55:58.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.806+0000 7f71f8cd3640 1 -- 172.21.15.104:0/2040994339 wait complete. 2024-09-17T02:55:58.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.808+0000 7f71f8cd3640 1 Processor -- start 2024-09-17T02:55:58.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.808+0000 7f71f8cd3640 1 -- start start 2024-09-17T02:55:58.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f8cd3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71e0005350 0x7f71f40a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f8cd3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71f40cc660 0x7f71f40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f8cd3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f40c9e40 0x7f71f40ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f8cd3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40d02d0 con 0x7f71f40cc660 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f8cd3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40d0150 con 0x7f71f40c9e40 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f8cd3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f71f40b39c0 con 0x7f71e0005350 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71f40cc660 0x7f71f40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71f40cc660 0x7f71f40c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45572/0 (socket says 172.21.15.104:45572) 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f1d9b640 1 -- 172.21.15.104:0/505161206 learned_addr learned my addr 172.21.15.104:0/505161206 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f2d9d640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f40c9e40 0x7f71f40ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.809+0000 7f71f259c640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71e0005350 0x7f71f40a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71f1d9b640 1 -- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71e0005350 msgr2=0x7f71f40a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71f1d9b640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71e0005350 0x7f71f40a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71f1d9b640 1 -- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f40c9e40 msgr2=0x7f71f40ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71f1d9b640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f40c9e40 0x7f71f40ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71f1d9b640 1 -- 172.21.15.104:0/505161206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f40af840 con 0x7f71f40cc660 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71f1d9b640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71f40cc660 0x7f71f40c9900 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f71e4003ec0 tx=0x7f71e4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71eaffd640 1 -- 172.21.15.104:0/505161206 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4015070 con 0x7f71f40cc660 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71eaffd640 1 -- 172.21.15.104:0/505161206 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71e4011840 con 0x7f71f40cc660 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f40afb20 con 0x7f71f40cc660 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71eaffd640 1 -- 172.21.15.104:0/505161206 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4011c70 con 0x7f71f40cc660 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.810+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f40b00e0 con 0x7f71f40cc660 2024-09-17T02:55:58.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.811+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f40b3eb0 con 0x7f71f40cc660 2024-09-17T02:55:58.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.812+0000 7f71eaffd640 1 -- 172.21.15.104:0/505161206 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71e4018070 con 0x7f71f40cc660 2024-09-17T02:55:58.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.812+0000 7f71eaffd640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f71d4078bc0 0x7f71d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:58.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.813+0000 7f71eaffd640 1 -- 172.21.15.104:0/505161206 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f71e409b820 con 0x7f71f40cc660 2024-09-17T02:55:58.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.813+0000 7f71f259c640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f71d4078bc0 0x7f71d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:58.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.813+0000 7f71f259c640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f71d4078bc0 0x7f71d407b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0049c0 tx=0x7f71dc006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:58.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.817+0000 7f71eaffd640 1 -- 172.21.15.104:0/505161206 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71e40636a0 con 0x7f71f40cc660 2024-09-17T02:55:58.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.987+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71f40ccaf0 con 0x7f71d4078bc0 2024-09-17T02:55:58.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.992+0000 7f71eaffd640 1 -- 172.21.15.104:0/505161206 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247474 (secure 0 0 0) 0x7f71dc016070 con 0x7f71d4078bc0 2024-09-17T02:55:58.994 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:58.995 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f71d4078bc0 msgr2=0x7f71d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f71d4078bc0 0x7f71d407b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0049c0 tx=0x7f71dc006040 comp rx=0 tx=0).stop 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71f40cc660 msgr2=0x7f71f40c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71f40cc660 0x7f71f40c9900 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f71e4003ec0 tx=0x7f71e4001630 comp rx=0 tx=0).stop 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 shutdown_connections 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f71d4078bc0 0x7f71d407b0d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f40c9e40 0x7f71f40ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f71f40cc660 0x7f71f40c9900 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 --2- 172.21.15.104:0/505161206 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71e0005350 0x7f71f40a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 >> 172.21.15.104:0/505161206 conn(0x7f71f40b44a0 msgr2=0x7f71f40c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 shutdown_connections 2024-09-17T02:55:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:58.996+0000 7f71f8cd3640 1 -- 172.21.15.104:0/505161206 wait complete. 2024-09-17T02:55:59.007 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-17T02:55:57.637445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2819,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559680,"statfs":{"total":1600000000,"available":1597113148,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002065"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659236+0000","last_change":"2024-09-17T02:55:55.658450+0000","last_active":"2024-09-17T02:55:55.659236+0000","last_peered":"2024-09-17T02:55:55.659236+0000","last_clean":"2024-09-17T02:55:55.659236+0000","last_became_active":"2024-09-17T02:55:55.658187+0000","last_became_peered":"2024-09-17T02:55:55.658187+0000","last_unstale":"2024-09-17T02:55:55.659236+0000","last_undegraded":"2024-09-17T02:55:55.659236+0000","last_fullsized":"2024-09-17T02:55:55.659236+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:19.963772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.663864+0000","last_change":"2024-09-17T02:55:55.663530+0000","last_active":"2024-09-17T02:55:55.663864+0000","last_peered":"2024-09-17T02:55:55.663864+0000","last_clean":"2024-09-17T02:55:55.663864+0000","last_became_active":"2024-09-17T02:55:55.663201+0000","last_became_peered":"2024-09-17T02:55:55.663201+0000","last_unstale":"2024-09-17T02:55:55.663864+0000","last_undegraded":"2024-09-17T02:55:55.663864+0000","last_fullsized":"2024-09-17T02:55:55.663864+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:57.411828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659822+0000","last_change":"2024-09-17T02:55:55.659447+0000","last_active":"2024-09-17T02:55:55.659822+0000","last_peered":"2024-09-17T02:55:55.659822+0000","last_clean":"2024-09-17T02:55:55.659822+0000","last_became_active":"2024-09-17T02:55:55.658603+0000","last_became_peered":"2024-09-17T02:55:55.658603+0000","last_unstale":"2024-09-17T02:55:55.659822+0000","last_undegraded":"2024-09-17T02:55:55.659822+0000","last_fullsized":"2024-09-17T02:55:55.659822+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:36.241365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657665+0000","last_change":"2024-09-17T02:55:55.657462+0000","last_active":"2024-09-17T02:55:55.657665+0000","last_peered":"2024-09-17T02:55:55.657665+0000","last_clean":"2024-09-17T02:55:55.657665+0000","last_became_active":"2024-09-17T02:55:55.655976+0000","last_became_peered":"2024-09-17T02:55:55.655976+0000","last_unstale":"2024-09-17T02:55:55.657665+0000","last_undegraded":"2024-09-17T02:55:55.657665+0000","last_fullsized":"2024-09-17T02:55:55.657665+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:03.042709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.655913+0000","last_change":"2024-09-17T02:55:55.654352+0000","last_active":"2024-09-17T02:55:55.655913+0000","last_peered":"2024-09-17T02:55:55.655913+0000","last_clean":"2024-09-17T02:55:55.655913+0000","last_became_active":"2024-09-17T02:55:55.654086+0000","last_became_peered":"2024-09-17T02:55:55.654086+0000","last_unstale":"2024-09-17T02:55:55.655913+0000","last_undegraded":"2024-09-17T02:55:55.655913+0000","last_fullsized":"2024-09-17T02:55:55.655913+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:31.433502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665229+0000","last_change":"2024-09-17T02:55:55.665026+0000","last_active":"2024-09-17T02:55:55.665229+0000","last_peered":"2024-09-17T02:55:55.665229+0000","last_clean":"2024-09-17T02:55:55.665229+0000","last_became_active":"2024-09-17T02:55:55.660649+0000","last_became_peered":"2024-09-17T02:55:55.660649+0000","last_unstale":"2024-09-17T02:55:55.665229+0000","last_undegraded":"2024-09-17T02:55:55.665229+0000","last_fullsized":"2024-09-17T02:55:55.665229+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:10.479621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659260+0000","last_change":"2024-09-17T02:55:55.658971+0000","last_active":"2024-09-17T02:55:55.659260+0000","last_peered":"2024-09-17T02:55:55.659260+0000","last_clean":"2024-09-17T02:55:55.659260+0000","last_became_active":"2024-09-17T02:55:55.658733+0000","last_became_peered":"2024-09-17T02:55:55.658733+0000","last_unstale":"2024-09-17T02:55:55.659260+0000","last_undegraded":"2024-09-17T02:55:55.659260+0000","last_fullsized":"2024-09-17T02:55:55.659260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:06.005248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659620+0000","last_change":"2024-09-17T02:55:55.659433+0000","last_active":"2024-09-17T02:55:55.659620+0000","last_peered":"2024-09-17T02:55:55.659620+0000","last_clean":"2024-09-17T02:55:55.659620+0000","last_became_active":"2024-09-17T02:55:55.658833+0000","last_became_peered":"2024-09-17T02:55:55.658833+0000","last_unstale":"2024-09-17T02:55:55.659620+0000","last_undegraded":"2024-09-17T02:55:55.659620+0000","last_fullsized":"2024-09-17T02:55:55.659620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:27.595071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.666532+0000","last_change":"2024-09-17T02:55:55.666264+0000","last_active":"2024-09-17T02:55:55.666532+0000","last_peered":"2024-09-17T02:55:55.666532+0000","last_clean":"2024-09-17T02:55:55.666532+0000","last_became_active":"2024-09-17T02:55:55.665688+0000","last_became_peered":"2024-09-17T02:55:55.665688+0000","last_unstale":"2024-09-17T02:55:55.666532+0000","last_undegraded":"2024-09-17T02:55:55.666532+0000","last_fullsized":"2024-09-17T02:55:55.666532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:31.504974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657210+0000","last_change":"2024-09-17T02:55:55.657007+0000","last_active":"2024-09-17T02:55:55.657210+0000","last_peered":"2024-09-17T02:55:55.657210+0000","last_clean":"2024-09-17T02:55:55.657210+0000","last_became_active":"2024-09-17T02:55:55.656694+0000","last_became_peered":"2024-09-17T02:55:55.656694+0000","last_unstale":"2024-09-17T02:55:55.657210+0000","last_undegraded":"2024-09-17T02:55:55.657210+0000","last_fullsized":"2024-09-17T02:55:55.657210+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:36.156729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.660940+0000","last_change":"2024-09-17T02:55:55.660727+0000","last_active":"2024-09-17T02:55:55.660940+0000","last_peered":"2024-09-17T02:55:55.660940+0000","last_clean":"2024-09-17T02:55:55.660940+0000","last_became_active":"2024-09-17T02:55:55.660455+0000","last_became_peered":"2024-09-17T02:55:55.660455+0000","last_unstale":"2024-09-17T02:55:55.660940+0000","last_undegraded":"2024-09-17T02:55:55.660940+0000","last_fullsized":"2024-09-17T02:55:55.660940+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:42.649857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661209+0000","last_change":"2024-09-17T02:55:55.660871+0000","last_active":"2024-09-17T02:55:55.661209+0000","last_peered":"2024-09-17T02:55:55.661209+0000","last_clean":"2024-09-17T02:55:55.661209+0000","last_became_active":"2024-09-17T02:55:55.659510+0000","last_became_peered":"2024-09-17T02:55:55.659510+0000","last_unstale":"2024-09-17T02:55:55.661209+0000","last_undegraded":"2024-09-17T02:55:55.661209+0000","last_fullsized":"2024-09-17T02:55:55.661209+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:54.829751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659736+0000","last_change":"2024-09-17T02:55:55.657914+0000","last_active":"2024-09-17T02:55:55.659736+0000","last_peered":"2024-09-17T02:55:55.659736+0000","last_clean":"2024-09-17T02:55:55.659736+0000","last_became_active":"2024-09-17T02:55:55.657632+0000","last_became_peered":"2024-09-17T02:55:55.657632+0000","last_unstale":"2024-09-17T02:55:55.659736+0000","last_undegraded":"2024-09-17T02:55:55.659736+0000","last_fullsized":"2024-09-17T02:55:55.659736+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:07.911943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.668948+0000","last_change":"2024-09-17T02:55:55.666664+0000","last_active":"2024-09-17T02:55:55.668948+0000","last_peered":"2024-09-17T02:55:55.668948+0000","last_clean":"2024-09-17T02:55:55.668948+0000","last_became_active":"2024-09-17T02:55:55.666017+0000","last_became_peered":"2024-09-17T02:55:55.666017+0000","last_unstale":"2024-09-17T02:55:55.668948+0000","last_undegraded":"2024-09-17T02:55:55.668948+0000","last_fullsized":"2024-09-17T02:55:55.668948+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:54.645486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654589+0000","last_change":"2024-09-17T02:55:55.654160+0000","last_active":"2024-09-17T02:55:55.654589+0000","last_peered":"2024-09-17T02:55:55.654589+0000","last_clean":"2024-09-17T02:55:55.654589+0000","last_became_active":"2024-09-17T02:55:55.653900+0000","last_became_peered":"2024-09-17T02:55:55.653900+0000","last_unstale":"2024-09-17T02:55:55.654589+0000","last_undegraded":"2024-09-17T02:55:55.654589+0000","last_fullsized":"2024-09-17T02:55:55.654589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:22.520838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654444+0000","last_change":"2024-09-17T02:55:55.653961+0000","last_active":"2024-09-17T02:55:55.654444+0000","last_peered":"2024-09-17T02:55:55.654444+0000","last_clean":"2024-09-17T02:55:55.654444+0000","last_became_active":"2024-09-17T02:55:55.653239+0000","last_became_peered":"2024-09-17T02:55:55.653239+0000","last_unstale":"2024-09-17T02:55:55.654444+0000","last_undegraded":"2024-09-17T02:55:55.654444+0000","last_fullsized":"2024-09-17T02:55:55.654444+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:09.425347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.663023+0000","last_change":"2024-09-17T02:55:55.662832+0000","last_active":"2024-09-17T02:55:55.663023+0000","last_peered":"2024-09-17T02:55:55.663023+0000","last_clean":"2024-09-17T02:55:55.663023+0000","last_became_active":"2024-09-17T02:55:55.662154+0000","last_became_peered":"2024-09-17T02:55:55.662154+0000","last_unstale":"2024-09-17T02:55:55.663023+0000","last_undegraded":"2024-09-17T02:55:55.663023+0000","last_fullsized":"2024-09-17T02:55:55.663023+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:08.813895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.663695+0000","last_change":"2024-09-17T02:55:55.663477+0000","last_active":"2024-09-17T02:55:55.663695+0000","last_peered":"2024-09-17T02:55:55.663695+0000","last_clean":"2024-09-17T02:55:55.663695+0000","last_became_active":"2024-09-17T02:55:55.663211+0000","last_became_peered":"2024-09-17T02:55:55.663211+0000","last_unstale":"2024-09-17T02:55:55.663695+0000","last_undegraded":"2024-09-17T02:55:55.663695+0000","last_fullsized":"2024-09-17T02:55:55.663695+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:57.033124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.653811+0000","last_change":"2024-09-17T02:55:55.653067+0000","last_active":"2024-09-17T02:55:55.653811+0000","last_peered":"2024-09-17T02:55:55.653811+0000","last_clean":"2024-09-17T02:55:55.653811+0000","last_became_active":"2024-09-17T02:55:55.652776+0000","last_became_peered":"2024-09-17T02:55:55.652776+0000","last_unstale":"2024-09-17T02:55:55.653811+0000","last_undegraded":"2024-09-17T02:55:55.653811+0000","last_fullsized":"2024-09-17T02:55:55.653811+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:09.559069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.655673+0000","last_change":"2024-09-17T02:55:55.655405+0000","last_active":"2024-09-17T02:55:55.655673+0000","last_peered":"2024-09-17T02:55:55.655673+0000","last_clean":"2024-09-17T02:55:55.655673+0000","last_became_active":"2024-09-17T02:55:55.655130+0000","last_became_peered":"2024-09-17T02:55:55.655130+0000","last_unstale":"2024-09-17T02:55:55.655673+0000","last_undegraded":"2024-09-17T02:55:55.655673+0000","last_fullsized":"2024-09-17T02:55:55.655673+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:10:45.180632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661425+0000","last_change":"2024-09-17T02:55:55.661234+0000","last_active":"2024-09-17T02:55:55.661425+0000","last_peered":"2024-09-17T02:55:55.661425+0000","last_clean":"2024-09-17T02:55:55.661425+0000","last_became_active":"2024-09-17T02:55:55.659746+0000","last_became_peered":"2024-09-17T02:55:55.659746+0000","last_unstale":"2024-09-17T02:55:55.661425+0000","last_undegraded":"2024-09-17T02:55:55.661425+0000","last_fullsized":"2024-09-17T02:55:55.661425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:42.822280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.656420+0000","last_change":"2024-09-17T02:55:55.656203+0000","last_active":"2024-09-17T02:55:55.656420+0000","last_peered":"2024-09-17T02:55:55.656420+0000","last_clean":"2024-09-17T02:55:55.656420+0000","last_became_active":"2024-09-17T02:55:55.655901+0000","last_became_peered":"2024-09-17T02:55:55.655901+0000","last_unstale":"2024-09-17T02:55:55.656420+0000","last_undegraded":"2024-09-17T02:55:55.656420+0000","last_fullsized":"2024-09-17T02:55:55.656420+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:50.061958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657208+0000","last_change":"2024-09-17T02:55:55.656999+0000","last_active":"2024-09-17T02:55:55.657208+0000","last_peered":"2024-09-17T02:55:55.657208+0000","last_clean":"2024-09-17T02:55:55.657208+0000","last_became_active":"2024-09-17T02:55:55.656079+0000","last_became_peered":"2024-09-17T02:55:55.656079+0000","last_unstale":"2024-09-17T02:55:55.657208+0000","last_undegraded":"2024-09-17T02:55:55.657208+0000","last_fullsized":"2024-09-17T02:55:55.657208+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:18.478477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.660069+0000","last_change":"2024-09-17T02:55:55.657510+0000","last_active":"2024-09-17T02:55:55.660069+0000","last_peered":"2024-09-17T02:55:55.660069+0000","last_clean":"2024-09-17T02:55:55.660069+0000","last_became_active":"2024-09-17T02:55:55.656140+0000","last_became_peered":"2024-09-17T02:55:55.656140+0000","last_unstale":"2024-09-17T02:55:55.660069+0000","last_undegraded":"2024-09-17T02:55:55.660069+0000","last_fullsized":"2024-09-17T02:55:55.660069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:30.195457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665736+0000","last_change":"2024-09-17T02:55:55.665539+0000","last_active":"2024-09-17T02:55:55.665736+0000","last_peered":"2024-09-17T02:55:55.665736+0000","last_clean":"2024-09-17T02:55:55.665736+0000","last_became_active":"2024-09-17T02:55:55.664994+0000","last_became_peered":"2024-09-17T02:55:55.664994+0000","last_unstale":"2024-09-17T02:55:55.665736+0000","last_undegraded":"2024-09-17T02:55:55.665736+0000","last_fullsized":"2024-09-17T02:55:55.665736+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:32.258529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.655622+0000","last_change":"2024-09-17T02:55:55.654896+0000","last_active":"2024-09-17T02:55:55.655622+0000","last_peered":"2024-09-17T02:55:55.655622+0000","last_clean":"2024-09-17T02:55:55.655622+0000","last_became_active":"2024-09-17T02:55:55.654338+0000","last_became_peered":"2024-09-17T02:55:55.654338+0000","last_unstale":"2024-09-17T02:55:55.655622+0000","last_undegraded":"2024-09-17T02:55:55.655622+0000","last_fullsized":"2024-09-17T02:55:55.655622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:59.260716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662694+0000","last_change":"2024-09-17T02:55:55.662446+0000","last_active":"2024-09-17T02:55:55.662694+0000","last_peered":"2024-09-17T02:55:55.662694+0000","last_clean":"2024-09-17T02:55:55.662694+0000","last_became_active":"2024-09-17T02:55:55.661752+0000","last_became_peered":"2024-09-17T02:55:55.661752+0000","last_unstale":"2024-09-17T02:55:55.662694+0000","last_undegraded":"2024-09-17T02:55:55.662694+0000","last_fullsized":"2024-09-17T02:55:55.662694+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:17.317734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.656747+0000","last_change":"2024-09-17T02:55:55.656530+0000","last_active":"2024-09-17T02:55:55.656747+0000","last_peered":"2024-09-17T02:55:55.656747+0000","last_clean":"2024-09-17T02:55:55.656747+0000","last_became_active":"2024-09-17T02:55:55.656261+0000","last_became_peered":"2024-09-17T02:55:55.656261+0000","last_unstale":"2024-09-17T02:55:55.656747+0000","last_undegraded":"2024-09-17T02:55:55.656747+0000","last_fullsized":"2024-09-17T02:55:55.656747+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:49.187176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665428+0000","last_change":"2024-09-17T02:55:55.665164+0000","last_active":"2024-09-17T02:55:55.665428+0000","last_peered":"2024-09-17T02:55:55.665428+0000","last_clean":"2024-09-17T02:55:55.665428+0000","last_became_active":"2024-09-17T02:55:55.664554+0000","last_became_peered":"2024-09-17T02:55:55.664554+0000","last_unstale":"2024-09-17T02:55:55.665428+0000","last_undegraded":"2024-09-17T02:55:55.665428+0000","last_fullsized":"2024-09-17T02:55:55.665428+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:31.775313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659579+0000","last_change":"2024-09-17T02:55:55.659365+0000","last_active":"2024-09-17T02:55:55.659579+0000","last_peered":"2024-09-17T02:55:55.659579+0000","last_clean":"2024-09-17T02:55:55.659579+0000","last_became_active":"2024-09-17T02:55:55.658024+0000","last_became_peered":"2024-09-17T02:55:55.658024+0000","last_unstale":"2024-09-17T02:55:55.659579+0000","last_undegraded":"2024-09-17T02:55:55.659579+0000","last_fullsized":"2024-09-17T02:55:55.659579+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:38.516399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661208+0000","last_change":"2024-09-17T02:55:55.660933+0000","last_active":"2024-09-17T02:55:55.661208+0000","last_peered":"2024-09-17T02:55:55.661208+0000","last_clean":"2024-09-17T02:55:55.661208+0000","last_became_active":"2024-09-17T02:55:55.659347+0000","last_became_peered":"2024-09-17T02:55:55.659347+0000","last_unstale":"2024-09-17T02:55:55.661208+0000","last_undegraded":"2024-09-17T02:55:55.661208+0000","last_fullsized":"2024-09-17T02:55:55.661208+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:07.293933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662313+0000","last_change":"2024-09-17T02:55:55.662053+0000","last_active":"2024-09-17T02:55:55.662313+0000","last_peered":"2024-09-17T02:55:55.662313+0000","last_clean":"2024-09-17T02:55:55.662313+0000","last_became_active":"2024-09-17T02:55:55.661804+0000","last_became_peered":"2024-09-17T02:55:55.661804+0000","last_unstale":"2024-09-17T02:55:55.662313+0000","last_undegraded":"2024-09-17T02:55:55.662313+0000","last_fullsized":"2024-09-17T02:55:55.662313+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:08.616062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.666478+0000","last_change":"2024-09-17T02:55:55.665728+0000","last_active":"2024-09-17T02:55:55.666478+0000","last_peered":"2024-09-17T02:55:55.666478+0000","last_clean":"2024-09-17T02:55:55.666478+0000","last_became_active":"2024-09-17T02:55:55.665305+0000","last_became_peered":"2024-09-17T02:55:55.665305+0000","last_unstale":"2024-09-17T02:55:55.666478+0000","last_undegraded":"2024-09-17T02:55:55.666478+0000","last_fullsized":"2024-09-17T02:55:55.666478+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:21.999422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.670263+0000","last_change":"2024-09-17T02:55:54.650606+0000","last_active":"2024-09-17T02:55:55.670263+0000","last_peered":"2024-09-17T02:55:55.670263+0000","last_clean":"2024-09-17T02:55:55.670263+0000","last_became_active":"2024-09-17T02:55:54.650317+0000","last_became_peered":"2024-09-17T02:55:54.650317+0000","last_unstale":"2024-09-17T02:55:55.670263+0000","last_undegraded":"2024-09-17T02:55:55.670263+0000","last_fullsized":"2024-09-17T02:55:55.670263+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:57.514511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.656872+0000","last_change":"2024-09-17T02:55:55.656613+0000","last_active":"2024-09-17T02:55:55.656872+0000","last_peered":"2024-09-17T02:55:55.656872+0000","last_clean":"2024-09-17T02:55:55.656872+0000","last_became_active":"2024-09-17T02:55:55.655619+0000","last_became_peered":"2024-09-17T02:55:55.655619+0000","last_unstale":"2024-09-17T02:55:55.656872+0000","last_undegraded":"2024-09-17T02:55:55.656872+0000","last_fullsized":"2024-09-17T02:55:55.656872+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:49.487506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669101+0000","last_change":"2024-09-17T02:55:54.654816+0000","last_active":"2024-09-17T02:55:55.669101+0000","last_peered":"2024-09-17T02:55:55.669101+0000","last_clean":"2024-09-17T02:55:55.669101+0000","last_became_active":"2024-09-17T02:55:54.654443+0000","last_became_peered":"2024-09-17T02:55:54.654443+0000","last_unstale":"2024-09-17T02:55:55.669101+0000","last_undegraded":"2024-09-17T02:55:55.669101+0000","last_fullsized":"2024-09-17T02:55:55.669101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:13.326794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662210+0000","last_change":"2024-09-17T02:55:55.662013+0000","last_active":"2024-09-17T02:55:55.662210+0000","last_peered":"2024-09-17T02:55:55.662210+0000","last_clean":"2024-09-17T02:55:55.662210+0000","last_became_active":"2024-09-17T02:55:55.661584+0000","last_became_peered":"2024-09-17T02:55:55.661584+0000","last_unstale":"2024-09-17T02:55:55.662210+0000","last_undegraded":"2024-09-17T02:55:55.662210+0000","last_fullsized":"2024-09-17T02:55:55.662210+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:06.169832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669737+0000","last_change":"2024-09-17T02:55:54.659660+0000","last_active":"2024-09-17T02:55:55.669737+0000","last_peered":"2024-09-17T02:55:55.669737+0000","last_clean":"2024-09-17T02:55:55.669737+0000","last_became_active":"2024-09-17T02:55:54.659258+0000","last_became_peered":"2024-09-17T02:55:54.659258+0000","last_unstale":"2024-09-17T02:55:55.669737+0000","last_undegraded":"2024-09-17T02:55:55.669737+0000","last_fullsized":"2024-09-17T02:55:55.669737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:14.176235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.667344+0000","last_change":"2024-09-17T02:55:55.666932+0000","last_active":"2024-09-17T02:55:55.667344+0000","last_peered":"2024-09-17T02:55:55.667344+0000","last_clean":"2024-09-17T02:55:55.667344+0000","last_became_active":"2024-09-17T02:55:55.666086+0000","last_became_peered":"2024-09-17T02:55:55.666086+0000","last_unstale":"2024-09-17T02:55:55.667344+0000","last_undegraded":"2024-09-17T02:55:55.667344+0000","last_fullsized":"2024-09-17T02:55:55.667344+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:15.637180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.668937+0000","last_change":"2024-09-17T02:55:54.654121+0000","last_active":"2024-09-17T02:55:55.668937+0000","last_peered":"2024-09-17T02:55:55.668937+0000","last_clean":"2024-09-17T02:55:55.668937+0000","last_became_active":"2024-09-17T02:55:54.653015+0000","last_became_peered":"2024-09-17T02:55:54.653015+0000","last_unstale":"2024-09-17T02:55:55.668937+0000","last_undegraded":"2024-09-17T02:55:55.668937+0000","last_fullsized":"2024-09-17T02:55:55.668937+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:21.423135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659294+0000","last_change":"2024-09-17T02:55:55.659023+0000","last_active":"2024-09-17T02:55:55.659294+0000","last_peered":"2024-09-17T02:55:55.659294+0000","last_clean":"2024-09-17T02:55:55.659294+0000","last_became_active":"2024-09-17T02:55:55.658192+0000","last_became_peered":"2024-09-17T02:55:55.658192+0000","last_unstale":"2024-09-17T02:55:55.659294+0000","last_undegraded":"2024-09-17T02:55:55.659294+0000","last_fullsized":"2024-09-17T02:55:55.659294+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:44.826641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.666625+0000","last_change":"2024-09-17T02:55:54.649784+0000","last_active":"2024-09-17T02:55:55.666625+0000","last_peered":"2024-09-17T02:55:55.666625+0000","last_clean":"2024-09-17T02:55:55.666625+0000","last_became_active":"2024-09-17T02:55:54.649524+0000","last_became_peered":"2024-09-17T02:55:54.649524+0000","last_unstale":"2024-09-17T02:55:55.666625+0000","last_undegraded":"2024-09-17T02:55:55.666625+0000","last_fullsized":"2024-09-17T02:55:55.666625+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:29.020586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.653701+0000","last_change":"2024-09-17T02:55:55.653478+0000","last_active":"2024-09-17T02:55:55.653701+0000","last_peered":"2024-09-17T02:55:55.653701+0000","last_clean":"2024-09-17T02:55:55.653701+0000","last_became_active":"2024-09-17T02:55:55.653226+0000","last_became_peered":"2024-09-17T02:55:55.653226+0000","last_unstale":"2024-09-17T02:55:55.653701+0000","last_undegraded":"2024-09-17T02:55:55.653701+0000","last_fullsized":"2024-09-17T02:55:55.653701+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:58.082716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669356+0000","last_change":"2024-09-17T02:55:54.658795+0000","last_active":"2024-09-17T02:55:55.669356+0000","last_peered":"2024-09-17T02:55:55.669356+0000","last_clean":"2024-09-17T02:55:55.669356+0000","last_became_active":"2024-09-17T02:55:54.658336+0000","last_became_peered":"2024-09-17T02:55:54.658336+0000","last_unstale":"2024-09-17T02:55:55.669356+0000","last_undegraded":"2024-09-17T02:55:55.669356+0000","last_fullsized":"2024-09-17T02:55:55.669356+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:26.815623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665287+0000","last_change":"2024-09-17T02:55:55.664356+0000","last_active":"2024-09-17T02:55:55.665287+0000","last_peered":"2024-09-17T02:55:55.665287+0000","last_clean":"2024-09-17T02:55:55.665287+0000","last_became_active":"2024-09-17T02:55:55.663807+0000","last_became_peered":"2024-09-17T02:55:55.663807+0000","last_unstale":"2024-09-17T02:55:55.665287+0000","last_undegraded":"2024-09-17T02:55:55.665287+0000","last_fullsized":"2024-09-17T02:55:55.665287+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:25.385594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.648275+0000","last_change":"2024-09-17T02:55:54.658180+0000","last_active":"2024-09-17T02:55:55.648275+0000","last_peered":"2024-09-17T02:55:55.648275+0000","last_clean":"2024-09-17T02:55:55.648275+0000","last_became_active":"2024-09-17T02:55:54.657832+0000","last_became_peered":"2024-09-17T02:55:54.657832+0000","last_unstale":"2024-09-17T02:55:55.648275+0000","last_undegraded":"2024-09-17T02:55:55.648275+0000","last_fullsized":"2024-09-17T02:55:55.648275+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:39.621996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657374+0000","last_change":"2024-09-17T02:55:55.656436+0000","last_active":"2024-09-17T02:55:55.657374+0000","last_peered":"2024-09-17T02:55:55.657374+0000","last_clean":"2024-09-17T02:55:55.657374+0000","last_became_active":"2024-09-17T02:55:55.655678+0000","last_became_peered":"2024-09-17T02:55:55.655678+0000","last_unstale":"2024-09-17T02:55:55.657374+0000","last_undegraded":"2024-09-17T02:55:55.657374+0000","last_fullsized":"2024-09-17T02:55:55.657374+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:47.809642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.649870+0000","last_change":"2024-09-17T02:55:54.648200+0000","last_active":"2024-09-17T02:55:55.649870+0000","last_peered":"2024-09-17T02:55:55.649870+0000","last_clean":"2024-09-17T02:55:55.649870+0000","last_became_active":"2024-09-17T02:55:54.647923+0000","last_became_peered":"2024-09-17T02:55:54.647923+0000","last_unstale":"2024-09-17T02:55:55.649870+0000","last_undegraded":"2024-09-17T02:55:55.649870+0000","last_fullsized":"2024-09-17T02:55:55.649870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:07.656016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.664642+0000","last_change":"2024-09-17T02:55:55.664207+0000","last_active":"2024-09-17T02:55:55.664642+0000","last_peered":"2024-09-17T02:55:55.664642+0000","last_clean":"2024-09-17T02:55:55.664642+0000","last_became_active":"2024-09-17T02:55:55.663936+0000","last_became_peered":"2024-09-17T02:55:55.663936+0000","last_unstale":"2024-09-17T02:55:55.664642+0000","last_undegraded":"2024-09-17T02:55:55.664642+0000","last_fullsized":"2024-09-17T02:55:55.664642+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:50.194820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654492+0000","last_change":"2024-09-17T02:55:54.655459+0000","last_active":"2024-09-17T02:55:55.654492+0000","last_peered":"2024-09-17T02:55:55.654492+0000","last_clean":"2024-09-17T02:55:55.654492+0000","last_became_active":"2024-09-17T02:55:54.654635+0000","last_became_peered":"2024-09-17T02:55:54.654635+0000","last_unstale":"2024-09-17T02:55:55.654492+0000","last_undegraded":"2024-09-17T02:55:55.654492+0000","last_fullsized":"2024-09-17T02:55:55.654492+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:22.385860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.658014+0000","last_change":"2024-09-17T02:55:55.657672+0000","last_active":"2024-09-17T02:55:55.658014+0000","last_peered":"2024-09-17T02:55:55.658014+0000","last_clean":"2024-09-17T02:55:55.658014+0000","last_became_active":"2024-09-17T02:55:55.657320+0000","last_became_peered":"2024-09-17T02:55:55.657320+0000","last_unstale":"2024-09-17T02:55:55.658014+0000","last_undegraded":"2024-09-17T02:55:55.658014+0000","last_fullsized":"2024-09-17T02:55:55.658014+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:51.520290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.650933+0000","last_change":"2024-09-17T02:55:54.649461+0000","last_active":"2024-09-17T02:55:55.650933+0000","last_peered":"2024-09-17T02:55:55.650933+0000","last_clean":"2024-09-17T02:55:55.650933+0000","last_became_active":"2024-09-17T02:55:54.648766+0000","last_became_peered":"2024-09-17T02:55:54.648766+0000","last_unstale":"2024-09-17T02:55:55.650933+0000","last_undegraded":"2024-09-17T02:55:55.650933+0000","last_fullsized":"2024-09-17T02:55:55.650933+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:47.418418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662471+0000","last_change":"2024-09-17T02:55:55.662247+0000","last_active":"2024-09-17T02:55:55.662471+0000","last_peered":"2024-09-17T02:55:55.662471+0000","last_clean":"2024-09-17T02:55:55.662471+0000","last_became_active":"2024-09-17T02:55:55.660196+0000","last_became_peered":"2024-09-17T02:55:55.660196+0000","last_unstale":"2024-09-17T02:55:55.662471+0000","last_undegraded":"2024-09-17T02:55:55.662471+0000","last_fullsized":"2024-09-17T02:55:55.662471+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:47.990157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.668961+0000","last_change":"2024-09-17T02:55:54.651961+0000","last_active":"2024-09-17T02:55:55.668961+0000","last_peered":"2024-09-17T02:55:55.668961+0000","last_clean":"2024-09-17T02:55:55.668961+0000","last_became_active":"2024-09-17T02:55:54.651696+0000","last_became_peered":"2024-09-17T02:55:54.651696+0000","last_unstale":"2024-09-17T02:55:55.668961+0000","last_undegraded":"2024-09-17T02:55:55.668961+0000","last_fullsized":"2024-09-17T02:55:55.668961+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:58.404833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665417+0000","last_change":"2024-09-17T02:55:55.665087+0000","last_active":"2024-09-17T02:55:55.665417+0000","last_peered":"2024-09-17T02:55:55.665417+0000","last_clean":"2024-09-17T02:55:55.665417+0000","last_became_active":"2024-09-17T02:55:55.664311+0000","last_became_peered":"2024-09-17T02:55:55.664311+0000","last_unstale":"2024-09-17T02:55:55.665417+0000","last_undegraded":"2024-09-17T02:55:55.665417+0000","last_fullsized":"2024-09-17T02:55:55.665417+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:45.981315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.670884+0000","last_change":"2024-09-17T02:55:54.657613+0000","last_active":"2024-09-17T02:55:55.670884+0000","last_peered":"2024-09-17T02:55:55.670884+0000","last_clean":"2024-09-17T02:55:55.670884+0000","last_became_active":"2024-09-17T02:55:54.657125+0000","last_became_peered":"2024-09-17T02:55:54.657125+0000","last_unstale":"2024-09-17T02:55:55.670884+0000","last_undegraded":"2024-09-17T02:55:55.670884+0000","last_fullsized":"2024-09-17T02:55:55.670884+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:48.799307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654600+0000","last_change":"2024-09-17T02:55:55.654317+0000","last_active":"2024-09-17T02:55:55.654600+0000","last_peered":"2024-09-17T02:55:55.654600+0000","last_clean":"2024-09-17T02:55:55.654600+0000","last_became_active":"2024-09-17T02:55:55.653642+0000","last_became_peered":"2024-09-17T02:55:55.653642+0000","last_unstale":"2024-09-17T02:55:55.654600+0000","last_undegraded":"2024-09-17T02:55:55.654600+0000","last_fullsized":"2024-09-17T02:55:55.654600+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:16.907625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669868+0000","last_change":"2024-09-17T02:55:54.648509+0000","last_active":"2024-09-17T02:55:55.669868+0000","last_peered":"2024-09-17T02:55:55.669868+0000","last_clean":"2024-09-17T02:55:55.669868+0000","last_became_active":"2024-09-17T02:55:54.648235+0000","last_became_peered":"2024-09-17T02:55:54.648235+0000","last_unstale":"2024-09-17T02:55:55.669868+0000","last_undegraded":"2024-09-17T02:55:55.669868+0000","last_fullsized":"2024-09-17T02:55:55.669868+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:44.253221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.654630+0000","last_change":"2024-09-17T02:55:55.654402+0000","last_active":"2024-09-17T02:55:55.654630+0000","last_peered":"2024-09-17T02:55:55.654630+0000","last_clean":"2024-09-17T02:55:55.654630+0000","last_became_active":"2024-09-17T02:55:55.654134+0000","last_became_peered":"2024-09-17T02:55:55.654134+0000","last_unstale":"2024-09-17T02:55:55.654630+0000","last_undegraded":"2024-09-17T02:55:55.654630+0000","last_fullsized":"2024-09-17T02:55:55.654630+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:09.397605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651476+0000","last_change":"2024-09-17T02:55:54.654542+0000","last_active":"2024-09-17T02:55:55.651476+0000","last_peered":"2024-09-17T02:55:55.651476+0000","last_clean":"2024-09-17T02:55:55.651476+0000","last_became_active":"2024-09-17T02:55:54.653485+0000","last_became_peered":"2024-09-17T02:55:54.653485+0000","last_unstale":"2024-09-17T02:55:55.651476+0000","last_undegraded":"2024-09-17T02:55:55.651476+0000","last_fullsized":"2024-09-17T02:55:55.651476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:39.446902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659361+0000","last_change":"2024-09-17T02:55:55.659112+0000","last_active":"2024-09-17T02:55:55.659361+0000","last_peered":"2024-09-17T02:55:55.659361+0000","last_clean":"2024-09-17T02:55:55.659361+0000","last_became_active":"2024-09-17T02:55:55.658723+0000","last_became_peered":"2024-09-17T02:55:55.658723+0000","last_unstale":"2024-09-17T02:55:55.659361+0000","last_undegraded":"2024-09-17T02:55:55.659361+0000","last_fullsized":"2024-09-17T02:55:55.659361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.404464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651742+0000","last_change":"2024-09-17T02:55:54.652906+0000","last_active":"2024-09-17T02:55:55.651742+0000","last_peered":"2024-09-17T02:55:55.651742+0000","last_clean":"2024-09-17T02:55:55.651742+0000","last_became_active":"2024-09-17T02:55:54.650807+0000","last_became_peered":"2024-09-17T02:55:54.650807+0000","last_unstale":"2024-09-17T02:55:55.651742+0000","last_undegraded":"2024-09-17T02:55:55.651742+0000","last_fullsized":"2024-09-17T02:55:55.651742+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:05.759917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661857+0000","last_change":"2024-09-17T02:55:55.661615+0000","last_active":"2024-09-17T02:55:55.661857+0000","last_peered":"2024-09-17T02:55:55.661857+0000","last_clean":"2024-09-17T02:55:55.661857+0000","last_became_active":"2024-09-17T02:55:55.661332+0000","last_became_peered":"2024-09-17T02:55:55.661332+0000","last_unstale":"2024-09-17T02:55:55.661857+0000","last_undegraded":"2024-09-17T02:55:55.661857+0000","last_fullsized":"2024-09-17T02:55:55.661857+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:25.615602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.673479+0000","last_change":"2024-09-17T02:55:54.658944+0000","last_active":"2024-09-17T02:55:55.673479+0000","last_peered":"2024-09-17T02:55:55.673479+0000","last_clean":"2024-09-17T02:55:55.673479+0000","last_became_active":"2024-09-17T02:55:54.658662+0000","last_became_peered":"2024-09-17T02:55:54.658662+0000","last_unstale":"2024-09-17T02:55:55.673479+0000","last_undegraded":"2024-09-17T02:55:55.673479+0000","last_fullsized":"2024-09-17T02:55:55.673479+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:08.600797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.650845+0000","last_change":"2024-09-17T02:55:55.650552+0000","last_active":"2024-09-17T02:55:55.650845+0000","last_peered":"2024-09-17T02:55:55.650845+0000","last_clean":"2024-09-17T02:55:55.650845+0000","last_became_active":"2024-09-17T02:55:55.650251+0000","last_became_peered":"2024-09-17T02:55:55.650251+0000","last_unstale":"2024-09-17T02:55:55.650845+0000","last_undegraded":"2024-09-17T02:55:55.650845+0000","last_fullsized":"2024-09-17T02:55:55.650845+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:44.516714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669446+0000","last_change":"2024-09-17T02:55:54.653827+0000","last_active":"2024-09-17T02:55:55.669446+0000","last_peered":"2024-09-17T02:55:55.669446+0000","last_clean":"2024-09-17T02:55:55.669446+0000","last_became_active":"2024-09-17T02:55:54.653517+0000","last_became_peered":"2024-09-17T02:55:54.653517+0000","last_unstale":"2024-09-17T02:55:55.669446+0000","last_undegraded":"2024-09-17T02:55:55.669446+0000","last_fullsized":"2024-09-17T02:55:55.669446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:00.259716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.652567+0000","last_change":"2024-09-17T02:55:55.652034+0000","last_active":"2024-09-17T02:55:55.652567+0000","last_peered":"2024-09-17T02:55:55.652567+0000","last_clean":"2024-09-17T02:55:55.652567+0000","last_became_active":"2024-09-17T02:55:55.651724+0000","last_became_peered":"2024-09-17T02:55:55.651724+0000","last_unstale":"2024-09-17T02:55:55.652567+0000","last_undegraded":"2024-09-17T02:55:55.652567+0000","last_fullsized":"2024-09-17T02:55:55.652567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:14.138279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669817+0000","last_change":"2024-09-17T02:55:54.657477+0000","last_active":"2024-09-17T02:55:55.669817+0000","last_peered":"2024-09-17T02:55:55.669817+0000","last_clean":"2024-09-17T02:55:55.669817+0000","last_became_active":"2024-09-17T02:55:54.657167+0000","last_became_peered":"2024-09-17T02:55:54.657167+0000","last_unstale":"2024-09-17T02:55:55.669817+0000","last_undegraded":"2024-09-17T02:55:55.669817+0000","last_fullsized":"2024-09-17T02:55:55.669817+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:22.237312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657073+0000","last_change":"2024-09-17T02:55:55.656874+0000","last_active":"2024-09-17T02:55:55.657073+0000","last_peered":"2024-09-17T02:55:55.657073+0000","last_clean":"2024-09-17T02:55:55.657073+0000","last_became_active":"2024-09-17T02:55:55.654545+0000","last_became_peered":"2024-09-17T02:55:55.654545+0000","last_unstale":"2024-09-17T02:55:55.657073+0000","last_undegraded":"2024-09-17T02:55:55.657073+0000","last_fullsized":"2024-09-17T02:55:55.657073+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:57.870944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.664841+0000","last_change":"2024-09-17T02:55:54.657870+0000","last_active":"2024-09-17T02:55:55.664841+0000","last_peered":"2024-09-17T02:55:55.664841+0000","last_clean":"2024-09-17T02:55:55.664841+0000","last_became_active":"2024-09-17T02:55:54.657569+0000","last_became_peered":"2024-09-17T02:55:54.657569+0000","last_unstale":"2024-09-17T02:55:55.664841+0000","last_undegraded":"2024-09-17T02:55:55.664841+0000","last_fullsized":"2024-09-17T02:55:55.664841+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:06.725260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.655361+0000","last_change":"2024-09-17T02:55:55.655172+0000","last_active":"2024-09-17T02:55:55.655361+0000","last_peered":"2024-09-17T02:55:55.655361+0000","last_clean":"2024-09-17T02:55:55.655361+0000","last_became_active":"2024-09-17T02:55:55.654921+0000","last_became_peered":"2024-09-17T02:55:55.654921+0000","last_unstale":"2024-09-17T02:55:55.655361+0000","last_undegraded":"2024-09-17T02:55:55.655361+0000","last_fullsized":"2024-09-17T02:55:55.655361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:12.829877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651965+0000","last_change":"2024-09-17T02:55:54.653216+0000","last_active":"2024-09-17T02:55:55.651965+0000","last_peered":"2024-09-17T02:55:55.651965+0000","last_clean":"2024-09-17T02:55:55.651965+0000","last_became_active":"2024-09-17T02:55:54.651513+0000","last_became_peered":"2024-09-17T02:55:54.651513+0000","last_unstale":"2024-09-17T02:55:55.651965+0000","last_undegraded":"2024-09-17T02:55:55.651965+0000","last_fullsized":"2024-09-17T02:55:55.651965+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:17.838615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662031+0000","last_change":"2024-09-17T02:55:55.661694+0000","last_active":"2024-09-17T02:55:55.662031+0000","last_peered":"2024-09-17T02:55:55.662031+0000","last_clean":"2024-09-17T02:55:55.662031+0000","last_became_active":"2024-09-17T02:55:55.659865+0000","last_became_peered":"2024-09-17T02:55:55.659865+0000","last_unstale":"2024-09-17T02:55:55.662031+0000","last_undegraded":"2024-09-17T02:55:55.662031+0000","last_fullsized":"2024-09-17T02:55:55.662031+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:29.290748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669262+0000","last_change":"2024-09-17T02:55:54.652252+0000","last_active":"2024-09-17T02:55:55.669262+0000","last_peered":"2024-09-17T02:55:55.669262+0000","last_clean":"2024-09-17T02:55:55.669262+0000","last_became_active":"2024-09-17T02:55:54.651964+0000","last_became_peered":"2024-09-17T02:55:54.651964+0000","last_unstale":"2024-09-17T02:55:55.669262+0000","last_undegraded":"2024-09-17T02:55:55.669262+0000","last_fullsized":"2024-09-17T02:55:55.669262+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:29.295148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.666451+0000","last_change":"2024-09-17T02:55:55.666181+0000","last_active":"2024-09-17T02:55:55.666451+0000","last_peered":"2024-09-17T02:55:55.666451+0000","last_clean":"2024-09-17T02:55:55.666451+0000","last_became_active":"2024-09-17T02:55:55.665638+0000","last_became_peered":"2024-09-17T02:55:55.665638+0000","last_unstale":"2024-09-17T02:55:55.666451+0000","last_undegraded":"2024-09-17T02:55:55.666451+0000","last_fullsized":"2024-09-17T02:55:55.666451+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:36.509037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.648535+0000","last_change":"2024-09-17T02:55:54.654010+0000","last_active":"2024-09-17T02:55:55.648535+0000","last_peered":"2024-09-17T02:55:55.648535+0000","last_clean":"2024-09-17T02:55:55.648535+0000","last_became_active":"2024-09-17T02:55:54.653447+0000","last_became_peered":"2024-09-17T02:55:54.653447+0000","last_unstale":"2024-09-17T02:55:55.648535+0000","last_undegraded":"2024-09-17T02:55:55.648535+0000","last_fullsized":"2024-09-17T02:55:55.648535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:09.464992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.663901+0000","last_change":"2024-09-17T02:55:55.659057+0000","last_active":"2024-09-17T02:55:55.663901+0000","last_peered":"2024-09-17T02:55:55.663901+0000","last_clean":"2024-09-17T02:55:55.663901+0000","last_became_active":"2024-09-17T02:55:55.658670+0000","last_became_peered":"2024-09-17T02:55:55.658670+0000","last_unstale":"2024-09-17T02:55:55.663901+0000","last_undegraded":"2024-09-17T02:55:55.663901+0000","last_fullsized":"2024-09-17T02:55:55.663901+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:10.256785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.650078+0000","last_change":"2024-09-17T02:55:54.649987+0000","last_active":"2024-09-17T02:55:55.650078+0000","last_peered":"2024-09-17T02:55:55.650078+0000","last_clean":"2024-09-17T02:55:55.650078+0000","last_became_active":"2024-09-17T02:55:54.649713+0000","last_became_peered":"2024-09-17T02:55:54.649713+0000","last_unstale":"2024-09-17T02:55:55.650078+0000","last_undegraded":"2024-09-17T02:55:55.650078+0000","last_fullsized":"2024-09-17T02:55:55.650078+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:33.747849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665259+0000","last_change":"2024-09-17T02:55:55.664062+0000","last_active":"2024-09-17T02:55:55.665259+0000","last_peered":"2024-09-17T02:55:55.665259+0000","last_clean":"2024-09-17T02:55:55.665259+0000","last_became_active":"2024-09-17T02:55:55.663475+0000","last_became_peered":"2024-09-17T02:55:55.663475+0000","last_unstale":"2024-09-17T02:55:55.665259+0000","last_undegraded":"2024-09-17T02:55:55.665259+0000","last_fullsized":"2024-09-17T02:55:55.665259+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:44.718318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.652008+0000","last_change":"2024-09-17T02:55:54.655568+0000","last_active":"2024-09-17T02:55:55.652008+0000","last_peered":"2024-09-17T02:55:55.652008+0000","last_clean":"2024-09-17T02:55:55.652008+0000","last_became_active":"2024-09-17T02:55:54.653853+0000","last_became_peered":"2024-09-17T02:55:54.653853+0000","last_unstale":"2024-09-17T02:55:55.652008+0000","last_undegraded":"2024-09-17T02:55:55.652008+0000","last_fullsized":"2024-09-17T02:55:55.652008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:03.304425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.656749+0000","last_change":"2024-09-17T02:55:55.654901+0000","last_active":"2024-09-17T02:55:55.656749+0000","last_peered":"2024-09-17T02:55:55.656749+0000","last_clean":"2024-09-17T02:55:55.656749+0000","last_became_active":"2024-09-17T02:55:55.653823+0000","last_became_peered":"2024-09-17T02:55:55.653823+0000","last_unstale":"2024-09-17T02:55:55.656749+0000","last_undegraded":"2024-09-17T02:55:55.656749+0000","last_fullsized":"2024-09-17T02:55:55.656749+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:29.425056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.652799+0000","last_change":"2024-09-17T02:55:54.657351+0000","last_active":"2024-09-17T02:55:55.652799+0000","last_peered":"2024-09-17T02:55:55.652799+0000","last_clean":"2024-09-17T02:55:55.652799+0000","last_became_active":"2024-09-17T02:55:54.657052+0000","last_became_peered":"2024-09-17T02:55:54.657052+0000","last_unstale":"2024-09-17T02:55:55.652799+0000","last_undegraded":"2024-09-17T02:55:55.652799+0000","last_fullsized":"2024-09-17T02:55:55.652799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:56.584447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.660716+0000","last_change":"2024-09-17T02:55:55.660517+0000","last_active":"2024-09-17T02:55:55.660716+0000","last_peered":"2024-09-17T02:55:55.660716+0000","last_clean":"2024-09-17T02:55:55.660716+0000","last_became_active":"2024-09-17T02:55:55.660248+0000","last_became_peered":"2024-09-17T02:55:55.660248+0000","last_unstale":"2024-09-17T02:55:55.660716+0000","last_undegraded":"2024-09-17T02:55:55.660716+0000","last_fullsized":"2024-09-17T02:55:55.660716+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:34.432499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651561+0000","last_change":"2024-09-17T02:55:54.651840+0000","last_active":"2024-09-17T02:55:55.651561+0000","last_peered":"2024-09-17T02:55:55.651561+0000","last_clean":"2024-09-17T02:55:55.651561+0000","last_became_active":"2024-09-17T02:55:54.651560+0000","last_became_peered":"2024-09-17T02:55:54.651560+0000","last_unstale":"2024-09-17T02:55:55.651561+0000","last_undegraded":"2024-09-17T02:55:55.651561+0000","last_fullsized":"2024-09-17T02:55:55.651561+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:10.745370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.661132+0000","last_change":"2024-09-17T02:55:55.660559+0000","last_active":"2024-09-17T02:55:55.661132+0000","last_peered":"2024-09-17T02:55:55.661132+0000","last_clean":"2024-09-17T02:55:55.661132+0000","last_became_active":"2024-09-17T02:55:55.660277+0000","last_became_peered":"2024-09-17T02:55:55.660277+0000","last_unstale":"2024-09-17T02:55:55.661132+0000","last_undegraded":"2024-09-17T02:55:55.661132+0000","last_fullsized":"2024-09-17T02:55:55.661132+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:27.352157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662357+0000","last_change":"2024-09-17T02:55:54.655140+0000","last_active":"2024-09-17T02:55:55.662357+0000","last_peered":"2024-09-17T02:55:55.662357+0000","last_clean":"2024-09-17T02:55:55.662357+0000","last_became_active":"2024-09-17T02:55:54.654787+0000","last_became_peered":"2024-09-17T02:55:54.654787+0000","last_unstale":"2024-09-17T02:55:55.662357+0000","last_undegraded":"2024-09-17T02:55:55.662357+0000","last_fullsized":"2024-09-17T02:55:55.662357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:45.383302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.662446+0000","last_change":"2024-09-17T02:55:55.662243+0000","last_active":"2024-09-17T02:55:55.662446+0000","last_peered":"2024-09-17T02:55:55.662446+0000","last_clean":"2024-09-17T02:55:55.662446+0000","last_became_active":"2024-09-17T02:55:55.661981+0000","last_became_peered":"2024-09-17T02:55:55.661981+0000","last_unstale":"2024-09-17T02:55:55.662446+0000","last_undegraded":"2024-09-17T02:55:55.662446+0000","last_fullsized":"2024-09-17T02:55:55.662446+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:06.887638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.652744+0000","last_change":"2024-09-17T02:55:54.656176+0000","last_active":"2024-09-17T02:55:55.652744+0000","last_peered":"2024-09-17T02:55:55.652744+0000","last_clean":"2024-09-17T02:55:55.652744+0000","last_became_active":"2024-09-17T02:55:54.655299+0000","last_became_peered":"2024-09-17T02:55:54.655299+0000","last_unstale":"2024-09-17T02:55:55.652744+0000","last_undegraded":"2024-09-17T02:55:55.652744+0000","last_fullsized":"2024-09-17T02:55:55.652744+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:02.498548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.664925+0000","last_change":"2024-09-17T02:55:55.661527+0000","last_active":"2024-09-17T02:55:55.664925+0000","last_peered":"2024-09-17T02:55:55.664925+0000","last_clean":"2024-09-17T02:55:55.664925+0000","last_became_active":"2024-09-17T02:55:55.660160+0000","last_became_peered":"2024-09-17T02:55:55.660160+0000","last_unstale":"2024-09-17T02:55:55.664925+0000","last_undegraded":"2024-09-17T02:55:55.664925+0000","last_fullsized":"2024-09-17T02:55:55.664925+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:40.468567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659101+0000","last_change":"2024-09-17T02:55:54.654173+0000","last_active":"2024-09-17T02:55:55.659101+0000","last_peered":"2024-09-17T02:55:55.659101+0000","last_clean":"2024-09-17T02:55:55.659101+0000","last_became_active":"2024-09-17T02:55:54.653894+0000","last_became_peered":"2024-09-17T02:55:54.653894+0000","last_unstale":"2024-09-17T02:55:55.659101+0000","last_undegraded":"2024-09-17T02:55:55.659101+0000","last_fullsized":"2024-09-17T02:55:55.659101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:09.199302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.665999+0000","last_change":"2024-09-17T02:55:55.665347+0000","last_active":"2024-09-17T02:55:55.665999+0000","last_peered":"2024-09-17T02:55:55.665999+0000","last_clean":"2024-09-17T02:55:55.665999+0000","last_became_active":"2024-09-17T02:55:55.665050+0000","last_became_peered":"2024-09-17T02:55:55.665050+0000","last_unstale":"2024-09-17T02:55:55.665999+0000","last_undegraded":"2024-09-17T02:55:55.665999+0000","last_fullsized":"2024-09-17T02:55:55.665999+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:30.743093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.658207+0000","last_change":"2024-09-17T02:55:54.650487+0000","last_active":"2024-09-17T02:55:55.658207+0000","last_peered":"2024-09-17T02:55:55.658207+0000","last_clean":"2024-09-17T02:55:55.658207+0000","last_became_active":"2024-09-17T02:55:54.650213+0000","last_became_peered":"2024-09-17T02:55:54.650213+0000","last_unstale":"2024-09-17T02:55:55.658207+0000","last_undegraded":"2024-09-17T02:55:55.658207+0000","last_fullsized":"2024-09-17T02:55:55.658207+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:03.353700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.657272+0000","last_change":"2024-09-17T02:55:55.657035+0000","last_active":"2024-09-17T02:55:55.657272+0000","last_peered":"2024-09-17T02:55:55.657272+0000","last_clean":"2024-09-17T02:55:55.657272+0000","last_became_active":"2024-09-17T02:55:55.656665+0000","last_became_peered":"2024-09-17T02:55:55.656665+0000","last_unstale":"2024-09-17T02:55:55.657272+0000","last_undegraded":"2024-09-17T02:55:55.657272+0000","last_fullsized":"2024-09-17T02:55:55.657272+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:18.008952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.650809+0000","last_change":"2024-09-17T02:55:54.648103+0000","last_active":"2024-09-17T02:55:55.650809+0000","last_peered":"2024-09-17T02:55:55.650809+0000","last_clean":"2024-09-17T02:55:55.650809+0000","last_became_active":"2024-09-17T02:55:54.647833+0000","last_became_peered":"2024-09-17T02:55:54.647833+0000","last_unstale":"2024-09-17T02:55:55.650809+0000","last_undegraded":"2024-09-17T02:55:55.650809+0000","last_fullsized":"2024-09-17T02:55:55.650809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:28.690230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.659339+0000","last_change":"2024-09-17T02:55:55.659114+0000","last_active":"2024-09-17T02:55:55.659339+0000","last_peered":"2024-09-17T02:55:55.659339+0000","last_clean":"2024-09-17T02:55:55.659339+0000","last_became_active":"2024-09-17T02:55:55.658478+0000","last_became_peered":"2024-09-17T02:55:55.658478+0000","last_unstale":"2024-09-17T02:55:55.659339+0000","last_undegraded":"2024-09-17T02:55:55.659339+0000","last_fullsized":"2024-09-17T02:55:55.659339+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:54.634932+0000","last_clean_scrub_stamp":"2024-09-17T02:55:54.634932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:45.292611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.669200+0000","last_change":"2024-09-17T02:55:54.658975+0000","last_active":"2024-09-17T02:55:55.669200+0000","last_peered":"2024-09-17T02:55:55.669200+0000","last_clean":"2024-09-17T02:55:55.669200+0000","last_became_active":"2024-09-17T02:55:54.658367+0000","last_became_peered":"2024-09-17T02:55:54.658367+0000","last_unstale":"2024-09-17T02:55:55.669200+0000","last_undegraded":"2024-09-17T02:55:55.669200+0000","last_fullsized":"2024-09-17T02:55:55.669200+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:55:53.632484+0000","last_clean_scrub_stamp":"2024-09-17T02:55:53.632484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:59.888899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":154,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T02:55:55.651648+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:55:55.651648+0000","last_peered":"2024-09-17T02:55:55.651648+0000","last_clean":"2024-09-17T02:55:55.651648+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:55:55.651648+0000","last_undegraded":"2024-09-17T02:55:55.651648+0000","last_fullsized":"2024-09-17T02:55:55.651648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:57.379115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199196880,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195104,"statfs":{"total":200000000,"available":199786666,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195104,"statfs":{"total":200000000,"available":199787268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785726,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":208,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195104,"statfs":{"total":200000000,"available":199786700,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":209,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195103,"statfs":{"total":200000000,"available":199785704,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":207,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195104,"statfs":{"total":200000000,"available":199787268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":784,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194528,"statfs":{"total":200000000,"available":199196936,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:55:59.010 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:55:59.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T02:55:59.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.168+0000 7fe288863640 1 -- 172.21.15.104:0/1373742050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 msgr2=0x7fe26c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.168+0000 7fe288863640 1 --2- 172.21.15.104:0/1373742050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 0x7fe26c004c10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe278001630 tx=0x7fe26c005830 comp rx=0 tx=0).stop 2024-09-17T02:55:59.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.168+0000 7fe282d9d640 1 -- 172.21.15.104:0/1373742050 reap_dead start 2024-09-17T02:55:59.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.168+0000 7fe288863640 1 -- 172.21.15.104:0/1373742050 shutdown_connections 2024-09-17T02:55:59.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.168+0000 7fe288863640 1 -- 172.21.15.104:0/1373742050 >> 172.21.15.104:0/1373742050 conn(0x7fe2840d28e0 msgr2=0x7fe2840d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:59.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.168+0000 7fe288863640 1 -- 172.21.15.104:0/1373742050 shutdown_connections 2024-09-17T02:55:59.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.168+0000 7fe288863640 1 -- 172.21.15.104:0/1373742050 wait complete. 2024-09-17T02:55:59.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.170+0000 7fe288863640 1 Processor -- start 2024-09-17T02:55:59.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.170+0000 7fe288863640 1 -- start start 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe288863640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 0x7fe2841f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe288863640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284158320 0x7fe284158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe288863640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe284151740 0x7fe284151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe288863640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840b5ac0 con 0x7fe26c004800 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe288863640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe2840b5940 con 0x7fe284158320 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe288863640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe2840d02a0 con 0x7fe284151740 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe28259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 0x7fe2841f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe28259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 0x7fe2841f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45578/0 (socket says 172.21.15.104:45578) 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe28259c640 1 -- 172.21.15.104:0/1700602612 learned_addr learned my addr 172.21.15.104:0/1700602612 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe282d9d640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe284151740 0x7fe284151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:59.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe281d9b640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284158320 0x7fe284158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe28259c640 1 -- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe284151740 msgr2=0x7fe284151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe28259c640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe284151740 0x7fe284151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe28259c640 1 -- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284158320 msgr2=0x7fe284158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe28259c640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284158320 0x7fe284158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe28259c640 1 -- 172.21.15.104:0/1700602612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2841f8120 con 0x7fe26c004800 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe282d9d640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe284151740 0x7fe284151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.171+0000 7fe281d9b640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284158320 0x7fe284158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.172+0000 7fe28259c640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 0x7fe2841f7be0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe274011ae0 tx=0x7fe274009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.172+0000 7fe272ffd640 1 -- 172.21.15.104:0/1700602612 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27401e070 con 0x7fe26c004800 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.172+0000 7fe272ffd640 1 -- 172.21.15.104:0/1700602612 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe27400fc40 con 0x7fe26c004800 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.172+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28409ced0 con 0x7fe26c004800 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.172+0000 7fe272ffd640 1 -- 172.21.15.104:0/1700602612 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274004030 con 0x7fe26c004800 2024-09-17T02:55:59.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.172+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28409d490 con 0x7fe26c004800 2024-09-17T02:55:59.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.173+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2840cdad0 con 0x7fe26c004800 2024-09-17T02:55:59.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.174+0000 7fe272ffd640 1 -- 172.21.15.104:0/1700602612 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe274021070 con 0x7fe26c004800 2024-09-17T02:55:59.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.174+0000 7fe272ffd640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe264078b90 0x7fe26407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:59.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.174+0000 7fe272ffd640 1 -- 172.21.15.104:0/1700602612 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe27409b540 con 0x7fe26c004800 2024-09-17T02:55:59.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.174+0000 7fe281d9b640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe264078b90 0x7fe26407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:59.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.175+0000 7fe281d9b640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe264078b90 0x7fe26407b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe278032000 tx=0x7fe278001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:59.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.179+0000 7fe272ffd640 1 -- 172.21.15.104:0/1700602612 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe2841f8120 con 0x7fe26c004800 2024-09-17T02:55:59.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.419+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe2840711b0 con 0x7fe26c004800 2024-09-17T02:55:59.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.422+0000 7fe272ffd640 1 -- 172.21.15.104:0/1700602612 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7fe274063330 con 0x7fe26c004800 2024-09-17T02:55:59.422 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T02:55:59.422 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T02:55:59.422 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T02:55:59.422 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T02:55:59.422 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T02:55:59.422 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T02:55:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe264078b90 msgr2=0x7fe26407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe264078b90 0x7fe26407b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe278032000 tx=0x7fe278001190 comp rx=0 tx=0).stop 2024-09-17T02:55:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 msgr2=0x7fe2841f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 0x7fe2841f7be0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe274011ae0 tx=0x7fe274009ea0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 shutdown_connections 2024-09-17T02:55:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe264078b90 0x7fe26407b0a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284158320 0x7fe284158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe284151740 0x7fe284151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 --2- 172.21.15.104:0/1700602612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe26c004800 0x7fe2841f7be0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 >> 172.21.15.104:0/1700602612 conn(0x7fe2840d28e0 msgr2=0x7fe2840b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:59.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 shutdown_connections 2024-09-17T02:55:59.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.424+0000 7fe288863640 1 -- 172.21.15.104:0/1700602612 wait complete. 2024-09-17T02:55:59.435 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:55:59.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.548+0000 7f29f6007640 1 -- 172.21.15.104:0/2103454432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d8003a50 msgr2=0x7f29d8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.548+0000 7f29f6007640 1 --2- 172.21.15.104:0/2103454432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d8003a50 0x7f29d8003ec0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009b20 tx=0x7f29d8005830 comp rx=0 tx=0).stop 2024-09-17T02:55:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.548+0000 7f29f6007640 1 -- 172.21.15.104:0/2103454432 shutdown_connections 2024-09-17T02:55:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.548+0000 7f29f6007640 1 --2- 172.21.15.104:0/2103454432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29d8003a50 0x7f29d8003ec0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.548+0000 7f29f6007640 1 -- 172.21.15.104:0/2103454432 >> 172.21.15.104:0/2103454432 conn(0x7f29f00b2450 msgr2=0x7f29f00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.549+0000 7f29f6007640 1 -- 172.21.15.104:0/2103454432 shutdown_connections 2024-09-17T02:55:59.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.549+0000 7f29f6007640 1 -- 172.21.15.104:0/2103454432 wait complete. 2024-09-17T02:55:59.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.550+0000 7f29f6007640 1 Processor -- start 2024-09-17T02:55:59.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.550+0000 7f29f6007640 1 -- start start 2024-09-17T02:55:59.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29f6007640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29d8003a50 0x7f29f0149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29f6007640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f01f5150 0x7f29f0154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29f6007640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0155030 0x7f29f0148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29f6007640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f29f006fe40 con 0x7f29f0155030 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29f6007640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29f00cd170 con 0x7f29d8003a50 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29f6007640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f29f01f5a80 con 0x7f29f01f5150 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0155030 0x7f29f0148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0155030 0x7f29f0148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45592/0 (socket says 172.21.15.104:45592) 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 -- 172.21.15.104:0/3274254062 learned_addr learned my addr 172.21.15.104:0/3274254062 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29eeffd640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f01f5150 0x7f29f0154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29ef7fe640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29d8003a50 0x7f29f0149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 -- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f01f5150 msgr2=0x7f29f0154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f01f5150 0x7f29f0154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 -- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29d8003a50 msgr2=0x7f29f0149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29d8003a50 0x7f29f0149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 -- 172.21.15.104:0/3274254062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f0153a50 con 0x7f29f0155030 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29eeffd640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f01f5150 0x7f29f0154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29effff640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0155030 0x7f29f0148c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f29f0074920 tx=0x7f29e80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29d7fff640 1 -- 172.21.15.104:0/3274254062 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8017070 con 0x7f29f0155030 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29d7fff640 1 -- 172.21.15.104:0/3274254062 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29e80108e0 con 0x7f29f0155030 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f0153d30 con 0x7f29f0155030 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.552+0000 7f29d7fff640 1 -- 172.21.15.104:0/3274254062 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8010d30 con 0x7f29f0155030 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.553+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f01542f0 con 0x7f29f0155030 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.553+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f006adb0 con 0x7f29f0155030 2024-09-17T02:55:59.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.554+0000 7f29d7fff640 1 -- 172.21.15.104:0/3274254062 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29e801a070 con 0x7f29f0155030 2024-09-17T02:55:59.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.555+0000 7f29d7fff640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29dc078b90 0x7f29dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:55:59.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.555+0000 7f29d7fff640 1 -- 172.21.15.104:0/3274254062 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f29e809abd0 con 0x7f29f0155030 2024-09-17T02:55:59.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.555+0000 7f29ef7fe640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29dc078b90 0x7f29dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:55:59.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.556+0000 7f29ef7fe640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29dc078b90 0x7f29dc07b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f29e0035000 tx=0x7f29e002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:55:59.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.559+0000 7f29d7fff640 1 -- 172.21.15.104:0/3274254062 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29f006adb0 con 0x7f29f0155030 2024-09-17T02:55:59.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.769+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29f006ffc0 con 0x7f29f0155030 2024-09-17T02:55:59.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.769+0000 7f29d7fff640 1 -- 172.21.15.104:0/3274254062 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7f29e8063010 con 0x7f29f0155030 2024-09-17T02:55:59.769 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:55:59.769 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:55:59.769 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:55:59.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.771+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29dc078b90 msgr2=0x7f29dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.771+0000 7f29f6007640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29dc078b90 0x7f29dc07b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f29e0035000 tx=0x7f29e002d040 comp rx=0 tx=0).stop 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0155030 msgr2=0x7f29f0148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0155030 0x7f29f0148c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f29f0074920 tx=0x7f29e80019b0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 shutdown_connections 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29dc078b90 0x7f29dc07b0a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0155030 0x7f29f0148c50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f01f5150 0x7f29f0154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 --2- 172.21.15.104:0/3274254062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29d8003a50 0x7f29f0149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 >> 172.21.15.104:0/3274254062 conn(0x7f29f00b2450 msgr2=0x7f29f00af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:55:59.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 shutdown_connections 2024-09-17T02:55:59.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:55:59.772+0000 7f29f6007640 1 -- 172.21.15.104:0/3274254062 wait complete. 2024-09-17T02:56:00.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T02:55:55.006646+0000', 'modified': '2024-09-17T02:55:57.007898+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5304}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5304': {'gid': 5304, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/4212438108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6834', 'nonce': 4212438108}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 4212438108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5304, 'qdb_cluster': [5304]} 2024-09-17T02:56:00.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T02:56:00.185 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T02:56:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.300+0000 7fcff6194640 1 -- 172.21.15.104:0/3704767122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcff00b0500 msgr2=0x7fcff00b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.300+0000 7fcff6194640 1 --2- 172.21.15.104:0/3704767122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcff00b0500 0x7fcff00b0910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8005fd0 tx=0x7fcfe802a8b0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.300+0000 7fcff6194640 1 -- 172.21.15.104:0/3704767122 shutdown_connections 2024-09-17T02:56:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.300+0000 7fcff6194640 1 --2- 172.21.15.104:0/3704767122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcff00b0500 0x7fcff00b0910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.300+0000 7fcff6194640 1 --2- 172.21.15.104:0/3704767122 >> v2:172.21.15.192:3300/0 conn(0x7fcff00734f0 0x7fcff0073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.300+0000 7fcff6194640 1 -- 172.21.15.104:0/3704767122 >> 172.21.15.104:0/3704767122 conn(0x7fcff006d200 msgr2=0x7fcff006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.300+0000 7fcff6194640 1 -- 172.21.15.104:0/3704767122 shutdown_connections 2024-09-17T02:56:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.300+0000 7fcff6194640 1 -- 172.21.15.104:0/3704767122 wait complete. 2024-09-17T02:56:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.302+0000 7fcff6194640 1 Processor -- start 2024-09-17T02:56:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.302+0000 7fcff6194640 1 -- start start 2024-09-17T02:56:00.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.303+0000 7fcff6194640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcff00734f0 0x7fcff00b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.303+0000 7fcff6194640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcff00b0500 0x7fcff01f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.303+0000 7fcff6194640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff015c220 0x7fcff01f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.303+0000 7fcff6194640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00b4f20 con 0x7fcff015c220 2024-09-17T02:56:00.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.303+0000 7fcff6194640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00b1250 con 0x7fcff00734f0 2024-09-17T02:56:00.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.303+0000 7fcff6194640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcff00b50a0 con 0x7fcff00b0500 2024-09-17T02:56:00.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff015c220 0x7fcff01f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff015c220 0x7fcff01f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45604/0 (socket says 172.21.15.104:45604) 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 -- 172.21.15.104:0/3408354446 learned_addr learned my addr 172.21.15.104:0/3408354446 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeeffd640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcff00b0500 0x7fcff01f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcff00734f0 0x7fcff00b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 -- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcff00b0500 msgr2=0x7fcff01f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcff00b0500 0x7fcff01f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 -- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcff00734f0 msgr2=0x7fcff00b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcff00734f0 0x7fcff00b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 -- 172.21.15.104:0/3408354446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff0157360 con 0x7fcff015c220 2024-09-17T02:56:00.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff015c220 0x7fcff01f6b60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009cd0 tx=0x7fcfe8033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:00.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfd7fff640 1 -- 172.21.15.104:0/3408354446 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8031990 con 0x7fcff015c220 2024-09-17T02:56:00.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfd7fff640 1 -- 172.21.15.104:0/3408354446 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe8031c20 con 0x7fcff015c220 2024-09-17T02:56:00.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcff6194640 1 -- 172.21.15.104:0/3408354446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff01f71f0 con 0x7fcff015c220 2024-09-17T02:56:00.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcfd7fff640 1 -- 172.21.15.104:0/3408354446 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8033070 con 0x7fcff015c220 2024-09-17T02:56:00.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.304+0000 7fcff6194640 1 -- 172.21.15.104:0/3408354446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff0159460 con 0x7fcff015c220 2024-09-17T02:56:00.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.306+0000 7fcfd7fff640 1 -- 172.21.15.104:0/3408354446 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcfe8033210 con 0x7fcff015c220 2024-09-17T02:56:00.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.307+0000 7fcfd7fff640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.307+0000 7fcfd7fff640 1 -- 172.21.15.104:0/3408354446 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fcfe80bbbc0 con 0x7fcff015c220 2024-09-17T02:56:00.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.307+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.307+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00056a0 tx=0x7fcfe0007e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:00.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.308+0000 7fcffd1d9740 1 Processor -- start 2024-09-17T02:56:00.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.308+0000 7fcffd1d9740 1 -- start start 2024-09-17T02:56:00.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3e8270 0x55c3ac7b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 0x55c3ac7ba4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac7d73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c3ac702820 con 0x55c3ac3c7590 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3ac6f1c50 con 0x55c3ac3e8270 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55c3ac6f5a60 con 0x55c3ac3bf3b0 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac7d73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac7d73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45610/0 (socket says 172.21.15.104:45610) 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeffff640 1 -- 172.21.15.104:0/3838772288 learned_addr learned my addr 172.21.15.104:0/3838772288 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3e8270 0x55c3ac7b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeeffd640 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 0x55c3ac7ba4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeffff640 1 -- 172.21.15.104:0/3838772288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 msgr2=0x55c3ac7ba4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 0x55c3ac7ba4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeffff640 1 -- 172.21.15.104:0/3838772288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3e8270 msgr2=0x55c3ac7b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:00.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3e8270 0x55c3ac7b9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.309+0000 7fcfeffff640 1 -- 172.21.15.104:0/3838772288 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ac453850 con 0x55c3ac3c7590 2024-09-17T02:56:00.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.310+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac7d73e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009420 tx=0x7fcfe80833d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0a0ed5ca81945d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:00.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.310+0000 7fcfd57fa640 1 -- 172.21.15.104:0/3838772288 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80317b0 con 0x55c3ac3c7590 2024-09-17T02:56:00.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.310+0000 7fcfd57fa640 1 -- 172.21.15.104:0/3838772288 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe80839c0 con 0x55c3ac3c7590 2024-09-17T02:56:00.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.310+0000 7fcfd57fa640 1 -- 172.21.15.104:0/3838772288 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80883f0 con 0x55c3ac3c7590 2024-09-17T02:56:00.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3838772288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 msgr2=0x55c3ac7d73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac7d73e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009420 tx=0x7fcfe80833d0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3838772288 shutdown_connections 2024-09-17T02:56:00.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac7d73e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 0x55c3ac7ba4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3838772288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3e8270 0x55c3ac7b9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3838772288 >> 172.21.15.104:0/3838772288 conn(0x55c3ac3dc3c0 msgr2=0x55c3ac790260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:00.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3838772288 shutdown_connections 2024-09-17T02:56:00.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.311+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3838772288 wait complete. 2024-09-17T02:56:00.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.312+0000 7fcffd1d9740 1 -- start start 2024-09-17T02:56:00.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.312+0000 7fcffd1d9740 1 Processor -- start 2024-09-17T02:56:00.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 0x55c3ac7e4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3c7590 0x55c3ac7ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac78f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c3ac462620 con 0x55c3ac3e8270 2024-09-17T02:56:00.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3ac6975f0 con 0x55c3ac3bf3b0 2024-09-17T02:56:00.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55c3ac702820 con 0x55c3ac3c7590 2024-09-17T02:56:00.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcffd1d9740 10 client.0 _ll_register_callbacks cb 0x55c3ac69b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:56:00.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac78f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac78f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45618/0 (socket says 172.21.15.104:45618) 2024-09-17T02:56:00.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 -- 172.21.15.104:0/3189407486 learned_addr learned my addr 172.21.15.104:0/3189407486 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:00.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeeffd640 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3c7590 0x55c3ac7ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 0x55c3ac7e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 -- 172.21.15.104:0/3189407486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3c7590 msgr2=0x55c3ac7ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3c7590 0x55c3ac7ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 -- 172.21.15.104:0/3189407486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 msgr2=0x55c3ac7e4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 0x55c3ac7e4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 -- 172.21.15.104:0/3189407486 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ac4ca6b0 con 0x55c3ac3e8270 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfeffff640 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac78f0d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8080c30 tx=0x7fcfe8083600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a2383385a94d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.313+0000 7fcfce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcfce7fc640 1 -- 172.21.15.104:0/3189407486 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80883f0 con 0x55c3ac3e8270 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcfce7fc640 1 -- 172.21.15.104:0/3189407486 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fcfe808cea0 con 0x55c3ac3e8270 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3189407486 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe80839c0 con 0x55c3ac3e8270 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcfce7fc640 1 -- 172.21.15.104:0/3189407486 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcfe808d0a0 con 0x55c3ac3e8270 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 10 client.5418 fetch_fsmap learned FSMap version 20 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3189407486 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c3ac7cc150 con 0x55c3ac3e8270 2024-09-17T02:56:00.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcfce7fc640 1 -- 172.21.15.104:0/3189407486 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe80839c0 con 0x55c3ac3e8270 2024-09-17T02:56:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcfce7fc640 1 -- 172.21.15.104:0/3189407486 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fcfe8033500 con 0x55c3ac3e8270 2024-09-17T02:56:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 10 client.5418 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T02:56:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 10 client.5418 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T02:56:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 20 client.5418 populate_metadata read hostname 'smithi104' 2024-09-17T02:56:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] conn(0x55c3ac3a6e40 0x55c3ac7cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 4 client.5418 mds_command: new command op to 5304 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T02:56:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3189407486 --> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3ac704770 con 0x55c3ac3a6e40 2024-09-17T02:56:00.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.314+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] conn(0x55c3ac3a6e40 0x55c3ac7cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcfce7fc640 10 client.5418 ms_handle_connect on v2:172.21.15.104:6834/4212438108 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] conn(0x55c3ac3a6e40 0x55c3ac7cce00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=967c9ed8455119fd server_cookie=d919f8b20bc868a2 in_seq=0 out_seq=0 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcfce7fc640 1 -- 172.21.15.104:0/3189407486 <== mds.0 v2:172.21.15.104:6834/4212438108 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3ac704770 con 0x55c3ac3a6e40 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcfce7fc640 10 client.5418 handle_command_reply: tid=0 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 client.5418 shutdown 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3189407486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 msgr2=0x55c3ac78f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac78f0d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8080c30 tx=0x7fcfe8083600 comp rx=0 tx=0).stop 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3189407486 shutdown_connections 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac78f0d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3c7590 0x55c3ac7ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] conn(0x55c3ac3a6e40 0x55c3ac7cce00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/3189407486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 0x55c3ac7e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcfce7fc640 0 client.5418 ms_handle_reset on v2:172.21.15.104:6834/4212438108 2024-09-17T02:56:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.315+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3189407486 >> 172.21.15.104:0/3189407486 conn(0x55c3ac3dc3c0 msgr2=0x55c3ac7a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.316+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3189407486 shutdown_connections 2024-09-17T02:56:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.316+0000 7fcffd1d9740 1 -- 172.21.15.104:0/3189407486 wait complete. 2024-09-17T02:56:00.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.316+0000 7fcffd1d9740 20 client.5418 trim_cache size 0 max 16384 2024-09-17T02:56:00.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.334+0000 7fcffd1d9740 1 Processor -- start 2024-09-17T02:56:00.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.334+0000 7fcffd1d9740 1 -- start start 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 0x55c3ac78ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac78ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3e8270 0x55c3ac7f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00699a0 con 0x55c3ac3c7590 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcff0068d00 con 0x55c3ac3bf3b0 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcff0069350 con 0x55c3ac3e8270 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcfeeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac78ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcfeeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac78ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45626/0 (socket says 172.21.15.104:45626) 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.335+0000 7fcfeeffd640 1 -- 172.21.15.104:0/1725427874 learned_addr learned my addr 172.21.15.104:0/1725427874 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:00.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfeeffd640 1 -- 172.21.15.104:0/1725427874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3e8270 msgr2=0x55c3ac7f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfeffff640 1 --2- 172.21.15.104:0/1725427874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3e8270 0x55c3ac7f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfeeffd640 1 --2- 172.21.15.104:0/1725427874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3e8270 0x55c3ac7f7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfeeffd640 1 -- 172.21.15.104:0/1725427874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 msgr2=0x55c3ac78ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfeeffd640 1 --2- 172.21.15.104:0/1725427874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 0x55c3ac78ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfeeffd640 1 -- 172.21.15.104:0/1725427874 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ac78ab30 con 0x55c3ac3c7590 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfeeffd640 1 --2- 172.21.15.104:0/1725427874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac78ef70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcff0156f10 tx=0x7fcfe4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd465c8237b05490 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfd4ff9640 1 -- 172.21.15.104:0/1725427874 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4020070 con 0x55c3ac3c7590 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfd4ff9640 1 -- 172.21.15.104:0/1725427874 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe401b400 con 0x55c3ac3c7590 2024-09-17T02:56:00.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.336+0000 7fcfd4ff9640 1 -- 172.21.15.104:0/1725427874 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe401b850 con 0x55c3ac3c7590 2024-09-17T02:56:00.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 -- 172.21.15.104:0/1725427874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 msgr2=0x55c3ac78ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/1725427874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac78ef70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcff0156f10 tx=0x7fcfe4009f50 comp rx=0 tx=0).stop 2024-09-17T02:56:00.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 -- 172.21.15.104:0/1725427874 shutdown_connections 2024-09-17T02:56:00.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/1725427874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3e8270 0x55c3ac7f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/1725427874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3c7590 0x55c3ac78ef70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/1725427874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3bf3b0 0x55c3ac78ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 -- 172.21.15.104:0/1725427874 >> 172.21.15.104:0/1725427874 conn(0x55c3ac3dc3c0 msgr2=0x55c3ac785920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:00.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 -- 172.21.15.104:0/1725427874 shutdown_connections 2024-09-17T02:56:00.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.337+0000 7fcffd1d9740 1 -- 172.21.15.104:0/1725427874 wait complete. 2024-09-17T02:56:00.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.338+0000 7fcffd1d9740 1 -- start start 2024-09-17T02:56:00.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.338+0000 7fcffd1d9740 1 Processor -- start 2024-09-17T02:56:00.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 0x55c3ac789990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3c7590 0x55c3ac84a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcffd1d9740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac84ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55c3ac462620 con 0x55c3ac3e8270 2024-09-17T02:56:00.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c3ac702820 con 0x55c3ac3c7590 2024-09-17T02:56:00.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcffd1d9740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55c3ac6975f0 con 0x55c3ac3bf3b0 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcffd1d9740 10 client.0 _ll_register_callbacks cb 0x7fcfe0017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcfeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac84ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcfeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac84ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45640/0 (socket says 172.21.15.104:45640) 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcfeffff640 1 -- 172.21.15.104:0/2891377676 learned_addr learned my addr 172.21.15.104:0/2891377676 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 0x55c3ac789990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.339+0000 7fcfeeffd640 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3c7590 0x55c3ac84a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfeffff640 1 -- 172.21.15.104:0/2891377676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 msgr2=0x55c3ac789990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfeffff640 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 0x55c3ac789990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfeffff640 1 -- 172.21.15.104:0/2891377676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3c7590 msgr2=0x55c3ac84a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfeffff640 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3c7590 0x55c3ac84a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfeffff640 1 -- 172.21.15.104:0/2891377676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ac7f6ee0 con 0x55c3ac3e8270 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfeffff640 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac84ad30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8088360 tx=0x7fcfe802ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9846037dd8343ac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:00.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfce7fc640 1 -- 172.21.15.104:0/2891377676 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80839c0 con 0x55c3ac3e8270 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfce7fc640 1 -- 172.21.15.104:0/2891377676 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fcfe8082c20 con 0x55c3ac3e8270 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 1 -- 172.21.15.104:0/2891377676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe401b400 con 0x55c3ac3e8270 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfce7fc640 1 -- 172.21.15.104:0/2891377676 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fcfe80883f0 con 0x55c3ac3e8270 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 10 client.5424 fetch_fsmap learned FSMap version 20 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 1 -- 172.21.15.104:0/2891377676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c3ac7f6ee0 con 0x55c3ac3e8270 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfce7fc640 1 -- 172.21.15.104:0/2891377676 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfe401b400 con 0x55c3ac3e8270 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcfce7fc640 1 -- 172.21.15.104:0/2891377676 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 20) ==== 3502+0+0 (secure 0 0 0) 0x7fcfe807f310 con 0x55c3ac3e8270 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 10 client.5424 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 10 client.5424 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 20 client.5424 populate_metadata read hostname 'smithi104' 2024-09-17T02:56:00.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] conn(0x55c3ac858240 0x55c3ac78e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 4 client.5424 mds_command: new command op to 5304 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.340+0000 7fcffd1d9740 1 -- 172.21.15.104:0/2891377676 --> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] -- command(tid 0: {"prefix": "status"}) -- 0x55c3ac7cfc10 con 0x55c3ac858240 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] conn(0x55c3ac858240 0x55c3ac78e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcfce7fc640 10 client.5424 ms_handle_connect on v2:172.21.15.104:6834/4212438108 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcfef7fe640 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] conn(0x55c3ac858240 0x55c3ac78e080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dabec5a85a4dcd13 server_cookie=3aac3d3f1921f257 in_seq=0 out_seq=0 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcfce7fc640 1 -- 172.21.15.104:0/2891377676 <== mds.0 v2:172.21.15.104:6834/4212438108 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c3ac7cfc10 con 0x55c3ac858240 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcfce7fc640 10 client.5424 handle_command_reply: tid=0 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 client.5424 shutdown 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 -- 172.21.15.104:0/2891377676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 msgr2=0x55c3ac84ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac84ad30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8088360 tx=0x7fcfe802ae40 comp rx=0 tx=0).stop 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 -- 172.21.15.104:0/2891377676 shutdown_connections 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.104:6834/4212438108,v1:172.21.15.104:6835/4212438108] conn(0x55c3ac858240 0x55c3ac78e080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c3ac3c7590 0x55c3ac84a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55c3ac3e8270 0x55c3ac84ad30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 --2- 172.21.15.104:0/2891377676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55c3ac3bf3b0 0x55c3ac789990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcfce7fc640 0 client.5424 ms_handle_reset on v2:172.21.15.104:6834/4212438108 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 -- 172.21.15.104:0/2891377676 >> 172.21.15.104:0/2891377676 conn(0x55c3ac3dc3c0 msgr2=0x55c3ac7d57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 -- 172.21.15.104:0/2891377676 shutdown_connections 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 1 -- 172.21.15.104:0/2891377676 wait complete. 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.341+0000 7fcffd1d9740 20 client.5424 trim_cache size 0 max 16384 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:00.347 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5304, 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 4.6905549620000002, 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 20, 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 46, 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 46, 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 10.019422068000001 2024-09-17T02:56:00.348 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:00.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 -- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfdc078b90 msgr2=0x7fcfdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00056a0 tx=0x7fcfe0007e30 comp rx=0 tx=0).stop 2024-09-17T02:56:00.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 -- 172.21.15.104:0/3408354446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff015c220 msgr2=0x7fcff01f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff015c220 0x7fcff01f6b60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009cd0 tx=0x7fcfe8033f70 comp rx=0 tx=0).stop 2024-09-17T02:56:00.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 -- 172.21.15.104:0/3408354446 shutdown_connections 2024-09-17T02:56:00.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfdc078b90 0x7fcfdc07b0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcff015c220 0x7fcff01f6b60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcff00b0500 0x7fcff01f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 --2- 172.21.15.104:0/3408354446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcff00734f0 0x7fcff00b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 -- 172.21.15.104:0/3408354446 >> 172.21.15.104:0/3408354446 conn(0x7fcff006d200 msgr2=0x7fcff006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:00.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 -- 172.21.15.104:0/3408354446 shutdown_connections 2024-09-17T02:56:00.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.342+0000 7fcff6194640 1 -- 172.21.15.104:0/3408354446 wait complete. 2024-09-17T02:56:00.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:56:00.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.465+0000 7fa4a803f640 1 -- 172.21.15.104:0/1353998052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a015de80 msgr2=0x7fa4a00d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.465+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1353998052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a015de80 0x7fa4a00d2200 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009830 tx=0x7fa49c02a510 comp rx=0 tx=0).stop 2024-09-17T02:56:00.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.465+0000 7fa4a803f640 1 -- 172.21.15.104:0/1353998052 shutdown_connections 2024-09-17T02:56:00.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.465+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1353998052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a0073d50 0x7fa4a0074160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.465+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1353998052 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a015de80 0x7fa4a00d2200 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.465+0000 7fa4a803f640 1 -- 172.21.15.104:0/1353998052 >> 172.21.15.104:0/1353998052 conn(0x7fa4a006cfc0 msgr2=0x7fa4a006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:00.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.465+0000 7fa4a803f640 1 -- 172.21.15.104:0/1353998052 shutdown_connections 2024-09-17T02:56:00.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.465+0000 7fa4a803f640 1 -- 172.21.15.104:0/1353998052 wait complete. 2024-09-17T02:56:00.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.467+0000 7fa4a803f640 1 Processor -- start 2024-09-17T02:56:00.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.467+0000 7fa4a803f640 1 -- start start 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a803f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a0073d50 0x7fa4a01f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a803f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a015de80 0x7fa4a0147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a803f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a0160880 0x7fa4a015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a803f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a00d0320 con 0x7fa4a0073d50 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a803f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a00d01a0 con 0x7fa4a0160880 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a803f640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a00d04a0 con 0x7fa4a015de80 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a5ddb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a0073d50 0x7fa4a01f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a5ddb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a0073d50 0x7fa4a01f96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45662/0 (socket says 172.21.15.104:45662) 2024-09-17T02:56:00.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a5ddb640 1 -- 172.21.15.104:0/1764580247 learned_addr learned my addr 172.21.15.104:0/1764580247 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a55da640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a015de80 0x7fa4a0147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a65dc640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a0160880 0x7fa4a015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a5ddb640 1 -- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a015de80 msgr2=0x7fa4a0147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a5ddb640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a015de80 0x7fa4a0147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a5ddb640 1 -- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a0160880 msgr2=0x7fa4a015bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a5ddb640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a0160880 0x7fa4a015bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a5ddb640 1 -- 172.21.15.104:0/1764580247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a01f6540 con 0x7fa4a0073d50 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.468+0000 7fa4a55da640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a015de80 0x7fa4a0147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.469+0000 7fa4a5ddb640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a0073d50 0x7fa4a01f96e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa49c000c00 tx=0x7fa49c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.469+0000 7fa4967fc640 1 -- 172.21.15.104:0/1764580247 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c031d60 con 0x7fa4a0073d50 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.469+0000 7fa4967fc640 1 -- 172.21.15.104:0/1764580247 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa49c0330d0 con 0x7fa4a0073d50 2024-09-17T02:56:00.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.469+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a01f6820 con 0x7fa4a0073d50 2024-09-17T02:56:00.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.469+0000 7fa4967fc640 1 -- 172.21.15.104:0/1764580247 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c033520 con 0x7fa4a0073d50 2024-09-17T02:56:00.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.469+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a01f6de0 con 0x7fa4a0073d50 2024-09-17T02:56:00.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.470+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a0069f00 con 0x7fa4a0073d50 2024-09-17T02:56:00.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.470+0000 7fa4967fc640 1 -- 172.21.15.104:0/1764580247 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa49c0035f0 con 0x7fa4a0073d50 2024-09-17T02:56:00.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.471+0000 7fa4967fc640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa484078b90 0x7fa48407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:00.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.471+0000 7fa4967fc640 1 -- 172.21.15.104:0/1764580247 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fa49c0bc2d0 con 0x7fa4a0073d50 2024-09-17T02:56:00.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.471+0000 7fa4a55da640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa484078b90 0x7fa48407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:00.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.472+0000 7fa4a55da640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa484078b90 0x7fa48407b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa490000f60 tx=0x7fa490009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:00.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.476+0000 7fa4967fc640 1 -- 172.21.15.104:0/1764580247 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa4a0069f00 con 0x7fa4a0073d50 2024-09-17T02:56:00.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.686+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa4a015cef0 con 0x7fa4a0073d50 2024-09-17T02:56:00.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.687+0000 7fa4967fc640 1 -- 172.21.15.104:0/1764580247 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7fa4a015cef0 con 0x7fa4a0073d50 2024-09-17T02:56:00.687 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:56:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa484078b90 msgr2=0x7fa48407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa484078b90 0x7fa48407b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa490000f60 tx=0x7fa490009040 comp rx=0 tx=0).stop 2024-09-17T02:56:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a0073d50 msgr2=0x7fa4a01f96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a0073d50 0x7fa4a01f96e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa49c000c00 tx=0x7fa49c033d60 comp rx=0 tx=0).stop 2024-09-17T02:56:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 shutdown_connections 2024-09-17T02:56:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa484078b90 0x7fa48407b0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4a0160880 0x7fa4a015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4a015de80 0x7fa4a0147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 --2- 172.21.15.104:0/1764580247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4a0073d50 0x7fa4a01f96e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 >> 172.21.15.104:0/1764580247 conn(0x7fa4a006cfc0 msgr2=0x7fa4a00b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 shutdown_connections 2024-09-17T02:56:00.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00.689+0000 7fa4a803f640 1 -- 172.21.15.104:0/1764580247 wait complete. 2024-09-17T02:56:00.699 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:56:00.699 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:56:00.699 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T02:56:00.700 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T02:56:00.700 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:00.700 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:56:00.700 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:56:00.700 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:56:00.700 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:56:00.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:00.700 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T02:56:00.716 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:56:00.716 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:56:00.716 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:56:00.716 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:00.716 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:00.717 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42738sec preferred_lft 42738sec 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T02:56:00.718 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T02:56:00.719 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:00.719 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:56:00.719 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T02:56:00.719 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T02:56:00.719 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:00.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:00.719 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:56:00.780 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T02:56:00.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:00.781 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T02:56:00.837 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T02:56:00.837 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:56:00.837 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:56:00.837 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:56:00.837 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:56:00.838 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:56:00.838 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:56:00.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:56:00.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:56:00.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:56:00.838 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:56:00.860 INFO:tasks.ceph.mds.c.smithi104.stderr:2024-09-17T02:56:00.861+0000 7f62bbeeb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:56:00.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:56:00.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:56:00.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:00.944 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:56:00.960 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T02:56:00.960 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T02:56:00.960 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:56:00.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:00.961 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T02:56:01.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:56:01.025 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:01.081 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:56:01.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:56:01.081 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:01.136 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:56:01.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:01.137 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:56:01.230 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:56:01.230 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:56:01.230 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:56:01.241 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:56:01.241 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:56:01.241 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:56:01.241 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:56:01.241 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:56:01.247 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:56:01.247 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:56:01.247 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:56:01.247 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:56:01.248 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:56:01.248 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:56:01.248 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:56:01.248 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:56:01.250 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T02:56:01.251 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:56:01.251 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:56:01.251 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:56:01.251 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:56:01.251 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:56:01.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:01.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:01.276 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:56:01.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:56:01.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:56:01.378 INFO:teuthology.orchestra.run.smithi104.stdout:client4964 2024-09-17T02:56:01.378 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:01.378 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:01.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:56:01.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2999720362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b3b00 msgr2=0x7f5c680d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:01.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2999720362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b3b00 0x7f5c680d11d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5c680d1fc0 tx=0x7f5c5c02a4d0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2999720362 shutdown_connections 2024-09-17T02:56:01.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2999720362 >> v2:172.21.15.192:3300/0 conn(0x7f5c680d1710 0x7f5c680cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2999720362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b3b00 0x7f5c680d11d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2999720362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c680b6f70 0x7f5c6815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2999720362 >> 172.21.15.104:0/2999720362 conn(0x7f5c68073df0 msgr2=0x7f5c68068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:01.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2999720362 shutdown_connections 2024-09-17T02:56:01.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.547+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2999720362 wait complete. 2024-09-17T02:56:01.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.549+0000 7f5c6d5c3640 1 Processor -- start 2024-09-17T02:56:01.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.549+0000 7f5c6d5c3640 1 -- start start 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c6d5c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c680b3b00 0x7f5c6815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c6d5c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b6f70 0x7f5c680cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c6d5c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c680d1710 0x7f5c680cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c6d5c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5c680d01f0 con 0x7f5c680b6f70 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c6d5c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c680d0070 con 0x7f5c680d1710 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c6d5c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5c680d0370 con 0x7f5c680b3b00 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b6f70 0x7f5c680cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b6f70 0x7f5c680cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45680/0 (socket says 172.21.15.104:45680) 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 -- 172.21.15.104:0/2818256963 learned_addr learned my addr 172.21.15.104:0/2818256963 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c66ffd640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c680b3b00 0x7f5c6815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c677fe640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c680d1710 0x7f5c680cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:01.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 -- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c680b3b00 msgr2=0x7f5c6815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c680b3b00 0x7f5c6815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 -- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c680d1710 msgr2=0x7f5c680cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c680d1710 0x7f5c680cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 -- 172.21.15.104:0/2818256963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c680cdbd0 con 0x7f5c680b6f70 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c677fe640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c680d1710 0x7f5c680cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.550+0000 7f5c667fc640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b6f70 0x7f5c680cce80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c034040 tx=0x7f5c5c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.551+0000 7f5c4f7fe640 1 -- 172.21.15.104:0/2818256963 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c03e030 con 0x7f5c680b6f70 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.551+0000 7f5c4f7fe640 1 -- 172.21.15.104:0/2818256963 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c5c003e00 con 0x7f5c680b6f70 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.551+0000 7f5c4f7fe640 1 -- 172.21.15.104:0/2818256963 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c035040 con 0x7f5c680b6f70 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.551+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c680cdeb0 con 0x7f5c680b6f70 2024-09-17T02:56:01.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.551+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c680ce470 con 0x7f5c680b6f70 2024-09-17T02:56:01.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.552+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6815ef90 con 0x7f5c680b6f70 2024-09-17T02:56:01.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.553+0000 7f5c4f7fe640 1 -- 172.21.15.104:0/2818256963 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c5c041030 con 0x7f5c680b6f70 2024-09-17T02:56:01.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.553+0000 7f5c4f7fe640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c54078b90 0x7f5c5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:01.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.553+0000 7f5c4f7fe640 1 -- 172.21.15.104:0/2818256963 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5c5c0bb430 con 0x7f5c680b6f70 2024-09-17T02:56:01.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.554+0000 7f5c66ffd640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c54078b90 0x7f5c5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:01.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.554+0000 7f5c66ffd640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c54078b90 0x7f5c5407b0a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c58005fd0 tx=0x7f5c5800b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:01.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.558+0000 7f5c4f7fe640 1 -- 172.21.15.104:0/2818256963 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c5c0832b0 con 0x7f5c680b6f70 2024-09-17T02:56:01.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.766+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5c680cd960 con 0x7f5c680b6f70 2024-09-17T02:56:01.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.767+0000 7f5c4f7fe640 1 -- 172.21.15.104:0/2818256963 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f5c5c087ce0 con 0x7f5c680b6f70 2024-09-17T02:56:01.766 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:56:01.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c54078b90 msgr2=0x7f5c5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:01.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c54078b90 0x7f5c5407b0a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c58005fd0 tx=0x7f5c5800b260 comp rx=0 tx=0).stop 2024-09-17T02:56:01.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b6f70 msgr2=0x7f5c680cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:01.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b6f70 0x7f5c680cce80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c034040 tx=0x7f5c5c003910 comp rx=0 tx=0).stop 2024-09-17T02:56:01.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 shutdown_connections 2024-09-17T02:56:01.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c54078b90 0x7f5c5407b0a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c680d1710 0x7f5c680cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c680b6f70 0x7f5c680cce80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 --2- 172.21.15.104:0/2818256963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c680b3b00 0x7f5c6815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:01.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 >> 172.21.15.104:0/2818256963 conn(0x7f5c68073df0 msgr2=0x7f5c680ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:01.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 shutdown_connections 2024-09-17T02:56:01.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:01.769+0000 7f5c6d5c3640 1 -- 172.21.15.104:0/2818256963 wait complete. 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:56:01.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:56:01.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:01.781 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T02:56:01.801 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:56:01.801 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:56:01.801 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:56:01.801 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:01.801 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:56:01.801 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:01.801 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:01.801 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-09-17T02:56:01.802 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:56:01.803 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T02:56:01.804 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T02:56:01.804 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:01.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:01.804 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:56:01.871 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T02:56:01.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:01.873 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T02:56:01.932 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T02:56:01.932 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:56:01.932 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:56:01.933 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:56:01.933 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:56:01.933 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:56:01.933 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:56:01.933 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:56:01.933 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:56:01.933 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:56:01.933 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:56:02.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:56:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:56:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:56:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:56:02.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:02.066 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:56:02.082 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T02:56:02.083 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T02:56:02.083 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:56:02.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:02.083 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T02:56:02.148 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:56:02.148 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:02.205 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:56:02.205 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:56:02.205 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:02.260 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:56:02.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:02.260 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:56:02.354 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:56:02.354 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:56:02.354 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:56:02.366 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:56:02.366 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:56:02.366 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:56:02.366 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:56:02.366 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:56:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:56:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:56:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:56:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:56:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:56:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:56:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:56:02.371 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:56:02.372 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T02:56:02.372 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:56:02.372 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:56:02.372 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:56:02.372 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:56:02.374 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:56:02.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:02.374 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:02.398 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:56:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:56:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:56:02.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:56:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:56:02.494 INFO:teuthology.orchestra.run.smithi192.stdout:client5239 2024-09-17T02:56:02.495 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:56:02.495 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:02.511 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:02.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.629+0000 7f34624b4640 1 -- 172.21.15.104:0/8548468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3444005350 msgr2=0x7f344400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:02.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.629+0000 7f34624b4640 1 --2- 172.21.15.104:0/8548468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3444005350 0x7f344400b9c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f345400c640 tx=0x7f3444005830 comp rx=0 tx=0).stop 2024-09-17T02:56:02.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.630+0000 7f34624b4640 1 -- 172.21.15.104:0/8548468 shutdown_connections 2024-09-17T02:56:02.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.630+0000 7f34624b4640 1 --2- 172.21.15.104:0/8548468 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3444005350 0x7f344400b9c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:02.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.630+0000 7f34624b4640 1 -- 172.21.15.104:0/8548468 >> 172.21.15.104:0/8548468 conn(0x7f345c069120 msgr2=0x7f345c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:02.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.630+0000 7f34624b4640 1 -- 172.21.15.104:0/8548468 shutdown_connections 2024-09-17T02:56:02.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.630+0000 7f34624b4640 1 -- 172.21.15.104:0/8548468 wait complete. 2024-09-17T02:56:02.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.631+0000 7f34624b4640 1 Processor -- start 2024-09-17T02:56:02.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.631+0000 7f34624b4640 1 -- start start 2024-09-17T02:56:02.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f34624b4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3444005350 0x7f345c157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:02.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f34624b4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c161b80 0x7f345c0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f34624b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f345c161f90 0x7f345c0b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f34624b4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0b69f0 con 0x7f345c161f90 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f34624b4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f345c15f8c0 con 0x7f345c161b80 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f34624b4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f345c0b6b70 con 0x7f3444005350 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f345c161f90 0x7f345c0b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f345c161f90 0x7f345c0b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45700/0 (socket says 172.21.15.104:45700) 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 -- 172.21.15.104:0/2875350524 learned_addr learned my addr 172.21.15.104:0/2875350524 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f345b7fe640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c161b80 0x7f345c0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f345bfff640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3444005350 0x7f345c157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 -- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3444005350 msgr2=0x7f345c157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3444005350 0x7f345c157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 -- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c161b80 msgr2=0x7f345c0b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:02.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c161b80 0x7f345c0b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:02.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 -- 172.21.15.104:0/2875350524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c1fa7c0 con 0x7f345c161f90 2024-09-17T02:56:02.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3460a51640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f345c161f90 0x7f345c0b5ea0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f345402b490 tx=0x7f3454003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:02.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.633+0000 7f3458ff9640 1 -- 172.21.15.104:0/2875350524 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345402bbb0 con 0x7f345c161f90 2024-09-17T02:56:02.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.634+0000 7f3458ff9640 1 -- 172.21.15.104:0/2875350524 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f345403a070 con 0x7f345c161f90 2024-09-17T02:56:02.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.634+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345c1f9a00 con 0x7f345c161f90 2024-09-17T02:56:02.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.634+0000 7f3458ff9640 1 -- 172.21.15.104:0/2875350524 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454006330 con 0x7f345c161f90 2024-09-17T02:56:02.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.634+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345c1f9fc0 con 0x7f345c161f90 2024-09-17T02:56:02.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.635+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345c162d80 con 0x7f345c161f90 2024-09-17T02:56:02.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.635+0000 7f3458ff9640 1 -- 172.21.15.104:0/2875350524 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34540064d0 con 0x7f345c161f90 2024-09-17T02:56:02.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.636+0000 7f3458ff9640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3448078bc0 0x7f344807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:02.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.636+0000 7f3458ff9640 1 -- 172.21.15.104:0/2875350524 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f34540bafe0 con 0x7f345c161f90 2024-09-17T02:56:02.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.636+0000 7f345bfff640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3448078bc0 0x7f344807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:02.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.636+0000 7f345bfff640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3448078bc0 0x7f344807b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f345c0d1e60 tx=0x7f344c006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:02.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.640+0000 7f3458ff9640 1 -- 172.21.15.104:0/2875350524 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f34540834e0 con 0x7f345c161f90 2024-09-17T02:56:02.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.856+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f345c1623b0 con 0x7f345c161f90 2024-09-17T02:56:02.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.856+0000 7f3458ff9640 1 -- 172.21.15.104:0/2875350524 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7f3454082de0 con 0x7f345c161f90 2024-09-17T02:56:02.856 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:02.856 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:56:02.856 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:56:02.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3448078bc0 msgr2=0x7f344807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3448078bc0 0x7f344807b0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f345c0d1e60 tx=0x7f344c006b70 comp rx=0 tx=0).stop 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f345c161f90 msgr2=0x7f345c0b5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f345c161f90 0x7f345c0b5ea0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f345402b490 tx=0x7f3454003ba0 comp rx=0 tx=0).stop 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 shutdown_connections 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3448078bc0 0x7f344807b0d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f345c161b80 0x7f345c0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f345c161f90 0x7f345c0b5ea0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 --2- 172.21.15.104:0/2875350524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3444005350 0x7f345c157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 >> 172.21.15.104:0/2875350524 conn(0x7f345c069120 msgr2=0x7f345c0b9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 shutdown_connections 2024-09-17T02:56:02.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:02.859+0000 7f34624b4640 1 -- 172.21.15.104:0/2875350524 wait complete. 2024-09-17T02:56:02.870 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T02:56:02.994 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":5304,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":7.334219321,"mdsmap_epoch":20,"osdmap_epoch":46,"osdmap_epoch_barrier":46,"uptime":12.663089724000001} 2024-09-17T02:56:02.995 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 5304, "mdsmap_epoch": 20, "osdmap_epoch": 46, "osdmap_epoch_barrier": 46, "rank_uptime": 7.334219321, "state": "up:active", "uptime": 12.663089724, "want_state": "up:active", "whoami": 0 } 2024-09-17T02:56:02.995 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-17T02:56:03.113 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_mon_report_interval":"5"} 2024-09-17T02:56:03.113 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-17T02:56:03.113 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-17T02:56:03.113 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:03.113 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:03.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:03.131 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-17T02:56:04.154 INFO:teuthology.orchestra.run.smithi104.stderr:265+0 records in 2024-09-17T02:56:04.155 INFO:teuthology.orchestra.run.smithi104.stderr:265+0 records out 2024-09-17T02:56:04.155 INFO:teuthology.orchestra.run.smithi104.stderr:277872640 bytes (278 MB, 265 MiB) copied, 0.964768 s, 288 MB/s 2024-09-17T02:56:04.155 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:04.155 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:04.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:04.170 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-17T02:56:04.891 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:56:04.894 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:56:05.236 INFO:teuthology.orchestra.run.smithi104.stderr:292+0 records in 2024-09-17T02:56:05.236 INFO:teuthology.orchestra.run.smithi104.stderr:292+0 records out 2024-09-17T02:56:05.236 INFO:teuthology.orchestra.run.smithi104.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.00823 s, 304 MB/s 2024-09-17T02:56:05.236 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-17T02:56:05.236 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:56:05.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 -- 172.21.15.104:0/1500497223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240d1710 msgr2=0x7fb0240cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:05.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 --2- 172.21.15.104:0/1500497223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240d1710 0x7fb0240cf920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb024069980 tx=0x7fb01c02a9a0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 -- 172.21.15.104:0/1500497223 shutdown_connections 2024-09-17T02:56:05.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 --2- 172.21.15.104:0/1500497223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240d1710 0x7fb0240cf920 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 --2- 172.21.15.104:0/1500497223 >> v2:172.21.15.192:3300/0 conn(0x7fb0240b3b00 0x7fb0240d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 --2- 172.21.15.104:0/1500497223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0240b6f70 0x7fb02415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 -- 172.21.15.104:0/1500497223 >> 172.21.15.104:0/1500497223 conn(0x7fb024073df0 msgr2=0x7fb024068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:05.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 -- 172.21.15.104:0/1500497223 shutdown_connections 2024-09-17T02:56:05.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.349+0000 7fb02abda640 1 -- 172.21.15.104:0/1500497223 wait complete. 2024-09-17T02:56:05.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.351+0000 7fb02abda640 1 Processor -- start 2024-09-17T02:56:05.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.351+0000 7fb02abda640 1 -- start start 2024-09-17T02:56:05.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.352+0000 7fb02abda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240b3b00 0x7fb0241614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:05.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.352+0000 7fb02abda640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0240b6f70 0x7fb02415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:05.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.352+0000 7fb02abda640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0240d1710 0x7fb024160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:05.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.352+0000 7fb02abda640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240d01f0 con 0x7fb0240b3b00 2024-09-17T02:56:05.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.352+0000 7fb02abda640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240d0070 con 0x7fb0240d1710 2024-09-17T02:56:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.352+0000 7fb02abda640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb0240d0370 con 0x7fb0240b6f70 2024-09-17T02:56:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240b3b00 0x7fb0241614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240b3b00 0x7fb0241614c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52840/0 (socket says 172.21.15.104:52840) 2024-09-17T02:56:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 -- 172.21.15.104:0/127116239 learned_addr learned my addr 172.21.15.104:0/127116239 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb029177640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0240d1710 0x7fb024160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb023fff640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0240b6f70 0x7fb02415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 -- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0240b6f70 msgr2=0x7fb02415fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:05.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0240b6f70 0x7fb02415fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 -- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0240d1710 msgr2=0x7fb024160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0240d1710 0x7fb024160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 -- 172.21.15.104:0/127116239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb024161a00 con 0x7fb0240b3b00 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb028976640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240b3b00 0x7fb0241614c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c9a0 tx=0x7fb01800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb0217fa640 1 -- 172.21.15.104:0/127116239 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018007bb0 con 0x7fb0240b3b00 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb0217fa640 1 -- 172.21.15.104:0/127116239 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb018007e40 con 0x7fb0240b3b00 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0240cbb20 con 0x7fb0240b3b00 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb0217fa640 1 -- 172.21.15.104:0/127116239 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01800f690 con 0x7fb0240b3b00 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.353+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0240cc0e0 con 0x7fb0240b3b00 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.354+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb02415ef90 con 0x7fb0240b3b00 2024-09-17T02:56:05.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.355+0000 7fb0217fa640 1 -- 172.21.15.104:0/127116239 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb01800f830 con 0x7fb0240b3b00 2024-09-17T02:56:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.355+0000 7fb0217fa640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb008078b90 0x7fb00807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.356+0000 7fb0217fa640 1 -- 172.21.15.104:0/127116239 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb01809b470 con 0x7fb0240b3b00 2024-09-17T02:56:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.356+0000 7fb023fff640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb008078b90 0x7fb00807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:05.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.356+0000 7fb023fff640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb008078b90 0x7fb00807b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb01000a4d0 tx=0x7fb01000a460 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:05.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.360+0000 7fb0217fa640 1 -- 172.21.15.104:0/127116239 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb018014030 con 0x7fb0240b3b00 2024-09-17T02:56:05.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.534+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fb024068fa0 con 0x7fb0240b3b00 2024-09-17T02:56:05.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.535+0000 7fb0217fa640 1 -- 172.21.15.104:0/127116239 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v46) ==== 81+0+34252 (secure 0 0 0) 0x7fb01806ce20 con 0x7fb0240b3b00 2024-09-17T02:56:05.536 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:05.536 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:05.537 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 46, 2024-09-17T02:56:05.537 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:05.537 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:56:05.537 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:55:56.643966+0000", 2024-09-17T02:56:05.537 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:56:05.538 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:56:05.538 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:56:05.538 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:56:05.538 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:56:05.538 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:56:05.539 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:56:05.539 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:56:05.539 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:56:05.539 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:05.539 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:56:05.540 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:56:05.540 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:56:05.540 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:56:05.540 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:56:05.540 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 7, 2024-09-17T02:56:05.541 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:56:05.541 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:56:05.541 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:56:05.541 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:56:05.541 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:56:05.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:56:05.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:56:05.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:56:05.542 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:56:05.542 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:05.543 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:05.543 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:05.543 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:05.543 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:05.543 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:05.544 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:05.544 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:05.544 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:05.544 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:05.544 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:05.545 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:05.545 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:05.545 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:56:05.545 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:56:05.545 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:56:05.545 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:56:05.546 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:56:05.546 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:05.546 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:05.546 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:05.546 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:05.547 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:05.547 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:05.547 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:05.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.547 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "17", 2024-09-17T02:56:05.547 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:05.548 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:05.548 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:05.548 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:05.548 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:05.548 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:05.549 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:05.549 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:05.549 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:05.549 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:05.549 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:05.550 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:05.550 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:05.550 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:05.550 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:05.550 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:05.551 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:05.551 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:05.551 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:05.551 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:05.551 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:05.551 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:05.552 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:05.552 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:05.552 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:05.552 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:05.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.553 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:05.553 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:05.553 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:05.553 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:05.553 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:05.554 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:05.554 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:05.554 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:05.554 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:05.554 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:05.554 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:05.554 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:05.555 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:56:05.555 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:56:05.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.555 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:05.555 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:56:05.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:05.556 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 6, 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:52.652619+0000", 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:05.557 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:56:05.558 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "45", 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:05.559 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:05.560 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.561 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:56:05.562 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:05.563 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 7, 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:56:05.564 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:53.964016+0000", 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:05.565 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:05.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "46", 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:05.567 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:05.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:05.569 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:56:05.570 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:05.571 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:05.572 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.573 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.574 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.574 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:56:05.574 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:05.574 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.574 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.575 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:05.575 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.575 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.575 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:56:05.575 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:05.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.576 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.576 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:56:05.576 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:05.576 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.577 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.578 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.580 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:05.581 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.582 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.583 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:05.584 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.586 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:05.587 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:05.589 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:05.590 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.591 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:05.592 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.593 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:05.594 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:05.595 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.596 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:05.597 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:05.598 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:05.600 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:05.601 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.602 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.603 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:05.604 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:05.606 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.608 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.609 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:56:05.610 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:05.612 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.613 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:05.614 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.615 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.616 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:05.617 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:05.619 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.620 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.621 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.622 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:05.623 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:05.624 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:05.625 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:05.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:05.627 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:05.628 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.629 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:56:05.630 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:56:05.631 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:56:05.632 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:05.632 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb008078b90 msgr2=0x7fb00807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb008078b90 0x7fb00807b0a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb01000a4d0 tx=0x7fb01000a460 comp rx=0 tx=0).stop 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240b3b00 msgr2=0x7fb0241614c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240b3b00 0x7fb0241614c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c9a0 tx=0x7fb01800ce60 comp rx=0 tx=0).stop 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 shutdown_connections 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb008078b90 0x7fb00807b0a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0240d1710 0x7fb024160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0240b6f70 0x7fb02415fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 --2- 172.21.15.104:0/127116239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0240b3b00 0x7fb0241614c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 >> 172.21.15.104:0/127116239 conn(0x7fb024073df0 msgr2=0x7fb0240ba1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 shutdown_connections 2024-09-17T02:56:05.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:05.538+0000 7fb02abda640 1 -- 172.21.15.104:0/127116239 wait complete. 2024-09-17T02:56:05.635 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T02:56:07.693 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:56:07.693+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-17T02:56:10.636 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:56:10.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 -- 172.21.15.104:0/1701015677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 msgr2=0x7f8594161160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:10.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 --2- 172.21.15.104:0/1701015677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 0x7f8594161160 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f85941541c0 tx=0x7f857c02a560 comp rx=0 tx=0).stop 2024-09-17T02:56:10.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 -- 172.21.15.104:0/1701015677 shutdown_connections 2024-09-17T02:56:10.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 --2- 172.21.15.104:0/1701015677 >> v2:172.21.15.192:3300/0 conn(0x7f85940d1d30 0x7f85940d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:10.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 --2- 172.21.15.104:0/1701015677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 0x7f8594161160 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:10.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 --2- 172.21.15.104:0/1701015677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859406f5c0 0x7f859415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:10.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 -- 172.21.15.104:0/1701015677 >> 172.21.15.104:0/1701015677 conn(0x7f859406d200 msgr2=0x7f859406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:10.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 -- 172.21.15.104:0/1701015677 shutdown_connections 2024-09-17T02:56:10.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.767+0000 7f8598c9b640 1 -- 172.21.15.104:0/1701015677 wait complete. 2024-09-17T02:56:10.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.769+0000 7f8598c9b640 1 Processor -- start 2024-09-17T02:56:10.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.769+0000 7f8598c9b640 1 -- start start 2024-09-17T02:56:10.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.770+0000 7f8598c9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f859406f5c0 0x7f85941419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:10.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.770+0000 7f8598c9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 0x7f8594158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:10.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.770+0000 7f8598c9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940d1d30 0x7f8594158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:10.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.770+0000 7f8598c9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8594146010 con 0x7f85940711d0 2024-09-17T02:56:10.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.770+0000 7f8598c9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8594145e90 con 0x7f859406f5c0 2024-09-17T02:56:10.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.770+0000 7f8598c9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8594146190 con 0x7f85940d1d30 2024-09-17T02:56:10.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.770+0000 7f8591d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 0x7f8594158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8591d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 0x7f8594158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52856/0 (socket says 172.21.15.104:52856) 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8591d9b640 1 -- 172.21.15.104:0/2886878896 learned_addr learned my addr 172.21.15.104:0/2886878896 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8592d9d640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940d1d30 0x7f8594158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f859259c640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f859406f5c0 0x7f85941419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8591d9b640 1 -- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940d1d30 msgr2=0x7f8594158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8591d9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940d1d30 0x7f8594158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8591d9b640 1 -- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f859406f5c0 msgr2=0x7f85941419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8591d9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f859406f5c0 0x7f85941419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8591d9b640 1 -- 172.21.15.104:0/2886878896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8594159900 con 0x7f85940711d0 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8591d9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 0x7f8594158940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f857c0099c0 tx=0x7f857c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f858affd640 1 -- 172.21.15.104:0/2886878896 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c03e030 con 0x7f85940711d0 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f858affd640 1 -- 172.21.15.104:0/2886878896 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857c003ca0 con 0x7f85940711d0 2024-09-17T02:56:10.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8594159be0 con 0x7f85940711d0 2024-09-17T02:56:10.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f858affd640 1 -- 172.21.15.104:0/2886878896 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c035040 con 0x7f85940711d0 2024-09-17T02:56:10.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.771+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85941434a0 con 0x7f85940711d0 2024-09-17T02:56:10.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.772+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8594146720 con 0x7f85940711d0 2024-09-17T02:56:10.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.773+0000 7f858affd640 1 -- 172.21.15.104:0/2886878896 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f857c041030 con 0x7f85940711d0 2024-09-17T02:56:10.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.774+0000 7f858affd640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8574078b90 0x7f857407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:10.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.774+0000 7f858affd640 1 -- 172.21.15.104:0/2886878896 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7f857c0bb340 con 0x7f85940711d0 2024-09-17T02:56:10.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.774+0000 7f858affd640 1 -- 172.21.15.104:0/2886878896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7f8574080710 con 0x7f85940711d0 2024-09-17T02:56:10.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.774+0000 7f859259c640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8574078b90 0x7f857407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:10.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.774+0000 7f859259c640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8574078b90 0x7f857407b0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8584009ab0 tx=0x7f8584005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:10.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.778+0000 7f858affd640 1 -- 172.21.15.104:0/2886878896 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f857c083140 con 0x7f85940711d0 2024-09-17T02:56:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.955+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f85940707c0 con 0x7f85940711d0 2024-09-17T02:56:10.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.956+0000 7f858affd640 1 -- 172.21.15.104:0/2886878896 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) ==== 81+0+34395 (secure 0 0 0) 0x7f857c087b70 con 0x7f85940711d0 2024-09-17T02:56:10.956 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:10.956 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:10.956 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 50, 2024-09-17T02:56:10.956 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:10.956 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:56:10.956 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:56:10.758837+0000", 2024-09-17T02:56:10.956 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:56:10.956 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:56:10.957 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 7, 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:10.958 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:56:10.959 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:10.960 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:10.961 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:10.961 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:10.961 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:10.961 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:10.961 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:10.961 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:10.961 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:10.961 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:10.962 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:10.963 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:10.964 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 6, 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:52.652619+0000", 2024-09-17T02:56:10.965 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:56:10.966 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:10.967 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:10.968 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:10.969 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:10.970 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:10.971 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 7, 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:53.964016+0000", 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:10.972 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:10.973 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:10.974 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:10.975 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:10.976 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:10.977 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:10.978 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:10.979 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:10.980 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.981 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.982 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:10.983 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.984 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:10.985 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:10.986 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.987 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.988 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:10.989 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:56:10.990 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:10.991 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.992 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.993 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.994 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.995 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:56:10.996 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:10.997 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.998 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:10.999 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.000 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.001 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.002 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull", 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.003 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.004 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.005 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.006 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.007 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.008 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.009 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.010 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.011 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.012 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.013 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:11.014 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.015 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.016 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.017 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.017 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.017 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.017 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.017 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.019 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:56:11.020 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.021 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.022 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.023 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.024 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.025 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:56:11.026 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:11.027 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:56:11.028 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:11.029 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.030 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.031 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.032 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.033 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:56:11.034 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.035 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:56:11.036 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.037 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8574078b90 msgr2=0x7f857407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8574078b90 0x7f857407b0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8584009ab0 tx=0x7f8584005f90 comp rx=0 tx=0).stop 2024-09-17T02:56:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 msgr2=0x7f8594158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 0x7f8594158940 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f857c0099c0 tx=0x7f857c0038a0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 shutdown_connections 2024-09-17T02:56:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8574078b90 0x7f857407b0a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940d1d30 0x7f8594158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f85940711d0 0x7f8594158940 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 --2- 172.21.15.104:0/2886878896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f859406f5c0 0x7f85941419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 >> 172.21.15.104:0/2886878896 conn(0x7f859406d200 msgr2=0x7f859415cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:11.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 shutdown_connections 2024-09-17T02:56:11.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:10.958+0000 7f8598c9b640 1 -- 172.21.15.104:0/2886878896 wait complete. 2024-09-17T02:56:11.040 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T02:56:11.041 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:11.041 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:11.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:11.058 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-17T02:56:11.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:56:11.259 INFO:teuthology.orchestra.run.smithi104.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-17T02:56:11.260 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records in 2024-09-17T02:56:11.260 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records out 2024-09-17T02:56:11.260 INFO:teuthology.orchestra.run.smithi104.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.140237 s, 374 MB/s 2024-09-17T02:56:11.260 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:56:11.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.373+0000 7fb44a08b640 1 -- 172.21.15.104:0/438822385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 msgr2=0x7fb43000ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.373+0000 7fb44a08b640 1 --2- 172.21.15.104:0/438822385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 0x7fb43000ba50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb4440b8520 tx=0x7fb430005830 comp rx=0 tx=0).stop 2024-09-17T02:56:11.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.373+0000 7fb44a08b640 1 -- 172.21.15.104:0/438822385 shutdown_connections 2024-09-17T02:56:11.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.373+0000 7fb44a08b640 1 --2- 172.21.15.104:0/438822385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 0x7fb43000ba50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.373+0000 7fb44a08b640 1 -- 172.21.15.104:0/438822385 >> 172.21.15.104:0/438822385 conn(0x7fb4440d28a0 msgr2=0x7fb4440d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:11.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.374+0000 7fb44a08b640 1 -- 172.21.15.104:0/438822385 shutdown_connections 2024-09-17T02:56:11.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.374+0000 7fb44a08b640 1 -- 172.21.15.104:0/438822385 wait complete. 2024-09-17T02:56:11.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.375+0000 7fb44a08b640 1 Processor -- start 2024-09-17T02:56:11.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.375+0000 7fb44a08b640 1 -- start start 2024-09-17T02:56:11.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb44a08b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 0x7fb4441f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:11.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb44a08b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44409ff00 0x7fb4441e6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:11.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb44a08b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4441f4140 0x7fb444071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:11.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb44a08b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb4440ce220 con 0x7fb4300053a0 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb44a08b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb4440ce0a0 con 0x7fb44409ff00 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb44a08b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb4440ce3a0 con 0x7fb4441f4140 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 0x7fb4441f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 0x7fb4441f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52868/0 (socket says 172.21.15.104:52868) 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 -- 172.21.15.104:0/2659233492 learned_addr learned my addr 172.21.15.104:0/2659233492 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb43bfff640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44409ff00 0x7fb4441e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb443fff640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4441f4140 0x7fb444071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 -- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4441f4140 msgr2=0x7fb444071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4441f4140 0x7fb444071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 -- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44409ff00 msgr2=0x7fb4441e6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44409ff00 0x7fb4441e6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 -- 172.21.15.104:0/2659233492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4441f7d70 con 0x7fb4300053a0 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb4437fe640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 0x7fb4441f7830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb434004e40 tx=0x7fb434001620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:11.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb440ff9640 1 -- 172.21.15.104:0/2659233492 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434015020 con 0x7fb4300053a0 2024-09-17T02:56:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb440ff9640 1 -- 172.21.15.104:0/2659233492 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb434011960 con 0x7fb4300053a0 2024-09-17T02:56:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4441e97f0 con 0x7fb4300053a0 2024-09-17T02:56:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb440ff9640 1 -- 172.21.15.104:0/2659233492 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434011d90 con 0x7fb4300053a0 2024-09-17T02:56:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.377+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44409cec0 con 0x7fb4300053a0 2024-09-17T02:56:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.379+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4440761f0 con 0x7fb4300053a0 2024-09-17T02:56:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.379+0000 7fb440ff9640 1 -- 172.21.15.104:0/2659233492 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb434018020 con 0x7fb4300053a0 2024-09-17T02:56:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.380+0000 7fb440ff9640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb424078b90 0x7fb42407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.380+0000 7fb440ff9640 1 -- 172.21.15.104:0/2659233492 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7fb43409b5a0 con 0x7fb4300053a0 2024-09-17T02:56:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.380+0000 7fb440ff9640 1 -- 172.21.15.104:0/2659233492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7fb424080770 con 0x7fb4300053a0 2024-09-17T02:56:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.380+0000 7fb43bfff640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb424078b90 0x7fb42407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.381+0000 7fb43bfff640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb424078b90 0x7fb42407b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009ad0 tx=0x7fb42c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.384+0000 7fb440ff9640 1 -- 172.21.15.104:0/2659233492 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb4440761f0 con 0x7fb4300053a0 2024-09-17T02:56:11.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.561+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fb4440d0ab0 con 0x7fb4300053a0 2024-09-17T02:56:11.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.562+0000 7fb440ff9640 1 -- 172.21.15.104:0/2659233492 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) ==== 81+0+34395 (secure 0 0 0) 0x7fb43401f020 con 0x7fb4300053a0 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 50, 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:56:10.758837+0000", 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:56:11.562 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 7, 2024-09-17T02:56:11.563 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:11.564 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:56:11.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:11.566 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:11.567 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:11.568 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.569 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 6, 2024-09-17T02:56:11.570 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:52.652619+0000", 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:11.571 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:11.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:11.573 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:11.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:56:11.575 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:11.576 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 7, 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:53.964016+0000", 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:11.577 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:56:11.578 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.579 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:11.580 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:11.581 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:11.582 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:11.583 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:56:11.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.585 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.586 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.587 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.588 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.589 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.590 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:56:11.591 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:56:11.592 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:56:11.593 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:56:11.594 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.595 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.596 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:56:11.597 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:56:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:56:11.599 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.600 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.601 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.602 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.603 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.604 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.605 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:11.606 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull", 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.607 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.608 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:56:11.609 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:56:11.610 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:56:11.611 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.612 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.614 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.615 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.617 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:11.618 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:11.619 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.621 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.622 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.623 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.624 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:11.625 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:56:11.626 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:56:11.627 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:56:11.628 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:56:11.629 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:11.630 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.631 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:56:11.632 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:11.633 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.634 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.635 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:11.636 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:56:11.637 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:11.638 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:11.639 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:11.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb424078b90 msgr2=0x7fb42407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb424078b90 0x7fb42407b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb42c009ad0 tx=0x7fb42c005f90 comp rx=0 tx=0).stop 2024-09-17T02:56:11.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 msgr2=0x7fb4441f7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 0x7fb4441f7830 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb434004e40 tx=0x7fb434001620 comp rx=0 tx=0).stop 2024-09-17T02:56:11.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 shutdown_connections 2024-09-17T02:56:11.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb424078b90 0x7fb42407b0a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44409ff00 0x7fb4441e6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4441f4140 0x7fb444071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 --2- 172.21.15.104:0/2659233492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4300053a0 0x7fb4441f7830 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 >> 172.21.15.104:0/2659233492 conn(0x7fb4440d28a0 msgr2=0x7fb4440b63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:11.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 shutdown_connections 2024-09-17T02:56:11.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.564+0000 7fb44a08b640 1 -- 172.21.15.104:0/2659233492 wait complete. 2024-09-17T02:56:11.643 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:11.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.757+0000 7f46d987e640 1 -- 172.21.15.104:0/246414392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 msgr2=0x7f46d40cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.757+0000 7f46d987e640 1 --2- 172.21.15.104:0/246414392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 0x7f46d40cef20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f46c40098e0 tx=0x7f46c402a530 comp rx=0 tx=0).stop 2024-09-17T02:56:11.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.757+0000 7f46d987e640 1 -- 172.21.15.104:0/246414392 shutdown_connections 2024-09-17T02:56:11.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.757+0000 7f46d987e640 1 --2- 172.21.15.104:0/246414392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d40cf460 0x7f46d40cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.757+0000 7f46d987e640 1 --2- 172.21.15.104:0/246414392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 0x7f46d40cef20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.757+0000 7f46d987e640 1 -- 172.21.15.104:0/246414392 >> 172.21.15.104:0/246414392 conn(0x7f46d40d28e0 msgr2=0x7f46d40d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:11.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.757+0000 7f46d987e640 1 -- 172.21.15.104:0/246414392 shutdown_connections 2024-09-17T02:56:11.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.757+0000 7f46d987e640 1 -- 172.21.15.104:0/246414392 wait complete. 2024-09-17T02:56:11.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.759+0000 7f46d987e640 1 Processor -- start 2024-09-17T02:56:11.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.759+0000 7f46d987e640 1 -- start start 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d987e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d40cd3f0 0x7f46d40a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d987e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d40cf460 0x7f46d415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d987e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 0x7f46d40b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d987e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f46d4160680 con 0x7f46d40d3400 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d987e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40b6ed0 con 0x7f46d40cf460 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d987e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f46d40cdf10 con 0x7f46d40cd3f0 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 0x7f46d40b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 0x7f46d40b7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52894/0 (socket says 172.21.15.104:52894) 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 -- 172.21.15.104:0/1035470891 learned_addr learned my addr 172.21.15.104:0/1035470891 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:11.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d2ffd640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d40cd3f0 0x7f46d40a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:11.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46cbfff640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d40cf460 0x7f46d415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:11.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 -- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d40cd3f0 msgr2=0x7f46d40a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d40cd3f0 0x7f46d40a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 -- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d40cf460 msgr2=0x7f46d415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d40cf460 0x7f46d415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 -- 172.21.15.104:0/1035470891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d41f7eb0 con 0x7f46d40d3400 2024-09-17T02:56:11.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46cbfff640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d40cf460 0x7f46d415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:11.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.761+0000 7f46d37fe640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 0x7f46d40b7560 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00c730 tx=0x7f46cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:11.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.763+0000 7f46d0ff9640 1 -- 172.21.15.104:0/1035470891 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc003b70 con 0x7f46d40d3400 2024-09-17T02:56:11.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.763+0000 7f46d0ff9640 1 -- 172.21.15.104:0/1035470891 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46cc003d10 con 0x7f46d40d3400 2024-09-17T02:56:11.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.763+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d40a0570 con 0x7f46d40d3400 2024-09-17T02:56:11.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.763+0000 7f46d0ff9640 1 -- 172.21.15.104:0/1035470891 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46cc005330 con 0x7f46d40d3400 2024-09-17T02:56:11.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.763+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d415c150 con 0x7f46d40d3400 2024-09-17T02:56:11.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.764+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d40cf870 con 0x7f46d40d3400 2024-09-17T02:56:11.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.765+0000 7f46d0ff9640 1 -- 172.21.15.104:0/1035470891 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46cc0054d0 con 0x7f46d40d3400 2024-09-17T02:56:11.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.766+0000 7f46d0ff9640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b4078bc0 0x7f46b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:11.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.766+0000 7f46d0ff9640 1 -- 172.21.15.104:0/1035470891 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7f46cc09aa70 con 0x7f46d40d3400 2024-09-17T02:56:11.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.766+0000 7f46d0ff9640 1 -- 172.21.15.104:0/1035470891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7f46b40807a0 con 0x7f46d40d3400 2024-09-17T02:56:11.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.766+0000 7f46d2ffd640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b4078bc0 0x7f46b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:11.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.767+0000 7f46d2ffd640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b4078bc0 0x7f46b407b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f46c4034000 tx=0x7f46c4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:11.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.771+0000 7f46d0ff9640 1 -- 172.21.15.104:0/1035470891 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46cc062eb0 con 0x7f46d40d3400 2024-09-17T02:56:11.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.981+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46d4072100 con 0x7f46d40d3400 2024-09-17T02:56:11.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.982+0000 7f46d0ff9640 1 -- 172.21.15.104:0/1035470891 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7f46cc0627b0 con 0x7f46d40d3400 2024-09-17T02:56:11.982 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:11.982 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:56:11.982 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:56:11.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b4078bc0 msgr2=0x7f46b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b4078bc0 0x7f46b407b0d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f46c4034000 tx=0x7f46c4004730 comp rx=0 tx=0).stop 2024-09-17T02:56:11.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 msgr2=0x7f46d40b7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:11.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 0x7f46d40b7560 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00c730 tx=0x7f46cc00cbf0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 shutdown_connections 2024-09-17T02:56:11.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b4078bc0 0x7f46b407b0d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d40cf460 0x7f46d415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d40d3400 0x7f46d40b7560 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 --2- 172.21.15.104:0/1035470891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d40cd3f0 0x7f46d40a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:11.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 >> 172.21.15.104:0/1035470891 conn(0x7f46d40d28e0 msgr2=0x7f46d40d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:11.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 shutdown_connections 2024-09-17T02:56:11.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:11.984+0000 7f46d987e640 1 -- 172.21.15.104:0/1035470891 wait complete. 2024-09-17T02:56:11.995 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T02:56:12.119 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":5304,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.459897715,"mdsmap_epoch":20,"osdmap_epoch":50,"osdmap_epoch_barrier":50,"uptime":21.788768842} 2024-09-17T02:56:12.119 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 5304, "mdsmap_epoch": 20, "osdmap_epoch": 50, "osdmap_epoch_barrier": 50, "rank_uptime": 16.459897715, "state": "up:active", "uptime": 21.788768842, "want_state": "up:active", "whoami": 0 } 2024-09-17T02:56:12.119 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T02:56:12.119 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:12.119 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:12.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:12.135 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-17T02:56:12.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:56:12.191 INFO:teuthology.orchestra.run.smithi104.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-17T02:56:12.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:12.191 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-17T02:56:12.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:12.250 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-17T02:56:12.325 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:56:12.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.478+0000 7f26c8d5e640 1 -- 172.21.15.104:0/4258634352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 msgr2=0x7f26b0004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:12.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.478+0000 7f26c8d5e640 1 --2- 172.21.15.104:0/4258634352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 0x7f26b0004060 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f26b4001880 tx=0x7f26b0005830 comp rx=0 tx=0).stop 2024-09-17T02:56:12.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.478+0000 7f26c2d9d640 1 -- 172.21.15.104:0/4258634352 reap_dead start 2024-09-17T02:56:12.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.479+0000 7f26c8d5e640 1 -- 172.21.15.104:0/4258634352 shutdown_connections 2024-09-17T02:56:12.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.479+0000 7f26c8d5e640 1 -- 172.21.15.104:0/4258634352 >> 172.21.15.104:0/4258634352 conn(0x7f26c40d28a0 msgr2=0x7f26c40d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:12.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.479+0000 7f26c8d5e640 1 -- 172.21.15.104:0/4258634352 shutdown_connections 2024-09-17T02:56:12.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.479+0000 7f26c8d5e640 1 -- 172.21.15.104:0/4258634352 wait complete. 2024-09-17T02:56:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.481+0000 7f26c8d5e640 1 Processor -- start 2024-09-17T02:56:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.481+0000 7f26c8d5e640 1 -- start start 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c8d5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 0x7f26c409c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c8d5e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26c41e20e0 0x7f26c41ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c8d5e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c4071710 0x7f26c4071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c8d5e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f26c40d0880 con 0x7f26b0003c10 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c8d5e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f26c40cfce0 con 0x7f26c4071710 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c8d5e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f26c40d0a00 con 0x7f26c41e20e0 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 0x7f26c409c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 0x7f26c409c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52918/0 (socket says 172.21.15.104:52918) 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c259c640 1 -- 172.21.15.104:0/728700543 learned_addr learned my addr 172.21.15.104:0/728700543 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c2d9d640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c4071710 0x7f26c4071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:12.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26b9d9b640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26c41e20e0 0x7f26c41ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c259c640 1 -- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26c41e20e0 msgr2=0x7f26c41ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c259c640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26c41e20e0 0x7f26c41ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c259c640 1 -- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c4071710 msgr2=0x7f26c4071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c259c640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c4071710 0x7f26c4071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.482+0000 7f26c259c640 1 -- 172.21.15.104:0/728700543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c4072060 con 0x7f26b0003c10 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.483+0000 7f26c259c640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 0x7f26c409c720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f26b4001230 tx=0x7f26b4006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.483+0000 7f26bb7fe640 1 -- 172.21.15.104:0/728700543 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4043070 con 0x7f26b0003c10 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.483+0000 7f26bb7fe640 1 -- 172.21.15.104:0/728700543 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26b4003950 con 0x7f26b0003c10 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.483+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c41f7890 con 0x7f26b0003c10 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.483+0000 7f26bb7fe640 1 -- 172.21.15.104:0/728700543 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4003da0 con 0x7f26b0003c10 2024-09-17T02:56:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.483+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c41e8880 con 0x7f26b0003c10 2024-09-17T02:56:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.484+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c41e8390 con 0x7f26b0003c10 2024-09-17T02:56:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.485+0000 7f26bb7fe640 1 -- 172.21.15.104:0/728700543 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26b4033480 con 0x7f26b0003c10 2024-09-17T02:56:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.485+0000 7f26bb7fe640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f26a4078b90 0x7f26a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.485+0000 7f26bb7fe640 1 -- 172.21.15.104:0/728700543 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7f26b40bacb0 con 0x7f26b0003c10 2024-09-17T02:56:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.485+0000 7f26b9d9b640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f26a4078b90 0x7f26a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:12.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.485+0000 7f26bb7fe640 1 -- 172.21.15.104:0/728700543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7f26a4080770 con 0x7f26b0003c10 2024-09-17T02:56:12.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.486+0000 7f26b9d9b640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f26a4078b90 0x7f26a407b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f26c40d2e00 tx=0x7f26ac005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:12.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.490+0000 7f26bb7fe640 1 -- 172.21.15.104:0/728700543 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f26c4072060 con 0x7f26b0003c10 2024-09-17T02:56:12.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.662+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f26c40cf3c0 con 0x7f26b0003c10 2024-09-17T02:56:12.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.664+0000 7f26bb7fe640 1 -- 172.21.15.104:0/728700543 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) ==== 81+0+34395 (secure 0 0 0) 0x7f26b4082a20 con 0x7f26b0003c10 2024-09-17T02:56:12.664 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:12.664 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:12.664 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 50, 2024-09-17T02:56:12.664 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:12.664 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:56:12.664 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:56:10.758837+0000", 2024-09-17T02:56:12.664 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:56:12.665 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 7, 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:56:12.666 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:56:12.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.667 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:56:12.667 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:56:12.667 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:56:12.667 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:12.667 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:12.668 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:12.669 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:56:12.669 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:56:12.669 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:56:12.669 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:56:12.669 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:56:12.669 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:12.670 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:12.671 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:12.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:12.673 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:56:12.674 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 6, 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:52.652619+0000", 2024-09-17T02:56:12.675 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:12.676 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:12.676 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:12.676 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:12.676 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:12.676 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:12.677 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:12.677 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:12.677 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:12.677 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:12.677 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:12.677 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:12.677 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:12.678 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:56:12.678 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:56:12.678 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:56:12.678 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:56:12.678 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:56:12.678 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:12.678 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:12.678 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:12.679 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:12.679 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:12.679 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:12.679 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:12.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.680 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:12.680 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:12.680 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:12.680 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:12.681 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:12.681 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:12.682 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:12.683 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:56:12.684 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:12.685 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 7, 2024-09-17T02:56:12.686 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:53.964016+0000", 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:12.687 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:12.688 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:12.689 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:12.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:12.691 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:12.691 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:12.692 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:12.693 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:12.693 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:12.693 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:56:12.693 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:56:12.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.693 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:12.693 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:12.696 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:56:12.696 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.696 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:12.696 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:12.696 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:12.696 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:12.697 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:12.698 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.699 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.701 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:12.701 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.701 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:56:12.703 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:12.704 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:12.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.706 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.707 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:56:12.708 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:12.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.709 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.709 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:12.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:56:12.710 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.711 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:12.712 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:56:12.714 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:56:12.715 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:56:12.717 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:12.718 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:12.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:56:12.721 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.722 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:56:12.723 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull", 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:12.724 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:56:12.725 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.726 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.727 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:12.728 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:56:12.729 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:12.730 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:12.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.732 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.733 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:56:12.735 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:12.736 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:56:12.737 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.738 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.739 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.740 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:56:12.741 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:12.742 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:12.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:56:12.745 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:56:12.746 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:12.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.747 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:12.747 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:56:12.747 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:12.747 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.747 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:56:12.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:12.749 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:12.750 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:12.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:12.752 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:12.753 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:12.754 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:56:12.755 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:56:12.756 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:56:12.757 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:56:12.757 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:12.757 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:12.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f26a4078b90 msgr2=0x7f26a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f26a4078b90 0x7f26a407b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f26c40d2e00 tx=0x7f26ac005f90 comp rx=0 tx=0).stop 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 msgr2=0x7f26c409c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 0x7f26c409c720 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f26b4001230 tx=0x7f26b4006990 comp rx=0 tx=0).stop 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 shutdown_connections 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f26a4078b90 0x7f26a407b0a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c4071710 0x7f26c4071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26c41e20e0 0x7f26c41ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 --2- 172.21.15.104:0/728700543 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26b0003c10 0x7f26c409c720 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 >> 172.21.15.104:0/728700543 conn(0x7f26c40d28a0 msgr2=0x7f26c41e9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 shutdown_connections 2024-09-17T02:56:12.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:12.666+0000 7f26c8d5e640 1 -- 172.21.15.104:0/728700543 wait complete. 2024-09-17T02:56:12.760 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T02:56:13.091 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:56:13.092+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-17T02:56:17.761 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:56:17.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.883+0000 7f9728fc6640 1 -- 172.21.15.104:0/2539948115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f972415c220 msgr2=0x7f972406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:17.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.883+0000 7f9728fc6640 1 --2- 172.21.15.104:0/2539948115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f972415c220 0x7f972406f550 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9714005fd0 tx=0x7f971402aa90 comp rx=0 tx=0).stop 2024-09-17T02:56:17.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.883+0000 7f9728fc6640 1 -- 172.21.15.104:0/2539948115 shutdown_connections 2024-09-17T02:56:17.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.883+0000 7f9728fc6640 1 --2- 172.21.15.104:0/2539948115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97240734f0 0x7f9724073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:17.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.883+0000 7f9728fc6640 1 --2- 172.21.15.104:0/2539948115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f972415c220 0x7f972406f550 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:17.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.883+0000 7f9728fc6640 1 -- 172.21.15.104:0/2539948115 >> 172.21.15.104:0/2539948115 conn(0x7f972406d200 msgr2=0x7f972406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:17.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.883+0000 7f9728fc6640 1 -- 172.21.15.104:0/2539948115 shutdown_connections 2024-09-17T02:56:17.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.883+0000 7f9728fc6640 1 -- 172.21.15.104:0/2539948115 wait complete. 2024-09-17T02:56:17.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.885+0000 7f9728fc6640 1 Processor -- start 2024-09-17T02:56:17.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.885+0000 7f9728fc6640 1 -- start start 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9728fc6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97240734f0 0x7f9724143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9728fc6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97240b0500 0x7f97241437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9728fc6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f972415c220 0x7f9724141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9728fc6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f97240b4f20 con 0x7f97240b0500 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9728fc6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f97240b1230 con 0x7f972415c220 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9728fc6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f97240b50a0 con 0x7f97240734f0 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9721d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97240b0500 0x7f97241437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9721d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97240b0500 0x7f97241437c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43888/0 (socket says 172.21.15.104:43888) 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9721d9b640 1 -- 172.21.15.104:0/715675168 learned_addr learned my addr 172.21.15.104:0/715675168 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f972259c640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97240734f0 0x7f9724143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.886+0000 7f9722d9d640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f972415c220 0x7f9724141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:17.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9721d9b640 1 -- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97240734f0 msgr2=0x7f9724143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9721d9b640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97240734f0 0x7f9724143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9721d9b640 1 -- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f972415c220 msgr2=0x7f9724141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9721d9b640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f972415c220 0x7f9724141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9721d9b640 1 -- 172.21.15.104:0/715675168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97241590e0 con 0x7f97240b0500 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9721d9b640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97240b0500 0x7f97241437c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f971800d750 tx=0x7f971800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9712ffd640 1 -- 172.21.15.104:0/715675168 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718017070 con 0x7f97240b0500 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9712ffd640 1 -- 172.21.15.104:0/715675168 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9718004310 con 0x7f97240b0500 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97241411f0 con 0x7f97240b0500 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9712ffd640 1 -- 172.21.15.104:0/715675168 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718009c30 con 0x7f97240b0500 2024-09-17T02:56:17.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.887+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97241417b0 con 0x7f97240b0500 2024-09-17T02:56:17.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.888+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9724158e50 con 0x7f97240b0500 2024-09-17T02:56:17.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.889+0000 7f9712ffd640 1 -- 172.21.15.104:0/715675168 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f97180047a0 con 0x7f97240b0500 2024-09-17T02:56:17.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.889+0000 7f9712ffd640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9704078b90 0x7f970407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:17.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.889+0000 7f9712ffd640 1 -- 172.21.15.104:0/715675168 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5709+0+0 (secure 0 0 0) 0x7f971809b510 con 0x7f97240b0500 2024-09-17T02:56:17.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.889+0000 7f9712ffd640 1 -- 172.21.15.104:0/715675168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=51}) -- 0x7f9704080770 con 0x7f97240b0500 2024-09-17T02:56:17.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.890+0000 7f972259c640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9704078b90 0x7f970407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:17.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.890+0000 7f972259c640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9704078b90 0x7f970407b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9714035000 tx=0x7f9714038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:17.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:17.893+0000 7f9712ffd640 1 -- 172.21.15.104:0/715675168 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9718020020 con 0x7f97240b0500 2024-09-17T02:56:18.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.069+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f97240d23c0 con 0x7f97240b0500 2024-09-17T02:56:18.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.070+0000 7f9712ffd640 1 -- 172.21.15.104:0/715675168 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v50) ==== 81+0+34395 (secure 0 0 0) 0x7f971800de60 con 0x7f97240b0500 2024-09-17T02:56:18.070 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:18.070 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:18.070 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 50, 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:56:10.758837+0000", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:56:18.071 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 7, 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:56:18.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:56:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:56:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:56:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:18.073 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:56:18.074 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:18.075 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:18.076 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:18.077 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:18.078 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:56:18.079 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 6, 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:52.652619+0000", 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:56:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:56:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 7, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:53.964016+0000", 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "47", 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:18.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.097 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:18.099 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:18.100 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:56:18.104 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.105 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:18.107 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:56:18.108 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:18.112 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.113 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:18.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.115 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.116 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull", 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:18.117 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.121 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:56:18.122 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:18.123 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:18.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:56:18.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.127 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:56:18.128 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:18.129 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.133 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:56:18.134 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:18.135 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:56:18.136 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:56:18.137 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:56:18.138 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:18.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.140 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:56:18.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:18.142 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:56:18.143 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:18.144 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:18.145 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:18.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:56:18.147 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:56:18.148 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:56:18.149 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:18.150 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:18.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9704078b90 msgr2=0x7f970407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:18.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9704078b90 0x7f970407b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9714035000 tx=0x7f9714038040 comp rx=0 tx=0).stop 2024-09-17T02:56:18.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97240b0500 msgr2=0x7f97241437c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:18.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97240b0500 0x7f97241437c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f971800d750 tx=0x7f971800dc10 comp rx=0 tx=0).stop 2024-09-17T02:56:18.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 shutdown_connections 2024-09-17T02:56:18.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9704078b90 0x7f970407b0a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:18.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f972415c220 0x7f9724141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:18.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97240b0500 0x7f97241437c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:18.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 --2- 172.21.15.104:0/715675168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97240734f0 0x7f9724143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:18.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 >> 172.21.15.104:0/715675168 conn(0x7f972406d200 msgr2=0x7f97241558a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:18.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 shutdown_connections 2024-09-17T02:56:18.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:18.072+0000 7f9728fc6640 1 -- 172.21.15.104:0/715675168 wait complete. 2024-09-17T02:56:18.153 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T02:56:19.784 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:56:19.784+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-17T02:56:23.154 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:56:23.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.280+0000 7fd04fbf1640 1 -- 172.21.15.104:0/836413269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0480d1c40 msgr2=0x7fd0480d2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.280+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/836413269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0480d1c40 0x7fd0480d2050 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd0480736e0 tx=0x7fd04002a5f0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.280+0000 7fd04fbf1640 1 -- 172.21.15.104:0/836413269 shutdown_connections 2024-09-17T02:56:23.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.280+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/836413269 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0480d1c40 0x7fd0480d2050 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.280+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/836413269 >> v2:172.21.15.192:3300/0 conn(0x7fd048162990 0x7fd048162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.280+0000 7fd04fbf1640 1 -- 172.21.15.104:0/836413269 >> 172.21.15.104:0/836413269 conn(0x7fd04806d200 msgr2=0x7fd04806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:23.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.280+0000 7fd04fbf1640 1 -- 172.21.15.104:0/836413269 shutdown_connections 2024-09-17T02:56:23.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.280+0000 7fd04fbf1640 1 -- 172.21.15.104:0/836413269 wait complete. 2024-09-17T02:56:23.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.282+0000 7fd04fbf1640 1 Processor -- start 2024-09-17T02:56:23.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.282+0000 7fd04fbf1640 1 -- start start 2024-09-17T02:56:23.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04fbf1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0480d1c40 0x7fd0481551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:23.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04fbf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd04815feb0 0x7fd0480cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:23.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04fbf1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd048162990 0x7fd0480d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04fbf1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd0480b4b80 con 0x7fd04815feb0 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04fbf1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd0480b4a00 con 0x7fd048162990 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04fbf1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd0480b4d00 con 0x7fd0480d1c40 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04d18c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd04815feb0 0x7fd0480cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04d18c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd04815feb0 0x7fd0480cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43896/0 (socket says 172.21.15.104:43896) 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04d18c640 1 -- 172.21.15.104:0/166030698 learned_addr learned my addr 172.21.15.104:0/166030698 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04d98d640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0480d1c40 0x7fd0481551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.283+0000 7fd04e18e640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd048162990 0x7fd0480d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd04d18c640 1 -- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0480d1c40 msgr2=0x7fd0481551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd04d18c640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0480d1c40 0x7fd0481551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd04d18c640 1 -- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd048162990 msgr2=0x7fd0480d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd04d18c640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd048162990 0x7fd0480d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd04d18c640 1 -- 172.21.15.104:0/166030698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0481f6010 con 0x7fd04815feb0 2024-09-17T02:56:23.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd04d18c640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd04815feb0 0x7fd0480cfc90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd03800d740 tx=0x7fd03800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:23.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd03e7fc640 1 -- 172.21.15.104:0/166030698 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038017070 con 0x7fd04815feb0 2024-09-17T02:56:23.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd03e7fc640 1 -- 172.21.15.104:0/166030698 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd038009d20 con 0x7fd04815feb0 2024-09-17T02:56:23.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0480b3a60 con 0x7fd04815feb0 2024-09-17T02:56:23.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd03e7fc640 1 -- 172.21.15.104:0/166030698 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0380106c0 con 0x7fd04815feb0 2024-09-17T02:56:23.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.284+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0480b4020 con 0x7fd04815feb0 2024-09-17T02:56:23.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.285+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0480b37d0 con 0x7fd04815feb0 2024-09-17T02:56:23.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.286+0000 7fd03e7fc640 1 -- 172.21.15.104:0/166030698 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd03801a070 con 0x7fd04815feb0 2024-09-17T02:56:23.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.286+0000 7fd03e7fc640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd02c078b90 0x7fd02c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:23.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.287+0000 7fd03e7fc640 1 -- 172.21.15.104:0/166030698 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7fd03809b210 con 0x7fd04815feb0 2024-09-17T02:56:23.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.287+0000 7fd04d98d640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd02c078b90 0x7fd02c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:23.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.287+0000 7fd04d98d640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd02c078b90 0x7fd02c07b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0440012e0 tx=0x7fd044009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:23.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.290+0000 7fd03e7fc640 1 -- 172.21.15.104:0/166030698 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd0380630e0 con 0x7fd04815feb0 2024-09-17T02:56:23.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.464+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fd0480b5220 con 0x7fd04815feb0 2024-09-17T02:56:23.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.465+0000 7fd03e7fc640 1 -- 172.21.15.104:0/166030698 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) ==== 81+0+34252 (secure 0 0 0) 0x7fd038067b10 con 0x7fd04815feb0 2024-09-17T02:56:23.465 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:23.465 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 54, 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:56:22.851658+0000", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:56:23.466 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 7, 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:56:23.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:23.468 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:23.469 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "54", 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:23.470 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:23.471 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:23.472 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.473 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 6, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:52.652619+0000", 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:23.475 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:23.476 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "54", 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:23.477 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:23.478 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:23.479 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:23.480 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 7, 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:53.964016+0000", 2024-09-17T02:56:23.481 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:23.482 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.483 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "54", 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:23.484 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:23.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:23.486 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:23.487 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.488 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:56:23.489 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.490 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.491 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:56:23.493 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.494 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:56:23.496 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:56:23.497 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:56:23.499 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.500 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:56:23.504 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.505 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.506 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:56:23.507 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.508 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.509 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.511 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.512 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.513 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.514 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:56:23.515 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.516 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.517 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.518 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.519 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.520 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.521 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.522 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.523 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.524 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.525 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.527 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.530 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.532 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.533 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.535 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.537 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:56:23.538 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.539 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.540 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:56:23.541 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:56:23.542 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:56:23.543 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:56:23.544 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:56:23.544 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.544 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:23.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd02c078b90 msgr2=0x7fd02c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd02c078b90 0x7fd02c07b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0440012e0 tx=0x7fd044009040 comp rx=0 tx=0).stop 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd04815feb0 msgr2=0x7fd0480cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd04815feb0 0x7fd0480cfc90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd03800d740 tx=0x7fd03800dc00 comp rx=0 tx=0).stop 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 shutdown_connections 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd02c078b90 0x7fd02c07b0a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd048162990 0x7fd0480d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd04815feb0 0x7fd0480cfc90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 --2- 172.21.15.104:0/166030698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0480d1c40 0x7fd0481551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 >> 172.21.15.104:0/166030698 conn(0x7fd04806d200 msgr2=0x7fd048158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 shutdown_connections 2024-09-17T02:56:23.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.468+0000 7fd04fbf1640 1 -- 172.21.15.104:0/166030698 wait complete. 2024-09-17T02:56:23.547 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-17T02:56:23.547 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:56:23.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.660+0000 7f7a4ed07640 1 -- 172.21.15.104:0/462035216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a4815cc30 msgr2=0x7f7a480cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.660+0000 7f7a4ed07640 1 --2- 172.21.15.104:0/462035216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a4815cc30 0x7f7a480cd770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009830 tx=0x7f7a3c02a540 comp rx=0 tx=0).stop 2024-09-17T02:56:23.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.660+0000 7f7a4ed07640 1 -- 172.21.15.104:0/462035216 shutdown_connections 2024-09-17T02:56:23.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.660+0000 7f7a4ed07640 1 --2- 172.21.15.104:0/462035216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a4815cc30 0x7f7a480cd770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.660+0000 7f7a4ed07640 1 -- 172.21.15.104:0/462035216 >> 172.21.15.104:0/462035216 conn(0x7f7a4806eb90 msgr2=0x7f7a4806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:23.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.660+0000 7f7a4ed07640 1 -- 172.21.15.104:0/462035216 shutdown_connections 2024-09-17T02:56:23.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.660+0000 7f7a4ed07640 1 -- 172.21.15.104:0/462035216 wait complete. 2024-09-17T02:56:23.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.662+0000 7f7a4ed07640 1 Processor -- start 2024-09-17T02:56:23.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.662+0000 7f7a4ed07640 1 -- start start 2024-09-17T02:56:23.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.663+0000 7f7a4ed07640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a48073e00 0x7f7a4814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:23.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.663+0000 7f7a4ed07640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a480cdcb0 0x7f7a48158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.663+0000 7f7a4ed07640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a4815cc30 0x7f7a48158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.663+0000 7f7a4ed07640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7a480d0360 con 0x7f7a4815cc30 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4ed07640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a480d01e0 con 0x7f7a480cdcb0 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4ed07640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7a480d04e0 con 0x7f7a48073e00 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a4815cc30 0x7f7a48158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a4815cc30 0x7f7a48158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43902/0 (socket says 172.21.15.104:43902) 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 -- 172.21.15.104:0/3115319906 learned_addr learned my addr 172.21.15.104:0/3115319906 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a47fff640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a480cdcb0 0x7f7a48158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4caa3640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a48073e00 0x7f7a4814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 -- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a48073e00 msgr2=0x7f7a4814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a48073e00 0x7f7a4814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 -- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a480cdcb0 msgr2=0x7f7a48158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a480cdcb0 0x7f7a48158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 -- 172.21.15.104:0/3115319906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a480aa6f0 con 0x7f7a4815cc30 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4caa3640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a48073e00 0x7f7a4814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4d2a4640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a4815cc30 0x7f7a48158870 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000c700 tx=0x7f7a4000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a457fa640 1 -- 172.21.15.104:0/3115319906 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40003b70 con 0x7f7a4815cc30 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a457fa640 1 -- 172.21.15.104:0/3115319906 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a40003d10 con 0x7f7a4815cc30 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a481f8490 con 0x7f7a4815cc30 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a457fa640 1 -- 172.21.15.104:0/3115319906 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40005330 con 0x7f7a4815cc30 2024-09-17T02:56:23.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.664+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a480aad20 con 0x7f7a4815cc30 2024-09-17T02:56:23.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.666+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a480d0a20 con 0x7f7a4815cc30 2024-09-17T02:56:23.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.666+0000 7f7a457fa640 1 -- 172.21.15.104:0/3115319906 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a400054d0 con 0x7f7a4815cc30 2024-09-17T02:56:23.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.666+0000 7f7a457fa640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7a34078bc0 0x7f7a3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:23.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.667+0000 7f7a457fa640 1 -- 172.21.15.104:0/3115319906 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7f7a4009a880 con 0x7f7a4815cc30 2024-09-17T02:56:23.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.667+0000 7f7a4caa3640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7a34078bc0 0x7f7a3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:23.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.667+0000 7f7a4caa3640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7a34078bc0 0x7f7a3407b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7a38001eb0 tx=0x7f7a38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:23.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.671+0000 7f7a457fa640 1 -- 172.21.15.104:0/3115319906 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7a40062de0 con 0x7f7a4815cc30 2024-09-17T02:56:23.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.846+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f7a4806adb0 con 0x7f7a4815cc30 2024-09-17T02:56:23.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.847+0000 7f7a457fa640 1 -- 172.21.15.104:0/3115319906 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) ==== 81+0+34252 (secure 0 0 0) 0x7f7a400626e0 con 0x7f7a4815cc30 2024-09-17T02:56:23.847 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:23.847 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:23.847 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 54, 2024-09-17T02:56:23.848 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:23.848 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:56:23.848 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:56:22.851658+0000", 2024-09-17T02:56:23.848 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:56:23.848 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:56:23.848 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:56:23.848 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:56:23.848 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:56:23.849 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 7, 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:23.850 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:23.851 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:23.852 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "54", 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:23.853 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:23.854 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:23.855 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:56:23.856 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:56:23.857 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:56:23.857 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:56:23.857 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:56:23.857 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:23.857 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:23.857 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 6, 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:52.652619+0000", 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:23.858 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:56:23.859 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "54", 2024-09-17T02:56:23.860 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:23.861 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:23.861 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:23.861 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:23.861 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:23.861 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:23.862 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:23.863 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:56:23.864 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:23.865 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 7, 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:55:53.964016+0000", 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:56:23.866 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:56:23.867 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "54", 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:56:23.868 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:56:23.869 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:56:23.870 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:56:23.871 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:56:23.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.872 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:56:23.872 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:56:23.872 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:56:23.872 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.872 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.872 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:56:23.872 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:23.873 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.874 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.875 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.876 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.878 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:56:23.879 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.880 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:56:23.881 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.882 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.883 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.885 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.887 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:56:23.888 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.889 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.891 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.892 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:56:23.893 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:56:23.893 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:56:23.893 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:56:23.893 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.893 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.893 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.893 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.894 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.895 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.897 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.897 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:56:23.897 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.897 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.897 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.897 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.897 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.898 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.899 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.900 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.901 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.902 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.903 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.904 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.905 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.906 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.907 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.908 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.909 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.911 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.912 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.913 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.914 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.916 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.917 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:56:23.918 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.919 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 44, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:56:23.920 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.923 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:56:23.925 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.926 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.927 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.928 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:56:23.930 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.931 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:56:23.932 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:56:23.933 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:56:23.934 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:56:23.935 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:56:23.935 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:56:23.935 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:56:23.935 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:56:23.935 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:23.935 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7a34078bc0 msgr2=0x7f7a3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7a34078bc0 0x7f7a3407b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7a38001eb0 tx=0x7f7a38009040 comp rx=0 tx=0).stop 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a4815cc30 msgr2=0x7f7a48158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a4815cc30 0x7f7a48158870 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7a4000c700 tx=0x7f7a4000cbc0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 shutdown_connections 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7a34078bc0 0x7f7a3407b0d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a480cdcb0 0x7f7a48158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a4815cc30 0x7f7a48158870 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 --2- 172.21.15.104:0/3115319906 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a48073e00 0x7f7a4814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.849+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 >> 172.21.15.104:0/3115319906 conn(0x7f7a4806eb90 msgr2=0x7f7a48159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:23.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.850+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 shutdown_connections 2024-09-17T02:56:23.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:23.850+0000 7f7a4ed07640 1 -- 172.21.15.104:0/3115319906 wait complete. 2024-09-17T02:56:23.938 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:24.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.053+0000 7feff01eb640 1 -- 172.21.15.104:0/4181693660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe8073580 msgr2=0x7fefe8073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:24.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.053+0000 7feff01eb640 1 --2- 172.21.15.104:0/4181693660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe8073580 0x7fefe8073990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fefd8009830 tx=0x7fefd802a510 comp rx=0 tx=0).stop 2024-09-17T02:56:24.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.053+0000 7feff01eb640 1 -- 172.21.15.104:0/4181693660 shutdown_connections 2024-09-17T02:56:24.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.053+0000 7feff01eb640 1 --2- 172.21.15.104:0/4181693660 >> v2:172.21.15.192:3300/0 conn(0x7fefe80b4ce0 0x7fefe80b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.053+0000 7feff01eb640 1 --2- 172.21.15.104:0/4181693660 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe8073580 0x7fefe8073990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.053+0000 7feff01eb640 1 -- 172.21.15.104:0/4181693660 >> 172.21.15.104:0/4181693660 conn(0x7fefe80b3640 msgr2=0x7fefe80b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:24.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.053+0000 7feff01eb640 1 -- 172.21.15.104:0/4181693660 shutdown_connections 2024-09-17T02:56:24.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.053+0000 7feff01eb640 1 -- 172.21.15.104:0/4181693660 wait complete. 2024-09-17T02:56:24.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.055+0000 7feff01eb640 1 Processor -- start 2024-09-17T02:56:24.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.055+0000 7feff01eb640 1 -- start start 2024-09-17T02:56:24.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7feff01eb640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe8073580 0x7fefe8141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7feff01eb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe80b4ce0 0x7fefe815e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7feff01eb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefe8152ce0 0x7fefe815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7feff01eb640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fefe80b59c0 con 0x7fefe8152ce0 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7feff01eb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fefe80b5840 con 0x7fefe80b4ce0 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7feff01eb640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fefe80b5b40 con 0x7fefe8073580 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefe8152ce0 0x7fefe815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefe8152ce0 0x7fefe815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51886/0 (socket says 172.21.15.104:51886) 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 -- 172.21.15.104:0/2604494318 learned_addr learned my addr 172.21.15.104:0/2604494318 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefed786640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe80b4ce0 0x7fefe815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefedf87640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe8073580 0x7fefe8141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:24.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 -- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe8073580 msgr2=0x7fefe8141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe8073580 0x7fefe8141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 -- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe80b4ce0 msgr2=0x7fefe815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe80b4ce0 0x7fefe815e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 -- 172.21.15.104:0/2604494318 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe81f6e20 con 0x7fefe8152ce0 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.056+0000 7fefee788640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefe8152ce0 0x7fefe815e740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fefe000ec20 tx=0x7fefe000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.057+0000 7fefde7fc640 1 -- 172.21.15.104:0/2604494318 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0003b70 con 0x7fefe8152ce0 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.057+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe81e7010 con 0x7fefe8152ce0 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.057+0000 7fefde7fc640 1 -- 172.21.15.104:0/2604494318 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefe0003d10 con 0x7fefe8152ce0 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.057+0000 7fefde7fc640 1 -- 172.21.15.104:0/2604494318 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe0004280 con 0x7fefe8152ce0 2024-09-17T02:56:24.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.057+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe81f73c0 con 0x7fefe8152ce0 2024-09-17T02:56:24.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.058+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe8073990 con 0x7fefe8152ce0 2024-09-17T02:56:24.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.058+0000 7fefde7fc640 1 -- 172.21.15.104:0/2604494318 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fefe0004420 con 0x7fefe8152ce0 2024-09-17T02:56:24.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.059+0000 7fefde7fc640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefcc078b90 0x7fefcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:24.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.059+0000 7fefde7fc640 1 -- 172.21.15.104:0/2604494318 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7fefe009b8c0 con 0x7fefe8152ce0 2024-09-17T02:56:24.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.059+0000 7fefedf87640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefcc078b90 0x7fefcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:24.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.060+0000 7fefedf87640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefcc078b90 0x7fefcc07b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fefe8073380 tx=0x7fefe4007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:24.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.064+0000 7fefde7fc640 1 -- 172.21.15.104:0/2604494318 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fefe00636c0 con 0x7fefe8152ce0 2024-09-17T02:56:24.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.270+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefe806e540 con 0x7fefe8152ce0 2024-09-17T02:56:24.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.270+0000 7fefde7fc640 1 -- 172.21.15.104:0/2604494318 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7fefe00680f0 con 0x7fefe8152ce0 2024-09-17T02:56:24.270 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:24.270 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:56:24.271 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefcc078b90 msgr2=0x7fefcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefcc078b90 0x7fefcc07b0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fefe8073380 tx=0x7fefe4007e90 comp rx=0 tx=0).stop 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefe8152ce0 msgr2=0x7fefe815e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefe8152ce0 0x7fefe815e740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fefe000ec20 tx=0x7fefe000c6a0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 shutdown_connections 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fefcc078b90 0x7fefcc07b0a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe80b4ce0 0x7fefe815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fefe8152ce0 0x7fefe815e740 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 --2- 172.21.15.104:0/2604494318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fefe8073580 0x7fefe8141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:24.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 >> 172.21.15.104:0/2604494318 conn(0x7fefe80b3640 msgr2=0x7fefe80d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:24.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 shutdown_connections 2024-09-17T02:56:24.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:24.273+0000 7feff01eb640 1 -- 172.21.15.104:0/2604494318 wait complete. 2024-09-17T02:56:24.284 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T02:56:24.409 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":5304,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.750048173,"mdsmap_epoch":20,"osdmap_epoch":54,"osdmap_epoch_barrier":50,"uptime":34.078919487999997} 2024-09-17T02:56:24.410 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 5304, "mdsmap_epoch": 20, "osdmap_epoch": 54, "osdmap_epoch_barrier": 50, "rank_uptime": 28.750048173, "state": "up:active", "uptime": 34.078919488, "want_state": "up:active", "whoami": 0 } 2024-09-17T02:56:24.410 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T02:56:24.410 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:24.410 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:24.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:24.427 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-17T02:56:24.669 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records in 2024-09-17T02:56:24.670 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records out 2024-09-17T02:56:24.670 INFO:teuthology.orchestra.run.smithi104.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.184942 s, 283 MB/s 2024-09-17T02:56:24.670 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:56:24.670 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:56:24.720 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:56:24.775 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:56:24.775 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:56:24.775 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:24.775 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:24.792 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:24.792 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:24.848 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:56:25.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.001+0000 7f23b229b640 1 -- 172.21.15.104:0/1976781409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 msgr2=0x7f23ac15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.001+0000 7f23b229b640 1 --2- 172.21.15.104:0/1976781409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 0x7f23ac15ef90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f239c009830 tx=0x7f239c02a480 comp rx=0 tx=0).stop 2024-09-17T02:56:25.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.001+0000 7f23b229b640 1 -- 172.21.15.104:0/1976781409 shutdown_connections 2024-09-17T02:56:25.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.001+0000 7f23b229b640 1 --2- 172.21.15.104:0/1976781409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac0b3b00 0x7f23ac0d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.001+0000 7f23b229b640 1 --2- 172.21.15.104:0/1976781409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 0x7f23ac15ef90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.001+0000 7f23b229b640 1 -- 172.21.15.104:0/1976781409 >> 172.21.15.104:0/1976781409 conn(0x7f23ac073df0 msgr2=0x7f23ac068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:25.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.001+0000 7f23b229b640 1 -- 172.21.15.104:0/1976781409 shutdown_connections 2024-09-17T02:56:25.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.001+0000 7f23b229b640 1 -- 172.21.15.104:0/1976781409 wait complete. 2024-09-17T02:56:25.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.003+0000 7f23b229b640 1 Processor -- start 2024-09-17T02:56:25.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.003+0000 7f23b229b640 1 -- start start 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23b229b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac0b3b00 0x7f23ac14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23b229b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 0x7f23ac161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23b229b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac0d1710 0x7f23ac161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23b229b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac0d01b0 con 0x7f23ac0b6f70 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23b229b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac0d0030 con 0x7f23ac0d1710 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23b229b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac0d0330 con 0x7f23ac0b3b00 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 0x7f23ac161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 0x7f23ac161820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51908/0 (socket says 172.21.15.104:51908) 2024-09-17T02:56:25.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 -- 172.21.15.104:0/311252441 learned_addr learned my addr 172.21.15.104:0/311252441 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23abfff640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac0b3b00 0x7f23ac14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23b0838640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac0d1710 0x7f23ac161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 -- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac0b3b00 msgr2=0x7f23ac14ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac0b3b00 0x7f23ac14ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 -- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac0d1710 msgr2=0x7f23ac161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac0d1710 0x7f23ac161d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 -- 172.21.15.104:0/311252441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac14f460 con 0x7f23ac0b6f70 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23ab7fe640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 0x7f23ac161820 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f23a000d700 tx=0x7f23a000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23a8ff9640 1 -- 172.21.15.104:0/311252441 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0017070 con 0x7f23ac0b6f70 2024-09-17T02:56:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.005+0000 7f23a8ff9640 1 -- 172.21.15.104:0/311252441 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a0005310 con 0x7f23ac0b6f70 2024-09-17T02:56:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.006+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac0cbbc0 con 0x7f23ac0b6f70 2024-09-17T02:56:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.006+0000 7f23a8ff9640 1 -- 172.21.15.104:0/311252441 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0009820 con 0x7f23ac0b6f70 2024-09-17T02:56:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.006+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac0cc180 con 0x7f23ac0b6f70 2024-09-17T02:56:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.007+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac1628b0 con 0x7f23ac0b6f70 2024-09-17T02:56:25.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.007+0000 7f23a8ff9640 1 -- 172.21.15.104:0/311252441 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23a00099c0 con 0x7f23ac0b6f70 2024-09-17T02:56:25.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.008+0000 7f23a8ff9640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2398078b90 0x7f239807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.008+0000 7f23a8ff9640 1 -- 172.21.15.104:0/311252441 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7f23a009acd0 con 0x7f23ac0b6f70 2024-09-17T02:56:25.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.008+0000 7f23abfff640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2398078b90 0x7f239807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.009+0000 7f23abfff640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2398078b90 0x7f239807b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f239c034000 tx=0x7f239c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:25.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.012+0000 7f23a8ff9640 1 -- 172.21.15.104:0/311252441 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23ac1628b0 con 0x7f23ac0b6f70 2024-09-17T02:56:25.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.196+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f23ac06aed0 con 0x7f23ac0b6f70 2024-09-17T02:56:25.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.197+0000 7f23a8ff9640 1 -- 172.21.15.104:0/311252441 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f23ac14f460 con 0x7f23ac0b6f70 2024-09-17T02:56:25.197 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:56:25.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2398078b90 msgr2=0x7f239807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2398078b90 0x7f239807b0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f239c034000 tx=0x7f239c004730 comp rx=0 tx=0).stop 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 msgr2=0x7f23ac161820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 0x7f23ac161820 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f23a000d700 tx=0x7f23a000dbc0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 shutdown_connections 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2398078b90 0x7f239807b0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac0d1710 0x7f23ac161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f23ac0b6f70 0x7f23ac161820 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 --2- 172.21.15.104:0/311252441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac0b3b00 0x7f23ac14ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 >> 172.21.15.104:0/311252441 conn(0x7f23ac073df0 msgr2=0x7f23ac0ba0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 shutdown_connections 2024-09-17T02:56:25.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.199+0000 7f23b229b640 1 -- 172.21.15.104:0/311252441 wait complete. 2024-09-17T02:56:25.210 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T02:56:25.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:25.210 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:25.262 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:56:25.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:25.263 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T02:56:25.287 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:56:25.287 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:56:25.288 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:25.306 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:56:25.306 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:25.363 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:56:25.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.477+0000 7f8ce54fa640 1 -- 172.21.15.104:0/3737567405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce00b6cb0 msgr2=0x7f8ce015f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.477+0000 7f8ce54fa640 1 --2- 172.21.15.104:0/3737567405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce00b6cb0 0x7f8ce015f0b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009830 tx=0x7f8cd402a530 comp rx=0 tx=0).stop 2024-09-17T02:56:25.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.477+0000 7f8ce54fa640 1 -- 172.21.15.104:0/3737567405 shutdown_connections 2024-09-17T02:56:25.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.477+0000 7f8ce54fa640 1 --2- 172.21.15.104:0/3737567405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce00b6cb0 0x7f8ce015f0b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.477+0000 7f8ce54fa640 1 -- 172.21.15.104:0/3737567405 >> 172.21.15.104:0/3737567405 conn(0x7f8ce0069120 msgr2=0x7f8ce0069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:25.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.477+0000 7f8ce54fa640 1 -- 172.21.15.104:0/3737567405 shutdown_connections 2024-09-17T02:56:25.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.477+0000 7f8ce54fa640 1 -- 172.21.15.104:0/3737567405 wait complete. 2024-09-17T02:56:25.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.479+0000 7f8ce54fa640 1 Processor -- start 2024-09-17T02:56:25.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.479+0000 7f8ce54fa640 1 -- start start 2024-09-17T02:56:25.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8ce54fa640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ce01621e0 0x7f8ce0159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8ce54fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce0162cb0 0x7f8ce00ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8ce54fa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce00b8c80 0x7f8ce00d3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8ce54fa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce0160090 con 0x7f8ce0162cb0 2024-09-17T02:56:25.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8ce54fa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce015ff10 con 0x7f8ce00b8c80 2024-09-17T02:56:25.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8ce54fa640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce0160210 con 0x7f8ce01621e0 2024-09-17T02:56:25.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8cde7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce0162cb0 0x7f8ce00ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8cde7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce0162cb0 0x7f8ce00ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51928/0 (socket says 172.21.15.104:51928) 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8cde7fc640 1 -- 172.21.15.104:0/4228439766 learned_addr learned my addr 172.21.15.104:0/4228439766 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8cdf7fe640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce00b8c80 0x7f8ce00d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.480+0000 7f8cdeffd640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ce01621e0 0x7f8ce0159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cde7fc640 1 -- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ce01621e0 msgr2=0x7f8ce0159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cde7fc640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ce01621e0 0x7f8ce0159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cde7fc640 1 -- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce00b8c80 msgr2=0x7f8ce00d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cde7fc640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce00b8c80 0x7f8ce00d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cde7fc640 1 -- 172.21.15.104:0/4228439766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce00cd110 con 0x7f8ce0162cb0 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cde7fc640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce0162cb0 0x7f8ce00ce660 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4000c00 tx=0x7f8cd4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:25.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cc77fe640 1 -- 172.21.15.104:0/4228439766 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4031d60 con 0x7f8ce0162cb0 2024-09-17T02:56:25.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cc77fe640 1 -- 172.21.15.104:0/4228439766 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cd4033e10 con 0x7f8ce0162cb0 2024-09-17T02:56:25.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8cc77fe640 1 -- 172.21.15.104:0/4228439766 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4033310 con 0x7f8ce0162cb0 2024-09-17T02:56:25.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce01f9230 con 0x7f8ce0162cb0 2024-09-17T02:56:25.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.481+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce01f97f0 con 0x7f8ce0162cb0 2024-09-17T02:56:25.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.482+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce01f8fa0 con 0x7f8ce0162cb0 2024-09-17T02:56:25.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.483+0000 7f8cc77fe640 1 -- 172.21.15.104:0/4228439766 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8cd40334b0 con 0x7f8ce0162cb0 2024-09-17T02:56:25.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.483+0000 7f8cc77fe640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.483+0000 7f8cc77fe640 1 -- 172.21.15.104:0/4228439766 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7f8cd40bc050 con 0x7f8ce0162cb0 2024-09-17T02:56:25.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.484+0000 7f8cdeffd640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.484+0000 7f8cdeffd640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0007fd0 tx=0x7f8cd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:25.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.488+0000 7f8cc77fe640 1 -- 172.21.15.104:0/4228439766 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8cd403f030 con 0x7f8ce0162cb0 2024-09-17T02:56:25.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.671+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8ce00b65a0 con 0x7f8ce0162cb0 2024-09-17T02:56:25.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.672+0000 7f8cc77fe640 1 -- 172.21.15.104:0/4228439766 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7f8cd4083e40 con 0x7f8ce0162cb0 2024-09-17T02:56:25.671 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:56:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ccc078bc0 msgr2=0x7f8ccc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0007fd0 tx=0x7f8cd0009040 comp rx=0 tx=0).stop 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce0162cb0 msgr2=0x7f8ce00ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce0162cb0 0x7f8ce00ce660 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4000c00 tx=0x7f8cd4033c20 comp rx=0 tx=0).stop 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 shutdown_connections 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ccc078bc0 0x7f8ccc07b0d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ce00b8c80 0x7f8ce00d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ce0162cb0 0x7f8ce00ce660 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 --2- 172.21.15.104:0/4228439766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ce01621e0 0x7f8ce0159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 >> 172.21.15.104:0/4228439766 conn(0x7f8ce0069120 msgr2=0x7f8ce00b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 shutdown_connections 2024-09-17T02:56:25.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.674+0000 7f8ce54fa640 1 -- 172.21.15.104:0/4228439766 wait complete. 2024-09-17T02:56:25.684 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T02:56:25.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:25.684 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:25.717 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:56:25.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:25.718 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T02:56:25.776 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:56:25.776 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:25.776 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:25.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:56:25.792 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:56:25.792 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:56:25.792 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:25.833 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:56:25.834 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:25.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.946+0000 7f7c34ddf640 1 -- 172.21.15.104:0/1958578883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30155f70 msgr2=0x7f7c300cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.946+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/1958578883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30155f70 0x7f7c300cd770 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c18005fd0 tx=0x7f7c1802a580 comp rx=0 tx=0).stop 2024-09-17T02:56:25.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.946+0000 7f7c34ddf640 1 -- 172.21.15.104:0/1958578883 shutdown_connections 2024-09-17T02:56:25.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.946+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/1958578883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30155f70 0x7f7c300cd770 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.946+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/1958578883 >> v2:172.21.15.192:3300/0 conn(0x7f7c30073e00 0x7f7c3015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.946+0000 7f7c34ddf640 1 -- 172.21.15.104:0/1958578883 >> 172.21.15.104:0/1958578883 conn(0x7f7c3006eb90 msgr2=0x7f7c3006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:25.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.947+0000 7f7c34ddf640 1 -- 172.21.15.104:0/1958578883 shutdown_connections 2024-09-17T02:56:25.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.947+0000 7f7c34ddf640 1 -- 172.21.15.104:0/1958578883 wait complete. 2024-09-17T02:56:25.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.948+0000 7f7c34ddf640 1 Processor -- start 2024-09-17T02:56:25.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.948+0000 7f7c34ddf640 1 -- start start 2024-09-17T02:56:25.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c34ddf640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c30073e00 0x7f7c301f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c34ddf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30155f70 0x7f7c3015f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c34ddf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30156380 0x7f7c300afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c34ddf640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7c300ce040 con 0x7f7c30156380 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c34ddf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7c300cdec0 con 0x7f7c30155f70 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c34ddf640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7c3015feb0 con 0x7f7c30073e00 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30156380 0x7f7c300afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30156380 0x7f7c300afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51942/0 (socket says 172.21.15.104:51942) 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 -- 172.21.15.104:0/762633252 learned_addr learned my addr 172.21.15.104:0/762633252 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c27fff640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30155f70 0x7f7c3015f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2e59c640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c30073e00 0x7f7c301f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 -- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c30073e00 msgr2=0x7f7c301f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c30073e00 0x7f7c301f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 -- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30155f70 msgr2=0x7f7c3015f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30155f70 0x7f7c3015f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:25.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 -- 172.21.15.104:0/762633252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c301f78d0 con 0x7f7c30156380 2024-09-17T02:56:25.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c2ed9d640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30156380 0x7f7c300afa00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800b970 tx=0x7f7c2800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:25.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c26ffd640 1 -- 172.21.15.104:0/762633252 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28019070 con 0x7f7c30156380 2024-09-17T02:56:25.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c26ffd640 1 -- 172.21.15.104:0/762633252 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c2800cc30 con 0x7f7c30156380 2024-09-17T02:56:25.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3015ead0 con 0x7f7c30156380 2024-09-17T02:56:25.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.950+0000 7f7c26ffd640 1 -- 172.21.15.104:0/762633252 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c280146a0 con 0x7f7c30156380 2024-09-17T02:56:25.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.951+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c3015fc20 con 0x7f7c30156380 2024-09-17T02:56:25.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.951+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c3015e840 con 0x7f7c30156380 2024-09-17T02:56:25.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.952+0000 7f7c26ffd640 1 -- 172.21.15.104:0/762633252 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c2801c070 con 0x7f7c30156380 2024-09-17T02:56:25.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.953+0000 7f7c26ffd640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c10078bc0 0x7f7c1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:25.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.953+0000 7f7c26ffd640 1 -- 172.21.15.104:0/762633252 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7f7c2809a8a0 con 0x7f7c30156380 2024-09-17T02:56:25.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.953+0000 7f7c2e59c640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c10078bc0 0x7f7c1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:25.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.953+0000 7f7c2e59c640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c10078bc0 0x7f7c1007b0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000bb50 tx=0x7f7c2000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:25.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:25.957+0000 7f7c26ffd640 1 -- 172.21.15.104:0/762633252 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c28062690 con 0x7f7c30156380 2024-09-17T02:56:26.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.165+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c301603c0 con 0x7f7c30156380 2024-09-17T02:56:26.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.165+0000 7f7c26ffd640 1 -- 172.21.15.104:0/762633252 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7f7c280670c0 con 0x7f7c30156380 2024-09-17T02:56:26.165 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:26.165 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:56:26.166 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:56:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.167+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c10078bc0 msgr2=0x7f7c1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.167+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c10078bc0 0x7f7c1007b0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000bb50 tx=0x7f7c2000b2e0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.167+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30156380 msgr2=0x7f7c300afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.167+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30156380 0x7f7c300afa00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800b970 tx=0x7f7c2800be30 comp rx=0 tx=0).stop 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.168+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 shutdown_connections 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.168+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c10078bc0 0x7f7c1007b0d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.168+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30155f70 0x7f7c3015f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.168+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7c30156380 0x7f7c300afa00 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.168+0000 7f7c34ddf640 1 --2- 172.21.15.104:0/762633252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c30073e00 0x7f7c301f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.168+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 >> 172.21.15.104:0/762633252 conn(0x7f7c3006eb90 msgr2=0x7f7c300705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.168+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 shutdown_connections 2024-09-17T02:56:26.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.168+0000 7f7c34ddf640 1 -- 172.21.15.104:0/762633252 wait complete. 2024-09-17T02:56:26.178 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:26.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.291+0000 7ff98828b640 1 -- 172.21.15.104:0/2404379623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff98015cc30 msgr2=0x7ff9800cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.291+0000 7ff98828b640 1 --2- 172.21.15.104:0/2404379623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff98015cc30 0x7ff9800cfa80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff980072ca0 tx=0x7ff97802a560 comp rx=0 tx=0).stop 2024-09-17T02:56:26.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.291+0000 7ff98828b640 1 -- 172.21.15.104:0/2404379623 shutdown_connections 2024-09-17T02:56:26.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.291+0000 7ff98828b640 1 --2- 172.21.15.104:0/2404379623 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff98015cc30 0x7ff9800cfa80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.291+0000 7ff98828b640 1 --2- 172.21.15.104:0/2404379623 >> v2:172.21.15.192:3300/0 conn(0x7ff9800cde80 0x7ff980156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.291+0000 7ff98828b640 1 -- 172.21.15.104:0/2404379623 >> 172.21.15.104:0/2404379623 conn(0x7ff98006eb90 msgr2=0x7ff98006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.291+0000 7ff98828b640 1 -- 172.21.15.104:0/2404379623 shutdown_connections 2024-09-17T02:56:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.291+0000 7ff98828b640 1 -- 172.21.15.104:0/2404379623 wait complete. 2024-09-17T02:56:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.293+0000 7ff98828b640 1 Processor -- start 2024-09-17T02:56:26.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.293+0000 7ff98828b640 1 -- start start 2024-09-17T02:56:26.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff98828b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff980073e00 0x7ff98014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff98828b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff98015cc30 0x7ff980158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff98828b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff980158aa0 0x7ff980151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff98828b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9800d0350 con 0x7ff980073e00 2024-09-17T02:56:26.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff98828b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff9800d01d0 con 0x7ff980158aa0 2024-09-17T02:56:26.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff98828b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff9800d04d0 con 0x7ff98015cc30 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff980073e00 0x7ff98014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff980073e00 0x7ff98014d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51966/0 (socket says 172.21.15.104:51966) 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 -- 172.21.15.104:0/295521699 learned_addr learned my addr 172.21.15.104:0/295521699 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986828640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff980158aa0 0x7ff980151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff985826640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff98015cc30 0x7ff980158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 -- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff98015cc30 msgr2=0x7ff980158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff98015cc30 0x7ff980158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 -- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff980158aa0 msgr2=0x7ff980151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff980158aa0 0x7ff980151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 -- 172.21.15.104:0/295521699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9801f6640 con 0x7ff980073e00 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986828640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff980158aa0 0x7ff980151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff985826640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff98015cc30 0x7ff980158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:26.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.294+0000 7ff986027640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff980073e00 0x7ff98014d7e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c710 tx=0x7ff97c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:26.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.295+0000 7ff976ffd640 1 -- 172.21.15.104:0/295521699 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c017070 con 0x7ff980073e00 2024-09-17T02:56:26.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.295+0000 7ff976ffd640 1 -- 172.21.15.104:0/295521699 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff97c00ce20 con 0x7ff980073e00 2024-09-17T02:56:26.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.295+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9801f68c0 con 0x7ff980073e00 2024-09-17T02:56:26.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.295+0000 7ff976ffd640 1 -- 172.21.15.104:0/295521699 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0052d0 con 0x7ff980073e00 2024-09-17T02:56:26.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.295+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9801f6e80 con 0x7ff980073e00 2024-09-17T02:56:26.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.296+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9800d0980 con 0x7ff980073e00 2024-09-17T02:56:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.297+0000 7ff976ffd640 1 -- 172.21.15.104:0/295521699 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff97c01a070 con 0x7ff980073e00 2024-09-17T02:56:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.297+0000 7ff976ffd640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff964078b90 0x7ff96407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.297+0000 7ff976ffd640 1 -- 172.21.15.104:0/295521699 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7ff97c09a7e0 con 0x7ff980073e00 2024-09-17T02:56:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.297+0000 7ff985826640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff964078b90 0x7ff96407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.298+0000 7ff985826640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff964078b90 0x7ff96407b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff9800b2950 tx=0x7ff970005dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:26.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.301+0000 7ff976ffd640 1 -- 172.21.15.104:0/295521699 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff97c021020 con 0x7ff980073e00 2024-09-17T02:56:26.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.511+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff980159dc0 con 0x7ff980073e00 2024-09-17T02:56:26.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.512+0000 7ff976ffd640 1 -- 172.21.15.104:0/295521699 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7ff9801f6640 con 0x7ff980073e00 2024-09-17T02:56:26.512 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:26.513 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:56:26.513 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:56:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff964078b90 msgr2=0x7ff96407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff964078b90 0x7ff96407b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff9800b2950 tx=0x7ff970005dd0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff980073e00 msgr2=0x7ff98014d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff980073e00 0x7ff98014d7e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c710 tx=0x7ff97c00cbd0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 shutdown_connections 2024-09-17T02:56:26.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff964078b90 0x7ff96407b0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff980158aa0 0x7ff980151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff98015cc30 0x7ff980158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 --2- 172.21.15.104:0/295521699 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff980073e00 0x7ff98014d7e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 >> 172.21.15.104:0/295521699 conn(0x7ff98006eb90 msgr2=0x7ff98014f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 shutdown_connections 2024-09-17T02:56:26.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.514+0000 7ff98828b640 1 -- 172.21.15.104:0/295521699 wait complete. 2024-09-17T02:56:26.525 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:56:26.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.638+0000 7ff0d395e640 1 -- 172.21.15.104:0/2123098257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0cc15f1f0 msgr2=0x7ff0cc15f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.638+0000 7ff0d395e640 1 --2- 172.21.15.104:0/2123098257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0cc15f1f0 0x7ff0cc15f600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009830 tx=0x7ff0bc02a480 comp rx=0 tx=0).stop 2024-09-17T02:56:26.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.638+0000 7ff0d395e640 1 -- 172.21.15.104:0/2123098257 shutdown_connections 2024-09-17T02:56:26.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.638+0000 7ff0d395e640 1 --2- 172.21.15.104:0/2123098257 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0cc15fb40 0x7ff0cc161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.638+0000 7ff0d395e640 1 --2- 172.21.15.104:0/2123098257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0cc15f1f0 0x7ff0cc15f600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.638+0000 7ff0d395e640 1 -- 172.21.15.104:0/2123098257 >> 172.21.15.104:0/2123098257 conn(0x7ff0cc069120 msgr2=0x7ff0cc069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:26.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.638+0000 7ff0d395e640 1 -- 172.21.15.104:0/2123098257 shutdown_connections 2024-09-17T02:56:26.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.638+0000 7ff0d395e640 1 -- 172.21.15.104:0/2123098257 wait complete. 2024-09-17T02:56:26.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.640+0000 7ff0d395e640 1 Processor -- start 2024-09-17T02:56:26.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.640+0000 7ff0d395e640 1 -- start start 2024-09-17T02:56:26.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d395e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0cc0b65e0 0x7ff0cc0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d395e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0cc15f1f0 0x7ff0cc0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d395e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0cc15fb40 0x7ff0cc14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d395e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc161da0 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d395e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc161c20 con 0x7ff0cc15fb40 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d395e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff0cc161f20 con 0x7ff0cc15f1f0 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d16fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0cc0b65e0 0x7ff0cc0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d16fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0cc0b65e0 0x7ff0cc0c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51968/0 (socket says 172.21.15.104:51968) 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.641+0000 7ff0d16fa640 1 -- 172.21.15.104:0/4243739584 learned_addr learned my addr 172.21.15.104:0/4243739584 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d1efb640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0cc15fb40 0x7ff0cc14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d0ef9640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0cc15f1f0 0x7ff0cc0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d16fa640 1 -- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0cc15f1f0 msgr2=0x7ff0cc0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d16fa640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0cc15f1f0 0x7ff0cc0ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d16fa640 1 -- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0cc15fb40 msgr2=0x7ff0cc14a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d16fa640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0cc15fb40 0x7ff0cc14a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d16fa640 1 -- 172.21.15.104:0/4243739584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc0c9970 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d16fa640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0cc0b65e0 0x7ff0cc0c8fd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800c3a0 tx=0x7ff0c800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:26.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0c1ffb640 1 -- 172.21.15.104:0/4243739584 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8011790 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0c1ffb640 1 -- 172.21.15.104:0/4243739584 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0c8017070 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0c1ffb640 1 -- 172.21.15.104:0/4243739584 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8011c80 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc0c9c50 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.642+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc158650 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.643+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0cc1623d0 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.644+0000 7ff0c1ffb640 1 -- 172.21.15.104:0/4243739584 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0c801c460 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.644+0000 7ff0c1ffb640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff0b0078b90 0x7ff0b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.645+0000 7ff0c1ffb640 1 -- 172.21.15.104:0/4243739584 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7ff0c809a930 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.645+0000 7ff0d0ef9640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff0b0078b90 0x7ff0b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.645+0000 7ff0d0ef9640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff0b0078b90 0x7ff0b007b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc034000 tx=0x7ff0bc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:26.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.649+0000 7ff0c1ffb640 1 -- 172.21.15.104:0/4243739584 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff0c8062d70 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.824+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0cc15e850 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.825+0000 7ff0c1ffb640 1 -- 172.21.15.104:0/4243739584 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16721 (secure 0 0 0) 0x7ff0c8062670 con 0x7ff0cc0b65e0 2024-09-17T02:56:26.825 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:26.825 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":54,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:56:22.851658+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:52.652619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:53.964016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff0b0078b90 msgr2=0x7ff0b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff0b0078b90 0x7ff0b007b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc034000 tx=0x7ff0bc004730 comp rx=0 tx=0).stop 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0cc0b65e0 msgr2=0x7ff0cc0c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0cc0b65e0 0x7ff0cc0c8fd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800c3a0 tx=0x7ff0c800c7a0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 shutdown_connections 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff0b0078b90 0x7ff0b007b0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0cc15fb40 0x7ff0cc14a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0cc15f1f0 0x7ff0cc0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 --2- 172.21.15.104:0/4243739584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0cc0b65e0 0x7ff0cc0c8fd0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 >> 172.21.15.104:0/4243739584 conn(0x7ff0cc069120 msgr2=0x7ff0cc0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:26.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 shutdown_connections 2024-09-17T02:56:26.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.827+0000 7ff0d395e640 1 -- 172.21.15.104:0/4243739584 wait complete. 2024-09-17T02:56:26.838 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T02:56:26.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:26.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.950+0000 7f27ad124640 1 -- 172.21.15.104:0/882334044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80cdf10 msgr2=0x7f27a80b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.950+0000 7f27ad124640 1 --2- 172.21.15.104:0/882334044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80cdf10 0x7f27a80b57e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f27a80c98b0 tx=0x7f279002a5f0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.950+0000 7f27ad124640 1 -- 172.21.15.104:0/882334044 shutdown_connections 2024-09-17T02:56:26.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.950+0000 7f27ad124640 1 --2- 172.21.15.104:0/882334044 >> v2:172.21.15.192:3300/0 conn(0x7f27a80b5d20 0x7f27a80cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.950+0000 7f27ad124640 1 --2- 172.21.15.104:0/882334044 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80cdf10 0x7f27a80b57e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.950+0000 7f27ad124640 1 -- 172.21.15.104:0/882334044 >> 172.21.15.104:0/882334044 conn(0x7f27a80b44a0 msgr2=0x7f27a80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:26.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.950+0000 7f27ad124640 1 -- 172.21.15.104:0/882334044 shutdown_connections 2024-09-17T02:56:26.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.950+0000 7f27ad124640 1 -- 172.21.15.104:0/882334044 wait complete. 2024-09-17T02:56:26.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.952+0000 7f27ad124640 1 Processor -- start 2024-09-17T02:56:26.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.952+0000 7f27ad124640 1 -- start start 2024-09-17T02:56:26.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.953+0000 7f27ad124640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a80b4fc0 0x7f27a8150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27ad124640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80b5d20 0x7f27a80cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27ad124640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27a80cdf10 0x7f27a80cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27ad124640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f27a80d18c0 con 0x7f27a80b5d20 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27ad124640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27a80d01d0 con 0x7f27a80b4fc0 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27ad124640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f27a8160f50 con 0x7f27a80cdf10 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80b5d20 0x7f27a80cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80b5d20 0x7f27a80cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51994/0 (socket says 172.21.15.104:51994) 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 -- 172.21.15.104:0/191246266 learned_addr learned my addr 172.21.15.104:0/191246266 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27a759e640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27a80cdf10 0x7f27a80cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27a6d9d640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a80b4fc0 0x7f27a8150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 -- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27a80cdf10 msgr2=0x7f27a80cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27a80cdf10 0x7f27a80cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 -- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a80b4fc0 msgr2=0x7f27a8150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a80b4fc0 0x7f27a8150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 -- 172.21.15.104:0/191246266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a80b3060 con 0x7f27a80b5d20 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27a759e640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27a80cdf10 0x7f27a80cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27a6d9d640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a80b4fc0 0x7f27a8150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279e59c640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80b5d20 0x7f27a80cbda0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2790034040 tx=0x7f2790003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279ffff640 1 -- 172.21.15.104:0/191246266 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279003e030 con 0x7f27a80b5d20 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279ffff640 1 -- 172.21.15.104:0/191246266 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2790003e00 con 0x7f27a80b5d20 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f279ffff640 1 -- 172.21.15.104:0/191246266 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790035040 con 0x7f27a80b5d20 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a80afd80 con 0x7f27a80b5d20 2024-09-17T02:56:26.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.954+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a80b0340 con 0x7f27a80b5d20 2024-09-17T02:56:26.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.956+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a80cfa80 con 0x7f27a80b5d20 2024-09-17T02:56:26.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.956+0000 7f279ffff640 1 -- 172.21.15.104:0/191246266 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2790041030 con 0x7f27a80b5d20 2024-09-17T02:56:26.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.956+0000 7f279ffff640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2788078bc0 0x7f278807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:26.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.957+0000 7f279ffff640 1 -- 172.21.15.104:0/191246266 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7f27900bb4d0 con 0x7f27a80b5d20 2024-09-17T02:56:26.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.957+0000 7f27a6d9d640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2788078bc0 0x7f278807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:26.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.957+0000 7f27a6d9d640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2788078bc0 0x7f278807b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2798000f60 tx=0x7f2798009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:26.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:26.961+0000 7f279ffff640 1 -- 172.21.15.104:0/191246266 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2790083910 con 0x7f27a80b5d20 2024-09-17T02:56:27.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.168+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27a80cead0 con 0x7f27a80b5d20 2024-09-17T02:56:27.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.168+0000 7f279ffff640 1 -- 172.21.15.104:0/191246266 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7f27900b9e20 con 0x7f27a80b5d20 2024-09-17T02:56:27.168 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:27.168 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:56:27.168 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:56:27.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.170+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2788078bc0 msgr2=0x7f278807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.170+0000 7f27ad124640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2788078bc0 0x7f278807b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2798000f60 tx=0x7f2798009040 comp rx=0 tx=0).stop 2024-09-17T02:56:27.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.170+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80b5d20 msgr2=0x7f27a80cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.170+0000 7f27ad124640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80b5d20 0x7f27a80cbda0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2790034040 tx=0x7f2790003910 comp rx=0 tx=0).stop 2024-09-17T02:56:27.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.171+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 shutdown_connections 2024-09-17T02:56:27.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.171+0000 7f27ad124640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2788078bc0 0x7f278807b0d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.171+0000 7f27ad124640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27a80cdf10 0x7f27a80cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.171+0000 7f27ad124640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27a80b5d20 0x7f27a80cbda0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.171+0000 7f27ad124640 1 --2- 172.21.15.104:0/191246266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27a80b4fc0 0x7f27a8150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.171+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 >> 172.21.15.104:0/191246266 conn(0x7f27a80b44a0 msgr2=0x7f27a8071ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:27.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.171+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 shutdown_connections 2024-09-17T02:56:27.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.171+0000 7f27ad124640 1 -- 172.21.15.104:0/191246266 wait complete. 2024-09-17T02:56:27.182 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:27.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.294+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/349287470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf38071150 msgr2=0x7fbf38069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.294+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/349287470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf38071150 0x7fbf38069240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbf30005fd0 tx=0x7fbf3002a8a0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.294+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/349287470 shutdown_connections 2024-09-17T02:56:27.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.294+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/349287470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf38071150 0x7fbf38069240 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.294+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/349287470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf3815d3b0 0x7fbf38068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.294+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/349287470 >> 172.21.15.104:0/349287470 conn(0x7fbf380b3640 msgr2=0x7fbf380b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:27.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.294+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/349287470 shutdown_connections 2024-09-17T02:56:27.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.294+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/349287470 wait complete. 2024-09-17T02:56:27.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.296+0000 7fbf3ffb0640 1 Processor -- start 2024-09-17T02:56:27.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.296+0000 7fbf3ffb0640 1 -- start start 2024-09-17T02:56:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3ffb0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf3806f540 0x7fbf381f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3ffb0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf38071150 0x7fbf381f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3ffb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf3815d3b0 0x7fbf38158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3ffb0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf380d0e70 con 0x7fbf3815d3b0 2024-09-17T02:56:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3ffb0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbf380d0cf0 con 0x7fbf38071150 2024-09-17T02:56:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3ffb0640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbf380d0ff0 con 0x7fbf3806f540 2024-09-17T02:56:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3e54d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf3815d3b0 0x7fbf38158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3e54d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf3815d3b0 0x7fbf38158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52012/0 (socket says 172.21.15.104:52012) 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.297+0000 7fbf3e54d640 1 -- 172.21.15.104:0/1138190802 learned_addr learned my addr 172.21.15.104:0/1138190802 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3dd4c640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf3806f540 0x7fbf381f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3d54b640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf38071150 0x7fbf381f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3e54d640 1 -- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf3806f540 msgr2=0x7fbf381f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3e54d640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf3806f540 0x7fbf381f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3e54d640 1 -- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf38071150 msgr2=0x7fbf381f7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3e54d640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf38071150 0x7fbf381f7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3e54d640 1 -- 172.21.15.104:0/1138190802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf380afa20 con 0x7fbf3815d3b0 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3dd4c640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf3806f540 0x7fbf381f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3d54b640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf38071150 0x7fbf381f7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3e54d640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf3815d3b0 0x7fbf38158c60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009b30 tx=0x7fbf30032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf2e7fc640 1 -- 172.21.15.104:0/1138190802 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30041070 con 0x7fbf3815d3b0 2024-09-17T02:56:27.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf2e7fc640 1 -- 172.21.15.104:0/1138190802 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf30004450 con 0x7fbf3815d3b0 2024-09-17T02:56:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf380afd00 con 0x7fbf3815d3b0 2024-09-17T02:56:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf2e7fc640 1 -- 172.21.15.104:0/1138190802 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30031430 con 0x7fbf3815d3b0 2024-09-17T02:56:27.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.298+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf380b02c0 con 0x7fbf3815d3b0 2024-09-17T02:56:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.299+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf380d14a0 con 0x7fbf3815d3b0 2024-09-17T02:56:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.300+0000 7fbf2e7fc640 1 -- 172.21.15.104:0/1138190802 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf30044070 con 0x7fbf3815d3b0 2024-09-17T02:56:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.300+0000 7fbf2e7fc640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf1c078b90 0x7fbf1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.300+0000 7fbf2e7fc640 1 -- 172.21.15.104:0/1138190802 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7fbf3002e020 con 0x7fbf3815d3b0 2024-09-17T02:56:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.301+0000 7fbf3dd4c640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf1c078b90 0x7fbf1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.301+0000 7fbf3dd4c640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf1c078b90 0x7fbf1c07b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf340016a0 tx=0x7fbf34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:27.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.305+0000 7fbf2e7fc640 1 -- 172.21.15.104:0/1138190802 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf3004b030 con 0x7fbf3815d3b0 2024-09-17T02:56:27.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.512+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf380b4340 con 0x7fbf3815d3b0 2024-09-17T02:56:27.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.513+0000 7fbf2e7fc640 1 -- 172.21.15.104:0/1138190802 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5232 (secure 0 0 0) 0x7fbf30083d30 con 0x7fbf3815d3b0 2024-09-17T02:56:27.513 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:27.513 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":20,"btime":"2024-09-17T02:55:57:657154+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:55:55.006646+0000","modified":"2024-09-17T02:55:57.007898+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4212438108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":4212438108},{"type":"v1","addr":"172.21.15.104:6835","nonce":4212438108}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5304,"qdb_cluster":[5304]},"id":3}]} 2024-09-17T02:56:27.513 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 20 2024-09-17T02:56:27.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf1c078b90 msgr2=0x7fbf1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf1c078b90 0x7fbf1c07b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf340016a0 tx=0x7fbf34009040 comp rx=0 tx=0).stop 2024-09-17T02:56:27.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf3815d3b0 msgr2=0x7fbf38158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf3815d3b0 0x7fbf38158c60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009b30 tx=0x7fbf30032d30 comp rx=0 tx=0).stop 2024-09-17T02:56:27.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 shutdown_connections 2024-09-17T02:56:27.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbf1c078b90 0x7fbf1c07b0a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf38071150 0x7fbf381f7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbf3815d3b0 0x7fbf38158c60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 --2- 172.21.15.104:0/1138190802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf3806f540 0x7fbf381f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 >> 172.21.15.104:0/1138190802 conn(0x7fbf380b3640 msgr2=0x7fbf38075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:27.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 shutdown_connections 2024-09-17T02:56:27.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.515+0000 7fbf3ffb0640 1 -- 172.21.15.104:0/1138190802 wait complete. 2024-09-17T02:56:27.526 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:56:27.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.637+0000 7f79a2969640 1 -- 172.21.15.104:0/1221928665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 msgr2=0x7f799c0b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.637+0000 7f79a2969640 1 --2- 172.21.15.104:0/1221928665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 0x7f799c0b6ae0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7990005fd0 tx=0x7f799002a5d0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.638+0000 7f79a2969640 1 -- 172.21.15.104:0/1221928665 shutdown_connections 2024-09-17T02:56:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.638+0000 7f79a2969640 1 --2- 172.21.15.104:0/1221928665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 0x7f799c0b6ae0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.638+0000 7f79a2969640 1 --2- 172.21.15.104:0/1221928665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799c162cb0 0x7f799c0b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.638+0000 7f79a2969640 1 -- 172.21.15.104:0/1221928665 >> 172.21.15.104:0/1221928665 conn(0x7f799c069120 msgr2=0x7f799c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.638+0000 7f79a2969640 1 -- 172.21.15.104:0/1221928665 shutdown_connections 2024-09-17T02:56:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.638+0000 7f79a2969640 1 -- 172.21.15.104:0/1221928665 wait complete. 2024-09-17T02:56:27.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.639+0000 7f79a2969640 1 Processor -- start 2024-09-17T02:56:27.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.640+0000 7f79a2969640 1 -- start start 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a2969640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f799c1611d0 0x7f799c0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a2969640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799c162cb0 0x7f799c151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a2969640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 0x7f799c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a2969640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f799c161cf0 con 0x7f799c1630c0 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a2969640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f799c1605e0 con 0x7f799c1611d0 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a2969640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f799c161e70 con 0x7f799c162cb0 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f799b7fe640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799c162cb0 0x7f799c151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f799bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f799c1611d0 0x7f799c0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f799bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f799c1611d0 0x7f799c0c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:45660/0 (socket says 172.21.15.104:45660) 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f799b7fe640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799c162cb0 0x7f799c151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:53384/0 (socket says 172.21.15.104:53384) 2024-09-17T02:56:27.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a0f06640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 0x7f799c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f799bfff640 1 -- 172.21.15.104:0/2229511760 learned_addr learned my addr 172.21.15.104:0/2229511760 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a0f06640 1 -- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799c162cb0 msgr2=0x7f799c151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a0f06640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799c162cb0 0x7f799c151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a0f06640 1 -- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f799c1611d0 msgr2=0x7f799c0c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a0f06640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f799c1611d0 0x7f799c0c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.641+0000 7f79a0f06640 1 -- 172.21.15.104:0/2229511760 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c1523d0 con 0x7f799c1630c0 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.642+0000 7f79a0f06640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 0x7f799c0ce150 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f799400c700 tx=0x7f799400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.642+0000 7f7998ff9640 1 -- 172.21.15.104:0/2229511760 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994003b70 con 0x7f799c1630c0 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.642+0000 7f7998ff9640 1 -- 172.21.15.104:0/2229511760 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7994003d10 con 0x7f799c1630c0 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.642+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799c0c8d90 con 0x7f799c1630c0 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.642+0000 7f7998ff9640 1 -- 172.21.15.104:0/2229511760 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994005330 con 0x7f799c1630c0 2024-09-17T02:56:27.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.642+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f799c0c9350 con 0x7f799c1630c0 2024-09-17T02:56:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.643+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799c162320 con 0x7f799c1630c0 2024-09-17T02:56:27.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.643+0000 7f7998ff9640 1 -- 172.21.15.104:0/2229511760 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79940054d0 con 0x7f799c1630c0 2024-09-17T02:56:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.644+0000 7f7998ff9640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7988078bc0 0x7f798807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.644+0000 7f7998ff9640 1 -- 172.21.15.104:0/2229511760 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5709+0+0 (secure 0 0 0) 0x7f799409a910 con 0x7f799c1630c0 2024-09-17T02:56:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.644+0000 7f799bfff640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7988078bc0 0x7f798807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.645+0000 7f799bfff640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7988078bc0 0x7f798807b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f798c009be0 tx=0x7f798c005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:27.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.648+0000 7f7998ff9640 1 -- 172.21.15.104:0/2229511760 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7994062700 con 0x7f799c1630c0 2024-09-17T02:56:27.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.825+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f799c15e550 con 0x7f799c1630c0 2024-09-17T02:56:27.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.826+0000 7f7998ff9640 1 -- 172.21.15.104:0/2229511760 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16721 (secure 0 0 0) 0x7f7994067130 con 0x7f799c1630c0 2024-09-17T02:56:27.826 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:27.826 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":54,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:56:22.851658+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:55:52.652619+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T02:55:53.964016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:56:27.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7988078bc0 msgr2=0x7f798807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7988078bc0 0x7f798807b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f798c009be0 tx=0x7f798c005f30 comp rx=0 tx=0).stop 2024-09-17T02:56:27.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 msgr2=0x7f799c0ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 0x7f799c0ce150 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f799400c700 tx=0x7f799400cbc0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 shutdown_connections 2024-09-17T02:56:27.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7988078bc0 0x7f798807b0d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f799c1630c0 0x7f799c0ce150 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f799c162cb0 0x7f799c151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 --2- 172.21.15.104:0/2229511760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f799c1611d0 0x7f799c0c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 >> 172.21.15.104:0/2229511760 conn(0x7f799c069120 msgr2=0x7f799c0b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:27.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 shutdown_connections 2024-09-17T02:56:27.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.828+0000 7f79a2969640 1 -- 172.21.15.104:0/2229511760 wait complete. 2024-09-17T02:56:27.839 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T02:56:27.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.955+0000 7f50d55b0640 1 -- 172.21.15.104:0/450982641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 msgr2=0x7f50bc00ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.955+0000 7f50d55b0640 1 --2- 172.21.15.104:0/450982641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 0x7f50bc00ba50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006fa0 tx=0x7f50bc005830 comp rx=0 tx=0).stop 2024-09-17T02:56:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.956+0000 7f50d55b0640 1 -- 172.21.15.104:0/450982641 shutdown_connections 2024-09-17T02:56:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.956+0000 7f50d55b0640 1 --2- 172.21.15.104:0/450982641 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 0x7f50bc00ba50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.956+0000 7f50d55b0640 1 -- 172.21.15.104:0/450982641 >> 172.21.15.104:0/450982641 conn(0x7f50d00d28a0 msgr2=0x7f50d00d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.956+0000 7f50d55b0640 1 -- 172.21.15.104:0/450982641 shutdown_connections 2024-09-17T02:56:27.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.956+0000 7f50d55b0640 1 -- 172.21.15.104:0/450982641 wait complete. 2024-09-17T02:56:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.957+0000 7f50d55b0640 1 Processor -- start 2024-09-17T02:56:27.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.958+0000 7f50d55b0640 1 -- start start 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50d55b0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 0x7f50d00b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50d55b0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50d00af610 0x7f50d01f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50d55b0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50d01e8af0 0x7f50d01e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50d55b0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00d0cc0 con 0x7f50bc0053a0 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50d55b0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f50d00d0b40 con 0x7f50d01e8af0 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50d55b0640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f50d00d0e40 con 0x7f50d00af610 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 0x7f50d00b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 0x7f50d00b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52060/0 (socket says 172.21.15.104:52060) 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 -- 172.21.15.104:0/2675681646 learned_addr learned my addr 172.21.15.104:0/2675681646 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ce7fc640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50d00af610 0x7f50d01f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 -- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50d00af610 msgr2=0x7f50d01f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50cf7fe640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50d01e8af0 0x7f50d01e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50d00af610 0x7f50d01f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 -- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50d01e8af0 msgr2=0x7f50d01e8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50d01e8af0 0x7f50d01e8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 -- 172.21.15.104:0/2675681646 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d01e9440 con 0x7f50bc0053a0 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ce7fc640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50d00af610 0x7f50d01f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50cf7fe640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50d01e8af0 0x7f50d01e8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50ceffd640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 0x7f50d00b26c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009fd0 tx=0x7f50c000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.959+0000 7f50c77fe640 1 -- 172.21.15.104:0/2675681646 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c001f070 con 0x7f50bc0053a0 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.960+0000 7f50c77fe640 1 -- 172.21.15.104:0/2675681646 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50c0012740 con 0x7f50bc0053a0 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.960+0000 7f50c77fe640 1 -- 172.21.15.104:0/2675681646 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c0012b50 con 0x7f50bc0053a0 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.960+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d01e0c10 con 0x7f50bc0053a0 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.960+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d01e1c00 con 0x7f50bc0053a0 2024-09-17T02:56:27.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.960+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d00ce9e0 con 0x7f50bc0053a0 2024-09-17T02:56:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.961+0000 7f50c77fe640 1 -- 172.21.15.104:0/2675681646 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50c0022070 con 0x7f50bc0053a0 2024-09-17T02:56:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.962+0000 7f50c77fe640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f50b0078b90 0x7f50b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.962+0000 7f50c77fe640 1 -- 172.21.15.104:0/2675681646 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5767+0+0 (secure 0 0 0) 0x7f50c009bee0 con 0x7f50bc0053a0 2024-09-17T02:56:27.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.962+0000 7f50ce7fc640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f50b0078b90 0x7f50b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:27.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.963+0000 7f50ce7fc640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f50b0078b90 0x7f50b007b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50d00b2dc0 tx=0x7f50b8006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:27.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:27.966+0000 7f50c77fe640 1 -- 172.21.15.104:0/2675681646 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50d01e9440 con 0x7f50bc0053a0 2024-09-17T02:56:28.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.175+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f50d0070fa0 con 0x7f50bc0053a0 2024-09-17T02:56:28.175 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:56:28.175+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T02:56:28.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.179+0000 7f50c77fe640 1 -- 172.21.15.104:0/2675681646 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7f50c0064370 con 0x7f50bc0053a0 2024-09-17T02:56:28.178 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f50b0078b90 msgr2=0x7f50b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f50b0078b90 0x7f50b007b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50d00b2dc0 tx=0x7f50b8006b70 comp rx=0 tx=0).stop 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 msgr2=0x7f50d00b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 0x7f50d00b26c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009fd0 tx=0x7f50c000f730 comp rx=0 tx=0).stop 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 shutdown_connections 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f50b0078b90 0x7f50b007b0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50d01e8af0 0x7f50d01e8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f50d00af610 0x7f50d01f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 --2- 172.21.15.104:0/2675681646 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f50bc0053a0 0x7f50d00b26c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 >> 172.21.15.104:0/2675681646 conn(0x7f50d00d28a0 msgr2=0x7f50d01df300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:28.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 shutdown_connections 2024-09-17T02:56:28.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.182+0000 7f50d55b0640 1 -- 172.21.15.104:0/2675681646 wait complete. 2024-09-17T02:56:28.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T02:56:28.248 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:56:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.313+0000 7f1b68920640 1 -- 172.21.15.104:0/1626287437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b640cdf10 msgr2=0x7f1b640b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:28.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.313+0000 7f1b68920640 1 --2- 172.21.15.104:0/1626287437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b640cdf10 0x7f1b640b57e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c005fd0 tx=0x7f1b4c02a5d0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.313+0000 7f1b68920640 1 -- 172.21.15.104:0/1626287437 shutdown_connections 2024-09-17T02:56:28.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.313+0000 7f1b68920640 1 --2- 172.21.15.104:0/1626287437 >> v2:172.21.15.192:3300/0 conn(0x7f1b640b5d20 0x7f1b640cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.313+0000 7f1b68920640 1 --2- 172.21.15.104:0/1626287437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b640cdf10 0x7f1b640b57e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.313+0000 7f1b68920640 1 -- 172.21.15.104:0/1626287437 >> 172.21.15.104:0/1626287437 conn(0x7f1b640b44a0 msgr2=0x7f1b640b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:28.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.313+0000 7f1b68920640 1 -- 172.21.15.104:0/1626287437 shutdown_connections 2024-09-17T02:56:28.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.314+0000 7f1b68920640 1 -- 172.21.15.104:0/1626287437 wait complete. 2024-09-17T02:56:28.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.315+0000 7f1b68920640 1 Processor -- start 2024-09-17T02:56:28.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.315+0000 7f1b68920640 1 -- start start 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b68920640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b640b4fc0 0x7f1b641f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b68920640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b640b5d20 0x7f1b64160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b68920640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b640cdf10 0x7f1b6414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b68920640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1b64160f50 con 0x7f1b640cdf10 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b68920640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1b640d0210 con 0x7f1b640b4fc0 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b68920640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1b641610d0 con 0x7f1b640b5d20 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b640cdf10 0x7f1b6414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b640cdf10 0x7f1b6414fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52080/0 (socket says 172.21.15.104:52080) 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 -- 172.21.15.104:0/3230805954 learned_addr learned my addr 172.21.15.104:0/3230805954 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:28.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b61d9b640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b640b5d20 0x7f1b64160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b6259c640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b640b4fc0 0x7f1b641f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 -- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b640b5d20 msgr2=0x7f1b64160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b640b5d20 0x7f1b64160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 -- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b640b4fc0 msgr2=0x7f1b641f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b640b4fc0 0x7f1b641f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 -- 172.21.15.104:0/3230805954 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b64150300 con 0x7f1b640cdf10 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b62d9d640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b640cdf10 0x7f1b6414fdc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00ea10 tx=0x7f1b5c00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b5affd640 1 -- 172.21.15.104:0/3230805954 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00cde0 con 0x7f1b640cdf10 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b5affd640 1 -- 172.21.15.104:0/3230805954 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b5c004c10 con 0x7f1b640cdf10 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6415e560 con 0x7f1b640cdf10 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.317+0000 7f1b5affd640 1 -- 172.21.15.104:0/3230805954 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c005020 con 0x7f1b640cdf10 2024-09-17T02:56:28.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.318+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b641f4760 con 0x7f1b640cdf10 2024-09-17T02:56:28.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.318+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b640cfa80 con 0x7f1b640cdf10 2024-09-17T02:56:28.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.319+0000 7f1b5affd640 1 -- 172.21.15.104:0/3230805954 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b5c0051c0 con 0x7f1b640cdf10 2024-09-17T02:56:28.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.320+0000 7f1b5affd640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1b44078bc0 0x7f1b4407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:28.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.320+0000 7f1b5affd640 1 -- 172.21.15.104:0/3230805954 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5853+0+0 (secure 0 0 0) 0x7f1b5c09b9b0 con 0x7f1b640cdf10 2024-09-17T02:56:28.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.320+0000 7f1b6259c640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1b44078bc0 0x7f1b4407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:28.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.321+0000 7f1b6259c640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1b44078bc0 0x7f1b4407b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1b640ccf90 tx=0x7f1b54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:28.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.324+0000 7f1b5affd640 1 -- 172.21.15.104:0/3230805954 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1b5c0637a0 con 0x7f1b640cdf10 2024-09-17T02:56:28.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:28.531+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1b640cead0 con 0x7f1b640cdf10 2024-09-17T02:56:29.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.182+0000 7f1b5affd640 1 -- 172.21.15.104:0/3230805954 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7f1b5c0681d0 con 0x7f1b640cdf10 2024-09-17T02:56:29.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1b44078bc0 msgr2=0x7f1b4407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1b44078bc0 0x7f1b4407b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1b640ccf90 tx=0x7f1b54009040 comp rx=0 tx=0).stop 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b640cdf10 msgr2=0x7f1b6414fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b640cdf10 0x7f1b6414fdc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00ea10 tx=0x7f1b5c00eed0 comp rx=0 tx=0).stop 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 shutdown_connections 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1b44078bc0 0x7f1b4407b0d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1b640cdf10 0x7f1b6414fdc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b640b5d20 0x7f1b64160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 --2- 172.21.15.104:0/3230805954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b640b4fc0 0x7f1b641f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 >> 172.21.15.104:0/3230805954 conn(0x7f1b640b44a0 msgr2=0x7f1b640b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 shutdown_connections 2024-09-17T02:56:29.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.185+0000 7f1b68920640 1 -- 172.21.15.104:0/3230805954 wait complete. 2024-09-17T02:56:29.197 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T02:56:29.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.316+0000 7f81b98f9640 1 -- 172.21.15.104:0/411321359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f819c003a50 msgr2=0x7f819c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:29.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.316+0000 7f81b98f9640 1 --2- 172.21.15.104:0/411321359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f819c003a50 0x7f819c003ec0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f81a8006fd0 tx=0x7f819c005830 comp rx=0 tx=0).stop 2024-09-17T02:56:29.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.316+0000 7f81b98f9640 1 -- 172.21.15.104:0/411321359 shutdown_connections 2024-09-17T02:56:29.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.316+0000 7f81b98f9640 1 --2- 172.21.15.104:0/411321359 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f819c003a50 0x7f819c003ec0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:29.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.316+0000 7f81b98f9640 1 -- 172.21.15.104:0/411321359 >> 172.21.15.104:0/411321359 conn(0x7f81b4069120 msgr2=0x7f81b4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:29.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.316+0000 7f81b98f9640 1 -- 172.21.15.104:0/411321359 shutdown_connections 2024-09-17T02:56:29.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.316+0000 7f81b98f9640 1 -- 172.21.15.104:0/411321359 wait complete. 2024-09-17T02:56:29.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.318+0000 7f81b98f9640 1 Processor -- start 2024-09-17T02:56:29.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.318+0000 7f81b98f9640 1 -- start start 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b98f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f819c003a50 0x7f81b40ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b98f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81b40ad130 0x7f81b41eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b98f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81b41eafc0 0x7f81b41f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b98f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f81b40b4030 con 0x7f81b40ad130 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b98f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f81b4162870 con 0x7f81b41eafc0 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b98f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f81b40b41b0 con 0x7f819c003a50 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81b40ad130 0x7f81b41eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81b40ad130 0x7f81b41eaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52096/0 (socket says 172.21.15.104:52096) 2024-09-17T02:56:29.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b27fc640 1 -- 172.21.15.104:0/2512609014 learned_addr learned my addr 172.21.15.104:0/2512609014 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b37fe640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81b41eafc0 0x7f81b41f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.319+0000 7f81b2ffd640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f819c003a50 0x7f81b40ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f81b27fc640 1 -- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f819c003a50 msgr2=0x7f81b40ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f81b27fc640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f819c003a50 0x7f81b40ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f81b27fc640 1 -- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81b41eafc0 msgr2=0x7f81b41f8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f81b27fc640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81b41eafc0 0x7f81b41f8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f81b27fc640 1 -- 172.21.15.104:0/2512609014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b41eb3d0 con 0x7f81b40ad130 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f81b27fc640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81b40ad130 0x7f81b41eaa80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f81a4003e90 tx=0x7f81a4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f819bfff640 1 -- 172.21.15.104:0/2512609014 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4015070 con 0x7f81b40ad130 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f819bfff640 1 -- 172.21.15.104:0/2512609014 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81a4011840 con 0x7f81b40ad130 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b40aba50 con 0x7f81b40ad130 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f819bfff640 1 -- 172.21.15.104:0/2512609014 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4011c90 con 0x7f81b40ad130 2024-09-17T02:56:29.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.320+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b40ac240 con 0x7f81b40ad130 2024-09-17T02:56:29.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.321+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b40abcd0 con 0x7f81b40ad130 2024-09-17T02:56:29.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.322+0000 7f819bfff640 1 -- 172.21.15.104:0/2512609014 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f81a4018070 con 0x7f81b40ad130 2024-09-17T02:56:29.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.322+0000 7f819bfff640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f81a0078b90 0x7f81a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:29.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.322+0000 7f819bfff640 1 -- 172.21.15.104:0/2512609014 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5853+0+0 (secure 0 0 0) 0x7f81a409b960 con 0x7f81b40ad130 2024-09-17T02:56:29.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.322+0000 7f81b2ffd640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f81a0078b90 0x7f81a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:29.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.323+0000 7f81b2ffd640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f81a0078b90 0x7f81a007b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f81a8033000 tx=0x7f81a8038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:29.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.326+0000 7f819bfff640 1 -- 172.21.15.104:0/2512609014 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f81b41eb3d0 con 0x7f81b40ad130 2024-09-17T02:56:29.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:29.499+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81b40d1c20 con 0x7f81b40ad130 2024-09-17T02:56:30.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.187+0000 7f819bfff640 1 -- 172.21.15.104:0/2512609014 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) ==== 181+0+0 (secure 0 0 0) 0x7f81a40636c0 con 0x7f81b40ad130 2024-09-17T02:56:30.187 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f81a0078b90 msgr2=0x7f81a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f81a0078b90 0x7f81a007b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f81a8033000 tx=0x7f81a8038040 comp rx=0 tx=0).stop 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81b40ad130 msgr2=0x7f81b41eaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81b40ad130 0x7f81b41eaa80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f81a4003e90 tx=0x7f81a4001630 comp rx=0 tx=0).stop 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 shutdown_connections 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f81a0078b90 0x7f81a007b0a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81b41eafc0 0x7f81b41f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81b40ad130 0x7f81b41eaa80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 --2- 172.21.15.104:0/2512609014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f819c003a50 0x7f81b40ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 >> 172.21.15.104:0/2512609014 conn(0x7f81b4069120 msgr2=0x7f81b4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:30.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 shutdown_connections 2024-09-17T02:56:30.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.190+0000 7f81b98f9640 1 -- 172.21.15.104:0/2512609014 wait complete. 2024-09-17T02:56:30.203 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T02:56:30.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.322+0000 7fca01d89640 1 -- 172.21.15.104:0/928178003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc0d2390 msgr2=0x7fc9fc1561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:30.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.322+0000 7fca01d89640 1 --2- 172.21.15.104:0/928178003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc0d2390 0x7fc9fc1561a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0005fd0 tx=0x7fc9f002a5d0 comp rx=0 tx=0).stop 2024-09-17T02:56:30.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.323+0000 7fca01d89640 1 -- 172.21.15.104:0/928178003 shutdown_connections 2024-09-17T02:56:30.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.323+0000 7fca01d89640 1 --2- 172.21.15.104:0/928178003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc0d2390 0x7fc9fc1561a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:30.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.323+0000 7fca01d89640 1 -- 172.21.15.104:0/928178003 >> 172.21.15.104:0/928178003 conn(0x7fc9fc068ee0 msgr2=0x7fc9fc0692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:30.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.323+0000 7fca01d89640 1 -- 172.21.15.104:0/928178003 shutdown_connections 2024-09-17T02:56:30.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.323+0000 7fca01d89640 1 -- 172.21.15.104:0/928178003 wait complete. 2024-09-17T02:56:30.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.324+0000 7fca01d89640 1 Processor -- start 2024-09-17T02:56:30.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.325+0000 7fca01d89640 1 -- start start 2024-09-17T02:56:30.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fca01d89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc155d90 0x7fc9fc154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:30.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fca01d89640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9fc15f7f0 0x7fc9fc154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:30.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fca01d89640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9fc1f64b0 0x7fc9fc1f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:30.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fca01d89640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc070f50 con 0x7fc9fc155d90 2024-09-17T02:56:30.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fca01d89640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc070dd0 con 0x7fc9fc15f7f0 2024-09-17T02:56:30.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fca01d89640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc9fc0710d0 con 0x7fc9fc1f64b0 2024-09-17T02:56:30.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc155d90 0x7fc9fc154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:30.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc155d90 0x7fc9fc154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52120/0 (socket says 172.21.15.104:52120) 2024-09-17T02:56:30.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 -- 172.21.15.104:0/977329039 learned_addr learned my addr 172.21.15.104:0/977329039 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:30.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 -- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9fc1f64b0 msgr2=0x7fc9fc1f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:30.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9fc1f64b0 0x7fc9fc1f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:30.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 -- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9fc15f7f0 msgr2=0x7fc9fc154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:30.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9faffd640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9fc15f7f0 0x7fc9fc154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:30.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9fc15f7f0 0x7fc9fc154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:30.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 -- 172.21.15.104:0/977329039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc0b2fc0 con 0x7fc9fc155d90 2024-09-17T02:56:30.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9faffd640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9fc15f7f0 0x7fc9fc154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:30.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.326+0000 7fc9fb7fe640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc155d90 0x7fc9fc154050 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00c390 tx=0x7fc9ec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:30.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.327+0000 7fc9e3fff640 1 -- 172.21.15.104:0/977329039 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec017070 con 0x7fc9fc155d90 2024-09-17T02:56:30.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.327+0000 7fc9e3fff640 1 -- 172.21.15.104:0/977329039 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9ec0035f0 con 0x7fc9fc155d90 2024-09-17T02:56:30.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.327+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc1f59d0 con 0x7fc9fc155d90 2024-09-17T02:56:30.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.327+0000 7fc9e3fff640 1 -- 172.21.15.104:0/977329039 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec003a20 con 0x7fc9fc155d90 2024-09-17T02:56:30.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.327+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc1f5f90 con 0x7fc9fc155d90 2024-09-17T02:56:30.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.328+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9fc1561a0 con 0x7fc9fc155d90 2024-09-17T02:56:30.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.328+0000 7fc9e3fff640 1 -- 172.21.15.104:0/977329039 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9ec01a070 con 0x7fc9fc155d90 2024-09-17T02:56:30.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.329+0000 7fc9e3fff640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9e8078b90 0x7fc9e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:30.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.329+0000 7fc9e3fff640 1 -- 172.21.15.104:0/977329039 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5415+0+0 (secure 0 0 0) 0x7fc9ec099eb0 con 0x7fc9fc155d90 2024-09-17T02:56:30.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.329+0000 7fc9faffd640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9e8078b90 0x7fc9e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:30.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.330+0000 7fc9faffd640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9e8078b90 0x7fc9e807b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0033000 tx=0x7fc9f0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:30.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.334+0000 7fc9e3fff640 1 -- 172.21.15.104:0/977329039 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9ec062410 con 0x7fc9fc155d90 2024-09-17T02:56:30.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:30.510+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9fc0b32a0 con 0x7fc9fc155d90 2024-09-17T02:56:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.188+0000 7fc9e3fff640 1 -- 172.21.15.104:0/977329039 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) ==== 169+0+0 (secure 0 0 0) 0x7fc9ec061d10 con 0x7fc9fc155d90 2024-09-17T02:56:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9e8078b90 msgr2=0x7fc9e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9e8078b90 0x7fc9e807b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0033000 tx=0x7fc9f0004730 comp rx=0 tx=0).stop 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc155d90 msgr2=0x7fc9fc154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc155d90 0x7fc9fc154050 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec00c390 tx=0x7fc9ec00c850 comp rx=0 tx=0).stop 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 shutdown_connections 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc9e8078b90 0x7fc9e807b0a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9fc15f7f0 0x7fc9fc154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9fc1f64b0 0x7fc9fc1f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 --2- 172.21.15.104:0/977329039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9fc155d90 0x7fc9fc154050 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 >> 172.21.15.104:0/977329039 conn(0x7fc9fc068ee0 msgr2=0x7fc9fc15d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 shutdown_connections 2024-09-17T02:56:31.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.191+0000 7fca01d89640 1 -- 172.21.15.104:0/977329039 wait complete. 2024-09-17T02:56:31.203 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T02:56:31.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.320+0000 7f46d6f69640 1 -- 172.21.15.104:0/3379912429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d0073c90 msgr2=0x7f46d00b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.320+0000 7f46d6f69640 1 --2- 172.21.15.104:0/3379912429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d0073c90 0x7f46d00b4ce0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f46b8005fd0 tx=0x7f46b802a5d0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.321+0000 7f46d6f69640 1 -- 172.21.15.104:0/3379912429 shutdown_connections 2024-09-17T02:56:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.321+0000 7f46d6f69640 1 --2- 172.21.15.104:0/3379912429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d0073c90 0x7f46d00b4ce0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.321+0000 7f46d6f69640 1 --2- 172.21.15.104:0/3379912429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d0152ce0 0x7f46d006f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.321+0000 7f46d6f69640 1 -- 172.21.15.104:0/3379912429 >> 172.21.15.104:0/3379912429 conn(0x7f46d00b3640 msgr2=0x7f46d00b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.321+0000 7f46d6f69640 1 -- 172.21.15.104:0/3379912429 shutdown_connections 2024-09-17T02:56:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.321+0000 7f46d6f69640 1 -- 172.21.15.104:0/3379912429 wait complete. 2024-09-17T02:56:31.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.322+0000 7f46d6f69640 1 Processor -- start 2024-09-17T02:56:31.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.322+0000 7f46d6f69640 1 -- start start 2024-09-17T02:56:31.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46d6f69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d006fa80 0x7f46d015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:31.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46d6f69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d0152ce0 0x7f46d01f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:31.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46d6f69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d01f7200 0x7f46d00cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:31.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46d6f69640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00b5880 con 0x7f46d0152ce0 2024-09-17T02:56:31.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46d6f69640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00b5700 con 0x7f46d006fa80 2024-09-17T02:56:31.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46d6f69640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f46d00b5a00 con 0x7f46d01f7200 2024-09-17T02:56:31.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d0152ce0 0x7f46d01f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:31.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d0152ce0 0x7f46d01f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52126/0 (socket says 172.21.15.104:52126) 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 -- 172.21.15.104:0/4228628839 learned_addr learned my addr 172.21.15.104:0/4228628839 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46d5506640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d01f7200 0x7f46d00cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46d4d05640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d006fa80 0x7f46d015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 -- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d01f7200 msgr2=0x7f46d00cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d01f7200 0x7f46d00cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 -- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d006fa80 msgr2=0x7f46d015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d006fa80 0x7f46d015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 -- 172.21.15.104:0/4228628839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d01f7610 con 0x7f46d0152ce0 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.324+0000 7f46cffff640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d0152ce0 0x7f46d01f6cc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c340 tx=0x7f46c000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.325+0000 7f46cd7fa640 1 -- 172.21.15.104:0/4228628839 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0017070 con 0x7f46d0152ce0 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.325+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d01569b0 con 0x7f46d0152ce0 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.325+0000 7f46cd7fa640 1 -- 172.21.15.104:0/4228628839 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46c00053c0 con 0x7f46d0152ce0 2024-09-17T02:56:31.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.325+0000 7f46cd7fa640 1 -- 172.21.15.104:0/4228628839 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0003850 con 0x7f46d0152ce0 2024-09-17T02:56:31.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.325+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d0156f70 con 0x7f46d0152ce0 2024-09-17T02:56:31.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.326+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d0156740 con 0x7f46d0152ce0 2024-09-17T02:56:31.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.326+0000 7f46cd7fa640 1 -- 172.21.15.104:0/4228628839 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46c001a070 con 0x7f46d0152ce0 2024-09-17T02:56:31.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.327+0000 7f46cd7fa640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b0078b90 0x7f46b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:31.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.327+0000 7f46cd7fa640 1 -- 172.21.15.104:0/4228628839 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7f46c0099c20 con 0x7f46d0152ce0 2024-09-17T02:56:31.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.327+0000 7f46d4d05640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b0078b90 0x7f46b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:31.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.328+0000 7f46d4d05640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b0078b90 0x7f46b007b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f46c80099a0 tx=0x7f46c8009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:31.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.331+0000 7f46cd7fa640 1 -- 172.21.15.104:0/4228628839 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46d01f7610 con 0x7f46d0152ce0 2024-09-17T02:56:31.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.507+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f46d00b5f20 con 0x7f46d0152ce0 2024-09-17T02:56:31.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.510+0000 7f46cd7fa640 1 -- 172.21.15.104:0/4228628839 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v27) ==== 71+0+0 (secure 0 0 0) 0x7f46c0061db0 con 0x7f46d0152ce0 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b0078b90 msgr2=0x7f46b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b0078b90 0x7f46b007b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f46c80099a0 tx=0x7f46c8009500 comp rx=0 tx=0).stop 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d0152ce0 msgr2=0x7f46d01f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d0152ce0 0x7f46d01f6cc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c340 tx=0x7f46c000c800 comp rx=0 tx=0).stop 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 shutdown_connections 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f46b0078b90 0x7f46b007b0a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46d01f7200 0x7f46d00cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f46d0152ce0 0x7f46d01f6cc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 --2- 172.21.15.104:0/4228628839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d006fa80 0x7f46d015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 >> 172.21.15.104:0/4228628839 conn(0x7f46d00b3640 msgr2=0x7f46d00b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 shutdown_connections 2024-09-17T02:56:31.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.513+0000 7f46d6f69640 1 -- 172.21.15.104:0/4228628839 wait complete. 2024-09-17T02:56:31.523 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-17T02:56:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.637+0000 7fd7efede640 1 -- 172.21.15.104:0/2852276516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7e80b7bb0 msgr2=0x7fd7e80cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.637+0000 7fd7efede640 1 --2- 172.21.15.104:0/2852276516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7e80b7bb0 0x7fd7e80cde90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009820 tx=0x7fd7e402a3f0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.637+0000 7fd7efede640 1 -- 172.21.15.104:0/2852276516 shutdown_connections 2024-09-17T02:56:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.637+0000 7fd7efede640 1 --2- 172.21.15.104:0/2852276516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7e80d0470 0x7fd7e80d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.637+0000 7fd7efede640 1 --2- 172.21.15.104:0/2852276516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7e80b7bb0 0x7fd7e80cde90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.637+0000 7fd7efede640 1 -- 172.21.15.104:0/2852276516 >> 172.21.15.104:0/2852276516 conn(0x7fd7e80d28a0 msgr2=0x7fd7e80d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.637+0000 7fd7efede640 1 -- 172.21.15.104:0/2852276516 shutdown_connections 2024-09-17T02:56:31.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.637+0000 7fd7efede640 1 -- 172.21.15.104:0/2852276516 wait complete. 2024-09-17T02:56:31.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.639+0000 7fd7efede640 1 Processor -- start 2024-09-17T02:56:31.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.639+0000 7fd7efede640 1 -- start start 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7efede640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e80b7bb0 0x7fd7e81e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7efede640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7e80cefb0 0x7fd7e80c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7efede640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7e80d0470 0x7fd7e80c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7efede640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e80cfad0 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7efede640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e80ce5e0 con 0x7fd7e80d0470 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7efede640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e80cfc50 con 0x7fd7e80cefb0 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7edc7a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e80b7bb0 0x7fd7e81e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7edc7a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e80b7bb0 0x7fd7e81e4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52130/0 (socket says 172.21.15.104:52130) 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7edc7a640 1 -- 172.21.15.104:0/2755290973 learned_addr learned my addr 172.21.15.104:0/2755290973 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7ed479640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7e80cefb0 0x7fd7e80c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:31.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.640+0000 7fd7ee47b640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7e80d0470 0x7fd7e80c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7edc7a640 1 -- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7e80cefb0 msgr2=0x7fd7e80c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7edc7a640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7e80cefb0 0x7fd7e80c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7edc7a640 1 -- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7e80d0470 msgr2=0x7fd7e80c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7edc7a640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7e80d0470 0x7fd7e80c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7edc7a640 1 -- 172.21.15.104:0/2755290973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e81f46e0 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7edc7a640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e80b7bb0 0x7fd7e81e4cb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009940 tx=0x7fd7e40049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7de7fc640 1 -- 172.21.15.104:0/2755290973 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4031950 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7de7fc640 1 -- 172.21.15.104:0/2755290973 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e4031be0 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e81e51f0 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7de7fc640 1 -- 172.21.15.104:0/2755290973 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40330d0 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.641+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e80b1370 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.642+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e80cde90 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.643+0000 7fd7de7fc640 1 -- 172.21.15.104:0/2755290973 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7e4033290 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.643+0000 7fd7de7fc640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7cc078bc0 0x7fd7cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:31.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.644+0000 7fd7ed479640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7cc078bc0 0x7fd7cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:31.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.644+0000 7fd7de7fc640 1 -- 172.21.15.104:0/2755290973 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7fd7e40bbe60 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.644+0000 7fd7ed479640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7cc078bc0 0x7fd7cc07b0d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c8810 tx=0x7fd7d8009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.648+0000 7fd7de7fc640 1 -- 172.21.15.104:0/2755290973 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7e403f030 con 0x7fd7e80b7bb0 2024-09-17T02:56:31.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:31.898+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7fd7e80af610 con 0x7fd7e80b7bb0 2024-09-17T02:56:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.199+0000 7fd7de7fc640 1 -- 172.21.15.104:0/2755290973 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v118) ==== 142+0+0 (secure 0 0 0) 0x7fd7e40845b0 con 0x7fd7e80b7bb0 2024-09-17T02:56:32.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7cc078bc0 msgr2=0x7fd7cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7cc078bc0 0x7fd7cc07b0d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c8810 tx=0x7fd7d8009260 comp rx=0 tx=0).stop 2024-09-17T02:56:32.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e80b7bb0 msgr2=0x7fd7e81e4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e80b7bb0 0x7fd7e81e4cb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009940 tx=0x7fd7e40049d0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 shutdown_connections 2024-09-17T02:56:32.201 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7cc078bc0 0x7fd7cc07b0d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7e80d0470 0x7fd7e80c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7e80cefb0 0x7fd7e80c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 --2- 172.21.15.104:0/2755290973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7e80b7bb0 0x7fd7e81e4cb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 >> 172.21.15.104:0/2755290973 conn(0x7fd7e80d28a0 msgr2=0x7fd7e80cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:32.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 shutdown_connections 2024-09-17T02:56:32.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.201+0000 7fd7efede640 1 -- 172.21.15.104:0/2755290973 wait complete. 2024-09-17T02:56:32.212 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-17T02:56:32.213 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2024-09-17T02:56:32.213 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:56:32.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.327+0000 7f63ba121640 1 -- 172.21.15.104:0/2698845329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 msgr2=0x7f63b40d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.327+0000 7f63ba121640 1 --2- 172.21.15.104:0/2698845329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 0x7f63b40d1bf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f63a8005fd0 tx=0x7f63a802a4f0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.327+0000 7f63ba121640 1 -- 172.21.15.104:0/2698845329 shutdown_connections 2024-09-17T02:56:32.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.327+0000 7f63ba121640 1 --2- 172.21.15.104:0/2698845329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 0x7f63b40d1bf0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.327+0000 7f63ba121640 1 --2- 172.21.15.104:0/2698845329 >> v2:172.21.15.192:3300/0 conn(0x7f63b415bff0 0x7f63b40cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.327+0000 7f63ba121640 1 -- 172.21.15.104:0/2698845329 >> 172.21.15.104:0/2698845329 conn(0x7f63b406cfc0 msgr2=0x7f63b406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:32.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.327+0000 7f63ba121640 1 -- 172.21.15.104:0/2698845329 shutdown_connections 2024-09-17T02:56:32.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.327+0000 7f63ba121640 1 -- 172.21.15.104:0/2698845329 wait complete. 2024-09-17T02:56:32.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.329+0000 7f63ba121640 1 Processor -- start 2024-09-17T02:56:32.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.329+0000 7f63ba121640 1 -- start start 2024-09-17T02:56:32.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63ba121640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 0x7f63b41e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63ba121640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b4073920 0x7f63b413dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63ba121640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b415bff0 0x7f63b413fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63ba121640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f63b40d22b0 con 0x7f63b4073510 2024-09-17T02:56:32.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63ba121640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f63b40d2130 con 0x7f63b4073920 2024-09-17T02:56:32.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63ba121640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f63b40d2430 con 0x7f63b415bff0 2024-09-17T02:56:32.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63b37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 0x7f63b41e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63b37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 0x7f63b41e4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52146/0 (socket says 172.21.15.104:52146) 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63b37fe640 1 -- 172.21.15.104:0/1731719165 learned_addr learned my addr 172.21.15.104:0/1731719165 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63b2ffd640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b4073920 0x7f63b413dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.330+0000 7f63b3fff640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b415bff0 0x7f63b413fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f63b37fe640 1 -- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b415bff0 msgr2=0x7f63b413fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f63b37fe640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b415bff0 0x7f63b413fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f63b37fe640 1 -- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b4073920 msgr2=0x7f63b413dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f63b37fe640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b4073920 0x7f63b413dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f63b37fe640 1 -- 172.21.15.104:0/1731719165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b413ebf0 con 0x7f63b4073510 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f63b37fe640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 0x7f63b41e4cb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c970 tx=0x7f63a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f639bfff640 1 -- 172.21.15.104:0/1731719165 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4007bb0 con 0x7f63b4073510 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f639bfff640 1 -- 172.21.15.104:0/1731719165 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63a4005020 con 0x7f63b4073510 2024-09-17T02:56:32.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b413eed0 con 0x7f63b4073510 2024-09-17T02:56:32.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f639bfff640 1 -- 172.21.15.104:0/1731719165 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4007e60 con 0x7f63b4073510 2024-09-17T02:56:32.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.331+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b413f490 con 0x7f63b4073510 2024-09-17T02:56:32.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.332+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b40745b0 con 0x7f63b4073510 2024-09-17T02:56:32.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.333+0000 7f639bfff640 1 -- 172.21.15.104:0/1731719165 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63a4005470 con 0x7f63b4073510 2024-09-17T02:56:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.333+0000 7f639bfff640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63a0078b90 0x7f63a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.333+0000 7f639bfff640 1 -- 172.21.15.104:0/1731719165 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7f63a409ae10 con 0x7f63b4073510 2024-09-17T02:56:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.334+0000 7f63b2ffd640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63a0078b90 0x7f63a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.334+0000 7f63b2ffd640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63a0078b90 0x7f63a007b0a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f63a8033000 tx=0x7f63a8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:32.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.338+0000 7f639bfff640 1 -- 172.21.15.104:0/1731719165 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f63b40745b0 con 0x7f63b4073510 2024-09-17T02:56:32.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.513+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63b40d1bf0 con 0x7f63b4073510 2024-09-17T02:56:32.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.514+0000 7f639bfff640 1 -- 172.21.15.104:0/1731719165 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+13082 (secure 0 0 0) 0x7f63a4014030 con 0x7f63b4073510 2024-09-17T02:56:32.514 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:32.514 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":58,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:56:31.188525+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/4212438108":"2024-09-18T02:56:28.176802+0000","172.21.15.104:6834/4212438108":"2024-09-18T02:56:28.176802+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:56:32.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.516+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63a0078b90 msgr2=0x7f63a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.516+0000 7f63ba121640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63a0078b90 0x7f63a007b0a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f63a8033000 tx=0x7f63a8004730 comp rx=0 tx=0).stop 2024-09-17T02:56:32.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.516+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 msgr2=0x7f63b41e4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.516+0000 7f63ba121640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 0x7f63b41e4cb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c970 tx=0x7f63a400ce30 comp rx=0 tx=0).stop 2024-09-17T02:56:32.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.516+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 shutdown_connections 2024-09-17T02:56:32.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.516+0000 7f63ba121640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63a0078b90 0x7f63a007b0a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.516+0000 7f63ba121640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63b4073920 0x7f63b413dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.517+0000 7f63ba121640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63b415bff0 0x7f63b413fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.517+0000 7f63ba121640 1 --2- 172.21.15.104:0/1731719165 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63b4073510 0x7f63b41e4cb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.517+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 >> 172.21.15.104:0/1731719165 conn(0x7f63b406cfc0 msgr2=0x7f63b4075d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:32.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.517+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 shutdown_connections 2024-09-17T02:56:32.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.517+0000 7f63ba121640 1 -- 172.21.15.104:0/1731719165 wait complete. 2024-09-17T02:56:32.527 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T02:56:32.528 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T02:56:32.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.643+0000 7f0296484640 1 -- 172.21.15.104:0/427255594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f029015b7f0 msgr2=0x7f029015bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.643+0000 7f0296484640 1 --2- 172.21.15.104:0/427255594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f029015b7f0 0x7f029015bc00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0280005fd0 tx=0x7f028002a540 comp rx=0 tx=0).stop 2024-09-17T02:56:32.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.643+0000 7f0296484640 1 -- 172.21.15.104:0/427255594 shutdown_connections 2024-09-17T02:56:32.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.643+0000 7f0296484640 1 --2- 172.21.15.104:0/427255594 >> v2:172.21.15.192:3300/0 conn(0x7f0290072f90 0x7f02900ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.643+0000 7f0296484640 1 --2- 172.21.15.104:0/427255594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f029015b7f0 0x7f029015bc00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.643+0000 7f0296484640 1 -- 172.21.15.104:0/427255594 >> 172.21.15.104:0/427255594 conn(0x7f02900b2450 msgr2=0x7f02900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:32.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.643+0000 7f0296484640 1 -- 172.21.15.104:0/427255594 shutdown_connections 2024-09-17T02:56:32.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.643+0000 7f0296484640 1 -- 172.21.15.104:0/427255594 wait complete. 2024-09-17T02:56:32.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.644+0000 7f0296484640 1 Processor -- start 2024-09-17T02:56:32.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.645+0000 7f0296484640 1 -- start start 2024-09-17T02:56:32.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f0296484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0290072470 0x7f029006ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f0296484640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0290072f90 0x7f029014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f0296484640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f029015b7f0 0x7f029014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f0296484640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f02900cebd0 con 0x7f0290072470 2024-09-17T02:56:32.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f0296484640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f02900cea50 con 0x7f0290072f90 2024-09-17T02:56:32.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f0296484640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f02900ced50 con 0x7f029015b7f0 2024-09-17T02:56:32.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0290072470 0x7f029006ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0290072470 0x7f029006ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52152/0 (socket says 172.21.15.104:52152) 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028ffff640 1 -- 172.21.15.104:0/4168547333 learned_addr learned my addr 172.21.15.104:0/4168547333 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f0294a21640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f029015b7f0 0x7f029014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028f7fe640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0290072f90 0x7f029014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028ffff640 1 -- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f029015b7f0 msgr2=0x7f029014c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028ffff640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f029015b7f0 0x7f029014c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028ffff640 1 -- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0290072f90 msgr2=0x7f029014bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028ffff640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0290072f90 0x7f029014bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028ffff640 1 -- 172.21.15.104:0/4168547333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02901e6a00 con 0x7f0290072470 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.646+0000 7f028f7fe640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0290072f90 0x7f029014bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.647+0000 7f028ffff640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0290072470 0x7f029006ef40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0280034040 tx=0x7f02800038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:32.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.647+0000 7f028cff9640 1 -- 172.21.15.104:0/4168547333 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028003e030 con 0x7f0290072470 2024-09-17T02:56:32.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.647+0000 7f028cff9640 1 -- 172.21.15.104:0/4168547333 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0280003d90 con 0x7f0290072470 2024-09-17T02:56:32.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.647+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02901e6ce0 con 0x7f0290072470 2024-09-17T02:56:32.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.647+0000 7f028cff9640 1 -- 172.21.15.104:0/4168547333 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280035040 con 0x7f0290072470 2024-09-17T02:56:32.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.647+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901e72a0 con 0x7f0290072470 2024-09-17T02:56:32.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.648+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02900cf220 con 0x7f0290072470 2024-09-17T02:56:32.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.648+0000 7f028cff9640 1 -- 172.21.15.104:0/4168547333 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0280041030 con 0x7f0290072470 2024-09-17T02:56:32.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.649+0000 7f028cff9640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0270078bc0 0x7f027007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.649+0000 7f028cff9640 1 -- 172.21.15.104:0/4168547333 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7f02800bb470 con 0x7f0290072470 2024-09-17T02:56:32.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.649+0000 7f028f7fe640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0270078bc0 0x7f027007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.650+0000 7f028f7fe640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0270078bc0 0x7f027007b0d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0290150e90 tx=0x7f0278009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:32.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.653+0000 7f028cff9640 1 -- 172.21.15.104:0/4168547333 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0280083560 con 0x7f0290072470 2024-09-17T02:56:32.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.828+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f02900ce580 con 0x7f0290072470 2024-09-17T02:56:32.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.828+0000 7f028cff9640 1 -- 172.21.15.104:0/4168547333 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) ==== 93+0+10 (secure 0 0 0) 0x7f0280087f90 con 0x7f0290072470 2024-09-17T02:56:32.828 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T02:56:32.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0270078bc0 msgr2=0x7f027007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0270078bc0 0x7f027007b0d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0290150e90 tx=0x7f0278009040 comp rx=0 tx=0).stop 2024-09-17T02:56:32.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0290072470 msgr2=0x7f029006ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0290072470 0x7f029006ef40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0280034040 tx=0x7f02800038a0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 shutdown_connections 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0270078bc0 0x7f027007b0d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0290072f90 0x7f029014bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f029015b7f0 0x7f029014c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 --2- 172.21.15.104:0/4168547333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0290072470 0x7f029006ef40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.830+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 >> 172.21.15.104:0/4168547333 conn(0x7f02900b2450 msgr2=0x7f02901e8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.831+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 shutdown_connections 2024-09-17T02:56:32.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.831+0000 7f0296484640 1 -- 172.21.15.104:0/4168547333 wait complete. 2024-09-17T02:56:32.841 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-17T02:56:32.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.955+0000 7f3a0270b640 1 -- 172.21.15.104:0/3452281986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 msgr2=0x7f39e4004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.955+0000 7f3a0270b640 1 --2- 172.21.15.104:0/3452281986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 0x7f39e4004080 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009b20 tx=0x7f39e4005830 comp rx=0 tx=0).stop 2024-09-17T02:56:32.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.955+0000 7f3a0270b640 1 -- 172.21.15.104:0/3452281986 shutdown_connections 2024-09-17T02:56:32.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.955+0000 7f3a0270b640 1 --2- 172.21.15.104:0/3452281986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 0x7f39e4004080 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.955+0000 7f3a0270b640 1 -- 172.21.15.104:0/3452281986 >> 172.21.15.104:0/3452281986 conn(0x7f39fc0b2450 msgr2=0x7f39fc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:32.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.955+0000 7f3a0270b640 1 -- 172.21.15.104:0/3452281986 shutdown_connections 2024-09-17T02:56:32.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.955+0000 7f3a0270b640 1 -- 172.21.15.104:0/3452281986 wait complete. 2024-09-17T02:56:32.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.956+0000 7f3a0270b640 1 Processor -- start 2024-09-17T02:56:32.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.957+0000 7f3a0270b640 1 -- start start 2024-09-17T02:56:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f3a0270b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 0x7f39fc0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f3a0270b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39fc0b0ca0 0x7f39fc1f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f3a0270b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39fc1f91e0 0x7f39fc0af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f3a0270b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc06ff70 con 0x7f39e4003c30 2024-09-17T02:56:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f3a0270b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc06fdf0 con 0x7f39fc1f91e0 2024-09-17T02:56:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f3a0270b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc0cd170 con 0x7f39fc0b0ca0 2024-09-17T02:56:32.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 0x7f39fc0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 0x7f39fc0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52164/0 (socket says 172.21.15.104:52164) 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fbfff640 1 -- 172.21.15.104:0/2684255862 learned_addr learned my addr 172.21.15.104:0/2684255862 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f3a00ca8640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39fc1f91e0 0x7f39fc0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fb7fe640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39fc0b0ca0 0x7f39fc1f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fbfff640 1 -- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39fc0b0ca0 msgr2=0x7f39fc1f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fbfff640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39fc0b0ca0 0x7f39fc1f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fbfff640 1 -- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39fc1f91e0 msgr2=0x7f39fc0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fbfff640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39fc1f91e0 0x7f39fc0af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.958+0000 7f39fbfff640 1 -- 172.21.15.104:0/2684255862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc0b10b0 con 0x7f39e4003c30 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.959+0000 7f39fbfff640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 0x7f39fc0b0760 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009b20 tx=0x7f39ec033650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.959+0000 7f39f8ff9640 1 -- 172.21.15.104:0/2684255862 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec038040 con 0x7f39e4003c30 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.959+0000 7f39f8ff9640 1 -- 172.21.15.104:0/2684255862 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39ec033840 con 0x7f39e4003c30 2024-09-17T02:56:32.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.959+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc1f9c30 con 0x7f39e4003c30 2024-09-17T02:56:32.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.959+0000 7f39f8ff9640 1 -- 172.21.15.104:0/2684255862 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec033c90 con 0x7f39e4003c30 2024-09-17T02:56:32.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.959+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc0aea50 con 0x7f39e4003c30 2024-09-17T02:56:32.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.960+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc1fa150 con 0x7f39e4003c30 2024-09-17T02:56:32.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.961+0000 7f39f8ff9640 1 -- 172.21.15.104:0/2684255862 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39ec043020 con 0x7f39e4003c30 2024-09-17T02:56:32.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.961+0000 7f39f8ff9640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f39e8078b90 0x7f39e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:32.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.961+0000 7f39f8ff9640 1 -- 172.21.15.104:0/2684255862 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7f39ec0baa20 con 0x7f39e4003c30 2024-09-17T02:56:32.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.961+0000 7f39fb7fe640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f39e8078b90 0x7f39e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:32.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.962+0000 7f39fb7fe640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f39e8078b90 0x7f39e807b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39fc1590f0 tx=0x7f39f0006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:32.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:32.966+0000 7f39f8ff9640 1 -- 172.21.15.104:0/2684255862 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39fc1fa150 con 0x7f39e4003c30 2024-09-17T02:56:33.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:33.206+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7f39fc0cd670 con 0x7f39e4003c30 2024-09-17T02:56:34.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.209+0000 7f39f8ff9640 1 -- 172.21.15.104:0/2684255862 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v120) ==== 137+0+0 (secure 0 0 0) 0x7f39ec04a020 con 0x7f39e4003c30 2024-09-17T02:56:34.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f39e8078b90 msgr2=0x7f39e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f39e8078b90 0x7f39e807b0a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39fc1590f0 tx=0x7f39f0006720 comp rx=0 tx=0).stop 2024-09-17T02:56:34.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 msgr2=0x7f39fc0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 0x7f39fc0b0760 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009b20 tx=0x7f39ec033650 comp rx=0 tx=0).stop 2024-09-17T02:56:34.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 shutdown_connections 2024-09-17T02:56:34.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f39e8078b90 0x7f39e807b0a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39fc1f91e0 0x7f39fc0af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39fc0b0ca0 0x7f39fc1f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 --2- 172.21.15.104:0/2684255862 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39e4003c30 0x7f39fc0b0760 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 >> 172.21.15.104:0/2684255862 conn(0x7f39fc0b2450 msgr2=0x7f39fc06f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:34.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 shutdown_connections 2024-09-17T02:56:34.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.211+0000 7f3a0270b640 1 -- 172.21.15.104:0/2684255862 wait complete. 2024-09-17T02:56:34.224 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-17T02:56:34.346 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_objectstore":"memstore"} 2024-09-17T02:56:34.347 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-17T02:56:34.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T02:56:34.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.460+0000 7f4075663640 1 -- 172.21.15.104:0/1240047010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 msgr2=0x7f40700d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.460+0000 7f4075663640 1 --2- 172.21.15.104:0/1240047010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 0x7f40700d11d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4064009830 tx=0x7f406402a480 comp rx=0 tx=0).stop 2024-09-17T02:56:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.460+0000 7f4075663640 1 -- 172.21.15.104:0/1240047010 shutdown_connections 2024-09-17T02:56:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.460+0000 7f4075663640 1 --2- 172.21.15.104:0/1240047010 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 0x7f40700d11d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.460+0000 7f4075663640 1 --2- 172.21.15.104:0/1240047010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40700b6f70 0x7f407015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.460+0000 7f4075663640 1 -- 172.21.15.104:0/1240047010 >> 172.21.15.104:0/1240047010 conn(0x7f4070073df0 msgr2=0x7f4070068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.460+0000 7f4075663640 1 -- 172.21.15.104:0/1240047010 shutdown_connections 2024-09-17T02:56:34.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.460+0000 7f4075663640 1 -- 172.21.15.104:0/1240047010 wait complete. 2024-09-17T02:56:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.462+0000 7f4075663640 1 Processor -- start 2024-09-17T02:56:34.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.462+0000 7f4075663640 1 -- start start 2024-09-17T02:56:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f4075663640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 0x7f40701f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f4075663640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b6f70 0x7f40700ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f4075663640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40700d1710 0x7f40700cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f4075663640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f40700d01b0 con 0x7f40700b3b00 2024-09-17T02:56:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f4075663640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f40700d0030 con 0x7f40700b6f70 2024-09-17T02:56:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f4075663640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f40700d0330 con 0x7f40700d1710 2024-09-17T02:56:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 0x7f40701f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:34.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 0x7f40701f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47510/0 (socket says 172.21.15.104:47510) 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 -- 172.21.15.104:0/2183619249 learned_addr learned my addr 172.21.15.104:0/2183619249 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406f7fe640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40700d1710 0x7f40700cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406e7fc640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b6f70 0x7f40700ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 -- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40700d1710 msgr2=0x7f40700cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40700d1710 0x7f40700cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 -- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b6f70 msgr2=0x7f40700ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b6f70 0x7f40700ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 -- 172.21.15.104:0/2183619249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407015b510 con 0x7f40700b3b00 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406f7fe640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40700d1710 0x7f40700cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.463+0000 7f406effd640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 0x7f40701f66c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f406000ea20 tx=0x7f406000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.464+0000 7f40577fe640 1 -- 172.21.15.104:0/2183619249 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406000cde0 con 0x7f40700b3b00 2024-09-17T02:56:34.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.464+0000 7f40577fe640 1 -- 172.21.15.104:0/2183619249 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4060011560 con 0x7f40700b3b00 2024-09-17T02:56:34.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.464+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407015b9b0 con 0x7f40700b3b00 2024-09-17T02:56:34.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.464+0000 7f40577fe640 1 -- 172.21.15.104:0/2183619249 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4060011990 con 0x7f40700b3b00 2024-09-17T02:56:34.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.464+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40700cddb0 con 0x7f40700b3b00 2024-09-17T02:56:34.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.465+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f407015f110 con 0x7f40700b3b00 2024-09-17T02:56:34.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.465+0000 7f40577fe640 1 -- 172.21.15.104:0/2183619249 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4060011b30 con 0x7f40700b3b00 2024-09-17T02:56:34.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.466+0000 7f40577fe640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f405c078b90 0x7f405c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:34.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.466+0000 7f40577fe640 1 -- 172.21.15.104:0/2183619249 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7f406009b730 con 0x7f40700b3b00 2024-09-17T02:56:34.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.466+0000 7f406e7fc640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f405c078b90 0x7f405c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:34.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.467+0000 7f406e7fc640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f405c078b90 0x7f405c07b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4064034000 tx=0x7f4064004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.471+0000 7f40577fe640 1 -- 172.21.15.104:0/2183619249 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4060016030 con 0x7f40700b3b00 2024-09-17T02:56:34.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.642+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f40700d1150 con 0x7f40700b3b00 2024-09-17T02:56:34.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.643+0000 7f40577fe640 1 -- 172.21.15.104:0/2183619249 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1472 (secure 0 0 0) 0x7f4060011e20 con 0x7f40700b3b00 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T02:56:34.643 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T02:56:34.644 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T02:56:34.644 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T02:56:34.644 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T02:56:34.644 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T02:56:34.644 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T02:56:34.644 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T02:56:34.644 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T02:56:34.644 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T02:56:34.645 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T02:56:34.645 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T02:56:34.645 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T02:56:34.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f405c078b90 msgr2=0x7f405c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f405c078b90 0x7f405c07b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4064034000 tx=0x7f4064004730 comp rx=0 tx=0).stop 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 msgr2=0x7f40701f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 0x7f40701f66c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f406000ea20 tx=0x7f406000eee0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 shutdown_connections 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f405c078b90 0x7f405c07b0a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b6f70 0x7f40700ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40700d1710 0x7f40700cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 --2- 172.21.15.104:0/2183619249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f40700b3b00 0x7f40701f66c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 >> 172.21.15.104:0/2183619249 conn(0x7f4070073df0 msgr2=0x7f40700d4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:34.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 shutdown_connections 2024-09-17T02:56:34.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.645+0000 7f4075663640 1 -- 172.21.15.104:0/2183619249 wait complete. 2024-09-17T02:56:34.656 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T02:56:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.771+0000 7f88c016e640 1 -- 172.21.15.104:0/4274302619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b5730 msgr2=0x7f88b80cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.771+0000 7f88c016e640 1 --2- 172.21.15.104:0/4274302619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b5730 0x7f88b80cdad0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009830 tx=0x7f88a802a530 comp rx=0 tx=0).stop 2024-09-17T02:56:34.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.772+0000 7f88c016e640 1 -- 172.21.15.104:0/4274302619 shutdown_connections 2024-09-17T02:56:34.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.772+0000 7f88c016e640 1 --2- 172.21.15.104:0/4274302619 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b5730 0x7f88b80cdad0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.772+0000 7f88c016e640 1 -- 172.21.15.104:0/4274302619 >> 172.21.15.104:0/4274302619 conn(0x7f88b80d28e0 msgr2=0x7f88b80d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:34.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.772+0000 7f88c016e640 1 -- 172.21.15.104:0/4274302619 shutdown_connections 2024-09-17T02:56:34.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.772+0000 7f88c016e640 1 -- 172.21.15.104:0/4274302619 wait complete. 2024-09-17T02:56:34.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.773+0000 7f88c016e640 1 Processor -- start 2024-09-17T02:56:34.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.773+0000 7f88c016e640 1 -- start start 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88c016e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b80b5730 0x7f88b80aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88c016e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b7ae0 0x7f88b815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88c016e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b80ce010 0x7f88b80b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88c016e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f88b80cf700 con 0x7f88b80b7ae0 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88c016e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f88b80ce630 con 0x7f88b80ce010 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88c016e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f88b80cf880 con 0x7f88b80b5730 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b7ae0 0x7f88b815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b7ae0 0x7f88b815a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47532/0 (socket says 172.21.15.104:47532) 2024-09-17T02:56:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 -- 172.21.15.104:0/1119495015 learned_addr learned my addr 172.21.15.104:0/1119495015 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bdf0a640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b80b5730 0x7f88b80aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88be70b640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b80ce010 0x7f88b80b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 -- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b80b5730 msgr2=0x7f88b80aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b80b5730 0x7f88b80aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 -- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b80ce010 msgr2=0x7f88b80b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b80ce010 0x7f88b80b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 -- 172.21.15.104:0/1119495015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b815ae60 con 0x7f88b80b7ae0 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88be70b640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b80ce010 0x7f88b80b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88bd709640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b7ae0 0x7f88b815a920 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009950 tx=0x7f88a8033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88ae7fc640 1 -- 172.21.15.104:0/1119495015 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a8031b60 con 0x7f88b80b7ae0 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88ae7fc640 1 -- 172.21.15.104:0/1119495015 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88a8031df0 con 0x7f88b80b7ae0 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88ae7fc640 1 -- 172.21.15.104:0/1119495015 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a8005280 con 0x7f88b80b7ae0 2024-09-17T02:56:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b81f4cb0 con 0x7f88b80b7ae0 2024-09-17T02:56:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.775+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b809c8c0 con 0x7f88b80b7ae0 2024-09-17T02:56:34.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.776+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b81f4f20 con 0x7f88b80b7ae0 2024-09-17T02:56:34.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.777+0000 7f88ae7fc640 1 -- 172.21.15.104:0/1119495015 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f88a8005420 con 0x7f88b80b7ae0 2024-09-17T02:56:34.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.778+0000 7f88ae7fc640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f889c078b90 0x7f889c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:34.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.778+0000 7f88ae7fc640 1 -- 172.21.15.104:0/1119495015 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7f88a80bbcb0 con 0x7f88b80b7ae0 2024-09-17T02:56:34.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.778+0000 7f88bdf0a640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f889c078b90 0x7f889c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:34.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.778+0000 7f88bdf0a640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f889c078b90 0x7f889c07b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88b4000fb0 tx=0x7f88b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:34.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.782+0000 7f88ae7fc640 1 -- 172.21.15.104:0/1119495015 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f88b815ae60 con 0x7f88b80b7ae0 2024-09-17T02:56:34.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.954+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f88b80cdad0 con 0x7f88b80b7ae0 2024-09-17T02:56:34.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.958+0000 7f88ae7fc640 1 -- 172.21.15.104:0/1119495015 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f88a803f030 con 0x7f88b80b7ae0 2024-09-17T02:56:34.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f889c078b90 msgr2=0x7f889c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f889c078b90 0x7f889c07b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88b4000fb0 tx=0x7f88b4009040 comp rx=0 tx=0).stop 2024-09-17T02:56:34.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b7ae0 msgr2=0x7f88b815a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:34.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b7ae0 0x7f88b815a920 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009950 tx=0x7f88a8033c10 comp rx=0 tx=0).stop 2024-09-17T02:56:34.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 shutdown_connections 2024-09-17T02:56:34.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f889c078b90 0x7f889c07b0a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88b80ce010 0x7f88b80b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f88b80b7ae0 0x7f88b815a920 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 --2- 172.21.15.104:0/1119495015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88b80b5730 0x7f88b80aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:34.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 >> 172.21.15.104:0/1119495015 conn(0x7f88b80d28e0 msgr2=0x7f88b815d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:34.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 shutdown_connections 2024-09-17T02:56:34.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:34.960+0000 7f88c016e640 1 -- 172.21.15.104:0/1119495015 wait complete. 2024-09-17T02:56:34.971 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:56:34.971 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:56:35.013 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:56:35.044 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:56:35.056 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:56:35.064 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:56:35.065 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:35.065 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:35.114 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:56:35.114 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:56:35.114 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:35.132 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:56:35.132 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:35.132 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:35.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:56:35.172 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:56:35.172 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:35.222 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:56:35.222 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T02:56:35.222 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:35.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.335+0000 7f6be50a4640 1 -- 172.21.15.104:0/1563073819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 msgr2=0x7f6be00b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:35.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.335+0000 7f6be50a4640 1 --2- 172.21.15.104:0/1563073819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 0x7f6be00b20f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009830 tx=0x7f6bc802a3f0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.335+0000 7f6be50a4640 1 -- 172.21.15.104:0/1563073819 shutdown_connections 2024-09-17T02:56:35.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.335+0000 7f6be50a4640 1 --2- 172.21.15.104:0/1563073819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 0x7f6be00b20f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.335+0000 7f6be50a4640 1 -- 172.21.15.104:0/1563073819 >> 172.21.15.104:0/1563073819 conn(0x7f6be00d2970 msgr2=0x7f6be00d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:35.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.335+0000 7f6be50a4640 1 -- 172.21.15.104:0/1563073819 shutdown_connections 2024-09-17T02:56:35.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.335+0000 7f6be50a4640 1 -- 172.21.15.104:0/1563073819 wait complete. 2024-09-17T02:56:35.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.337+0000 7f6be50a4640 1 Processor -- start 2024-09-17T02:56:35.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.337+0000 7f6be50a4640 1 -- start start 2024-09-17T02:56:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.338+0000 7f6be50a4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6be00b2630 0x7f6be00c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.338+0000 7f6be50a4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 0x7f6be009fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.338+0000 7f6be50a4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6be00d3490 0x7f6be00a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.338+0000 7f6be50a4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0168300 con 0x7f6be00b7c80 2024-09-17T02:56:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.338+0000 7f6be50a4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0168180 con 0x7f6be00d3490 2024-09-17T02:56:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.338+0000 7f6be50a4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6be0168480 con 0x7f6be00b2630 2024-09-17T02:56:35.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 0x7f6be009fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 0x7f6be009fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47542/0 (socket says 172.21.15.104:47542) 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 -- 172.21.15.104:0/479566593 learned_addr learned my addr 172.21.15.104:0/479566593 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bdf59e640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6be00d3490 0x7f6be00a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bded9d640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6be00b2630 0x7f6be00c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 -- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6be00b2630 msgr2=0x7f6be00c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6be00b2630 0x7f6be00c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 -- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6be00d3490 msgr2=0x7f6be00a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6be00d3490 0x7f6be00a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 -- 172.21.15.104:0/479566593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be00a07d0 con 0x7f6be00b7c80 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bdf59e640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6be00d3490 0x7f6be00a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bded9d640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6be00b2630 0x7f6be00c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd659c640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 0x7f6be009fae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009950 tx=0x7f6bc8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:35.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd7fff640 1 -- 172.21.15.104:0/479566593 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8031d60 con 0x7f6be00b7c80 2024-09-17T02:56:35.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd7fff640 1 -- 172.21.15.104:0/479566593 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bc8033e10 con 0x7f6be00b7c80 2024-09-17T02:56:35.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be00ceed0 con 0x7f6be00b7c80 2024-09-17T02:56:35.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6bd7fff640 1 -- 172.21.15.104:0/479566593 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8005260 con 0x7f6be00b7c80 2024-09-17T02:56:35.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.339+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be009cc10 con 0x7f6be00b7c80 2024-09-17T02:56:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.340+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be00b20f0 con 0x7f6be00b7c80 2024-09-17T02:56:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.341+0000 7f6bd7fff640 1 -- 172.21.15.104:0/479566593 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6bc8005400 con 0x7f6be00b7c80 2024-09-17T02:56:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.341+0000 7f6bd7fff640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6bc0078b90 0x7f6bc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.342+0000 7f6bd7fff640 1 -- 172.21.15.104:0/479566593 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7f6bc80bbd30 con 0x7f6be00b7c80 2024-09-17T02:56:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.342+0000 7f6bded9d640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6bc0078b90 0x7f6bc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:35.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.342+0000 7f6bded9d640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6bc0078b90 0x7f6bc007b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0006fd0 tx=0x7f6bd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:35.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.347+0000 7f6bd7fff640 1 -- 172.21.15.104:0/479566593 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6bc803f030 con 0x7f6be00b7c80 2024-09-17T02:56:35.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.554+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6be00cec50 con 0x7f6be00b7c80 2024-09-17T02:56:35.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.554+0000 7f6bd7fff640 1 -- 172.21.15.104:0/479566593 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+3917 (secure 0 0 0) 0x7f6be00cec50 con 0x7f6be00b7c80 2024-09-17T02:56:35.554 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:35.554 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":22,"btime":"2024-09-17T02:56:29:180395+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1575666983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1575666983},{"type":"v1","addr":"172.21.15.192:6836","nonce":1575666983}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5122,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4226335548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4226335548},{"type":"v1","addr":"172.21.15.192:6837","nonce":4226335548}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/206407299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":206407299},{"type":"v1","addr":"172.21.15.104:6833","nonce":206407299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5568,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/526642114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":526642114},{"type":"v1","addr":"172.21.15.104:6835","nonce":526642114}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[]} 2024-09-17T02:56:35.554 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 22 2024-09-17T02:56:35.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6bc0078b90 msgr2=0x7f6bc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:35.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6bc0078b90 0x7f6bc007b0a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0006fd0 tx=0x7f6bd0008040 comp rx=0 tx=0).stop 2024-09-17T02:56:35.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 msgr2=0x7f6be009fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:35.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 0x7f6be009fae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009950 tx=0x7f6bc8033c20 comp rx=0 tx=0).stop 2024-09-17T02:56:35.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 shutdown_connections 2024-09-17T02:56:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6bc0078b90 0x7f6bc007b0a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6be00d3490 0x7f6be00a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6be00b7c80 0x7f6be009fae0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 --2- 172.21.15.104:0/479566593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6be00b2630 0x7f6be00c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 >> 172.21.15.104:0/479566593 conn(0x7f6be00d2970 msgr2=0x7f6be00af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 shutdown_connections 2024-09-17T02:56:35.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.557+0000 7f6be50a4640 1 -- 172.21.15.104:0/479566593 wait complete. 2024-09-17T02:56:35.568 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T02:56:35.568 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T02:56:35.568 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T02:56:35.568 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:56:35.569 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T02:56:35.569 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T02:56:35.569 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T02:56:35.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:56:35.569 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T02:56:35.570 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T02:56:35.570 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T02:56:35.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:56:35.570 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T02:56:35.570 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T02:56:35.570 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T02:56:35.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:56:35.578 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T02:56:35.578 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T02:56:35.581 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T02:56:35.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T02:56:35.582 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T02:56:35.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T02:56:35.583 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T02:56:35.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T02:56:35.623 INFO:tasks.ceph.mds.a:Started 2024-09-17T02:56:35.624 DEBUG:teuthology.parallel:result is None 2024-09-17T02:56:35.625 INFO:tasks.ceph.mds.c:Started 2024-09-17T02:56:35.625 DEBUG:teuthology.parallel:result is None 2024-09-17T02:56:35.626 INFO:tasks.ceph.mds.b:Started 2024-09-17T02:56:35.626 DEBUG:teuthology.parallel:result is None 2024-09-17T02:56:35.627 INFO:tasks.ceph.mds.d:Started 2024-09-17T02:56:35.627 DEBUG:teuthology.parallel:result is None 2024-09-17T02:56:35.627 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T02:56:35.711 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T02:56:35.712 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:56:35.721 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T02:56:35.721 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T02:56:35.721 INFO:tasks.ceph.mds.b.smithi192.stderr:2024-09-17T02:56:35.723+0000 7f17f9f17640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T02:56:35.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.749+0000 7f3a39d94640 1 -- 172.21.15.104:0/1751861567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d3490 msgr2=0x7f3a340b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:35.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.749+0000 7f3a39d94640 1 --2- 172.21.15.104:0/1751861567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d3490 0x7f3a340b7c80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009900 tx=0x7f3a2402a580 comp rx=0 tx=0).stop 2024-09-17T02:56:35.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.749+0000 7f3a39d94640 1 -- 172.21.15.104:0/1751861567 shutdown_connections 2024-09-17T02:56:35.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.749+0000 7f3a39d94640 1 --2- 172.21.15.104:0/1751861567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a340d13e0 0x7f3a341615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.749+0000 7f3a39d94640 1 --2- 172.21.15.104:0/1751861567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d3490 0x7f3a340b7c80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.749+0000 7f3a39d94640 1 -- 172.21.15.104:0/1751861567 >> 172.21.15.104:0/1751861567 conn(0x7f3a340d2970 msgr2=0x7f3a340d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:35.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.749+0000 7f3a39d94640 1 -- 172.21.15.104:0/1751861567 shutdown_connections 2024-09-17T02:56:35.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.749+0000 7f3a39d94640 1 -- 172.21.15.104:0/1751861567 wait complete. 2024-09-17T02:56:35.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.751+0000 7f3a39d94640 1 Processor -- start 2024-09-17T02:56:35.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.751+0000 7f3a39d94640 1 -- start start 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a39d94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d0fd0 0x7f3a3414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a39d94640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a340d13e0 0x7f3a34160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a39d94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a340d3490 0x7f3a3414c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a39d94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340b6bd0 con 0x7f3a340d0fd0 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a39d94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340b6a50 con 0x7f3a340d3490 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a39d94640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3a340b6d50 con 0x7f3a340d13e0 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d0fd0 0x7f3a3414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a337fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d0fd0 0x7f3a3414d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47592/0 (socket says 172.21.15.104:47592) 2024-09-17T02:56:35.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a337fe640 1 -- 172.21.15.104:0/3140635245 learned_addr learned my addr 172.21.15.104:0/3140635245 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a32ffd640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a340d13e0 0x7f3a34160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.752+0000 7f3a33fff640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a340d3490 0x7f3a3414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a337fe640 1 -- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a340d13e0 msgr2=0x7f3a34160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a337fe640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a340d13e0 0x7f3a34160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a337fe640 1 -- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a340d3490 msgr2=0x7f3a3414c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a337fe640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a340d3490 0x7f3a3414c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a337fe640 1 -- 172.21.15.104:0/3140635245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3414d8b0 con 0x7f3a340d0fd0 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a337fe640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d0fd0 0x7f3a3414d370 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3a24000c00 tx=0x7f3a24003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a1bfff640 1 -- 172.21.15.104:0/3140635245 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2403e030 con 0x7f3a340d0fd0 2024-09-17T02:56:35.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a1bfff640 1 -- 172.21.15.104:0/3140635245 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a24003e00 con 0x7f3a340d0fd0 2024-09-17T02:56:35.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a1bfff640 1 -- 172.21.15.104:0/3140635245 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24035040 con 0x7f3a340d0fd0 2024-09-17T02:56:35.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3415ef80 con 0x7f3a340d0fd0 2024-09-17T02:56:35.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.753+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3415f540 con 0x7f3a340d0fd0 2024-09-17T02:56:35.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.754+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3415d440 con 0x7f3a340d0fd0 2024-09-17T02:56:35.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.755+0000 7f3a1bfff640 1 -- 172.21.15.104:0/3140635245 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a24041030 con 0x7f3a340d0fd0 2024-09-17T02:56:35.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.755+0000 7f3a1bfff640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3a20078b90 0x7f3a2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:35.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.756+0000 7f3a1bfff640 1 -- 172.21.15.104:0/3140635245 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 4943+0+0 (secure 0 0 0) 0x7f3a240bb150 con 0x7f3a340d0fd0 2024-09-17T02:56:35.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.756+0000 7f3a32ffd640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3a20078b90 0x7f3a2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:35.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.756+0000 7f3a32ffd640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3a20078b90 0x7f3a2007b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a340b02d0 tx=0x7f3a28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:35.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.760+0000 7f3a1bfff640 1 -- 172.21.15.104:0/3140635245 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a24083240 con 0x7f3a340d0fd0 2024-09-17T02:56:35.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:35.946+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3a340d0900 con 0x7f3a340d0fd0 2024-09-17T02:56:36.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.228+0000 7f3a1bfff640 1 -- 172.21.15.104:0/3140635245 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) ==== 97+0+0 (secure 0 0 0) 0x7f3a24087c70 con 0x7f3a340d0fd0 2024-09-17T02:56:36.228 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T02:56:36.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3a20078b90 msgr2=0x7f3a2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3a20078b90 0x7f3a2007b0a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a340b02d0 tx=0x7f3a28009040 comp rx=0 tx=0).stop 2024-09-17T02:56:36.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d0fd0 msgr2=0x7f3a3414d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d0fd0 0x7f3a3414d370 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3a24000c00 tx=0x7f3a24003910 comp rx=0 tx=0).stop 2024-09-17T02:56:36.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 shutdown_connections 2024-09-17T02:56:36.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3a20078b90 0x7f3a2007b0a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a340d3490 0x7f3a3414c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a340d13e0 0x7f3a34160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 --2- 172.21.15.104:0/3140635245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3a340d0fd0 0x7f3a3414d370 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 >> 172.21.15.104:0/3140635245 conn(0x7f3a340d2970 msgr2=0x7f3a340b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:36.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 shutdown_connections 2024-09-17T02:56:36.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.231+0000 7f3a39d94640 1 -- 172.21.15.104:0/3140635245 wait complete. 2024-09-17T02:56:36.245 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T02:56:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.358+0000 7f31bca30640 1 -- 172.21.15.104:0/610126911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80d0470 msgr2=0x7f31b80d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.358+0000 7f31bca30640 1 --2- 172.21.15.104:0/610126911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80d0470 0x7f31b80d0880 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f31a0005fd0 tx=0x7f31a002a4b0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.358+0000 7f31bca30640 1 -- 172.21.15.104:0/610126911 shutdown_connections 2024-09-17T02:56:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.358+0000 7f31bca30640 1 --2- 172.21.15.104:0/610126911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80d0470 0x7f31b80d0880 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.358+0000 7f31bca30640 1 -- 172.21.15.104:0/610126911 >> 172.21.15.104:0/610126911 conn(0x7f31b80d28a0 msgr2=0x7f31b80d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.358+0000 7f31bca30640 1 -- 172.21.15.104:0/610126911 shutdown_connections 2024-09-17T02:56:36.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.358+0000 7f31bca30640 1 -- 172.21.15.104:0/610126911 wait complete. 2024-09-17T02:56:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.360+0000 7f31bca30640 1 Processor -- start 2024-09-17T02:56:36.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.360+0000 7f31bca30640 1 -- start start 2024-09-17T02:56:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.361+0000 7f31bca30640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b7bb0 0x7f31b81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.361+0000 7f31bca30640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80cefb0 0x7f31b815aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.361+0000 7f31bca30640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80d0470 0x7f31b80712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.361+0000 7f31bca30640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f31b80cfc50 con 0x7f31b80cefb0 2024-09-17T02:56:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.361+0000 7f31bca30640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f31b80cfad0 con 0x7f31b80b7bb0 2024-09-17T02:56:36.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.361+0000 7f31bca30640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f31b80cfdd0 con 0x7f31b80d0470 2024-09-17T02:56:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.361+0000 7f31add9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80cefb0 0x7f31b815aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31add9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80cefb0 0x7f31b815aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47610/0 (socket says 172.21.15.104:47610) 2024-09-17T02:56:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31add9b640 1 -- 172.21.15.104:0/3553666078 learned_addr learned my addr 172.21.15.104:0/3553666078 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31b659c640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b7bb0 0x7f31b81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31b6d9d640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80d0470 0x7f31b80712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:36.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31add9b640 1 -- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80d0470 msgr2=0x7f31b80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31add9b640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80d0470 0x7f31b80712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31add9b640 1 -- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b7bb0 msgr2=0x7f31b81574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31add9b640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b7bb0 0x7f31b81574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31add9b640 1 -- 172.21.15.104:0/3553666078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b81603c0 con 0x7f31b80cefb0 2024-09-17T02:56:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31add9b640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80cefb0 0x7f31b815aec0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f31a0034040 tx=0x7f31a00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31af7fe640 1 -- 172.21.15.104:0/3553666078 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a003e030 con 0x7f31b80cefb0 2024-09-17T02:56:36.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31af7fe640 1 -- 172.21.15.104:0/3553666078 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31a00047a0 con 0x7f31b80cefb0 2024-09-17T02:56:36.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b81f71d0 con 0x7f31b80cefb0 2024-09-17T02:56:36.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31af7fe640 1 -- 172.21.15.104:0/3553666078 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0035040 con 0x7f31b80cefb0 2024-09-17T02:56:36.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.362+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b81f7790 con 0x7f31b80cefb0 2024-09-17T02:56:36.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.363+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b80d0880 con 0x7f31b80cefb0 2024-09-17T02:56:36.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.364+0000 7f31af7fe640 1 -- 172.21.15.104:0/3553666078 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31a0041030 con 0x7f31b80cefb0 2024-09-17T02:56:36.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.365+0000 7f31af7fe640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3198078b90 0x7f319807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:36.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.365+0000 7f31b659c640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3198078b90 0x7f319807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:36.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.365+0000 7f31af7fe640 1 -- 172.21.15.104:0/3553666078 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4857+0+0 (secure 0 0 0) 0x7f31a00bb1a0 con 0x7f31b80cefb0 2024-09-17T02:56:36.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.365+0000 7f31b659c640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3198078b90 0x7f319807b0a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f31a8001710 tx=0x7f31a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:36.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.369+0000 7f31af7fe640 1 -- 172.21.15.104:0/3553666078 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f31a00832e0 con 0x7f31b80cefb0 2024-09-17T02:56:36.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.608+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f31b80b7300 con 0x7f31b80cefb0 2024-09-17T02:56:36.608 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.609+0000 7f31af7fe640 1 -- 172.21.15.104:0/3553666078 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7f31a0087d10 con 0x7f31b80cefb0 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:56:36.609 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:56:36.610 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.611 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.611 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.611 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.611 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T02:56:36.611 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T02:56:36.611 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.612 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:56:36.612 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:56:36.612 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:56:36.612 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.612 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.613 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.613 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.613 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T02:56:36.613 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T02:56:36.613 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.613 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:56:36.614 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:56:36.614 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:56:36.614 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.614 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.614 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.615 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.615 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T02:56:36.615 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T02:56:36.615 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.615 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:56:36.615 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:56:36.616 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.616 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.616 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.616 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.616 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T02:56:36.616 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T02:56:36.616 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.616 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.617 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.618 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.619 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:56:36.620 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:56:36.620 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.620 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.620 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.620 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.620 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.621 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:56:36.622 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:56:36.622 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.622 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.622 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.622 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.623 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T02:56:36.623 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T02:56:36.623 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.623 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:56:36.623 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T02:56:36.623 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T02:56:36.624 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.624 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.624 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.624 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T02:56:36.624 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T02:56:36.625 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.625 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:56:36.625 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:56:36.625 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:56:36.625 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:56:36.626 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.626 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.626 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.626 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T02:56:36.626 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T02:56:36.626 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.627 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:56:36.627 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:56:36.627 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:56:36.627 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:56:36.627 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.627 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.628 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.628 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T02:56:36.628 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T02:56:36.628 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.628 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:56:36.628 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:56:36.628 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:56:36.628 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.629 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.630 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T02:56:36.631 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T02:56:36.631 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:56:36.631 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:56:36.631 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:56:36.632 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:56:36.632 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.632 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.632 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:56:36.632 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:36.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3198078b90 msgr2=0x7f319807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3198078b90 0x7f319807b0a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f31a8001710 tx=0x7f31a8009040 comp rx=0 tx=0).stop 2024-09-17T02:56:36.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80cefb0 msgr2=0x7f31b815aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80cefb0 0x7f31b815aec0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f31a0034040 tx=0x7f31a00039e0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 shutdown_connections 2024-09-17T02:56:36.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3198078b90 0x7f319807b0a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31b80d0470 0x7f31b80712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f31b80cefb0 0x7f31b815aec0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 --2- 172.21.15.104:0/3553666078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f31b80b7bb0 0x7f31b81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 >> 172.21.15.104:0/3553666078 conn(0x7f31b80d28a0 msgr2=0x7f31b80b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:36.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 shutdown_connections 2024-09-17T02:56:36.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.611+0000 7f31bca30640 1 -- 172.21.15.104:0/3553666078 wait complete. 2024-09-17T02:56:36.636 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T02:56:36.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.748+0000 7fab744b6640 1 -- 172.21.15.104:0/4232315490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15bc00 msgr2=0x7fab6c072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.748+0000 7fab744b6640 1 --2- 172.21.15.104:0/4232315490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15bc00 0x7fab6c072b80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fab60005fd0 tx=0x7fab6002a540 comp rx=0 tx=0).stop 2024-09-17T02:56:36.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.748+0000 7fab744b6640 1 -- 172.21.15.104:0/4232315490 shutdown_connections 2024-09-17T02:56:36.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.748+0000 7fab744b6640 1 --2- 172.21.15.104:0/4232315490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15bc00 0x7fab6c072b80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.748+0000 7fab744b6640 1 -- 172.21.15.104:0/4232315490 >> 172.21.15.104:0/4232315490 conn(0x7fab6c0b2450 msgr2=0x7fab6c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:36.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.748+0000 7fab744b6640 1 -- 172.21.15.104:0/4232315490 shutdown_connections 2024-09-17T02:56:36.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.748+0000 7fab744b6640 1 -- 172.21.15.104:0/4232315490 wait complete. 2024-09-17T02:56:36.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.750+0000 7fab744b6640 1 Processor -- start 2024-09-17T02:56:36.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.750+0000 7fab744b6640 1 -- start start 2024-09-17T02:56:36.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab744b6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6c0ce280 0x7fab6c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:36.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab744b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15b7f0 0x7fab6c14b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:36.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab744b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab6c15bc00 0x7fab6c06ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:36.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab744b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c0ceda0 con 0x7fab6c15b7f0 2024-09-17T02:56:36.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab744b6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c0700b0 con 0x7fab6c0ce280 2024-09-17T02:56:36.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab744b6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c0cef20 con 0x7fab6c15bc00 2024-09-17T02:56:36.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab71a51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15b7f0 0x7fab6c14b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab71a51640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15b7f0 0x7fab6c14b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47626/0 (socket says 172.21.15.104:47626) 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.751+0000 7fab71a51640 1 -- 172.21.15.104:0/3443686953 learned_addr learned my addr 172.21.15.104:0/3443686953 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab72252640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6c0ce280 0x7fab6c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab72a53640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab6c15bc00 0x7fab6c06ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab71a51640 1 -- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab6c15bc00 msgr2=0x7fab6c06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab71a51640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab6c15bc00 0x7fab6c06ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab71a51640 1 -- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6c0ce280 msgr2=0x7fab6c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab71a51640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6c0ce280 0x7fab6c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab71a51640 1 -- 172.21.15.104:0/3443686953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c0ad7f0 con 0x7fab6c15b7f0 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab71a51640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15b7f0 0x7fab6c14b110 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c00 tx=0x7fab60003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:36.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab6affd640 1 -- 172.21.15.104:0/3443686953 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6003e030 con 0x7fab6c15b7f0 2024-09-17T02:56:36.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab6affd640 1 -- 172.21.15.104:0/3443686953 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab60003e60 con 0x7fab6c15b7f0 2024-09-17T02:56:36.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6c0ab6a0 con 0x7fab6c15b7f0 2024-09-17T02:56:36.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab6affd640 1 -- 172.21.15.104:0/3443686953 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab60035040 con 0x7fab6c15b7f0 2024-09-17T02:56:36.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.752+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6c0ada90 con 0x7fab6c15b7f0 2024-09-17T02:56:36.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.753+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6c0ab410 con 0x7fab6c15b7f0 2024-09-17T02:56:36.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.754+0000 7fab6affd640 1 -- 172.21.15.104:0/3443686953 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab60041030 con 0x7fab6c15b7f0 2024-09-17T02:56:36.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.754+0000 7fab6affd640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fab58078b90 0x7fab5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:36.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.754+0000 7fab6affd640 1 -- 172.21.15.104:0/3443686953 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4857+0+0 (secure 0 0 0) 0x7fab600bb250 con 0x7fab6c15b7f0 2024-09-17T02:56:36.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.754+0000 7fab72252640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fab58078b90 0x7fab5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:36.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.755+0000 7fab72252640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fab58078b90 0x7fab5807b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fab5c007fd0 tx=0x7fab5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:36.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.760+0000 7fab6affd640 1 -- 172.21.15.104:0/3443686953 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab60083a70 con 0x7fab6c15b7f0 2024-09-17T02:56:36.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.937+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fab6c0cf440 con 0x7fab6c15b7f0 2024-09-17T02:56:36.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.937+0000 7fab6affd640 1 -- 172.21.15.104:0/3443686953 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) ==== 84+0+65 (secure 0 0 0) 0x7fab60083370 con 0x7fab6c15b7f0 2024-09-17T02:56:36.936 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:36.936 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T02:56:36.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:56:36.936 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T02:56:36.936 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T02:56:36.936 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:56:36.936 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T02:56:36.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fab58078b90 msgr2=0x7fab5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fab58078b90 0x7fab5807b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fab5c007fd0 tx=0x7fab5c009040 comp rx=0 tx=0).stop 2024-09-17T02:56:36.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15b7f0 msgr2=0x7fab6c14b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15b7f0 0x7fab6c14b110 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fab60000c00 tx=0x7fab60003970 comp rx=0 tx=0).stop 2024-09-17T02:56:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 shutdown_connections 2024-09-17T02:56:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fab58078b90 0x7fab5807b0a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab6c15bc00 0x7fab6c06ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fab6c15b7f0 0x7fab6c14b110 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 --2- 172.21.15.104:0/3443686953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6c0ce280 0x7fab6c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 >> 172.21.15.104:0/3443686953 conn(0x7fab6c0b2450 msgr2=0x7fab6c158730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:36.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 shutdown_connections 2024-09-17T02:56:36.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:36.939+0000 7fab744b6640 1 -- 172.21.15.104:0/3443686953 wait complete. 2024-09-17T02:56:36.949 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T02:56:36.949 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T02:56:37.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.067+0000 7f2d24732640 1 -- 172.21.15.104:0/1787763949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d1c15c290 msgr2=0x7f2d1c0725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:37.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.067+0000 7f2d24732640 1 --2- 172.21.15.104:0/1787763949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d1c15c290 0x7f2d1c0725f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005fd0 tx=0x7f2d1802a5d0 comp rx=0 tx=0).stop 2024-09-17T02:56:37.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.067+0000 7f2d24732640 1 -- 172.21.15.104:0/1787763949 shutdown_connections 2024-09-17T02:56:37.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.067+0000 7f2d24732640 1 --2- 172.21.15.104:0/1787763949 >> v2:172.21.15.192:3300/0 conn(0x7f2d1c152c00 0x7f2d1c0b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:37.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.067+0000 7f2d24732640 1 --2- 172.21.15.104:0/1787763949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d1c15c290 0x7f2d1c0725f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:37.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.067+0000 7f2d24732640 1 -- 172.21.15.104:0/1787763949 >> 172.21.15.104:0/1787763949 conn(0x7f2d1c069610 msgr2=0x7f2d1c0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:37.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.067+0000 7f2d24732640 1 -- 172.21.15.104:0/1787763949 shutdown_connections 2024-09-17T02:56:37.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.067+0000 7f2d24732640 1 -- 172.21.15.104:0/1787763949 wait complete. 2024-09-17T02:56:37.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.068+0000 7f2d24732640 1 Processor -- start 2024-09-17T02:56:37.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.069+0000 7f2d24732640 1 -- start start 2024-09-17T02:56:37.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d24732640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d1c06fd10 0x7f2d1c142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:37.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d24732640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d1c152c00 0x7f2d1c145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:37.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d24732640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d1c15c290 0x7f2d1c1459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:37.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d24732640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c0b4010 con 0x7f2d1c15c290 2024-09-17T02:56:37.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d24732640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1c0b3e90 con 0x7f2d1c152c00 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d24732640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2d1c0b4190 con 0x7f2d1c06fd10 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d1c15c290 0x7f2d1c1459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d1c15c290 0x7f2d1c1459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47640/0 (socket says 172.21.15.104:47640) 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 -- 172.21.15.104:0/4136327990 learned_addr learned my addr 172.21.15.104:0/4136327990 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d21ccd640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d1c152c00 0x7f2d1c145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d224ce640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d1c06fd10 0x7f2d1c142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 -- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d1c06fd10 msgr2=0x7f2d1c142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d1c06fd10 0x7f2d1c142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 -- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d1c152c00 msgr2=0x7f2d1c145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:37.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d1c152c00 0x7f2d1c145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 -- 172.21.15.104:0/4136327990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d1c143040 con 0x7f2d1c15c290 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.070+0000 7f2d22ccf640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d1c15c290 0x7f2d1c1459d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c730 tx=0x7f2d1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.071+0000 7f2d12ffd640 1 -- 172.21.15.104:0/4136327990 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14003b70 con 0x7f2d1c15c290 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.071+0000 7f2d12ffd640 1 -- 172.21.15.104:0/4136327990 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d14003d10 con 0x7f2d1c15c290 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.071+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1c146230 con 0x7f2d1c15c290 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.071+0000 7f2d12ffd640 1 -- 172.21.15.104:0/4136327990 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400aab0 con 0x7f2d1c15c290 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.071+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1c1f73e0 con 0x7f2d1c15c290 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.073+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d1c145f80 con 0x7f2d1c15c290 2024-09-17T02:56:37.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.073+0000 7f2d12ffd640 1 -- 172.21.15.104:0/4136327990 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d1400ac50 con 0x7f2d1c15c290 2024-09-17T02:56:37.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.074+0000 7f2d12ffd640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2d00078bc0 0x7f2d0007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:37.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.074+0000 7f2d12ffd640 1 -- 172.21.15.104:0/4136327990 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4857+0+0 (secure 0 0 0) 0x7f2d1409a5e0 con 0x7f2d1c15c290 2024-09-17T02:56:37.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.074+0000 7f2d224ce640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2d00078bc0 0x7f2d0007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:37.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.074+0000 7f2d224ce640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2d00078bc0 0x7f2d0007b0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2d18033000 tx=0x7f2d18004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:37.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.078+0000 7f2d12ffd640 1 -- 172.21.15.104:0/4136327990 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2d140627b0 con 0x7f2d1c15c290 2024-09-17T02:56:37.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:37.254+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2d1c0725f0 con 0x7f2d1c15c290 2024-09-17T02:56:38.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.235+0000 7f2d12ffd640 1 -- 172.21.15.104:0/4136327990 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) ==== 138+0+0 (secure 0 0 0) 0x7f2d140671e0 con 0x7f2d1c15c290 2024-09-17T02:56:38.234 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T02:56:38.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2d00078bc0 msgr2=0x7f2d0007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:38.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2d00078bc0 0x7f2d0007b0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2d18033000 tx=0x7f2d18004730 comp rx=0 tx=0).stop 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d1c15c290 msgr2=0x7f2d1c1459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d1c15c290 0x7f2d1c1459d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400c730 tx=0x7f2d1400cbf0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 shutdown_connections 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2d00078bc0 0x7f2d0007b0d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d1c152c00 0x7f2d1c145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2d1c15c290 0x7f2d1c1459d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 --2- 172.21.15.104:0/4136327990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d1c06fd10 0x7f2d1c142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 >> 172.21.15.104:0/4136327990 conn(0x7f2d1c069610 msgr2=0x7f2d1c0b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 shutdown_connections 2024-09-17T02:56:38.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.239+0000 7f2d24732640 1 -- 172.21.15.104:0/4136327990 wait complete. 2024-09-17T02:56:38.253 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T02:56:38.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.379+0000 7f2b302d5640 1 -- 172.21.15.104:0/549418859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b280ce280 msgr2=0x7f2b280ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:38.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.379+0000 7f2b302d5640 1 --2- 172.21.15.104:0/549418859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b280ce280 0x7f2b280ce690 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2b28070910 tx=0x7f2b2002a820 comp rx=0 tx=0).stop 2024-09-17T02:56:38.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.379+0000 7f2b302d5640 1 -- 172.21.15.104:0/549418859 shutdown_connections 2024-09-17T02:56:38.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.379+0000 7f2b302d5640 1 --2- 172.21.15.104:0/549418859 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b280ce280 0x7f2b280ce690 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.379+0000 7f2b302d5640 1 --2- 172.21.15.104:0/549418859 >> v2:172.21.15.192:3300/0 conn(0x7f2b2815bc00 0x7f2b28072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.379+0000 7f2b302d5640 1 -- 172.21.15.104:0/549418859 >> 172.21.15.104:0/549418859 conn(0x7f2b280b2450 msgr2=0x7f2b280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:38.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.379+0000 7f2b302d5640 1 -- 172.21.15.104:0/549418859 shutdown_connections 2024-09-17T02:56:38.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.379+0000 7f2b302d5640 1 -- 172.21.15.104:0/549418859 wait complete. 2024-09-17T02:56:38.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.381+0000 7f2b302d5640 1 Processor -- start 2024-09-17T02:56:38.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.381+0000 7f2b302d5640 1 -- start start 2024-09-17T02:56:38.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b302d5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b280ce280 0x7f2b28153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:38.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b302d5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b2815b7f0 0x7f2b280b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:38.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b302d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b2815bc00 0x7f2b280b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:38.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b302d5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2b280cefa0 con 0x7f2b2815bc00 2024-09-17T02:56:38.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b302d5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b280cee20 con 0x7f2b2815b7f0 2024-09-17T02:56:38.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b302d5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2b280cf120 con 0x7f2b280ce280 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b2e872640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b2815bc00 0x7f2b280b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b2e872640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b2815bc00 0x7f2b280b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47660/0 (socket says 172.21.15.104:47660) 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.382+0000 7f2b2e872640 1 -- 172.21.15.104:0/3571402728 learned_addr learned my addr 172.21.15.104:0/3571402728 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b2d870640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b2815b7f0 0x7f2b280b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b2e071640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b280ce280 0x7f2b28153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b2e872640 1 -- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b280ce280 msgr2=0x7f2b28153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b2e872640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b280ce280 0x7f2b28153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b2e872640 1 -- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b2815b7f0 msgr2=0x7f2b280b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b2e872640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b2815b7f0 0x7f2b280b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b2e872640 1 -- 172.21.15.104:0/3571402728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b281f7310 con 0x7f2b2815bc00 2024-09-17T02:56:38.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b2e872640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b2815bc00 0x7f2b280b4ce0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009ca0 tx=0x7f2b20032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b1effd640 1 -- 172.21.15.104:0/3571402728 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2003f020 con 0x7f2b2815bc00 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b1effd640 1 -- 172.21.15.104:0/3571402728 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b20004040 con 0x7f2b2815bc00 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b281f75f0 con 0x7f2b2815bc00 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b1effd640 1 -- 172.21.15.104:0/3571402728 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20037040 con 0x7f2b2815bc00 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.383+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b281f7bb0 con 0x7f2b2815bc00 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.384+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b28153850 con 0x7f2b2815bc00 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.385+0000 7f2b1effd640 1 -- 172.21.15.104:0/3571402728 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b20042020 con 0x7f2b2815bc00 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.385+0000 7f2b1effd640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.385+0000 7f2b1effd640 1 -- 172.21.15.104:0/3571402728 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5227+0+0 (secure 0 0 0) 0x7f2b200bb1c0 con 0x7f2b2815bc00 2024-09-17T02:56:38.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.386+0000 7f2b2e071640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:38.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.386+0000 7f2b2e071640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b24001610 tx=0x7f2b24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:38.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.390+0000 7f2b1effd640 1 -- 172.21.15.104:0/3571402728 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b20049030 con 0x7f2b2815bc00 2024-09-17T02:56:38.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:38.566+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2b2815f3c0 con 0x7f2b2815bc00 2024-09-17T02:56:39.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.241+0000 7f2b1effd640 1 -- 172.21.15.104:0/3571402728 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) ==== 170+0+0 (secure 0 0 0) 0x7f2b20083900 con 0x7f2b2815bc00 2024-09-17T02:56:39.240 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T02:56:39.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b0c078b90 msgr2=0x7f2b0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:39.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b24001610 tx=0x7f2b24009040 comp rx=0 tx=0).stop 2024-09-17T02:56:39.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b2815bc00 msgr2=0x7f2b280b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:39.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b2815bc00 0x7f2b280b4ce0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009ca0 tx=0x7f2b20032c90 comp rx=0 tx=0).stop 2024-09-17T02:56:39.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 shutdown_connections 2024-09-17T02:56:39.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b0c078b90 0x7f2b0c07b0a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b2815b7f0 0x7f2b280b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b2815bc00 0x7f2b280b4ce0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 --2- 172.21.15.104:0/3571402728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b280ce280 0x7f2b28153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.244+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 >> 172.21.15.104:0/3571402728 conn(0x7f2b280b2450 msgr2=0x7f2b280b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:39.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.245+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 shutdown_connections 2024-09-17T02:56:39.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.245+0000 7f2b302d5640 1 -- 172.21.15.104:0/3571402728 wait complete. 2024-09-17T02:56:39.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T02:56:39.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.387+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/2268355642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00b7ae0 msgr2=0x7fa9b00b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:39.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.387+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/2268355642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00b7ae0 0x7fa9b00b5730 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00cd5b0 tx=0x7fa9a002a4a0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.387+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/2268355642 shutdown_connections 2024-09-17T02:56:39.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.387+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/2268355642 >> v2:172.21.15.192:3300/0 conn(0x7fa9b00d1590 0x7fa9b00ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.387+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/2268355642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00b7ae0 0x7fa9b00b5730 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.387+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/2268355642 >> 172.21.15.104:0/2268355642 conn(0x7fa9b00d28e0 msgr2=0x7fa9b00d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:39.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.387+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/2268355642 shutdown_connections 2024-09-17T02:56:39.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.387+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/2268355642 wait complete. 2024-09-17T02:56:39.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.389+0000 7fa9b4fc3640 1 Processor -- start 2024-09-17T02:56:39.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.389+0000 7fa9b4fc3640 1 -- start start 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9b4fc3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9b00b7ae0 0x7fa9b01f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9b4fc3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00d1180 0x7fa9b00ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9b4fc3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9b00d1590 0x7fa9b006d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9b4fc3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b00cf380 con 0x7fa9b00d1180 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9b4fc3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b00cf200 con 0x7fa9b00b7ae0 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9b4fc3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b00cf500 con 0x7fa9b00d1590 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9add9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00d1180 0x7fa9b00ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9add9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00d1180 0x7fa9b00ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47680/0 (socket says 172.21.15.104:47680) 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9add9b640 1 -- 172.21.15.104:0/365669705 learned_addr learned my addr 172.21.15.104:0/365669705 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:39.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9ae59c640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9b00b7ae0 0x7fa9b01f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.390+0000 7fa9aed9d640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9b00d1590 0x7fa9b006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa9add9b640 1 -- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9b00d1590 msgr2=0x7fa9b006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa9add9b640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9b00d1590 0x7fa9b006d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa9add9b640 1 -- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9b00b7ae0 msgr2=0x7fa9b01f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa9add9b640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9b00b7ae0 0x7fa9b01f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa9add9b640 1 -- 172.21.15.104:0/365669705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b00cb470 con 0x7fa9b00d1180 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa9add9b640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00d1180 0x7fa9b00ca820 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c3c0 tx=0x7fa9a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa99effd640 1 -- 172.21.15.104:0/365669705 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4017070 con 0x7fa9b00d1180 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa99effd640 1 -- 172.21.15.104:0/365669705 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9a40035f0 con 0x7fa9b00d1180 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b00cb750 con 0x7fa9b00d1180 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa99effd640 1 -- 172.21.15.104:0/365669705 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4003a20 con 0x7fa9b00d1180 2024-09-17T02:56:39.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.391+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b00cbd10 con 0x7fa9b00d1180 2024-09-17T02:56:39.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.392+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b00cc150 con 0x7fa9b00d1180 2024-09-17T02:56:39.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.393+0000 7fa99effd640 1 -- 172.21.15.104:0/365669705 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9a401a070 con 0x7fa9b00d1180 2024-09-17T02:56:39.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.393+0000 7fa99effd640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa990078b90 0x7fa99007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:39.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.393+0000 7fa99effd640 1 -- 172.21.15.104:0/365669705 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5609+0+0 (secure 0 0 0) 0x7fa9a4099e00 con 0x7fa9b00d1180 2024-09-17T02:56:39.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.394+0000 7fa9ae59c640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa990078b90 0x7fa99007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:39.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.394+0000 7fa9ae59c640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa990078b90 0x7fa99007b0a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0034000 tx=0x7fa9a0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:39.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.398+0000 7fa99effd640 1 -- 172.21.15.104:0/365669705 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa9b00cd330 con 0x7fa9b00d1180 2024-09-17T02:56:39.605 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:39.607+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa9b00b5730 con 0x7fa9b00d1180 2024-09-17T02:56:40.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.260+0000 7fa99effd640 1 -- 172.21.15.104:0/365669705 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v25) ==== 172+0+0 (secure 0 0 0) 0x7fa9a4061ce0 con 0x7fa9b00d1180 2024-09-17T02:56:40.260 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 8 and data pool 9 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa990078b90 msgr2=0x7fa99007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa990078b90 0x7fa99007b0a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0034000 tx=0x7fa9a0004730 comp rx=0 tx=0).stop 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00d1180 msgr2=0x7fa9b00ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00d1180 0x7fa9b00ca820 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c3c0 tx=0x7fa9a400c880 comp rx=0 tx=0).stop 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 shutdown_connections 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa990078b90 0x7fa99007b0a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9b00d1590 0x7fa9b006d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa9b00d1180 0x7fa9b00ca820 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 --2- 172.21.15.104:0/365669705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9b00b7ae0 0x7fa9b01f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 >> 172.21.15.104:0/365669705 conn(0x7fa9b00d28e0 msgr2=0x7fa9b0071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 shutdown_connections 2024-09-17T02:56:40.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.265+0000 7fa9b4fc3640 1 -- 172.21.15.104:0/365669705 wait complete. 2024-09-17T02:56:40.279 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:56:40.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.395+0000 7f10dea4d640 1 -- 172.21.15.104:0/2599872871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 msgr2=0x7f10d80cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.395+0000 7f10dea4d640 1 --2- 172.21.15.104:0/2599872871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 0x7f10d80cfa80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f10d80d3a70 tx=0x7f10d002aa30 comp rx=0 tx=0).stop 2024-09-17T02:56:40.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.395+0000 7f10dea4d640 1 -- 172.21.15.104:0/2599872871 shutdown_connections 2024-09-17T02:56:40.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.395+0000 7f10dea4d640 1 --2- 172.21.15.104:0/2599872871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 0x7f10d80cfa80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.395+0000 7f10dea4d640 1 --2- 172.21.15.104:0/2599872871 >> v2:172.21.15.192:3300/0 conn(0x7f10d80b4fc0 0x7f10d80b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.395+0000 7f10dea4d640 1 -- 172.21.15.104:0/2599872871 >> 172.21.15.104:0/2599872871 conn(0x7f10d80b44a0 msgr2=0x7f10d80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:40.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.395+0000 7f10dea4d640 1 -- 172.21.15.104:0/2599872871 shutdown_connections 2024-09-17T02:56:40.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.395+0000 7f10dea4d640 1 -- 172.21.15.104:0/2599872871 wait complete. 2024-09-17T02:56:40.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.397+0000 7f10dea4d640 1 Processor -- start 2024-09-17T02:56:40.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.397+0000 7f10dea4d640 1 -- start start 2024-09-17T02:56:40.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dea4d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80b3f00 0x7f10d80af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:40.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dea4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80b4fc0 0x7f10d8156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:40.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dea4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 0x7f10d815d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:40.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dea4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f10d80d18c0 con 0x7f10d80cdf10 2024-09-17T02:56:40.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dea4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10d80d01d0 con 0x7f10d80b4fc0 2024-09-17T02:56:40.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dea4d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f10d8160f50 con 0x7f10d80b3f00 2024-09-17T02:56:40.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 0x7f10d815d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 0x7f10d815d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47698/0 (socket says 172.21.15.104:47698) 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 -- 172.21.15.104:0/1674192314 learned_addr learned my addr 172.21.15.104:0/1674192314 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10d7fff640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80b3f00 0x7f10d80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10d77fe640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80b4fc0 0x7f10d8156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 -- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80b3f00 msgr2=0x7f10d80af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80b3f00 0x7f10d80af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 -- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80b4fc0 msgr2=0x7f10d8156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80b4fc0 0x7f10d8156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 -- 172.21.15.104:0/1674192314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d815e4a0 con 0x7f10d80cdf10 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dcfea640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 0x7f10d815d9e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10d002b020 tx=0x7f10d0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10d4ff9640 1 -- 172.21.15.104:0/1674192314 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0033050 con 0x7f10d80cdf10 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10d4ff9640 1 -- 172.21.15.104:0/1674192314 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10d0004450 con 0x7f10d80cdf10 2024-09-17T02:56:40.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d815e780 con 0x7f10d80cdf10 2024-09-17T02:56:40.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.399+0000 7f10d4ff9640 1 -- 172.21.15.104:0/1674192314 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0038450 con 0x7f10d80cdf10 2024-09-17T02:56:40.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.400+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d815f230 con 0x7f10d80cdf10 2024-09-17T02:56:40.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.400+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d815e210 con 0x7f10d80cdf10 2024-09-17T02:56:40.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.401+0000 7f10d4ff9640 1 -- 172.21.15.104:0/1674192314 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10d0036070 con 0x7f10d80cdf10 2024-09-17T02:56:40.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.402+0000 7f10d4ff9640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10c4078b90 0x7f10c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:40.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.402+0000 7f10d4ff9640 1 -- 172.21.15.104:0/1674192314 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f10d00bc000 con 0x7f10d80cdf10 2024-09-17T02:56:40.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.402+0000 7f10d7fff640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10c4078b90 0x7f10c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:40.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.403+0000 7f10d7fff640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10c4078b90 0x7f10c407b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f10c8004630 tx=0x7f10c800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:40.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.406+0000 7f10d4ff9640 1 -- 172.21.15.104:0/1674192314 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f10d0083f10 con 0x7f10d80cdf10 2024-09-17T02:56:40.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.583+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10d80b39c0 con 0x7f10d80cdf10 2024-09-17T02:56:40.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.584+0000 7f10d4ff9640 1 -- 172.21.15.104:0/1674192314 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16786 (secure 0 0 0) 0x7f10d0088940 con 0x7f10d80cdf10 2024-09-17T02:56:40.583 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:40.583 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":65,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:56:39.608280+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:56:37.257971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T02:56:38.570795+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:56:40.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.586+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10c4078b90 msgr2=0x7f10c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.586+0000 7f10dea4d640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10c4078b90 0x7f10c407b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f10c8004630 tx=0x7f10c800b2e0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.586+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 msgr2=0x7f10d815d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.586+0000 7f10dea4d640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 0x7f10d815d9e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10d002b020 tx=0x7f10d0003f10 comp rx=0 tx=0).stop 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.587+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 shutdown_connections 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.587+0000 7f10dea4d640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10c4078b90 0x7f10c407b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.587+0000 7f10dea4d640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80b4fc0 0x7f10d8156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.587+0000 7f10dea4d640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80cdf10 0x7f10d815d9e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.587+0000 7f10dea4d640 1 --2- 172.21.15.104:0/1674192314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80b3f00 0x7f10d80af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.587+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 >> 172.21.15.104:0/1674192314 conn(0x7f10d80b44a0 msgr2=0x7f10d815c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.587+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 shutdown_connections 2024-09-17T02:56:40.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.587+0000 7f10dea4d640 1 -- 172.21.15.104:0/1674192314 wait complete. 2024-09-17T02:56:40.597 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:56:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.711+0000 7f01f00dd640 1 -- 172.21.15.104:0/3786956233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01e80cdf10 msgr2=0x7f01e80cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.711+0000 7f01f00dd640 1 --2- 172.21.15.104:0/3786956233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01e80cdf10 0x7f01e80cfa80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f01e0005fd0 tx=0x7f01e002a8b0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.711+0000 7f01f00dd640 1 -- 172.21.15.104:0/3786956233 shutdown_connections 2024-09-17T02:56:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.711+0000 7f01f00dd640 1 --2- 172.21.15.104:0/3786956233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01e80cdf10 0x7f01e80cfa80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.711+0000 7f01f00dd640 1 --2- 172.21.15.104:0/3786956233 >> v2:172.21.15.192:3300/0 conn(0x7f01e80b4fc0 0x7f01e80b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.711+0000 7f01f00dd640 1 -- 172.21.15.104:0/3786956233 >> 172.21.15.104:0/3786956233 conn(0x7f01e80b44a0 msgr2=0x7f01e80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.711+0000 7f01f00dd640 1 -- 172.21.15.104:0/3786956233 shutdown_connections 2024-09-17T02:56:40.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.711+0000 7f01f00dd640 1 -- 172.21.15.104:0/3786956233 wait complete. 2024-09-17T02:56:40.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.713+0000 7f01f00dd640 1 Processor -- start 2024-09-17T02:56:40.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.713+0000 7f01f00dd640 1 -- start start 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01f00dd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01e80b3f00 0x7f01e80b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01f00dd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01e80b4fc0 0x7f01e8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01f00dd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01e80cdf10 0x7f01e8155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01f00dd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f01e80d0210 con 0x7f01e80b4fc0 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01f00dd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f01e8160f50 con 0x7f01e80b3f00 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01f00dd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f01e81568d0 con 0x7f01e80cdf10 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01ed678640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01e80b4fc0 0x7f01e8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01ed678640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01e80b4fc0 0x7f01e8155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47708/0 (socket says 172.21.15.104:47708) 2024-09-17T02:56:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01ed678640 1 -- 172.21.15.104:0/4148786414 learned_addr learned my addr 172.21.15.104:0/4148786414 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.714+0000 7f01ee67a640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01e80cdf10 0x7f01e8155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01ede79640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01e80b3f00 0x7f01e80b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01ed678640 1 -- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01e80cdf10 msgr2=0x7f01e8155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01ed678640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01e80cdf10 0x7f01e8155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01ed678640 1 -- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01e80b3f00 msgr2=0x7f01e80b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01ed678640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01e80b3f00 0x7f01e80b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01ed678640 1 -- 172.21.15.104:0/4148786414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e80b1070 con 0x7f01e80b4fc0 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01ed678640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01e80b4fc0 0x7f01e8155800 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c3a0 tx=0x7f01d800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01de7fc640 1 -- 172.21.15.104:0/4148786414 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8011790 con 0x7f01e80b4fc0 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01de7fc640 1 -- 172.21.15.104:0/4148786414 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01d8017070 con 0x7f01e80b4fc0 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e80b2140 con 0x7f01e80b4fc0 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01de7fc640 1 -- 172.21.15.104:0/4148786414 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8011c80 con 0x7f01e80b4fc0 2024-09-17T02:56:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.715+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e80b26e0 con 0x7f01e80b4fc0 2024-09-17T02:56:40.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.716+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e80b39c0 con 0x7f01e80b4fc0 2024-09-17T02:56:40.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.717+0000 7f01de7fc640 1 -- 172.21.15.104:0/4148786414 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01d801c460 con 0x7f01e80b4fc0 2024-09-17T02:56:40.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.717+0000 7f01de7fc640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01cc078b90 0x7f01cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.717+0000 7f01de7fc640 1 -- 172.21.15.104:0/4148786414 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f01d809aa70 con 0x7f01e80b4fc0 2024-09-17T02:56:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.718+0000 7f01ede79640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01cc078b90 0x7f01cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.718+0000 7f01ede79640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01cc078b90 0x7f01cc07b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009b30 tx=0x7f01e4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:40.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.722+0000 7f01de7fc640 1 -- 172.21.15.104:0/4148786414 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01e80b1070 con 0x7f01e80b4fc0 2024-09-17T02:56:40.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.896+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01e8071f40 con 0x7f01e80b4fc0 2024-09-17T02:56:40.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.897+0000 7f01de7fc640 1 -- 172.21.15.104:0/4148786414 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16786 (secure 0 0 0) 0x7f01d80627d0 con 0x7f01e80b4fc0 2024-09-17T02:56:40.896 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:40.896 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":65,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:56:39.608280+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:56:37.257971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T02:56:38.570795+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:56:40.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01cc078b90 msgr2=0x7f01cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01cc078b90 0x7f01cc07b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009b30 tx=0x7f01e4005f90 comp rx=0 tx=0).stop 2024-09-17T02:56:40.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01e80b4fc0 msgr2=0x7f01e8155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:40.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01e80b4fc0 0x7f01e8155800 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c3a0 tx=0x7f01d800c860 comp rx=0 tx=0).stop 2024-09-17T02:56:40.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 shutdown_connections 2024-09-17T02:56:40.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f01cc078b90 0x7f01cc07b0a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01e80cdf10 0x7f01e8155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01e80b4fc0 0x7f01e8155800 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 --2- 172.21.15.104:0/4148786414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01e80b3f00 0x7f01e80b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:40.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 >> 172.21.15.104:0/4148786414 conn(0x7f01e80b44a0 msgr2=0x7f01e80b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:40.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 shutdown_connections 2024-09-17T02:56:40.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:40.899+0000 7f01f00dd640 1 -- 172.21.15.104:0/4148786414 wait complete. 2024-09-17T02:56:40.910 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T02:56:41.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 -- 172.21.15.104:0/2206672604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c152ce0 msgr2=0x7fb16c06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:41.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 --2- 172.21.15.104:0/2206672604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c152ce0 0x7fb16c06f540 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb16c159c90 tx=0x7fb15c02a560 comp rx=0 tx=0).stop 2024-09-17T02:56:41.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 -- 172.21.15.104:0/2206672604 shutdown_connections 2024-09-17T02:56:41.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 --2- 172.21.15.104:0/2206672604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb16c073ac0 0x7fb16c15f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 --2- 172.21.15.104:0/2206672604 >> v2:172.21.15.192:3300/0 conn(0x7fb16c06fa80 0x7fb16c073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 --2- 172.21.15.104:0/2206672604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c152ce0 0x7fb16c06f540 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 -- 172.21.15.104:0/2206672604 >> 172.21.15.104:0/2206672604 conn(0x7fb16c0b3640 msgr2=0x7fb16c0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:41.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 -- 172.21.15.104:0/2206672604 shutdown_connections 2024-09-17T02:56:41.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.026+0000 7fb171ad5640 1 -- 172.21.15.104:0/2206672604 wait complete. 2024-09-17T02:56:41.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.028+0000 7fb171ad5640 1 Processor -- start 2024-09-17T02:56:41.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.028+0000 7fb171ad5640 1 -- start start 2024-09-17T02:56:41.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.029+0000 7fb171ad5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb16c06fa80 0x7fb16c155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:41.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.029+0000 7fb171ad5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c073ac0 0x7fb16c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:41.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.029+0000 7fb171ad5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb16c152ce0 0x7fb16c15e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:41.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.029+0000 7fb171ad5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c160010 con 0x7fb16c073ac0 2024-09-17T02:56:41.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.029+0000 7fb171ad5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c15fe90 con 0x7fb16c152ce0 2024-09-17T02:56:41.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.029+0000 7fb171ad5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb16c160190 con 0x7fb16c06fa80 2024-09-17T02:56:41.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.029+0000 7fb16affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c073ac0 0x7fb16c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:41.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c073ac0 0x7fb16c15b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47732/0 (socket says 172.21.15.104:47732) 2024-09-17T02:56:41.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16affd640 1 -- 172.21.15.104:0/3819354004 learned_addr learned my addr 172.21.15.104:0/3819354004 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:41.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16bfff640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb16c152ce0 0x7fb16c15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:41.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16b7fe640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb16c06fa80 0x7fb16c155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:41.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16affd640 1 -- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb16c06fa80 msgr2=0x7fb16c155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:41.030 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16affd640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb16c06fa80 0x7fb16c155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16affd640 1 -- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb16c152ce0 msgr2=0x7fb16c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16affd640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb16c152ce0 0x7fb16c15e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16affd640 1 -- 172.21.15.104:0/3819354004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c150760 con 0x7fb16c073ac0 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16bfff640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb16c152ce0 0x7fb16c15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb16affd640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c073ac0 0x7fb16c15b160 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c970 tx=0x7fb16000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb153fff640 1 -- 172.21.15.104:0/3819354004 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160004230 con 0x7fb16c073ac0 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb153fff640 1 -- 172.21.15.104:0/3819354004 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1600043d0 con 0x7fb16c073ac0 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c150a40 con 0x7fb16c073ac0 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb153fff640 1 -- 172.21.15.104:0/3819354004 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160007c10 con 0x7fb16c073ac0 2024-09-17T02:56:41.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.030+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c151000 con 0x7fb16c073ac0 2024-09-17T02:56:41.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.031+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c15f690 con 0x7fb16c073ac0 2024-09-17T02:56:41.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.032+0000 7fb153fff640 1 -- 172.21.15.104:0/3819354004 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1600035f0 con 0x7fb16c073ac0 2024-09-17T02:56:41.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.032+0000 7fb153fff640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb158078b90 0x7fb15807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:41.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.032+0000 7fb153fff640 1 -- 172.21.15.104:0/3819354004 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7fb16009b1c0 con 0x7fb16c073ac0 2024-09-17T02:56:41.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.033+0000 7fb16b7fe640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb158078b90 0x7fb15807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:41.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.033+0000 7fb16b7fe640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb158078b90 0x7fb15807b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb15c033000 tx=0x7fb15c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:41.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.037+0000 7fb153fff640 1 -- 172.21.15.104:0/3819354004 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb160014070 con 0x7fb16c073ac0 2024-09-17T02:56:41.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.244+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb16c0d0850 con 0x7fb16c073ac0 2024-09-17T02:56:41.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.270+0000 7fb153fff640 1 -- 172.21.15.104:0/3819354004 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7fb160062fb0 con 0x7fb16c073ac0 2024-09-17T02:56:41.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb158078b90 msgr2=0x7fb15807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:41.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb158078b90 0x7fb15807b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb15c033000 tx=0x7fb15c004730 comp rx=0 tx=0).stop 2024-09-17T02:56:41.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c073ac0 msgr2=0x7fb16c15b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:41.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c073ac0 0x7fb16c15b160 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb16000c970 tx=0x7fb16000ce30 comp rx=0 tx=0).stop 2024-09-17T02:56:41.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 shutdown_connections 2024-09-17T02:56:41.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb158078b90 0x7fb15807b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb16c152ce0 0x7fb16c15e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb16c073ac0 0x7fb16c15b160 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 --2- 172.21.15.104:0/3819354004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb16c06fa80 0x7fb16c155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 >> 172.21.15.104:0/3819354004 conn(0x7fb16c0b3640 msgr2=0x7fb16c0d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:41.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 shutdown_connections 2024-09-17T02:56:41.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.273+0000 7fb171ad5640 1 -- 172.21.15.104:0/3819354004 wait complete. 2024-09-17T02:56:41.283 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T02:56:41.283 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T02:56:41.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.401+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/410861686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b1415fbe0 msgr2=0x7f0b140b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:41.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.401+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/410861686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b1415fbe0 0x7f0b140b65e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0b1408d840 tx=0x7f0b0402a560 comp rx=0 tx=0).stop 2024-09-17T02:56:41.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.401+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/410861686 shutdown_connections 2024-09-17T02:56:41.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.401+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/410861686 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b1415fbe0 0x7f0b140b65e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.401+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/410861686 >> v2:172.21.15.192:3300/0 conn(0x7f0b140d05e0 0x7f0b1415f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.401+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/410861686 >> 172.21.15.104:0/410861686 conn(0x7f0b14069120 msgr2=0x7f0b14069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:41.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.401+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/410861686 shutdown_connections 2024-09-17T02:56:41.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.401+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/410861686 wait complete. 2024-09-17T02:56:41.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.402+0000 7f0b1ac9b640 1 Processor -- start 2024-09-17T02:56:41.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.403+0000 7f0b1ac9b640 1 -- start start 2024-09-17T02:56:41.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b1ac9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b140b6b20 0x7f0b140ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:41.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b1ac9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b140d05e0 0x7f0b14153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:41.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b1ac9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b1415fbe0 0x7f0b14153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:41.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b1ac9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0b141633f0 con 0x7f0b140d05e0 2024-09-17T02:56:41.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b1ac9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140d4160 con 0x7f0b1415fbe0 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b1ac9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0b14163570 con 0x7f0b140b6b20 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b140d05e0 0x7f0b14153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b140d05e0 0x7f0b14153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47752/0 (socket says 172.21.15.104:47752) 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b0bfff640 1 -- 172.21.15.104:0/174061613 learned_addr learned my addr 172.21.15.104:0/174061613 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b18a37640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b140b6b20 0x7f0b140ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b19238640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b1415fbe0 0x7f0b14153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b0bfff640 1 -- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b140b6b20 msgr2=0x7f0b140ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b0bfff640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b140b6b20 0x7f0b140ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b0bfff640 1 -- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b1415fbe0 msgr2=0x7f0b14153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b0bfff640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b1415fbe0 0x7f0b14153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b0bfff640 1 -- 172.21.15.104:0/174061613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b141f79a0 con 0x7f0b140d05e0 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.404+0000 7f0b19238640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b1415fbe0 0x7f0b14153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:41.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.405+0000 7f0b0bfff640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b140d05e0 0x7f0b14153340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000c00 tx=0x7f0b04003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:41.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.405+0000 7f0b097fa640 1 -- 172.21.15.104:0/174061613 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0403e030 con 0x7f0b140d05e0 2024-09-17T02:56:41.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.405+0000 7f0b097fa640 1 -- 172.21.15.104:0/174061613 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b04003e00 con 0x7f0b140d05e0 2024-09-17T02:56:41.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.405+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b141f7c80 con 0x7f0b140d05e0 2024-09-17T02:56:41.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.405+0000 7f0b097fa640 1 -- 172.21.15.104:0/174061613 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04035040 con 0x7f0b140d05e0 2024-09-17T02:56:41.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.405+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b141f8240 con 0x7f0b140d05e0 2024-09-17T02:56:41.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.406+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b141f7710 con 0x7f0b140d05e0 2024-09-17T02:56:41.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.407+0000 7f0b097fa640 1 -- 172.21.15.104:0/174061613 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b04041030 con 0x7f0b140d05e0 2024-09-17T02:56:41.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.407+0000 7f0b097fa640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b00078b90 0x7f0b0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:41.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.407+0000 7f0b097fa640 1 -- 172.21.15.104:0/174061613 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f0b040bb430 con 0x7f0b140d05e0 2024-09-17T02:56:41.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.407+0000 7f0b18a37640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b00078b90 0x7f0b0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:41.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.408+0000 7f0b18a37640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b00078b90 0x7f0b0007b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0b10004630 tx=0x7f0b1000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:41.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.412+0000 7f0b097fa640 1 -- 172.21.15.104:0/174061613 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b140b6f30 con 0x7f0b140d05e0 2024-09-17T02:56:41.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:41.622+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0b140b7ea0 con 0x7f0b140d05e0 2024-09-17T02:56:42.232 INFO:tasks.ceph.mds.c.smithi104.stderr:2024-09-17T02:56:42.234+0000 7f18e5f5a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:56:42.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.275+0000 7f0b097fa640 1 -- 172.21.15.104:0/174061613 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7f0b040832c0 con 0x7f0b140d05e0 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b00078b90 msgr2=0x7f0b0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b00078b90 0x7f0b0007b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0b10004630 tx=0x7f0b1000b2e0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b140d05e0 msgr2=0x7f0b14153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b140d05e0 0x7f0b14153340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000c00 tx=0x7f0b04003910 comp rx=0 tx=0).stop 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 shutdown_connections 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b00078b90 0x7f0b0007b0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b1415fbe0 0x7f0b14153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b140d05e0 0x7f0b14153340 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 --2- 172.21.15.104:0/174061613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b140b6b20 0x7f0b140ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 >> 172.21.15.104:0/174061613 conn(0x7f0b14069120 msgr2=0x7f0b140b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:42.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 shutdown_connections 2024-09-17T02:56:42.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.278+0000 7f0b1ac9b640 1 -- 172.21.15.104:0/174061613 wait complete. 2024-09-17T02:56:42.289 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T02:56:42.289 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:42.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.405+0000 7fb44d44d640 1 -- 172.21.15.104:0/3395328202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 msgr2=0x7fb4480b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.405+0000 7fb44d44d640 1 --2- 172.21.15.104:0/3395328202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 0x7fb4480b69f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb438005fd0 tx=0x7fb43802a820 comp rx=0 tx=0).stop 2024-09-17T02:56:42.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.405+0000 7fb44d44d640 1 -- 172.21.15.104:0/3395328202 shutdown_connections 2024-09-17T02:56:42.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.405+0000 7fb44d44d640 1 --2- 172.21.15.104:0/3395328202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb44815fd10 0x7fb448161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.405+0000 7fb44d44d640 1 --2- 172.21.15.104:0/3395328202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 0x7fb4480b69f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.405+0000 7fb44d44d640 1 -- 172.21.15.104:0/3395328202 >> 172.21.15.104:0/3395328202 conn(0x7fb448069120 msgr2=0x7fb448069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:42.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.405+0000 7fb44d44d640 1 -- 172.21.15.104:0/3395328202 shutdown_connections 2024-09-17T02:56:42.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.405+0000 7fb44d44d640 1 -- 172.21.15.104:0/3395328202 wait complete. 2024-09-17T02:56:42.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.407+0000 7fb44d44d640 1 Processor -- start 2024-09-17T02:56:42.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.407+0000 7fb44d44d640 1 -- start start 2024-09-17T02:56:42.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb44d44d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 0x7fb4480ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:42.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb44d44d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb44815f1f0 0x7fb4481563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:42.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb44d44d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44815fd10 0x7fb448156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:42.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb44d44d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb448161df0 con 0x7fb4480b65e0 2024-09-17T02:56:42.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb44d44d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb448161c70 con 0x7fb44815fd10 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb44d44d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb448161f70 con 0x7fb44815f1f0 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 0x7fb4480ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 0x7fb4480ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47756/0 (socket says 172.21.15.104:47756) 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.408+0000 7fb446ffd640 1 -- 172.21.15.104:0/2067659522 learned_addr learned my addr 172.21.15.104:0/2067659522 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb4467fc640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb44815f1f0 0x7fb4481563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb4477fe640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44815fd10 0x7fb448156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb446ffd640 1 -- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb44815f1f0 msgr2=0x7fb4481563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb446ffd640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb44815f1f0 0x7fb4481563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb446ffd640 1 -- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44815fd10 msgr2=0x7fb448156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb446ffd640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44815fd10 0x7fb448156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb446ffd640 1 -- 172.21.15.104:0/2067659522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4481598b0 con 0x7fb4480b65e0 2024-09-17T02:56:42.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb4467fc640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb44815f1f0 0x7fb4481563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:42.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb4477fe640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44815fd10 0x7fb448156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:42.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb446ffd640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 0x7fb4480ce420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb43802ae10 tx=0x7fb438032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:42.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb42f7fe640 1 -- 172.21.15.104:0/2067659522 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438037040 con 0x7fb4480b65e0 2024-09-17T02:56:42.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb42f7fe640 1 -- 172.21.15.104:0/2067659522 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb438042070 con 0x7fb4480b65e0 2024-09-17T02:56:42.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb448159b90 con 0x7fb4480b65e0 2024-09-17T02:56:42.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb42f7fe640 1 -- 172.21.15.104:0/2067659522 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438004280 con 0x7fb4480b65e0 2024-09-17T02:56:42.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.409+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44815a150 con 0x7fb4480b65e0 2024-09-17T02:56:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.410+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4481624b0 con 0x7fb4480b65e0 2024-09-17T02:56:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.411+0000 7fb42f7fe640 1 -- 172.21.15.104:0/2067659522 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb438004420 con 0x7fb4480b65e0 2024-09-17T02:56:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.411+0000 7fb42f7fe640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb434078b90 0x7fb43407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.411+0000 7fb42f7fe640 1 -- 172.21.15.104:0/2067659522 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fb4380bbb30 con 0x7fb4480b65e0 2024-09-17T02:56:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.412+0000 7fb4467fc640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb434078b90 0x7fb43407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:42.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.412+0000 7fb4467fc640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb434078b90 0x7fb43407b0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb44815a440 tx=0x7fb43c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:42.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.416+0000 7fb42f7fe640 1 -- 172.21.15.104:0/2067659522 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb438084000 con 0x7fb4480b65e0 2024-09-17T02:56:42.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.624+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4480d1f80 con 0x7fb4480b65e0 2024-09-17T02:56:42.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.624+0000 7fb42f7fe640 1 -- 172.21.15.104:0/2067659522 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7fb438083900 con 0x7fb4480b65e0 2024-09-17T02:56:42.623 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:42.623 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"btime":"2024-09-17T02:56:42:271452+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/258221702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":258221702},{"type":"v1","addr":"172.21.15.192:6836","nonce":258221702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4219924766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4219924766},{"type":"v1","addr":"172.21.15.192:6837","nonce":4219924766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2744372735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2744372735},{"type":"v1","addr":"172.21.15.104:6833","nonce":2744372735}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:56:39.608242+0000","modified":"2024-09-17T02:56:41.622912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1457390445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1457390445},{"type":"v1","addr":"172.21.15.104:6835","nonce":1457390445}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5649,"qdb_cluster":[5649]},"id":4}]} 2024-09-17T02:56:42.623 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 27 2024-09-17T02:56:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.626+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb434078b90 msgr2=0x7fb43407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.626+0000 7fb44d44d640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb434078b90 0x7fb43407b0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb44815a440 tx=0x7fb43c009040 comp rx=0 tx=0).stop 2024-09-17T02:56:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.626+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 msgr2=0x7fb4480ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.626+0000 7fb44d44d640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 0x7fb4480ce420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb43802ae10 tx=0x7fb438032d10 comp rx=0 tx=0).stop 2024-09-17T02:56:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.627+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 shutdown_connections 2024-09-17T02:56:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.627+0000 7fb44d44d640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb434078b90 0x7fb43407b0a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.627+0000 7fb44d44d640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb44815fd10 0x7fb448156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.627+0000 7fb44d44d640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb44815f1f0 0x7fb4481563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.627+0000 7fb44d44d640 1 --2- 172.21.15.104:0/2067659522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4480b65e0 0x7fb4480ce420 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.627+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 >> 172.21.15.104:0/2067659522 conn(0x7fb448069120 msgr2=0x7fb44815f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.627+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 shutdown_connections 2024-09-17T02:56:42.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.627+0000 7fb44d44d640 1 -- 172.21.15.104:0/2067659522 wait complete. 2024-09-17T02:56:42.637 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:56:42.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.750+0000 7f10dd05c640 1 -- 172.21.15.104:0/1884199571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d13e0 msgr2=0x7f10d81615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.750+0000 7f10dd05c640 1 --2- 172.21.15.104:0/1884199571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d13e0 0x7f10d81615d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f10d0005fd0 tx=0x7f10d002aa10 comp rx=0 tx=0).stop 2024-09-17T02:56:42.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.750+0000 7f10dd05c640 1 -- 172.21.15.104:0/1884199571 shutdown_connections 2024-09-17T02:56:42.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.750+0000 7f10dd05c640 1 --2- 172.21.15.104:0/1884199571 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d13e0 0x7f10d81615d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.750+0000 7f10dd05c640 1 --2- 172.21.15.104:0/1884199571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80d3490 0x7f10d80b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.750+0000 7f10dd05c640 1 -- 172.21.15.104:0/1884199571 >> 172.21.15.104:0/1884199571 conn(0x7f10d80d2970 msgr2=0x7f10d80d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:42.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.750+0000 7f10dd05c640 1 -- 172.21.15.104:0/1884199571 shutdown_connections 2024-09-17T02:56:42.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.750+0000 7f10dd05c640 1 -- 172.21.15.104:0/1884199571 wait complete. 2024-09-17T02:56:42.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.752+0000 7f10dd05c640 1 Processor -- start 2024-09-17T02:56:42.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.752+0000 7f10dd05c640 1 -- start start 2024-09-17T02:56:42.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10dd05c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d0fd0 0x7f10d8158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10dd05c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80d13e0 0x7f10d80c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10dd05c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80d3490 0x7f10d80c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10dd05c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f10d80b6bd0 con 0x7f10d80d0fd0 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10dd05c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10d80b6a50 con 0x7f10d80d3490 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10dd05c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f10d80b6d50 con 0x7f10d80d13e0 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d0fd0 0x7f10d8158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d0fd0 0x7f10d8158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47784/0 (socket says 172.21.15.104:47784) 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 -- 172.21.15.104:0/3465050426 learned_addr learned my addr 172.21.15.104:0/3465050426 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10cffff640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80d13e0 0x7f10d80c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d759e640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80d3490 0x7f10d80c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:42.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 -- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80d13e0 msgr2=0x7f10d80c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80d13e0 0x7f10d80c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 -- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80d3490 msgr2=0x7f10d80c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80d3490 0x7f10d80c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 -- 172.21.15.104:0/3465050426 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d80cfe10 con 0x7f10d80d0fd0 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d759e640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80d3490 0x7f10d80c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10cffff640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80d13e0 0x7f10d80c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10d6d9d640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d0fd0 0x7f10d8158550 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f10c800d750 tx=0x7f10c800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10cf7fe640 1 -- 172.21.15.104:0/3465050426 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8017070 con 0x7f10d80d0fd0 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10cf7fe640 1 -- 172.21.15.104:0/3465050426 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10c8004310 con 0x7f10d80d0fd0 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10cf7fe640 1 -- 172.21.15.104:0/3465050426 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c800de60 con 0x7f10d80d0fd0 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.754+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d80d00f0 con 0x7f10d80d0fd0 2024-09-17T02:56:42.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.755+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d8158a90 con 0x7f10d80d0fd0 2024-09-17T02:56:42.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.756+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d80b7c80 con 0x7f10d80d0fd0 2024-09-17T02:56:42.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.756+0000 7f10cf7fe640 1 -- 172.21.15.104:0/3465050426 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10c8009c30 con 0x7f10d80d0fd0 2024-09-17T02:56:42.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.757+0000 7f10cf7fe640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10b8078b90 0x7f10b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:42.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.757+0000 7f10cf7fe640 1 -- 172.21.15.104:0/3465050426 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f10c809b130 con 0x7f10d80d0fd0 2024-09-17T02:56:42.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.757+0000 7f10cffff640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10b8078b90 0x7f10b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:42.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.757+0000 7f10cffff640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10b8078b90 0x7f10b807b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f10d8155d90 tx=0x7f10c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:42.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.761+0000 7f10cf7fe640 1 -- 172.21.15.104:0/3465050426 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f10c8020020 con 0x7f10d80d0fd0 2024-09-17T02:56:42.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.933+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10d80d02c0 con 0x7f10d80d0fd0 2024-09-17T02:56:42.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.935+0000 7f10cf7fe640 1 -- 172.21.15.104:0/3465050426 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16773 (secure 0 0 0) 0x7f10c8063600 con 0x7f10d80d0fd0 2024-09-17T02:56:42.933 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:42.934 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":66,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:56:41.243262+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:56:37.257971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T02:56:38.570795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:56:42.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10b8078b90 msgr2=0x7f10b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10b8078b90 0x7f10b807b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f10d8155d90 tx=0x7f10c0009040 comp rx=0 tx=0).stop 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d0fd0 msgr2=0x7f10d8158550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d0fd0 0x7f10d8158550 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f10c800d750 tx=0x7f10c800dc10 comp rx=0 tx=0).stop 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 shutdown_connections 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10b8078b90 0x7f10b807b0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10d80d3490 0x7f10d80c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10d80d13e0 0x7f10d80c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 --2- 172.21.15.104:0/3465050426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10d80d0fd0 0x7f10d8158550 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 >> 172.21.15.104:0/3465050426 conn(0x7f10d80d2970 msgr2=0x7f10d80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 shutdown_connections 2024-09-17T02:56:42.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:42.937+0000 7f10dd05c640 1 -- 172.21.15.104:0/3465050426 wait complete. 2024-09-17T02:56:42.947 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:56:42.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:56:43.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.062+0000 7f746cd33640 1 -- 172.21.15.104:0/3600780168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7454004800 msgr2=0x7f7454004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.062+0000 7f746cd33640 1 --2- 172.21.15.104:0/3600780168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7454004800 0x7f7454004c10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f74500016c0 tx=0x7f7454005830 comp rx=0 tx=0).stop 2024-09-17T02:56:43.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.062+0000 7f746cd33640 1 -- 172.21.15.104:0/3600780168 shutdown_connections 2024-09-17T02:56:43.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.062+0000 7f746cd33640 1 --2- 172.21.15.104:0/3600780168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7454004800 0x7f7454004c10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.062+0000 7f746cd33640 1 -- 172.21.15.104:0/3600780168 >> 172.21.15.104:0/3600780168 conn(0x7f74680d2970 msgr2=0x7f74680d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:43.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.062+0000 7f746cd33640 1 -- 172.21.15.104:0/3600780168 shutdown_connections 2024-09-17T02:56:43.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.062+0000 7f746cd33640 1 -- 172.21.15.104:0/3600780168 wait complete. 2024-09-17T02:56:43.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.064+0000 7f746cd33640 1 Processor -- start 2024-09-17T02:56:43.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.064+0000 7f746cd33640 1 -- start start 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f746cd33640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7454004800 0x7f7468153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f746cd33640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74680c9940 0x7f746815f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f746cd33640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74681f6c80 0x7f74680cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f746cd33640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f74680b20f0 con 0x7f74681f6c80 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f746cd33640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f74680b2ed0 con 0x7f7454004800 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f746cd33640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f74680b2270 con 0x7f74680c9940 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f7466d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74681f6c80 0x7f74680cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f7466d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74681f6c80 0x7f74680cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47810/0 (socket says 172.21.15.104:47810) 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f7466d9d640 1 -- 172.21.15.104:0/235387352 learned_addr learned my addr 172.21.15.104:0/235387352 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f7466d9d640 1 -- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74680c9940 msgr2=0x7f746815f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f745ffff640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74680c9940 0x7f746815f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f746659c640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7454004800 0x7f7468153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f7466d9d640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74680c9940 0x7f746815f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f7466d9d640 1 -- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7454004800 msgr2=0x7f7468153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f7466d9d640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7454004800 0x7f7468153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.065+0000 7f7466d9d640 1 -- 172.21.15.104:0/235387352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74681f77f0 con 0x7f74681f6c80 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.066+0000 7f7466d9d640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74681f6c80 0x7f74680cbfa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7460005fd0 tx=0x7f7460004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.066+0000 7f745effd640 1 -- 172.21.15.104:0/235387352 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460004b20 con 0x7f74681f6c80 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.066+0000 7f745effd640 1 -- 172.21.15.104:0/235387352 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7460004cc0 con 0x7f74681f6c80 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.066+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74681f7ad0 con 0x7f74681f6c80 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.066+0000 7f745effd640 1 -- 172.21.15.104:0/235387352 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460010d40 con 0x7f74681f6c80 2024-09-17T02:56:43.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.066+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746815f170 con 0x7f74681f6c80 2024-09-17T02:56:43.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.067+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74681f7560 con 0x7f74681f6c80 2024-09-17T02:56:43.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.067+0000 7f745effd640 1 -- 172.21.15.104:0/235387352 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f746001c020 con 0x7f74681f6c80 2024-09-17T02:56:43.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.068+0000 7f745effd640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7448078bc0 0x7f744807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.068+0000 7f745effd640 1 -- 172.21.15.104:0/235387352 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f746009b470 con 0x7f74681f6c80 2024-09-17T02:56:43.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.068+0000 7f746659c640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7448078bc0 0x7f744807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.069+0000 7f746659c640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7448078bc0 0x7f744807b0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7458001220 tx=0x7f74580067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:43.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.072+0000 7f745effd640 1 -- 172.21.15.104:0/235387352 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74600638b0 con 0x7f74681f6c80 2024-09-17T02:56:43.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.240+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74680d0fd0 con 0x7f7448078bc0 2024-09-17T02:56:43.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.245+0000 7f745effd640 1 -- 172.21.15.104:0/235387352 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247476 (secure 0 0 0) 0x7f74680d0fd0 con 0x7f7448078bc0 2024-09-17T02:56:43.247 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:43.248 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7448078bc0 msgr2=0x7f744807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7448078bc0 0x7f744807b0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7458001220 tx=0x7f74580067a0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74681f6c80 msgr2=0x7f74680cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74681f6c80 0x7f74680cbfa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7460005fd0 tx=0x7f7460004700 comp rx=0 tx=0).stop 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 shutdown_connections 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7448078bc0 0x7f744807b0d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f74681f6c80 0x7f74680cbfa0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74680c9940 0x7f746815f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 --2- 172.21.15.104:0/235387352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7454004800 0x7f7468153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 >> 172.21.15.104:0/235387352 conn(0x7f74680d2970 msgr2=0x7f7468071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 shutdown_connections 2024-09-17T02:56:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.248+0000 7f746cd33640 1 -- 172.21.15.104:0/235387352 wait complete. 2024-09-17T02:56:43.258 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-17T02:56:41.647269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558750,"statfs":{"total":1600000000,"available":1596160580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000853"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257909+0000","last_change":"2024-09-17T02:56:40.257352+0000","last_active":"2024-09-17T02:56:40.257909+0000","last_peered":"2024-09-17T02:56:40.257909+0000","last_clean":"2024-09-17T02:56:40.257909+0000","last_became_active":"2024-09-17T02:56:40.257080+0000","last_became_peered":"2024-09-17T02:56:40.257080+0000","last_unstale":"2024-09-17T02:56:40.257909+0000","last_undegraded":"2024-09-17T02:56:40.257909+0000","last_fullsized":"2024-09-17T02:56:40.257909+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:01.702015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.261714+0000","last_change":"2024-09-17T02:56:40.261252+0000","last_active":"2024-09-17T02:56:40.261714+0000","last_peered":"2024-09-17T02:56:40.261714+0000","last_clean":"2024-09-17T02:56:40.261714+0000","last_became_active":"2024-09-17T02:56:40.259141+0000","last_became_peered":"2024-09-17T02:56:40.259141+0000","last_unstale":"2024-09-17T02:56:40.261714+0000","last_undegraded":"2024-09-17T02:56:40.261714+0000","last_fullsized":"2024-09-17T02:56:40.261714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:49.232931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246461+0000","last_change":"2024-09-17T02:56:40.259001+0000","last_active":"2024-09-17T02:56:41.246461+0000","last_peered":"2024-09-17T02:56:41.246461+0000","last_clean":"2024-09-17T02:56:41.246461+0000","last_became_active":"2024-09-17T02:56:40.257059+0000","last_became_peered":"2024-09-17T02:56:40.257059+0000","last_unstale":"2024-09-17T02:56:41.246461+0000","last_undegraded":"2024-09-17T02:56:41.246461+0000","last_fullsized":"2024-09-17T02:56:41.246461+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:32.694137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.261187+0000","last_change":"2024-09-17T02:56:40.260967+0000","last_active":"2024-09-17T02:56:40.261187+0000","last_peered":"2024-09-17T02:56:40.261187+0000","last_clean":"2024-09-17T02:56:40.261187+0000","last_became_active":"2024-09-17T02:56:40.260577+0000","last_became_peered":"2024-09-17T02:56:40.260577+0000","last_unstale":"2024-09-17T02:56:40.261187+0000","last_undegraded":"2024-09-17T02:56:40.261187+0000","last_fullsized":"2024-09-17T02:56:40.261187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:15.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.255603+0000","last_change":"2024-09-17T02:56:40.253526+0000","last_active":"2024-09-17T02:56:40.255603+0000","last_peered":"2024-09-17T02:56:40.255603+0000","last_clean":"2024-09-17T02:56:40.255603+0000","last_became_active":"2024-09-17T02:56:40.253250+0000","last_became_peered":"2024-09-17T02:56:40.253250+0000","last_unstale":"2024-09-17T02:56:40.255603+0000","last_undegraded":"2024-09-17T02:56:40.255603+0000","last_fullsized":"2024-09-17T02:56:40.255603+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:00.387561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.254193+0000","last_change":"2024-09-17T02:56:40.251987+0000","last_active":"2024-09-17T02:56:40.254193+0000","last_peered":"2024-09-17T02:56:40.254193+0000","last_clean":"2024-09-17T02:56:40.254193+0000","last_became_active":"2024-09-17T02:56:40.251696+0000","last_became_peered":"2024-09-17T02:56:40.251696+0000","last_unstale":"2024-09-17T02:56:40.254193+0000","last_undegraded":"2024-09-17T02:56:40.254193+0000","last_fullsized":"2024-09-17T02:56:40.254193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:21.763486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249268+0000","last_change":"2024-09-17T02:56:40.254265+0000","last_active":"2024-09-17T02:56:41.249268+0000","last_peered":"2024-09-17T02:56:41.249268+0000","last_clean":"2024-09-17T02:56:41.249268+0000","last_became_active":"2024-09-17T02:56:40.253939+0000","last_became_peered":"2024-09-17T02:56:40.253939+0000","last_unstale":"2024-09-17T02:56:41.249268+0000","last_undegraded":"2024-09-17T02:56:41.249268+0000","last_fullsized":"2024-09-17T02:56:41.249268+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:35.816185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257936+0000","last_change":"2024-09-17T02:56:40.257516+0000","last_active":"2024-09-17T02:56:40.257936+0000","last_peered":"2024-09-17T02:56:40.257936+0000","last_clean":"2024-09-17T02:56:40.257936+0000","last_became_active":"2024-09-17T02:56:40.256056+0000","last_became_peered":"2024-09-17T02:56:40.256056+0000","last_unstale":"2024-09-17T02:56:40.257936+0000","last_undegraded":"2024-09-17T02:56:40.257936+0000","last_fullsized":"2024-09-17T02:56:40.257936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:28.970495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249177+0000","last_change":"2024-09-17T02:56:40.261509+0000","last_active":"2024-09-17T02:56:41.249177+0000","last_peered":"2024-09-17T02:56:41.249177+0000","last_clean":"2024-09-17T02:56:41.249177+0000","last_became_active":"2024-09-17T02:56:40.261261+0000","last_became_peered":"2024-09-17T02:56:40.261261+0000","last_unstale":"2024-09-17T02:56:41.249177+0000","last_undegraded":"2024-09-17T02:56:41.249177+0000","last_fullsized":"2024-09-17T02:56:41.249177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:39.212818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467600+0000","last_change":"2024-09-17T02:56:40.258211+0000","last_active":"2024-09-17T02:56:41.467600+0000","last_peered":"2024-09-17T02:56:41.467600+0000","last_clean":"2024-09-17T02:56:41.467600+0000","last_became_active":"2024-09-17T02:56:40.257843+0000","last_became_peered":"2024-09-17T02:56:40.257843+0000","last_unstale":"2024-09-17T02:56:41.467600+0000","last_undegraded":"2024-09-17T02:56:41.467600+0000","last_fullsized":"2024-09-17T02:56:41.467600+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:03.332143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467598+0000","last_change":"2024-09-17T02:56:40.255814+0000","last_active":"2024-09-17T02:56:41.467598+0000","last_peered":"2024-09-17T02:56:41.467598+0000","last_clean":"2024-09-17T02:56:41.467598+0000","last_became_active":"2024-09-17T02:56:40.255490+0000","last_became_peered":"2024-09-17T02:56:40.255490+0000","last_unstale":"2024-09-17T02:56:41.467598+0000","last_undegraded":"2024-09-17T02:56:41.467598+0000","last_fullsized":"2024-09-17T02:56:41.467598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.491954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258797+0000","last_change":"2024-09-17T02:56:40.257407+0000","last_active":"2024-09-17T02:56:40.258797+0000","last_peered":"2024-09-17T02:56:40.258797+0000","last_clean":"2024-09-17T02:56:40.258797+0000","last_became_active":"2024-09-17T02:56:40.256776+0000","last_became_peered":"2024-09-17T02:56:40.256776+0000","last_unstale":"2024-09-17T02:56:40.258797+0000","last_undegraded":"2024-09-17T02:56:40.258797+0000","last_fullsized":"2024-09-17T02:56:40.258797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:13.118261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.248997+0000","last_change":"2024-09-17T02:56:40.261385+0000","last_active":"2024-09-17T02:56:41.248997+0000","last_peered":"2024-09-17T02:56:41.248997+0000","last_clean":"2024-09-17T02:56:41.248997+0000","last_became_active":"2024-09-17T02:56:40.261046+0000","last_became_peered":"2024-09-17T02:56:40.261046+0000","last_unstale":"2024-09-17T02:56:41.248997+0000","last_undegraded":"2024-09-17T02:56:41.248997+0000","last_fullsized":"2024-09-17T02:56:41.248997+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:21.934662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249447+0000","last_change":"2024-09-17T02:56:40.249770+0000","last_active":"2024-09-17T02:56:41.249447+0000","last_peered":"2024-09-17T02:56:41.249447+0000","last_clean":"2024-09-17T02:56:41.249447+0000","last_became_active":"2024-09-17T02:56:40.249397+0000","last_became_peered":"2024-09-17T02:56:40.249397+0000","last_unstale":"2024-09-17T02:56:41.249447+0000","last_undegraded":"2024-09-17T02:56:41.249447+0000","last_fullsized":"2024-09-17T02:56:41.249447+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:57.446039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249588+0000","last_change":"2024-09-17T02:56:40.258607+0000","last_active":"2024-09-17T02:56:41.249588+0000","last_peered":"2024-09-17T02:56:41.249588+0000","last_clean":"2024-09-17T02:56:41.249588+0000","last_became_active":"2024-09-17T02:56:40.257249+0000","last_became_peered":"2024-09-17T02:56:40.257249+0000","last_unstale":"2024-09-17T02:56:41.249588+0000","last_undegraded":"2024-09-17T02:56:41.249588+0000","last_fullsized":"2024-09-17T02:56:41.249588+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:59.781673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.255349+0000","last_change":"2024-09-17T02:56:40.255099+0000","last_active":"2024-09-17T02:56:40.255349+0000","last_peered":"2024-09-17T02:56:40.255349+0000","last_clean":"2024-09-17T02:56:40.255349+0000","last_became_active":"2024-09-17T02:56:40.254798+0000","last_became_peered":"2024-09-17T02:56:40.254798+0000","last_unstale":"2024-09-17T02:56:40.255349+0000","last_undegraded":"2024-09-17T02:56:40.255349+0000","last_fullsized":"2024-09-17T02:56:40.255349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:51.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.256994+0000","last_change":"2024-09-17T02:56:40.255060+0000","last_active":"2024-09-17T02:56:40.256994+0000","last_peered":"2024-09-17T02:56:40.256994+0000","last_clean":"2024-09-17T02:56:40.256994+0000","last_became_active":"2024-09-17T02:56:40.254783+0000","last_became_peered":"2024-09-17T02:56:40.254783+0000","last_unstale":"2024-09-17T02:56:40.256994+0000","last_undegraded":"2024-09-17T02:56:40.256994+0000","last_fullsized":"2024-09-17T02:56:40.256994+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:51.984870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246649+0000","last_change":"2024-09-17T02:56:40.263456+0000","last_active":"2024-09-17T02:56:41.246649+0000","last_peered":"2024-09-17T02:56:41.246649+0000","last_clean":"2024-09-17T02:56:41.246649+0000","last_became_active":"2024-09-17T02:56:40.263227+0000","last_became_peered":"2024-09-17T02:56:40.263227+0000","last_unstale":"2024-09-17T02:56:41.246649+0000","last_undegraded":"2024-09-17T02:56:41.246649+0000","last_fullsized":"2024-09-17T02:56:41.246649+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:59.347301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.259733+0000","last_change":"2024-09-17T02:56:40.259542+0000","last_active":"2024-09-17T02:56:40.259733+0000","last_peered":"2024-09-17T02:56:40.259733+0000","last_clean":"2024-09-17T02:56:40.259733+0000","last_became_active":"2024-09-17T02:56:40.258761+0000","last_became_peered":"2024-09-17T02:56:40.258761+0000","last_unstale":"2024-09-17T02:56:40.259733+0000","last_undegraded":"2024-09-17T02:56:40.259733+0000","last_fullsized":"2024-09-17T02:56:40.259733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:40.292450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257152+0000","last_change":"2024-09-17T02:56:40.256892+0000","last_active":"2024-09-17T02:56:40.257152+0000","last_peered":"2024-09-17T02:56:40.257152+0000","last_clean":"2024-09-17T02:56:40.257152+0000","last_became_active":"2024-09-17T02:56:40.256642+0000","last_became_peered":"2024-09-17T02:56:40.256642+0000","last_unstale":"2024-09-17T02:56:40.257152+0000","last_undegraded":"2024-09-17T02:56:40.257152+0000","last_fullsized":"2024-09-17T02:56:40.257152+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:48.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246476+0000","last_change":"2024-09-17T02:56:40.258565+0000","last_active":"2024-09-17T02:56:41.246476+0000","last_peered":"2024-09-17T02:56:41.246476+0000","last_clean":"2024-09-17T02:56:41.246476+0000","last_became_active":"2024-09-17T02:56:40.256969+0000","last_became_peered":"2024-09-17T02:56:40.256969+0000","last_unstale":"2024-09-17T02:56:41.246476+0000","last_undegraded":"2024-09-17T02:56:41.246476+0000","last_fullsized":"2024-09-17T02:56:41.246476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:18.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.252595+0000","last_change":"2024-09-17T02:56:40.251805+0000","last_active":"2024-09-17T02:56:40.252595+0000","last_peered":"2024-09-17T02:56:40.252595+0000","last_clean":"2024-09-17T02:56:40.252595+0000","last_became_active":"2024-09-17T02:56:40.251532+0000","last_became_peered":"2024-09-17T02:56:40.251532+0000","last_unstale":"2024-09-17T02:56:40.252595+0000","last_undegraded":"2024-09-17T02:56:40.252595+0000","last_fullsized":"2024-09-17T02:56:40.252595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:09.534448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246844+0000","last_change":"2024-09-17T02:56:40.259797+0000","last_active":"2024-09-17T02:56:41.246844+0000","last_peered":"2024-09-17T02:56:41.246844+0000","last_clean":"2024-09-17T02:56:41.246844+0000","last_became_active":"2024-09-17T02:56:40.258703+0000","last_became_peered":"2024-09-17T02:56:40.258703+0000","last_unstale":"2024-09-17T02:56:41.246844+0000","last_undegraded":"2024-09-17T02:56:41.246844+0000","last_fullsized":"2024-09-17T02:56:41.246844+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:28.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.248815+0000","last_change":"2024-09-17T02:56:40.261294+0000","last_active":"2024-09-17T02:56:41.248815+0000","last_peered":"2024-09-17T02:56:41.248815+0000","last_clean":"2024-09-17T02:56:41.248815+0000","last_became_active":"2024-09-17T02:56:40.260998+0000","last_became_peered":"2024-09-17T02:56:40.260998+0000","last_unstale":"2024-09-17T02:56:41.248815+0000","last_undegraded":"2024-09-17T02:56:41.248815+0000","last_fullsized":"2024-09-17T02:56:41.248815+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:18.640194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258584+0000","last_change":"2024-09-17T02:56:40.258392+0000","last_active":"2024-09-17T02:56:40.258584+0000","last_peered":"2024-09-17T02:56:40.258584+0000","last_clean":"2024-09-17T02:56:40.258584+0000","last_became_active":"2024-09-17T02:56:40.258112+0000","last_became_peered":"2024-09-17T02:56:40.258112+0000","last_unstale":"2024-09-17T02:56:40.258584+0000","last_undegraded":"2024-09-17T02:56:40.258584+0000","last_fullsized":"2024-09-17T02:56:40.258584+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:31.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258879+0000","last_change":"2024-09-17T02:56:40.258200+0000","last_active":"2024-09-17T02:56:40.258879+0000","last_peered":"2024-09-17T02:56:40.258879+0000","last_clean":"2024-09-17T02:56:40.258879+0000","last_became_active":"2024-09-17T02:56:40.256262+0000","last_became_peered":"2024-09-17T02:56:40.256262+0000","last_unstale":"2024-09-17T02:56:40.258879+0000","last_undegraded":"2024-09-17T02:56:40.258879+0000","last_fullsized":"2024-09-17T02:56:40.258879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:18.221755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.256072+0000","last_change":"2024-09-17T02:56:40.255804+0000","last_active":"2024-09-17T02:56:40.256072+0000","last_peered":"2024-09-17T02:56:40.256072+0000","last_clean":"2024-09-17T02:56:40.256072+0000","last_became_active":"2024-09-17T02:56:40.255031+0000","last_became_peered":"2024-09-17T02:56:40.255031+0000","last_unstale":"2024-09-17T02:56:40.256072+0000","last_undegraded":"2024-09-17T02:56:40.256072+0000","last_fullsized":"2024-09-17T02:56:40.256072+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:10.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258483+0000","last_change":"2024-09-17T02:56:40.258271+0000","last_active":"2024-09-17T02:56:40.258483+0000","last_peered":"2024-09-17T02:56:40.258483+0000","last_clean":"2024-09-17T02:56:40.258483+0000","last_became_active":"2024-09-17T02:56:40.257989+0000","last_became_peered":"2024-09-17T02:56:40.257989+0000","last_unstale":"2024-09-17T02:56:40.258483+0000","last_undegraded":"2024-09-17T02:56:40.258483+0000","last_fullsized":"2024-09-17T02:56:40.258483+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:27.715699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257130+0000","last_change":"2024-09-17T02:56:40.256605+0000","last_active":"2024-09-17T02:56:40.257130+0000","last_peered":"2024-09-17T02:56:40.257130+0000","last_clean":"2024-09-17T02:56:40.257130+0000","last_became_active":"2024-09-17T02:56:40.256322+0000","last_became_peered":"2024-09-17T02:56:40.256322+0000","last_unstale":"2024-09-17T02:56:40.257130+0000","last_undegraded":"2024-09-17T02:56:40.257130+0000","last_fullsized":"2024-09-17T02:56:40.257130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:40.419183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247280+0000","last_change":"2024-09-17T02:56:40.255142+0000","last_active":"2024-09-17T02:56:41.247280+0000","last_peered":"2024-09-17T02:56:41.247280+0000","last_clean":"2024-09-17T02:56:41.247280+0000","last_became_active":"2024-09-17T02:56:40.254488+0000","last_became_peered":"2024-09-17T02:56:40.254488+0000","last_unstale":"2024-09-17T02:56:41.247280+0000","last_undegraded":"2024-09-17T02:56:41.247280+0000","last_fullsized":"2024-09-17T02:56:41.247280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:03.346484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.259984+0000","last_change":"2024-09-17T02:56:40.259789+0000","last_active":"2024-09-17T02:56:40.259984+0000","last_peered":"2024-09-17T02:56:40.259984+0000","last_clean":"2024-09-17T02:56:40.259984+0000","last_became_active":"2024-09-17T02:56:40.259477+0000","last_became_peered":"2024-09-17T02:56:40.259477+0000","last_unstale":"2024-09-17T02:56:40.259984+0000","last_undegraded":"2024-09-17T02:56:40.259984+0000","last_fullsized":"2024-09-17T02:56:40.259984+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:55.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.256425+0000","last_change":"2024-09-17T02:56:40.256224+0000","last_active":"2024-09-17T02:56:40.256425+0000","last_peered":"2024-09-17T02:56:40.256425+0000","last_clean":"2024-09-17T02:56:40.256425+0000","last_became_active":"2024-09-17T02:56:40.255415+0000","last_became_peered":"2024-09-17T02:56:40.255415+0000","last_unstale":"2024-09-17T02:56:40.256425+0000","last_undegraded":"2024-09-17T02:56:40.256425+0000","last_fullsized":"2024-09-17T02:56:40.256425+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:52.019394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260045+0000","last_change":"2024-09-17T02:56:40.259509+0000","last_active":"2024-09-17T02:56:40.260045+0000","last_peered":"2024-09-17T02:56:40.260045+0000","last_clean":"2024-09-17T02:56:40.260045+0000","last_became_active":"2024-09-17T02:56:40.258168+0000","last_became_peered":"2024-09-17T02:56:40.258168+0000","last_unstale":"2024-09-17T02:56:40.260045+0000","last_undegraded":"2024-09-17T02:56:40.260045+0000","last_fullsized":"2024-09-17T02:56:40.260045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:46.555569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"65'4","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.272626+0000","last_change":"2024-09-17T02:56:39.258398+0000","last_active":"2024-09-17T02:56:40.272626+0000","last_peered":"2024-09-17T02:56:40.272626+0000","last_clean":"2024-09-17T02:56:40.272626+0000","last_became_active":"2024-09-17T02:56:39.256782+0000","last_became_peered":"2024-09-17T02:56:39.256782+0000","last_unstale":"2024-09-17T02:56:40.272626+0000","last_undegraded":"2024-09-17T02:56:40.272626+0000","last_fullsized":"2024-09-17T02:56:40.272626+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:18.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467354+0000","last_change":"2024-09-17T02:56:40.260736+0000","last_active":"2024-09-17T02:56:41.467354+0000","last_peered":"2024-09-17T02:56:41.467354+0000","last_clean":"2024-09-17T02:56:41.467354+0000","last_became_active":"2024-09-17T02:56:40.260468+0000","last_became_peered":"2024-09-17T02:56:40.260468+0000","last_unstale":"2024-09-17T02:56:41.467354+0000","last_undegraded":"2024-09-17T02:56:41.467354+0000","last_fullsized":"2024-09-17T02:56:41.467354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:06.250730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.272468+0000","last_change":"2024-09-17T02:56:39.255977+0000","last_active":"2024-09-17T02:56:40.272468+0000","last_peered":"2024-09-17T02:56:40.272468+0000","last_clean":"2024-09-17T02:56:40.272468+0000","last_became_active":"2024-09-17T02:56:39.255243+0000","last_became_peered":"2024-09-17T02:56:39.255243+0000","last_unstale":"2024-09-17T02:56:40.272468+0000","last_undegraded":"2024-09-17T02:56:40.272468+0000","last_fullsized":"2024-09-17T02:56:40.272468+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:15.632283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260396+0000","last_change":"2024-09-17T02:56:40.260162+0000","last_active":"2024-09-17T02:56:40.260396+0000","last_peered":"2024-09-17T02:56:40.260396+0000","last_clean":"2024-09-17T02:56:40.260396+0000","last_became_active":"2024-09-17T02:56:40.259779+0000","last_became_peered":"2024-09-17T02:56:40.259779+0000","last_unstale":"2024-09-17T02:56:40.260396+0000","last_undegraded":"2024-09-17T02:56:40.260396+0000","last_fullsized":"2024-09-17T02:56:40.260396+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:23.507266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.272557+0000","last_change":"2024-09-17T02:56:39.257132+0000","last_active":"2024-09-17T02:56:40.272557+0000","last_peered":"2024-09-17T02:56:40.272557+0000","last_clean":"2024-09-17T02:56:40.272557+0000","last_became_active":"2024-09-17T02:56:39.254964+0000","last_became_peered":"2024-09-17T02:56:39.254964+0000","last_unstale":"2024-09-17T02:56:40.272557+0000","last_undegraded":"2024-09-17T02:56:40.272557+0000","last_fullsized":"2024-09-17T02:56:40.272557+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:20.513156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.263043+0000","last_change":"2024-09-17T02:56:40.262709+0000","last_active":"2024-09-17T02:56:40.263043+0000","last_peered":"2024-09-17T02:56:40.263043+0000","last_clean":"2024-09-17T02:56:40.263043+0000","last_became_active":"2024-09-17T02:56:40.262267+0000","last_became_peered":"2024-09-17T02:56:40.262267+0000","last_unstale":"2024-09-17T02:56:40.263043+0000","last_undegraded":"2024-09-17T02:56:40.263043+0000","last_fullsized":"2024-09-17T02:56:40.263043+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:12.775808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273657+0000","last_change":"2024-09-17T02:56:39.258513+0000","last_active":"2024-09-17T02:56:40.273657+0000","last_peered":"2024-09-17T02:56:40.273657+0000","last_clean":"2024-09-17T02:56:40.273657+0000","last_became_active":"2024-09-17T02:56:39.258197+0000","last_became_peered":"2024-09-17T02:56:39.258197+0000","last_unstale":"2024-09-17T02:56:40.273657+0000","last_undegraded":"2024-09-17T02:56:40.273657+0000","last_fullsized":"2024-09-17T02:56:40.273657+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:48.051626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.253790+0000","last_change":"2024-09-17T02:56:40.253342+0000","last_active":"2024-09-17T02:56:40.253790+0000","last_peered":"2024-09-17T02:56:40.253790+0000","last_clean":"2024-09-17T02:56:40.253790+0000","last_became_active":"2024-09-17T02:56:40.253059+0000","last_became_peered":"2024-09-17T02:56:40.253059+0000","last_unstale":"2024-09-17T02:56:40.253790+0000","last_undegraded":"2024-09-17T02:56:40.253790+0000","last_fullsized":"2024-09-17T02:56:40.253790+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:08.111926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"65'1","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249742+0000","last_change":"2024-09-17T02:56:39.250390+0000","last_active":"2024-09-17T02:56:41.249742+0000","last_peered":"2024-09-17T02:56:41.249742+0000","last_clean":"2024-09-17T02:56:41.249742+0000","last_became_active":"2024-09-17T02:56:39.248965+0000","last_became_peered":"2024-09-17T02:56:39.248965+0000","last_unstale":"2024-09-17T02:56:41.249742+0000","last_undegraded":"2024-09-17T02:56:41.249742+0000","last_fullsized":"2024-09-17T02:56:41.249742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:00.018505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260735+0000","last_change":"2024-09-17T02:56:40.259839+0000","last_active":"2024-09-17T02:56:40.260735+0000","last_peered":"2024-09-17T02:56:40.260735+0000","last_clean":"2024-09-17T02:56:40.260735+0000","last_became_active":"2024-09-17T02:56:40.258694+0000","last_became_peered":"2024-09-17T02:56:40.258694+0000","last_unstale":"2024-09-17T02:56:40.260735+0000","last_undegraded":"2024-09-17T02:56:40.260735+0000","last_fullsized":"2024-09-17T02:56:40.260735+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:37.634885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.272705+0000","last_change":"2024-09-17T02:56:39.257808+0000","last_active":"2024-09-17T02:56:40.272705+0000","last_peered":"2024-09-17T02:56:40.272705+0000","last_clean":"2024-09-17T02:56:40.272705+0000","last_became_active":"2024-09-17T02:56:39.254041+0000","last_became_peered":"2024-09-17T02:56:39.254041+0000","last_unstale":"2024-09-17T02:56:40.272705+0000","last_undegraded":"2024-09-17T02:56:40.272705+0000","last_fullsized":"2024-09-17T02:56:40.272705+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:16.439547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249048+0000","last_change":"2024-09-17T02:56:40.251542+0000","last_active":"2024-09-17T02:56:41.249048+0000","last_peered":"2024-09-17T02:56:41.249048+0000","last_clean":"2024-09-17T02:56:41.249048+0000","last_became_active":"2024-09-17T02:56:40.251186+0000","last_became_peered":"2024-09-17T02:56:40.251186+0000","last_unstale":"2024-09-17T02:56:41.249048+0000","last_undegraded":"2024-09-17T02:56:41.249048+0000","last_fullsized":"2024-09-17T02:56:41.249048+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:27.559868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.254742+0000","last_change":"2024-09-17T02:56:39.252737+0000","last_active":"2024-09-17T02:56:40.254742+0000","last_peered":"2024-09-17T02:56:40.254742+0000","last_clean":"2024-09-17T02:56:40.254742+0000","last_became_active":"2024-09-17T02:56:39.252404+0000","last_became_peered":"2024-09-17T02:56:39.252404+0000","last_unstale":"2024-09-17T02:56:40.254742+0000","last_undegraded":"2024-09-17T02:56:40.254742+0000","last_fullsized":"2024-09-17T02:56:40.254742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:02.769836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260606+0000","last_change":"2024-09-17T02:56:40.260296+0000","last_active":"2024-09-17T02:56:40.260606+0000","last_peered":"2024-09-17T02:56:40.260606+0000","last_clean":"2024-09-17T02:56:40.260606+0000","last_became_active":"2024-09-17T02:56:40.258357+0000","last_became_peered":"2024-09-17T02:56:40.258357+0000","last_unstale":"2024-09-17T02:56:40.260606+0000","last_undegraded":"2024-09-17T02:56:40.260606+0000","last_fullsized":"2024-09-17T02:56:40.260606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:05.400661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249742+0000","last_change":"2024-09-17T02:56:39.252256+0000","last_active":"2024-09-17T02:56:41.249742+0000","last_peered":"2024-09-17T02:56:41.249742+0000","last_clean":"2024-09-17T02:56:41.249742+0000","last_became_active":"2024-09-17T02:56:39.251978+0000","last_became_peered":"2024-09-17T02:56:39.251978+0000","last_unstale":"2024-09-17T02:56:41.249742+0000","last_undegraded":"2024-09-17T02:56:41.249742+0000","last_fullsized":"2024-09-17T02:56:41.249742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:08.009188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249590+0000","last_change":"2024-09-17T02:56:40.259070+0000","last_active":"2024-09-17T02:56:41.249590+0000","last_peered":"2024-09-17T02:56:41.249590+0000","last_clean":"2024-09-17T02:56:41.249590+0000","last_became_active":"2024-09-17T02:56:40.258500+0000","last_became_peered":"2024-09-17T02:56:40.258500+0000","last_unstale":"2024-09-17T02:56:41.249590+0000","last_undegraded":"2024-09-17T02:56:41.249590+0000","last_fullsized":"2024-09-17T02:56:41.249590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:44.331230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247243+0000","last_change":"2024-09-17T02:56:39.252585+0000","last_active":"2024-09-17T02:56:41.247243+0000","last_peered":"2024-09-17T02:56:41.247243+0000","last_clean":"2024-09-17T02:56:41.247243+0000","last_became_active":"2024-09-17T02:56:39.252111+0000","last_became_peered":"2024-09-17T02:56:39.252111+0000","last_unstale":"2024-09-17T02:56:41.247243+0000","last_undegraded":"2024-09-17T02:56:41.247243+0000","last_fullsized":"2024-09-17T02:56:41.247243+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:59.038513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246684+0000","last_change":"2024-09-17T02:56:40.257778+0000","last_active":"2024-09-17T02:56:41.246684+0000","last_peered":"2024-09-17T02:56:41.246684+0000","last_clean":"2024-09-17T02:56:41.246684+0000","last_became_active":"2024-09-17T02:56:40.256565+0000","last_became_peered":"2024-09-17T02:56:40.256565+0000","last_unstale":"2024-09-17T02:56:41.246684+0000","last_undegraded":"2024-09-17T02:56:41.246684+0000","last_fullsized":"2024-09-17T02:56:41.246684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:24.376090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.250403+0000","last_change":"2024-09-17T02:56:39.251402+0000","last_active":"2024-09-17T02:56:40.250403+0000","last_peered":"2024-09-17T02:56:40.250403+0000","last_clean":"2024-09-17T02:56:40.250403+0000","last_became_active":"2024-09-17T02:56:39.251139+0000","last_became_peered":"2024-09-17T02:56:39.251139+0000","last_unstale":"2024-09-17T02:56:40.250403+0000","last_undegraded":"2024-09-17T02:56:40.250403+0000","last_fullsized":"2024-09-17T02:56:40.250403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:08.438263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467346+0000","last_change":"2024-09-17T02:56:40.260972+0000","last_active":"2024-09-17T02:56:41.467346+0000","last_peered":"2024-09-17T02:56:41.467346+0000","last_clean":"2024-09-17T02:56:41.467346+0000","last_became_active":"2024-09-17T02:56:40.259435+0000","last_became_peered":"2024-09-17T02:56:40.259435+0000","last_unstale":"2024-09-17T02:56:41.467346+0000","last_undegraded":"2024-09-17T02:56:41.467346+0000","last_fullsized":"2024-09-17T02:56:41.467346+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:38.767421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"65'3","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247108+0000","last_change":"2024-09-17T02:56:39.251192+0000","last_active":"2024-09-17T02:56:41.247108+0000","last_peered":"2024-09-17T02:56:41.247108+0000","last_clean":"2024-09-17T02:56:41.247108+0000","last_became_active":"2024-09-17T02:56:39.250931+0000","last_became_peered":"2024-09-17T02:56:39.250931+0000","last_unstale":"2024-09-17T02:56:41.247108+0000","last_undegraded":"2024-09-17T02:56:41.247108+0000","last_fullsized":"2024-09-17T02:56:41.247108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:20.631936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247022+0000","last_change":"2024-09-17T02:56:40.259493+0000","last_active":"2024-09-17T02:56:41.247022+0000","last_peered":"2024-09-17T02:56:41.247022+0000","last_clean":"2024-09-17T02:56:41.247022+0000","last_became_active":"2024-09-17T02:56:40.258293+0000","last_became_peered":"2024-09-17T02:56:40.258293+0000","last_unstale":"2024-09-17T02:56:41.247022+0000","last_undegraded":"2024-09-17T02:56:41.247022+0000","last_fullsized":"2024-09-17T02:56:41.247022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:30.333324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"65'6","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249580+0000","last_change":"2024-09-17T02:56:39.247250+0000","last_active":"2024-09-17T02:56:41.249580+0000","last_peered":"2024-09-17T02:56:41.249580+0000","last_clean":"2024-09-17T02:56:41.249580+0000","last_became_active":"2024-09-17T02:56:39.246966+0000","last_became_peered":"2024-09-17T02:56:39.246966+0000","last_unstale":"2024-09-17T02:56:41.249580+0000","last_undegraded":"2024-09-17T02:56:41.249580+0000","last_fullsized":"2024-09-17T02:56:41.249580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:23.795978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.259178+0000","last_change":"2024-09-17T02:56:40.258967+0000","last_active":"2024-09-17T02:56:40.259178+0000","last_peered":"2024-09-17T02:56:40.259178+0000","last_clean":"2024-09-17T02:56:40.259178+0000","last_became_active":"2024-09-17T02:56:40.257945+0000","last_became_peered":"2024-09-17T02:56:40.257945+0000","last_unstale":"2024-09-17T02:56:40.259178+0000","last_undegraded":"2024-09-17T02:56:40.259178+0000","last_fullsized":"2024-09-17T02:56:40.259178+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:22.994269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273515+0000","last_change":"2024-09-17T02:56:39.251967+0000","last_active":"2024-09-17T02:56:40.273515+0000","last_peered":"2024-09-17T02:56:40.273515+0000","last_clean":"2024-09-17T02:56:40.273515+0000","last_became_active":"2024-09-17T02:56:39.251669+0000","last_became_peered":"2024-09-17T02:56:39.251669+0000","last_unstale":"2024-09-17T02:56:40.273515+0000","last_undegraded":"2024-09-17T02:56:40.273515+0000","last_fullsized":"2024-09-17T02:56:40.273515+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:11.628369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246656+0000","last_change":"2024-09-17T02:56:40.252179+0000","last_active":"2024-09-17T02:56:41.246656+0000","last_peered":"2024-09-17T02:56:41.246656+0000","last_clean":"2024-09-17T02:56:41.246656+0000","last_became_active":"2024-09-17T02:56:40.251913+0000","last_became_peered":"2024-09-17T02:56:40.251913+0000","last_unstale":"2024-09-17T02:56:41.246656+0000","last_undegraded":"2024-09-17T02:56:41.246656+0000","last_fullsized":"2024-09-17T02:56:41.246656+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:46.193785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249433+0000","last_change":"2024-09-17T02:56:39.250925+0000","last_active":"2024-09-17T02:56:41.249433+0000","last_peered":"2024-09-17T02:56:41.249433+0000","last_clean":"2024-09-17T02:56:41.249433+0000","last_became_active":"2024-09-17T02:56:39.250209+0000","last_became_peered":"2024-09-17T02:56:39.250209+0000","last_unstale":"2024-09-17T02:56:41.249433+0000","last_undegraded":"2024-09-17T02:56:41.249433+0000","last_fullsized":"2024-09-17T02:56:41.249433+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:52.158602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249804+0000","last_change":"2024-09-17T02:56:40.250817+0000","last_active":"2024-09-17T02:56:41.249804+0000","last_peered":"2024-09-17T02:56:41.249804+0000","last_clean":"2024-09-17T02:56:41.249804+0000","last_became_active":"2024-09-17T02:56:40.250501+0000","last_became_peered":"2024-09-17T02:56:40.250501+0000","last_unstale":"2024-09-17T02:56:41.249804+0000","last_undegraded":"2024-09-17T02:56:41.249804+0000","last_fullsized":"2024-09-17T02:56:41.249804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:45.348070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.252628+0000","last_change":"2024-09-17T02:56:39.255051+0000","last_active":"2024-09-17T02:56:40.252628+0000","last_peered":"2024-09-17T02:56:40.252628+0000","last_clean":"2024-09-17T02:56:40.252628+0000","last_became_active":"2024-09-17T02:56:39.254771+0000","last_became_peered":"2024-09-17T02:56:39.254771+0000","last_unstale":"2024-09-17T02:56:40.252628+0000","last_undegraded":"2024-09-17T02:56:40.252628+0000","last_fullsized":"2024-09-17T02:56:40.252628+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:50.646086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246564+0000","last_change":"2024-09-17T02:56:40.251461+0000","last_active":"2024-09-17T02:56:41.246564+0000","last_peered":"2024-09-17T02:56:41.246564+0000","last_clean":"2024-09-17T02:56:41.246564+0000","last_became_active":"2024-09-17T02:56:40.251186+0000","last_became_peered":"2024-09-17T02:56:40.251186+0000","last_unstale":"2024-09-17T02:56:41.246564+0000","last_undegraded":"2024-09-17T02:56:41.246564+0000","last_fullsized":"2024-09-17T02:56:41.246564+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:02.431576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"65'8","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247185+0000","last_change":"2024-09-17T02:56:39.253806+0000","last_active":"2024-09-17T02:56:41.247185+0000","last_peered":"2024-09-17T02:56:41.247185+0000","last_clean":"2024-09-17T02:56:41.247185+0000","last_became_active":"2024-09-17T02:56:39.253252+0000","last_became_peered":"2024-09-17T02:56:39.253252+0000","last_unstale":"2024-09-17T02:56:41.247185+0000","last_undegraded":"2024-09-17T02:56:41.247185+0000","last_fullsized":"2024-09-17T02:56:41.247185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:33.103976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246928+0000","last_change":"2024-09-17T02:56:40.254817+0000","last_active":"2024-09-17T02:56:41.246928+0000","last_peered":"2024-09-17T02:56:41.246928+0000","last_clean":"2024-09-17T02:56:41.246928+0000","last_became_active":"2024-09-17T02:56:40.254115+0000","last_became_peered":"2024-09-17T02:56:40.254115+0000","last_unstale":"2024-09-17T02:56:41.246928+0000","last_undegraded":"2024-09-17T02:56:41.246928+0000","last_fullsized":"2024-09-17T02:56:41.246928+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:23.071855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273506+0000","last_change":"2024-09-17T02:56:39.255693+0000","last_active":"2024-09-17T02:56:40.273506+0000","last_peered":"2024-09-17T02:56:40.273506+0000","last_clean":"2024-09-17T02:56:40.273506+0000","last_became_active":"2024-09-17T02:56:39.251990+0000","last_became_peered":"2024-09-17T02:56:39.251990+0000","last_unstale":"2024-09-17T02:56:40.273506+0000","last_undegraded":"2024-09-17T02:56:40.273506+0000","last_fullsized":"2024-09-17T02:56:40.273506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:13.614834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258855+0000","last_change":"2024-09-17T02:56:40.257741+0000","last_active":"2024-09-17T02:56:40.258855+0000","last_peered":"2024-09-17T02:56:40.258855+0000","last_clean":"2024-09-17T02:56:40.258855+0000","last_became_active":"2024-09-17T02:56:40.256599+0000","last_became_peered":"2024-09-17T02:56:40.256599+0000","last_unstale":"2024-09-17T02:56:40.258855+0000","last_undegraded":"2024-09-17T02:56:40.258855+0000","last_fullsized":"2024-09-17T02:56:40.258855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.383844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273365+0000","last_change":"2024-09-17T02:56:39.256599+0000","last_active":"2024-09-17T02:56:40.273365+0000","last_peered":"2024-09-17T02:56:40.273365+0000","last_clean":"2024-09-17T02:56:40.273365+0000","last_became_active":"2024-09-17T02:56:39.254504+0000","last_became_peered":"2024-09-17T02:56:39.254504+0000","last_unstale":"2024-09-17T02:56:40.273365+0000","last_undegraded":"2024-09-17T02:56:40.273365+0000","last_fullsized":"2024-09-17T02:56:40.273365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:23.776693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.256966+0000","last_change":"2024-09-17T02:56:40.254366+0000","last_active":"2024-09-17T02:56:40.256966+0000","last_peered":"2024-09-17T02:56:40.256966+0000","last_clean":"2024-09-17T02:56:40.256966+0000","last_became_active":"2024-09-17T02:56:40.254061+0000","last_became_peered":"2024-09-17T02:56:40.254061+0000","last_unstale":"2024-09-17T02:56:40.256966+0000","last_undegraded":"2024-09-17T02:56:40.256966+0000","last_fullsized":"2024-09-17T02:56:40.256966+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:00.579716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273804+0000","last_change":"2024-09-17T02:56:39.257740+0000","last_active":"2024-09-17T02:56:40.273804+0000","last_peered":"2024-09-17T02:56:40.273804+0000","last_clean":"2024-09-17T02:56:40.273804+0000","last_became_active":"2024-09-17T02:56:39.257090+0000","last_became_peered":"2024-09-17T02:56:39.257090+0000","last_unstale":"2024-09-17T02:56:40.273804+0000","last_undegraded":"2024-09-17T02:56:40.273804+0000","last_fullsized":"2024-09-17T02:56:40.273804+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:56.758219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246870+0000","last_change":"2024-09-17T02:56:40.257289+0000","last_active":"2024-09-17T02:56:41.246870+0000","last_peered":"2024-09-17T02:56:41.246870+0000","last_clean":"2024-09-17T02:56:41.246870+0000","last_became_active":"2024-09-17T02:56:40.256209+0000","last_became_peered":"2024-09-17T02:56:40.256209+0000","last_unstale":"2024-09-17T02:56:41.246870+0000","last_undegraded":"2024-09-17T02:56:41.246870+0000","last_fullsized":"2024-09-17T02:56:41.246870+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:27.607552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.253792+0000","last_change":"2024-09-17T02:56:39.248592+0000","last_active":"2024-09-17T02:56:40.253792+0000","last_peered":"2024-09-17T02:56:40.253792+0000","last_clean":"2024-09-17T02:56:40.253792+0000","last_became_active":"2024-09-17T02:56:39.248314+0000","last_became_peered":"2024-09-17T02:56:39.248314+0000","last_unstale":"2024-09-17T02:56:40.253792+0000","last_undegraded":"2024-09-17T02:56:40.253792+0000","last_fullsized":"2024-09-17T02:56:40.253792+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:37.122653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257502+0000","last_change":"2024-09-17T02:56:40.257230+0000","last_active":"2024-09-17T02:56:40.257502+0000","last_peered":"2024-09-17T02:56:40.257502+0000","last_clean":"2024-09-17T02:56:40.257502+0000","last_became_active":"2024-09-17T02:56:40.256246+0000","last_became_peered":"2024-09-17T02:56:40.256246+0000","last_unstale":"2024-09-17T02:56:40.257502+0000","last_undegraded":"2024-09-17T02:56:40.257502+0000","last_fullsized":"2024-09-17T02:56:40.257502+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:33.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273613+0000","last_change":"2024-09-17T02:56:39.249918+0000","last_active":"2024-09-17T02:56:40.273613+0000","last_peered":"2024-09-17T02:56:40.273613+0000","last_clean":"2024-09-17T02:56:40.273613+0000","last_became_active":"2024-09-17T02:56:39.247913+0000","last_became_peered":"2024-09-17T02:56:39.247913+0000","last_unstale":"2024-09-17T02:56:40.273613+0000","last_undegraded":"2024-09-17T02:56:40.273613+0000","last_fullsized":"2024-09-17T02:56:40.273613+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:51.885111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.263752+0000","last_change":"2024-09-17T02:56:40.263563+0000","last_active":"2024-09-17T02:56:40.263752+0000","last_peered":"2024-09-17T02:56:40.263752+0000","last_clean":"2024-09-17T02:56:40.263752+0000","last_became_active":"2024-09-17T02:56:40.263255+0000","last_became_peered":"2024-09-17T02:56:40.263255+0000","last_unstale":"2024-09-17T02:56:40.263752+0000","last_undegraded":"2024-09-17T02:56:40.263752+0000","last_fullsized":"2024-09-17T02:56:40.263752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:29.421521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467568+0000","last_change":"2024-09-17T02:56:39.250123+0000","last_active":"2024-09-17T02:56:41.467568+0000","last_peered":"2024-09-17T02:56:41.467568+0000","last_clean":"2024-09-17T02:56:41.467568+0000","last_became_active":"2024-09-17T02:56:39.249795+0000","last_became_peered":"2024-09-17T02:56:39.249795+0000","last_unstale":"2024-09-17T02:56:41.467568+0000","last_undegraded":"2024-09-17T02:56:41.467568+0000","last_fullsized":"2024-09-17T02:56:41.467568+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:38.329446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.255405+0000","last_change":"2024-09-17T02:56:40.254518+0000","last_active":"2024-09-17T02:56:40.255405+0000","last_peered":"2024-09-17T02:56:40.255405+0000","last_clean":"2024-09-17T02:56:40.255405+0000","last_became_active":"2024-09-17T02:56:40.253798+0000","last_became_peered":"2024-09-17T02:56:40.253798+0000","last_unstale":"2024-09-17T02:56:40.255405+0000","last_undegraded":"2024-09-17T02:56:40.255405+0000","last_fullsized":"2024-09-17T02:56:40.255405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:08.848891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.254841+0000","last_change":"2024-09-17T02:56:39.257408+0000","last_active":"2024-09-17T02:56:40.254841+0000","last_peered":"2024-09-17T02:56:40.254841+0000","last_clean":"2024-09-17T02:56:40.254841+0000","last_became_active":"2024-09-17T02:56:39.256607+0000","last_became_peered":"2024-09-17T02:56:39.256607+0000","last_unstale":"2024-09-17T02:56:40.254841+0000","last_undegraded":"2024-09-17T02:56:40.254841+0000","last_fullsized":"2024-09-17T02:56:40.254841+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:31.769008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260141+0000","last_change":"2024-09-17T02:56:40.259944+0000","last_active":"2024-09-17T02:56:40.260141+0000","last_peered":"2024-09-17T02:56:40.260141+0000","last_clean":"2024-09-17T02:56:40.260141+0000","last_became_active":"2024-09-17T02:56:40.259525+0000","last_became_peered":"2024-09-17T02:56:40.259525+0000","last_unstale":"2024-09-17T02:56:40.260141+0000","last_undegraded":"2024-09-17T02:56:40.260141+0000","last_fullsized":"2024-09-17T02:56:40.260141+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:09.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"65'2","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467369+0000","last_change":"2024-09-17T02:56:39.249788+0000","last_active":"2024-09-17T02:56:41.467369+0000","last_peered":"2024-09-17T02:56:41.467369+0000","last_clean":"2024-09-17T02:56:41.467369+0000","last_became_active":"2024-09-17T02:56:39.249480+0000","last_became_peered":"2024-09-17T02:56:39.249480+0000","last_unstale":"2024-09-17T02:56:41.467369+0000","last_undegraded":"2024-09-17T02:56:41.467369+0000","last_fullsized":"2024-09-17T02:56:41.467369+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:37.897630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257312+0000","last_change":"2024-09-17T02:56:40.257087+0000","last_active":"2024-09-17T02:56:40.257312+0000","last_peered":"2024-09-17T02:56:40.257312+0000","last_clean":"2024-09-17T02:56:40.257312+0000","last_became_active":"2024-09-17T02:56:40.256221+0000","last_became_peered":"2024-09-17T02:56:40.256221+0000","last_unstale":"2024-09-17T02:56:40.257312+0000","last_undegraded":"2024-09-17T02:56:40.257312+0000","last_fullsized":"2024-09-17T02:56:40.257312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:52.902918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257712+0000","last_change":"2024-09-17T02:56:39.258124+0000","last_active":"2024-09-17T02:56:40.257712+0000","last_peered":"2024-09-17T02:56:40.257712+0000","last_clean":"2024-09-17T02:56:40.257712+0000","last_became_active":"2024-09-17T02:56:39.254432+0000","last_became_peered":"2024-09-17T02:56:39.254432+0000","last_unstale":"2024-09-17T02:56:40.257712+0000","last_undegraded":"2024-09-17T02:56:40.257712+0000","last_fullsized":"2024-09-17T02:56:40.257712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:19.968957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467807+0000","last_change":"2024-09-17T02:56:40.256773+0000","last_active":"2024-09-17T02:56:41.467807+0000","last_peered":"2024-09-17T02:56:41.467807+0000","last_clean":"2024-09-17T02:56:41.467807+0000","last_became_active":"2024-09-17T02:56:40.256531+0000","last_became_peered":"2024-09-17T02:56:40.256531+0000","last_unstale":"2024-09-17T02:56:41.467807+0000","last_undegraded":"2024-09-17T02:56:41.467807+0000","last_fullsized":"2024-09-17T02:56:41.467807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:01.160002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.248947+0000","last_change":"2024-09-17T02:56:39.251225+0000","last_active":"2024-09-17T02:56:41.248947+0000","last_peered":"2024-09-17T02:56:41.248947+0000","last_clean":"2024-09-17T02:56:41.248947+0000","last_became_active":"2024-09-17T02:56:39.250364+0000","last_became_peered":"2024-09-17T02:56:39.250364+0000","last_unstale":"2024-09-17T02:56:41.248947+0000","last_undegraded":"2024-09-17T02:56:41.248947+0000","last_fullsized":"2024-09-17T02:56:41.248947+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:41.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.262834+0000","last_change":"2024-09-17T02:56:40.261824+0000","last_active":"2024-09-17T02:56:40.262834+0000","last_peered":"2024-09-17T02:56:40.262834+0000","last_clean":"2024-09-17T02:56:40.262834+0000","last_became_active":"2024-09-17T02:56:40.259183+0000","last_became_peered":"2024-09-17T02:56:40.259183+0000","last_unstale":"2024-09-17T02:56:40.262834+0000","last_undegraded":"2024-09-17T02:56:40.262834+0000","last_fullsized":"2024-09-17T02:56:40.262834+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:55.192658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.251751+0000","last_change":"2024-09-17T02:56:39.252791+0000","last_active":"2024-09-17T02:56:40.251751+0000","last_peered":"2024-09-17T02:56:40.251751+0000","last_clean":"2024-09-17T02:56:40.251751+0000","last_became_active":"2024-09-17T02:56:39.252447+0000","last_became_peered":"2024-09-17T02:56:39.252447+0000","last_unstale":"2024-09-17T02:56:40.251751+0000","last_undegraded":"2024-09-17T02:56:40.251751+0000","last_fullsized":"2024-09-17T02:56:40.251751+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:03.954990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.262618+0000","last_change":"2024-09-17T02:56:40.262400+0000","last_active":"2024-09-17T02:56:40.262618+0000","last_peered":"2024-09-17T02:56:40.262618+0000","last_clean":"2024-09-17T02:56:40.262618+0000","last_became_active":"2024-09-17T02:56:40.259505+0000","last_became_peered":"2024-09-17T02:56:40.259505+0000","last_unstale":"2024-09-17T02:56:40.262618+0000","last_undegraded":"2024-09-17T02:56:40.262618+0000","last_fullsized":"2024-09-17T02:56:40.262618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:39.996619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467659+0000","last_change":"2024-09-17T02:56:39.254579+0000","last_active":"2024-09-17T02:56:41.467659+0000","last_peered":"2024-09-17T02:56:41.467659+0000","last_clean":"2024-09-17T02:56:41.467659+0000","last_became_active":"2024-09-17T02:56:39.254313+0000","last_became_peered":"2024-09-17T02:56:39.254313+0000","last_unstale":"2024-09-17T02:56:41.467659+0000","last_undegraded":"2024-09-17T02:56:41.467659+0000","last_fullsized":"2024-09-17T02:56:41.467659+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:14.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247054+0000","last_change":"2024-09-17T02:56:40.253727+0000","last_active":"2024-09-17T02:56:41.247054+0000","last_peered":"2024-09-17T02:56:41.247054+0000","last_clean":"2024-09-17T02:56:41.247054+0000","last_became_active":"2024-09-17T02:56:40.253435+0000","last_became_peered":"2024-09-17T02:56:40.253435+0000","last_unstale":"2024-09-17T02:56:41.247054+0000","last_undegraded":"2024-09-17T02:56:41.247054+0000","last_fullsized":"2024-09-17T02:56:41.247054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:06.415272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249831+0000","last_change":"2024-09-17T02:56:39.250856+0000","last_active":"2024-09-17T02:56:41.249831+0000","last_peered":"2024-09-17T02:56:41.249831+0000","last_clean":"2024-09-17T02:56:41.249831+0000","last_became_active":"2024-09-17T02:56:39.249730+0000","last_became_peered":"2024-09-17T02:56:39.249730+0000","last_unstale":"2024-09-17T02:56:41.249831+0000","last_undegraded":"2024-09-17T02:56:41.249831+0000","last_fullsized":"2024-09-17T02:56:41.249831+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:25.079000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467495+0000","last_change":"2024-09-17T02:56:40.258148+0000","last_active":"2024-09-17T02:56:41.467495+0000","last_peered":"2024-09-17T02:56:41.467495+0000","last_clean":"2024-09-17T02:56:41.467495+0000","last_became_active":"2024-09-17T02:56:40.257876+0000","last_became_peered":"2024-09-17T02:56:40.257876+0000","last_unstale":"2024-09-17T02:56:41.467495+0000","last_undegraded":"2024-09-17T02:56:41.467495+0000","last_fullsized":"2024-09-17T02:56:41.467495+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:30.036767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467467+0000","last_change":"2024-09-17T02:56:39.259018+0000","last_active":"2024-09-17T02:56:41.467467+0000","last_peered":"2024-09-17T02:56:41.467467+0000","last_clean":"2024-09-17T02:56:41.467467+0000","last_became_active":"2024-09-17T02:56:39.258718+0000","last_became_peered":"2024-09-17T02:56:39.258718+0000","last_unstale":"2024-09-17T02:56:41.467467+0000","last_undegraded":"2024-09-17T02:56:41.467467+0000","last_fullsized":"2024-09-17T02:56:41.467467+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:57.113289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260010+0000","last_change":"2024-09-17T02:56:40.258088+0000","last_active":"2024-09-17T02:56:40.260010+0000","last_peered":"2024-09-17T02:56:40.260010+0000","last_clean":"2024-09-17T02:56:40.260010+0000","last_became_active":"2024-09-17T02:56:40.256376+0000","last_became_peered":"2024-09-17T02:56:40.256376+0000","last_unstale":"2024-09-17T02:56:40.260010+0000","last_undegraded":"2024-09-17T02:56:40.260010+0000","last_fullsized":"2024-09-17T02:56:40.260010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:04.609782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.249385+0000","last_change":"2024-09-17T02:56:39.257527+0000","last_active":"2024-09-17T02:56:40.249385+0000","last_peered":"2024-09-17T02:56:40.249385+0000","last_clean":"2024-09-17T02:56:40.249385+0000","last_became_active":"2024-09-17T02:56:39.257212+0000","last_became_peered":"2024-09-17T02:56:39.257212+0000","last_unstale":"2024-09-17T02:56:40.249385+0000","last_undegraded":"2024-09-17T02:56:40.249385+0000","last_fullsized":"2024-09-17T02:56:40.249385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:08.179971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257017+0000","last_change":"2024-09-17T02:56:40.255191+0000","last_active":"2024-09-17T02:56:40.257017+0000","last_peered":"2024-09-17T02:56:40.257017+0000","last_clean":"2024-09-17T02:56:40.257017+0000","last_became_active":"2024-09-17T02:56:40.254913+0000","last_became_peered":"2024-09-17T02:56:40.254913+0000","last_unstale":"2024-09-17T02:56:40.257017+0000","last_undegraded":"2024-09-17T02:56:40.257017+0000","last_fullsized":"2024-09-17T02:56:40.257017+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:27.742125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249195+0000","last_change":"2024-09-17T02:56:39.253794+0000","last_active":"2024-09-17T02:56:41.249195+0000","last_peered":"2024-09-17T02:56:41.249195+0000","last_clean":"2024-09-17T02:56:41.249195+0000","last_became_active":"2024-09-17T02:56:39.253536+0000","last_became_peered":"2024-09-17T02:56:39.253536+0000","last_unstale":"2024-09-17T02:56:41.249195+0000","last_undegraded":"2024-09-17T02:56:41.249195+0000","last_fullsized":"2024-09-17T02:56:41.249195+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:56.141703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":197,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246357+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:56:41.246357+0000","last_peered":"2024-09-17T02:56:41.246357+0000","last_clean":"2024-09-17T02:56:41.246357+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:56:41.246357+0000","last_undegraded":"2024-09-17T02:56:41.246357+0000","last_fullsized":"2024-09-17T02:56:41.246357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:45.523259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":900,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194411,"statfs":{"total":200000000,"available":199077739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668267,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":324,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199667615,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194986,"statfs":{"total":200000000,"available":199666655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":324,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668211,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":324,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668211,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":324,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668177,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":902,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:56:43.263 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:56:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.412+0000 7fa47f92b640 1 -- 172.21.15.104:0/2429456894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa47815bc00 msgr2=0x7fa478072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.412+0000 7fa47f92b640 1 --2- 172.21.15.104:0/2429456894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa47815bc00 0x7fa478072b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa478074880 tx=0x7fa46802a4a0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.412+0000 7fa47f92b640 1 -- 172.21.15.104:0/2429456894 shutdown_connections 2024-09-17T02:56:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.412+0000 7fa47f92b640 1 --2- 172.21.15.104:0/2429456894 >> v2:172.21.15.192:3300/0 conn(0x7fa4780ce280 0x7fa4780ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.412+0000 7fa47f92b640 1 --2- 172.21.15.104:0/2429456894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa47815bc00 0x7fa478072b80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.412+0000 7fa47f92b640 1 -- 172.21.15.104:0/2429456894 >> 172.21.15.104:0/2429456894 conn(0x7fa4780b2450 msgr2=0x7fa4780b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.412+0000 7fa47f92b640 1 -- 172.21.15.104:0/2429456894 shutdown_connections 2024-09-17T02:56:43.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.412+0000 7fa47f92b640 1 -- 172.21.15.104:0/2429456894 wait complete. 2024-09-17T02:56:43.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.414+0000 7fa47f92b640 1 Processor -- start 2024-09-17T02:56:43.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.414+0000 7fa47f92b640 1 -- start start 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47f92b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4780ce280 0x7fa478153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47f92b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa47815b7f0 0x7fa4781581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47f92b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa47815bc00 0x7fa478158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47f92b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa4780cebd0 con 0x7fa4780ce280 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47f92b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4780700c0 con 0x7fa47815b7f0 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47f92b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa4780ced50 con 0x7fa47815bc00 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4780ce280 0x7fa478153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4780ce280 0x7fa478153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47830/0 (socket says 172.21.15.104:47830) 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 -- 172.21.15.104:0/1751777265 learned_addr learned my addr 172.21.15.104:0/1751777265 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47dec8640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa47815bc00 0x7fa478158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47cec6640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa47815b7f0 0x7fa4781581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 -- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa47815bc00 msgr2=0x7fa478158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa47815bc00 0x7fa478158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 -- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa47815b7f0 msgr2=0x7fa4781581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa47815b7f0 0x7fa4781581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 -- 172.21.15.104:0/1751777265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4781539d0 con 0x7fa4780ce280 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47cec6640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa47815b7f0 0x7fa4781581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.415+0000 7fa47d6c7640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4780ce280 0x7fa478153490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa47400c3f0 tx=0x7fa47400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.416+0000 7fa46dffb640 1 -- 172.21.15.104:0/1751777265 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474017070 con 0x7fa4780ce280 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.416+0000 7fa46dffb640 1 -- 172.21.15.104:0/1751777265 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4740035f0 con 0x7fa4780ce280 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.416+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4781f72d0 con 0x7fa4780ce280 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.416+0000 7fa46dffb640 1 -- 172.21.15.104:0/1751777265 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474003a40 con 0x7fa4780ce280 2024-09-17T02:56:43.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.416+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4781f7890 con 0x7fa4780ce280 2024-09-17T02:56:43.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.417+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4780ce690 con 0x7fa4780ce280 2024-09-17T02:56:43.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.417+0000 7fa46dffb640 1 -- 172.21.15.104:0/1751777265 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa47401a070 con 0x7fa4780ce280 2024-09-17T02:56:43.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.418+0000 7fa46dffb640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa45c078bc0 0x7fa45c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.418+0000 7fa46dffb640 1 -- 172.21.15.104:0/1751777265 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fa474099f50 con 0x7fa4780ce280 2024-09-17T02:56:43.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.418+0000 7fa47cec6640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa45c078bc0 0x7fa45c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.419+0000 7fa47cec6640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa45c078bc0 0x7fa45c07b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa468034000 tx=0x7fa468004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:43.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.422+0000 7fa46dffb640 1 -- 172.21.15.104:0/1751777265 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa4740624b0 con 0x7fa4780ce280 2024-09-17T02:56:43.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.592+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa47815b030 con 0x7fa45c078bc0 2024-09-17T02:56:43.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.597+0000 7fa46dffb640 1 -- 172.21.15.104:0/1751777265 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247476 (secure 0 0 0) 0x7fa47815b030 con 0x7fa45c078bc0 2024-09-17T02:56:43.600 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:43.602 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:56:43.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa45c078bc0 msgr2=0x7fa45c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa45c078bc0 0x7fa45c07b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa468034000 tx=0x7fa468004730 comp rx=0 tx=0).stop 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4780ce280 msgr2=0x7fa478153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4780ce280 0x7fa478153490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa47400c3f0 tx=0x7fa47400c8b0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 shutdown_connections 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa45c078bc0 0x7fa45c07b0d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa47815b7f0 0x7fa4781581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa47815bc00 0x7fa478158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 --2- 172.21.15.104:0/1751777265 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa4780ce280 0x7fa478153490 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 >> 172.21.15.104:0/1751777265 conn(0x7fa4780b2450 msgr2=0x7fa4780d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 shutdown_connections 2024-09-17T02:56:43.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.600+0000 7fa47f92b640 1 -- 172.21.15.104:0/1751777265 wait complete. 2024-09-17T02:56:43.609 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-17T02:56:41.647269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558750,"statfs":{"total":1600000000,"available":1596160580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000853"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257909+0000","last_change":"2024-09-17T02:56:40.257352+0000","last_active":"2024-09-17T02:56:40.257909+0000","last_peered":"2024-09-17T02:56:40.257909+0000","last_clean":"2024-09-17T02:56:40.257909+0000","last_became_active":"2024-09-17T02:56:40.257080+0000","last_became_peered":"2024-09-17T02:56:40.257080+0000","last_unstale":"2024-09-17T02:56:40.257909+0000","last_undegraded":"2024-09-17T02:56:40.257909+0000","last_fullsized":"2024-09-17T02:56:40.257909+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:01.702015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.261714+0000","last_change":"2024-09-17T02:56:40.261252+0000","last_active":"2024-09-17T02:56:40.261714+0000","last_peered":"2024-09-17T02:56:40.261714+0000","last_clean":"2024-09-17T02:56:40.261714+0000","last_became_active":"2024-09-17T02:56:40.259141+0000","last_became_peered":"2024-09-17T02:56:40.259141+0000","last_unstale":"2024-09-17T02:56:40.261714+0000","last_undegraded":"2024-09-17T02:56:40.261714+0000","last_fullsized":"2024-09-17T02:56:40.261714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:49.232931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246461+0000","last_change":"2024-09-17T02:56:40.259001+0000","last_active":"2024-09-17T02:56:41.246461+0000","last_peered":"2024-09-17T02:56:41.246461+0000","last_clean":"2024-09-17T02:56:41.246461+0000","last_became_active":"2024-09-17T02:56:40.257059+0000","last_became_peered":"2024-09-17T02:56:40.257059+0000","last_unstale":"2024-09-17T02:56:41.246461+0000","last_undegraded":"2024-09-17T02:56:41.246461+0000","last_fullsized":"2024-09-17T02:56:41.246461+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:32.694137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.261187+0000","last_change":"2024-09-17T02:56:40.260967+0000","last_active":"2024-09-17T02:56:40.261187+0000","last_peered":"2024-09-17T02:56:40.261187+0000","last_clean":"2024-09-17T02:56:40.261187+0000","last_became_active":"2024-09-17T02:56:40.260577+0000","last_became_peered":"2024-09-17T02:56:40.260577+0000","last_unstale":"2024-09-17T02:56:40.261187+0000","last_undegraded":"2024-09-17T02:56:40.261187+0000","last_fullsized":"2024-09-17T02:56:40.261187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:15.165132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.255603+0000","last_change":"2024-09-17T02:56:40.253526+0000","last_active":"2024-09-17T02:56:40.255603+0000","last_peered":"2024-09-17T02:56:40.255603+0000","last_clean":"2024-09-17T02:56:40.255603+0000","last_became_active":"2024-09-17T02:56:40.253250+0000","last_became_peered":"2024-09-17T02:56:40.253250+0000","last_unstale":"2024-09-17T02:56:40.255603+0000","last_undegraded":"2024-09-17T02:56:40.255603+0000","last_fullsized":"2024-09-17T02:56:40.255603+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:00.387561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.254193+0000","last_change":"2024-09-17T02:56:40.251987+0000","last_active":"2024-09-17T02:56:40.254193+0000","last_peered":"2024-09-17T02:56:40.254193+0000","last_clean":"2024-09-17T02:56:40.254193+0000","last_became_active":"2024-09-17T02:56:40.251696+0000","last_became_peered":"2024-09-17T02:56:40.251696+0000","last_unstale":"2024-09-17T02:56:40.254193+0000","last_undegraded":"2024-09-17T02:56:40.254193+0000","last_fullsized":"2024-09-17T02:56:40.254193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:21.763486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249268+0000","last_change":"2024-09-17T02:56:40.254265+0000","last_active":"2024-09-17T02:56:41.249268+0000","last_peered":"2024-09-17T02:56:41.249268+0000","last_clean":"2024-09-17T02:56:41.249268+0000","last_became_active":"2024-09-17T02:56:40.253939+0000","last_became_peered":"2024-09-17T02:56:40.253939+0000","last_unstale":"2024-09-17T02:56:41.249268+0000","last_undegraded":"2024-09-17T02:56:41.249268+0000","last_fullsized":"2024-09-17T02:56:41.249268+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:35.816185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257936+0000","last_change":"2024-09-17T02:56:40.257516+0000","last_active":"2024-09-17T02:56:40.257936+0000","last_peered":"2024-09-17T02:56:40.257936+0000","last_clean":"2024-09-17T02:56:40.257936+0000","last_became_active":"2024-09-17T02:56:40.256056+0000","last_became_peered":"2024-09-17T02:56:40.256056+0000","last_unstale":"2024-09-17T02:56:40.257936+0000","last_undegraded":"2024-09-17T02:56:40.257936+0000","last_fullsized":"2024-09-17T02:56:40.257936+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:28.970495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249177+0000","last_change":"2024-09-17T02:56:40.261509+0000","last_active":"2024-09-17T02:56:41.249177+0000","last_peered":"2024-09-17T02:56:41.249177+0000","last_clean":"2024-09-17T02:56:41.249177+0000","last_became_active":"2024-09-17T02:56:40.261261+0000","last_became_peered":"2024-09-17T02:56:40.261261+0000","last_unstale":"2024-09-17T02:56:41.249177+0000","last_undegraded":"2024-09-17T02:56:41.249177+0000","last_fullsized":"2024-09-17T02:56:41.249177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:39.212818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467600+0000","last_change":"2024-09-17T02:56:40.258211+0000","last_active":"2024-09-17T02:56:41.467600+0000","last_peered":"2024-09-17T02:56:41.467600+0000","last_clean":"2024-09-17T02:56:41.467600+0000","last_became_active":"2024-09-17T02:56:40.257843+0000","last_became_peered":"2024-09-17T02:56:40.257843+0000","last_unstale":"2024-09-17T02:56:41.467600+0000","last_undegraded":"2024-09-17T02:56:41.467600+0000","last_fullsized":"2024-09-17T02:56:41.467600+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:03.332143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467598+0000","last_change":"2024-09-17T02:56:40.255814+0000","last_active":"2024-09-17T02:56:41.467598+0000","last_peered":"2024-09-17T02:56:41.467598+0000","last_clean":"2024-09-17T02:56:41.467598+0000","last_became_active":"2024-09-17T02:56:40.255490+0000","last_became_peered":"2024-09-17T02:56:40.255490+0000","last_unstale":"2024-09-17T02:56:41.467598+0000","last_undegraded":"2024-09-17T02:56:41.467598+0000","last_fullsized":"2024-09-17T02:56:41.467598+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:01.491954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258797+0000","last_change":"2024-09-17T02:56:40.257407+0000","last_active":"2024-09-17T02:56:40.258797+0000","last_peered":"2024-09-17T02:56:40.258797+0000","last_clean":"2024-09-17T02:56:40.258797+0000","last_became_active":"2024-09-17T02:56:40.256776+0000","last_became_peered":"2024-09-17T02:56:40.256776+0000","last_unstale":"2024-09-17T02:56:40.258797+0000","last_undegraded":"2024-09-17T02:56:40.258797+0000","last_fullsized":"2024-09-17T02:56:40.258797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:13.118261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.248997+0000","last_change":"2024-09-17T02:56:40.261385+0000","last_active":"2024-09-17T02:56:41.248997+0000","last_peered":"2024-09-17T02:56:41.248997+0000","last_clean":"2024-09-17T02:56:41.248997+0000","last_became_active":"2024-09-17T02:56:40.261046+0000","last_became_peered":"2024-09-17T02:56:40.261046+0000","last_unstale":"2024-09-17T02:56:41.248997+0000","last_undegraded":"2024-09-17T02:56:41.248997+0000","last_fullsized":"2024-09-17T02:56:41.248997+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:21.934662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249447+0000","last_change":"2024-09-17T02:56:40.249770+0000","last_active":"2024-09-17T02:56:41.249447+0000","last_peered":"2024-09-17T02:56:41.249447+0000","last_clean":"2024-09-17T02:56:41.249447+0000","last_became_active":"2024-09-17T02:56:40.249397+0000","last_became_peered":"2024-09-17T02:56:40.249397+0000","last_unstale":"2024-09-17T02:56:41.249447+0000","last_undegraded":"2024-09-17T02:56:41.249447+0000","last_fullsized":"2024-09-17T02:56:41.249447+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:08:57.446039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249588+0000","last_change":"2024-09-17T02:56:40.258607+0000","last_active":"2024-09-17T02:56:41.249588+0000","last_peered":"2024-09-17T02:56:41.249588+0000","last_clean":"2024-09-17T02:56:41.249588+0000","last_became_active":"2024-09-17T02:56:40.257249+0000","last_became_peered":"2024-09-17T02:56:40.257249+0000","last_unstale":"2024-09-17T02:56:41.249588+0000","last_undegraded":"2024-09-17T02:56:41.249588+0000","last_fullsized":"2024-09-17T02:56:41.249588+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:59.781673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.255349+0000","last_change":"2024-09-17T02:56:40.255099+0000","last_active":"2024-09-17T02:56:40.255349+0000","last_peered":"2024-09-17T02:56:40.255349+0000","last_clean":"2024-09-17T02:56:40.255349+0000","last_became_active":"2024-09-17T02:56:40.254798+0000","last_became_peered":"2024-09-17T02:56:40.254798+0000","last_unstale":"2024-09-17T02:56:40.255349+0000","last_undegraded":"2024-09-17T02:56:40.255349+0000","last_fullsized":"2024-09-17T02:56:40.255349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:51.440267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.256994+0000","last_change":"2024-09-17T02:56:40.255060+0000","last_active":"2024-09-17T02:56:40.256994+0000","last_peered":"2024-09-17T02:56:40.256994+0000","last_clean":"2024-09-17T02:56:40.256994+0000","last_became_active":"2024-09-17T02:56:40.254783+0000","last_became_peered":"2024-09-17T02:56:40.254783+0000","last_unstale":"2024-09-17T02:56:40.256994+0000","last_undegraded":"2024-09-17T02:56:40.256994+0000","last_fullsized":"2024-09-17T02:56:40.256994+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:51.984870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246649+0000","last_change":"2024-09-17T02:56:40.263456+0000","last_active":"2024-09-17T02:56:41.246649+0000","last_peered":"2024-09-17T02:56:41.246649+0000","last_clean":"2024-09-17T02:56:41.246649+0000","last_became_active":"2024-09-17T02:56:40.263227+0000","last_became_peered":"2024-09-17T02:56:40.263227+0000","last_unstale":"2024-09-17T02:56:41.246649+0000","last_undegraded":"2024-09-17T02:56:41.246649+0000","last_fullsized":"2024-09-17T02:56:41.246649+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:59.347301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.259733+0000","last_change":"2024-09-17T02:56:40.259542+0000","last_active":"2024-09-17T02:56:40.259733+0000","last_peered":"2024-09-17T02:56:40.259733+0000","last_clean":"2024-09-17T02:56:40.259733+0000","last_became_active":"2024-09-17T02:56:40.258761+0000","last_became_peered":"2024-09-17T02:56:40.258761+0000","last_unstale":"2024-09-17T02:56:40.259733+0000","last_undegraded":"2024-09-17T02:56:40.259733+0000","last_fullsized":"2024-09-17T02:56:40.259733+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:45:40.292450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257152+0000","last_change":"2024-09-17T02:56:40.256892+0000","last_active":"2024-09-17T02:56:40.257152+0000","last_peered":"2024-09-17T02:56:40.257152+0000","last_clean":"2024-09-17T02:56:40.257152+0000","last_became_active":"2024-09-17T02:56:40.256642+0000","last_became_peered":"2024-09-17T02:56:40.256642+0000","last_unstale":"2024-09-17T02:56:40.257152+0000","last_undegraded":"2024-09-17T02:56:40.257152+0000","last_fullsized":"2024-09-17T02:56:40.257152+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:48.785299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246476+0000","last_change":"2024-09-17T02:56:40.258565+0000","last_active":"2024-09-17T02:56:41.246476+0000","last_peered":"2024-09-17T02:56:41.246476+0000","last_clean":"2024-09-17T02:56:41.246476+0000","last_became_active":"2024-09-17T02:56:40.256969+0000","last_became_peered":"2024-09-17T02:56:40.256969+0000","last_unstale":"2024-09-17T02:56:41.246476+0000","last_undegraded":"2024-09-17T02:56:41.246476+0000","last_fullsized":"2024-09-17T02:56:41.246476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:18.517705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.252595+0000","last_change":"2024-09-17T02:56:40.251805+0000","last_active":"2024-09-17T02:56:40.252595+0000","last_peered":"2024-09-17T02:56:40.252595+0000","last_clean":"2024-09-17T02:56:40.252595+0000","last_became_active":"2024-09-17T02:56:40.251532+0000","last_became_peered":"2024-09-17T02:56:40.251532+0000","last_unstale":"2024-09-17T02:56:40.252595+0000","last_undegraded":"2024-09-17T02:56:40.252595+0000","last_fullsized":"2024-09-17T02:56:40.252595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:09.534448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246844+0000","last_change":"2024-09-17T02:56:40.259797+0000","last_active":"2024-09-17T02:56:41.246844+0000","last_peered":"2024-09-17T02:56:41.246844+0000","last_clean":"2024-09-17T02:56:41.246844+0000","last_became_active":"2024-09-17T02:56:40.258703+0000","last_became_peered":"2024-09-17T02:56:40.258703+0000","last_unstale":"2024-09-17T02:56:41.246844+0000","last_undegraded":"2024-09-17T02:56:41.246844+0000","last_fullsized":"2024-09-17T02:56:41.246844+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:28.865476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.248815+0000","last_change":"2024-09-17T02:56:40.261294+0000","last_active":"2024-09-17T02:56:41.248815+0000","last_peered":"2024-09-17T02:56:41.248815+0000","last_clean":"2024-09-17T02:56:41.248815+0000","last_became_active":"2024-09-17T02:56:40.260998+0000","last_became_peered":"2024-09-17T02:56:40.260998+0000","last_unstale":"2024-09-17T02:56:41.248815+0000","last_undegraded":"2024-09-17T02:56:41.248815+0000","last_fullsized":"2024-09-17T02:56:41.248815+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:18.640194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258584+0000","last_change":"2024-09-17T02:56:40.258392+0000","last_active":"2024-09-17T02:56:40.258584+0000","last_peered":"2024-09-17T02:56:40.258584+0000","last_clean":"2024-09-17T02:56:40.258584+0000","last_became_active":"2024-09-17T02:56:40.258112+0000","last_became_peered":"2024-09-17T02:56:40.258112+0000","last_unstale":"2024-09-17T02:56:40.258584+0000","last_undegraded":"2024-09-17T02:56:40.258584+0000","last_fullsized":"2024-09-17T02:56:40.258584+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:31.011243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258879+0000","last_change":"2024-09-17T02:56:40.258200+0000","last_active":"2024-09-17T02:56:40.258879+0000","last_peered":"2024-09-17T02:56:40.258879+0000","last_clean":"2024-09-17T02:56:40.258879+0000","last_became_active":"2024-09-17T02:56:40.256262+0000","last_became_peered":"2024-09-17T02:56:40.256262+0000","last_unstale":"2024-09-17T02:56:40.258879+0000","last_undegraded":"2024-09-17T02:56:40.258879+0000","last_fullsized":"2024-09-17T02:56:40.258879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:18.221755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.256072+0000","last_change":"2024-09-17T02:56:40.255804+0000","last_active":"2024-09-17T02:56:40.256072+0000","last_peered":"2024-09-17T02:56:40.256072+0000","last_clean":"2024-09-17T02:56:40.256072+0000","last_became_active":"2024-09-17T02:56:40.255031+0000","last_became_peered":"2024-09-17T02:56:40.255031+0000","last_unstale":"2024-09-17T02:56:40.256072+0000","last_undegraded":"2024-09-17T02:56:40.256072+0000","last_fullsized":"2024-09-17T02:56:40.256072+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:10.500845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258483+0000","last_change":"2024-09-17T02:56:40.258271+0000","last_active":"2024-09-17T02:56:40.258483+0000","last_peered":"2024-09-17T02:56:40.258483+0000","last_clean":"2024-09-17T02:56:40.258483+0000","last_became_active":"2024-09-17T02:56:40.257989+0000","last_became_peered":"2024-09-17T02:56:40.257989+0000","last_unstale":"2024-09-17T02:56:40.258483+0000","last_undegraded":"2024-09-17T02:56:40.258483+0000","last_fullsized":"2024-09-17T02:56:40.258483+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:27.715699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257130+0000","last_change":"2024-09-17T02:56:40.256605+0000","last_active":"2024-09-17T02:56:40.257130+0000","last_peered":"2024-09-17T02:56:40.257130+0000","last_clean":"2024-09-17T02:56:40.257130+0000","last_became_active":"2024-09-17T02:56:40.256322+0000","last_became_peered":"2024-09-17T02:56:40.256322+0000","last_unstale":"2024-09-17T02:56:40.257130+0000","last_undegraded":"2024-09-17T02:56:40.257130+0000","last_fullsized":"2024-09-17T02:56:40.257130+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:40.419183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247280+0000","last_change":"2024-09-17T02:56:40.255142+0000","last_active":"2024-09-17T02:56:41.247280+0000","last_peered":"2024-09-17T02:56:41.247280+0000","last_clean":"2024-09-17T02:56:41.247280+0000","last_became_active":"2024-09-17T02:56:40.254488+0000","last_became_peered":"2024-09-17T02:56:40.254488+0000","last_unstale":"2024-09-17T02:56:41.247280+0000","last_undegraded":"2024-09-17T02:56:41.247280+0000","last_fullsized":"2024-09-17T02:56:41.247280+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:03.346484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.259984+0000","last_change":"2024-09-17T02:56:40.259789+0000","last_active":"2024-09-17T02:56:40.259984+0000","last_peered":"2024-09-17T02:56:40.259984+0000","last_clean":"2024-09-17T02:56:40.259984+0000","last_became_active":"2024-09-17T02:56:40.259477+0000","last_became_peered":"2024-09-17T02:56:40.259477+0000","last_unstale":"2024-09-17T02:56:40.259984+0000","last_undegraded":"2024-09-17T02:56:40.259984+0000","last_fullsized":"2024-09-17T02:56:40.259984+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:55.093748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.256425+0000","last_change":"2024-09-17T02:56:40.256224+0000","last_active":"2024-09-17T02:56:40.256425+0000","last_peered":"2024-09-17T02:56:40.256425+0000","last_clean":"2024-09-17T02:56:40.256425+0000","last_became_active":"2024-09-17T02:56:40.255415+0000","last_became_peered":"2024-09-17T02:56:40.255415+0000","last_unstale":"2024-09-17T02:56:40.256425+0000","last_undegraded":"2024-09-17T02:56:40.256425+0000","last_fullsized":"2024-09-17T02:56:40.256425+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:52.019394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260045+0000","last_change":"2024-09-17T02:56:40.259509+0000","last_active":"2024-09-17T02:56:40.260045+0000","last_peered":"2024-09-17T02:56:40.260045+0000","last_clean":"2024-09-17T02:56:40.260045+0000","last_became_active":"2024-09-17T02:56:40.258168+0000","last_became_peered":"2024-09-17T02:56:40.258168+0000","last_unstale":"2024-09-17T02:56:40.260045+0000","last_undegraded":"2024-09-17T02:56:40.260045+0000","last_fullsized":"2024-09-17T02:56:40.260045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:46.555569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"65'4","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.272626+0000","last_change":"2024-09-17T02:56:39.258398+0000","last_active":"2024-09-17T02:56:40.272626+0000","last_peered":"2024-09-17T02:56:40.272626+0000","last_clean":"2024-09-17T02:56:40.272626+0000","last_became_active":"2024-09-17T02:56:39.256782+0000","last_became_peered":"2024-09-17T02:56:39.256782+0000","last_unstale":"2024-09-17T02:56:40.272626+0000","last_undegraded":"2024-09-17T02:56:40.272626+0000","last_fullsized":"2024-09-17T02:56:40.272626+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:18.579455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467354+0000","last_change":"2024-09-17T02:56:40.260736+0000","last_active":"2024-09-17T02:56:41.467354+0000","last_peered":"2024-09-17T02:56:41.467354+0000","last_clean":"2024-09-17T02:56:41.467354+0000","last_became_active":"2024-09-17T02:56:40.260468+0000","last_became_peered":"2024-09-17T02:56:40.260468+0000","last_unstale":"2024-09-17T02:56:41.467354+0000","last_undegraded":"2024-09-17T02:56:41.467354+0000","last_fullsized":"2024-09-17T02:56:41.467354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:06.250730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.272468+0000","last_change":"2024-09-17T02:56:39.255977+0000","last_active":"2024-09-17T02:56:40.272468+0000","last_peered":"2024-09-17T02:56:40.272468+0000","last_clean":"2024-09-17T02:56:40.272468+0000","last_became_active":"2024-09-17T02:56:39.255243+0000","last_became_peered":"2024-09-17T02:56:39.255243+0000","last_unstale":"2024-09-17T02:56:40.272468+0000","last_undegraded":"2024-09-17T02:56:40.272468+0000","last_fullsized":"2024-09-17T02:56:40.272468+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:15.632283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260396+0000","last_change":"2024-09-17T02:56:40.260162+0000","last_active":"2024-09-17T02:56:40.260396+0000","last_peered":"2024-09-17T02:56:40.260396+0000","last_clean":"2024-09-17T02:56:40.260396+0000","last_became_active":"2024-09-17T02:56:40.259779+0000","last_became_peered":"2024-09-17T02:56:40.259779+0000","last_unstale":"2024-09-17T02:56:40.260396+0000","last_undegraded":"2024-09-17T02:56:40.260396+0000","last_fullsized":"2024-09-17T02:56:40.260396+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:23.507266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.272557+0000","last_change":"2024-09-17T02:56:39.257132+0000","last_active":"2024-09-17T02:56:40.272557+0000","last_peered":"2024-09-17T02:56:40.272557+0000","last_clean":"2024-09-17T02:56:40.272557+0000","last_became_active":"2024-09-17T02:56:39.254964+0000","last_became_peered":"2024-09-17T02:56:39.254964+0000","last_unstale":"2024-09-17T02:56:40.272557+0000","last_undegraded":"2024-09-17T02:56:40.272557+0000","last_fullsized":"2024-09-17T02:56:40.272557+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:20.513156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.263043+0000","last_change":"2024-09-17T02:56:40.262709+0000","last_active":"2024-09-17T02:56:40.263043+0000","last_peered":"2024-09-17T02:56:40.263043+0000","last_clean":"2024-09-17T02:56:40.263043+0000","last_became_active":"2024-09-17T02:56:40.262267+0000","last_became_peered":"2024-09-17T02:56:40.262267+0000","last_unstale":"2024-09-17T02:56:40.263043+0000","last_undegraded":"2024-09-17T02:56:40.263043+0000","last_fullsized":"2024-09-17T02:56:40.263043+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:12.775808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273657+0000","last_change":"2024-09-17T02:56:39.258513+0000","last_active":"2024-09-17T02:56:40.273657+0000","last_peered":"2024-09-17T02:56:40.273657+0000","last_clean":"2024-09-17T02:56:40.273657+0000","last_became_active":"2024-09-17T02:56:39.258197+0000","last_became_peered":"2024-09-17T02:56:39.258197+0000","last_unstale":"2024-09-17T02:56:40.273657+0000","last_undegraded":"2024-09-17T02:56:40.273657+0000","last_fullsized":"2024-09-17T02:56:40.273657+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:48.051626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.253790+0000","last_change":"2024-09-17T02:56:40.253342+0000","last_active":"2024-09-17T02:56:40.253790+0000","last_peered":"2024-09-17T02:56:40.253790+0000","last_clean":"2024-09-17T02:56:40.253790+0000","last_became_active":"2024-09-17T02:56:40.253059+0000","last_became_peered":"2024-09-17T02:56:40.253059+0000","last_unstale":"2024-09-17T02:56:40.253790+0000","last_undegraded":"2024-09-17T02:56:40.253790+0000","last_fullsized":"2024-09-17T02:56:40.253790+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:08.111926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"65'1","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249742+0000","last_change":"2024-09-17T02:56:39.250390+0000","last_active":"2024-09-17T02:56:41.249742+0000","last_peered":"2024-09-17T02:56:41.249742+0000","last_clean":"2024-09-17T02:56:41.249742+0000","last_became_active":"2024-09-17T02:56:39.248965+0000","last_became_peered":"2024-09-17T02:56:39.248965+0000","last_unstale":"2024-09-17T02:56:41.249742+0000","last_undegraded":"2024-09-17T02:56:41.249742+0000","last_fullsized":"2024-09-17T02:56:41.249742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:00.018505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260735+0000","last_change":"2024-09-17T02:56:40.259839+0000","last_active":"2024-09-17T02:56:40.260735+0000","last_peered":"2024-09-17T02:56:40.260735+0000","last_clean":"2024-09-17T02:56:40.260735+0000","last_became_active":"2024-09-17T02:56:40.258694+0000","last_became_peered":"2024-09-17T02:56:40.258694+0000","last_unstale":"2024-09-17T02:56:40.260735+0000","last_undegraded":"2024-09-17T02:56:40.260735+0000","last_fullsized":"2024-09-17T02:56:40.260735+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:37.634885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.272705+0000","last_change":"2024-09-17T02:56:39.257808+0000","last_active":"2024-09-17T02:56:40.272705+0000","last_peered":"2024-09-17T02:56:40.272705+0000","last_clean":"2024-09-17T02:56:40.272705+0000","last_became_active":"2024-09-17T02:56:39.254041+0000","last_became_peered":"2024-09-17T02:56:39.254041+0000","last_unstale":"2024-09-17T02:56:40.272705+0000","last_undegraded":"2024-09-17T02:56:40.272705+0000","last_fullsized":"2024-09-17T02:56:40.272705+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:16.439547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249048+0000","last_change":"2024-09-17T02:56:40.251542+0000","last_active":"2024-09-17T02:56:41.249048+0000","last_peered":"2024-09-17T02:56:41.249048+0000","last_clean":"2024-09-17T02:56:41.249048+0000","last_became_active":"2024-09-17T02:56:40.251186+0000","last_became_peered":"2024-09-17T02:56:40.251186+0000","last_unstale":"2024-09-17T02:56:41.249048+0000","last_undegraded":"2024-09-17T02:56:41.249048+0000","last_fullsized":"2024-09-17T02:56:41.249048+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:27.559868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.254742+0000","last_change":"2024-09-17T02:56:39.252737+0000","last_active":"2024-09-17T02:56:40.254742+0000","last_peered":"2024-09-17T02:56:40.254742+0000","last_clean":"2024-09-17T02:56:40.254742+0000","last_became_active":"2024-09-17T02:56:39.252404+0000","last_became_peered":"2024-09-17T02:56:39.252404+0000","last_unstale":"2024-09-17T02:56:40.254742+0000","last_undegraded":"2024-09-17T02:56:40.254742+0000","last_fullsized":"2024-09-17T02:56:40.254742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:02.769836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260606+0000","last_change":"2024-09-17T02:56:40.260296+0000","last_active":"2024-09-17T02:56:40.260606+0000","last_peered":"2024-09-17T02:56:40.260606+0000","last_clean":"2024-09-17T02:56:40.260606+0000","last_became_active":"2024-09-17T02:56:40.258357+0000","last_became_peered":"2024-09-17T02:56:40.258357+0000","last_unstale":"2024-09-17T02:56:40.260606+0000","last_undegraded":"2024-09-17T02:56:40.260606+0000","last_fullsized":"2024-09-17T02:56:40.260606+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:52:05.400661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249742+0000","last_change":"2024-09-17T02:56:39.252256+0000","last_active":"2024-09-17T02:56:41.249742+0000","last_peered":"2024-09-17T02:56:41.249742+0000","last_clean":"2024-09-17T02:56:41.249742+0000","last_became_active":"2024-09-17T02:56:39.251978+0000","last_became_peered":"2024-09-17T02:56:39.251978+0000","last_unstale":"2024-09-17T02:56:41.249742+0000","last_undegraded":"2024-09-17T02:56:41.249742+0000","last_fullsized":"2024-09-17T02:56:41.249742+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:08.009188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249590+0000","last_change":"2024-09-17T02:56:40.259070+0000","last_active":"2024-09-17T02:56:41.249590+0000","last_peered":"2024-09-17T02:56:41.249590+0000","last_clean":"2024-09-17T02:56:41.249590+0000","last_became_active":"2024-09-17T02:56:40.258500+0000","last_became_peered":"2024-09-17T02:56:40.258500+0000","last_unstale":"2024-09-17T02:56:41.249590+0000","last_undegraded":"2024-09-17T02:56:41.249590+0000","last_fullsized":"2024-09-17T02:56:41.249590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:44.331230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247243+0000","last_change":"2024-09-17T02:56:39.252585+0000","last_active":"2024-09-17T02:56:41.247243+0000","last_peered":"2024-09-17T02:56:41.247243+0000","last_clean":"2024-09-17T02:56:41.247243+0000","last_became_active":"2024-09-17T02:56:39.252111+0000","last_became_peered":"2024-09-17T02:56:39.252111+0000","last_unstale":"2024-09-17T02:56:41.247243+0000","last_undegraded":"2024-09-17T02:56:41.247243+0000","last_fullsized":"2024-09-17T02:56:41.247243+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:59.038513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246684+0000","last_change":"2024-09-17T02:56:40.257778+0000","last_active":"2024-09-17T02:56:41.246684+0000","last_peered":"2024-09-17T02:56:41.246684+0000","last_clean":"2024-09-17T02:56:41.246684+0000","last_became_active":"2024-09-17T02:56:40.256565+0000","last_became_peered":"2024-09-17T02:56:40.256565+0000","last_unstale":"2024-09-17T02:56:41.246684+0000","last_undegraded":"2024-09-17T02:56:41.246684+0000","last_fullsized":"2024-09-17T02:56:41.246684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:24.376090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.250403+0000","last_change":"2024-09-17T02:56:39.251402+0000","last_active":"2024-09-17T02:56:40.250403+0000","last_peered":"2024-09-17T02:56:40.250403+0000","last_clean":"2024-09-17T02:56:40.250403+0000","last_became_active":"2024-09-17T02:56:39.251139+0000","last_became_peered":"2024-09-17T02:56:39.251139+0000","last_unstale":"2024-09-17T02:56:40.250403+0000","last_undegraded":"2024-09-17T02:56:40.250403+0000","last_fullsized":"2024-09-17T02:56:40.250403+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:08.438263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467346+0000","last_change":"2024-09-17T02:56:40.260972+0000","last_active":"2024-09-17T02:56:41.467346+0000","last_peered":"2024-09-17T02:56:41.467346+0000","last_clean":"2024-09-17T02:56:41.467346+0000","last_became_active":"2024-09-17T02:56:40.259435+0000","last_became_peered":"2024-09-17T02:56:40.259435+0000","last_unstale":"2024-09-17T02:56:41.467346+0000","last_undegraded":"2024-09-17T02:56:41.467346+0000","last_fullsized":"2024-09-17T02:56:41.467346+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:38.767421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"65'3","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247108+0000","last_change":"2024-09-17T02:56:39.251192+0000","last_active":"2024-09-17T02:56:41.247108+0000","last_peered":"2024-09-17T02:56:41.247108+0000","last_clean":"2024-09-17T02:56:41.247108+0000","last_became_active":"2024-09-17T02:56:39.250931+0000","last_became_peered":"2024-09-17T02:56:39.250931+0000","last_unstale":"2024-09-17T02:56:41.247108+0000","last_undegraded":"2024-09-17T02:56:41.247108+0000","last_fullsized":"2024-09-17T02:56:41.247108+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:17:20.631936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247022+0000","last_change":"2024-09-17T02:56:40.259493+0000","last_active":"2024-09-17T02:56:41.247022+0000","last_peered":"2024-09-17T02:56:41.247022+0000","last_clean":"2024-09-17T02:56:41.247022+0000","last_became_active":"2024-09-17T02:56:40.258293+0000","last_became_peered":"2024-09-17T02:56:40.258293+0000","last_unstale":"2024-09-17T02:56:41.247022+0000","last_undegraded":"2024-09-17T02:56:41.247022+0000","last_fullsized":"2024-09-17T02:56:41.247022+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:30.333324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"65'6","reported_seq":21,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249580+0000","last_change":"2024-09-17T02:56:39.247250+0000","last_active":"2024-09-17T02:56:41.249580+0000","last_peered":"2024-09-17T02:56:41.249580+0000","last_clean":"2024-09-17T02:56:41.249580+0000","last_became_active":"2024-09-17T02:56:39.246966+0000","last_became_peered":"2024-09-17T02:56:39.246966+0000","last_unstale":"2024-09-17T02:56:41.249580+0000","last_undegraded":"2024-09-17T02:56:41.249580+0000","last_fullsized":"2024-09-17T02:56:41.249580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:23.795978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.259178+0000","last_change":"2024-09-17T02:56:40.258967+0000","last_active":"2024-09-17T02:56:40.259178+0000","last_peered":"2024-09-17T02:56:40.259178+0000","last_clean":"2024-09-17T02:56:40.259178+0000","last_became_active":"2024-09-17T02:56:40.257945+0000","last_became_peered":"2024-09-17T02:56:40.257945+0000","last_unstale":"2024-09-17T02:56:40.259178+0000","last_undegraded":"2024-09-17T02:56:40.259178+0000","last_fullsized":"2024-09-17T02:56:40.259178+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:22.994269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273515+0000","last_change":"2024-09-17T02:56:39.251967+0000","last_active":"2024-09-17T02:56:40.273515+0000","last_peered":"2024-09-17T02:56:40.273515+0000","last_clean":"2024-09-17T02:56:40.273515+0000","last_became_active":"2024-09-17T02:56:39.251669+0000","last_became_peered":"2024-09-17T02:56:39.251669+0000","last_unstale":"2024-09-17T02:56:40.273515+0000","last_undegraded":"2024-09-17T02:56:40.273515+0000","last_fullsized":"2024-09-17T02:56:40.273515+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:11.628369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246656+0000","last_change":"2024-09-17T02:56:40.252179+0000","last_active":"2024-09-17T02:56:41.246656+0000","last_peered":"2024-09-17T02:56:41.246656+0000","last_clean":"2024-09-17T02:56:41.246656+0000","last_became_active":"2024-09-17T02:56:40.251913+0000","last_became_peered":"2024-09-17T02:56:40.251913+0000","last_unstale":"2024-09-17T02:56:41.246656+0000","last_undegraded":"2024-09-17T02:56:41.246656+0000","last_fullsized":"2024-09-17T02:56:41.246656+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:46.193785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249433+0000","last_change":"2024-09-17T02:56:39.250925+0000","last_active":"2024-09-17T02:56:41.249433+0000","last_peered":"2024-09-17T02:56:41.249433+0000","last_clean":"2024-09-17T02:56:41.249433+0000","last_became_active":"2024-09-17T02:56:39.250209+0000","last_became_peered":"2024-09-17T02:56:39.250209+0000","last_unstale":"2024-09-17T02:56:41.249433+0000","last_undegraded":"2024-09-17T02:56:41.249433+0000","last_fullsized":"2024-09-17T02:56:41.249433+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:52.158602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249804+0000","last_change":"2024-09-17T02:56:40.250817+0000","last_active":"2024-09-17T02:56:41.249804+0000","last_peered":"2024-09-17T02:56:41.249804+0000","last_clean":"2024-09-17T02:56:41.249804+0000","last_became_active":"2024-09-17T02:56:40.250501+0000","last_became_peered":"2024-09-17T02:56:40.250501+0000","last_unstale":"2024-09-17T02:56:41.249804+0000","last_undegraded":"2024-09-17T02:56:41.249804+0000","last_fullsized":"2024-09-17T02:56:41.249804+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:45.348070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.252628+0000","last_change":"2024-09-17T02:56:39.255051+0000","last_active":"2024-09-17T02:56:40.252628+0000","last_peered":"2024-09-17T02:56:40.252628+0000","last_clean":"2024-09-17T02:56:40.252628+0000","last_became_active":"2024-09-17T02:56:39.254771+0000","last_became_peered":"2024-09-17T02:56:39.254771+0000","last_unstale":"2024-09-17T02:56:40.252628+0000","last_undegraded":"2024-09-17T02:56:40.252628+0000","last_fullsized":"2024-09-17T02:56:40.252628+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:19:50.646086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246564+0000","last_change":"2024-09-17T02:56:40.251461+0000","last_active":"2024-09-17T02:56:41.246564+0000","last_peered":"2024-09-17T02:56:41.246564+0000","last_clean":"2024-09-17T02:56:41.246564+0000","last_became_active":"2024-09-17T02:56:40.251186+0000","last_became_peered":"2024-09-17T02:56:40.251186+0000","last_unstale":"2024-09-17T02:56:41.246564+0000","last_undegraded":"2024-09-17T02:56:41.246564+0000","last_fullsized":"2024-09-17T02:56:41.246564+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:02.431576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"65'8","reported_seq":23,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247185+0000","last_change":"2024-09-17T02:56:39.253806+0000","last_active":"2024-09-17T02:56:41.247185+0000","last_peered":"2024-09-17T02:56:41.247185+0000","last_clean":"2024-09-17T02:56:41.247185+0000","last_became_active":"2024-09-17T02:56:39.253252+0000","last_became_peered":"2024-09-17T02:56:39.253252+0000","last_unstale":"2024-09-17T02:56:41.247185+0000","last_undegraded":"2024-09-17T02:56:41.247185+0000","last_fullsized":"2024-09-17T02:56:41.247185+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:20:33.103976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246928+0000","last_change":"2024-09-17T02:56:40.254817+0000","last_active":"2024-09-17T02:56:41.246928+0000","last_peered":"2024-09-17T02:56:41.246928+0000","last_clean":"2024-09-17T02:56:41.246928+0000","last_became_active":"2024-09-17T02:56:40.254115+0000","last_became_peered":"2024-09-17T02:56:40.254115+0000","last_unstale":"2024-09-17T02:56:41.246928+0000","last_undegraded":"2024-09-17T02:56:41.246928+0000","last_fullsized":"2024-09-17T02:56:41.246928+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:23.071855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273506+0000","last_change":"2024-09-17T02:56:39.255693+0000","last_active":"2024-09-17T02:56:40.273506+0000","last_peered":"2024-09-17T02:56:40.273506+0000","last_clean":"2024-09-17T02:56:40.273506+0000","last_became_active":"2024-09-17T02:56:39.251990+0000","last_became_peered":"2024-09-17T02:56:39.251990+0000","last_unstale":"2024-09-17T02:56:40.273506+0000","last_undegraded":"2024-09-17T02:56:40.273506+0000","last_fullsized":"2024-09-17T02:56:40.273506+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:05:13.614834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.258855+0000","last_change":"2024-09-17T02:56:40.257741+0000","last_active":"2024-09-17T02:56:40.258855+0000","last_peered":"2024-09-17T02:56:40.258855+0000","last_clean":"2024-09-17T02:56:40.258855+0000","last_became_active":"2024-09-17T02:56:40.256599+0000","last_became_peered":"2024-09-17T02:56:40.256599+0000","last_unstale":"2024-09-17T02:56:40.258855+0000","last_undegraded":"2024-09-17T02:56:40.258855+0000","last_fullsized":"2024-09-17T02:56:40.258855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:36.383844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273365+0000","last_change":"2024-09-17T02:56:39.256599+0000","last_active":"2024-09-17T02:56:40.273365+0000","last_peered":"2024-09-17T02:56:40.273365+0000","last_clean":"2024-09-17T02:56:40.273365+0000","last_became_active":"2024-09-17T02:56:39.254504+0000","last_became_peered":"2024-09-17T02:56:39.254504+0000","last_unstale":"2024-09-17T02:56:40.273365+0000","last_undegraded":"2024-09-17T02:56:40.273365+0000","last_fullsized":"2024-09-17T02:56:40.273365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:23.776693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.256966+0000","last_change":"2024-09-17T02:56:40.254366+0000","last_active":"2024-09-17T02:56:40.256966+0000","last_peered":"2024-09-17T02:56:40.256966+0000","last_clean":"2024-09-17T02:56:40.256966+0000","last_became_active":"2024-09-17T02:56:40.254061+0000","last_became_peered":"2024-09-17T02:56:40.254061+0000","last_unstale":"2024-09-17T02:56:40.256966+0000","last_undegraded":"2024-09-17T02:56:40.256966+0000","last_fullsized":"2024-09-17T02:56:40.256966+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:00.579716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"65'1","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273804+0000","last_change":"2024-09-17T02:56:39.257740+0000","last_active":"2024-09-17T02:56:40.273804+0000","last_peered":"2024-09-17T02:56:40.273804+0000","last_clean":"2024-09-17T02:56:40.273804+0000","last_became_active":"2024-09-17T02:56:39.257090+0000","last_became_peered":"2024-09-17T02:56:39.257090+0000","last_unstale":"2024-09-17T02:56:40.273804+0000","last_undegraded":"2024-09-17T02:56:40.273804+0000","last_fullsized":"2024-09-17T02:56:40.273804+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:56.758219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246870+0000","last_change":"2024-09-17T02:56:40.257289+0000","last_active":"2024-09-17T02:56:41.246870+0000","last_peered":"2024-09-17T02:56:41.246870+0000","last_clean":"2024-09-17T02:56:41.246870+0000","last_became_active":"2024-09-17T02:56:40.256209+0000","last_became_peered":"2024-09-17T02:56:40.256209+0000","last_unstale":"2024-09-17T02:56:41.246870+0000","last_undegraded":"2024-09-17T02:56:41.246870+0000","last_fullsized":"2024-09-17T02:56:41.246870+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:27.607552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.253792+0000","last_change":"2024-09-17T02:56:39.248592+0000","last_active":"2024-09-17T02:56:40.253792+0000","last_peered":"2024-09-17T02:56:40.253792+0000","last_clean":"2024-09-17T02:56:40.253792+0000","last_became_active":"2024-09-17T02:56:39.248314+0000","last_became_peered":"2024-09-17T02:56:39.248314+0000","last_unstale":"2024-09-17T02:56:40.253792+0000","last_undegraded":"2024-09-17T02:56:40.253792+0000","last_fullsized":"2024-09-17T02:56:40.253792+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:37.122653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257502+0000","last_change":"2024-09-17T02:56:40.257230+0000","last_active":"2024-09-17T02:56:40.257502+0000","last_peered":"2024-09-17T02:56:40.257502+0000","last_clean":"2024-09-17T02:56:40.257502+0000","last_became_active":"2024-09-17T02:56:40.256246+0000","last_became_peered":"2024-09-17T02:56:40.256246+0000","last_unstale":"2024-09-17T02:56:40.257502+0000","last_undegraded":"2024-09-17T02:56:40.257502+0000","last_fullsized":"2024-09-17T02:56:40.257502+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:33.873282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"65'2","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.273613+0000","last_change":"2024-09-17T02:56:39.249918+0000","last_active":"2024-09-17T02:56:40.273613+0000","last_peered":"2024-09-17T02:56:40.273613+0000","last_clean":"2024-09-17T02:56:40.273613+0000","last_became_active":"2024-09-17T02:56:39.247913+0000","last_became_peered":"2024-09-17T02:56:39.247913+0000","last_unstale":"2024-09-17T02:56:40.273613+0000","last_undegraded":"2024-09-17T02:56:40.273613+0000","last_fullsized":"2024-09-17T02:56:40.273613+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:51.885111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.263752+0000","last_change":"2024-09-17T02:56:40.263563+0000","last_active":"2024-09-17T02:56:40.263752+0000","last_peered":"2024-09-17T02:56:40.263752+0000","last_clean":"2024-09-17T02:56:40.263752+0000","last_became_active":"2024-09-17T02:56:40.263255+0000","last_became_peered":"2024-09-17T02:56:40.263255+0000","last_unstale":"2024-09-17T02:56:40.263752+0000","last_undegraded":"2024-09-17T02:56:40.263752+0000","last_fullsized":"2024-09-17T02:56:40.263752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:29.421521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467568+0000","last_change":"2024-09-17T02:56:39.250123+0000","last_active":"2024-09-17T02:56:41.467568+0000","last_peered":"2024-09-17T02:56:41.467568+0000","last_clean":"2024-09-17T02:56:41.467568+0000","last_became_active":"2024-09-17T02:56:39.249795+0000","last_became_peered":"2024-09-17T02:56:39.249795+0000","last_unstale":"2024-09-17T02:56:41.467568+0000","last_undegraded":"2024-09-17T02:56:41.467568+0000","last_fullsized":"2024-09-17T02:56:41.467568+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:38.329446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.255405+0000","last_change":"2024-09-17T02:56:40.254518+0000","last_active":"2024-09-17T02:56:40.255405+0000","last_peered":"2024-09-17T02:56:40.255405+0000","last_clean":"2024-09-17T02:56:40.255405+0000","last_became_active":"2024-09-17T02:56:40.253798+0000","last_became_peered":"2024-09-17T02:56:40.253798+0000","last_unstale":"2024-09-17T02:56:40.255405+0000","last_undegraded":"2024-09-17T02:56:40.255405+0000","last_fullsized":"2024-09-17T02:56:40.255405+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:08.848891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.254841+0000","last_change":"2024-09-17T02:56:39.257408+0000","last_active":"2024-09-17T02:56:40.254841+0000","last_peered":"2024-09-17T02:56:40.254841+0000","last_clean":"2024-09-17T02:56:40.254841+0000","last_became_active":"2024-09-17T02:56:39.256607+0000","last_became_peered":"2024-09-17T02:56:39.256607+0000","last_unstale":"2024-09-17T02:56:40.254841+0000","last_undegraded":"2024-09-17T02:56:40.254841+0000","last_fullsized":"2024-09-17T02:56:40.254841+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:31.769008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260141+0000","last_change":"2024-09-17T02:56:40.259944+0000","last_active":"2024-09-17T02:56:40.260141+0000","last_peered":"2024-09-17T02:56:40.260141+0000","last_clean":"2024-09-17T02:56:40.260141+0000","last_became_active":"2024-09-17T02:56:40.259525+0000","last_became_peered":"2024-09-17T02:56:40.259525+0000","last_unstale":"2024-09-17T02:56:40.260141+0000","last_undegraded":"2024-09-17T02:56:40.260141+0000","last_fullsized":"2024-09-17T02:56:40.260141+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:09.529135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"65'2","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467369+0000","last_change":"2024-09-17T02:56:39.249788+0000","last_active":"2024-09-17T02:56:41.467369+0000","last_peered":"2024-09-17T02:56:41.467369+0000","last_clean":"2024-09-17T02:56:41.467369+0000","last_became_active":"2024-09-17T02:56:39.249480+0000","last_became_peered":"2024-09-17T02:56:39.249480+0000","last_unstale":"2024-09-17T02:56:41.467369+0000","last_undegraded":"2024-09-17T02:56:41.467369+0000","last_fullsized":"2024-09-17T02:56:41.467369+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:37.897630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257312+0000","last_change":"2024-09-17T02:56:40.257087+0000","last_active":"2024-09-17T02:56:40.257312+0000","last_peered":"2024-09-17T02:56:40.257312+0000","last_clean":"2024-09-17T02:56:40.257312+0000","last_became_active":"2024-09-17T02:56:40.256221+0000","last_became_peered":"2024-09-17T02:56:40.256221+0000","last_unstale":"2024-09-17T02:56:40.257312+0000","last_undegraded":"2024-09-17T02:56:40.257312+0000","last_fullsized":"2024-09-17T02:56:40.257312+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:52.902918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257712+0000","last_change":"2024-09-17T02:56:39.258124+0000","last_active":"2024-09-17T02:56:40.257712+0000","last_peered":"2024-09-17T02:56:40.257712+0000","last_clean":"2024-09-17T02:56:40.257712+0000","last_became_active":"2024-09-17T02:56:39.254432+0000","last_became_peered":"2024-09-17T02:56:39.254432+0000","last_unstale":"2024-09-17T02:56:40.257712+0000","last_undegraded":"2024-09-17T02:56:40.257712+0000","last_fullsized":"2024-09-17T02:56:40.257712+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:19.968957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467807+0000","last_change":"2024-09-17T02:56:40.256773+0000","last_active":"2024-09-17T02:56:41.467807+0000","last_peered":"2024-09-17T02:56:41.467807+0000","last_clean":"2024-09-17T02:56:41.467807+0000","last_became_active":"2024-09-17T02:56:40.256531+0000","last_became_peered":"2024-09-17T02:56:40.256531+0000","last_unstale":"2024-09-17T02:56:41.467807+0000","last_undegraded":"2024-09-17T02:56:41.467807+0000","last_fullsized":"2024-09-17T02:56:41.467807+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:01.160002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.248947+0000","last_change":"2024-09-17T02:56:39.251225+0000","last_active":"2024-09-17T02:56:41.248947+0000","last_peered":"2024-09-17T02:56:41.248947+0000","last_clean":"2024-09-17T02:56:41.248947+0000","last_became_active":"2024-09-17T02:56:39.250364+0000","last_became_peered":"2024-09-17T02:56:39.250364+0000","last_unstale":"2024-09-17T02:56:41.248947+0000","last_undegraded":"2024-09-17T02:56:41.248947+0000","last_fullsized":"2024-09-17T02:56:41.248947+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:41.026320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.262834+0000","last_change":"2024-09-17T02:56:40.261824+0000","last_active":"2024-09-17T02:56:40.262834+0000","last_peered":"2024-09-17T02:56:40.262834+0000","last_clean":"2024-09-17T02:56:40.262834+0000","last_became_active":"2024-09-17T02:56:40.259183+0000","last_became_peered":"2024-09-17T02:56:40.259183+0000","last_unstale":"2024-09-17T02:56:40.262834+0000","last_undegraded":"2024-09-17T02:56:40.262834+0000","last_fullsized":"2024-09-17T02:56:40.262834+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:55.192658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.251751+0000","last_change":"2024-09-17T02:56:39.252791+0000","last_active":"2024-09-17T02:56:40.251751+0000","last_peered":"2024-09-17T02:56:40.251751+0000","last_clean":"2024-09-17T02:56:40.251751+0000","last_became_active":"2024-09-17T02:56:39.252447+0000","last_became_peered":"2024-09-17T02:56:39.252447+0000","last_unstale":"2024-09-17T02:56:40.251751+0000","last_undegraded":"2024-09-17T02:56:40.251751+0000","last_fullsized":"2024-09-17T02:56:40.251751+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:03.954990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.262618+0000","last_change":"2024-09-17T02:56:40.262400+0000","last_active":"2024-09-17T02:56:40.262618+0000","last_peered":"2024-09-17T02:56:40.262618+0000","last_clean":"2024-09-17T02:56:40.262618+0000","last_became_active":"2024-09-17T02:56:40.259505+0000","last_became_peered":"2024-09-17T02:56:40.259505+0000","last_unstale":"2024-09-17T02:56:40.262618+0000","last_undegraded":"2024-09-17T02:56:40.262618+0000","last_fullsized":"2024-09-17T02:56:40.262618+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:39.996619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467659+0000","last_change":"2024-09-17T02:56:39.254579+0000","last_active":"2024-09-17T02:56:41.467659+0000","last_peered":"2024-09-17T02:56:41.467659+0000","last_clean":"2024-09-17T02:56:41.467659+0000","last_became_active":"2024-09-17T02:56:39.254313+0000","last_became_peered":"2024-09-17T02:56:39.254313+0000","last_unstale":"2024-09-17T02:56:41.467659+0000","last_undegraded":"2024-09-17T02:56:41.467659+0000","last_fullsized":"2024-09-17T02:56:41.467659+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:14.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.247054+0000","last_change":"2024-09-17T02:56:40.253727+0000","last_active":"2024-09-17T02:56:41.247054+0000","last_peered":"2024-09-17T02:56:41.247054+0000","last_clean":"2024-09-17T02:56:41.247054+0000","last_became_active":"2024-09-17T02:56:40.253435+0000","last_became_peered":"2024-09-17T02:56:40.253435+0000","last_unstale":"2024-09-17T02:56:41.247054+0000","last_undegraded":"2024-09-17T02:56:41.247054+0000","last_fullsized":"2024-09-17T02:56:41.247054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:06.415272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249831+0000","last_change":"2024-09-17T02:56:39.250856+0000","last_active":"2024-09-17T02:56:41.249831+0000","last_peered":"2024-09-17T02:56:41.249831+0000","last_clean":"2024-09-17T02:56:41.249831+0000","last_became_active":"2024-09-17T02:56:39.249730+0000","last_became_peered":"2024-09-17T02:56:39.249730+0000","last_unstale":"2024-09-17T02:56:41.249831+0000","last_undegraded":"2024-09-17T02:56:41.249831+0000","last_fullsized":"2024-09-17T02:56:41.249831+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:25.079000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467495+0000","last_change":"2024-09-17T02:56:40.258148+0000","last_active":"2024-09-17T02:56:41.467495+0000","last_peered":"2024-09-17T02:56:41.467495+0000","last_clean":"2024-09-17T02:56:41.467495+0000","last_became_active":"2024-09-17T02:56:40.257876+0000","last_became_peered":"2024-09-17T02:56:40.257876+0000","last_unstale":"2024-09-17T02:56:41.467495+0000","last_undegraded":"2024-09-17T02:56:41.467495+0000","last_fullsized":"2024-09-17T02:56:41.467495+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:30.036767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.467467+0000","last_change":"2024-09-17T02:56:39.259018+0000","last_active":"2024-09-17T02:56:41.467467+0000","last_peered":"2024-09-17T02:56:41.467467+0000","last_clean":"2024-09-17T02:56:41.467467+0000","last_became_active":"2024-09-17T02:56:39.258718+0000","last_became_peered":"2024-09-17T02:56:39.258718+0000","last_unstale":"2024-09-17T02:56:41.467467+0000","last_undegraded":"2024-09-17T02:56:41.467467+0000","last_fullsized":"2024-09-17T02:56:41.467467+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:57.113289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.260010+0000","last_change":"2024-09-17T02:56:40.258088+0000","last_active":"2024-09-17T02:56:40.260010+0000","last_peered":"2024-09-17T02:56:40.260010+0000","last_clean":"2024-09-17T02:56:40.260010+0000","last_became_active":"2024-09-17T02:56:40.256376+0000","last_became_peered":"2024-09-17T02:56:40.256376+0000","last_unstale":"2024-09-17T02:56:40.260010+0000","last_undegraded":"2024-09-17T02:56:40.260010+0000","last_fullsized":"2024-09-17T02:56:40.260010+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:04.609782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.249385+0000","last_change":"2024-09-17T02:56:39.257527+0000","last_active":"2024-09-17T02:56:40.249385+0000","last_peered":"2024-09-17T02:56:40.249385+0000","last_clean":"2024-09-17T02:56:40.249385+0000","last_became_active":"2024-09-17T02:56:39.257212+0000","last_became_peered":"2024-09-17T02:56:39.257212+0000","last_unstale":"2024-09-17T02:56:40.249385+0000","last_undegraded":"2024-09-17T02:56:40.249385+0000","last_fullsized":"2024-09-17T02:56:40.249385+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:08.179971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T02:56:40.257017+0000","last_change":"2024-09-17T02:56:40.255191+0000","last_active":"2024-09-17T02:56:40.257017+0000","last_peered":"2024-09-17T02:56:40.257017+0000","last_clean":"2024-09-17T02:56:40.257017+0000","last_became_active":"2024-09-17T02:56:40.254913+0000","last_became_peered":"2024-09-17T02:56:40.254913+0000","last_unstale":"2024-09-17T02:56:40.257017+0000","last_undegraded":"2024-09-17T02:56:40.257017+0000","last_fullsized":"2024-09-17T02:56:40.257017+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:39.236021+0000","last_clean_scrub_stamp":"2024-09-17T02:56:39.236021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:27.742125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.249195+0000","last_change":"2024-09-17T02:56:39.253794+0000","last_active":"2024-09-17T02:56:41.249195+0000","last_peered":"2024-09-17T02:56:41.249195+0000","last_clean":"2024-09-17T02:56:41.249195+0000","last_became_active":"2024-09-17T02:56:39.253536+0000","last_became_peered":"2024-09-17T02:56:39.253536+0000","last_unstale":"2024-09-17T02:56:41.249195+0000","last_undegraded":"2024-09-17T02:56:41.249195+0000","last_fullsized":"2024-09-17T02:56:41.249195+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:56:38.229562+0000","last_clean_scrub_stamp":"2024-09-17T02:56:38.229562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:56.141703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":197,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-17T02:56:41.246357+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:56:41.246357+0000","last_peered":"2024-09-17T02:56:41.246357+0000","last_clean":"2024-09-17T02:56:41.246357+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:56:41.246357+0000","last_undegraded":"2024-09-17T02:56:41.246357+0000","last_fullsized":"2024-09-17T02:56:41.246357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:45.523259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":900,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194411,"statfs":{"total":200000000,"available":199077739,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":323,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668267,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":324,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199667615,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194986,"statfs":{"total":200000000,"available":199666655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":324,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668211,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":324,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668211,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":324,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194988,"statfs":{"total":200000000,"available":199668177,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":902,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:56:43.613 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:56:43.614 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T02:56:43.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.771+0000 7fca55d9b640 1 -- 172.21.15.104:0/1248574937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 msgr2=0x7fca5015f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.771+0000 7fca55d9b640 1 --2- 172.21.15.104:0/1248574937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 0x7fca5015f6a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fca40005fd0 tx=0x7fca4002a5d0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.771+0000 7fca55d9b640 1 -- 172.21.15.104:0/1248574937 shutdown_connections 2024-09-17T02:56:43.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.771+0000 7fca55d9b640 1 --2- 172.21.15.104:0/1248574937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca5015fbe0 0x7fca500b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.771+0000 7fca55d9b640 1 --2- 172.21.15.104:0/1248574937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 0x7fca5015f6a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.771+0000 7fca55d9b640 1 -- 172.21.15.104:0/1248574937 >> 172.21.15.104:0/1248574937 conn(0x7fca50069120 msgr2=0x7fca50069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:43.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.772+0000 7fca55d9b640 1 -- 172.21.15.104:0/1248574937 shutdown_connections 2024-09-17T02:56:43.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.772+0000 7fca55d9b640 1 -- 172.21.15.104:0/1248574937 wait complete. 2024-09-17T02:56:43.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.773+0000 7fca55d9b640 1 Processor -- start 2024-09-17T02:56:43.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.774+0000 7fca55d9b640 1 -- start start 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca55d9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b6b20 0x7fca5015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca55d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 0x7fca5014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca55d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca5015fbe0 0x7fca501f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca55d9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fca501633f0 con 0x7fca500d05e0 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca55d9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fca500d41a0 con 0x7fca5015fbe0 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca55d9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fca50163570 con 0x7fca500b6b20 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 0x7fca5014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 0x7fca5014a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:47852/0 (socket says 172.21.15.104:47852) 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 -- 172.21.15.104:0/2769636177 learned_addr learned my addr 172.21.15.104:0/2769636177 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4f7fe640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b6b20 0x7fca5015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4ffff640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca5015fbe0 0x7fca501f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 -- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b6b20 msgr2=0x7fca5015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b6b20 0x7fca5015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 -- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca5015fbe0 msgr2=0x7fca501f9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca5015fbe0 0x7fca501f9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 -- 172.21.15.104:0/2769636177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5014a860 con 0x7fca500d05e0 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca4effd640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 0x7fca5014a320 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fca4400d6d0 tx=0x7fca4400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca37fff640 1 -- 172.21.15.104:0/2769636177 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44017070 con 0x7fca500d05e0 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.775+0000 7fca37fff640 1 -- 172.21.15.104:0/2769636177 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca44005330 con 0x7fca500d05e0 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.776+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5015a2b0 con 0x7fca500d05e0 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.776+0000 7fca37fff640 1 -- 172.21.15.104:0/2769636177 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44009820 con 0x7fca500d05e0 2024-09-17T02:56:43.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.776+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca501f99f0 con 0x7fca500d05e0 2024-09-17T02:56:43.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.777+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5014d0a0 con 0x7fca500d05e0 2024-09-17T02:56:43.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.777+0000 7fca37fff640 1 -- 172.21.15.104:0/2769636177 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca440099c0 con 0x7fca500d05e0 2024-09-17T02:56:43.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.778+0000 7fca37fff640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fca3c078b90 0x7fca3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:43.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.778+0000 7fca37fff640 1 -- 172.21.15.104:0/2769636177 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fca4409adf0 con 0x7fca500d05e0 2024-09-17T02:56:43.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.778+0000 7fca4f7fe640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fca3c078b90 0x7fca3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:43.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.778+0000 7fca4f7fe640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fca3c078b90 0x7fca3c07b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca40033000 tx=0x7fca40004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:43.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:43.782+0000 7fca37fff640 1 -- 172.21.15.104:0/2769636177 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca440632c0 con 0x7fca500d05e0 2024-09-17T02:56:44.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.022+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fca50163a20 con 0x7fca500d05e0 2024-09-17T02:56:44.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.025+0000 7fca37fff640 1 -- 172.21.15.104:0/2769636177 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7fca44062bc0 con 0x7fca500d05e0 2024-09-17T02:56:44.023 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T02:56:44.023 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T02:56:44.023 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T02:56:44.023 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T02:56:44.023 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T02:56:44.024 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T02:56:44.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fca3c078b90 msgr2=0x7fca3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fca3c078b90 0x7fca3c07b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca40033000 tx=0x7fca40004730 comp rx=0 tx=0).stop 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 msgr2=0x7fca5014a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 0x7fca5014a320 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fca4400d6d0 tx=0x7fca4400db90 comp rx=0 tx=0).stop 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 shutdown_connections 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fca3c078b90 0x7fca3c07b0a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca5015fbe0 0x7fca501f9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fca500d05e0 0x7fca5014a320 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 --2- 172.21.15.104:0/2769636177 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fca500b6b20 0x7fca5015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 >> 172.21.15.104:0/2769636177 conn(0x7fca50069120 msgr2=0x7fca500b8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 shutdown_connections 2024-09-17T02:56:44.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.027+0000 7fca55d9b640 1 -- 172.21.15.104:0/2769636177 wait complete. 2024-09-17T02:56:44.037 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:44.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.150+0000 7fc7f5840640 1 -- 172.21.15.104:0/3606800012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00b6f70 msgr2=0x7fc7f015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.150+0000 7fc7f5840640 1 --2- 172.21.15.104:0/3606800012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00b6f70 0x7fc7f015ef90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00b44d0 tx=0x7fc7e002a4d0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.150+0000 7fc7f5840640 1 -- 172.21.15.104:0/3606800012 shutdown_connections 2024-09-17T02:56:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.150+0000 7fc7f5840640 1 --2- 172.21.15.104:0/3606800012 >> v2:172.21.15.192:3300/0 conn(0x7fc7f00b3b00 0x7fc7f00d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.150+0000 7fc7f5840640 1 --2- 172.21.15.104:0/3606800012 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00b6f70 0x7fc7f015ef90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.150+0000 7fc7f5840640 1 -- 172.21.15.104:0/3606800012 >> 172.21.15.104:0/3606800012 conn(0x7fc7f0073df0 msgr2=0x7fc7f0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.150+0000 7fc7f5840640 1 -- 172.21.15.104:0/3606800012 shutdown_connections 2024-09-17T02:56:44.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.150+0000 7fc7f5840640 1 -- 172.21.15.104:0/3606800012 wait complete. 2024-09-17T02:56:44.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.151+0000 7fc7f5840640 1 Processor -- start 2024-09-17T02:56:44.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.152+0000 7fc7f5840640 1 -- start start 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7f5840640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7f00b3b00 0x7fc7f00b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7f5840640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7f00b6f70 0x7fc7f015f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7f5840640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00d1710 0x7fc7f015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7f5840640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00d01b0 con 0x7fc7f00d1710 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7f5840640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00d0030 con 0x7fc7f00b6f70 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7f5840640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f00d0330 con 0x7fc7f00b3b00 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7ef7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00d1710 0x7fc7f015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7ef7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00d1710 0x7fc7f015cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39376/0 (socket says 172.21.15.104:39376) 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7ef7fe640 1 -- 172.21.15.104:0/2299148726 learned_addr learned my addr 172.21.15.104:0/2299148726 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7eeffd640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7f00b3b00 0x7fc7f00b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7ef7fe640 1 -- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7f00b3b00 msgr2=0x7fc7f00b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7ef7fe640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7f00b3b00 0x7fc7f00b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7ef7fe640 1 -- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7f00b6f70 msgr2=0x7fc7f015f650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T02:56:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7ef7fe640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7f00b6f70 0x7fc7f015f650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.153+0000 7fc7ef7fe640 1 -- 172.21.15.104:0/2299148726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f00c9630 con 0x7fc7f00d1710 2024-09-17T02:56:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.154+0000 7fc7ef7fe640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00d1710 0x7fc7f015cb20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b970 tx=0x7fc7e800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.154+0000 7fc7d7fff640 1 -- 172.21.15.104:0/2299148726 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8019070 con 0x7fc7f00d1710 2024-09-17T02:56:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.154+0000 7fc7d7fff640 1 -- 172.21.15.104:0/2299148726 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7e800cc30 con 0x7fc7f00d1710 2024-09-17T02:56:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.154+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f00c9910 con 0x7fc7f00d1710 2024-09-17T02:56:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.154+0000 7fc7d7fff640 1 -- 172.21.15.104:0/2299148726 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80146a0 con 0x7fc7f00d1710 2024-09-17T02:56:44.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.154+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f00c9ed0 con 0x7fc7f00d1710 2024-09-17T02:56:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.155+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f00b34f0 con 0x7fc7f00d1710 2024-09-17T02:56:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.156+0000 7fc7d7fff640 1 -- 172.21.15.104:0/2299148726 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7e801c070 con 0x7fc7f00d1710 2024-09-17T02:56:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.156+0000 7fc7d7fff640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc7dc078bc0 0x7fc7dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.156+0000 7fc7d7fff640 1 -- 172.21.15.104:0/2299148726 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fc7e809aa90 con 0x7fc7f00d1710 2024-09-17T02:56:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.157+0000 7fc7eeffd640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc7dc078bc0 0x7fc7dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.157+0000 7fc7eeffd640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc7dc078bc0 0x7fc7dc07b0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0033000 tx=0x7fc7e0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:44.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.161+0000 7fc7d7fff640 1 -- 172.21.15.104:0/2299148726 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc7e8062ed0 con 0x7fc7f00d1710 2024-09-17T02:56:44.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.371+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7f00b4fb0 con 0x7fc7f00d1710 2024-09-17T02:56:44.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.372+0000 7fc7d7fff640 1 -- 172.21.15.104:0/2299148726 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7fc7e80627d0 con 0x7fc7f00d1710 2024-09-17T02:56:44.371 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:44.371 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"btime":"2024-09-17T02:56:42:271452+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/258221702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":258221702},{"type":"v1","addr":"172.21.15.192:6836","nonce":258221702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4219924766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4219924766},{"type":"v1","addr":"172.21.15.192:6837","nonce":4219924766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2744372735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2744372735},{"type":"v1","addr":"172.21.15.104:6833","nonce":2744372735}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:56:39.608242+0000","modified":"2024-09-17T02:56:41.622912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1457390445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1457390445},{"type":"v1","addr":"172.21.15.104:6835","nonce":1457390445}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5649,"qdb_cluster":[5649]},"id":4}]} 2024-09-17T02:56:44.371 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 27 2024-09-17T02:56:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc7dc078bc0 msgr2=0x7fc7dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc7dc078bc0 0x7fc7dc07b0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0033000 tx=0x7fc7e0004730 comp rx=0 tx=0).stop 2024-09-17T02:56:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00d1710 msgr2=0x7fc7f015cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00d1710 0x7fc7f015cb20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b970 tx=0x7fc7e800be30 comp rx=0 tx=0).stop 2024-09-17T02:56:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 shutdown_connections 2024-09-17T02:56:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc7dc078bc0 0x7fc7dc07b0d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7f00b6f70 0x7fc7f015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7f00d1710 0x7fc7f015cb20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 --2- 172.21.15.104:0/2299148726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7f00b3b00 0x7fc7f00b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 >> 172.21.15.104:0/2299148726 conn(0x7fc7f0073df0 msgr2=0x7fc7f00b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 shutdown_connections 2024-09-17T02:56:44.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.374+0000 7fc7f5840640 1 -- 172.21.15.104:0/2299148726 wait complete. 2024-09-17T02:56:44.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T02:56:39.608242+0000', 'modified': '2024-09-17T02:56:41.622912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5649}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5649': {'gid': 5649, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/1457390445', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6834', 'nonce': 1457390445}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 1457390445}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5649, 'qdb_cluster': [5649]} 2024-09-17T02:56:44.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T02:56:44.788 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T02:56:44.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.906+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/2512756956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 msgr2=0x7fb79c0b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.906+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/2512756956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 0x7fb79c0b69f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb798005fd0 tx=0x7fb79802a4a0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.906+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/2512756956 shutdown_connections 2024-09-17T02:56:44.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.906+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/2512756956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c15f1f0 0x7fb79c15f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.906+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/2512756956 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 0x7fb79c0b69f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.906+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/2512756956 >> 172.21.15.104:0/2512756956 conn(0x7fb79c069120 msgr2=0x7fb79c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.906+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/2512756956 shutdown_connections 2024-09-17T02:56:44.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.906+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/2512756956 wait complete. 2024-09-17T02:56:44.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.908+0000 7fb7a3ea9640 1 Processor -- start 2024-09-17T02:56:44.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.908+0000 7fb7a3ea9640 1 -- start start 2024-09-17T02:56:44.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a3ea9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 0x7fb79c0d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a3ea9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15f1f0 0x7fb79c0d5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a3ea9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c15fb40 0x7fb79c1f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a3ea9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c163490 con 0x7fb79c0b65e0 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a3ea9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1625a0 con 0x7fb79c15f1f0 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a3ea9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb79c163610 con 0x7fb79c15fb40 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 0x7fb79c0d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 0x7fb79c0d4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39384/0 (socket says 172.21.15.104:39384) 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1c45640 1 -- 172.21.15.104:0/52682911 learned_addr learned my addr 172.21.15.104:0/52682911 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1444640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15f1f0 0x7fb79c0d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a2446640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c15fb40 0x7fb79c1f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1c45640 1 -- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c15fb40 msgr2=0x7fb79c1f9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c15fb40 0x7fb79c1f9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1c45640 1 -- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15f1f0 msgr2=0x7fb79c0d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15f1f0 0x7fb79c0d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a1c45640 1 -- 172.21.15.104:0/52682911 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79c0cc160 con 0x7fb79c0b65e0 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.909+0000 7fb7a2446640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c15fb40 0x7fb79c1f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.910+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 0x7fb79c0d4ac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb798034040 tx=0x7fb798003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.910+0000 7fb7927fc640 1 -- 172.21.15.104:0/52682911 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79803e030 con 0x7fb79c0b65e0 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.910+0000 7fb7927fc640 1 -- 172.21.15.104:0/52682911 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7980047a0 con 0x7fb79c0b65e0 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.910+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/52682911 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79c0cc440 con 0x7fb79c0b65e0 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.910+0000 7fb7927fc640 1 -- 172.21.15.104:0/52682911 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798035040 con 0x7fb79c0b65e0 2024-09-17T02:56:44.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.910+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/52682911 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79c0cca00 con 0x7fb79c0b65e0 2024-09-17T02:56:44.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.912+0000 7fb7927fc640 1 -- 172.21.15.104:0/52682911 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb798041030 con 0x7fb79c0b65e0 2024-09-17T02:56:44.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.912+0000 7fb7927fc640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb780078b90 0x7fb78007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.912+0000 7fb7927fc640 1 -- 172.21.15.104:0/52682911 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fb7980bb510 con 0x7fb79c0b65e0 2024-09-17T02:56:44.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.913+0000 7fb7a1444640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb780078b90 0x7fb78007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.913+0000 7fb7a1444640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb780078b90 0x7fb78007b0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb79c156fe0 tx=0x7fb78c00a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:44.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.913+0000 7fb7aae1c740 1 Processor -- start 2024-09-17T02:56:44.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.913+0000 7fb7aae1c740 1 -- start start 2024-09-17T02:56:44.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80966fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce8056c3b0 0x55ce809674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce809843e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ce808af820 con 0x55ce80595270 2024-09-17T02:56:44.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ce8089ec50 con 0x55ce80574590 2024-09-17T02:56:44.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55ce808a2a60 con 0x55ce8056c3b0 2024-09-17T02:56:44.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80966fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80966fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39398/0 (socket says 172.21.15.104:39398) 2024-09-17T02:56:44.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 -- 172.21.15.104:0/2152871397 learned_addr learned my addr 172.21.15.104:0/2152871397 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:44.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a2446640 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce809843e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1444640 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce8056c3b0 0x55ce809674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 -- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce8056c3b0 msgr2=0x55ce809674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:44.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce8056c3b0 0x55ce809674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 -- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 msgr2=0x55ce809843e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:44.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce809843e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 -- 172.21.15.104:0/2152871397 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce80600850 con 0x55ce80595270 2024-09-17T02:56:44.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a2446640 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce809843e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:44.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80966fa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb7980832a0 tx=0x7fb798082d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dba580c92ec8b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:44.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb77f7fe640 1 -- 172.21.15.104:0/2152871397 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798048070 con 0x55ce80595270 2024-09-17T02:56:44.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb77f7fe640 1 -- 172.21.15.104:0/2152871397 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb798082e20 con 0x55ce80595270 2024-09-17T02:56:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.915+0000 7fb77f7fe640 1 -- 172.21.15.104:0/2152871397 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7980b9e60 con 0x55ce80595270 2024-09-17T02:56:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2152871397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 msgr2=0x55ce80966fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80966fa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb7980832a0 tx=0x7fb798082d20 comp rx=0 tx=0).stop 2024-09-17T02:56:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2152871397 shutdown_connections 2024-09-17T02:56:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce809843e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce8056c3b0 0x55ce809674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2152871397 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80966fa0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2152871397 >> 172.21.15.104:0/2152871397 conn(0x55ce805893c0 msgr2=0x55ce8093d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2152871397 shutdown_connections 2024-09-17T02:56:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.916+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2152871397 wait complete. 2024-09-17T02:56:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.917+0000 7fb7aae1c740 1 -- start start 2024-09-17T02:56:44.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.917+0000 7fb7aae1c740 1 Processor -- start 2024-09-17T02:56:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce80978b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 0x55ce8097b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80984a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ce8060f620 con 0x55ce80595270 2024-09-17T02:56:44.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ce808445f0 con 0x55ce8056c3b0 2024-09-17T02:56:44.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55ce8097aba0 con 0x55ce80574590 2024-09-17T02:56:44.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7aae1c740 10 client.0 _ll_register_callbacks cb 0x55ce808480a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:56:44.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80984a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80984a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39400/0 (socket says 172.21.15.104:39400) 2024-09-17T02:56:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 -- 172.21.15.104:0/2760416371 learned_addr learned my addr 172.21.15.104:0/2760416371 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce80978b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a1444640 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 0x55ce8097b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 -- 172.21.15.104:0/2760416371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 msgr2=0x55ce8097b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 0x55ce8097b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 -- 172.21.15.104:0/2760416371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 msgr2=0x55ce80978b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:44.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce80978b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 -- 172.21.15.104:0/2760416371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce806776b0 con 0x55ce80595270 2024-09-17T02:56:44.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb7a2446640 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80984a00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb79400cd00 tx=0x7fb79400a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b423492a20e4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:44.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb77cff9640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:56:44.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb77cff9640 1 -- 172.21.15.104:0/2760416371 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794003970 con 0x55ce80595270 2024-09-17T02:56:44.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.919+0000 7fb77cff9640 1 -- 172.21.15.104:0/2760416371 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fb794003b10 con 0x55ce80595270 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2760416371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb798082e20 con 0x55ce80595270 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb77cff9640 1 -- 172.21.15.104:0/2760416371 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb794022050 con 0x55ce80595270 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 10 client.5787 fetch_fsmap learned FSMap version 27 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2760416371 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ce8097a580 con 0x55ce80595270 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb77cff9640 1 -- 172.21.15.104:0/2760416371 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb798082e20 con 0x55ce80595270 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb77cff9640 1 -- 172.21.15.104:0/2760416371 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fb794025020 con 0x55ce80595270 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 10 client.5787 fetch_fsmap finished waiting for FSMap version 27 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 10 client.5787 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 20 client.5787 populate_metadata read hostname 'smithi104' 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] conn(0x55ce80553e40 0x55ce8095fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 4 client.5787 mds_command: new command op to 5649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T02:56:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2760416371 --> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce808b1770 con 0x55ce80553e40 2024-09-17T02:56:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] conn(0x55ce80553e40 0x55ce8095fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb77cff9640 10 client.5787 ms_handle_connect on v2:172.21.15.104:6834/1457390445 2024-09-17T02:56:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.920+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] conn(0x55ce80553e40 0x55ce8095fb30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c450882ff4fb47bc server_cookie=f92a9d90d4f755a in_seq=0 out_seq=0 2024-09-17T02:56:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb77cff9640 1 -- 172.21.15.104:0/2760416371 <== mds.0 v2:172.21.15.104:6834/1457390445 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce808b1770 con 0x55ce80553e40 2024-09-17T02:56:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb77cff9640 10 client.5787 handle_command_reply: tid=0 2024-09-17T02:56:44.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 client.5787 shutdown 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2760416371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 msgr2=0x55ce80984a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80984a00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb79400cd00 tx=0x7fb79400a7b0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2760416371 shutdown_connections 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] conn(0x55ce80553e40 0x55ce8095fb30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce80984a00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 0x55ce8097b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb77cff9640 0 client.5787 ms_handle_reset on v2:172.21.15.104:6834/1457390445 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/2760416371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce80978b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2760416371 >> 172.21.15.104:0/2760416371 conn(0x55ce805893c0 msgr2=0x55ce8093d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2760416371 shutdown_connections 2024-09-17T02:56:44.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.921+0000 7fb7aae1c740 1 -- 172.21.15.104:0/2760416371 wait complete. 2024-09-17T02:56:44.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.922+0000 7fb7aae1c740 20 client.5787 trim_cache size 0 max 16384 2024-09-17T02:56:44.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.940+0000 7fb7aae1c740 1 Processor -- start 2024-09-17T02:56:44.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.940+0000 7fb7aae1c740 1 -- start start 2024-09-17T02:56:44.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce8095eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 0x55ce80977d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce809782c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c201810 con 0x55ce80595270 2024-09-17T02:56:44.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c200b70 con 0x55ce8056c3b0 2024-09-17T02:56:44.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb79c2011c0 con 0x55ce80574590 2024-09-17T02:56:44.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7a2446640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce809782c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7a2446640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce809782c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39408/0 (socket says 172.21.15.104:39408) 2024-09-17T02:56:44.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7a2446640 1 -- 172.21.15.104:0/1768291445 learned_addr learned my addr 172.21.15.104:0/1768291445 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:44.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.941+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce8095eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb7a1444640 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 0x55ce80977d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb7a2446640 1 -- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 msgr2=0x55ce80977d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:44.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb7a2446640 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 0x55ce80977d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb7a2446640 1 -- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 msgr2=0x55ce8095eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:44.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb7a2446640 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce8095eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb7a2446640 1 -- 172.21.15.104:0/1768291445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce80964710 con 0x55ce80595270 2024-09-17T02:56:44.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce8095eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:44.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb7a2446640 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce809782c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb79400cc50 tx=0x7fb79400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b509abf347cc15c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:44.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb77effd640 1 -- 172.21.15.104:0/1768291445 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79400acb0 con 0x55ce80595270 2024-09-17T02:56:44.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb77effd640 1 -- 172.21.15.104:0/1768291445 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb794003d60 con 0x55ce80595270 2024-09-17T02:56:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.942+0000 7fb77effd640 1 -- 172.21.15.104:0/1768291445 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794003970 con 0x55ce80595270 2024-09-17T02:56:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 -- 172.21.15.104:0/1768291445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 msgr2=0x55ce809782c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce809782c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb79400cc50 tx=0x7fb79400cc80 comp rx=0 tx=0).stop 2024-09-17T02:56:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 -- 172.21.15.104:0/1768291445 shutdown_connections 2024-09-17T02:56:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce80595270 0x55ce809782c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80574590 0x55ce80977d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/1768291445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce8056c3b0 0x55ce8095eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 -- 172.21.15.104:0/1768291445 >> 172.21.15.104:0/1768291445 conn(0x55ce805893c0 msgr2=0x55ce80957060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 -- 172.21.15.104:0/1768291445 shutdown_connections 2024-09-17T02:56:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.943+0000 7fb7aae1c740 1 -- 172.21.15.104:0/1768291445 wait complete. 2024-09-17T02:56:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.944+0000 7fb7aae1c740 1 -- start start 2024-09-17T02:56:44.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.944+0000 7fb7aae1c740 1 Processor -- start 2024-09-17T02:56:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce8056c3b0 0x55ce809fe010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce8097ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7aae1c740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80595270 0x55ce8097b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55ce80984f40 con 0x55ce8056c3b0 2024-09-17T02:56:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ce8097b690 con 0x55ce80574590 2024-09-17T02:56:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7aae1c740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55ce80954fc0 con 0x55ce80595270 2024-09-17T02:56:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7aae1c740 10 client.0 _ll_register_callbacks cb 0x7fb794009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:56:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7a1c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce8056c3b0 0x55ce809fe010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7a1c45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce8056c3b0 0x55ce809fe010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39420/0 (socket says 172.21.15.104:39420) 2024-09-17T02:56:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7a1c45640 1 -- 172.21.15.104:0/3125600972 learned_addr learned my addr 172.21.15.104:0/3125600972 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7a1444640 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce8097ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.945+0000 7fb7a2446640 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80595270 0x55ce8097b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7a1c45640 1 -- 172.21.15.104:0/3125600972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80595270 msgr2=0x55ce8097b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80595270 0x55ce8097b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7a1c45640 1 -- 172.21.15.104:0/3125600972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 msgr2=0x55ce8097ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:56:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce8097ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7a1c45640 1 -- 172.21.15.104:0/3125600972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce80981dd0 con 0x55ce8056c3b0 2024-09-17T02:56:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7a1c45640 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce8056c3b0 0x55ce809fe010 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb7980832a0 tx=0x7fb79808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b21ac8393048c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:44.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb77cff9640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:56:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb77cff9640 1 -- 172.21.15.104:0/3125600972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798048040 con 0x55ce8056c3b0 2024-09-17T02:56:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb77cff9640 1 -- 172.21.15.104:0/3125600972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fb79808c760 con 0x55ce8056c3b0 2024-09-17T02:56:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 1 -- 172.21.15.104:0/3125600972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb794003d60 con 0x55ce8056c3b0 2024-09-17T02:56:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb77cff9640 1 -- 172.21.15.104:0/3125600972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb7980a3050 con 0x55ce8056c3b0 2024-09-17T02:56:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 10 client.5793 fetch_fsmap learned FSMap version 27 2024-09-17T02:56:44.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 1 -- 172.21.15.104:0/3125600972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55ce809a4d60 con 0x55ce8056c3b0 2024-09-17T02:56:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb77cff9640 1 -- 172.21.15.104:0/3125600972 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb794003d60 con 0x55ce8056c3b0 2024-09-17T02:56:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb77cff9640 1 -- 172.21.15.104:0/3125600972 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 27) ==== 3502+0+0 (secure 0 0 0) 0x7fb7980bb0b0 con 0x55ce8056c3b0 2024-09-17T02:56:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 10 client.5793 fetch_fsmap finished waiting for FSMap version 27 2024-09-17T02:56:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 10 client.5793 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T02:56:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 20 client.5793 populate_metadata read hostname 'smithi104' 2024-09-17T02:56:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] conn(0x55ce80a00fe0 0x55ce80a041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 4 client.5793 mds_command: new command op to 5649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T02:56:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7aae1c740 1 -- 172.21.15.104:0/3125600972 --> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] -- command(tid 0: {"prefix": "status"}) -- 0x55ce809617e0 con 0x55ce80a00fe0 2024-09-17T02:56:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.946+0000 7fb7a1444640 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] conn(0x55ce80a00fe0 0x55ce80a041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb77cff9640 10 client.5793 ms_handle_connect on v2:172.21.15.104:6834/1457390445 2024-09-17T02:56:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7a1444640 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] conn(0x55ce80a00fe0 0x55ce80a041a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d898d73fd257672a server_cookie=50d231a46c2ae08d in_seq=0 out_seq=0 2024-09-17T02:56:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb77cff9640 1 -- 172.21.15.104:0/3125600972 <== mds.0 v2:172.21.15.104:6834/1457390445 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ce809617e0 con 0x55ce80a00fe0 2024-09-17T02:56:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb77cff9640 10 client.5793 handle_command_reply: tid=0 2024-09-17T02:56:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 client.5793 shutdown 2024-09-17T02:56:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 -- 172.21.15.104:0/3125600972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce8056c3b0 msgr2=0x55ce809fe010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce8056c3b0 0x55ce809fe010 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb7980832a0 tx=0x7fb79808a040 comp rx=0 tx=0).stop 2024-09-17T02:56:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 -- 172.21.15.104:0/3125600972 shutdown_connections 2024-09-17T02:56:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.104:6834/1457390445,v1:172.21.15.104:6835/1457390445] conn(0x55ce80a00fe0 0x55ce80a041a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ce80574590 0x55ce8097ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55ce80595270 0x55ce8097b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 --2- 172.21.15.104:0/3125600972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55ce8056c3b0 0x55ce809fe010 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb77cff9640 0 client.5793 ms_handle_reset on v2:172.21.15.104:6834/1457390445 2024-09-17T02:56:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 -- 172.21.15.104:0/3125600972 >> 172.21.15.104:0/3125600972 conn(0x55ce805893c0 msgr2=0x55ce80957060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 -- 172.21.15.104:0/3125600972 shutdown_connections 2024-09-17T02:56:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 1 -- 172.21.15.104:0/3125600972 wait complete. 2024-09-17T02:56:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.947+0000 7fb7aae1c740 20 client.5793 trim_cache size 0 max 16384 2024-09-17T02:56:44.964 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:56:44.964 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:56:44.964 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T02:56:44.964 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5649, 2024-09-17T02:56:44.964 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T02:56:44.964 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T02:56:44.965 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T02:56:44.965 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 4.6858423570000003, 2024-09-17T02:56:44.965 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 27, 2024-09-17T02:56:44.965 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 66, 2024-09-17T02:56:44.965 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 66, 2024-09-17T02:56:44.965 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 9.2316664310000007 2024-09-17T02:56:44.965 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:56:44.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb780078b90 msgr2=0x7fb78007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb780078b90 0x7fb78007b0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb79c156fe0 tx=0x7fb78c00a250 comp rx=0 tx=0).stop 2024-09-17T02:56:44.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/52682911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 msgr2=0x7fb79c0d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:44.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 0x7fb79c0d4ac0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb798034040 tx=0x7fb798003970 comp rx=0 tx=0).stop 2024-09-17T02:56:44.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/52682911 shutdown_connections 2024-09-17T02:56:44.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb780078b90 0x7fb78007b0a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15f1f0 0x7fb79c0d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c15fb40 0x7fb79c1f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 --2- 172.21.15.104:0/52682911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb79c0b65e0 0x7fb79c0d4ac0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:44.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/52682911 >> 172.21.15.104:0/52682911 conn(0x7fb79c069120 msgr2=0x7fb79c161310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:44.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/52682911 shutdown_connections 2024-09-17T02:56:44.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:44.948+0000 7fb7a3ea9640 1 -- 172.21.15.104:0/52682911 wait complete. 2024-09-17T02:56:44.969 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:56:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.083+0000 7f5fcec8b640 1 -- 172.21.15.104:0/580857810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80b7bb0 msgr2=0x7f5fc80cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.083+0000 7f5fcec8b640 1 --2- 172.21.15.104:0/580857810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80b7bb0 0x7f5fc80cde90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80098e0 tx=0x7f5fb802a4a0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.083+0000 7f5fcec8b640 1 -- 172.21.15.104:0/580857810 shutdown_connections 2024-09-17T02:56:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.083+0000 7f5fcec8b640 1 --2- 172.21.15.104:0/580857810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80b7bb0 0x7f5fc80cde90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.083+0000 7f5fcec8b640 1 -- 172.21.15.104:0/580857810 >> 172.21.15.104:0/580857810 conn(0x7f5fc80d28a0 msgr2=0x7f5fc80d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.083+0000 7f5fcec8b640 1 -- 172.21.15.104:0/580857810 shutdown_connections 2024-09-17T02:56:45.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.083+0000 7f5fcec8b640 1 -- 172.21.15.104:0/580857810 wait complete. 2024-09-17T02:56:45.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.084+0000 7f5fcec8b640 1 Processor -- start 2024-09-17T02:56:45.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.085+0000 7f5fcec8b640 1 -- start start 2024-09-17T02:56:45.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcec8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc80b7bb0 0x7f5fc8161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:45.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcec8b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc80cefb0 0x7f5fc80caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:45.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcec8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80d0470 0x7f5fc81f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcec8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc80cfc50 con 0x7f5fc80d0470 2024-09-17T02:56:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcec8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc80cfad0 con 0x7f5fc80b7bb0 2024-09-17T02:56:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcec8b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc80cfdd0 con 0x7f5fc80cefb0 2024-09-17T02:56:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcd228640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80d0470 0x7f5fc81f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcd228640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80d0470 0x7f5fc81f8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39436/0 (socket says 172.21.15.104:39436) 2024-09-17T02:56:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcd228640 1 -- 172.21.15.104:0/2450105894 learned_addr learned my addr 172.21.15.104:0/2450105894 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:45.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcca27640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc80b7bb0 0x7f5fc8161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:45.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcd228640 1 -- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc80cefb0 msgr2=0x7f5fc80caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:45.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fc7fff640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc80cefb0 0x7f5fc80caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:45.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcd228640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc80cefb0 0x7f5fc80caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcd228640 1 -- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc80b7bb0 msgr2=0x7f5fc8161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:45.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcd228640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc80b7bb0 0x7f5fc8161820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.086+0000 7f5fcd228640 1 -- 172.21.15.104:0/2450105894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc8161d60 con 0x7f5fc80d0470 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.087+0000 7f5fcca27640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc80b7bb0 0x7f5fc8161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.087+0000 7f5fc7fff640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc80cefb0 0x7f5fc80caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.087+0000 7f5fcd228640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80d0470 0x7f5fc81f8d40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000b9e0 tx=0x7f5fc000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.087+0000 7f5fc57fa640 1 -- 172.21.15.104:0/2450105894 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0003b70 con 0x7f5fc80d0470 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.087+0000 7f5fc57fa640 1 -- 172.21.15.104:0/2450105894 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fc0003e00 con 0x7f5fc80d0470 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.087+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc806d870 con 0x7f5fc80d0470 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.087+0000 7f5fc57fa640 1 -- 172.21.15.104:0/2450105894 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc000cb80 con 0x7f5fc80d0470 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.087+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc81f9ac0 con 0x7f5fc80d0470 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.088+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc806ef00 con 0x7f5fc80d0470 2024-09-17T02:56:45.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.089+0000 7f5fc57fa640 1 -- 172.21.15.104:0/2450105894 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fc0004000 con 0x7f5fc80d0470 2024-09-17T02:56:45.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.089+0000 7f5fc57fa640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fb4078bc0 0x7f5fb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:45.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.089+0000 7f5fc57fa640 1 -- 172.21.15.104:0/2450105894 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f5fc009ab00 con 0x7f5fc80d0470 2024-09-17T02:56:45.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.090+0000 7f5fcca27640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fb4078bc0 0x7f5fb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:45.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.090+0000 7f5fcca27640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fb4078bc0 0x7f5fb407b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8034000 tx=0x7f5fb8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:45.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.094+0000 7f5fc57fa640 1 -- 172.21.15.104:0/2450105894 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5fc0063060 con 0x7f5fc80d0470 2024-09-17T02:56:45.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.303+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5fc815c9d0 con 0x7f5fc80d0470 2024-09-17T02:56:45.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.304+0000 7f5fc57fa640 1 -- 172.21.15.104:0/2450105894 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f5fc0062960 con 0x7f5fc80d0470 2024-09-17T02:56:45.302 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fb4078bc0 msgr2=0x7f5fb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fb4078bc0 0x7f5fb407b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8034000 tx=0x7f5fb8004730 comp rx=0 tx=0).stop 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80d0470 msgr2=0x7f5fc81f8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80d0470 0x7f5fc81f8d40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000b9e0 tx=0x7f5fc000bea0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 shutdown_connections 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5fb4078bc0 0x7f5fb407b0d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5fc80d0470 0x7f5fc81f8d40 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc80cefb0 0x7f5fc80caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 --2- 172.21.15.104:0/2450105894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc80b7bb0 0x7f5fc8161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 >> 172.21.15.104:0/2450105894 conn(0x7f5fc80d28a0 msgr2=0x7f5fc8163a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 shutdown_connections 2024-09-17T02:56:45.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45.306+0000 7f5fcec8b640 1 -- 172.21.15.104:0/2450105894 wait complete. 2024-09-17T02:56:45.315 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:56:45.316 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:56:45.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T02:56:45.316 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T02:56:45.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:45.316 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:56:45.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:56:45.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:56:45.316 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:56:45.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:45.317 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T02:56:45.332 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:56:45.332 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:45.333 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42694sec preferred_lft 42694sec 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:56:45.334 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T02:56:45.335 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T02:56:45.335 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:45.335 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:56:45.335 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T02:56:45.335 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T02:56:45.335 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:45.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:45.335 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:56:45.396 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T02:56:45.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:45.397 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T02:56:45.453 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T02:56:45.453 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:56:45.454 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:56:45.454 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:56:45.454 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:56:45.454 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:56:45.454 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:56:45.454 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:56:45.454 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:56:45.455 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:56:45.455 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:56:45.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:56:45.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:56:45.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:45.579 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:56:45.594 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T02:56:45.594 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T02:56:45.594 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:56:45.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:45.595 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T02:56:45.659 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:56:45.659 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:45.715 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:56:45.715 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:56:45.715 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:45.770 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:56:45.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:45.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:56:45.864 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:56:45.865 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:56:45.865 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:56:45.876 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:56:45.876 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:56:45.876 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:56:45.876 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:56:45.876 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:56:45.882 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:56:45.882 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:56:45.882 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:56:45.882 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:56:45.882 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:56:45.882 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:56:45.882 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:56:45.882 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:56:45.883 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T02:56:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:56:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:56:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:56:45.883 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:56:45.884 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:56:45.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:45.884 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:56:45.915 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:56:46.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:56:46.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:56:46.016 INFO:teuthology.orchestra.run.smithi104.stdout:client5183 2024-09-17T02:56:46.016 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:56:46.017 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:46.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:56:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.185+0000 7f16ccbf1640 1 -- 172.21.15.104:0/3799901473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c8152ce0 msgr2=0x7f16c806f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.185+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/3799901473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c8152ce0 0x7f16c806f540 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f16c815d1d0 tx=0x7f16b802a4d0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.185+0000 7f16ccbf1640 1 -- 172.21.15.104:0/3799901473 shutdown_connections 2024-09-17T02:56:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.185+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/3799901473 >> v2:172.21.15.192:3300/0 conn(0x7f16c8073c90 0x7f16c80b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.185+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/3799901473 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c8152ce0 0x7f16c806f540 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.185+0000 7f16ccbf1640 1 -- 172.21.15.104:0/3799901473 >> 172.21.15.104:0/3799901473 conn(0x7f16c80b3640 msgr2=0x7f16c80b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:46.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.185+0000 7f16ccbf1640 1 -- 172.21.15.104:0/3799901473 shutdown_connections 2024-09-17T02:56:46.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.185+0000 7f16ccbf1640 1 -- 172.21.15.104:0/3799901473 wait complete. 2024-09-17T02:56:46.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.187+0000 7f16ccbf1640 1 Processor -- start 2024-09-17T02:56:46.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.187+0000 7f16ccbf1640 1 -- start start 2024-09-17T02:56:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16ccbf1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16c806fa80 0x7f16c80cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16ccbf1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c8152ce0 0x7f16c815d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:46.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16ccbf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c80c68b0 0x7f16c815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16ccbf1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f16c80b5860 con 0x7f16c80c68b0 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16ccbf1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16c80b56e0 con 0x7f16c8152ce0 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16ccbf1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f16c80b59e0 con 0x7f16c806fa80 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16c6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c80c68b0 0x7f16c815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16c6d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c80c68b0 0x7f16c815ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39454/0 (socket says 172.21.15.104:39454) 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.188+0000 7f16c6d9d640 1 -- 172.21.15.104:0/1082090843 learned_addr learned my addr 172.21.15.104:0/1082090843 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c659c640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16c806fa80 0x7f16c80cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c5d9b640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c8152ce0 0x7f16c815d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c6d9d640 1 -- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16c806fa80 msgr2=0x7f16c80cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c6d9d640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16c806fa80 0x7f16c80cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c6d9d640 1 -- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c8152ce0 msgr2=0x7f16c815d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c6d9d640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c8152ce0 0x7f16c815d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c6d9d640 1 -- 172.21.15.104:0/1082090843 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c81f3840 con 0x7f16c80c68b0 2024-09-17T02:56:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c5d9b640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c8152ce0 0x7f16c815d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:56:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16c6d9d640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c80c68b0 0x7f16c815ded0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f16c000cad0 tx=0x7f16c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16b6ffd640 1 -- 172.21.15.104:0/1082090843 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c000ae20 con 0x7f16c80c68b0 2024-09-17T02:56:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c81f3b20 con 0x7f16c80c68b0 2024-09-17T02:56:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16b6ffd640 1 -- 172.21.15.104:0/1082090843 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16c000f450 con 0x7f16c80c68b0 2024-09-17T02:56:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16b6ffd640 1 -- 172.21.15.104:0/1082090843 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c000f8c0 con 0x7f16c80c68b0 2024-09-17T02:56:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.189+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c81f40e0 con 0x7f16c80c68b0 2024-09-17T02:56:46.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.190+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c814ea10 con 0x7f16c80c68b0 2024-09-17T02:56:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.191+0000 7f16b6ffd640 1 -- 172.21.15.104:0/1082090843 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16c000fa60 con 0x7f16c80c68b0 2024-09-17T02:56:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.191+0000 7f16b6ffd640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16a8078bc0 0x7f16a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.191+0000 7f16b6ffd640 1 -- 172.21.15.104:0/1082090843 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f16c009b7e0 con 0x7f16c80c68b0 2024-09-17T02:56:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.191+0000 7f16c659c640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16a8078bc0 0x7f16a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:46.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.192+0000 7f16c659c640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16a8078bc0 0x7f16a807b0d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f16b8033000 tx=0x7f16b8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:46.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.196+0000 7f16b6ffd640 1 -- 172.21.15.104:0/1082090843 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16c0014030 con 0x7f16c80c68b0 2024-09-17T02:56:46.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.405+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f16c80d12d0 con 0x7f16c80c68b0 2024-09-17T02:56:46.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.406+0000 7f16b6ffd640 1 -- 172.21.15.104:0/1082090843 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f16c0063c30 con 0x7f16c80c68b0 2024-09-17T02:56:46.405 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16a8078bc0 msgr2=0x7f16a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16a8078bc0 0x7f16a807b0d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f16b8033000 tx=0x7f16b8004730 comp rx=0 tx=0).stop 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c80c68b0 msgr2=0x7f16c815ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c80c68b0 0x7f16c815ded0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f16c000cad0 tx=0x7f16c000cf90 comp rx=0 tx=0).stop 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 shutdown_connections 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16a8078bc0 0x7f16a807b0d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c8152ce0 0x7f16c815d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16c80c68b0 0x7f16c815ded0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 --2- 172.21.15.104:0/1082090843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16c806fa80 0x7f16c80cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 >> 172.21.15.104:0/1082090843 conn(0x7f16c80b3640 msgr2=0x7f16c815d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 shutdown_connections 2024-09-17T02:56:46.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:46.408+0000 7f16ccbf1640 1 -- 172.21.15.104:0/1082090843 wait complete. 2024-09-17T02:56:46.417 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:56:46.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:56:46.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T02:56:46.418 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T02:56:46.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:46.418 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:56:46.418 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:56:46.418 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:56:46.418 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:56:46.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:46.418 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T02:56:46.438 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:56:46.438 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:56:46.438 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:56:46.438 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:46.438 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:56:46.438 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:46.438 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:46.438 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42688sec preferred_lft 42688sec 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:46.439 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T02:56:46.440 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:56:46.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:46.441 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:56:46.506 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T02:56:46.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:46.508 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T02:56:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T02:56:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:56:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:56:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:56:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:56:46.568 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:56:46.568 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:56:46.569 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:56:46.569 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:56:46.569 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:56:46.569 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:56:46.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:56:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:56:46.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:56:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:56:46.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:46.704 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:56:46.720 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T02:56:46.720 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T02:56:46.720 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:56:46.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:46.721 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T02:56:46.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:56:46.787 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:46.842 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:56:46.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:56:46.843 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:46.898 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:56:46.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:46.898 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:56:46.992 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:56:46.992 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:56:46.992 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:56:47.003 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:56:47.003 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:56:47.003 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:56:47.003 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:56:47.003 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:56:47.008 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:56:47.008 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:56:47.008 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:56:47.009 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:56:47.009 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:56:47.009 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:56:47.009 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:56:47.009 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:56:47.009 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T02:56:47.009 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:56:47.010 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:56:47.010 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:56:47.010 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:56:47.011 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:56:47.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:56:47.011 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:56:47.035 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:56:47.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:56:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:56:47.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:56:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:56:47.131 INFO:teuthology.orchestra.run.smithi192.stdout:client5189 2024-09-17T02:56:47.132 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:56:47.132 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:56:47.148 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:56:47.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.270+0000 7f7897eec640 1 -- 172.21.15.104:0/3286429817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 msgr2=0x7f789006f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:47.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.270+0000 7f7897eec640 1 --2- 172.21.15.104:0/3286429817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 0x7f789006f550 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f78900d21a0 tx=0x7f788c02a5f0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.270+0000 7f7897eec640 1 -- 172.21.15.104:0/3286429817 shutdown_connections 2024-09-17T02:56:47.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.270+0000 7f7897eec640 1 --2- 172.21.15.104:0/3286429817 >> v2:172.21.15.192:3300/0 conn(0x7f78900b0500 0x7f78900b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.270+0000 7f7897eec640 1 --2- 172.21.15.104:0/3286429817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 0x7f789006f550 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.270+0000 7f7897eec640 1 -- 172.21.15.104:0/3286429817 >> 172.21.15.104:0/3286429817 conn(0x7f789006d200 msgr2=0x7f789006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:47.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.270+0000 7f7897eec640 1 -- 172.21.15.104:0/3286429817 shutdown_connections 2024-09-17T02:56:47.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.270+0000 7f7897eec640 1 -- 172.21.15.104:0/3286429817 wait complete. 2024-09-17T02:56:47.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.272+0000 7f7897eec640 1 Processor -- start 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.272+0000 7f7897eec640 1 -- start start 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7897eec640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78900734f0 0x7f789015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7897eec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78900b0500 0x7f78901469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7897eec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 0x7f789015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7897eec640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f78900b4f20 con 0x7f789015c220 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7897eec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78900b1200 con 0x7f78900b0500 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7897eec640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f78900b50a0 con 0x7f78900734f0 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7896489640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 0x7f789015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7896489640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 0x7f789015e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39470/0 (socket says 172.21.15.104:39470) 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7896489640 1 -- 172.21.15.104:0/359004675 learned_addr learned my addr 172.21.15.104:0/359004675 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7895c88640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78900734f0 0x7f789015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:47.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7895487640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78900b0500 0x7f78901469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7896489640 1 -- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78900734f0 msgr2=0x7f789015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.273+0000 7f7896489640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78900734f0 0x7f789015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f7896489640 1 -- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78900b0500 msgr2=0x7f78901469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f7896489640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78900b0500 0x7f78901469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f7896489640 1 -- 172.21.15.104:0/359004675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789015dcb0 con 0x7f789015c220 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f7896489640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 0x7f789015e4e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f788800e960 tx=0x7f788800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f78867fc640 1 -- 172.21.15.104:0/359004675 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888004d20 con 0x7f789015c220 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f78867fc640 1 -- 172.21.15.104:0/359004675 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f788800cac0 con 0x7f789015c220 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f78867fc640 1 -- 172.21.15.104:0/359004675 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888005020 con 0x7f789015c220 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789015d6f0 con 0x7f789015c220 2024-09-17T02:56:47.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.274+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78901567b0 con 0x7f789015c220 2024-09-17T02:56:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.275+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78900b0910 con 0x7f789015c220 2024-09-17T02:56:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.276+0000 7f78867fc640 1 -- 172.21.15.104:0/359004675 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78880051c0 con 0x7f789015c220 2024-09-17T02:56:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.276+0000 7f78867fc640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7874078b90 0x7f787407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:56:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.276+0000 7f78867fc640 1 -- 172.21.15.104:0/359004675 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f788809b4f0 con 0x7f789015c220 2024-09-17T02:56:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.276+0000 7f7895c88640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7874078b90 0x7f787407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:56:47.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.277+0000 7f7895c88640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7874078b90 0x7f787407b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f788c033000 tx=0x7f788c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:56:47.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.280+0000 7f78867fc640 1 -- 172.21.15.104:0/359004675 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7888016030 con 0x7f789015c220 2024-09-17T02:56:47.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.488+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78900d23c0 con 0x7f789015c220 2024-09-17T02:56:47.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.489+0000 7f78867fc640 1 -- 172.21.15.104:0/359004675 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7f7888063a50 con 0x7f789015c220 2024-09-17T02:56:47.488 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:56:47.488 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"btime":"2024-09-17T02:56:42:271452+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/258221702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":258221702},{"type":"v1","addr":"172.21.15.192:6836","nonce":258221702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4219924766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4219924766},{"type":"v1","addr":"172.21.15.192:6837","nonce":4219924766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2744372735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2744372735},{"type":"v1","addr":"172.21.15.104:6833","nonce":2744372735}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:56:39.608242+0000","modified":"2024-09-17T02:56:41.622912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1457390445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1457390445},{"type":"v1","addr":"172.21.15.104:6835","nonce":1457390445}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5649,"qdb_cluster":[5649]},"id":4}]} 2024-09-17T02:56:47.488 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 27 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7874078b90 msgr2=0x7f787407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7874078b90 0x7f787407b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f788c033000 tx=0x7f788c004730 comp rx=0 tx=0).stop 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 msgr2=0x7f789015e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 0x7f789015e4e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f788800e960 tx=0x7f788800ee20 comp rx=0 tx=0).stop 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 shutdown_connections 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7874078b90 0x7f787407b0a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78900b0500 0x7f78901469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f789015c220 0x7f789015e4e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 --2- 172.21.15.104:0/359004675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78900734f0 0x7f789015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:56:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 >> 172.21.15.104:0/359004675 conn(0x7f789006d200 msgr2=0x7f7890073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:56:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 shutdown_connections 2024-09-17T02:56:47.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:56:47.491+0000 7f7897eec640 1 -- 172.21.15.104:0/359004675 wait complete. 2024-09-17T02:56:47.501 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T02:56:47.626 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":5649,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":7.3578318249999999,"mdsmap_epoch":27,"osdmap_epoch":66,"osdmap_epoch_barrier":66,"uptime":11.903658571999999} 2024-09-17T02:56:47.627 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 5649, "mdsmap_epoch": 27, "osdmap_epoch": 66, "osdmap_epoch_barrier": 66, "rank_uptime": 7.357831825, "state": "up:active", "uptime": 11.903658572, "want_state": "up:active", "whoami": 0 } 2024-09-17T02:56:47.628 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-17T02:56:47.747 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_mon_report_interval":"5"} 2024-09-17T02:56:47.747 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-17T02:56:47.747 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-17T02:56:47.860 INFO:teuthology.orchestra.run.smithi104.stdout:{"mon_tick_interval":"5"} 2024-09-17T02:56:47.861 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-17T02:56:47.861 INFO:tasks.cephfs.test_full:pool capacity 557082176, 531MB should be enough to fill it 2024-09-17T02:56:47.861 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T02:56:47.861 DEBUG:teuthology.orchestra.run.smithi104:> import time 2024-09-17T02:56:47.861 DEBUG:teuthology.orchestra.run.smithi104:> import datetime 2024-09-17T02:56:47.861 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-09-17T02:56:47.861 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T02:56:47.861 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> # Write some buffered data through before going full, all should be well 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> print("writing some data through which we expect to succeed") 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> bytes = 0 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(f) 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> # buffered IO, the error should always only appear from fsync and not 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> # from write 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> full = False 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.862 DEBUG:teuthology.orchestra.run.smithi104:> for n in range(0, int(531 * 0.9)): 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> print("done writing {0} bytes".format(bytes)) 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> # OK, now we should sneak in under the full condition 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> # due to the time it takes the OSDs to report to the 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> # mons, and get a successful fsync on our full-making data 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(f) 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> # buffered write, add more dirty data to the buffer 2024-09-17T02:56:47.863 DEBUG:teuthology.orchestra.run.smithi104:> print("starting buffered write") 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> try: 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> for n in range(0, int(531 * 0.2)): 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> time.sleep(15.0) 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> except OSError: 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> pass; 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> # Wait long enough for a background flush that should fail 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> time.sleep(30) 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.864 DEBUG:teuthology.orchestra.run.smithi104:> if False: 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> # ...and check that the failed background flush is reflected in fclose 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> try: 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> os.close(f) 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> except OSError: 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> print("close() returned an error as expected") 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> else: 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("close() failed to raise error") 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> else: 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> # The kernel cephfs client does not raise errors on fclose 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> os.close(f) 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-17T02:56:47.865 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T02:56:50.792 INFO:teuthology.orchestra.run.smithi104.stdout:writing some data through which we expect to succeed 2024-09-17T02:56:50.792 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-17T02:56:50.792 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-17T02:56:50.792 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-17T02:56:50.793 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-17T02:56:50.793 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-17T02:56:50.793 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-17T02:56:50.793 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-17T02:56:50.793 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-17T02:56:50.793 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-17T02:56:50.793 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-17T02:56:50.794 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-17T02:56:50.794 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-17T02:56:50.794 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-17T02:56:50.794 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-17T02:56:50.794 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-17T02:56:50.794 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-17T02:56:50.794 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-17T02:56:50.795 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-17T02:56:50.795 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-17T02:56:50.795 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-17T02:56:50.795 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-17T02:56:50.795 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-17T02:56:50.795 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-17T02:56:50.796 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-17T02:56:50.796 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-17T02:56:50.796 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-17T02:56:50.796 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-17T02:56:50.796 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-17T02:56:50.796 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-17T02:56:50.796 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 30932992 bytes via buffered write, may repeat 2024-09-17T02:56:50.797 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 31981568 bytes via buffered write, may repeat 2024-09-17T02:56:50.797 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 33030144 bytes via buffered write, may repeat 2024-09-17T02:56:50.797 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 34078720 bytes via buffered write, may repeat 2024-09-17T02:56:50.797 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 35127296 bytes via buffered write, may repeat 2024-09-17T02:56:50.797 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 36175872 bytes via buffered write, may repeat 2024-09-17T02:56:50.797 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 37224448 bytes via buffered write, may repeat 2024-09-17T02:56:50.798 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 38273024 bytes via buffered write, may repeat 2024-09-17T02:56:50.798 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 39321600 bytes via buffered write, may repeat 2024-09-17T02:56:50.798 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 40370176 bytes via buffered write, may repeat 2024-09-17T02:56:50.798 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 41418752 bytes via buffered write, may repeat 2024-09-17T02:56:50.798 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 42467328 bytes via buffered write, may repeat 2024-09-17T02:56:50.798 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 43515904 bytes via buffered write, may repeat 2024-09-17T02:56:50.798 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 44564480 bytes via buffered write, may repeat 2024-09-17T02:56:50.799 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 45613056 bytes via buffered write, may repeat 2024-09-17T02:56:50.799 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 46661632 bytes via buffered write, may repeat 2024-09-17T02:56:50.799 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 47710208 bytes via buffered write, may repeat 2024-09-17T02:56:50.799 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 48758784 bytes via buffered write, may repeat 2024-09-17T02:56:50.799 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 49807360 bytes via buffered write, may repeat 2024-09-17T02:56:50.799 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 50855936 bytes via buffered write, may repeat 2024-09-17T02:56:50.799 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 51904512 bytes via buffered write, may repeat 2024-09-17T02:56:50.800 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 52953088 bytes via buffered write, may repeat 2024-09-17T02:56:50.800 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 54001664 bytes via buffered write, may repeat 2024-09-17T02:56:50.800 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 55050240 bytes via buffered write, may repeat 2024-09-17T02:56:50.800 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 56098816 bytes via buffered write, may repeat 2024-09-17T02:56:50.800 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 57147392 bytes via buffered write, may repeat 2024-09-17T02:56:50.800 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 58195968 bytes via buffered write, may repeat 2024-09-17T02:56:50.801 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 59244544 bytes via buffered write, may repeat 2024-09-17T02:56:50.801 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 60293120 bytes via buffered write, may repeat 2024-09-17T02:56:50.801 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 61341696 bytes via buffered write, may repeat 2024-09-17T02:56:50.801 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 62390272 bytes via buffered write, may repeat 2024-09-17T02:56:50.801 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 63438848 bytes via buffered write, may repeat 2024-09-17T02:56:50.801 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 64487424 bytes via buffered write, may repeat 2024-09-17T02:56:50.801 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 65536000 bytes via buffered write, may repeat 2024-09-17T02:56:50.802 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 66584576 bytes via buffered write, may repeat 2024-09-17T02:56:50.802 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 67633152 bytes via buffered write, may repeat 2024-09-17T02:56:50.802 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 68681728 bytes via buffered write, may repeat 2024-09-17T02:56:50.802 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 69730304 bytes via buffered write, may repeat 2024-09-17T02:56:50.802 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 70778880 bytes via buffered write, may repeat 2024-09-17T02:56:50.802 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 71827456 bytes via buffered write, may repeat 2024-09-17T02:56:50.802 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 72876032 bytes via buffered write, may repeat 2024-09-17T02:56:50.803 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 73924608 bytes via buffered write, may repeat 2024-09-17T02:56:50.803 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 74973184 bytes via buffered write, may repeat 2024-09-17T02:56:50.803 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 76021760 bytes via buffered write, may repeat 2024-09-17T02:56:50.803 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 77070336 bytes via buffered write, may repeat 2024-09-17T02:56:50.803 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 78118912 bytes via buffered write, may repeat 2024-09-17T02:56:50.803 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 79167488 bytes via buffered write, may repeat 2024-09-17T02:56:50.803 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 80216064 bytes via buffered write, may repeat 2024-09-17T02:56:50.804 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 81264640 bytes via buffered write, may repeat 2024-09-17T02:56:50.804 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 82313216 bytes via buffered write, may repeat 2024-09-17T02:56:50.804 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 83361792 bytes via buffered write, may repeat 2024-09-17T02:56:50.804 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 84410368 bytes via buffered write, may repeat 2024-09-17T02:56:50.804 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 85458944 bytes via buffered write, may repeat 2024-09-17T02:56:50.804 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 86507520 bytes via buffered write, may repeat 2024-09-17T02:56:50.804 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 87556096 bytes via buffered write, may repeat 2024-09-17T02:56:50.805 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 88604672 bytes via buffered write, may repeat 2024-09-17T02:56:50.805 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 89653248 bytes via buffered write, may repeat 2024-09-17T02:56:50.805 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 90701824 bytes via buffered write, may repeat 2024-09-17T02:56:50.805 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 91750400 bytes via buffered write, may repeat 2024-09-17T02:56:50.805 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 92798976 bytes via buffered write, may repeat 2024-09-17T02:56:50.805 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 93847552 bytes via buffered write, may repeat 2024-09-17T02:56:50.805 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 94896128 bytes via buffered write, may repeat 2024-09-17T02:56:50.806 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 95944704 bytes via buffered write, may repeat 2024-09-17T02:56:50.806 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 96993280 bytes via buffered write, may repeat 2024-09-17T02:56:50.806 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 98041856 bytes via buffered write, may repeat 2024-09-17T02:56:50.806 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 99090432 bytes via buffered write, may repeat 2024-09-17T02:56:50.806 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 100139008 bytes via buffered write, may repeat 2024-09-17T02:56:50.806 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 101187584 bytes via buffered write, may repeat 2024-09-17T02:56:50.806 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 102236160 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 103284736 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 104333312 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 105381888 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 106430464 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 107479040 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 108527616 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 109576192 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 110624768 bytes via buffered write, may repeat 2024-09-17T02:56:50.807 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 111673344 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 112721920 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 113770496 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 114819072 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 115867648 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 116916224 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 117964800 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 119013376 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 120061952 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 121110528 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 122159104 bytes via buffered write, may repeat 2024-09-17T02:56:50.808 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 123207680 bytes via buffered write, may repeat 2024-09-17T02:56:50.809 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 124256256 bytes via buffered write, may repeat 2024-09-17T02:56:50.809 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 125304832 bytes via buffered write, may repeat 2024-09-17T02:56:50.809 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 126353408 bytes via buffered write, may repeat 2024-09-17T02:56:50.809 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 127401984 bytes via buffered write, may repeat 2024-09-17T02:56:50.809 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 128450560 bytes via buffered write, may repeat 2024-09-17T02:56:50.810 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 129499136 bytes via buffered write, may repeat 2024-09-17T02:56:50.810 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 130547712 bytes via buffered write, may repeat 2024-09-17T02:56:50.810 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 131596288 bytes via buffered write, may repeat 2024-09-17T02:56:50.810 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 132644864 bytes via buffered write, may repeat 2024-09-17T02:56:50.810 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 133693440 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 134742016 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 135790592 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 136839168 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 137887744 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 138936320 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 139984896 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 141033472 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 142082048 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 143130624 bytes via buffered write, may repeat 2024-09-17T02:56:50.811 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 144179200 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 145227776 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 146276352 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 147324928 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 148373504 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 149422080 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 150470656 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 151519232 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 152567808 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 153616384 bytes via buffered write, may repeat 2024-09-17T02:56:50.812 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 154664960 bytes via buffered write, may repeat 2024-09-17T02:56:50.813 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 155713536 bytes via buffered write, may repeat 2024-09-17T02:56:50.813 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 156762112 bytes via buffered write, may repeat 2024-09-17T02:56:50.813 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 157810688 bytes via buffered write, may repeat 2024-09-17T02:56:50.813 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 158859264 bytes via buffered write, may repeat 2024-09-17T02:56:50.813 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 159907840 bytes via buffered write, may repeat 2024-09-17T02:56:50.813 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 160956416 bytes via buffered write, may repeat 2024-09-17T02:56:50.813 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 162004992 bytes via buffered write, may repeat 2024-09-17T02:56:50.842 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 163053568 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 164102144 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 165150720 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 166199296 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 167247872 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 168296448 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 169345024 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 170393600 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 171442176 bytes via buffered write, may repeat 2024-09-17T02:56:50.843 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 172490752 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 173539328 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 174587904 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 175636480 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 176685056 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 177733632 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 178782208 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 179830784 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 180879360 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 181927936 bytes via buffered write, may repeat 2024-09-17T02:56:50.844 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 182976512 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 184025088 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 185073664 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 186122240 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 187170816 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 188219392 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 189267968 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 190316544 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 191365120 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 192413696 bytes via buffered write, may repeat 2024-09-17T02:56:50.845 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 193462272 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 194510848 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 195559424 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 196608000 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 197656576 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 198705152 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 199753728 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 200802304 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 201850880 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 202899456 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 203948032 bytes via buffered write, may repeat 2024-09-17T02:56:50.846 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 204996608 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 206045184 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 207093760 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 208142336 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 209190912 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 210239488 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 211288064 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 212336640 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 213385216 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 214433792 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 215482368 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 216530944 bytes via buffered write, may repeat 2024-09-17T02:56:50.847 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 217579520 bytes via buffered write, may repeat 2024-09-17T02:56:50.848 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 218628096 bytes via buffered write, may repeat 2024-09-17T02:56:50.848 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 219676672 bytes via buffered write, may repeat 2024-09-17T02:56:50.848 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 220725248 bytes via buffered write, may repeat 2024-09-17T02:56:50.848 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 221773824 bytes via buffered write, may repeat 2024-09-17T02:56:50.848 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 222822400 bytes via buffered write, may repeat 2024-09-17T02:56:50.848 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 223870976 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 224919552 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 225968128 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 227016704 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 228065280 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 229113856 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 230162432 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 231211008 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 232259584 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 233308160 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 234356736 bytes via buffered write, may repeat 2024-09-17T02:56:50.849 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 235405312 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 236453888 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 237502464 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 238551040 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 239599616 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 240648192 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 241696768 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 242745344 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 243793920 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 244842496 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 245891072 bytes via buffered write, may repeat 2024-09-17T02:56:50.850 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 246939648 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 247988224 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 249036800 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 250085376 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 251133952 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 252182528 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 253231104 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 254279680 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 255328256 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 256376832 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 257425408 bytes via buffered write, may repeat 2024-09-17T02:56:50.851 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 258473984 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 259522560 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 260571136 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 261619712 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 262668288 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 263716864 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 264765440 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 265814016 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 266862592 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 267911168 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 268959744 bytes via buffered write, may repeat 2024-09-17T02:56:50.852 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 270008320 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 271056896 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 272105472 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 273154048 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 274202624 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 275251200 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 276299776 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 277348352 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 278396928 bytes via buffered write, may repeat 2024-09-17T02:56:50.853 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 279445504 bytes via buffered write, may repeat 2024-09-17T02:56:50.854 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 280494080 bytes via buffered write, may repeat 2024-09-17T02:56:50.854 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 281542656 bytes via buffered write, may repeat 2024-09-17T02:56:50.854 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 282591232 bytes via buffered write, may repeat 2024-09-17T02:56:50.854 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 283639808 bytes via buffered write, may repeat 2024-09-17T02:56:50.854 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 284688384 bytes via buffered write, may repeat 2024-09-17T02:56:50.854 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 285736960 bytes via buffered write, may repeat 2024-09-17T02:56:50.855 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 286785536 bytes via buffered write, may repeat 2024-09-17T02:56:50.855 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 287834112 bytes via buffered write, may repeat 2024-09-17T02:56:50.855 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 288882688 bytes via buffered write, may repeat 2024-09-17T02:56:50.855 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 289931264 bytes via buffered write, may repeat 2024-09-17T02:56:50.855 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 290979840 bytes via buffered write, may repeat 2024-09-17T02:56:50.855 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 292028416 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 293076992 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 294125568 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 295174144 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 296222720 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 297271296 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 298319872 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 299368448 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 300417024 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 301465600 bytes via buffered write, may repeat 2024-09-17T02:56:50.856 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 302514176 bytes via buffered write, may repeat 2024-09-17T02:56:50.857 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 303562752 bytes via buffered write, may repeat 2024-09-17T02:56:50.857 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 304611328 bytes via buffered write, may repeat 2024-09-17T02:56:50.857 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 305659904 bytes via buffered write, may repeat 2024-09-17T02:56:50.857 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 306708480 bytes via buffered write, may repeat 2024-09-17T02:56:50.857 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 307757056 bytes via buffered write, may repeat 2024-09-17T02:56:50.858 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 308805632 bytes via buffered write, may repeat 2024-09-17T02:56:50.858 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 309854208 bytes via buffered write, may repeat 2024-09-17T02:56:50.858 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 310902784 bytes via buffered write, may repeat 2024-09-17T02:56:50.858 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 311951360 bytes via buffered write, may repeat 2024-09-17T02:56:50.858 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 312999936 bytes via buffered write, may repeat 2024-09-17T02:56:50.858 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 314048512 bytes via buffered write, may repeat 2024-09-17T02:56:50.858 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 315097088 bytes via buffered write, may repeat 2024-09-17T02:56:50.859 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 316145664 bytes via buffered write, may repeat 2024-09-17T02:56:50.859 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 317194240 bytes via buffered write, may repeat 2024-09-17T02:56:50.859 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 318242816 bytes via buffered write, may repeat 2024-09-17T02:56:50.860 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 319291392 bytes via buffered write, may repeat 2024-09-17T02:56:50.860 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 320339968 bytes via buffered write, may repeat 2024-09-17T02:56:50.860 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 321388544 bytes via buffered write, may repeat 2024-09-17T02:56:50.860 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 322437120 bytes via buffered write, may repeat 2024-09-17T02:56:50.860 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 323485696 bytes via buffered write, may repeat 2024-09-17T02:56:50.891 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 324534272 bytes via buffered write, may repeat 2024-09-17T02:56:50.891 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 325582848 bytes via buffered write, may repeat 2024-09-17T02:56:50.891 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 326631424 bytes via buffered write, may repeat 2024-09-17T02:56:50.891 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 327680000 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 328728576 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 329777152 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 330825728 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 331874304 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 332922880 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 333971456 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 335020032 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 336068608 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 337117184 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 338165760 bytes via buffered write, may repeat 2024-09-17T02:56:50.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 339214336 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 340262912 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 341311488 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 342360064 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 343408640 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 344457216 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 345505792 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 346554368 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 347602944 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 348651520 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 349700096 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 350748672 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 351797248 bytes via buffered write, may repeat 2024-09-17T02:56:50.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 352845824 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 353894400 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 354942976 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 355991552 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 357040128 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 358088704 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 359137280 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 360185856 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 361234432 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 362283008 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 363331584 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 364380160 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 365428736 bytes via buffered write, may repeat 2024-09-17T02:56:50.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 366477312 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 367525888 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 368574464 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 369623040 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 370671616 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 371720192 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 372768768 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 373817344 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 374865920 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 375914496 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 376963072 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 378011648 bytes via buffered write, may repeat 2024-09-17T02:56:50.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 379060224 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 380108800 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 381157376 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 382205952 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 383254528 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 384303104 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 385351680 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 386400256 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 387448832 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 388497408 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 389545984 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 390594560 bytes via buffered write, may repeat 2024-09-17T02:56:50.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 391643136 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 392691712 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 393740288 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 394788864 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 395837440 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 396886016 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 397934592 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 398983168 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 400031744 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 401080320 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 402128896 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 403177472 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 404226048 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 405274624 bytes via buffered write, may repeat 2024-09-17T02:56:50.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 406323200 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 407371776 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 408420352 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 409468928 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 410517504 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 411566080 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 412614656 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 413663232 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 414711808 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 415760384 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 416808960 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 417857536 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 418906112 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 419954688 bytes via buffered write, may repeat 2024-09-17T02:56:50.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 421003264 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 422051840 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 423100416 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 424148992 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 425197568 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 426246144 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 427294720 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 428343296 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 429391872 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 430440448 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 431489024 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 432537600 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 433586176 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 434634752 bytes via buffered write, may repeat 2024-09-17T02:56:50.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 435683328 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 436731904 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 437780480 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 438829056 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 439877632 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 440926208 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 441974784 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 443023360 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 444071936 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 445120512 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 446169088 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 447217664 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 448266240 bytes via buffered write, may repeat 2024-09-17T02:56:50.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 449314816 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 450363392 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 451411968 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 452460544 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 453509120 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 454557696 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 455606272 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 456654848 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 457703424 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 458752000 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 459800576 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 460849152 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 461897728 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 462946304 bytes via buffered write, may repeat 2024-09-17T02:56:50.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 463994880 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 465043456 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 466092032 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 467140608 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 468189184 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 469237760 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 470286336 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 471334912 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 472383488 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 473432064 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 474480640 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 475529216 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 476577792 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 477626368 bytes via buffered write, may repeat 2024-09-17T02:56:50.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 478674944 bytes via buffered write, may repeat 2024-09-17T02:56:50.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 479723520 bytes via buffered write, may repeat 2024-09-17T02:56:50.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 480772096 bytes via buffered write, may repeat 2024-09-17T02:56:50.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 481820672 bytes via buffered write, may repeat 2024-09-17T02:56:50.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 482869248 bytes via buffered write, may repeat 2024-09-17T02:56:50.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 483917824 bytes via buffered write, may repeat 2024-09-17T02:56:50.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 484966400 bytes via buffered write, may repeat 2024-09-17T02:56:53.301 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:56:53.303+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-17T02:57:03.099 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:57:03.099+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-17T02:57:05.162 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:57:05.165 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:57:35.390 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:57:35.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:58:05.457 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:58:05.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:58:06.338 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 486014976 bytes via buffered write, may repeat 2024-09-17T02:58:06.338 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 487063552 bytes via buffered write, may repeat 2024-09-17T02:58:06.338 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 488112128 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 489160704 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 490209280 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 491257856 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 492306432 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 493355008 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 494403584 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 495452160 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 496500736 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 497549312 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 498597888 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 499646464 bytes via buffered write, may repeat 2024-09-17T02:58:06.339 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 500695040 bytes via buffered write, may repeat 2024-09-17T02:58:06.340 INFO:teuthology.orchestra.run.smithi104.stdout:done writing 500695040 bytes 2024-09-17T02:58:06.340 INFO:teuthology.orchestra.run.smithi104.stdout:successfully fsync'ed prior to getting full state reported 2024-09-17T02:58:06.340 INFO:teuthology.orchestra.run.smithi104.stdout:starting buffered write 2024-09-17T02:58:06.340 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T02:58:06.340 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T02:58:06.340 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T02:58:06.340 INFO:teuthology.orchestra.run.smithi104.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-17T02:58:06.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:58:06.351 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:58:06.351 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:58:06.402 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:58:06.446 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:58:06.447 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:58:06.447 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:58:06.447 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:06.464 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:58:06.465 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:06.521 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.679+0000 7fef0cf58640 1 -- 172.21.15.104:0/2925214087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef08073e00 msgr2=0x7fef08156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.679+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2925214087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef08073e00 0x7fef08156200 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fef08072ac0 tx=0x7feef802a4d0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.679+0000 7fef0cf58640 1 -- 172.21.15.104:0/2925214087 shutdown_connections 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.679+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2925214087 >> v2:172.21.15.192:3300/0 conn(0x7fef080cde80 0x7fef080cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.679+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2925214087 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef08073e00 0x7fef08156200 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.679+0000 7fef0cf58640 1 -- 172.21.15.104:0/2925214087 >> 172.21.15.104:0/2925214087 conn(0x7fef0806eb90 msgr2=0x7fef0806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.679+0000 7fef0cf58640 1 -- 172.21.15.104:0/2925214087 shutdown_connections 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.679+0000 7fef0cf58640 1 -- 172.21.15.104:0/2925214087 wait complete. 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.681+0000 7fef0cf58640 1 Processor -- start 2024-09-17T02:58:06.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.681+0000 7fef0cf58640 1 -- start start 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7fef0cf58640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef08073e00 0x7fef0815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7fef0cf58640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef0815cc30 0x7fef0813afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7fef0cf58640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0813b4f0 0x7fef0813b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7fef0cf58640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fef080d0350 con 0x7fef0815cc30 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7fef0cf58640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fef080d01d0 con 0x7fef0813b4f0 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7fef0cf58640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fef080d04d0 con 0x7fef08073e00 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7feefdd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef0815cc30 0x7fef0813afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7feefdd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef0815cc30 0x7fef0813afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42854/0 (socket says 172.21.15.104:42854) 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7feefdd9b640 1 -- 172.21.15.104:0/2498496354 learned_addr learned my addr 172.21.15.104:0/2498496354 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7fef06d9d640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0813b4f0 0x7fef0813b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7feefdd9b640 1 -- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef08073e00 msgr2=0x7fef0815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.682+0000 7feefdd9b640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef08073e00 0x7fef0815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7feefdd9b640 1 -- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0813b4f0 msgr2=0x7fef0813b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7feefdd9b640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0813b4f0 0x7fef0813b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7feefdd9b640 1 -- 172.21.15.104:0/2498496354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0813be40 con 0x7fef0815cc30 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7fef06d9d640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0813b4f0 0x7fef0813b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7feefdd9b640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef0815cc30 0x7fef0813afb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7feef000b410 tx=0x7feef000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7feeff7fe640 1 -- 172.21.15.104:0/2498496354 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0015020 con 0x7fef0815cc30 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7feeff7fe640 1 -- 172.21.15.104:0/2498496354 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feef0011920 con 0x7fef0815cc30 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0813a4f0 con 0x7fef0815cc30 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7feeff7fe640 1 -- 172.21.15.104:0/2498496354 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0011d70 con 0x7fef0815cc30 2024-09-17T02:58:06.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.683+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef0814d9e0 con 0x7fef0815cc30 2024-09-17T02:58:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.684+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef080d0a00 con 0x7fef0815cc30 2024-09-17T02:58:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.685+0000 7feeff7fe640 1 -- 172.21.15.104:0/2498496354 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feef0018020 con 0x7fef0815cc30 2024-09-17T02:58:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.685+0000 7feeff7fe640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feee8078b90 0x7feee807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.685+0000 7feeff7fe640 1 -- 172.21.15.104:0/2498496354 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7feef009b0a0 con 0x7fef0815cc30 2024-09-17T02:58:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.685+0000 7feeff7fe640 1 -- 172.21.15.104:0/2498496354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7feee8080710 con 0x7fef0815cc30 2024-09-17T02:58:06.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.686+0000 7fef0659c640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feee8078b90 0x7feee807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:06.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.686+0000 7fef0659c640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feee8078b90 0x7feee807b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feef8033000 tx=0x7feef80046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:06.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.689+0000 7feeff7fe640 1 -- 172.21.15.104:0/2498496354 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feef001f020 con 0x7fef0815cc30 2024-09-17T02:58:06.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.873+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef08154dd0 con 0x7fef0815cc30 2024-09-17T02:58:06.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.874+0000 7feeff7fe640 1 -- 172.21.15.104:0/2498496354 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) ==== 80+0+0 (secure 0 0 0) 0x7feef0063650 con 0x7fef0815cc30 2024-09-17T02:58:06.872 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feee8078b90 msgr2=0x7feee807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feee8078b90 0x7feee807b0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feef8033000 tx=0x7feef80046c0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef0815cc30 msgr2=0x7fef0813afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef0815cc30 0x7fef0813afb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7feef000b410 tx=0x7feef000b8d0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 shutdown_connections 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feee8078b90 0x7feee807b0a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef0813b4f0 0x7fef0813b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef0815cc30 0x7fef0813afb0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 --2- 172.21.15.104:0/2498496354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef08073e00 0x7fef0815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 >> 172.21.15.104:0/2498496354 conn(0x7fef0806eb90 msgr2=0x7fef08153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 shutdown_connections 2024-09-17T02:58:06.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:06.876+0000 7fef0cf58640 1 -- 172.21.15.104:0/2498496354 wait complete. 2024-09-17T02:58:06.886 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T02:58:06.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:06.886 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T02:58:06.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:58:06.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:06.917 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T02:58:06.972 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:58:06.972 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:58:06.972 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:06.992 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:58:06.992 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:07.051 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:58:07.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.166+0000 7fd2c9215640 1 -- 172.21.15.104:0/3871177951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac004d40 msgr2=0x7fd2ac005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.166+0000 7fd2c9215640 1 --2- 172.21.15.104:0/3871177951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2ac004d40 0x7fd2ac005150 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc005fd0 tx=0x7fd2ac005830 comp rx=0 tx=0).stop 2024-09-17T02:58:07.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.166+0000 7fd2c359e640 1 -- 172.21.15.104:0/3871177951 reap_dead start 2024-09-17T02:58:07.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.166+0000 7fd2c9215640 1 -- 172.21.15.104:0/3871177951 shutdown_connections 2024-09-17T02:58:07.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.166+0000 7fd2c9215640 1 -- 172.21.15.104:0/3871177951 >> 172.21.15.104:0/3871177951 conn(0x7fd2c4069120 msgr2=0x7fd2c4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:07.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.167+0000 7fd2c9215640 1 -- 172.21.15.104:0/3871177951 shutdown_connections 2024-09-17T02:58:07.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.167+0000 7fd2c9215640 1 -- 172.21.15.104:0/3871177951 wait complete. 2024-09-17T02:58:07.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.169+0000 7fd2c9215640 1 Processor -- start 2024-09-17T02:58:07.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.169+0000 7fd2c9215640 1 -- start start 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c9215640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2ac004d40 0x7fd2c40cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c9215640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2c40cce90 0x7fd2c415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c9215640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c41f5c70 0x7fd2c41f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c9215640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c41618c0 con 0x7fd2c40cce90 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c9215640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c40b6cb0 con 0x7fd2c41f5c70 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c9215640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c4161a40 con 0x7fd2ac004d40 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2c40cce90 0x7fd2c415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2c40cce90 0x7fd2c415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42874/0 (socket says 172.21.15.104:42874) 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c259c640 1 -- 172.21.15.104:0/3496114131 learned_addr learned my addr 172.21.15.104:0/3496114131 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c2d9d640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2ac004d40 0x7fd2c40cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c359e640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c41f5c70 0x7fd2c41f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c259c640 1 -- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2ac004d40 msgr2=0x7fd2c40cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c259c640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2ac004d40 0x7fd2c40cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c259c640 1 -- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c41f5c70 msgr2=0x7fd2c41f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c259c640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c41f5c70 0x7fd2c41f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.170+0000 7fd2c259c640 1 -- 172.21.15.104:0/3496114131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c40cb960 con 0x7fd2c40cce90 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.171+0000 7fd2c259c640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2c40cce90 0x7fd2c415b370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8001eb0 tx=0x7fd2b80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.171+0000 7fd2ab7fe640 1 -- 172.21.15.104:0/3496114131 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8015070 con 0x7fd2c40cce90 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.171+0000 7fd2ab7fe640 1 -- 172.21.15.104:0/3496114131 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2b8011900 con 0x7fd2c40cce90 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.171+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c41f68f0 con 0x7fd2c40cce90 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.171+0000 7fd2ab7fe640 1 -- 172.21.15.104:0/3496114131 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8011d10 con 0x7fd2c40cce90 2024-09-17T02:58:07.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.171+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c415a890 con 0x7fd2c40cce90 2024-09-17T02:58:07.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.172+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c41f6660 con 0x7fd2c40cce90 2024-09-17T02:58:07.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.173+0000 7fd2ab7fe640 1 -- 172.21.15.104:0/3496114131 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2b8018070 con 0x7fd2c40cce90 2024-09-17T02:58:07.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.173+0000 7fd2ab7fe640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2b0078bc0 0x7fd2b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:07.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.174+0000 7fd2ab7fe640 1 -- 172.21.15.104:0/3496114131 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fd2b809bcd0 con 0x7fd2c40cce90 2024-09-17T02:58:07.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.174+0000 7fd2ab7fe640 1 -- 172.21.15.104:0/3496114131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7fd2b00807a0 con 0x7fd2c40cce90 2024-09-17T02:58:07.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.174+0000 7fd2c2d9d640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2b0078bc0 0x7fd2b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:07.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.174+0000 7fd2c2d9d640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2b0078bc0 0x7fd2b007b0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40d1e60 tx=0x7fd2b4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:07.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.177+0000 7fd2ab7fe640 1 -- 172.21.15.104:0/3496114131 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2c40cb960 con 0x7fd2c40cce90 2024-09-17T02:58:07.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.426+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd2c4161380 con 0x7fd2c40cce90 2024-09-17T02:58:07.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.427+0000 7fd2ab7fe640 1 -- 172.21.15.104:0/3496114131 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v70) ==== 80+0+0 (secure 0 0 0) 0x7fd2c40b6f30 con 0x7fd2c40cce90 2024-09-17T02:58:07.426 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:58:07.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2b0078bc0 msgr2=0x7fd2b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2b0078bc0 0x7fd2b007b0d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40d1e60 tx=0x7fd2b4005f90 comp rx=0 tx=0).stop 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2c40cce90 msgr2=0x7fd2c415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2c40cce90 0x7fd2c415b370 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8001eb0 tx=0x7fd2b80039c0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 shutdown_connections 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2b0078bc0 0x7fd2b007b0d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2c41f5c70 0x7fd2c41f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2c40cce90 0x7fd2c415b370 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 --2- 172.21.15.104:0/3496114131 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2ac004d40 0x7fd2c40cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 >> 172.21.15.104:0/3496114131 conn(0x7fd2c4069120 msgr2=0x7fd2c40d2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 shutdown_connections 2024-09-17T02:58:07.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.431+0000 7fd2c9215640 1 -- 172.21.15.104:0/3496114131 wait complete. 2024-09-17T02:58:07.447 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T02:58:07.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:07.447 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T02:58:07.475 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:58:07.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:07.476 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T02:58:07.532 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:58:07.532 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:58:07.532 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:07.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:58:07.549 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:58:07.549 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:58:07.550 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:07.587 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:58:07.587 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:58:07.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.704+0000 7fc0d710b640 1 -- 172.21.15.104:0/3823548250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0b8003fd0 msgr2=0x7fc0b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.704+0000 7fc0d710b640 1 --2- 172.21.15.104:0/3823548250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0b8003fd0 0x7fc0b8004800 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c610 tx=0x7fc0b8005830 comp rx=0 tx=0).stop 2024-09-17T02:58:07.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.704+0000 7fc0d56a8640 1 -- 172.21.15.104:0/3823548250 reap_dead start 2024-09-17T02:58:07.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.704+0000 7fc0d710b640 1 -- 172.21.15.104:0/3823548250 shutdown_connections 2024-09-17T02:58:07.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.704+0000 7fc0d710b640 1 -- 172.21.15.104:0/3823548250 >> 172.21.15.104:0/3823548250 conn(0x7fc0d00b2450 msgr2=0x7fc0d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:07.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.704+0000 7fc0d710b640 1 -- 172.21.15.104:0/3823548250 shutdown_connections 2024-09-17T02:58:07.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.704+0000 7fc0d710b640 1 -- 172.21.15.104:0/3823548250 wait complete. 2024-09-17T02:58:07.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.705+0000 7fc0d710b640 1 Processor -- start 2024-09-17T02:58:07.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.705+0000 7fc0d710b640 1 -- start start 2024-09-17T02:58:07.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0d710b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0b8003fd0 0x7fc0d01f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0d710b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d014afc0 0x7fc0d014a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0d710b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0d01f4c00 0x7fc0d01f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0d710b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d00b3c90 con 0x7fc0d014afc0 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0d710b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d006fe60 con 0x7fc0d01f4c00 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0d710b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d00b3e10 con 0x7fc0b8003fd0 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d014afc0 0x7fc0d014a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d014afc0 0x7fc0d014a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42890/0 (socket says 172.21.15.104:42890) 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 -- 172.21.15.104:0/76075948 learned_addr learned my addr 172.21.15.104:0/76075948 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0d56a8640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0d01f4c00 0x7fc0d01f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0d4ea7640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0b8003fd0 0x7fc0d01f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 -- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0b8003fd0 msgr2=0x7fc0d01f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0b8003fd0 0x7fc0d01f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 -- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0d01f4c00 msgr2=0x7fc0d01f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0d01f4c00 0x7fc0d01f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 -- 172.21.15.104:0/76075948 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d01f5550 con 0x7fc0d014afc0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.707+0000 7fc0cffff640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d014afc0 0x7fc0d014a4b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c730 tx=0x7fc0c4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.708+0000 7fc0cd7fa640 1 -- 172.21.15.104:0/76075948 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4042070 con 0x7fc0d014afc0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.708+0000 7fc0cd7fa640 1 -- 172.21.15.104:0/76075948 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0c402bab0 con 0x7fc0d014afc0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.708+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d014d8c0 con 0x7fc0d014afc0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.708+0000 7fc0cd7fa640 1 -- 172.21.15.104:0/76075948 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4039070 con 0x7fc0d014afc0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.708+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d014ba80 con 0x7fc0d014afc0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.709+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d00b3750 con 0x7fc0d014afc0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.710+0000 7fc0cd7fa640 1 -- 172.21.15.104:0/76075948 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0c4034470 con 0x7fc0d014afc0 2024-09-17T02:58:07.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.710+0000 7fc0cd7fa640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0bc078b90 0x7fc0bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:07.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.710+0000 7fc0cd7fa640 1 -- 172.21.15.104:0/76075948 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fc0c40baaf0 con 0x7fc0d014afc0 2024-09-17T02:58:07.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.710+0000 7fc0cd7fa640 1 -- 172.21.15.104:0/76075948 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7fc0bc080770 con 0x7fc0d014afc0 2024-09-17T02:58:07.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.710+0000 7fc0d4ea7640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0bc078b90 0x7fc0bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:07.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.711+0000 7fc0d4ea7640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0bc078b90 0x7fc0bc07b0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009bb0 tx=0x7fc0c0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:07.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.715+0000 7fc0cd7fa640 1 -- 172.21.15.104:0/76075948 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc0d01f5550 con 0x7fc0d014afc0 2024-09-17T02:58:07.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.924+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0d014b530 con 0x7fc0d014afc0 2024-09-17T02:58:07.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.925+0000 7fc0cd7fa640 1 -- 172.21.15.104:0/76075948 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7fc0c4082ff0 con 0x7fc0d014afc0 2024-09-17T02:58:07.924 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:07.924 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"btime":"2024-09-17T02:56:42:271452+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/258221702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":258221702},{"type":"v1","addr":"172.21.15.192:6836","nonce":258221702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4219924766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4219924766},{"type":"v1","addr":"172.21.15.192:6837","nonce":4219924766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2744372735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2744372735},{"type":"v1","addr":"172.21.15.104:6833","nonce":2744372735}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:56:39.608242+0000","modified":"2024-09-17T02:56:41.622912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1457390445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1457390445},{"type":"v1","addr":"172.21.15.104:6835","nonce":1457390445}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5649,"qdb_cluster":[5649]},"id":4}]} 2024-09-17T02:58:07.924 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 27 2024-09-17T02:58:07.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0bc078b90 msgr2=0x7fc0bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0bc078b90 0x7fc0bc07b0a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0009bb0 tx=0x7fc0c0005f90 comp rx=0 tx=0).stop 2024-09-17T02:58:07.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d014afc0 msgr2=0x7fc0d014a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:07.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d014afc0 0x7fc0d014a4b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c730 tx=0x7fc0c4004bb0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 shutdown_connections 2024-09-17T02:58:07.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0bc078b90 0x7fc0bc07b0a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0d01f4c00 0x7fc0d01f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc0d014afc0 0x7fc0d014a4b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 --2- 172.21.15.104:0/76075948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0b8003fd0 0x7fc0d01f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:07.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 >> 172.21.15.104:0/76075948 conn(0x7fc0d00b2450 msgr2=0x7fc0d01e5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:07.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 shutdown_connections 2024-09-17T02:58:07.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:07.927+0000 7fc0d710b640 1 -- 172.21.15.104:0/76075948 wait complete. 2024-09-17T02:58:07.937 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:58:08.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.051+0000 7fa88a1c3640 1 -- 172.21.15.104:0/2668793250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa86c0053a0 msgr2=0x7fa86c00ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.051+0000 7fa88a1c3640 1 --2- 172.21.15.104:0/2668793250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa86c0053a0 0x7fa86c00ba50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00c610 tx=0x7fa86c005830 comp rx=0 tx=0).stop 2024-09-17T02:58:08.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.051+0000 7fa88a1c3640 1 -- 172.21.15.104:0/2668793250 shutdown_connections 2024-09-17T02:58:08.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.051+0000 7fa88a1c3640 1 --2- 172.21.15.104:0/2668793250 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa86c0053a0 0x7fa86c00ba50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.051+0000 7fa88a1c3640 1 -- 172.21.15.104:0/2668793250 >> 172.21.15.104:0/2668793250 conn(0x7fa8840d2970 msgr2=0x7fa8840d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:08.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.051+0000 7fa88a1c3640 1 -- 172.21.15.104:0/2668793250 shutdown_connections 2024-09-17T02:58:08.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.051+0000 7fa88a1c3640 1 -- 172.21.15.104:0/2668793250 wait complete. 2024-09-17T02:58:08.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.053+0000 7fa88a1c3640 1 Processor -- start 2024-09-17T02:58:08.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.053+0000 7fa88a1c3640 1 -- start start 2024-09-17T02:58:08.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa88a1c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa86c0053a0 0x7fa8841f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa88a1c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa88406e0d0 0x7fa8840c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa88a1c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa88406e4e0 0x7fa8840c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa88a1c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa8840b2a40 con 0x7fa88406e0d0 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa88a1c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa8840b23b0 con 0x7fa88406e4e0 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa88a1c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa8840b2bc0 con 0x7fa86c0053a0 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa88406e0d0 0x7fa8840c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa882ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa88406e0d0 0x7fa8840c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42908/0 (socket says 172.21.15.104:42908) 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa882ffd640 1 -- 172.21.15.104:0/1874213815 learned_addr learned my addr 172.21.15.104:0/1874213815 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa883fff640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa88406e4e0 0x7fa8840c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa8837fe640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa86c0053a0 0x7fa8841f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa882ffd640 1 -- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa86c0053a0 msgr2=0x7fa8841f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa882ffd640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa86c0053a0 0x7fa8841f6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa882ffd640 1 -- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa88406e4e0 msgr2=0x7fa8840c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa882ffd640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa88406e4e0 0x7fa8840c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.054+0000 7fa882ffd640 1 -- 172.21.15.104:0/1874213815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8840cb8e0 con 0x7fa88406e0d0 2024-09-17T02:58:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.055+0000 7fa882ffd640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa88406e0d0 0x7fa8840c9940 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa878011a50 tx=0x7fa878011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.055+0000 7fa86bfff640 1 -- 172.21.15.104:0/1874213815 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87801f070 con 0x7fa88406e0d0 2024-09-17T02:58:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.055+0000 7fa86bfff640 1 -- 172.21.15.104:0/1874213815 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa87800fe80 con 0x7fa88406e0d0 2024-09-17T02:58:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.055+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8840cbd80 con 0x7fa88406e0d0 2024-09-17T02:58:08.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.055+0000 7fa86bfff640 1 -- 172.21.15.104:0/1874213815 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa878012670 con 0x7fa88406e0d0 2024-09-17T02:58:08.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.055+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8840cc340 con 0x7fa88406e0d0 2024-09-17T02:58:08.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.056+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8840d0fd0 con 0x7fa88406e0d0 2024-09-17T02:58:08.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.057+0000 7fa86bfff640 1 -- 172.21.15.104:0/1874213815 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa878022070 con 0x7fa88406e0d0 2024-09-17T02:58:08.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.057+0000 7fa86bfff640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa870078bc0 0x7fa87007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.057+0000 7fa86bfff640 1 -- 172.21.15.104:0/1874213815 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fa87809b7e0 con 0x7fa88406e0d0 2024-09-17T02:58:08.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.057+0000 7fa8837fe640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa870078bc0 0x7fa87007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.057+0000 7fa86bfff640 1 -- 172.21.15.104:0/1874213815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7fa8700807a0 con 0x7fa88406e0d0 2024-09-17T02:58:08.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.058+0000 7fa8837fe640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa870078bc0 0x7fa87007b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa874006d20 tx=0x7fa874006070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:08.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.062+0000 7fa86bfff640 1 -- 172.21.15.104:0/1874213815 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa878063660 con 0x7fa88406e0d0 2024-09-17T02:58:08.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.272+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8840cdd00 con 0x7fa88406e0d0 2024-09-17T02:58:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.272+0000 7fa86bfff640 1 -- 172.21.15.104:0/1874213815 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7fa878068090 con 0x7fa88406e0d0 2024-09-17T02:58:08.271 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:08.271 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"btime":"2024-09-17T02:56:42:271452+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/258221702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":258221702},{"type":"v1","addr":"172.21.15.192:6836","nonce":258221702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4219924766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4219924766},{"type":"v1","addr":"172.21.15.192:6837","nonce":4219924766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2744372735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2744372735},{"type":"v1","addr":"172.21.15.104:6833","nonce":2744372735}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:56:39.608242+0000","modified":"2024-09-17T02:56:41.622912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1457390445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1457390445},{"type":"v1","addr":"172.21.15.104:6835","nonce":1457390445}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5649,"qdb_cluster":[5649]},"id":4}]} 2024-09-17T02:58:08.271 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 27 2024-09-17T02:58:08.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa870078bc0 msgr2=0x7fa87007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa870078bc0 0x7fa87007b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa874006d20 tx=0x7fa874006070 comp rx=0 tx=0).stop 2024-09-17T02:58:08.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa88406e0d0 msgr2=0x7fa8840c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa88406e0d0 0x7fa8840c9940 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa878011a50 tx=0x7fa878011f10 comp rx=0 tx=0).stop 2024-09-17T02:58:08.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 shutdown_connections 2024-09-17T02:58:08.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa870078bc0 0x7fa87007b0d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa88406e4e0 0x7fa8840c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa88406e0d0 0x7fa8840c9940 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 --2- 172.21.15.104:0/1874213815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa86c0053a0 0x7fa8841f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 >> 172.21.15.104:0/1874213815 conn(0x7fa8840d2970 msgr2=0x7fa8840b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 shutdown_connections 2024-09-17T02:58:08.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.275+0000 7fa88a1c3640 1 -- 172.21.15.104:0/1874213815 wait complete. 2024-09-17T02:58:08.286 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:58:08.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.400+0000 7fbde02de640 1 -- 172.21.15.104:0/3003748236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815f1f0 msgr2=0x7fbdd815f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.400+0000 7fbde02de640 1 --2- 172.21.15.104:0/3003748236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815f1f0 0x7fbdd815f600 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8005fd0 tx=0x7fbdc802a540 comp rx=0 tx=0).stop 2024-09-17T02:58:08.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.400+0000 7fbde02de640 1 -- 172.21.15.104:0/3003748236 shutdown_connections 2024-09-17T02:58:08.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.400+0000 7fbde02de640 1 --2- 172.21.15.104:0/3003748236 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815f1f0 0x7fbdd815f600 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.400+0000 7fbde02de640 1 --2- 172.21.15.104:0/3003748236 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd80b65e0 0x7fbdd80b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.400+0000 7fbde02de640 1 -- 172.21.15.104:0/3003748236 >> 172.21.15.104:0/3003748236 conn(0x7fbdd8069120 msgr2=0x7fbdd8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:08.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.400+0000 7fbde02de640 1 -- 172.21.15.104:0/3003748236 shutdown_connections 2024-09-17T02:58:08.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.400+0000 7fbde02de640 1 -- 172.21.15.104:0/3003748236 wait complete. 2024-09-17T02:58:08.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.402+0000 7fbde02de640 1 Processor -- start 2024-09-17T02:58:08.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.402+0000 7fbde02de640 1 -- start start 2024-09-17T02:58:08.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbde02de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd80b65e0 0x7fbdd81fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbde02de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd815f1f0 0x7fbdd81ed090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbde02de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815fb40 0x7fbdd80cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbde02de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8163490 con 0x7fbdd815fb40 2024-09-17T02:58:08.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbde02de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd81625a0 con 0x7fbdd80b65e0 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbde02de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd8163610 con 0x7fbdd815f1f0 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbdde87b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815fb40 0x7fbdd80cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbdde07a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd80b65e0 0x7fbdd81fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbdde87b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815fb40 0x7fbdd80cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42928/0 (socket says 172.21.15.104:42928) 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbddd879640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd815f1f0 0x7fbdd81ed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.403+0000 7fbdde87b640 1 -- 172.21.15.104:0/165502692 learned_addr learned my addr 172.21.15.104:0/165502692 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdde87b640 1 -- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd815f1f0 msgr2=0x7fbdd81ed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdde87b640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd815f1f0 0x7fbdd81ed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdde87b640 1 -- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd80b65e0 msgr2=0x7fbdd81fa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdde87b640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd80b65e0 0x7fbdd81fa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdde87b640 1 -- 172.21.15.104:0/165502692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd815d900 con 0x7fbdd815fb40 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbddd879640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd815f1f0 0x7fbdd81ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:58:08.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdde87b640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815fb40 0x7fbdd80cdd70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0002230 tx=0x7fbdd000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:08.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdceffd640 1 -- 172.21.15.104:0/165502692 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0003b70 con 0x7fbdd815fb40 2024-09-17T02:58:08.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdceffd640 1 -- 172.21.15.104:0/165502692 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd0003d10 con 0x7fbdd815fb40 2024-09-17T02:58:08.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd81fa920 con 0x7fbdd815fb40 2024-09-17T02:58:08.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbdceffd640 1 -- 172.21.15.104:0/165502692 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0005330 con 0x7fbdd815fb40 2024-09-17T02:58:08.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.404+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd81f6910 con 0x7fbdd815fb40 2024-09-17T02:58:08.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.405+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd81f6680 con 0x7fbdd815fb40 2024-09-17T02:58:08.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.406+0000 7fbdceffd640 1 -- 172.21.15.104:0/165502692 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbdd00056e0 con 0x7fbdd815fb40 2024-09-17T02:58:08.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.406+0000 7fbdceffd640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.406+0000 7fbdceffd640 1 -- 172.21.15.104:0/165502692 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fbdd009ab20 con 0x7fbdd815fb40 2024-09-17T02:58:08.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.406+0000 7fbdceffd640 1 -- 172.21.15.104:0/165502692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7fbdbc080770 con 0x7fbdd815fb40 2024-09-17T02:58:08.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.406+0000 7fbdde07a640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.407+0000 7fbdde07a640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80d1e60 tx=0x7fbdd4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:08.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.411+0000 7fbdceffd640 1 -- 172.21.15.104:0/165502692 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbdd81fa920 con 0x7fbdd815fb40 2024-09-17T02:58:08.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.586+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdd80ced60 con 0x7fbdd815fb40 2024-09-17T02:58:08.586 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.587+0000 7fbdceffd640 1 -- 172.21.15.104:0/165502692 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16831 (secure 0 0 0) 0x7fbdd80b6f30 con 0x7fbdd815fb40 2024-09-17T02:58:08.586 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:08.587 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":70,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:56:57.340011+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:56:37.257971+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T02:56:38.570795+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbdbc078b90 msgr2=0x7fbdbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80d1e60 tx=0x7fbdd4005f90 comp rx=0 tx=0).stop 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815fb40 msgr2=0x7fbdd80cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815fb40 0x7fbdd80cdd70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0002230 tx=0x7fbdd000cb90 comp rx=0 tx=0).stop 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 shutdown_connections 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbdd815fb40 0x7fbdd80cdd70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd815f1f0 0x7fbdd81ed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 --2- 172.21.15.104:0/165502692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd80b65e0 0x7fbdd81fa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 >> 172.21.15.104:0/165502692 conn(0x7fbdd8069120 msgr2=0x7fbdd80b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:08.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 shutdown_connections 2024-09-17T02:58:08.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.590+0000 7fbde02de640 1 -- 172.21.15.104:0/165502692 wait complete. 2024-09-17T02:58:08.600 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T02:58:08.600 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:58:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.715+0000 7f1c305ba640 1 -- 172.21.15.104:0/605535444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c28072cf0 msgr2=0x7f1c28073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.715+0000 7f1c305ba640 1 --2- 172.21.15.104:0/605535444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c28072cf0 0x7f1c28073100 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1c18005fd0 tx=0x7f1c1802a4b0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.715+0000 7f1c305ba640 1 -- 172.21.15.104:0/605535444 shutdown_connections 2024-09-17T02:58:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.715+0000 7f1c305ba640 1 --2- 172.21.15.104:0/605535444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c2815ce00 0x7f1c2815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.715+0000 7f1c305ba640 1 --2- 172.21.15.104:0/605535444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c28072cf0 0x7f1c28073100 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.715+0000 7f1c305ba640 1 -- 172.21.15.104:0/605535444 >> 172.21.15.104:0/605535444 conn(0x7f1c2806eb90 msgr2=0x7f1c2806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.715+0000 7f1c305ba640 1 -- 172.21.15.104:0/605535444 shutdown_connections 2024-09-17T02:58:08.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.715+0000 7f1c305ba640 1 -- 172.21.15.104:0/605535444 wait complete. 2024-09-17T02:58:08.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.717+0000 7f1c305ba640 1 Processor -- start 2024-09-17T02:58:08.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.717+0000 7f1c305ba640 1 -- start start 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c305ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2806f6b0 0x7f1c280b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c305ba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c28072cf0 0x7f1c280b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c305ba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815ce00 0x7f1c280b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c305ba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2815dae0 con 0x7f1c2806f6b0 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c305ba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2815d960 con 0x7f1c2815ce00 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c305ba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2815dc60 con 0x7f1c28072cf0 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2e356640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2806f6b0 0x7f1c280b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2e356640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2806f6b0 0x7f1c280b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42940/0 (socket says 172.21.15.104:42940) 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2e356640 1 -- 172.21.15.104:0/2128575307 learned_addr learned my addr 172.21.15.104:0/2128575307 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:08.718 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2db55640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c28072cf0 0x7f1c280b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2eb57640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815ce00 0x7f1c280b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2e356640 1 -- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c28072cf0 msgr2=0x7f1c280b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2e356640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c28072cf0 0x7f1c280b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2e356640 1 -- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815ce00 msgr2=0x7f1c280b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2e356640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815ce00 0x7f1c280b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2e356640 1 -- 172.21.15.104:0/2128575307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c281f9310 con 0x7f1c2806f6b0 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2db55640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c28072cf0 0x7f1c280b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.718+0000 7f1c2eb57640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815ce00 0x7f1c280b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:08.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.719+0000 7f1c2e356640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2806f6b0 0x7f1c280b4a00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c3a0 tx=0x7f1c2400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.719+0000 7f1c1effd640 1 -- 172.21.15.104:0/2128575307 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24017070 con 0x7f1c2806f6b0 2024-09-17T02:58:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.719+0000 7f1c1effd640 1 -- 172.21.15.104:0/2128575307 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c240053c0 con 0x7f1c2806f6b0 2024-09-17T02:58:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.719+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c281f9590 con 0x7f1c2806f6b0 2024-09-17T02:58:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.719+0000 7f1c1effd640 1 -- 172.21.15.104:0/2128575307 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24003850 con 0x7f1c2806f6b0 2024-09-17T02:58:08.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.719+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c281f9b50 con 0x7f1c2806f6b0 2024-09-17T02:58:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.720+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c28073100 con 0x7f1c2806f6b0 2024-09-17T02:58:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.721+0000 7f1c1effd640 1 -- 172.21.15.104:0/2128575307 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c2401a070 con 0x7f1c2806f6b0 2024-09-17T02:58:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.721+0000 7f1c1effd640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c0c078b90 0x7f1c0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.721+0000 7f1c1effd640 1 -- 172.21.15.104:0/2128575307 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f1c2409a0e0 con 0x7f1c2806f6b0 2024-09-17T02:58:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.721+0000 7f1c2db55640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c0c078b90 0x7f1c0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.722+0000 7f1c1effd640 1 -- 172.21.15.104:0/2128575307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7f1c0c080710 con 0x7f1c2806f6b0 2024-09-17T02:58:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.722+0000 7f1c2db55640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c0c078b90 0x7f1c0c07b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1c18033000 tx=0x7f1c18004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:08.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.726+0000 7f1c1effd640 1 -- 172.21.15.104:0/2128575307 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c281f9310 con 0x7f1c2806f6b0 2024-09-17T02:58:08.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.935+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c281590c0 con 0x7f1c2806f6b0 2024-09-17T02:58:08.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.936+0000 7f1c1effd640 1 -- 172.21.15.104:0/2128575307 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7f1c24062520 con 0x7f1c2806f6b0 2024-09-17T02:58:08.935 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:08.935 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"btime":"2024-09-17T02:56:42:271452+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/258221702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":258221702},{"type":"v1","addr":"172.21.15.192:6836","nonce":258221702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4219924766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4219924766},{"type":"v1","addr":"172.21.15.192:6837","nonce":4219924766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2744372735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2744372735},{"type":"v1","addr":"172.21.15.104:6833","nonce":2744372735}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:56:39.608242+0000","modified":"2024-09-17T02:56:41.622912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1457390445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1457390445},{"type":"v1","addr":"172.21.15.104:6835","nonce":1457390445}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5649,"qdb_cluster":[5649]},"id":4}]} 2024-09-17T02:58:08.935 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 27 2024-09-17T02:58:08.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c0c078b90 msgr2=0x7f1c0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c0c078b90 0x7f1c0c07b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1c18033000 tx=0x7f1c18004730 comp rx=0 tx=0).stop 2024-09-17T02:58:08.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2806f6b0 msgr2=0x7f1c280b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2806f6b0 0x7f1c280b4a00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c3a0 tx=0x7f1c2400c860 comp rx=0 tx=0).stop 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 shutdown_connections 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c0c078b90 0x7f1c0c07b0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2815ce00 0x7f1c280b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c28072cf0 0x7f1c280b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 --2- 172.21.15.104:0/2128575307 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c2806f6b0 0x7f1c280b4a00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.938+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 >> 172.21.15.104:0/2128575307 conn(0x7f1c2806eb90 msgr2=0x7f1c2815e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.939+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 shutdown_connections 2024-09-17T02:58:08.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:08.939+0000 7f1c305ba640 1 -- 172.21.15.104:0/2128575307 wait complete. 2024-09-17T02:58:08.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:58:09.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.062+0000 7fb125f0b640 1 -- 172.21.15.104:0/2443471557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb108003a00 msgr2=0x7fb108003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.062+0000 7fb125f0b640 1 --2- 172.21.15.104:0/2443471557 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb108003a00 0x7fb108003e90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb110009d00 tx=0x7fb108005830 comp rx=0 tx=0).stop 2024-09-17T02:58:09.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.062+0000 7fb11ffff640 1 -- 172.21.15.104:0/2443471557 reap_dead start 2024-09-17T02:58:09.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.062+0000 7fb125f0b640 1 -- 172.21.15.104:0/2443471557 shutdown_connections 2024-09-17T02:58:09.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.062+0000 7fb125f0b640 1 -- 172.21.15.104:0/2443471557 >> 172.21.15.104:0/2443471557 conn(0x7fb1200b2450 msgr2=0x7fb1200b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:09.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.062+0000 7fb125f0b640 1 -- 172.21.15.104:0/2443471557 shutdown_connections 2024-09-17T02:58:09.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.062+0000 7fb125f0b640 1 -- 172.21.15.104:0/2443471557 wait complete. 2024-09-17T02:58:09.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.064+0000 7fb125f0b640 1 Processor -- start 2024-09-17T02:58:09.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.064+0000 7fb125f0b640 1 -- start start 2024-09-17T02:58:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb125f0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb108003a00 0x7fb1201f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb125f0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1201e6bf0 0x7fb1201f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb125f0b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb12015be10 0x7fb120159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb125f0b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb120072880 con 0x7fb1201e6bf0 2024-09-17T02:58:09.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb125f0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb1200cf4a0 con 0x7fb108003a00 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb125f0b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb120072a00 con 0x7fb12015be10 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb11effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1201e6bf0 0x7fb1201f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb11effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1201e6bf0 0x7fb1201f2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42954/0 (socket says 172.21.15.104:42954) 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.065+0000 7fb11effd640 1 -- 172.21.15.104:0/3366723009 learned_addr learned my addr 172.21.15.104:0/3366723009 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb11f7fe640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb108003a00 0x7fb1201f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb11ffff640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb12015be10 0x7fb120159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb11effd640 1 -- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb12015be10 msgr2=0x7fb120159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb11effd640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb12015be10 0x7fb120159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb11effd640 1 -- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb108003a00 msgr2=0x7fb1201f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb11effd640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb108003a00 0x7fb1201f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb11effd640 1 -- 172.21.15.104:0/3366723009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1201e5bf0 con 0x7fb1201e6bf0 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb11effd640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1201e6bf0 0x7fb1201f2fb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb1140117e0 tx=0x7fb114011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:09.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb107fff640 1 -- 172.21.15.104:0/3366723009 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11400f9a0 con 0x7fb1201e6bf0 2024-09-17T02:58:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb107fff640 1 -- 172.21.15.104:0/3366723009 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb11400fb40 con 0x7fb1201e6bf0 2024-09-17T02:58:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1201e5ed0 con 0x7fb1201e6bf0 2024-09-17T02:58:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb107fff640 1 -- 172.21.15.104:0/3366723009 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114005020 con 0x7fb1201e6bf0 2024-09-17T02:58:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.066+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1201f27b0 con 0x7fb1201e6bf0 2024-09-17T02:58:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.067+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb12015bc00 con 0x7fb1201e6bf0 2024-09-17T02:58:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.068+0000 7fb107fff640 1 -- 172.21.15.104:0/3366723009 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1140051c0 con 0x7fb1201e6bf0 2024-09-17T02:58:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.068+0000 7fb107fff640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb10c078b90 0x7fb10c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.068+0000 7fb107fff640 1 -- 172.21.15.104:0/3366723009 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fb11409b880 con 0x7fb1201e6bf0 2024-09-17T02:58:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.069+0000 7fb107fff640 1 -- 172.21.15.104:0/3366723009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7fb10c080710 con 0x7fb1201e6bf0 2024-09-17T02:58:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.069+0000 7fb11f7fe640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb10c078b90 0x7fb10c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.069+0000 7fb11f7fe640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb10c078b90 0x7fb10c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb110035000 tx=0x7fb1100046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:09.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.073+0000 7fb107fff640 1 -- 172.21.15.104:0/3366723009 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb114063670 con 0x7fb1201e6bf0 2024-09-17T02:58:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.282+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1200b0d90 con 0x7fb1201e6bf0 2024-09-17T02:58:09.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.283+0000 7fb107fff640 1 -- 172.21.15.104:0/3366723009 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5232 (secure 0 0 0) 0x7fb1140680a0 con 0x7fb1201e6bf0 2024-09-17T02:58:09.282 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:09.282 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":27,"btime":"2024-09-17T02:56:42:271452+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/258221702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":258221702},{"type":"v1","addr":"172.21.15.192:6836","nonce":258221702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4219924766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4219924766},{"type":"v1","addr":"172.21.15.192:6837","nonce":4219924766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2744372735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2744372735},{"type":"v1","addr":"172.21.15.104:6833","nonce":2744372735}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:56:39.608242+0000","modified":"2024-09-17T02:56:41.622912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5649":{"gid":5649,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1457390445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1457390445},{"type":"v1","addr":"172.21.15.104:6835","nonce":1457390445}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5649,"qdb_cluster":[5649]},"id":4}]} 2024-09-17T02:58:09.282 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 27 2024-09-17T02:58:09.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb10c078b90 msgr2=0x7fb10c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb10c078b90 0x7fb10c07b0a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb110035000 tx=0x7fb1100046c0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1201e6bf0 msgr2=0x7fb1201f2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1201e6bf0 0x7fb1201f2fb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb1140117e0 tx=0x7fb114011ca0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 shutdown_connections 2024-09-17T02:58:09.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb10c078b90 0x7fb10c07b0a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb12015be10 0x7fb120159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1201e6bf0 0x7fb1201f2fb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 --2- 172.21.15.104:0/3366723009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb108003a00 0x7fb1201f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 >> 172.21.15.104:0/3366723009 conn(0x7fb1200b2450 msgr2=0x7fb1200d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:09.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 shutdown_connections 2024-09-17T02:58:09.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.285+0000 7fb125f0b640 1 -- 172.21.15.104:0/3366723009 wait complete. 2024-09-17T02:58:09.295 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:58:09.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.409+0000 7f111da4d640 1 -- 172.21.15.104:0/2994462887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f111806f540 msgr2=0x7f11181608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.409+0000 7f111da4d640 1 --2- 172.21.15.104:0/2994462887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f111806f540 0x7f11181608a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1108009830 tx=0x7f110802a5c0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.409+0000 7f111da4d640 1 -- 172.21.15.104:0/2994462887 shutdown_connections 2024-09-17T02:58:09.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.409+0000 7f111da4d640 1 --2- 172.21.15.104:0/2994462887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f111806f540 0x7f11181608a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.409+0000 7f111da4d640 1 -- 172.21.15.104:0/2994462887 >> 172.21.15.104:0/2994462887 conn(0x7f11180b3640 msgr2=0x7f11180b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:09.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.409+0000 7f111da4d640 1 -- 172.21.15.104:0/2994462887 shutdown_connections 2024-09-17T02:58:09.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.409+0000 7f111da4d640 1 -- 172.21.15.104:0/2994462887 wait complete. 2024-09-17T02:58:09.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.411+0000 7f111da4d640 1 Processor -- start 2024-09-17T02:58:09.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.411+0000 7f111da4d640 1 -- start start 2024-09-17T02:58:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.412+0000 7f111da4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f111806f540 0x7f11180b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f111da4d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f111815d3b0 0x7f111814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f111da4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11180c68b0 0x7f111814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f111da4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f11180d10a0 con 0x7f11180c68b0 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f111da4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f11180d0f20 con 0x7f111806f540 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f111da4d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f11180d1220 con 0x7f111815d3b0 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11180c68b0 0x7f111814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11180c68b0 0x7f111814cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42970/0 (socket says 172.21.15.104:42970) 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 -- 172.21.15.104:0/2145491744 learned_addr learned my addr 172.21.15.104:0/2145491744 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f1116ffd640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f111806f540 0x7f11180b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f110ffff640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f111815d3b0 0x7f111814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 -- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f111815d3b0 msgr2=0x7f111814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f111815d3b0 0x7f111814c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 -- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f111806f540 msgr2=0x7f11180b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f111806f540 0x7f11180b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 -- 172.21.15.104:0/2145491744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11180afe90 con 0x7f11180c68b0 2024-09-17T02:58:09.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f11177fe640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11180c68b0 0x7f111814cdf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f111000c6e0 tx=0x7f111000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:09.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f1114ff9640 1 -- 172.21.15.104:0/2145491744 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110003b70 con 0x7f11180c68b0 2024-09-17T02:58:09.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f1114ff9640 1 -- 172.21.15.104:0/2145491744 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1110003d10 con 0x7f11180c68b0 2024-09-17T02:58:09.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11180b0170 con 0x7f11180c68b0 2024-09-17T02:58:09.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f1114ff9640 1 -- 172.21.15.104:0/2145491744 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110005330 con 0x7f11180c68b0 2024-09-17T02:58:09.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.413+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11180b5730 con 0x7f11180c68b0 2024-09-17T02:58:09.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.414+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111806a480 con 0x7f11180c68b0 2024-09-17T02:58:09.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.415+0000 7f1114ff9640 1 -- 172.21.15.104:0/2145491744 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11100054d0 con 0x7f11180c68b0 2024-09-17T02:58:09.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.416+0000 7f1114ff9640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.416+0000 7f1114ff9640 1 -- 172.21.15.104:0/2145491744 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f111009a9d0 con 0x7f11180c68b0 2024-09-17T02:58:09.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.416+0000 7f1114ff9640 1 -- 172.21.15.104:0/2145491744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7f10f8080770 con 0x7f11180c68b0 2024-09-17T02:58:09.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.416+0000 7f1116ffd640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.417+0000 7f1116ffd640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1108034000 tx=0x7f1108004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:09.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.420+0000 7f1114ff9640 1 -- 172.21.15.104:0/2145491744 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11100627b0 con 0x7f11180c68b0 2024-09-17T02:58:09.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.594+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11180d16b0 con 0x7f11180c68b0 2024-09-17T02:58:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.596+0000 7f1114ff9640 1 -- 172.21.15.104:0/2145491744 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16831 (secure 0 0 0) 0x7f11100671e0 con 0x7f11180c68b0 2024-09-17T02:58:09.594 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:09.594 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":70,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:56:57.340011+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:56:37.257971+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T02:56:38.570795+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:58:09.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 msgr2=0x7f10f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1108034000 tx=0x7f1108004730 comp rx=0 tx=0).stop 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11180c68b0 msgr2=0x7f111814cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11180c68b0 0x7f111814cdf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f111000c6e0 tx=0x7f111000cba0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 shutdown_connections 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11180c68b0 0x7f111814cdf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f111815d3b0 0x7f111814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 --2- 172.21.15.104:0/2145491744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f111806f540 0x7f11180b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 >> 172.21.15.104:0/2145491744 conn(0x7f11180b3640 msgr2=0x7f111815ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 shutdown_connections 2024-09-17T02:58:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.598+0000 7f111da4d640 1 -- 172.21.15.104:0/2145491744 wait complete. 2024-09-17T02:58:09.608 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T02:58:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.723+0000 7f702944d640 1 -- 172.21.15.104:0/1670096316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f700c006410 msgr2=0x7f700c00cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.723+0000 7f702944d640 1 --2- 172.21.15.104:0/1670096316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f700c006410 0x7f700c00cad0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c610 tx=0x7f700c006940 comp rx=0 tx=0).stop 2024-09-17T02:58:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.723+0000 7f702944d640 1 -- 172.21.15.104:0/1670096316 shutdown_connections 2024-09-17T02:58:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.723+0000 7f702944d640 1 --2- 172.21.15.104:0/1670096316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f700c006410 0x7f700c00cad0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.723+0000 7f702944d640 1 -- 172.21.15.104:0/1670096316 >> 172.21.15.104:0/1670096316 conn(0x7f70240b3440 msgr2=0x7f702406ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.723+0000 7f702944d640 1 -- 172.21.15.104:0/1670096316 shutdown_connections 2024-09-17T02:58:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.723+0000 7f702944d640 1 -- 172.21.15.104:0/1670096316 wait complete. 2024-09-17T02:58:09.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.725+0000 7f702944d640 1 Processor -- start 2024-09-17T02:58:09.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.725+0000 7f702944d640 1 -- start start 2024-09-17T02:58:09.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.726+0000 7f702944d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f700c006410 0x7f70241f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f702944d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70240ccbc0 0x7f70240ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f702944d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f702415a370 0x7f702415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f702944d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f702415f440 con 0x7f702415a370 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f702944d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f702415f2c0 con 0x7f70240ccbc0 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f702944d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f702415f5c0 con 0x7f700c006410 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f702415a370 0x7f702415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f702415a370 0x7f702415a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42992/0 (socket says 172.21.15.104:42992) 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 -- 172.21.15.104:0/3494216986 learned_addr learned my addr 172.21.15.104:0/3494216986 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f7022ffd640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f700c006410 0x7f70241f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70227fc640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70240ccbc0 0x7f70240ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 -- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f700c006410 msgr2=0x7f70241f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f700c006410 0x7f70241f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 -- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70240ccbc0 msgr2=0x7f70240ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70240ccbc0 0x7f70240ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 -- 172.21.15.104:0/3494216986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702415acc0 con 0x7f702415a370 2024-09-17T02:58:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70227fc640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70240ccbc0 0x7f70240ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f70237fe640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f702415a370 0x7f702415a780 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f701c001330 tx=0x7f701c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c039070 con 0x7f702415a370 2024-09-17T02:58:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f701c02bda0 con 0x7f702415a370 2024-09-17T02:58:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70240c6b10 con 0x7f702415a370 2024-09-17T02:58:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c006280 con 0x7f702415a370 2024-09-17T02:58:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.727+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70240c70d0 con 0x7f702415a370 2024-09-17T02:58:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.729+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702406f8d0 con 0x7f702415a370 2024-09-17T02:58:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.729+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f701c006420 con 0x7f702415a370 2024-09-17T02:58:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.730+0000 7f700b7fe640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7010078bc0 0x7f701007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.730+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f701c0ba7a0 con 0x7f702415a370 2024-09-17T02:58:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.730+0000 7f7022ffd640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7010078bc0 0x7f701007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.730+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=71}) -- 0x7f70100807a0 con 0x7f702415a370 2024-09-17T02:58:09.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.731+0000 7f7022ffd640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7010078bc0 0x7f701007b0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f701400db30 tx=0x7f701400d2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:09.733 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.735+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f702415acc0 con 0x7f702415a370 2024-09-17T02:58:09.821 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:58:09.823+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-17T02:58:09.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.829+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 7 ==== osd_map(71..71 src has 1..71) ==== 304+0+0 (secure 0 0 0) 0x7f701c0b8de0 con 0x7f702415a370 2024-09-17T02:58:09.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.829+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=72}) -- 0x7f7010080fb0 con 0x7f702415a370 2024-09-17T02:58:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.947+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f702406ee70 con 0x7f702415a370 2024-09-17T02:58:09.946 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:58:09.948+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T02:58:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.950+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) ==== 161+0+0 (secure 0 0 0) 0x7f701c082620 con 0x7f702415a370 2024-09-17T02:58:09.948 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T02:58:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.951+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 <== mon.0 v2:172.21.15.104:3300/0 9 ==== osd_map(72..72 src has 1..72) ==== 382+0+0 (secure 0 0 0) 0x7f701c07e890 con 0x7f702415a370 2024-09-17T02:58:09.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.951+0000 7f700b7fe640 1 -- 172.21.15.104:0/3494216986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=73}) -- 0x7f7010081100 con 0x7f702415a370 2024-09-17T02:58:09.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.954+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7010078bc0 msgr2=0x7f701007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.954+0000 7f702944d640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7010078bc0 0x7f701007b0d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f701400db30 tx=0x7f701400d2e0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.954+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f702415a370 msgr2=0x7f702415a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:09.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.954+0000 7f702944d640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f702415a370 0x7f702415a780 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f701c001330 tx=0x7f701c00c2d0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.955+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 shutdown_connections 2024-09-17T02:58:09.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.955+0000 7f702944d640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7010078bc0 0x7f701007b0d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.955+0000 7f702944d640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70240ccbc0 0x7f70240ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.955+0000 7f702944d640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f702415a370 0x7f702415a780 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.955+0000 7f702944d640 1 --2- 172.21.15.104:0/3494216986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f700c006410 0x7f70241f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:09.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.955+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 >> 172.21.15.104:0/3494216986 conn(0x7f70240b3440 msgr2=0x7f702414dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:09.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.955+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 shutdown_connections 2024-09-17T02:58:09.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:09.955+0000 7f702944d640 1 -- 172.21.15.104:0/3494216986 wait complete. 2024-09-17T02:58:09.966 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T02:58:10.013 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:58:10.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.083+0000 7fa01355e640 1 -- 172.21.15.104:0/2400565442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c0734f0 msgr2=0x7fa00c073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:10.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.083+0000 7fa01355e640 1 --2- 172.21.15.104:0/2400565442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c0734f0 0x7fa00c073900 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa00c0d21a0 tx=0x7f9ffc02a560 comp rx=0 tx=0).stop 2024-09-17T02:58:10.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.083+0000 7fa01355e640 1 -- 172.21.15.104:0/2400565442 shutdown_connections 2024-09-17T02:58:10.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.083+0000 7fa01355e640 1 --2- 172.21.15.104:0/2400565442 >> v2:172.21.15.192:3300/0 conn(0x7fa00c0b0500 0x7fa00c0b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:10.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.083+0000 7fa01355e640 1 --2- 172.21.15.104:0/2400565442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c0734f0 0x7fa00c073900 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:10.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.083+0000 7fa01355e640 1 -- 172.21.15.104:0/2400565442 >> 172.21.15.104:0/2400565442 conn(0x7fa00c06d200 msgr2=0x7fa00c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:10.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.083+0000 7fa01355e640 1 -- 172.21.15.104:0/2400565442 shutdown_connections 2024-09-17T02:58:10.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.083+0000 7fa01355e640 1 -- 172.21.15.104:0/2400565442 wait complete. 2024-09-17T02:58:10.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.085+0000 7fa01355e640 1 Processor -- start 2024-09-17T02:58:10.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.085+0000 7fa01355e640 1 -- start start 2024-09-17T02:58:10.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa01355e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa00c0734f0 0x7fa00c14bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:10.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa01355e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa00c0b0500 0x7fa00c1f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa01355e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c15c220 0x7fa00c1f8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa01355e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c0b4f20 con 0x7fa00c15c220 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa01355e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c0b1200 con 0x7fa00c0734f0 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa01355e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c0b50a0 con 0x7fa00c0b0500 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c15c220 0x7fa00c1f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c15c220 0x7fa00c1f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43024/0 (socket says 172.21.15.104:43024) 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 -- 172.21.15.104:0/1495978194 learned_addr learned my addr 172.21.15.104:0/1495978194 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa010af9640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa00c0b0500 0x7fa00c1f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa0112fa640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa00c0734f0 0x7fa00c14bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 -- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa00c0b0500 msgr2=0x7fa00c1f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa00c0b0500 0x7fa00c1f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:10.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 -- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa00c0734f0 msgr2=0x7fa00c14bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa00c0734f0 0x7fa00c14bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 -- 172.21.15.104:0/1495978194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c157830 con 0x7fa00c15c220 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa010af9640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa00c0b0500 0x7fa00c1f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa011afb640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c15c220 0x7fa00c1f8110 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa00400cae0 tx=0x7fa004007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa001ffb640 1 -- 172.21.15.104:0/1495978194 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004007da0 con 0x7fa00c15c220 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa001ffb640 1 -- 172.21.15.104:0/1495978194 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa004004c30 con 0x7fa00c15c220 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa001ffb640 1 -- 172.21.15.104:0/1495978194 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004005280 con 0x7fa00c15c220 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.087+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c14e850 con 0x7fa00c15c220 2024-09-17T02:58:10.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.088+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c159040 con 0x7fa00c15c220 2024-09-17T02:58:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.089+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00c073900 con 0x7fa00c15c220 2024-09-17T02:58:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.089+0000 7fa001ffb640 1 -- 172.21.15.104:0/1495978194 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa004005420 con 0x7fa00c15c220 2024-09-17T02:58:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.090+0000 7fa001ffb640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ff0078b90 0x7f9ff007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.090+0000 7fa001ffb640 1 -- 172.21.15.104:0/1495978194 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7fa00409b690 con 0x7fa00c15c220 2024-09-17T02:58:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.090+0000 7fa001ffb640 1 -- 172.21.15.104:0/1495978194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=73}) -- 0x7f9ff0080820 con 0x7fa00c15c220 2024-09-17T02:58:10.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.090+0000 7fa0112fa640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ff0078b90 0x7f9ff007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:10.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.091+0000 7fa0112fa640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ff0078b90 0x7f9ff007b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa008006fd0 tx=0x7fa008008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:10.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.094+0000 7fa001ffb640 1 -- 172.21.15.104:0/1495978194 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa004014070 con 0x7fa00c15c220 2024-09-17T02:58:10.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.308+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa00c14e5e0 con 0x7fa00c15c220 2024-09-17T02:58:10.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.951+0000 7fa001ffb640 1 -- 172.21.15.104:0/1495978194 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7fa004063b90 con 0x7fa00c15c220 2024-09-17T02:58:10.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ff0078b90 msgr2=0x7f9ff007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:10.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ff0078b90 0x7f9ff007b0a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa008006fd0 tx=0x7fa008008040 comp rx=0 tx=0).stop 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c15c220 msgr2=0x7fa00c1f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c15c220 0x7fa00c1f8110 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa00400cae0 tx=0x7fa004007220 comp rx=0 tx=0).stop 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 shutdown_connections 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ff0078b90 0x7f9ff007b0a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa00c15c220 0x7fa00c1f8110 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa00c0b0500 0x7fa00c1f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 --2- 172.21.15.104:0/1495978194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa00c0734f0 0x7fa00c14bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.954+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 >> 172.21.15.104:0/1495978194 conn(0x7fa00c06d200 msgr2=0x7fa00c06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.955+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 shutdown_connections 2024-09-17T02:58:10.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:10.955+0000 7fa01355e640 1 -- 172.21.15.104:0/1495978194 wait complete. 2024-09-17T02:58:10.966 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T02:58:11.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.088+0000 7f41a67fc640 1 -- 172.21.15.104:0/2536506466 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c031bf0 con 0x7f41a80d1c30 2024-09-17T02:58:11.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.089+0000 7f41adb94640 1 -- 172.21.15.104:0/2536506466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a80d1c30 msgr2=0x7f41a80d2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.089+0000 7f41adb94640 1 --2- 172.21.15.104:0/2536506466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a80d1c30 0x7f41a80d2040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f419c009830 tx=0x7f419c02a510 comp rx=0 tx=0).stop 2024-09-17T02:58:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.089+0000 7f41adb94640 1 -- 172.21.15.104:0/2536506466 shutdown_connections 2024-09-17T02:58:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.089+0000 7f41adb94640 1 --2- 172.21.15.104:0/2536506466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a80d1c30 0x7f41a80d2040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.089+0000 7f41adb94640 1 --2- 172.21.15.104:0/2536506466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a815d2a0 0x7f41a80cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.089+0000 7f41adb94640 1 -- 172.21.15.104:0/2536506466 >> 172.21.15.104:0/2536506466 conn(0x7f41a8068ee0 msgr2=0x7f41a80692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.089+0000 7f41adb94640 1 -- 172.21.15.104:0/2536506466 shutdown_connections 2024-09-17T02:58:11.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.089+0000 7f41adb94640 1 -- 172.21.15.104:0/2536506466 wait complete. 2024-09-17T02:58:11.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.091+0000 7f41adb94640 1 Processor -- start 2024-09-17T02:58:11.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.091+0000 7f41adb94640 1 -- start start 2024-09-17T02:58:11.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41adb94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a806cde0 0x7f41a815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41adb94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a80d1c30 0x7f41a81461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41adb94640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a815d2a0 0x7f41a8159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41adb94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80708a0 con 0x7f41a80d1c30 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41adb94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8070720 con 0x7f41a806cde0 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41adb94640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f41a8070a20 con 0x7f41a815d2a0 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41a6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a80d1c30 0x7f41a81461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41a6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a80d1c30 0x7f41a81461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43032/0 (socket says 172.21.15.104:43032) 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41a6ffd640 1 -- 172.21.15.104:0/4108652873 learned_addr learned my addr 172.21.15.104:0/4108652873 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41a77fe640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a806cde0 0x7f41a815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.092+0000 7f41a7fff640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a815d2a0 0x7f41a8159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f41a6ffd640 1 -- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a815d2a0 msgr2=0x7f41a8159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:11.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f41a6ffd640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a815d2a0 0x7f41a8159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f41a6ffd640 1 -- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a806cde0 msgr2=0x7f41a815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f41a6ffd640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a806cde0 0x7f41a815b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f41a6ffd640 1 -- 172.21.15.104:0/4108652873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a814fe40 con 0x7f41a80d1c30 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f41a6ffd640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a80d1c30 0x7f41a81461e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f419c02ab00 tx=0x7f419c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c031d60 con 0x7f41a80d1c30 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f419c033e10 con 0x7f41a80d1c30 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a815bc00 con 0x7f41a80d1c30 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c005260 con 0x7f41a80d1c30 2024-09-17T02:58:11.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.093+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a815c1c0 con 0x7f41a80d1c30 2024-09-17T02:58:11.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.094+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a815b970 con 0x7f41a80d1c30 2024-09-17T02:58:11.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.095+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f419c005400 con 0x7f41a80d1c30 2024-09-17T02:58:11.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.095+0000 7f418ffff640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4194078bc0 0x7f419407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:11.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.096+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5795+0+0 (secure 0 0 0) 0x7f419c0bbe20 con 0x7f41a80d1c30 2024-09-17T02:58:11.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.096+0000 7f41a77fe640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4194078bc0 0x7f419407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:11.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.096+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=73}) -- 0x7f4194080850 con 0x7f41a80d1c30 2024-09-17T02:58:11.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.096+0000 7f41a77fe640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4194078bc0 0x7f419407b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4198009590 tx=0x7f4198005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:11.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.100+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f419c03f030 con 0x7f41a80d1c30 2024-09-17T02:58:11.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.272+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f41a806db30 con 0x7f41a80d1c30 2024-09-17T02:58:11.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.958+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) ==== 181+0+0 (secure 0 0 0) 0x7f419c083b30 con 0x7f41a80d1c30 2024-09-17T02:58:11.957 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T02:58:11.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.958+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(73..73 src has 1..73) ==== 304+0+0 (secure 0 0 0) 0x7f419c0ba400 con 0x7f41a80d1c30 2024-09-17T02:58:11.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.958+0000 7f418ffff640 1 -- 172.21.15.104:0/4108652873 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=74}) -- 0x7f419407ec80 con 0x7f41a80d1c30 2024-09-17T02:58:11.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4194078bc0 msgr2=0x7f419407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:11.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4194078bc0 0x7f419407b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4198009590 tx=0x7f4198005f30 comp rx=0 tx=0).stop 2024-09-17T02:58:11.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a80d1c30 msgr2=0x7f41a81461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:11.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a80d1c30 0x7f41a81461e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f419c02ab00 tx=0x7f419c033c20 comp rx=0 tx=0).stop 2024-09-17T02:58:11.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 shutdown_connections 2024-09-17T02:58:11.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4194078bc0 0x7f419407b0d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:11.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a815d2a0 0x7f41a8159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:11.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a80d1c30 0x7f41a81461e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:11.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 --2- 172.21.15.104:0/4108652873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a806cde0 0x7f41a815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:11.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 >> 172.21.15.104:0/4108652873 conn(0x7f41a8068ee0 msgr2=0x7f41a815c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:11.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 shutdown_connections 2024-09-17T02:58:11.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:11.967+0000 7f41adb94640 1 -- 172.21.15.104:0/4108652873 wait complete. 2024-09-17T02:58:11.978 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T02:58:12.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.099+0000 7fec5744d640 1 -- 172.21.15.104:0/652651926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec50070420 msgr2=0x7fec500737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:12.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.099+0000 7fec5744d640 1 --2- 172.21.15.104:0/652651926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec50070420 0x7fec500737c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fec500720a0 tx=0x7fec4802a8b0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.099+0000 7fec5744d640 1 -- 172.21.15.104:0/652651926 shutdown_connections 2024-09-17T02:58:12.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.099+0000 7fec5744d640 1 --2- 172.21.15.104:0/652651926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec50070420 0x7fec500737c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.099+0000 7fec5744d640 1 --2- 172.21.15.104:0/652651926 >> v2:172.21.15.192:3300/0 conn(0x7fec501455f0 0x7fec500b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.099+0000 7fec5744d640 1 -- 172.21.15.104:0/652651926 >> 172.21.15.104:0/652651926 conn(0x7fec50069610 msgr2=0x7fec500b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:12.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.099+0000 7fec5744d640 1 -- 172.21.15.104:0/652651926 shutdown_connections 2024-09-17T02:58:12.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.099+0000 7fec5744d640 1 -- 172.21.15.104:0/652651926 wait complete. 2024-09-17T02:58:12.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.101+0000 7fec5744d640 1 Processor -- start 2024-09-17T02:58:12.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.101+0000 7fec5744d640 1 -- start start 2024-09-17T02:58:12.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.102+0000 7fec5744d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec500b50b0 0x7fec50143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:12.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.102+0000 7fec5744d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec501455f0 0x7fec501e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:12.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.102+0000 7fec5744d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec501444d0 0x7fec501e6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:12.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.102+0000 7fec5744d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fec500741a0 con 0x7fec501455f0 2024-09-17T02:58:12.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.102+0000 7fec5744d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec50074020 con 0x7fec501444d0 2024-09-17T02:58:12.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.102+0000 7fec5744d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fec50074320 con 0x7fec500b50b0 2024-09-17T02:58:12.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec501455f0 0x7fec501e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:12.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec501455f0 0x7fec501e64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43050/0 (socket says 172.21.15.104:43050) 2024-09-17T02:58:12.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 -- 172.21.15.104:0/55815432 learned_addr learned my addr 172.21.15.104:0/55815432 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:12.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec559ea640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec501444d0 0x7fec501e6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:12.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 -- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec500b50b0 msgr2=0x7fec50143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:12.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec551e9640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec500b50b0 0x7fec50143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:12.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec500b50b0 0x7fec50143f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 -- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec501444d0 msgr2=0x7fec501e6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:12.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec501444d0 0x7fec501e6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 -- 172.21.15.104:0/55815432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec501f5b50 con 0x7fec501455f0 2024-09-17T02:58:12.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec549e8640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec501455f0 0x7fec501e64e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fec4000c3a0 tx=0x7fec4000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:12.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec40017070 con 0x7fec501455f0 2024-09-17T02:58:12.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec400035f0 con 0x7fec501455f0 2024-09-17T02:58:12.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec40003a40 con 0x7fec501455f0 2024-09-17T02:58:12.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec501f5e30 con 0x7fec501455f0 2024-09-17T02:58:12.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.103+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501f63f0 con 0x7fec501455f0 2024-09-17T02:58:12.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.104+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec500747d0 con 0x7fec501455f0 2024-09-17T02:58:12.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.105+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec4001a070 con 0x7fec501455f0 2024-09-17T02:58:12.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.105+0000 7fec45ffb640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec34078b90 0x7fec3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:12.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.106+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5357+0+0 (secure 0 0 0) 0x7fec40099ed0 con 0x7fec501455f0 2024-09-17T02:58:12.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.106+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=74}) -- 0x7fec3407fa10 con 0x7fec501455f0 2024-09-17T02:58:12.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.106+0000 7fec551e9640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec34078b90 0x7fec3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:12.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.106+0000 7fec551e9640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec34078b90 0x7fec3407b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00b9a0 tx=0x7fec4c005c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:12.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.110+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec40062470 con 0x7fec501455f0 2024-09-17T02:58:12.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.284+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec5006a480 con 0x7fec501455f0 2024-09-17T02:58:12.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.960+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) ==== 169+0+0 (secure 0 0 0) 0x7fec40061d70 con 0x7fec501455f0 2024-09-17T02:58:12.959 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T02:58:12.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.961+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(74..74 src has 1..74) ==== 296+0+0 (secure 0 0 0) 0x7fec40098670 con 0x7fec501455f0 2024-09-17T02:58:12.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.961+0000 7fec45ffb640 1 -- 172.21.15.104:0/55815432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=75}) -- 0x7fec3407e7a0 con 0x7fec501455f0 2024-09-17T02:58:12.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.965+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec34078b90 msgr2=0x7fec3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:12.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.965+0000 7fec5744d640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec34078b90 0x7fec3407b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fec4c00b9a0 tx=0x7fec4c005c20 comp rx=0 tx=0).stop 2024-09-17T02:58:12.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.965+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec501455f0 msgr2=0x7fec501e64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:12.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.965+0000 7fec5744d640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec501455f0 0x7fec501e64e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fec4000c3a0 tx=0x7fec4000c860 comp rx=0 tx=0).stop 2024-09-17T02:58:12.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.968+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 shutdown_connections 2024-09-17T02:58:12.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.968+0000 7fec5744d640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec34078b90 0x7fec3407b0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.968+0000 7fec5744d640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec501444d0 0x7fec501e6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.968+0000 7fec5744d640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec501455f0 0x7fec501e64e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.968+0000 7fec5744d640 1 --2- 172.21.15.104:0/55815432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec500b50b0 0x7fec50143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:12.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.968+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 >> 172.21.15.104:0/55815432 conn(0x7fec50069610 msgr2=0x7fec501e7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:12.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.971+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 shutdown_connections 2024-09-17T02:58:12.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:12.971+0000 7fec5744d640 1 -- 172.21.15.104:0/55815432 wait complete. 2024-09-17T02:58:12.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T02:58:13.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.100+0000 7f8a0b49b640 1 -- 172.21.15.104:0/1501783115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d13e0 msgr2=0x7f8a041615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.100+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/1501783115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d13e0 0x7f8a041615d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f89fc005fd0 tx=0x7f89fc02a9e0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.100+0000 7f8a0b49b640 1 -- 172.21.15.104:0/1501783115 shutdown_connections 2024-09-17T02:58:13.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.100+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/1501783115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d13e0 0x7f8a041615d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.100+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/1501783115 >> v2:172.21.15.192:3300/0 conn(0x7f8a040d3490 0x7f8a040b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.100+0000 7f8a0b49b640 1 -- 172.21.15.104:0/1501783115 >> 172.21.15.104:0/1501783115 conn(0x7f8a040d2970 msgr2=0x7f8a040d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:13.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.100+0000 7f8a0b49b640 1 -- 172.21.15.104:0/1501783115 shutdown_connections 2024-09-17T02:58:13.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.100+0000 7f8a0b49b640 1 -- 172.21.15.104:0/1501783115 wait complete. 2024-09-17T02:58:13.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.102+0000 7f8a0b49b640 1 Processor -- start 2024-09-17T02:58:13.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.102+0000 7f8a0b49b640 1 -- start start 2024-09-17T02:58:13.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.103+0000 7f8a0b49b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a040d0fd0 0x7f8a040ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:13.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.103+0000 7f8a0b49b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a040d13e0 0x7f8a041604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:13.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.103+0000 7f8a0b49b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d3490 0x7f8a04150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:13.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.103+0000 7f8a0b49b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8a040b6bd0 con 0x7f8a040d3490 2024-09-17T02:58:13.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.103+0000 7f8a0b49b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a040b6a50 con 0x7f8a040d13e0 2024-09-17T02:58:13.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.103+0000 7f8a0b49b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8a040b6d50 con 0x7f8a040d0fd0 2024-09-17T02:58:13.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d3490 0x7f8a04150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:13.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d3490 0x7f8a04150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43070/0 (socket says 172.21.15.104:43070) 2024-09-17T02:58:13.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 -- 172.21.15.104:0/4220718043 learned_addr learned my addr 172.21.15.104:0/4220718043 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:13.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09237640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a040d0fd0 0x7f8a040ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:13.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a08a36640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a040d13e0 0x7f8a041604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:13.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 -- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a040d0fd0 msgr2=0x7f8a040ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a040d0fd0 0x7f8a040ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 -- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a040d13e0 msgr2=0x7f8a041604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a040d13e0 0x7f8a041604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 -- 172.21.15.104:0/4220718043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a040c99e0 con 0x7f8a040d3490 2024-09-17T02:58:13.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a08a36640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a040d13e0 0x7f8a041604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:13.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09237640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a040d0fd0 0x7f8a040ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:13.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a09a38640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d3490 0x7f8a04150b30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009d90 tx=0x7f89fc0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:13.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f89f9ffb640 1 -- 172.21.15.104:0/4220718043 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc033050 con 0x7f8a040d3490 2024-09-17T02:58:13.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f89f9ffb640 1 -- 172.21.15.104:0/4220718043 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89fc004450 con 0x7f8a040d3490 2024-09-17T02:58:13.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f89f9ffb640 1 -- 172.21.15.104:0/4220718043 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc004820 con 0x7f8a040d3490 2024-09-17T02:58:13.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a040c9c80 con 0x7f8a040d3490 2024-09-17T02:58:13.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.104+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a040ca240 con 0x7f8a040d3490 2024-09-17T02:58:13.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.105+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a040b7c80 con 0x7f8a040d3490 2024-09-17T02:58:13.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.106+0000 7f89f9ffb640 1 -- 172.21.15.104:0/4220718043 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f89fc036070 con 0x7f8a040d3490 2024-09-17T02:58:13.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.106+0000 7f89f9ffb640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f89e8078b90 0x7f89e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:13.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.107+0000 7f89f9ffb640 1 -- 172.21.15.104:0/4220718043 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7f89fc0bbc10 con 0x7f8a040d3490 2024-09-17T02:58:13.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.107+0000 7f89f9ffb640 1 -- 172.21.15.104:0/4220718043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=75}) -- 0x7f89e807e3d0 con 0x7f8a040d3490 2024-09-17T02:58:13.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.107+0000 7f8a09237640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f89e8078b90 0x7f89e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:13.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.107+0000 7f8a09237640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f89e8078b90 0x7f89e807b0a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009aa0 tx=0x7f8a00005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:13.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.111+0000 7f89f9ffb640 1 -- 172.21.15.104:0/4220718043 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89fc0843e0 con 0x7f8a040d3490 2024-09-17T02:58:13.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.284+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f8a04160c50 con 0x7f8a040d3490 2024-09-17T02:58:13.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.288+0000 7f89f9ffb640 1 -- 172.21.15.104:0/4220718043 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7f89fc083ce0 con 0x7f8a040d3490 2024-09-17T02:58:13.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f89e8078b90 msgr2=0x7f89e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f89e8078b90 0x7f89e807b0a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009aa0 tx=0x7f8a00005db0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d3490 msgr2=0x7f8a04150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d3490 0x7f8a04150b30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009d90 tx=0x7f89fc0093d0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 shutdown_connections 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f89e8078b90 0x7f89e807b0a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a040d13e0 0x7f8a041604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a040d3490 0x7f8a04150b30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 --2- 172.21.15.104:0/4220718043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a040d0fd0 0x7f8a040ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.290+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 >> 172.21.15.104:0/4220718043 conn(0x7f8a040d2970 msgr2=0x7f8a040b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.291+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 shutdown_connections 2024-09-17T02:58:13.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.291+0000 7f8a0b49b640 1 -- 172.21.15.104:0/4220718043 wait complete. 2024-09-17T02:58:13.301 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-17T02:58:13.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.414+0000 7ff423812640 1 -- 172.21.15.104:0/1330020018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff408003a50 msgr2=0x7ff408003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.414+0000 7ff423812640 1 --2- 172.21.15.104:0/1330020018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff408003a50 0x7ff408003ec0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff418001e00 tx=0x7ff408005830 comp rx=0 tx=0).stop 2024-09-17T02:58:13.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.414+0000 7ff423812640 1 -- 172.21.15.104:0/1330020018 shutdown_connections 2024-09-17T02:58:13.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.414+0000 7ff423812640 1 --2- 172.21.15.104:0/1330020018 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff408003a50 0x7ff408003ec0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.414+0000 7ff423812640 1 -- 172.21.15.104:0/1330020018 >> 172.21.15.104:0/1330020018 conn(0x7ff41c0d28a0 msgr2=0x7ff41c0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:13.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.415+0000 7ff423812640 1 -- 172.21.15.104:0/1330020018 shutdown_connections 2024-09-17T02:58:13.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.415+0000 7ff423812640 1 -- 172.21.15.104:0/1330020018 wait complete. 2024-09-17T02:58:13.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.416+0000 7ff423812640 1 Processor -- start 2024-09-17T02:58:13.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.416+0000 7ff423812640 1 -- start start 2024-09-17T02:58:13.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff423812640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff408003a50 0x7ff41c1e83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:13.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff423812640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff41c1e8930 0x7ff41c09fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff423812640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff41c1ded60 0x7ff41c0a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff423812640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c0ce010 con 0x7ff41c1ded60 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff423812640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c0cde90 con 0x7ff408003a50 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff423812640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c0ce190 con 0x7ff41c1e8930 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff41c1ded60 0x7ff41c0a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff41c1ded60 0x7ff41c0a0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43084/0 (socket says 172.21.15.104:43084) 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 -- 172.21.15.104:0/3684058124 learned_addr learned my addr 172.21.15.104:0/3684058124 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff420dad640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff41c1e8930 0x7ff41c09fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff4215ae640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff408003a50 0x7ff41c1e83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 -- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff41c1e8930 msgr2=0x7ff41c09fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff41c1e8930 0x7ff41c09fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 -- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff408003a50 msgr2=0x7ff41c1e83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff408003a50 0x7ff41c1e83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 -- 172.21.15.104:0/3684058124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c1e2eb0 con 0x7ff41c1ded60 2024-09-17T02:58:13.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff421daf640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff41c1ded60 0x7ff41c0a0050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0d2110 tx=0x7ff414011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:13.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff411ffb640 1 -- 172.21.15.104:0/3684058124 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414004240 con 0x7ff41c1ded60 2024-09-17T02:58:13.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff411ffb640 1 -- 172.21.15.104:0/3684058124 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff414016070 con 0x7ff41c1ded60 2024-09-17T02:58:13.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c1e8de0 con 0x7ff41c1ded60 2024-09-17T02:58:13.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.418+0000 7ff411ffb640 1 -- 172.21.15.104:0/3684058124 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41400fa90 con 0x7ff41c1ded60 2024-09-17T02:58:13.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.419+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c1dfc50 con 0x7ff41c1ded60 2024-09-17T02:58:13.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.420+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41c0d09f0 con 0x7ff41c1ded60 2024-09-17T02:58:13.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.420+0000 7ff411ffb640 1 -- 172.21.15.104:0/3684058124 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff41400fc30 con 0x7ff41c1ded60 2024-09-17T02:58:13.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.421+0000 7ff411ffb640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff400078b90 0x7ff40007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:13.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.421+0000 7ff411ffb640 1 -- 172.21.15.104:0/3684058124 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7ff41409b230 con 0x7ff41c1ded60 2024-09-17T02:58:13.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.421+0000 7ff411ffb640 1 -- 172.21.15.104:0/3684058124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=75}) -- 0x7ff40007e3d0 con 0x7ff41c1ded60 2024-09-17T02:58:13.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.421+0000 7ff4215ae640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff400078b90 0x7ff40007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:13.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.422+0000 7ff4215ae640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff400078b90 0x7ff40007b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff418032000 tx=0x7ff418001560 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:13.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.425+0000 7ff411ffb640 1 -- 172.21.15.104:0/3684058124 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff41c1e8de0 con 0x7ff41c1ded60 2024-09-17T02:58:13.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.665+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7ff41c0d12d0 con 0x7ff41c1ded60 2024-09-17T02:58:13.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.961+0000 7ff411ffb640 1 -- 172.21.15.104:0/3684058124 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v185) ==== 134+0+0 (secure 0 0 0) 0x7ff414063440 con 0x7ff41c1ded60 2024-09-17T02:58:13.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff400078b90 msgr2=0x7ff40007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff400078b90 0x7ff40007b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff418032000 tx=0x7ff418001560 comp rx=0 tx=0).stop 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff41c1ded60 msgr2=0x7ff41c0a0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff41c1ded60 0x7ff41c0a0050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0d2110 tx=0x7ff414011b30 comp rx=0 tx=0).stop 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 shutdown_connections 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff400078b90 0x7ff40007b0a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff41c1ded60 0x7ff41c0a0050 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff41c1e8930 0x7ff41c09fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 --2- 172.21.15.104:0/3684058124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff408003a50 0x7ff41c1e83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 >> 172.21.15.104:0/3684058124 conn(0x7ff41c0d28a0 msgr2=0x7ff41c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 shutdown_connections 2024-09-17T02:58:13.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:13.964+0000 7ff423812640 1 -- 172.21.15.104:0/3684058124 wait complete. 2024-09-17T02:58:13.974 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-17T02:58:13.974 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2024-09-17T02:58:13.974 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2024-09-17T02:58:13.975 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:58:14.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.087+0000 7fa089025640 1 -- 172.21.15.104:0/2225764435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840734f0 msgr2=0x7fa084073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.087+0000 7fa089025640 1 --2- 172.21.15.104:0/2225764435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840734f0 0x7fa084073900 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa084072420 tx=0x7fa06c02a5f0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.087+0000 7fa089025640 1 -- 172.21.15.104:0/2225764435 shutdown_connections 2024-09-17T02:58:14.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.087+0000 7fa089025640 1 --2- 172.21.15.104:0/2225764435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840734f0 0x7fa084073900 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.087+0000 7fa089025640 1 --2- 172.21.15.104:0/2225764435 >> v2:172.21.15.192:3300/0 conn(0x7fa08415c220 0x7fa08406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.087+0000 7fa089025640 1 -- 172.21.15.104:0/2225764435 >> 172.21.15.104:0/2225764435 conn(0x7fa08406d200 msgr2=0x7fa08406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:14.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.088+0000 7fa089025640 1 -- 172.21.15.104:0/2225764435 shutdown_connections 2024-09-17T02:58:14.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.088+0000 7fa089025640 1 -- 172.21.15.104:0/2225764435 wait complete. 2024-09-17T02:58:14.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.089+0000 7fa089025640 1 Processor -- start 2024-09-17T02:58:14.088 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.090+0000 7fa089025640 1 -- start start 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa089025640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840734f0 0x7fa084068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa089025640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840b0500 0x7fa084069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa089025640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa08415c220 0x7fa0840aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa089025640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa0840b4f20 con 0x7fa0840b0500 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa089025640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa0840b1230 con 0x7fa08415c220 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa089025640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa0840b50a0 con 0x7fa0840734f0 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa07a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840b0500 0x7fa084069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa07a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840b0500 0x7fa084069240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33746/0 (socket says 172.21.15.104:33746) 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa07a59c640 1 -- 172.21.15.104:0/1560710694 learned_addr learned my addr 172.21.15.104:0/1560710694 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa082d9d640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840734f0 0x7fa084068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa08359e640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa08415c220 0x7fa0840aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa07a59c640 1 -- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840734f0 msgr2=0x7fa084068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa07a59c640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840734f0 0x7fa084068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa07a59c640 1 -- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa08415c220 msgr2=0x7fa0840aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa07a59c640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa08415c220 0x7fa0840aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa07a59c640 1 -- 172.21.15.104:0/1560710694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08414c5a0 con 0x7fa0840b0500 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa082d9d640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840734f0 0x7fa084068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.091+0000 7fa08359e640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa08415c220 0x7fa0840aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.092+0000 7fa07a59c640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840b0500 0x7fa084069240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa06c034040 tx=0x7fa06c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.092+0000 7fa07bfff640 1 -- 172.21.15.104:0/1560710694 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c03e030 con 0x7fa0840b0500 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.092+0000 7fa07bfff640 1 -- 172.21.15.104:0/1560710694 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa06c0047a0 con 0x7fa0840b0500 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.092+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08414c880 con 0x7fa0840b0500 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.092+0000 7fa07bfff640 1 -- 172.21.15.104:0/1560710694 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c035040 con 0x7fa0840b0500 2024-09-17T02:58:14.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.092+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08414ce40 con 0x7fa0840b0500 2024-09-17T02:58:14.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.093+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08414c310 con 0x7fa0840b0500 2024-09-17T02:58:14.093 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.094+0000 7fa07bfff640 1 -- 172.21.15.104:0/1560710694 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa06c041030 con 0x7fa0840b0500 2024-09-17T02:58:14.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.094+0000 7fa07bfff640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa064078bc0 0x7fa06407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.094+0000 7fa07bfff640 1 -- 172.21.15.104:0/1560710694 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 4943+0+0 (secure 0 0 0) 0x7fa06c0bb1c0 con 0x7fa0840b0500 2024-09-17T02:58:14.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.094+0000 7fa082d9d640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa064078bc0 0x7fa06407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.095+0000 7fa07bfff640 1 -- 172.21.15.104:0/1560710694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=75}) -- 0x7fa06407e400 con 0x7fa0840b0500 2024-09-17T02:58:14.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.095+0000 7fa082d9d640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa064078bc0 0x7fa06407b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa074009aa0 tx=0x7fa074005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:14.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.099+0000 7fa07bfff640 1 -- 172.21.15.104:0/1560710694 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa06c083910 con 0x7fa0840b0500 2024-09-17T02:58:14.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.273+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa084160520 con 0x7fa0840b0500 2024-09-17T02:58:14.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.274+0000 7fa07bfff640 1 -- 172.21.15.104:0/1560710694 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+13094 (secure 0 0 0) 0x7fa084160520 con 0x7fa0840b0500 2024-09-17T02:58:14.272 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:14.273 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":74,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:58:12.958706+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/1457390445":"2024-09-18T02:58:09.948535+0000","172.21.15.104:6834/1457390445":"2024-09-18T02:58:09.948535+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa064078bc0 msgr2=0x7fa06407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa064078bc0 0x7fa06407b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa074009aa0 tx=0x7fa074005db0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840b0500 msgr2=0x7fa084069240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840b0500 0x7fa084069240 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa06c034040 tx=0x7fa06c0039e0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 shutdown_connections 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa064078bc0 0x7fa06407b0d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa08415c220 0x7fa0840aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0840b0500 0x7fa084069240 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 --2- 172.21.15.104:0/1560710694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840734f0 0x7fa084068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 >> 172.21.15.104:0/1560710694 conn(0x7fa08406d200 msgr2=0x7fa08406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:14.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 shutdown_connections 2024-09-17T02:58:14.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.276+0000 7fa089025640 1 -- 172.21.15.104:0/1560710694 wait complete. 2024-09-17T02:58:14.286 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T02:58:14.287 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T02:58:14.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.404+0000 7f36b2e4d640 1 -- 172.21.15.104:0/3332298171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac0cb2c0 msgr2=0x7f36ac0cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.404+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/3332298171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac0cb2c0 0x7f36ac0cb6d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f36ac072090 tx=0x7f36a402a980 comp rx=0 tx=0).stop 2024-09-17T02:58:14.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.404+0000 7f36b2e4d640 1 -- 172.21.15.104:0/3332298171 shutdown_connections 2024-09-17T02:58:14.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.404+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/3332298171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac0cb2c0 0x7f36ac0cb6d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.404+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/3332298171 >> v2:172.21.15.192:3300/0 conn(0x7f36ac145790 0x7f36ac0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.404+0000 7f36b2e4d640 1 -- 172.21.15.104:0/3332298171 >> 172.21.15.104:0/3332298171 conn(0x7f36ac0cd580 msgr2=0x7f36ac0cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:14.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.404+0000 7f36b2e4d640 1 -- 172.21.15.104:0/3332298171 shutdown_connections 2024-09-17T02:58:14.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.404+0000 7f36b2e4d640 1 -- 172.21.15.104:0/3332298171 wait complete. 2024-09-17T02:58:14.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.406+0000 7f36b2e4d640 1 Processor -- start 2024-09-17T02:58:14.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.406+0000 7f36b2e4d640 1 -- start start 2024-09-17T02:58:14.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b2e4d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ac0c6990 0x7f36ac0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b2e4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ac0cb2c0 0x7f36ac0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b2e4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac145790 0x7f36ac1f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b2e4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac0cbd90 con 0x7f36ac145790 2024-09-17T02:58:14.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b2e4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac0cbc10 con 0x7f36ac0cb2c0 2024-09-17T02:58:14.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b2e4d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f36ac0cbf10 con 0x7f36ac0c6990 2024-09-17T02:58:14.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b13ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac145790 0x7f36ac1f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b13ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac145790 0x7f36ac1f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33770/0 (socket says 172.21.15.104:33770) 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.407+0000 7f36b13ea640 1 -- 172.21.15.104:0/4040617105 learned_addr learned my addr 172.21.15.104:0/4040617105 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36a3fff640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ac0cb2c0 0x7f36ac0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b0be9640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ac0c6990 0x7f36ac0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b13ea640 1 -- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ac0c6990 msgr2=0x7f36ac0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b13ea640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ac0c6990 0x7f36ac0c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b13ea640 1 -- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ac0cb2c0 msgr2=0x7f36ac0c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b13ea640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ac0cb2c0 0x7f36ac0c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b13ea640 1 -- 172.21.15.104:0/4040617105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac13d310 con 0x7f36ac145790 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36a3fff640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ac0cb2c0 0x7f36ac0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b0be9640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ac0c6990 0x7f36ac0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b13ea640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac145790 0x7f36ac1f4eb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009d60 tx=0x7f36a4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36a17fa640 1 -- 172.21.15.104:0/4040617105 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4034040 con 0x7f36ac145790 2024-09-17T02:58:14.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36a17fa640 1 -- 172.21.15.104:0/4040617105 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a40046e0 con 0x7f36ac145790 2024-09-17T02:58:14.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac0c8220 con 0x7f36ac145790 2024-09-17T02:58:14.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36a17fa640 1 -- 172.21.15.104:0/4040617105 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a40456e0 con 0x7f36ac145790 2024-09-17T02:58:14.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.408+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac0c87e0 con 0x7f36ac145790 2024-09-17T02:58:14.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.409+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac0cc430 con 0x7f36ac145790 2024-09-17T02:58:14.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.410+0000 7f36a17fa640 1 -- 172.21.15.104:0/4040617105 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36a4037020 con 0x7f36ac145790 2024-09-17T02:58:14.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.410+0000 7f36a17fa640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.410+0000 7f36a17fa640 1 -- 172.21.15.104:0/4040617105 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4943+0+0 (secure 0 0 0) 0x7f36a40bc380 con 0x7f36ac145790 2024-09-17T02:58:14.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.411+0000 7f36b0be9640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.411+0000 7f36b0be9640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3698078b90 0x7f369807b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36a80058c0 tx=0x7f36a8005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:14.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.415+0000 7f36a17fa640 1 -- 172.21.15.104:0/4040617105 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36a4084500 con 0x7f36ac145790 2024-09-17T02:58:14.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.595+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f36ac070940 con 0x7f36ac145790 2024-09-17T02:58:14.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.595+0000 7f36a17fa640 1 -- 172.21.15.104:0/4040617105 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f36a4088f30 con 0x7f36ac145790 2024-09-17T02:58:14.594 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T02:58:14.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3698078b90 msgr2=0x7f369807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3698078b90 0x7f369807b0a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36a80058c0 tx=0x7f36a8005c90 comp rx=0 tx=0).stop 2024-09-17T02:58:14.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac145790 msgr2=0x7f36ac1f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac145790 0x7f36ac1f4eb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009d60 tx=0x7f36a4003f70 comp rx=0 tx=0).stop 2024-09-17T02:58:14.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 shutdown_connections 2024-09-17T02:58:14.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3698078b90 0x7f369807b0a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ac0cb2c0 0x7f36ac0c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36ac145790 0x7f36ac1f4eb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 --2- 172.21.15.104:0/4040617105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ac0c6990 0x7f36ac0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 >> 172.21.15.104:0/4040617105 conn(0x7f36ac0cd580 msgr2=0x7f36ac0cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:14.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 shutdown_connections 2024-09-17T02:58:14.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.597+0000 7f36b2e4d640 1 -- 172.21.15.104:0/4040617105 wait complete. 2024-09-17T02:58:14.607 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-17T02:58:14.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.721+0000 7f8aa14de640 1 -- 172.21.15.104:0/2248793332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0cefb0 msgr2=0x7f8a9c0cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.721+0000 7f8aa14de640 1 --2- 172.21.15.104:0/2248793332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0cefb0 0x7f8a9c0cf3c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8a94005fd0 tx=0x7f8a9402a980 comp rx=0 tx=0).stop 2024-09-17T02:58:14.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.721+0000 7f8aa14de640 1 -- 172.21.15.104:0/2248793332 shutdown_connections 2024-09-17T02:58:14.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.721+0000 7f8aa14de640 1 --2- 172.21.15.104:0/2248793332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0cefb0 0x7f8a9c0cf3c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.721+0000 7f8aa14de640 1 --2- 172.21.15.104:0/2248793332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0b7bb0 0x7f8a9c0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.721+0000 7f8aa14de640 1 -- 172.21.15.104:0/2248793332 >> 172.21.15.104:0/2248793332 conn(0x7f8a9c0d28a0 msgr2=0x7f8a9c0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:14.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.721+0000 7f8aa14de640 1 -- 172.21.15.104:0/2248793332 shutdown_connections 2024-09-17T02:58:14.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.721+0000 7f8aa14de640 1 -- 172.21.15.104:0/2248793332 wait complete. 2024-09-17T02:58:14.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.723+0000 7f8aa14de640 1 Processor -- start 2024-09-17T02:58:14.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.723+0000 7f8aa14de640 1 -- start start 2024-09-17T02:58:14.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8aa14de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0b7bb0 0x7f8a9c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8aa14de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c0cefb0 0x7f8a9c148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8aa14de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0d0470 0x7f8a9c0c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8aa14de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0cfa80 con 0x7f8a9c0d0470 2024-09-17T02:58:14.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8aa14de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9c0cf900 con 0x7f8a9c0cefb0 2024-09-17T02:58:14.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8aa14de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9c0cfc00 con 0x7f8a9c0b7bb0 2024-09-17T02:58:14.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0d0470 0x7f8a9c0c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8a9b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0d0470 0x7f8a9c0c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33782/0 (socket says 172.21.15.104:33782) 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8a9b7fe640 1 -- 172.21.15.104:0/3478599475 learned_addr learned my addr 172.21.15.104:0/3478599475 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8a927fc640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c0cefb0 0x7f8a9c148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.724+0000 7f8a9affd640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0b7bb0 0x7f8a9c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a9b7fe640 1 -- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0b7bb0 msgr2=0x7f8a9c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a9b7fe640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0b7bb0 0x7f8a9c15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a9b7fe640 1 -- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c0cefb0 msgr2=0x7f8a9c148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a9b7fe640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c0cefb0 0x7f8a9c148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a9b7fe640 1 -- 172.21.15.104:0/3478599475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9c15e4e0 con 0x7f8a9c0d0470 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a9b7fe640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0d0470 0x7f8a9c0c98e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8a94033040 tx=0x7f8a94003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a93fff640 1 -- 172.21.15.104:0/3478599475 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94034040 con 0x7f8a9c0d0470 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a93fff640 1 -- 172.21.15.104:0/3478599475 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a94004540 con 0x7f8a9c0d0470 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8a93fff640 1 -- 172.21.15.104:0/3478599475 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94045480 con 0x7f8a9c0d0470 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9c15df20 con 0x7f8a9c0d0470 2024-09-17T02:58:14.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.725+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9c0cb980 con 0x7f8a9c0d0470 2024-09-17T02:58:14.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.726+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9c15dc90 con 0x7f8a9c0d0470 2024-09-17T02:58:14.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.727+0000 7f8a93fff640 1 -- 172.21.15.104:0/3478599475 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a94037020 con 0x7f8a9c0d0470 2024-09-17T02:58:14.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.727+0000 7f8a93fff640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a7c078b90 0x7f8a7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:14.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.727+0000 7f8a93fff640 1 -- 172.21.15.104:0/3478599475 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4943+0+0 (secure 0 0 0) 0x7f8a940bc180 con 0x7f8a9c0d0470 2024-09-17T02:58:14.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.727+0000 7f8a9affd640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a7c078b90 0x7f8a7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:14.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.728+0000 7f8a9affd640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a7c078b90 0x7f8a7c07b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c005fd0 tx=0x7f8a8c00b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:14.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.732+0000 7f8a93fff640 1 -- 172.21.15.104:0/3478599475 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8a94084270 con 0x7f8a9c0d0470 2024-09-17T02:58:14.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:14.971+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7f8a9c06a100 con 0x7f8a9c0d0470 2024-09-17T02:58:15.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.968+0000 7f8a93fff640 1 -- 172.21.15.104:0/3478599475 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v187) ==== 136+0+0 (secure 0 0 0) 0x7f8a9c06a100 con 0x7f8a9c0d0470 2024-09-17T02:58:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a7c078b90 msgr2=0x7f8a7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a7c078b90 0x7f8a7c07b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c005fd0 tx=0x7f8a8c00b390 comp rx=0 tx=0).stop 2024-09-17T02:58:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0d0470 msgr2=0x7f8a9c0c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0d0470 0x7f8a9c0c98e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8a94033040 tx=0x7f8a94003f70 comp rx=0 tx=0).stop 2024-09-17T02:58:15.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 shutdown_connections 2024-09-17T02:58:15.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a7c078b90 0x7f8a7c07b0a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:15.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c0cefb0 0x7f8a9c148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:15.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a9c0d0470 0x7f8a9c0c98e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:15.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 --2- 172.21.15.104:0/3478599475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0b7bb0 0x7f8a9c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:15.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.971+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 >> 172.21.15.104:0/3478599475 conn(0x7f8a9c0d28a0 msgr2=0x7f8a9c15f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:15.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.972+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 shutdown_connections 2024-09-17T02:58:15.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:15.972+0000 7f8aa14de640 1 -- 172.21.15.104:0/3478599475 wait complete. 2024-09-17T02:58:15.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-17T02:58:16.109 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_objectstore":"memstore"} 2024-09-17T02:58:16.109 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-17T02:58:16.109 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T02:58:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.223+0000 7f4fa3269640 1 -- 172.21.15.104:0/2784493416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c15b7f0 msgr2=0x7f4f9c15bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.223+0000 7f4fa3269640 1 --2- 172.21.15.104:0/2784493416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c15b7f0 0x7f4f9c15bc00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4f98009830 tx=0x7f4f9802a4b0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.223+0000 7f4fa3269640 1 -- 172.21.15.104:0/2784493416 shutdown_connections 2024-09-17T02:58:16.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.223+0000 7f4fa3269640 1 --2- 172.21.15.104:0/2784493416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c15b7f0 0x7f4f9c15bc00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.223+0000 7f4fa3269640 1 -- 172.21.15.104:0/2784493416 >> 172.21.15.104:0/2784493416 conn(0x7f4f9c0b2450 msgr2=0x7f4f9c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:16.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.223+0000 7f4fa3269640 1 -- 172.21.15.104:0/2784493416 shutdown_connections 2024-09-17T02:58:16.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.223+0000 7f4fa3269640 1 -- 172.21.15.104:0/2784493416 wait complete. 2024-09-17T02:58:16.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.225+0000 7f4fa3269640 1 Processor -- start 2024-09-17T02:58:16.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.225+0000 7f4fa3269640 1 -- start start 2024-09-17T02:58:16.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.226+0000 7f4fa3269640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c072470 0x7f4f9c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:16.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.226+0000 7f4fa3269640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9c072f90 0x7f4f9c1457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:16.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.226+0000 7f4fa3269640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c15b7f0 0x7f4f9c145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.226+0000 7f4fa3269640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c0cede0 con 0x7f4f9c072f90 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.226+0000 7f4fa3269640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c0cec60 con 0x7f4f9c15b7f0 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.226+0000 7f4fa3269640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9c0cef60 con 0x7f4f9c072470 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9c072f90 0x7f4f9c1457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9c072f90 0x7f4f9c1457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33784/0 (socket says 172.21.15.104:33784) 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 -- 172.21.15.104:0/3129724281 learned_addr learned my addr 172.21.15.104:0/3129724281 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa1806640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c15b7f0 0x7f4f9c145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa1005640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c072470 0x7f4f9c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 -- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c072470 msgr2=0x7f4f9c15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c072470 0x7f4f9c15ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 -- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c15b7f0 msgr2=0x7f4f9c145d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c15b7f0 0x7f4f9c145d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 -- 172.21.15.104:0/3129724281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c146310 con 0x7f4f9c072f90 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa1005640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c072470 0x7f4f9c15ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa0804640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9c072f90 0x7f4f9c1457c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c4b0 tx=0x7f4f8c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4f91ffb640 1 -- 172.21.15.104:0/3129724281 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c016020 con 0x7f4f9c072f90 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c1465f0 con 0x7f4f9c072f90 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4f91ffb640 1 -- 172.21.15.104:0/3129724281 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f8c012920 con 0x7f4f9c072f90 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.227+0000 7f4f91ffb640 1 -- 172.21.15.104:0/3129724281 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c012d70 con 0x7f4f9c072f90 2024-09-17T02:58:16.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.228+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c146bb0 con 0x7f4f9c072f90 2024-09-17T02:58:16.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.228+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c0cf450 con 0x7f4f9c072f90 2024-09-17T02:58:16.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.229+0000 7f4f91ffb640 1 -- 172.21.15.104:0/3129724281 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f8c019020 con 0x7f4f9c072f90 2024-09-17T02:58:16.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.230+0000 7f4f91ffb640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f80078b90 0x7f4f8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:16.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.230+0000 7f4f91ffb640 1 -- 172.21.15.104:0/3129724281 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4943+0+0 (secure 0 0 0) 0x7f4f8c09a8e0 con 0x7f4f9c072f90 2024-09-17T02:58:16.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.230+0000 7f4fa1005640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f80078b90 0x7f4f8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:16.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.231+0000 7f4fa1005640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f80078b90 0x7f4f8007b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f98034000 tx=0x7f4f98004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:16.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.234+0000 7f4f91ffb640 1 -- 172.21.15.104:0/3129724281 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f8c020030 con 0x7f4f9c072f90 2024-09-17T02:58:16.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.410+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4f9c157080 con 0x7f4f9c072f90 2024-09-17T02:58:16.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.410+0000 7f4f91ffb640 1 -- 172.21.15.104:0/3129724281 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v29) ==== 59+0+1472 (secure 0 0 0) 0x7f4f8c062fa0 con 0x7f4f9c072f90 2024-09-17T02:58:16.409 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T02:58:16.409 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T02:58:16.409 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T02:58:16.409 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T02:58:16.410 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T02:58:16.411 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T02:58:16.411 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T02:58:16.411 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T02:58:16.411 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T02:58:16.411 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T02:58:16.411 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T02:58:16.411 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T02:58:16.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f80078b90 msgr2=0x7f4f8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f80078b90 0x7f4f8007b0a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4f98034000 tx=0x7f4f98004730 comp rx=0 tx=0).stop 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9c072f90 msgr2=0x7f4f9c1457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9c072f90 0x7f4f9c1457c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c4b0 tx=0x7f4f8c00c970 comp rx=0 tx=0).stop 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 shutdown_connections 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f80078b90 0x7f4f8007b0a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f9c15b7f0 0x7f4f9c145d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f9c072f90 0x7f4f9c1457c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 --2- 172.21.15.104:0/3129724281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f9c072470 0x7f4f9c15ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.412+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 >> 172.21.15.104:0/3129724281 conn(0x7f4f9c0b2450 msgr2=0x7f4f9c156470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.413+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 shutdown_connections 2024-09-17T02:58:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.413+0000 7f4fa3269640 1 -- 172.21.15.104:0/3129724281 wait complete. 2024-09-17T02:58:16.422 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T02:58:16.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.540+0000 7f97a988b640 1 -- 172.21.15.104:0/2143441173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f978c003a80 msgr2=0x7f978c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.540+0000 7f97a988b640 1 --2- 172.21.15.104:0/2143441173 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f978c003a80 0x7f978c003ef0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f979c0016c0 tx=0x7f978c005830 comp rx=0 tx=0).stop 2024-09-17T02:58:16.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.540+0000 7f97a37fe640 1 -- 172.21.15.104:0/2143441173 reap_dead start 2024-09-17T02:58:16.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.540+0000 7f97a988b640 1 -- 172.21.15.104:0/2143441173 shutdown_connections 2024-09-17T02:58:16.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.540+0000 7f97a988b640 1 -- 172.21.15.104:0/2143441173 >> 172.21.15.104:0/2143441173 conn(0x7f97a4073df0 msgr2=0x7f97a4068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:16.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.540+0000 7f97a988b640 1 -- 172.21.15.104:0/2143441173 shutdown_connections 2024-09-17T02:58:16.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.540+0000 7f97a988b640 1 -- 172.21.15.104:0/2143441173 wait complete. 2024-09-17T02:58:16.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.542+0000 7f97a988b640 1 Processor -- start 2024-09-17T02:58:16.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.542+0000 7f97a988b640 1 -- start start 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a988b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f978c003a80 0x7f97a415bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a988b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a415c170 0x7f97a415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a988b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97a40c8220 0x7f97a415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a988b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f97a40d3c00 con 0x7f97a40c8220 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a988b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f97a415f3c0 con 0x7f97a415c170 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a988b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f97a40d3d80 con 0x7f978c003a80 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97a40c8220 0x7f97a415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97a40c8220 0x7f97a415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33794/0 (socket says 172.21.15.104:33794) 2024-09-17T02:58:16.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a37fe640 1 -- 172.21.15.104:0/1282333407 learned_addr learned my addr 172.21.15.104:0/1282333407 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a27fc640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a415c170 0x7f97a415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a2ffd640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f978c003a80 0x7f97a415bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.543+0000 7f97a37fe640 1 -- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f978c003a80 msgr2=0x7f97a415bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f97a37fe640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f978c003a80 0x7f97a415bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f97a37fe640 1 -- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a415c170 msgr2=0x7f97a415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f97a37fe640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a415c170 0x7f97a415aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f97a37fe640 1 -- 172.21.15.104:0/1282333407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a40cacb0 con 0x7f97a40c8220 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f97a37fe640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97a40c8220 0x7f97a415b420 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9794001eb0 tx=0x7f979400ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f978bfff640 1 -- 172.21.15.104:0/1282333407 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794010890 con 0x7f97a40c8220 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f978bfff640 1 -- 172.21.15.104:0/1282333407 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9794016070 con 0x7f97a40c8220 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a40caf90 con 0x7f97a40c8220 2024-09-17T02:58:16.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f978bfff640 1 -- 172.21.15.104:0/1282333407 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794010dc0 con 0x7f97a40c8220 2024-09-17T02:58:16.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.544+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a40ccfd0 con 0x7f97a40c8220 2024-09-17T02:58:16.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.545+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a40caa40 con 0x7f97a40c8220 2024-09-17T02:58:16.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.546+0000 7f978bfff640 1 -- 172.21.15.104:0/1282333407 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f979401b460 con 0x7f97a40c8220 2024-09-17T02:58:16.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.546+0000 7f978bfff640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9790078bc0 0x7f979007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:16.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.547+0000 7f978bfff640 1 -- 172.21.15.104:0/1282333407 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4943+0+0 (secure 0 0 0) 0x7f979409ad00 con 0x7f97a40c8220 2024-09-17T02:58:16.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.547+0000 7f97a2ffd640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9790078bc0 0x7f979007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:16.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.547+0000 7f97a2ffd640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9790078bc0 0x7f979007b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f979c032000 tx=0x7f979c001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:16.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.551+0000 7f978bfff640 1 -- 172.21.15.104:0/1282333407 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9794062d70 con 0x7f97a40c8220 2024-09-17T02:58:16.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.728+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f97a40d4310 con 0x7f97a40c8220 2024-09-17T02:58:16.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.731+0000 7f978bfff640 1 -- 172.21.15.104:0/1282333407 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f97940677a0 con 0x7f97a40c8220 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9790078bc0 msgr2=0x7f979007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9790078bc0 0x7f979007b0d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f979c032000 tx=0x7f979c001190 comp rx=0 tx=0).stop 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97a40c8220 msgr2=0x7f97a415b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97a40c8220 0x7f97a415b420 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9794001eb0 tx=0x7f979400ea20 comp rx=0 tx=0).stop 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 shutdown_connections 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9790078bc0 0x7f979007b0d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a415c170 0x7f97a415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97a40c8220 0x7f97a415b420 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 --2- 172.21.15.104:0/1282333407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f978c003a80 0x7f97a415bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:16.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 >> 172.21.15.104:0/1282333407 conn(0x7f97a4073df0 msgr2=0x7f97a40d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:16.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 shutdown_connections 2024-09-17T02:58:16.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:16.734+0000 7f97a988b640 1 -- 172.21.15.104:0/1282333407 wait complete. 2024-09-17T02:58:16.744 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:58:16.744 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:58:16.787 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:58:16.829 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:58:16.830 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:58:16.830 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:16.845 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:58:16.846 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:58:16.846 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:16.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:58:16.888 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:58:16.888 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:16.904 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:58:16.904 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:58:16.905 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:16.945 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:58:16.946 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T02:58:16.946 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:58:17.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.060+0000 7f26222cc640 1 -- 172.21.15.104:0/3215266715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f261c0b6f70 msgr2=0x7f261c15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.060+0000 7f26222cc640 1 --2- 172.21.15.104:0/3215266715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f261c0b6f70 0x7f261c15ef90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f260c005fd0 tx=0x7f260c02a5d0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.060+0000 7f26222cc640 1 -- 172.21.15.104:0/3215266715 shutdown_connections 2024-09-17T02:58:17.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.060+0000 7f26222cc640 1 --2- 172.21.15.104:0/3215266715 >> v2:172.21.15.192:3300/0 conn(0x7f261c0d18e0 0x7f261c0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.060+0000 7f26222cc640 1 --2- 172.21.15.104:0/3215266715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f261c0b6f70 0x7f261c15ef90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.060+0000 7f26222cc640 1 -- 172.21.15.104:0/3215266715 >> 172.21.15.104:0/3215266715 conn(0x7f261c073df0 msgr2=0x7f261c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:17.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.060+0000 7f26222cc640 1 -- 172.21.15.104:0/3215266715 shutdown_connections 2024-09-17T02:58:17.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.060+0000 7f26222cc640 1 -- 172.21.15.104:0/3215266715 wait complete. 2024-09-17T02:58:17.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.062+0000 7f26222cc640 1 Processor -- start 2024-09-17T02:58:17.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.062+0000 7f26222cc640 1 -- start start 2024-09-17T02:58:17.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.063+0000 7f26222cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c0b3b00 0x7f261c0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:17.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.063+0000 7f26222cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f261c0b6f70 0x7f261c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:17.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.063+0000 7f26222cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f261c0d18e0 0x7f261c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:17.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.063+0000 7f26222cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f261c0d3dc0 con 0x7f261c0b6f70 2024-09-17T02:58:17.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.063+0000 7f26222cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f261c0d3c40 con 0x7f261c0b3b00 2024-09-17T02:58:17.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.063+0000 7f26222cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f261c0d3f40 con 0x7f261c0d18e0 2024-09-17T02:58:17.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f261c0b6f70 0x7f261c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:17.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f261c0b6f70 0x7f261c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33798/0 (socket says 172.21.15.104:33798) 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 -- 172.21.15.104:0/3381186916 learned_addr learned my addr 172.21.15.104:0/3381186916 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f2620869640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f261c0d18e0 0x7f261c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261bfff640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c0b3b00 0x7f261c0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 -- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f261c0d18e0 msgr2=0x7f261c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f261c0d18e0 0x7f261c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 -- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c0b3b00 msgr2=0x7f261c0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c0b3b00 0x7f261c0cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 -- 172.21.15.104:0/3381186916 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261c0ccef0 con 0x7f261c0b6f70 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261bfff640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c0b3b00 0x7f261c0cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f261b7fe640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f261c0b6f70 0x7f261c146b70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f261000c3a0 tx=0x7f261000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f2618ff9640 1 -- 172.21.15.104:0/3381186916 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610017070 con 0x7f261c0b6f70 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f2618ff9640 1 -- 172.21.15.104:0/3381186916 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26100053c0 con 0x7f261c0b6f70 2024-09-17T02:58:17.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261c0cd1d0 con 0x7f261c0b6f70 2024-09-17T02:58:17.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f2618ff9640 1 -- 172.21.15.104:0/3381186916 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610003850 con 0x7f261c0b6f70 2024-09-17T02:58:17.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.064+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261c0cd790 con 0x7f261c0b6f70 2024-09-17T02:58:17.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.065+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261c0d4460 con 0x7f261c0b6f70 2024-09-17T02:58:17.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.066+0000 7f2618ff9640 1 -- 172.21.15.104:0/3381186916 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f261001a070 con 0x7f261c0b6f70 2024-09-17T02:58:17.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.067+0000 7f2618ff9640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2608078b90 0x7f260807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:17.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.067+0000 7f2618ff9640 1 -- 172.21.15.104:0/3381186916 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4943+0+0 (secure 0 0 0) 0x7f261009a2c0 con 0x7f261c0b6f70 2024-09-17T02:58:17.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.067+0000 7f261bfff640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2608078b90 0x7f260807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:17.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.068+0000 7f261bfff640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2608078b90 0x7f260807b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f260c033000 tx=0x7f260c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:17.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.071+0000 7f2618ff9640 1 -- 172.21.15.104:0/3381186916 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2610021020 con 0x7f261c0b6f70 2024-09-17T02:58:17.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.277+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f261c06d3d0 con 0x7f261c0b6f70 2024-09-17T02:58:17.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.278+0000 7f2618ff9640 1 -- 172.21.15.104:0/3381186916 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+3920 (secure 0 0 0) 0x7f2610062a00 con 0x7f261c0b6f70 2024-09-17T02:58:17.277 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:17.277 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":29,"btime":"2024-09-17T02:58:10:950567+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/258221702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":258221702},{"type":"v1","addr":"172.21.15.192:6836","nonce":258221702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5111,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4219924766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4219924766},{"type":"v1","addr":"172.21.15.192:6837","nonce":4219924766}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2744372735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2744372735},{"type":"v1","addr":"172.21.15.104:6833","nonce":2744372735}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5880,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1247115989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1247115989},{"type":"v1","addr":"172.21.15.104:6835","nonce":1247115989}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[]} 2024-09-17T02:58:17.277 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 29 2024-09-17T02:58:17.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2608078b90 msgr2=0x7f260807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2608078b90 0x7f260807b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f260c033000 tx=0x7f260c004730 comp rx=0 tx=0).stop 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f261c0b6f70 msgr2=0x7f261c146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f261c0b6f70 0x7f261c146b70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f261000c3a0 tx=0x7f261000c860 comp rx=0 tx=0).stop 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 shutdown_connections 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2608078b90 0x7f260807b0a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f261c0d18e0 0x7f261c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f261c0b6f70 0x7f261c146b70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 --2- 172.21.15.104:0/3381186916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f261c0b3b00 0x7f261c0cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 >> 172.21.15.104:0/3381186916 conn(0x7f261c073df0 msgr2=0x7f261c0d5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 shutdown_connections 2024-09-17T02:58:17.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.280+0000 7f26222cc640 1 -- 172.21.15.104:0/3381186916 wait complete. 2024-09-17T02:58:17.290 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T02:58:17.291 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T02:58:17.291 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T02:58:17.291 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:58:17.291 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T02:58:17.291 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T02:58:17.291 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T02:58:17.292 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:58:17.292 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T02:58:17.292 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T02:58:17.292 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T02:58:17.292 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:58:17.292 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T02:58:17.292 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T02:58:17.293 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T02:58:17.293 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:58:17.300 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T02:58:17.301 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T02:58:17.303 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T02:58:17.303 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T02:58:17.304 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T02:58:17.305 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T02:58:17.305 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T02:58:17.306 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T02:58:17.345 INFO:tasks.ceph.mds.a:Started 2024-09-17T02:58:17.346 DEBUG:teuthology.parallel:result is None 2024-09-17T02:58:17.347 INFO:tasks.ceph.mds.c:Started 2024-09-17T02:58:17.347 DEBUG:teuthology.parallel:result is None 2024-09-17T02:58:17.348 INFO:tasks.ceph.mds.b:Started 2024-09-17T02:58:17.348 DEBUG:teuthology.parallel:result is None 2024-09-17T02:58:17.349 INFO:tasks.ceph.mds.d:Started 2024-09-17T02:58:17.349 DEBUG:teuthology.parallel:result is None 2024-09-17T02:58:17.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T02:58:17.432 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:58:17.432 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T02:58:17.440 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T02:58:17.440 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T02:58:17.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.470+0000 7f54c2bad640 1 -- 172.21.15.104:0/3390142065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc073c90 msgr2=0x7f54bc0b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.470+0000 7f54c2bad640 1 --2- 172.21.15.104:0/3390142065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc073c90 0x7f54bc0b4ce0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0724b0 tx=0x7f54b402a820 comp rx=0 tx=0).stop 2024-09-17T02:58:17.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.470+0000 7f54c2bad640 1 -- 172.21.15.104:0/3390142065 shutdown_connections 2024-09-17T02:58:17.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.470+0000 7f54c2bad640 1 --2- 172.21.15.104:0/3390142065 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc073c90 0x7f54bc0b4ce0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.470+0000 7f54c2bad640 1 --2- 172.21.15.104:0/3390142065 >> v2:172.21.15.192:3300/0 conn(0x7f54bc152ce0 0x7f54bc06f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.470+0000 7f54c2bad640 1 -- 172.21.15.104:0/3390142065 >> 172.21.15.104:0/3390142065 conn(0x7f54bc0b3640 msgr2=0x7f54bc0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:17.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.470+0000 7f54c2bad640 1 -- 172.21.15.104:0/3390142065 shutdown_connections 2024-09-17T02:58:17.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.470+0000 7f54c2bad640 1 -- 172.21.15.104:0/3390142065 wait complete. 2024-09-17T02:58:17.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.472+0000 7f54c2bad640 1 Processor -- start 2024-09-17T02:58:17.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.472+0000 7f54c2bad640 1 -- start start 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c2bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc06fa80 0x7f54bc158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c2bad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54bc152ce0 0x7f54bc1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c2bad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc15e320 0x7f54bc15e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c2bad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0b58b0 con 0x7f54bc06fa80 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c2bad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0b5730 con 0x7f54bc15e320 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c2bad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0b5a30 con 0x7f54bc152ce0 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c0949640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc06fa80 0x7f54bc158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c0949640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc06fa80 0x7f54bc158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33852/0 (socket says 172.21.15.104:33852) 2024-09-17T02:58:17.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c0949640 1 -- 172.21.15.104:0/1718093514 learned_addr learned my addr 172.21.15.104:0/1718093514 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54c114a640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc15e320 0x7f54bc15e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.473+0000 7f54bbfff640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54bc152ce0 0x7f54bc1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54c0949640 1 -- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54bc152ce0 msgr2=0x7f54bc1491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54c0949640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54bc152ce0 0x7f54bc1491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54c0949640 1 -- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc15e320 msgr2=0x7f54bc15e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54c0949640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc15e320 0x7f54bc15e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54c0949640 1 -- 172.21.15.104:0/1718093514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc15ec70 con 0x7f54bc06fa80 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54c0949640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc06fa80 0x7f54bc158800 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009fd0 tx=0x7f54b000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54b97fa640 1 -- 172.21.15.104:0/1718093514 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b000ccc0 con 0x7f54bc06fa80 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54b97fa640 1 -- 172.21.15.104:0/1718093514 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54b000ee70 con 0x7f54bc06fa80 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54b97fa640 1 -- 172.21.15.104:0/1718093514 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b000ce60 con 0x7f54bc06fa80 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc150b80 con 0x7f54bc06fa80 2024-09-17T02:58:17.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.474+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc1f7450 con 0x7f54bc06fa80 2024-09-17T02:58:17.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.475+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc0b5ee0 con 0x7f54bc06fa80 2024-09-17T02:58:17.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.476+0000 7f54b97fa640 1 -- 172.21.15.104:0/1718093514 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54b0004280 con 0x7f54bc06fa80 2024-09-17T02:58:17.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.477+0000 7f54b97fa640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54a0078bc0 0x7f54a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:17.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.477+0000 7f54b97fa640 1 -- 172.21.15.104:0/1718093514 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 4943+0+0 (secure 0 0 0) 0x7f54b009b190 con 0x7f54bc06fa80 2024-09-17T02:58:17.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.477+0000 7f54bbfff640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54a0078bc0 0x7f54a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:17.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.477+0000 7f54bbfff640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54a0078bc0 0x7f54a007b0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54bc06f990 tx=0x7f54a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:17.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.481+0000 7f54b97fa640 1 -- 172.21.15.104:0/1718093514 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f54bc15ec70 con 0x7f54bc06fa80 2024-09-17T02:58:17.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.667+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f54bc0cde50 con 0x7f54bc06fa80 2024-09-17T02:58:17.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.979+0000 7f54b97fa640 1 -- 172.21.15.104:0/1718093514 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) ==== 97+0+0 (secure 0 0 0) 0x7f54b0063310 con 0x7f54bc06fa80 2024-09-17T02:58:17.978 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T02:58:17.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.981+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54a0078bc0 msgr2=0x7f54a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.981+0000 7f54c2bad640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54a0078bc0 0x7f54a007b0d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f54bc06f990 tx=0x7f54a8009040 comp rx=0 tx=0).stop 2024-09-17T02:58:17.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.981+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc06fa80 msgr2=0x7f54bc158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:17.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.981+0000 7f54c2bad640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc06fa80 0x7f54bc158800 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009fd0 tx=0x7f54b000ec20 comp rx=0 tx=0).stop 2024-09-17T02:58:17.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.982+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 shutdown_connections 2024-09-17T02:58:17.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.982+0000 7f54c2bad640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54a0078bc0 0x7f54a007b0d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.982+0000 7f54c2bad640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc15e320 0x7f54bc15e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.982+0000 7f54c2bad640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54bc152ce0 0x7f54bc1491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.982+0000 7f54c2bad640 1 --2- 172.21.15.104:0/1718093514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54bc06fa80 0x7f54bc158800 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:17.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.982+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 >> 172.21.15.104:0/1718093514 conn(0x7f54bc0b3640 msgr2=0x7f54bc0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:17.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.982+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 shutdown_connections 2024-09-17T02:58:17.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:17.982+0000 7f54c2bad640 1 -- 172.21.15.104:0/1718093514 wait complete. 2024-09-17T02:58:17.993 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T02:58:18.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.106+0000 7fbe254c5640 1 -- 172.21.15.104:0/3412466460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b6f70 msgr2=0x7fbe2015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.106+0000 7fbe254c5640 1 --2- 172.21.15.104:0/3412466460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b6f70 0x7fbe2015ef90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fbe200b44d0 tx=0x7fbe1002a820 comp rx=0 tx=0).stop 2024-09-17T02:58:18.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.107+0000 7fbe254c5640 1 -- 172.21.15.104:0/3412466460 shutdown_connections 2024-09-17T02:58:18.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.107+0000 7fbe254c5640 1 --2- 172.21.15.104:0/3412466460 >> v2:172.21.15.192:3300/0 conn(0x7fbe200b3b00 0x7fbe200d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.107+0000 7fbe254c5640 1 --2- 172.21.15.104:0/3412466460 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b6f70 0x7fbe2015ef90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.107+0000 7fbe254c5640 1 -- 172.21.15.104:0/3412466460 >> 172.21.15.104:0/3412466460 conn(0x7fbe20073df0 msgr2=0x7fbe20068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:18.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.107+0000 7fbe254c5640 1 -- 172.21.15.104:0/3412466460 shutdown_connections 2024-09-17T02:58:18.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.107+0000 7fbe254c5640 1 -- 172.21.15.104:0/3412466460 wait complete. 2024-09-17T02:58:18.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.108+0000 7fbe254c5640 1 Processor -- start 2024-09-17T02:58:18.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.109+0000 7fbe254c5640 1 -- start start 2024-09-17T02:58:18.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe254c5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b3b00 0x7fbe200cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe254c5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe200b6f70 0x7fbe201f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe254c5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe200d1710 0x7fbe2015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe254c5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200d01b0 con 0x7fbe200b3b00 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe254c5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200d0030 con 0x7fbe200d1710 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe254c5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbe200d0330 con 0x7fbe200b6f70 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b3b00 0x7fbe200cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b3b00 0x7fbe200cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33870/0 (socket says 172.21.15.104:33870) 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 -- 172.21.15.104:0/2073659989 learned_addr learned my addr 172.21.15.104:0/2073659989 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1f7fe640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe200d1710 0x7fbe2015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1e7fc640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe200b6f70 0x7fbe201f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 -- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe200b6f70 msgr2=0x7fbe201f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe200b6f70 0x7fbe201f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 -- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe200d1710 msgr2=0x7fbe2015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe200d1710 0x7fbe2015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 -- 172.21.15.104:0/2073659989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe200ccb70 con 0x7fbe200b3b00 2024-09-17T02:58:18.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1f7fe640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe200d1710 0x7fbe2015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:18.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.110+0000 7fbe1effd640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b3b00 0x7fbe200cc4c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbe10035040 tx=0x7fbe10032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:18.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.111+0000 7fbe177fe640 1 -- 172.21.15.104:0/2073659989 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10037040 con 0x7fbe200b3b00 2024-09-17T02:58:18.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.111+0000 7fbe177fe640 1 -- 172.21.15.104:0/2073659989 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe10042070 con 0x7fbe200b3b00 2024-09-17T02:58:18.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.111+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe200cbc50 con 0x7fbe200b3b00 2024-09-17T02:58:18.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.111+0000 7fbe177fe640 1 -- 172.21.15.104:0/2073659989 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10003e60 con 0x7fbe200b3b00 2024-09-17T02:58:18.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.111+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe201f5ad0 con 0x7fbe200b3b00 2024-09-17T02:58:18.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.112+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe200d58f0 con 0x7fbe200b3b00 2024-09-17T02:58:18.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.112+0000 7fbe177fe640 1 -- 172.21.15.104:0/2073659989 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe10004280 con 0x7fbe200b3b00 2024-09-17T02:58:18.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.113+0000 7fbe177fe640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe00078b90 0x7fbe0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.113+0000 7fbe177fe640 1 -- 172.21.15.104:0/2073659989 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7fbe100bb6a0 con 0x7fbe200b3b00 2024-09-17T02:58:18.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.113+0000 7fbe1e7fc640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe00078b90 0x7fbe0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.114+0000 7fbe1e7fc640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe00078b90 0x7fbe0007b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbe08005fd0 tx=0x7fbe08005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:18.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.118+0000 7fbe177fe640 1 -- 172.21.15.104:0/2073659989 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbe10083f50 con 0x7fbe200b3b00 2024-09-17T02:58:18.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.358+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbe201f6810 con 0x7fbe200b3b00 2024-09-17T02:58:18.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.359+0000 7fbe177fe640 1 -- 172.21.15.104:0/2073659989 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) ==== 80+0+5304 (secure 0 0 0) 0x7fbe10083850 con 0x7fbe200b3b00 2024-09-17T02:58:18.357 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.358 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:58:18.359 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:58:18.360 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.361 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T02:58:18.362 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.363 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T02:58:18.364 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.365 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T02:58:18.366 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:58:18.367 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.368 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.369 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:58:18.370 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:58:18.371 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:58:18.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe00078b90 msgr2=0x7fbe0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe00078b90 0x7fbe0007b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbe08005fd0 tx=0x7fbe08005850 comp rx=0 tx=0).stop 2024-09-17T02:58:18.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b3b00 msgr2=0x7fbe200cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b3b00 0x7fbe200cc4c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbe10035040 tx=0x7fbe10032d10 comp rx=0 tx=0).stop 2024-09-17T02:58:18.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 shutdown_connections 2024-09-17T02:58:18.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbe00078b90 0x7fbe0007b0a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe200d1710 0x7fbe2015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbe200b6f70 0x7fbe201f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 --2- 172.21.15.104:0/2073659989 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbe200b3b00 0x7fbe200cc4c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 >> 172.21.15.104:0/2073659989 conn(0x7fbe20073df0 msgr2=0x7fbe200b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:18.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 shutdown_connections 2024-09-17T02:58:18.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.361+0000 7fbe254c5640 1 -- 172.21.15.104:0/2073659989 wait complete. 2024-09-17T02:58:18.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T02:58:18.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.488+0000 7f6983007640 1 -- 172.21.15.104:0/3289131415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c073540 msgr2=0x7f697c0b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.488+0000 7f6983007640 1 --2- 172.21.15.104:0/3289131415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c073540 0x7f697c0b3750 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6974005fd0 tx=0x7f697402aa10 comp rx=0 tx=0).stop 2024-09-17T02:58:18.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.488+0000 7f6983007640 1 -- 172.21.15.104:0/3289131415 shutdown_connections 2024-09-17T02:58:18.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.488+0000 7f6983007640 1 --2- 172.21.15.104:0/3289131415 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c073540 0x7f697c0b3750 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.488+0000 7f6983007640 1 --2- 172.21.15.104:0/3289131415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c0cff70 0x7f697c15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.488+0000 7f6983007640 1 -- 172.21.15.104:0/3289131415 >> 172.21.15.104:0/3289131415 conn(0x7f697c0b2450 msgr2=0x7f697c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:18.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.488+0000 7f6983007640 1 -- 172.21.15.104:0/3289131415 shutdown_connections 2024-09-17T02:58:18.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.488+0000 7f6983007640 1 -- 172.21.15.104:0/3289131415 wait complete. 2024-09-17T02:58:18.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.490+0000 7f6983007640 1 Processor -- start 2024-09-17T02:58:18.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.490+0000 7f6983007640 1 -- start start 2024-09-17T02:58:18.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6983007640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c06f840 0x7f697c1e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6983007640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c073540 0x7f697c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6983007640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0cff70 0x7f697c0c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6983007640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f697c06fdd0 con 0x7f697c06f840 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6983007640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f697c06fc50 con 0x7f697c0cff70 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6983007640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f697c0b3c90 con 0x7f697c073540 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6980da3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c06f840 0x7f697c1e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6980da3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c06f840 0x7f697c1e7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33896/0 (socket says 172.21.15.104:33896) 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.491+0000 7f6980da3640 1 -- 172.21.15.104:0/2054177306 learned_addr learned my addr 172.21.15.104:0/2054177306 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f697bfff640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c073540 0x7f697c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f69815a4640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0cff70 0x7f697c0c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f6980da3640 1 -- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c073540 msgr2=0x7f697c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f6980da3640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c073540 0x7f697c156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f6980da3640 1 -- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0cff70 msgr2=0x7f697c0c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f6980da3640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0cff70 0x7f697c0c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f6980da3640 1 -- 172.21.15.104:0/2054177306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c0c6490 con 0x7f697c06f840 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f697bfff640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c073540 0x7f697c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f69815a4640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0cff70 0x7f697c0c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f6980da3640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c06f840 0x7f697c1e7330 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f696c00fbc0 tx=0x7f696c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f69797fa640 1 -- 172.21.15.104:0/2054177306 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c01c070 con 0x7f697c06f840 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f69797fa640 1 -- 172.21.15.104:0/2054177306 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f696c00c8d0 con 0x7f697c06f840 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c1e4ce0 con 0x7f697c06f840 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f69797fa640 1 -- 172.21.15.104:0/2054177306 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c00cd00 con 0x7f697c06f840 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.492+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c0c79b0 con 0x7f697c06f840 2024-09-17T02:58:18.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.493+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c0b40e0 con 0x7f697c06f840 2024-09-17T02:58:18.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.494+0000 7f69797fa640 1 -- 172.21.15.104:0/2054177306 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f696c01f070 con 0x7f697c06f840 2024-09-17T02:58:18.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.495+0000 7f69797fa640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6968078b90 0x7f696807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.495+0000 7f69797fa640 1 -- 172.21.15.104:0/2054177306 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7f696c09c550 con 0x7f697c06f840 2024-09-17T02:58:18.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.495+0000 7f697bfff640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6968078b90 0x7f696807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.495+0000 7f697bfff640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6968078b90 0x7f696807b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f697c0cc7d0 tx=0x7f6970009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:18.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.499+0000 7f69797fa640 1 -- 172.21.15.104:0/2054177306 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f696c064690 con 0x7f697c06f840 2024-09-17T02:58:18.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.673+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f697c1f2af0 con 0x7f697c06f840 2024-09-17T02:58:18.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.673+0000 7f69797fa640 1 -- 172.21.15.104:0/2054177306 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7f696c0690c0 con 0x7f697c06f840 2024-09-17T02:58:18.672 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:18.672 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T02:58:18.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:58:18.672 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T02:58:18.673 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T02:58:18.673 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:58:18.673 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T02:58:18.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.675+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6968078b90 msgr2=0x7f696807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.675+0000 7f6983007640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6968078b90 0x7f696807b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f697c0cc7d0 tx=0x7f6970009040 comp rx=0 tx=0).stop 2024-09-17T02:58:18.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.675+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c06f840 msgr2=0x7f697c1e7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.675+0000 7f6983007640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c06f840 0x7f697c1e7330 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f696c00fbc0 tx=0x7f696c00d7b0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.676+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 shutdown_connections 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.676+0000 7f6983007640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6968078b90 0x7f696807b0a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.676+0000 7f6983007640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0cff70 0x7f697c0c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.676+0000 7f6983007640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c073540 0x7f697c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.676+0000 7f6983007640 1 --2- 172.21.15.104:0/2054177306 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c06f840 0x7f697c1e7330 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.676+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 >> 172.21.15.104:0/2054177306 conn(0x7f697c0b2450 msgr2=0x7f697c15a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.676+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 shutdown_connections 2024-09-17T02:58:18.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.676+0000 7f6983007640 1 -- 172.21.15.104:0/2054177306 wait complete. 2024-09-17T02:58:18.686 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T02:58:18.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T02:58:18.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.804+0000 7fc8d9b19640 1 -- 172.21.15.104:0/3289228141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8bc0039e0 msgr2=0x7fc8bc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.804+0000 7fc8d9b19640 1 --2- 172.21.15.104:0/3289228141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8bc0039e0 0x7fc8bc003e10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40017c0 tx=0x7fc8bc005830 comp rx=0 tx=0).stop 2024-09-17T02:58:18.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.804+0000 7fc8d3fff640 1 -- 172.21.15.104:0/3289228141 reap_dead start 2024-09-17T02:58:18.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.804+0000 7fc8d9b19640 1 -- 172.21.15.104:0/3289228141 shutdown_connections 2024-09-17T02:58:18.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.804+0000 7fc8d9b19640 1 -- 172.21.15.104:0/3289228141 >> 172.21.15.104:0/3289228141 conn(0x7fc8d40d4c20 msgr2=0x7fc8d40d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:18.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.804+0000 7fc8d9b19640 1 -- 172.21.15.104:0/3289228141 shutdown_connections 2024-09-17T02:58:18.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.804+0000 7fc8d9b19640 1 -- 172.21.15.104:0/3289228141 wait complete. 2024-09-17T02:58:18.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.805+0000 7fc8d9b19640 1 Processor -- start 2024-09-17T02:58:18.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.806+0000 7fc8d9b19640 1 -- start start 2024-09-17T02:58:18.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d9b19640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8bc0039e0 0x7fc8d4148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d9b19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d4158e50 0x7fc8d40ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d9b19640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8d40cd260 0x7fc8d40cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d9b19640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d40b34a0 con 0x7fc8d4158e50 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d9b19640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d40b3320 con 0x7fc8bc0039e0 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d9b19640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d40b3620 con 0x7fc8d40cd260 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d4158e50 0x7fc8d40ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d4158e50 0x7fc8d40ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33910/0 (socket says 172.21.15.104:33910) 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d2ffd640 1 -- 172.21.15.104:0/645605118 learned_addr learned my addr 172.21.15.104:0/645605118 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d3fff640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8d40cd260 0x7fc8d40cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d37fe640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8bc0039e0 0x7fc8d4148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d2ffd640 1 -- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8d40cd260 msgr2=0x7fc8d40cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d2ffd640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8d40cd260 0x7fc8d40cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d2ffd640 1 -- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8bc0039e0 msgr2=0x7fc8d4148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d2ffd640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8bc0039e0 0x7fc8d4148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d2ffd640 1 -- 172.21.15.104:0/645605118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d4149620 con 0x7fc8d4158e50 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.807+0000 7fc8d37fe640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8bc0039e0 0x7fc8d4148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.808+0000 7fc8d2ffd640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d4158e50 0x7fc8d40ce660 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8011a50 tx=0x7fc8c8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.808+0000 7fc8bbfff640 1 -- 172.21.15.104:0/645605118 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c801f070 con 0x7fc8d4158e50 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.808+0000 7fc8bbfff640 1 -- 172.21.15.104:0/645605118 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8c800fe80 con 0x7fc8d4158e50 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.808+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d4149900 con 0x7fc8d4158e50 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.808+0000 7fc8bbfff640 1 -- 172.21.15.104:0/645605118 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8012690 con 0x7fc8d4158e50 2024-09-17T02:58:18.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.808+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d40cbc60 con 0x7fc8d4158e50 2024-09-17T02:58:18.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.809+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d40d3780 con 0x7fc8d4158e50 2024-09-17T02:58:18.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.810+0000 7fc8bbfff640 1 -- 172.21.15.104:0/645605118 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8c8022070 con 0x7fc8d4158e50 2024-09-17T02:58:18.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.810+0000 7fc8bbfff640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8c0078b90 0x7fc8c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:18.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.810+0000 7fc8bbfff640 1 -- 172.21.15.104:0/645605118 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7fc8c809b480 con 0x7fc8d4158e50 2024-09-17T02:58:18.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.810+0000 7fc8d37fe640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8c0078b90 0x7fc8c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:18.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.811+0000 7fc8d37fe640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8c0078b90 0x7fc8c007b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4032000 tx=0x7fc8c402c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:18.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.815+0000 7fc8bbfff640 1 -- 172.21.15.104:0/645605118 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8d40d3780 con 0x7fc8d4158e50 2024-09-17T02:58:18.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:18.990+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc8d40b3bb0 con 0x7fc8d4158e50 2024-09-17T02:58:19.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.989+0000 7fc8bbfff640 1 -- 172.21.15.104:0/645605118 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7fc8c80635c0 con 0x7fc8d4158e50 2024-09-17T02:58:19.988 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8c0078b90 msgr2=0x7fc8c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8c0078b90 0x7fc8c007b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4032000 tx=0x7fc8c402c000 comp rx=0 tx=0).stop 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d4158e50 msgr2=0x7fc8d40ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d4158e50 0x7fc8d40ce660 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8011a50 tx=0x7fc8c8011f10 comp rx=0 tx=0).stop 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 shutdown_connections 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8c0078b90 0x7fc8c007b0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8d40cd260 0x7fc8d40cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8d4158e50 0x7fc8d40ce660 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 --2- 172.21.15.104:0/645605118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8bc0039e0 0x7fc8d4148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 >> 172.21.15.104:0/645605118 conn(0x7fc8d40d4c20 msgr2=0x7fc8d40b9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 shutdown_connections 2024-09-17T02:58:19.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:19.993+0000 7fc8d9b19640 1 -- 172.21.15.104:0/645605118 wait complete. 2024-09-17T02:58:20.008 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T02:58:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.134+0000 7f5899684640 1 -- 172.21.15.104:0/4106842760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940d18e0 msgr2=0x7f589415ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.134+0000 7f5899684640 1 --2- 172.21.15.104:0/4106842760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940d18e0 0x7f589415ef90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5888009830 tx=0x7f588802a530 comp rx=0 tx=0).stop 2024-09-17T02:58:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.134+0000 7f5899684640 1 -- 172.21.15.104:0/4106842760 shutdown_connections 2024-09-17T02:58:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.134+0000 7f5899684640 1 --2- 172.21.15.104:0/4106842760 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940d18e0 0x7f589415ef90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:20.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.134+0000 7f5899684640 1 -- 172.21.15.104:0/4106842760 >> 172.21.15.104:0/4106842760 conn(0x7f5894073df0 msgr2=0x7f5894068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:20.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.134+0000 7f5899684640 1 -- 172.21.15.104:0/4106842760 shutdown_connections 2024-09-17T02:58:20.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.134+0000 7f5899684640 1 -- 172.21.15.104:0/4106842760 wait complete. 2024-09-17T02:58:20.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.136+0000 7f5899684640 1 Processor -- start 2024-09-17T02:58:20.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.136+0000 7f5899684640 1 -- start start 2024-09-17T02:58:20.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.137+0000 7f5899684640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940b3b00 0x7f5894160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:20.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.137+0000 7f5899684640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58940b6f70 0x7f589415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.137+0000 7f5899684640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58940d18e0 0x7f58940ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.137+0000 7f5899684640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f58940d3fc0 con 0x7f58940b3b00 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.137+0000 7f5899684640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f58940d3e40 con 0x7f58940d18e0 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.137+0000 7f5899684640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f58940d4140 con 0x7f58940b6f70 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940b3b00 0x7f5894160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940b3b00 0x7f5894160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33926/0 (socket says 172.21.15.104:33926) 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 -- 172.21.15.104:0/3451701046 learned_addr learned my addr 172.21.15.104:0/3451701046 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f58927fc640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58940b6f70 0x7f589415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f58937fe640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58940d18e0 0x7f58940ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 -- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58940b6f70 msgr2=0x7f589415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58940b6f70 0x7f589415bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 -- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58940d18e0 msgr2=0x7f58940ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:20.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58940d18e0 0x7f58940ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 -- 172.21.15.104:0/3451701046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58941f6380 con 0x7f58940b3b00 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f58937fe640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58940d18e0 0x7f58940ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f58927fc640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58940b6f70 0x7f589415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5892ffd640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940b3b00 0x7f5894160ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f588400c430 tx=0x7f588400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f587b7fe640 1 -- 172.21.15.104:0/3451701046 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884011790 con 0x7f58940b3b00 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f587b7fe640 1 -- 172.21.15.104:0/3451701046 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5884017070 con 0x7f58940b3b00 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f587b7fe640 1 -- 172.21.15.104:0/3451701046 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884011ca0 con 0x7f58940b3b00 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58941f6660 con 0x7f58940b3b00 2024-09-17T02:58:20.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.138+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58941f6c20 con 0x7f58940b3b00 2024-09-17T02:58:20.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.139+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58940d4630 con 0x7f58940b3b00 2024-09-17T02:58:20.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.140+0000 7f587b7fe640 1 -- 172.21.15.104:0/3451701046 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f588401c460 con 0x7f58940b3b00 2024-09-17T02:58:20.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.140+0000 7f587b7fe640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5880078b90 0x7f588007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:20.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.141+0000 7f587b7fe640 1 -- 172.21.15.104:0/3451701046 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5227+0+0 (secure 0 0 0) 0x7f588409a9a0 con 0x7f58940b3b00 2024-09-17T02:58:20.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.141+0000 7f58927fc640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5880078b90 0x7f588007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:20.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.141+0000 7f58927fc640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5880078b90 0x7f588007b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5888034000 tx=0x7f5888004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:20.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.145+0000 7f587b7fe640 1 -- 172.21.15.104:0/3451701046 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5884062fd0 con 0x7f58940b3b00 2024-09-17T02:58:20.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.318+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f58940d37d0 con 0x7f58940b3b00 2024-09-17T02:58:20.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.991+0000 7f587b7fe640 1 -- 172.21.15.104:0/3451701046 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) ==== 170+0+0 (secure 0 0 0) 0x7f58840628d0 con 0x7f58940b3b00 2024-09-17T02:58:20.990 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T02:58:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.994+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5880078b90 msgr2=0x7f588007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.994+0000 7f5899684640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5880078b90 0x7f588007b0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5888034000 tx=0x7f5888004730 comp rx=0 tx=0).stop 2024-09-17T02:58:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.994+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940b3b00 msgr2=0x7f5894160ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:20.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.994+0000 7f5899684640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940b3b00 0x7f5894160ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f588400c430 tx=0x7f588400c8f0 comp rx=0 tx=0).stop 2024-09-17T02:58:20.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.996+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 shutdown_connections 2024-09-17T02:58:20.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.996+0000 7f5899684640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5880078b90 0x7f588007b0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:20.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.996+0000 7f5899684640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58940d18e0 0x7f58940ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:20.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.996+0000 7f5899684640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f58940b6f70 0x7f589415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:20.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.996+0000 7f5899684640 1 --2- 172.21.15.104:0/3451701046 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f58940b3b00 0x7f5894160ef0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:20.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.996+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 >> 172.21.15.104:0/3451701046 conn(0x7f5894073df0 msgr2=0x7f589415e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.997+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 shutdown_connections 2024-09-17T02:58:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:20.997+0000 7f5899684640 1 -- 172.21.15.104:0/3451701046 wait complete. 2024-09-17T02:58:21.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T02:58:21.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.135+0000 7f550135e640 1 -- 172.21.15.104:0/3462854005 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e8004800 msgr2=0x7f54e8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:21.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.135+0000 7f550135e640 1 --2- 172.21.15.104:0/3462854005 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54e8004800 0x7f54e8004c10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f54e400c470 tx=0x7f54e8005830 comp rx=0 tx=0).stop 2024-09-17T02:58:21.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.135+0000 7f54fb7fe640 1 -- 172.21.15.104:0/3462854005 reap_dead start 2024-09-17T02:58:21.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.135+0000 7f550135e640 1 -- 172.21.15.104:0/3462854005 shutdown_connections 2024-09-17T02:58:21.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.135+0000 7f550135e640 1 -- 172.21.15.104:0/3462854005 >> 172.21.15.104:0/3462854005 conn(0x7f54fc0d28e0 msgr2=0x7f54fc0d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:21.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.135+0000 7f550135e640 1 -- 172.21.15.104:0/3462854005 shutdown_connections 2024-09-17T02:58:21.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.135+0000 7f550135e640 1 -- 172.21.15.104:0/3462854005 wait complete. 2024-09-17T02:58:21.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.137+0000 7f550135e640 1 Processor -- start 2024-09-17T02:58:21.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.137+0000 7f550135e640 1 -- start start 2024-09-17T02:58:21.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f550135e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54e8004800 0x7f54fc1f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:21.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f550135e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54fc150240 0x7f54fc0b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:21.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f550135e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54fc14d800 0x7f54fc14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:21.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f550135e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0b5ac0 con 0x7f54fc150240 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f550135e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0b5940 con 0x7f54fc14d800 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f550135e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc0ceff0 con 0x7f54e8004800 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f54f27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54fc150240 0x7f54fc0b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f54f27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54fc150240 0x7f54fc0b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33944/0 (socket says 172.21.15.104:33944) 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.138+0000 7f54f27fc640 1 -- 172.21.15.104:0/1253940811 learned_addr learned my addr 172.21.15.104:0/1253940811 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54faffd640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54e8004800 0x7f54fc1f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54fb7fe640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54fc14d800 0x7f54fc14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f27fc640 1 -- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54e8004800 msgr2=0x7f54fc1f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f27fc640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54e8004800 0x7f54fc1f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f27fc640 1 -- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54fc14d800 msgr2=0x7f54fc14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f27fc640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54fc14d800 0x7f54fc14dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f27fc640 1 -- 172.21.15.104:0/1253940811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc0c6720 con 0x7f54fc150240 2024-09-17T02:58:21.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f27fc640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54fc150240 0x7f54fc0b2f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f54e4000c00 tx=0x7f54e4006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:21.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f3fff640 1 -- 172.21.15.104:0/1253940811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4006660 con 0x7f54fc150240 2024-09-17T02:58:21.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f3fff640 1 -- 172.21.15.104:0/1253940811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54e402b740 con 0x7f54fc150240 2024-09-17T02:58:21.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54fc1f70f0 con 0x7f54fc150240 2024-09-17T02:58:21.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f54f3fff640 1 -- 172.21.15.104:0/1253940811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e402bb50 con 0x7f54fc150240 2024-09-17T02:58:21.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.139+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54fc1f76b0 con 0x7f54fc150240 2024-09-17T02:58:21.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.140+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54fc0cdad0 con 0x7f54fc150240 2024-09-17T02:58:21.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.141+0000 7f54f3fff640 1 -- 172.21.15.104:0/1253940811 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54e4046020 con 0x7f54fc150240 2024-09-17T02:58:21.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.142+0000 7f54f3fff640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54dc078b90 0x7f54dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:21.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.142+0000 7f54f3fff640 1 -- 172.21.15.104:0/1253940811 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5609+0+0 (secure 0 0 0) 0x7f54e40bb150 con 0x7f54fc150240 2024-09-17T02:58:21.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.142+0000 7f54faffd640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54dc078b90 0x7f54dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:21.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.143+0000 7f54faffd640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54dc078b90 0x7f54dc07b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0058e0 tx=0x7f54ec005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:21.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.146+0000 7f54f3fff640 1 -- 172.21.15.104:0/1253940811 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f54e404d020 con 0x7f54fc150240 2024-09-17T02:58:21.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:21.351+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f54fc075250 con 0x7f54fc150240 2024-09-17T02:58:22.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.014+0000 7f54f3fff640 1 -- 172.21.15.104:0/1253940811 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v32) ==== 174+0+0 (secure 0 0 0) 0x7f54fc0cd330 con 0x7f54fc150240 2024-09-17T02:58:22.015 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 10 and data pool 11 2024-09-17T02:58:22.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.020+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54dc078b90 msgr2=0x7f54dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.020+0000 7f550135e640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54dc078b90 0x7f54dc07b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0058e0 tx=0x7f54ec005f30 comp rx=0 tx=0).stop 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.020+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54fc150240 msgr2=0x7f54fc0b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.021+0000 7f550135e640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54fc150240 0x7f54fc0b2f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f54e4000c00 tx=0x7f54e4006060 comp rx=0 tx=0).stop 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.021+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 shutdown_connections 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.021+0000 7f550135e640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f54dc078b90 0x7f54dc07b0a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.021+0000 7f550135e640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54fc14d800 0x7f54fc14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.021+0000 7f550135e640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54fc150240 0x7f54fc0b2f40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.021+0000 7f550135e640 1 --2- 172.21.15.104:0/1253940811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54e8004800 0x7f54fc1f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.021+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 >> 172.21.15.104:0/1253940811 conn(0x7f54fc0d28e0 msgr2=0x7f54fc15c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.021+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 shutdown_connections 2024-09-17T02:58:22.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.023+0000 7f550135e640 1 -- 172.21.15.104:0/1253940811 wait complete. 2024-09-17T02:58:22.037 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:58:22.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.149+0000 7f39252de640 1 -- 172.21.15.104:0/1679584715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3908004800 msgr2=0x7f3908004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.149+0000 7f39252de640 1 --2- 172.21.15.104:0/1679584715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3908004800 0x7f3908004c10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f391400baf0 tx=0x7f3908005830 comp rx=0 tx=0).stop 2024-09-17T02:58:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.149+0000 7f39252de640 1 -- 172.21.15.104:0/1679584715 shutdown_connections 2024-09-17T02:58:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.149+0000 7f39252de640 1 --2- 172.21.15.104:0/1679584715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3908004800 0x7f3908004c10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.149+0000 7f39252de640 1 -- 172.21.15.104:0/1679584715 >> 172.21.15.104:0/1679584715 conn(0x7f39200b44a0 msgr2=0x7f39200b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.149+0000 7f39252de640 1 -- 172.21.15.104:0/1679584715 shutdown_connections 2024-09-17T02:58:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.149+0000 7f39252de640 1 -- 172.21.15.104:0/1679584715 wait complete. 2024-09-17T02:58:22.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.151+0000 7f39252de640 1 Processor -- start 2024-09-17T02:58:22.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.151+0000 7f39252de640 1 -- start start 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39252de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3908004800 0x7f39201604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39252de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f392014b380 0x7f39200c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39252de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f392014b8d0 0x7f39200c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39252de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f39200b39c0 con 0x7f392014b8d0 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39252de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39200b5a40 con 0x7f392014b380 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39252de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f39200b3b40 con 0x7f3908004800 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f392014b8d0 0x7f39200c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f392014b8d0 0x7f39200c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33968/0 (socket says 172.21.15.104:33968) 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 -- 172.21.15.104:0/4146748327 learned_addr learned my addr 172.21.15.104:0/4146748327 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391effd640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3908004800 0x7f39201604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391e7fc640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f392014b380 0x7f39200c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 -- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3908004800 msgr2=0x7f39201604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3908004800 0x7f39201604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 -- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f392014b380 msgr2=0x7f39200c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f392014b380 0x7f39200c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 -- 172.21.15.104:0/4146748327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200b2210 con 0x7f392014b8d0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f391f7fe640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f392014b8d0 0x7f39200c79a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3920073110 tx=0x7f391800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39077fe640 1 -- 172.21.15.104:0/4146748327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391800f880 con 0x7f392014b8d0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39077fe640 1 -- 172.21.15.104:0/4146748327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3918016070 con 0x7f392014b8d0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39200b2480 con 0x7f392014b8d0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39077fe640 1 -- 172.21.15.104:0/4146748327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391800fdb0 con 0x7f392014b8d0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.153+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39200c9290 con 0x7f392014b8d0 2024-09-17T02:58:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.154+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39200b40a0 con 0x7f392014b8d0 2024-09-17T02:58:22.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.155+0000 7f39077fe640 1 -- 172.21.15.104:0/4146748327 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f391801b460 con 0x7f392014b8d0 2024-09-17T02:58:22.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.156+0000 7f39077fe640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f390c078bc0 0x7f390c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.156+0000 7f39077fe640 1 -- 172.21.15.104:0/4146748327 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f391809ade0 con 0x7f392014b8d0 2024-09-17T02:58:22.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.156+0000 7f391effd640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f390c078bc0 0x7f390c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.157+0000 7f391effd640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f390c078bc0 0x7f390c07b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3910000fd0 tx=0x7f3910006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:22.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.161+0000 7f39077fe640 1 -- 172.21.15.104:0/4146748327 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3918063220 con 0x7f392014b8d0 2024-09-17T02:58:22.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.334+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39200c6260 con 0x7f392014b8d0 2024-09-17T02:58:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.335+0000 7f39077fe640 1 -- 172.21.15.104:0/4146748327 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16789 (secure 0 0 0) 0x7f3918062b20 con 0x7f392014b8d0 2024-09-17T02:58:22.335 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:22.335 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":82,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:58:21.353675+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:58:18.993978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T02:58:20.323190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:58:22.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.337+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f390c078bc0 msgr2=0x7f390c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.337+0000 7f39252de640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f390c078bc0 0x7f390c07b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3910000fd0 tx=0x7f3910006040 comp rx=0 tx=0).stop 2024-09-17T02:58:22.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.337+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f392014b8d0 msgr2=0x7f39200c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.337+0000 7f39252de640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f392014b8d0 0x7f39200c79a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3920073110 tx=0x7f391800d950 comp rx=0 tx=0).stop 2024-09-17T02:58:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.338+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 shutdown_connections 2024-09-17T02:58:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.338+0000 7f39252de640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f390c078bc0 0x7f390c07b0d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.338+0000 7f39252de640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f392014b380 0x7f39200c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.338+0000 7f39252de640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f392014b8d0 0x7f39200c79a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.338+0000 7f39252de640 1 --2- 172.21.15.104:0/4146748327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3908004800 0x7f39201604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.338+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 >> 172.21.15.104:0/4146748327 conn(0x7f39200b44a0 msgr2=0x7f39200d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.338+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 shutdown_connections 2024-09-17T02:58:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.338+0000 7f39252de640 1 -- 172.21.15.104:0/4146748327 wait complete. 2024-09-17T02:58:22.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:58:22.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.463+0000 7fe10fbe4640 1 -- 172.21.15.104:0/2640778137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080cdf10 msgr2=0x7fe1080b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.463+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/2640778137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080cdf10 0x7fe1080b57e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8005fd0 tx=0x7fe0f802a530 comp rx=0 tx=0).stop 2024-09-17T02:58:22.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.463+0000 7fe10fbe4640 1 -- 172.21.15.104:0/2640778137 shutdown_connections 2024-09-17T02:58:22.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.463+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/2640778137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080b5d20 0x7fe1080cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.463+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/2640778137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080cdf10 0x7fe1080b57e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.463+0000 7fe10fbe4640 1 -- 172.21.15.104:0/2640778137 >> 172.21.15.104:0/2640778137 conn(0x7fe1080b44a0 msgr2=0x7fe1080b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:22.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.463+0000 7fe10fbe4640 1 -- 172.21.15.104:0/2640778137 shutdown_connections 2024-09-17T02:58:22.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.463+0000 7fe10fbe4640 1 -- 172.21.15.104:0/2640778137 wait complete. 2024-09-17T02:58:22.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.465+0000 7fe10fbe4640 1 Processor -- start 2024-09-17T02:58:22.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.465+0000 7fe10fbe4640 1 -- start start 2024-09-17T02:58:22.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10fbe4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080b4fc0 0x7fe10814edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10fbe4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1080b5d20 0x7fe1081f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10fbe4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080cdf10 0x7fe1081f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10fbe4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe108160f50 con 0x7fe1080b4fc0 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10fbe4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe1080d0210 con 0x7fe1080b5d20 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10fbe4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe1081610d0 con 0x7fe1080cdf10 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080b4fc0 0x7fe10814edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080b4fc0 0x7fe10814edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:33984/0 (socket says 172.21.15.104:33984) 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 -- 172.21.15.104:0/1068225753 learned_addr learned my addr 172.21.15.104:0/1068225753 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d17f640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1080b5d20 0x7fe1081f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10e181640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080cdf10 0x7fe1081f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 -- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080cdf10 msgr2=0x7fe1081f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080cdf10 0x7fe1081f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 -- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1080b5d20 msgr2=0x7fe1081f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1080b5d20 0x7fe1081f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 -- 172.21.15.104:0/1068225753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe108160570 con 0x7fe1080b4fc0 2024-09-17T02:58:22.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.466+0000 7fe10d980640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080b4fc0 0x7fe10814edd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe10400b420 tx=0x7fe10400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:22.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.467+0000 7fe0fe7fc640 1 -- 172.21.15.104:0/1068225753 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104011830 con 0x7fe1080b4fc0 2024-09-17T02:58:22.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.467+0000 7fe0fe7fc640 1 -- 172.21.15.104:0/1068225753 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe104016070 con 0x7fe1080b4fc0 2024-09-17T02:58:22.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.467+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10814f310 con 0x7fe1080b4fc0 2024-09-17T02:58:22.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.467+0000 7fe0fe7fc640 1 -- 172.21.15.104:0/1068225753 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104011d60 con 0x7fe1080b4fc0 2024-09-17T02:58:22.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.467+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe108160af0 con 0x7fe1080b4fc0 2024-09-17T02:58:22.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.468+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1080cfa80 con 0x7fe1080b4fc0 2024-09-17T02:58:22.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.469+0000 7fe0fe7fc640 1 -- 172.21.15.104:0/1068225753 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe10401b460 con 0x7fe1080b4fc0 2024-09-17T02:58:22.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.469+0000 7fe0fe7fc640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.469+0000 7fe0fe7fc640 1 -- 172.21.15.104:0/1068225753 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fe10409ab70 con 0x7fe1080b4fc0 2024-09-17T02:58:22.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.469+0000 7fe10d17f640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.470+0000 7fe10d17f640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8033000 tx=0x7fe0f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:22.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.474+0000 7fe0fe7fc640 1 -- 172.21.15.104:0/1068225753 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe108160570 con 0x7fe1080b4fc0 2024-09-17T02:58:22.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.649+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1080a09d0 con 0x7fe1080b4fc0 2024-09-17T02:58:22.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.650+0000 7fe0fe7fc640 1 -- 172.21.15.104:0/1068225753 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16789 (secure 0 0 0) 0x7fe104062fb0 con 0x7fe1080b4fc0 2024-09-17T02:58:22.650 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:22.650 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":82,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:58:21.353675+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:58:18.993978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T02:58:20.323190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:58:22.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0ec078b90 msgr2=0x7fe0ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8033000 tx=0x7fe0f8004730 comp rx=0 tx=0).stop 2024-09-17T02:58:22.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080b4fc0 msgr2=0x7fe10814edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080b4fc0 0x7fe10814edd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe10400b420 tx=0x7fe10400b8e0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 shutdown_connections 2024-09-17T02:58:22.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0ec078b90 0x7fe0ec07b0a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1080b5d20 0x7fe1081f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1080cdf10 0x7fe1081f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 --2- 172.21.15.104:0/1068225753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1080b4fc0 0x7fe10814edd0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 >> 172.21.15.104:0/1068225753 conn(0x7fe1080b44a0 msgr2=0x7fe1080b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:22.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 shutdown_connections 2024-09-17T02:58:22.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.652+0000 7fe10fbe4640 1 -- 172.21.15.104:0/1068225753 wait complete. 2024-09-17T02:58:22.664 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T02:58:22.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.780+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/3709479328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 msgr2=0x7f6ef00b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.780+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/3709479328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 0x7f6ef00b6d30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8005fd0 tx=0x7f6ee802aae0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.780+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/3709479328 shutdown_connections 2024-09-17T02:58:22.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.780+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/3709479328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 0x7f6ef00b6d30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.780+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/3709479328 >> v2:172.21.15.192:3300/0 conn(0x7f6ef00d0ff0 0x7f6ef0160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.780+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/3709479328 >> 172.21.15.104:0/3709479328 conn(0x7f6ef00b44a0 msgr2=0x7f6ef00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:22.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.780+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/3709479328 shutdown_connections 2024-09-17T02:58:22.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.780+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/3709479328 wait complete. 2024-09-17T02:58:22.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.782+0000 7f6ef4bb0640 1 Processor -- start 2024-09-17T02:58:22.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.782+0000 7f6ef4bb0640 1 -- start start 2024-09-17T02:58:22.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6ef4bb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 0x7f6ef0152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6ef4bb0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ef00d0ff0 0x7f6ef00cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6ef4bb0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ef00d1400 0x7f6ef00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6ef4bb0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef00b7270 con 0x7f6ef00b6920 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6ef4bb0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0161cb0 con 0x7f6ef00d1400 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6ef4bb0640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef00b73f0 con 0x7f6ef00d0ff0 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6eee59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 0x7f6ef0152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6eee59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 0x7f6ef0152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34012/0 (socket says 172.21.15.104:34012) 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6eee59c640 1 -- 172.21.15.104:0/1641563922 learned_addr learned my addr 172.21.15.104:0/1641563922 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6eeed9d640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ef00d1400 0x7f6ef00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.783+0000 7f6ee5d9b640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ef00d0ff0 0x7f6ef00cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6eee59c640 1 -- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ef00d0ff0 msgr2=0x7f6ef00cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.784 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6eee59c640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ef00d0ff0 0x7f6ef00cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6eee59c640 1 -- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ef00d1400 msgr2=0x7f6ef00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6eee59c640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ef00d1400 0x7f6ef00cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6eee59c640 1 -- 172.21.15.104:0/1641563922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef00c81e0 con 0x7f6ef00b6920 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6eee59c640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 0x7f6ef0152950 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000d6d0 tx=0x7f6ee000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6ee77fe640 1 -- 172.21.15.104:0/1641563922 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0017070 con 0x7f6ef00b6920 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6ee77fe640 1 -- 172.21.15.104:0/1641563922 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ee0004310 con 0x7f6ef00b6920 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef00c84c0 con 0x7f6ef00b6920 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6ee77fe640 1 -- 172.21.15.104:0/1641563922 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0009a20 con 0x7f6ef00b6920 2024-09-17T02:58:22.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.784+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef00c8a80 con 0x7f6ef00b6920 2024-09-17T02:58:22.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.785+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef00d0920 con 0x7f6ef00b6920 2024-09-17T02:58:22.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.786+0000 7f6ee77fe640 1 -- 172.21.15.104:0/1641563922 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ee00035f0 con 0x7f6ef00b6920 2024-09-17T02:58:22.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.786+0000 7f6ee77fe640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078b90 0x7f6ed007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:22.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.787+0000 7f6ee77fe640 1 -- 172.21.15.104:0/1641563922 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f6ee009ac20 con 0x7f6ef00b6920 2024-09-17T02:58:22.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.787+0000 7f6ee5d9b640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078b90 0x7f6ed007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:22.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.787+0000 7f6ee5d9b640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078b90 0x7f6ed007b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00b2c40 tx=0x7f6ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:22.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:22.791+0000 7f6ee77fe640 1 -- 172.21.15.104:0/1641563922 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ee0062a10 con 0x7f6ef00b6920 2024-09-17T02:58:23.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.000+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6ef00b3300 con 0x7f6ef00b6920 2024-09-17T02:58:23.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.018+0000 7f6ee77fe640 1 -- 172.21.15.104:0/1641563922 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7f6ee0067440 con 0x7f6ef00b6920 2024-09-17T02:58:23.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078b90 msgr2=0x7f6ed007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:23.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078b90 0x7f6ed007b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00b2c40 tx=0x7f6ed8009040 comp rx=0 tx=0).stop 2024-09-17T02:58:23.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 msgr2=0x7f6ef0152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:23.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 0x7f6ef0152950 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000d6d0 tx=0x7f6ee000db90 comp rx=0 tx=0).stop 2024-09-17T02:58:23.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 shutdown_connections 2024-09-17T02:58:23.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6ed0078b90 0x7f6ed007b0a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ef00d1400 0x7f6ef00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ef00d0ff0 0x7f6ef00cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 --2- 172.21.15.104:0/1641563922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6ef00b6920 0x7f6ef0152950 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 >> 172.21.15.104:0/1641563922 conn(0x7f6ef00b44a0 msgr2=0x7f6ef00b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:23.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 shutdown_connections 2024-09-17T02:58:23.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.020+0000 7f6ef4bb0640 1 -- 172.21.15.104:0/1641563922 wait complete. 2024-09-17T02:58:23.031 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T02:58:23.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T02:58:23.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 -- 172.21.15.104:0/1732861580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 msgr2=0x7f2f0c15f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:23.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 --2- 172.21.15.104:0/1732861580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 0x7f2f0c15f690 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0724b0 tx=0x7f2f0402aa30 comp rx=0 tx=0).stop 2024-09-17T02:58:23.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 -- 172.21.15.104:0/1732861580 shutdown_connections 2024-09-17T02:58:23.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 --2- 172.21.15.104:0/1732861580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 0x7f2f0c15f690 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 --2- 172.21.15.104:0/1732861580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c06fa80 0x7f2f0c073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 --2- 172.21.15.104:0/1732861580 >> v2:172.21.15.192:3300/0 conn(0x7f2f0c152ce0 0x7f2f0c06f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 -- 172.21.15.104:0/1732861580 >> 172.21.15.104:0/1732861580 conn(0x7f2f0c0b3640 msgr2=0x7f2f0c0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:23.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 -- 172.21.15.104:0/1732861580 shutdown_connections 2024-09-17T02:58:23.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.147+0000 7f2f11084640 1 -- 172.21.15.104:0/1732861580 wait complete. 2024-09-17T02:58:23.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.149+0000 7f2f11084640 1 Processor -- start 2024-09-17T02:58:23.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.149+0000 7f2f11084640 1 -- start start 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.150+0000 7f2f11084640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c06fa80 0x7f2f0c141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.150+0000 7f2f11084640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 0x7f2f0c13e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f11084640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c152ce0 0x7f2f0c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f11084640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c15ff60 con 0x7f2f0c073ac0 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f11084640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0c15fde0 con 0x7f2f0c152ce0 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f11084640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0c1600e0 con 0x7f2f0c06fa80 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 0x7f2f0c13e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 0x7f2f0c13e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:34028/0 (socket says 172.21.15.104:34028) 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 -- 172.21.15.104:0/2070353991 learned_addr learned my addr 172.21.15.104:0/2070353991 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0ad9d640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c06fa80 0x7f2f0c141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:23.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0b59e640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c152ce0 0x7f2f0c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 -- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c06fa80 msgr2=0x7f2f0c141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c06fa80 0x7f2f0c141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 -- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c152ce0 msgr2=0x7f2f0c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c152ce0 0x7f2f0c068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 -- 172.21.15.104:0/2070353991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0c15baa0 con 0x7f2f0c073ac0 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f0a59c640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 0x7f2f0c13e880 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400d5f0 tx=0x7f2ef400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f037fe640 1 -- 172.21.15.104:0/2070353991 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4017070 con 0x7f2f0c073ac0 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f037fe640 1 -- 172.21.15.104:0/2070353991 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ef4005330 con 0x7f2f0c073ac0 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f037fe640 1 -- 172.21.15.104:0/2070353991 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40047a0 con 0x7f2f0c073ac0 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0c1f6ea0 con 0x7f2f0c073ac0 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.151+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0c13edc0 con 0x7f2f0c073ac0 2024-09-17T02:58:23.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.152+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f0c15f690 con 0x7f2f0c073ac0 2024-09-17T02:58:23.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.153+0000 7f2f037fe640 1 -- 172.21.15.104:0/2070353991 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ef4004940 con 0x7f2f0c073ac0 2024-09-17T02:58:23.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.154+0000 7f2f037fe640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2eec078b90 0x7f2eec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:23.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.154+0000 7f2f037fe640 1 -- 172.21.15.104:0/2070353991 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f2ef409aca0 con 0x7f2f0c073ac0 2024-09-17T02:58:23.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.154+0000 7f2f0ad9d640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2eec078b90 0x7f2eec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:23.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.155+0000 7f2f0ad9d640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2eec078b90 0x7f2eec07b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c073380 tx=0x7f2efc00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:23.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.158+0000 7f2f037fe640 1 -- 172.21.15.104:0/2070353991 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ef4062aa0 con 0x7f2f0c073ac0 2024-09-17T02:58:23.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:23.371+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2f0c06f5e0 con 0x7f2f0c073ac0 2024-09-17T02:58:23.987 INFO:tasks.ceph.mds.a.smithi104.stderr:2024-09-17T02:58:23.987+0000 7f927ac0b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T02:58:24.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.024+0000 7f2f037fe640 1 -- 172.21.15.104:0/2070353991 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f2ef40674d0 con 0x7f2f0c073ac0 2024-09-17T02:58:24.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2eec078b90 msgr2=0x7f2eec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2eec078b90 0x7f2eec07b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c073380 tx=0x7f2efc00b2e0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 msgr2=0x7f2f0c13e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 0x7f2f0c13e880 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400d5f0 tx=0x7f2ef400dab0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 shutdown_connections 2024-09-17T02:58:24.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2eec078b90 0x7f2eec07b0a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c152ce0 0x7f2f0c068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f0c073ac0 0x7f2f0c13e880 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 --2- 172.21.15.104:0/2070353991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f0c06fa80 0x7f2f0c141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 >> 172.21.15.104:0/2070353991 conn(0x7f2f0c0b3640 msgr2=0x7f2f0c1542d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:24.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 shutdown_connections 2024-09-17T02:58:24.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.027+0000 7f2f11084640 1 -- 172.21.15.104:0/2070353991 wait complete. 2024-09-17T02:58:24.040 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T02:58:24.040 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:58:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.158+0000 7fb4e1f28640 1 -- 172.21.15.104:0/2772576980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0b2630 msgr2=0x7fb4dc0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.158+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/2772576980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0b2630 0x7fb4dc0b2a40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0d2500 tx=0x7fb4d402a9a0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.158+0000 7fb4e1f28640 1 -- 172.21.15.104:0/2772576980 shutdown_connections 2024-09-17T02:58:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.158+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/2772576980 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0b2630 0x7fb4dc0b2a40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.158+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/2772576980 >> v2:172.21.15.192:3300/0 conn(0x7fb4dc0b7c80 0x7fb4dc0b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.158+0000 7fb4e1f28640 1 -- 172.21.15.104:0/2772576980 >> 172.21.15.104:0/2772576980 conn(0x7fb4dc0d2970 msgr2=0x7fb4dc0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.158+0000 7fb4e1f28640 1 -- 172.21.15.104:0/2772576980 shutdown_connections 2024-09-17T02:58:24.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.158+0000 7fb4e1f28640 1 -- 172.21.15.104:0/2772576980 wait complete. 2024-09-17T02:58:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.160+0000 7fb4e1f28640 1 Processor -- start 2024-09-17T02:58:24.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.160+0000 7fb4e1f28640 1 -- start start 2024-09-17T02:58:24.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4e1f28640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4dc0b2630 0x7fb4dc0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4e1f28640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4dc0b7c80 0x7fb4dc1ea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4e1f28640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0d3490 0x7fb4dc1e7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4e1f28640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc0b6bd0 con 0x7fb4dc0d3490 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4e1f28640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc0b6a50 con 0x7fb4dc0b7c80 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4e1f28640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb4dc0b6d50 con 0x7fb4dc0b2630 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4dbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0d3490 0x7fb4dc1e7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4dbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0d3490 0x7fb4dc1e7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60842/0 (socket says 172.21.15.104:60842) 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.161+0000 7fb4dbfff640 1 -- 172.21.15.104:0/3757667454 learned_addr learned my addr 172.21.15.104:0/3757667454 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4db7fe640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4dc0b2630 0x7fb4dc0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4daffd640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4dc0b7c80 0x7fb4dc1ea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4dbfff640 1 -- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4dc0b2630 msgr2=0x7fb4dc0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4dbfff640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4dc0b2630 0x7fb4dc0c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4dbfff640 1 -- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4dc0b7c80 msgr2=0x7fb4dc1ea4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4dbfff640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4dc0b7c80 0x7fb4dc1ea4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4dbfff640 1 -- 172.21.15.104:0/3757667454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4dc0c9360 con 0x7fb4dc0d3490 2024-09-17T02:58:24.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4daffd640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4dc0b7c80 0x7fb4dc1ea4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:24.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4dbfff640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0d3490 0x7fb4dc1e7bf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4005fd0 tx=0x7fb4d4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:24.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4c3fff640 1 -- 172.21.15.104:0/3757667454 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4033050 con 0x7fb4dc0d3490 2024-09-17T02:58:24.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4c3fff640 1 -- 172.21.15.104:0/3757667454 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4d40044d0 con 0x7fb4dc0d3490 2024-09-17T02:58:24.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4dc0cab30 con 0x7fb4dc0d3490 2024-09-17T02:58:24.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4c3fff640 1 -- 172.21.15.104:0/3757667454 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4038450 con 0x7fb4dc0d3490 2024-09-17T02:58:24.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.162+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4dc0cb0f0 con 0x7fb4dc0d3490 2024-09-17T02:58:24.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.163+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4dc0b2a40 con 0x7fb4dc0d3490 2024-09-17T02:58:24.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.164+0000 7fb4c3fff640 1 -- 172.21.15.104:0/3757667454 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4d4036070 con 0x7fb4dc0d3490 2024-09-17T02:58:24.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.164+0000 7fb4c3fff640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb4c8078b90 0x7fb4c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.164+0000 7fb4c3fff640 1 -- 172.21.15.104:0/3757667454 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fb4d40bc000 con 0x7fb4dc0d3490 2024-09-17T02:58:24.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.165+0000 7fb4db7fe640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb4c8078b90 0x7fb4c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.165+0000 7fb4db7fe640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb4c8078b90 0x7fb4c807b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0015e0 tx=0x7fb4cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:24.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.169+0000 7fb4c3fff640 1 -- 172.21.15.104:0/3757667454 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb4d40844d0 con 0x7fb4dc0d3490 2024-09-17T02:58:24.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.378+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4dc1ead00 con 0x7fb4dc0d3490 2024-09-17T02:58:24.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.379+0000 7fb4c3fff640 1 -- 172.21.15.104:0/3757667454 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5234 (secure 0 0 0) 0x7fb4d4083dd0 con 0x7fb4dc0d3490 2024-09-17T02:58:24.379 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:24.380 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"btime":"2024-09-17T02:58:24:019923+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2179511021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2179511021},{"type":"v1","addr":"172.21.15.192:6836","nonce":2179511021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1325951818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1325951818},{"type":"v1","addr":"172.21.15.192:6837","nonce":1325951818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3545243059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3545243059},{"type":"v1","addr":"172.21.15.104:6834","nonce":3545243059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:58:21.353636+0000","modified":"2024-09-17T02:58:23.373377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/233806124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":233806124},{"type":"v1","addr":"172.21.15.104:6835","nonce":233806124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":5}]} 2024-09-17T02:58:24.380 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 34 2024-09-17T02:58:24.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb4c8078b90 msgr2=0x7fb4c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb4c8078b90 0x7fb4c807b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0015e0 tx=0x7fb4cc009040 comp rx=0 tx=0).stop 2024-09-17T02:58:24.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0d3490 msgr2=0x7fb4dc1e7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0d3490 0x7fb4dc1e7bf0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4005fd0 tx=0x7fb4d4003f70 comp rx=0 tx=0).stop 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 shutdown_connections 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb4c8078b90 0x7fb4c807b0a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4dc0b7c80 0x7fb4dc1ea4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb4dc0d3490 0x7fb4dc1e7bf0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 --2- 172.21.15.104:0/3757667454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb4dc0b2630 0x7fb4dc0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.381+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 >> 172.21.15.104:0/3757667454 conn(0x7fb4dc0d2970 msgr2=0x7fb4dc06d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.382+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 shutdown_connections 2024-09-17T02:58:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.382+0000 7fb4e1f28640 1 -- 172.21.15.104:0/3757667454 wait complete. 2024-09-17T02:58:24.393 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 -- 172.21.15.104:0/2928122292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 msgr2=0x7f551c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 --2- 172.21.15.104:0/2928122292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 0x7f551c0cdc00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f551c0b6aa0 tx=0x7f551802a4f0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 -- 172.21.15.104:0/2928122292 shutdown_connections 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 --2- 172.21.15.104:0/2928122292 >> v2:172.21.15.192:3300/0 conn(0x7f551c073920 0x7f551c0d2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 --2- 172.21.15.104:0/2928122292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f551c073510 0x7f551c0d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 --2- 172.21.15.104:0/2928122292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 0x7f551c0cdc00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 -- 172.21.15.104:0/2928122292 >> 172.21.15.104:0/2928122292 conn(0x7f551c06cfc0 msgr2=0x7f551c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 -- 172.21.15.104:0/2928122292 shutdown_connections 2024-09-17T02:58:24.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.506+0000 7f552385c640 1 -- 172.21.15.104:0/2928122292 wait complete. 2024-09-17T02:58:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.508+0000 7f552385c640 1 Processor -- start 2024-09-17T02:58:24.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.508+0000 7f552385c640 1 -- start start 2024-09-17T02:58:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f552385c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c073510 0x7f551c0d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f552385c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f551c073920 0x7f551c14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f552385c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 0x7f551c14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f552385c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f551c070e50 con 0x7f551c15bff0 2024-09-17T02:58:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f552385c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f551c070cd0 con 0x7f551c073510 2024-09-17T02:58:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f552385c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f551c070fd0 con 0x7f551c073920 2024-09-17T02:58:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f5521df9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 0x7f551c14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f5521df9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 0x7f551c14b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60862/0 (socket says 172.21.15.104:60862) 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f5521df9640 1 -- 172.21.15.104:0/1205727507 learned_addr learned my addr 172.21.15.104:0/1205727507 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f5520df7640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f551c073920 0x7f551c14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.509+0000 7f55215f8640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c073510 0x7f551c0d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5521df9640 1 -- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f551c073920 msgr2=0x7f551c14b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5521df9640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f551c073920 0x7f551c14b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5521df9640 1 -- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c073510 msgr2=0x7f551c0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5521df9640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c073510 0x7f551c0d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5521df9640 1 -- 172.21.15.104:0/1205727507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c158480 con 0x7f551c15bff0 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5521df9640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 0x7f551c14b600 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f551400e960 tx=0x7f551400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5511ffb640 1 -- 172.21.15.104:0/1205727507 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514004d20 con 0x7f551c15bff0 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5511ffb640 1 -- 172.21.15.104:0/1205727507 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f551400cb20 con 0x7f551c15bff0 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f5511ffb640 1 -- 172.21.15.104:0/1205727507 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514005020 con 0x7f551c15bff0 2024-09-17T02:58:24.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551c1f7220 con 0x7f551c15bff0 2024-09-17T02:58:24.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.510+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f551c1f77e0 con 0x7f551c15bff0 2024-09-17T02:58:24.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.511+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551c0cdc00 con 0x7f551c15bff0 2024-09-17T02:58:24.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.512+0000 7f5511ffb640 1 -- 172.21.15.104:0/1205727507 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55140051c0 con 0x7f551c15bff0 2024-09-17T02:58:24.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.512+0000 7f5511ffb640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5500078b90 0x7f550007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.512+0000 7f5511ffb640 1 -- 172.21.15.104:0/1205727507 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f551409b540 con 0x7f551c15bff0 2024-09-17T02:58:24.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.513+0000 7f55215f8640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5500078b90 0x7f550007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.513+0000 7f55215f8640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5500078b90 0x7f550007b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5518033000 tx=0x7f5518004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:24.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.517+0000 7f5511ffb640 1 -- 172.21.15.104:0/1205727507 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5514016030 con 0x7f551c15bff0 2024-09-17T02:58:24.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.690+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f551c158210 con 0x7f551c15bff0 2024-09-17T02:58:24.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.691+0000 7f5511ffb640 1 -- 172.21.15.104:0/1205727507 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16776 (secure 0 0 0) 0x7f55140633c0 con 0x7f551c15bff0 2024-09-17T02:58:24.690 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:24.691 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":83,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:58:23.003519+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:58:18.993978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T02:58:20.323190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:58:24.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5500078b90 msgr2=0x7f550007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5500078b90 0x7f550007b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5518033000 tx=0x7f5518004730 comp rx=0 tx=0).stop 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 msgr2=0x7f551c14b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 0x7f551c14b600 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f551400e960 tx=0x7f551400ee20 comp rx=0 tx=0).stop 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 shutdown_connections 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5500078b90 0x7f550007b0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f551c15bff0 0x7f551c14b600 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f551c073920 0x7f551c14b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 --2- 172.21.15.104:0/1205727507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c073510 0x7f551c0d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 >> 172.21.15.104:0/1205727507 conn(0x7f551c06cfc0 msgr2=0x7f551c1512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 shutdown_connections 2024-09-17T02:58:24.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.693+0000 7f552385c640 1 -- 172.21.15.104:0/1205727507 wait complete. 2024-09-17T02:58:24.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:58:24.704 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:58:24.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.817+0000 7f9a605ad640 1 -- 172.21.15.104:0/1103261634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a580cefb0 msgr2=0x7f9a580cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.817+0000 7f9a605ad640 1 --2- 172.21.15.104:0/1103261634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a580cefb0 0x7f9a580cf3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b4080 tx=0x7f9a5002a970 comp rx=0 tx=0).stop 2024-09-17T02:58:24.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.817+0000 7f9a605ad640 1 -- 172.21.15.104:0/1103261634 shutdown_connections 2024-09-17T02:58:24.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.817+0000 7f9a605ad640 1 --2- 172.21.15.104:0/1103261634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a580cefb0 0x7f9a580cf3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.817+0000 7f9a605ad640 1 --2- 172.21.15.104:0/1103261634 >> v2:172.21.15.192:3300/0 conn(0x7f9a580b7bb0 0x7f9a580cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.817+0000 7f9a605ad640 1 -- 172.21.15.104:0/1103261634 >> 172.21.15.104:0/1103261634 conn(0x7f9a580d28a0 msgr2=0x7f9a580d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:24.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.817+0000 7f9a605ad640 1 -- 172.21.15.104:0/1103261634 shutdown_connections 2024-09-17T02:58:24.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.817+0000 7f9a605ad640 1 -- 172.21.15.104:0/1103261634 wait complete. 2024-09-17T02:58:24.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.818+0000 7f9a605ad640 1 Processor -- start 2024-09-17T02:58:24.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.819+0000 7f9a605ad640 1 -- start start 2024-09-17T02:58:24.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a605ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a580b7bb0 0x7f9a5814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a605ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a580cefb0 0x7f9a581f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a605ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a580d0470 0x7f9a580710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a605ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580cfa80 con 0x7f9a580d0470 2024-09-17T02:58:24.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a605ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580cf900 con 0x7f9a580cefb0 2024-09-17T02:58:24.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a605ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9a580cfc00 con 0x7f9a580b7bb0 2024-09-17T02:58:24.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5eb4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a580d0470 0x7f9a580710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5eb4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a580d0470 0x7f9a580710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60868/0 (socket says 172.21.15.104:60868) 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5eb4a640 1 -- 172.21.15.104:0/2388711103 learned_addr learned my addr 172.21.15.104:0/2388711103 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5e349640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a580b7bb0 0x7f9a5814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5db48640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a580cefb0 0x7f9a581f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5eb4a640 1 -- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a580b7bb0 msgr2=0x7f9a5814ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5eb4a640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a580b7bb0 0x7f9a5814ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5eb4a640 1 -- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a580cefb0 msgr2=0x7f9a581f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5eb4a640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a580cefb0 0x7f9a581f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.820+0000 7f9a5eb4a640 1 -- 172.21.15.104:0/2388711103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5814b6c0 con 0x7f9a580d0470 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.821+0000 7f9a5eb4a640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a580d0470 0x7f9a580710a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009d60 tx=0x7f9a50003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.821+0000 7f9a4effd640 1 -- 172.21.15.104:0/2388711103 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50034040 con 0x7f9a580d0470 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.821+0000 7f9a4effd640 1 -- 172.21.15.104:0/2388711103 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a50004560 con 0x7f9a580d0470 2024-09-17T02:58:24.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.821+0000 7f9a4effd640 1 -- 172.21.15.104:0/2388711103 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50045480 con 0x7f9a580d0470 2024-09-17T02:58:24.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.821+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5814b9a0 con 0x7f9a580d0470 2024-09-17T02:58:24.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.821+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a58149130 con 0x7f9a580d0470 2024-09-17T02:58:24.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.822+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5814b430 con 0x7f9a580d0470 2024-09-17T02:58:24.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.823+0000 7f9a4effd640 1 -- 172.21.15.104:0/2388711103 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a50037020 con 0x7f9a580d0470 2024-09-17T02:58:24.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.823+0000 7f9a4effd640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a3c078bc0 0x7f9a3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:24.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.823+0000 7f9a4effd640 1 -- 172.21.15.104:0/2388711103 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f9a500bc420 con 0x7f9a580d0470 2024-09-17T02:58:24.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.823+0000 7f9a5e349640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a3c078bc0 0x7f9a3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:24.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.824+0000 7f9a5e349640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a3c078bc0 0x7f9a3c07b0d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009b90 tx=0x7f9a54005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:24.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.827+0000 7f9a4effd640 1 -- 172.21.15.104:0/2388711103 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a500848f0 con 0x7f9a580d0470 2024-09-17T02:58:24.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:24.997+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a58149390 con 0x7f9a3c078bc0 2024-09-17T02:58:25.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.002+0000 7f9a4effd640 1 -- 172.21.15.104:0/2388711103 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242336 (secure 0 0 0) 0x7f9a58149390 con 0x7f9a3c078bc0 2024-09-17T02:58:25.004 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:25.005 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:58:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.004+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a3c078bc0 msgr2=0x7f9a3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.004+0000 7f9a605ad640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a3c078bc0 0x7f9a3c07b0d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a54009b90 tx=0x7f9a54005f30 comp rx=0 tx=0).stop 2024-09-17T02:58:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.004+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a580d0470 msgr2=0x7f9a580710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.004+0000 7f9a605ad640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a580d0470 0x7f9a580710a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009d60 tx=0x7f9a50003f90 comp rx=0 tx=0).stop 2024-09-17T02:58:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.004+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 shutdown_connections 2024-09-17T02:58:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.004+0000 7f9a605ad640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a3c078bc0 0x7f9a3c07b0d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.004+0000 7f9a605ad640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a580cefb0 0x7f9a581f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.004+0000 7f9a605ad640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a580d0470 0x7f9a580710a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.005+0000 7f9a605ad640 1 --2- 172.21.15.104:0/2388711103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a580b7bb0 0x7f9a5814ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.005+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 >> 172.21.15.104:0/2388711103 conn(0x7f9a580d28a0 msgr2=0x7f9a580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.005+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 shutdown_connections 2024-09-17T02:58:25.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.005+0000 7f9a605ad640 1 -- 172.21.15.104:0/2388711103 wait complete. 2024-09-17T02:58:25.015 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-17T02:58:23.674451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4432,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558067,"statfs":{"total":1600000000,"available":1595461170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001077"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002072+0000","last_change":"2024-09-17T02:58:21.002072+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002072+0000","last_undegraded":"2024-09-17T02:58:21.002072+0000","last_fullsized":"2024-09-17T02:58:21.002072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995746+0000","last_change":"2024-09-17T02:58:20.995746+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995746+0000","last_undegraded":"2024-09-17T02:58:20.995746+0000","last_fullsized":"2024-09-17T02:58:20.995746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000391+0000","last_change":"2024-09-17T02:58:21.000391+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000391+0000","last_undegraded":"2024-09-17T02:58:21.000391+0000","last_fullsized":"2024-09-17T02:58:21.000391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995861+0000","last_change":"2024-09-17T02:58:20.995861+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995861+0000","last_undegraded":"2024-09-17T02:58:20.995861+0000","last_fullsized":"2024-09-17T02:58:20.995861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001855+0000","last_change":"2024-09-17T02:58:21.001855+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001855+0000","last_undegraded":"2024-09-17T02:58:21.001855+0000","last_fullsized":"2024-09-17T02:58:21.001855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.997223+0000","last_change":"2024-09-17T02:58:20.997223+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.997223+0000","last_undegraded":"2024-09-17T02:58:20.997223+0000","last_fullsized":"2024-09-17T02:58:20.997223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002013+0000","last_change":"2024-09-17T02:58:21.002013+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002013+0000","last_undegraded":"2024-09-17T02:58:21.002013+0000","last_fullsized":"2024-09-17T02:58:21.002013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996890+0000","last_change":"2024-09-17T02:58:20.996890+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996890+0000","last_undegraded":"2024-09-17T02:58:20.996890+0000","last_fullsized":"2024-09-17T02:58:20.996890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001414+0000","last_change":"2024-09-17T02:58:21.001414+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001414+0000","last_undegraded":"2024-09-17T02:58:21.001414+0000","last_fullsized":"2024-09-17T02:58:21.001414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000432+0000","last_change":"2024-09-17T02:58:21.000432+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000432+0000","last_undegraded":"2024-09-17T02:58:21.000432+0000","last_fullsized":"2024-09-17T02:58:21.000432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000798+0000","last_change":"2024-09-17T02:58:21.000798+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000798+0000","last_undegraded":"2024-09-17T02:58:21.000798+0000","last_fullsized":"2024-09-17T02:58:21.000798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995223+0000","last_change":"2024-09-17T02:58:20.995223+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995223+0000","last_undegraded":"2024-09-17T02:58:20.995223+0000","last_fullsized":"2024-09-17T02:58:20.995223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000052+0000","last_change":"2024-09-17T02:58:21.000052+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000052+0000","last_undegraded":"2024-09-17T02:58:21.000052+0000","last_fullsized":"2024-09-17T02:58:21.000052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001039+0000","last_change":"2024-09-17T02:58:21.001039+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001039+0000","last_undegraded":"2024-09-17T02:58:21.001039+0000","last_fullsized":"2024-09-17T02:58:21.001039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999256+0000","last_change":"2024-09-17T02:58:20.999256+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999256+0000","last_undegraded":"2024-09-17T02:58:20.999256+0000","last_fullsized":"2024-09-17T02:58:20.999256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998080+0000","last_change":"2024-09-17T02:58:20.998080+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998080+0000","last_undegraded":"2024-09-17T02:58:20.998080+0000","last_fullsized":"2024-09-17T02:58:20.998080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000794+0000","last_change":"2024-09-17T02:58:21.000794+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000794+0000","last_undegraded":"2024-09-17T02:58:21.000794+0000","last_fullsized":"2024-09-17T02:58:21.000794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994683+0000","last_change":"2024-09-17T02:58:20.994683+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994683+0000","last_undegraded":"2024-09-17T02:58:20.994683+0000","last_fullsized":"2024-09-17T02:58:20.994683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996614+0000","last_change":"2024-09-17T02:58:20.996614+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996614+0000","last_undegraded":"2024-09-17T02:58:20.996614+0000","last_fullsized":"2024-09-17T02:58:20.996614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998650+0000","last_change":"2024-09-17T02:58:20.998650+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998650+0000","last_undegraded":"2024-09-17T02:58:20.998650+0000","last_fullsized":"2024-09-17T02:58:20.998650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998483+0000","last_change":"2024-09-17T02:58:20.998483+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998483+0000","last_undegraded":"2024-09-17T02:58:20.998483+0000","last_fullsized":"2024-09-17T02:58:20.998483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998864+0000","last_change":"2024-09-17T02:58:20.998864+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998864+0000","last_undegraded":"2024-09-17T02:58:20.998864+0000","last_fullsized":"2024-09-17T02:58:20.998864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999615+0000","last_change":"2024-09-17T02:58:20.999615+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999615+0000","last_undegraded":"2024-09-17T02:58:20.999615+0000","last_fullsized":"2024-09-17T02:58:20.999615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000939+0000","last_change":"2024-09-17T02:58:21.000939+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000939+0000","last_undegraded":"2024-09-17T02:58:21.000939+0000","last_fullsized":"2024-09-17T02:58:21.000939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000094+0000","last_change":"2024-09-17T02:58:21.000094+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000094+0000","last_undegraded":"2024-09-17T02:58:21.000094+0000","last_fullsized":"2024-09-17T02:58:21.000094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002578+0000","last_change":"2024-09-17T02:58:21.002578+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002578+0000","last_undegraded":"2024-09-17T02:58:21.002578+0000","last_fullsized":"2024-09-17T02:58:21.002578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000635+0000","last_change":"2024-09-17T02:58:21.000635+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000635+0000","last_undegraded":"2024-09-17T02:58:21.000635+0000","last_fullsized":"2024-09-17T02:58:21.000635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000804+0000","last_change":"2024-09-17T02:58:21.000804+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000804+0000","last_undegraded":"2024-09-17T02:58:21.000804+0000","last_fullsized":"2024-09-17T02:58:21.000804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999738+0000","last_change":"2024-09-17T02:58:20.999738+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999738+0000","last_undegraded":"2024-09-17T02:58:20.999738+0000","last_fullsized":"2024-09-17T02:58:20.999738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000762+0000","last_change":"2024-09-17T02:58:21.000762+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000762+0000","last_undegraded":"2024-09-17T02:58:21.000762+0000","last_fullsized":"2024-09-17T02:58:21.000762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001100+0000","last_change":"2024-09-17T02:58:21.001100+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001100+0000","last_undegraded":"2024-09-17T02:58:21.001100+0000","last_fullsized":"2024-09-17T02:58:21.001100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995225+0000","last_change":"2024-09-17T02:58:20.995225+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995225+0000","last_undegraded":"2024-09-17T02:58:20.995225+0000","last_fullsized":"2024-09-17T02:58:20.995225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000172+0000","last_change":"2024-09-17T02:58:21.000172+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000172+0000","last_undegraded":"2024-09-17T02:58:21.000172+0000","last_fullsized":"2024-09-17T02:58:21.000172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006499+0000","last_change":"2024-09-17T02:58:21.003281+0000","last_active":"2024-09-17T02:58:21.006499+0000","last_peered":"2024-09-17T02:58:21.006499+0000","last_clean":"2024-09-17T02:58:21.006499+0000","last_became_active":"2024-09-17T02:58:21.002339+0000","last_became_peered":"2024-09-17T02:58:21.002339+0000","last_unstale":"2024-09-17T02:58:21.006499+0000","last_undegraded":"2024-09-17T02:58:21.006499+0000","last_fullsized":"2024-09-17T02:58:21.006499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:34.463154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001135+0000","last_change":"2024-09-17T02:58:21.001135+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001135+0000","last_undegraded":"2024-09-17T02:58:21.001135+0000","last_fullsized":"2024-09-17T02:58:21.001135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006875+0000","last_change":"2024-09-17T02:58:21.006659+0000","last_active":"2024-09-17T02:58:21.006875+0000","last_peered":"2024-09-17T02:58:21.006875+0000","last_clean":"2024-09-17T02:58:21.006875+0000","last_became_active":"2024-09-17T02:58:21.005416+0000","last_became_peered":"2024-09-17T02:58:21.005416+0000","last_unstale":"2024-09-17T02:58:21.006875+0000","last_undegraded":"2024-09-17T02:58:21.006875+0000","last_fullsized":"2024-09-17T02:58:21.006875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:43.841299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996769+0000","last_change":"2024-09-17T02:58:20.996769+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996769+0000","last_undegraded":"2024-09-17T02:58:20.996769+0000","last_fullsized":"2024-09-17T02:58:20.996769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006369+0000","last_change":"2024-09-17T02:58:21.006096+0000","last_active":"2024-09-17T02:58:21.006369+0000","last_peered":"2024-09-17T02:58:21.006369+0000","last_clean":"2024-09-17T02:58:21.006369+0000","last_became_active":"2024-09-17T02:58:21.005526+0000","last_became_peered":"2024-09-17T02:58:21.005526+0000","last_unstale":"2024-09-17T02:58:21.006369+0000","last_undegraded":"2024-09-17T02:58:21.006369+0000","last_fullsized":"2024-09-17T02:58:21.006369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:24.299267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001412+0000","last_change":"2024-09-17T02:58:21.001412+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001412+0000","last_undegraded":"2024-09-17T02:58:21.001412+0000","last_fullsized":"2024-09-17T02:58:21.001412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006476+0000","last_change":"2024-09-17T02:58:21.006163+0000","last_active":"2024-09-17T02:58:21.006476+0000","last_peered":"2024-09-17T02:58:21.006476+0000","last_clean":"2024-09-17T02:58:21.006476+0000","last_became_active":"2024-09-17T02:58:21.005823+0000","last_became_peered":"2024-09-17T02:58:21.005823+0000","last_unstale":"2024-09-17T02:58:21.006476+0000","last_undegraded":"2024-09-17T02:58:21.006476+0000","last_fullsized":"2024-09-17T02:58:21.006476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:01.885292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001792+0000","last_change":"2024-09-17T02:58:21.001792+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001792+0000","last_undegraded":"2024-09-17T02:58:21.001792+0000","last_fullsized":"2024-09-17T02:58:21.001792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.007658+0000","last_change":"2024-09-17T02:58:21.007467+0000","last_active":"2024-09-17T02:58:21.007658+0000","last_peered":"2024-09-17T02:58:21.007658+0000","last_clean":"2024-09-17T02:58:21.007658+0000","last_became_active":"2024-09-17T02:58:21.007127+0000","last_became_peered":"2024-09-17T02:58:21.007127+0000","last_unstale":"2024-09-17T02:58:21.007658+0000","last_undegraded":"2024-09-17T02:58:21.007658+0000","last_fullsized":"2024-09-17T02:58:21.007658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:55.372211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.997904+0000","last_change":"2024-09-17T02:58:20.997904+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.997904+0000","last_undegraded":"2024-09-17T02:58:20.997904+0000","last_fullsized":"2024-09-17T02:58:20.997904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006579+0000","last_change":"2024-09-17T02:58:21.006408+0000","last_active":"2024-09-17T02:58:21.006579+0000","last_peered":"2024-09-17T02:58:21.006579+0000","last_clean":"2024-09-17T02:58:21.006579+0000","last_became_active":"2024-09-17T02:58:21.005945+0000","last_became_peered":"2024-09-17T02:58:21.005945+0000","last_unstale":"2024-09-17T02:58:21.006579+0000","last_undegraded":"2024-09-17T02:58:21.006579+0000","last_fullsized":"2024-09-17T02:58:21.006579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.041280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001169+0000","last_change":"2024-09-17T02:58:21.001169+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001169+0000","last_undegraded":"2024-09-17T02:58:21.001169+0000","last_fullsized":"2024-09-17T02:58:21.001169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.001098+0000","last_change":"2024-09-17T02:58:21.000894+0000","last_active":"2024-09-17T02:58:21.001098+0000","last_peered":"2024-09-17T02:58:21.001098+0000","last_clean":"2024-09-17T02:58:21.001098+0000","last_became_active":"2024-09-17T02:58:21.000611+0000","last_became_peered":"2024-09-17T02:58:21.000611+0000","last_unstale":"2024-09-17T02:58:21.001098+0000","last_undegraded":"2024-09-17T02:58:21.001098+0000","last_fullsized":"2024-09-17T02:58:21.001098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:02.722779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999633+0000","last_change":"2024-09-17T02:58:20.999633+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999633+0000","last_undegraded":"2024-09-17T02:58:20.999633+0000","last_fullsized":"2024-09-17T02:58:20.999633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.996658+0000","last_change":"2024-09-17T02:58:20.996167+0000","last_active":"2024-09-17T02:58:20.996658+0000","last_peered":"2024-09-17T02:58:20.996658+0000","last_clean":"2024-09-17T02:58:20.996658+0000","last_became_active":"2024-09-17T02:58:20.995880+0000","last_became_peered":"2024-09-17T02:58:20.995880+0000","last_unstale":"2024-09-17T02:58:20.996658+0000","last_undegraded":"2024-09-17T02:58:20.996658+0000","last_fullsized":"2024-09-17T02:58:20.996658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:30.834624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001635+0000","last_change":"2024-09-17T02:58:21.001635+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001635+0000","last_undegraded":"2024-09-17T02:58:21.001635+0000","last_fullsized":"2024-09-17T02:58:21.001635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003653+0000","last_change":"2024-09-17T02:58:21.003450+0000","last_active":"2024-09-17T02:58:21.003653+0000","last_peered":"2024-09-17T02:58:21.003653+0000","last_clean":"2024-09-17T02:58:21.003653+0000","last_became_active":"2024-09-17T02:58:21.002955+0000","last_became_peered":"2024-09-17T02:58:21.002955+0000","last_unstale":"2024-09-17T02:58:21.003653+0000","last_undegraded":"2024-09-17T02:58:21.003653+0000","last_fullsized":"2024-09-17T02:58:21.003653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:10.589201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999815+0000","last_change":"2024-09-17T02:58:20.999815+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999815+0000","last_undegraded":"2024-09-17T02:58:20.999815+0000","last_fullsized":"2024-09-17T02:58:20.999815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005759+0000","last_change":"2024-09-17T02:58:21.005548+0000","last_active":"2024-09-17T02:58:21.005759+0000","last_peered":"2024-09-17T02:58:21.005759+0000","last_clean":"2024-09-17T02:58:21.005759+0000","last_became_active":"2024-09-17T02:58:21.005071+0000","last_became_peered":"2024-09-17T02:58:21.005071+0000","last_unstale":"2024-09-17T02:58:21.005759+0000","last_undegraded":"2024-09-17T02:58:21.005759+0000","last_fullsized":"2024-09-17T02:58:21.005759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:03.004891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996225+0000","last_change":"2024-09-17T02:58:20.996225+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996225+0000","last_undegraded":"2024-09-17T02:58:20.996225+0000","last_fullsized":"2024-09-17T02:58:20.996225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.004646+0000","last_change":"2024-09-17T02:58:21.004399+0000","last_active":"2024-09-17T02:58:21.004646+0000","last_peered":"2024-09-17T02:58:21.004646+0000","last_clean":"2024-09-17T02:58:21.004646+0000","last_became_active":"2024-09-17T02:58:21.004078+0000","last_became_peered":"2024-09-17T02:58:21.004078+0000","last_unstale":"2024-09-17T02:58:21.004646+0000","last_undegraded":"2024-09-17T02:58:21.004646+0000","last_fullsized":"2024-09-17T02:58:21.004646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:11.089885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000415+0000","last_change":"2024-09-17T02:58:21.000415+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000415+0000","last_undegraded":"2024-09-17T02:58:21.000415+0000","last_fullsized":"2024-09-17T02:58:21.000415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.997632+0000","last_change":"2024-09-17T02:58:20.997321+0000","last_active":"2024-09-17T02:58:20.997632+0000","last_peered":"2024-09-17T02:58:20.997632+0000","last_clean":"2024-09-17T02:58:20.997632+0000","last_became_active":"2024-09-17T02:58:20.996864+0000","last_became_peered":"2024-09-17T02:58:20.996864+0000","last_unstale":"2024-09-17T02:58:20.997632+0000","last_undegraded":"2024-09-17T02:58:20.997632+0000","last_fullsized":"2024-09-17T02:58:20.997632+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:29.400328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998665+0000","last_change":"2024-09-17T02:58:20.998665+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998665+0000","last_undegraded":"2024-09-17T02:58:20.998665+0000","last_fullsized":"2024-09-17T02:58:20.998665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003212+0000","last_change":"2024-09-17T02:58:21.002715+0000","last_active":"2024-09-17T02:58:21.003212+0000","last_peered":"2024-09-17T02:58:21.003212+0000","last_clean":"2024-09-17T02:58:21.003212+0000","last_became_active":"2024-09-17T02:58:21.002427+0000","last_became_peered":"2024-09-17T02:58:21.002427+0000","last_unstale":"2024-09-17T02:58:21.003212+0000","last_undegraded":"2024-09-17T02:58:21.003212+0000","last_fullsized":"2024-09-17T02:58:21.003212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:10.359392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000312+0000","last_change":"2024-09-17T02:58:21.000312+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000312+0000","last_undegraded":"2024-09-17T02:58:21.000312+0000","last_fullsized":"2024-09-17T02:58:21.000312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.998907+0000","last_change":"2024-09-17T02:58:20.998480+0000","last_active":"2024-09-17T02:58:20.998907+0000","last_peered":"2024-09-17T02:58:20.998907+0000","last_clean":"2024-09-17T02:58:20.998907+0000","last_became_active":"2024-09-17T02:58:20.998192+0000","last_became_peered":"2024-09-17T02:58:20.998192+0000","last_unstale":"2024-09-17T02:58:20.998907+0000","last_undegraded":"2024-09-17T02:58:20.998907+0000","last_fullsized":"2024-09-17T02:58:20.998907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:40.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999432+0000","last_change":"2024-09-17T02:58:20.999432+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999432+0000","last_undegraded":"2024-09-17T02:58:20.999432+0000","last_fullsized":"2024-09-17T02:58:20.999432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003964+0000","last_change":"2024-09-17T02:58:21.003758+0000","last_active":"2024-09-17T02:58:21.003964+0000","last_peered":"2024-09-17T02:58:21.003964+0000","last_clean":"2024-09-17T02:58:21.003964+0000","last_became_active":"2024-09-17T02:58:21.003431+0000","last_became_peered":"2024-09-17T02:58:21.003431+0000","last_unstale":"2024-09-17T02:58:21.003964+0000","last_undegraded":"2024-09-17T02:58:21.003964+0000","last_fullsized":"2024-09-17T02:58:21.003964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:21.198235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999984+0000","last_change":"2024-09-17T02:58:20.999984+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999984+0000","last_undegraded":"2024-09-17T02:58:20.999984+0000","last_fullsized":"2024-09-17T02:58:20.999984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009396+0000","last_change":"2024-09-17T02:58:21.009192+0000","last_active":"2024-09-17T02:58:21.009396+0000","last_peered":"2024-09-17T02:58:21.009396+0000","last_clean":"2024-09-17T02:58:21.009396+0000","last_became_active":"2024-09-17T02:58:21.008557+0000","last_became_peered":"2024-09-17T02:58:21.008557+0000","last_unstale":"2024-09-17T02:58:21.009396+0000","last_undegraded":"2024-09-17T02:58:21.009396+0000","last_fullsized":"2024-09-17T02:58:21.009396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:56.121586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999700+0000","last_change":"2024-09-17T02:58:20.999700+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999700+0000","last_undegraded":"2024-09-17T02:58:20.999700+0000","last_fullsized":"2024-09-17T02:58:20.999700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009306+0000","last_change":"2024-09-17T02:58:21.009117+0000","last_active":"2024-09-17T02:58:21.009306+0000","last_peered":"2024-09-17T02:58:21.009306+0000","last_clean":"2024-09-17T02:58:21.009306+0000","last_became_active":"2024-09-17T02:58:21.007266+0000","last_became_peered":"2024-09-17T02:58:21.007266+0000","last_unstale":"2024-09-17T02:58:21.009306+0000","last_undegraded":"2024-09-17T02:58:21.009306+0000","last_fullsized":"2024-09-17T02:58:21.009306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:59.064669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999778+0000","last_change":"2024-09-17T02:58:20.999778+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999778+0000","last_undegraded":"2024-09-17T02:58:20.999778+0000","last_fullsized":"2024-09-17T02:58:20.999778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005991+0000","last_change":"2024-09-17T02:58:21.005789+0000","last_active":"2024-09-17T02:58:21.005991+0000","last_peered":"2024-09-17T02:58:21.005991+0000","last_clean":"2024-09-17T02:58:21.005991+0000","last_became_active":"2024-09-17T02:58:21.005141+0000","last_became_peered":"2024-09-17T02:58:21.005141+0000","last_unstale":"2024-09-17T02:58:21.005991+0000","last_undegraded":"2024-09-17T02:58:21.005991+0000","last_fullsized":"2024-09-17T02:58:21.005991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:24.161214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994603+0000","last_change":"2024-09-17T02:58:20.994603+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994603+0000","last_undegraded":"2024-09-17T02:58:20.994603+0000","last_fullsized":"2024-09-17T02:58:20.994603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.002600+0000","last_change":"2024-09-17T02:58:21.002316+0000","last_active":"2024-09-17T02:58:21.002600+0000","last_peered":"2024-09-17T02:58:21.002600+0000","last_clean":"2024-09-17T02:58:21.002600+0000","last_became_active":"2024-09-17T02:58:21.002050+0000","last_became_peered":"2024-09-17T02:58:21.002050+0000","last_unstale":"2024-09-17T02:58:21.002600+0000","last_undegraded":"2024-09-17T02:58:21.002600+0000","last_fullsized":"2024-09-17T02:58:21.002600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:51.431907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000134+0000","last_change":"2024-09-17T02:58:21.000134+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000134+0000","last_undegraded":"2024-09-17T02:58:21.000134+0000","last_fullsized":"2024-09-17T02:58:21.000134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.007687+0000","last_change":"2024-09-17T02:58:21.007482+0000","last_active":"2024-09-17T02:58:21.007687+0000","last_peered":"2024-09-17T02:58:21.007687+0000","last_clean":"2024-09-17T02:58:21.007687+0000","last_became_active":"2024-09-17T02:58:21.007194+0000","last_became_peered":"2024-09-17T02:58:21.007194+0000","last_unstale":"2024-09-17T02:58:21.007687+0000","last_undegraded":"2024-09-17T02:58:21.007687+0000","last_fullsized":"2024-09-17T02:58:21.007687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.437518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999410+0000","last_change":"2024-09-17T02:58:20.999410+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999410+0000","last_undegraded":"2024-09-17T02:58:20.999410+0000","last_fullsized":"2024-09-17T02:58:20.999410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009612+0000","last_change":"2024-09-17T02:58:21.009391+0000","last_active":"2024-09-17T02:58:21.009612+0000","last_peered":"2024-09-17T02:58:21.009612+0000","last_clean":"2024-09-17T02:58:21.009612+0000","last_became_active":"2024-09-17T02:58:21.007661+0000","last_became_peered":"2024-09-17T02:58:21.007661+0000","last_unstale":"2024-09-17T02:58:21.009612+0000","last_undegraded":"2024-09-17T02:58:21.009612+0000","last_fullsized":"2024-09-17T02:58:21.009612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:15.787004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998495+0000","last_change":"2024-09-17T02:58:20.998495+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998495+0000","last_undegraded":"2024-09-17T02:58:20.998495+0000","last_fullsized":"2024-09-17T02:58:20.998495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005602+0000","last_change":"2024-09-17T02:58:21.005375+0000","last_active":"2024-09-17T02:58:21.005602+0000","last_peered":"2024-09-17T02:58:21.005602+0000","last_clean":"2024-09-17T02:58:21.005602+0000","last_became_active":"2024-09-17T02:58:21.004679+0000","last_became_peered":"2024-09-17T02:58:21.004679+0000","last_unstale":"2024-09-17T02:58:21.005602+0000","last_undegraded":"2024-09-17T02:58:21.005602+0000","last_fullsized":"2024-09-17T02:58:21.005602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:41.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998958+0000","last_change":"2024-09-17T02:58:20.998958+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998958+0000","last_undegraded":"2024-09-17T02:58:20.998958+0000","last_fullsized":"2024-09-17T02:58:20.998958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003294+0000","last_change":"2024-09-17T02:58:21.002742+0000","last_active":"2024-09-17T02:58:21.003294+0000","last_peered":"2024-09-17T02:58:21.003294+0000","last_clean":"2024-09-17T02:58:21.003294+0000","last_became_active":"2024-09-17T02:58:21.002199+0000","last_became_peered":"2024-09-17T02:58:21.002199+0000","last_unstale":"2024-09-17T02:58:21.003294+0000","last_undegraded":"2024-09-17T02:58:21.003294+0000","last_fullsized":"2024-09-17T02:58:21.003294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:24.839326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998998+0000","last_change":"2024-09-17T02:58:20.998998+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998998+0000","last_undegraded":"2024-09-17T02:58:20.998998+0000","last_fullsized":"2024-09-17T02:58:20.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006502+0000","last_change":"2024-09-17T02:58:21.006274+0000","last_active":"2024-09-17T02:58:21.006502+0000","last_peered":"2024-09-17T02:58:21.006502+0000","last_clean":"2024-09-17T02:58:21.006502+0000","last_became_active":"2024-09-17T02:58:21.006012+0000","last_became_peered":"2024-09-17T02:58:21.006012+0000","last_unstale":"2024-09-17T02:58:21.006502+0000","last_undegraded":"2024-09-17T02:58:21.006502+0000","last_fullsized":"2024-09-17T02:58:21.006502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:59.618395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000750+0000","last_change":"2024-09-17T02:58:21.000750+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000750+0000","last_undegraded":"2024-09-17T02:58:21.000750+0000","last_fullsized":"2024-09-17T02:58:21.000750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006597+0000","last_change":"2024-09-17T02:58:21.006384+0000","last_active":"2024-09-17T02:58:21.006597+0000","last_peered":"2024-09-17T02:58:21.006597+0000","last_clean":"2024-09-17T02:58:21.006597+0000","last_became_active":"2024-09-17T02:58:21.006070+0000","last_became_peered":"2024-09-17T02:58:21.006070+0000","last_unstale":"2024-09-17T02:58:21.006597+0000","last_undegraded":"2024-09-17T02:58:21.006597+0000","last_fullsized":"2024-09-17T02:58:21.006597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:22.028745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000505+0000","last_change":"2024-09-17T02:58:21.000505+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000505+0000","last_undegraded":"2024-09-17T02:58:21.000505+0000","last_fullsized":"2024-09-17T02:58:21.000505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.004707+0000","last_change":"2024-09-17T02:58:21.004339+0000","last_active":"2024-09-17T02:58:21.004707+0000","last_peered":"2024-09-17T02:58:21.004707+0000","last_clean":"2024-09-17T02:58:21.004707+0000","last_became_active":"2024-09-17T02:58:21.004045+0000","last_became_peered":"2024-09-17T02:58:21.004045+0000","last_unstale":"2024-09-17T02:58:21.004707+0000","last_undegraded":"2024-09-17T02:58:21.004707+0000","last_fullsized":"2024-09-17T02:58:21.004707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:00.083016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999105+0000","last_change":"2024-09-17T02:58:20.999105+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999105+0000","last_undegraded":"2024-09-17T02:58:20.999105+0000","last_fullsized":"2024-09-17T02:58:20.999105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003882+0000","last_change":"2024-09-17T02:58:21.003230+0000","last_active":"2024-09-17T02:58:21.003882+0000","last_peered":"2024-09-17T02:58:21.003882+0000","last_clean":"2024-09-17T02:58:21.003882+0000","last_became_active":"2024-09-17T02:58:21.002944+0000","last_became_peered":"2024-09-17T02:58:21.002944+0000","last_unstale":"2024-09-17T02:58:21.003882+0000","last_undegraded":"2024-09-17T02:58:21.003882+0000","last_fullsized":"2024-09-17T02:58:21.003882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:00.076084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999501+0000","last_change":"2024-09-17T02:58:20.999501+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999501+0000","last_undegraded":"2024-09-17T02:58:20.999501+0000","last_fullsized":"2024-09-17T02:58:20.999501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006158+0000","last_change":"2024-09-17T02:58:21.005929+0000","last_active":"2024-09-17T02:58:21.006158+0000","last_peered":"2024-09-17T02:58:21.006158+0000","last_clean":"2024-09-17T02:58:21.006158+0000","last_became_active":"2024-09-17T02:58:21.005655+0000","last_became_peered":"2024-09-17T02:58:21.005655+0000","last_unstale":"2024-09-17T02:58:21.006158+0000","last_undegraded":"2024-09-17T02:58:21.006158+0000","last_fullsized":"2024-09-17T02:58:21.006158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:06.615787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996385+0000","last_change":"2024-09-17T02:58:20.996385+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996385+0000","last_undegraded":"2024-09-17T02:58:20.996385+0000","last_fullsized":"2024-09-17T02:58:20.996385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.001191+0000","last_change":"2024-09-17T02:58:21.000999+0000","last_active":"2024-09-17T02:58:21.001191+0000","last_peered":"2024-09-17T02:58:21.001191+0000","last_clean":"2024-09-17T02:58:21.001191+0000","last_became_active":"2024-09-17T02:58:21.000691+0000","last_became_peered":"2024-09-17T02:58:21.000691+0000","last_unstale":"2024-09-17T02:58:21.001191+0000","last_undegraded":"2024-09-17T02:58:21.001191+0000","last_fullsized":"2024-09-17T02:58:21.001191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:19.598276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994898+0000","last_change":"2024-09-17T02:58:20.994898+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994898+0000","last_undegraded":"2024-09-17T02:58:20.994898+0000","last_fullsized":"2024-09-17T02:58:20.994898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009045+0000","last_change":"2024-09-17T02:58:21.008825+0000","last_active":"2024-09-17T02:58:21.009045+0000","last_peered":"2024-09-17T02:58:21.009045+0000","last_clean":"2024-09-17T02:58:21.009045+0000","last_became_active":"2024-09-17T02:58:21.008199+0000","last_became_peered":"2024-09-17T02:58:21.008199+0000","last_unstale":"2024-09-17T02:58:21.009045+0000","last_undegraded":"2024-09-17T02:58:21.009045+0000","last_fullsized":"2024-09-17T02:58:21.009045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:58.095824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996361+0000","last_change":"2024-09-17T02:58:20.996361+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996361+0000","last_undegraded":"2024-09-17T02:58:20.996361+0000","last_fullsized":"2024-09-17T02:58:20.996361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009037+0000","last_change":"2024-09-17T02:58:21.008811+0000","last_active":"2024-09-17T02:58:21.009037+0000","last_peered":"2024-09-17T02:58:21.009037+0000","last_clean":"2024-09-17T02:58:21.009037+0000","last_became_active":"2024-09-17T02:58:21.006905+0000","last_became_peered":"2024-09-17T02:58:21.006905+0000","last_unstale":"2024-09-17T02:58:21.009037+0000","last_undegraded":"2024-09-17T02:58:21.009037+0000","last_fullsized":"2024-09-17T02:58:21.009037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:26.616807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999381+0000","last_change":"2024-09-17T02:58:20.999381+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999381+0000","last_undegraded":"2024-09-17T02:58:20.999381+0000","last_fullsized":"2024-09-17T02:58:20.999381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.008520+0000","last_change":"2024-09-17T02:58:21.008132+0000","last_active":"2024-09-17T02:58:21.008520+0000","last_peered":"2024-09-17T02:58:21.008520+0000","last_clean":"2024-09-17T02:58:21.008520+0000","last_became_active":"2024-09-17T02:58:21.007404+0000","last_became_peered":"2024-09-17T02:58:21.007404+0000","last_unstale":"2024-09-17T02:58:21.008520+0000","last_undegraded":"2024-09-17T02:58:21.008520+0000","last_fullsized":"2024-09-17T02:58:21.008520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:31.189583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":228,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.998167+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:58:20.998167+0000","last_peered":"2024-09-17T02:58:20.998167+0000","last_clean":"2024-09-17T02:58:20.998167+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:58:20.998167+0000","last_undegraded":"2024-09-17T02:58:20.998167+0000","last_fullsized":"2024-09-17T02:58:20.998167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:58.696508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991439,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194897,"statfs":{"total":200000000,"available":199575532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194897,"statfs":{"total":200000000,"available":199575532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991439,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:58:25.020 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:58:25.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.168+0000 7efc0b1ba640 1 -- 172.21.15.104:0/2744871887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efbf0004d90 msgr2=0x7efbf0005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.168+0000 7efc0b1ba640 1 --2- 172.21.15.104:0/2744871887 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efbf0004d90 0x7efbf0005260 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7efc040d1770 tx=0x7efbf0005830 comp rx=0 tx=0).stop 2024-09-17T02:58:25.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.168+0000 7efc09757640 1 -- 172.21.15.104:0/2744871887 reap_dead start 2024-09-17T02:58:25.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.168+0000 7efc0b1ba640 1 -- 172.21.15.104:0/2744871887 shutdown_connections 2024-09-17T02:58:25.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.168+0000 7efc0b1ba640 1 -- 172.21.15.104:0/2744871887 >> 172.21.15.104:0/2744871887 conn(0x7efc0406d200 msgr2=0x7efc0406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:25.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.168+0000 7efc0b1ba640 1 -- 172.21.15.104:0/2744871887 shutdown_connections 2024-09-17T02:58:25.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.168+0000 7efc0b1ba640 1 -- 172.21.15.104:0/2744871887 wait complete. 2024-09-17T02:58:25.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.170+0000 7efc0b1ba640 1 Processor -- start 2024-09-17T02:58:25.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.170+0000 7efc0b1ba640 1 -- start start 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc0b1ba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efbf0004d90 0x7efc04142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc0b1ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc040b3700 0x7efc04143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc0b1ba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc041437c0 0x7efc041f7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc0b1ba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7efc0415cf10 con 0x7efc040b3700 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc0b1ba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efc0415cd90 con 0x7efbf0004d90 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc0b1ba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efc0415d090 con 0x7efc041437c0 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc03fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc040b3700 0x7efc04143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc03fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc040b3700 0x7efc04143280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60886/0 (socket says 172.21.15.104:60886) 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc03fff640 1 -- 172.21.15.104:0/10030073 learned_addr learned my addr 172.21.15.104:0/10030073 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc09757640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc041437c0 0x7efc041f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc08f56640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efbf0004d90 0x7efc04142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc03fff640 1 -- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc041437c0 msgr2=0x7efc041f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc03fff640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc041437c0 0x7efc041f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc03fff640 1 -- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efbf0004d90 msgr2=0x7efc04142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc03fff640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efbf0004d90 0x7efc04142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc03fff640 1 -- 172.21.15.104:0/10030073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc040b3b10 con 0x7efc040b3700 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.171+0000 7efc08f56640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efbf0004d90 0x7efc04142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.172+0000 7efc03fff640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc040b3700 0x7efc04143280 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efbec003f50 tx=0x7efbec0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.172+0000 7efc017fa640 1 -- 172.21.15.104:0/10030073 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec011640 con 0x7efc040b3700 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.172+0000 7efc017fa640 1 -- 172.21.15.104:0/10030073 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efbec016020 con 0x7efc040b3700 2024-09-17T02:58:25.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.172+0000 7efc017fa640 1 -- 172.21.15.104:0/10030073 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec011a60 con 0x7efc040b3700 2024-09-17T02:58:25.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.172+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc040aa960 con 0x7efc040b3700 2024-09-17T02:58:25.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.172+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc040b2f00 con 0x7efc040b3700 2024-09-17T02:58:25.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.173+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0415d620 con 0x7efc040b3700 2024-09-17T02:58:25.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.174+0000 7efc017fa640 1 -- 172.21.15.104:0/10030073 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efbec011c00 con 0x7efc040b3700 2024-09-17T02:58:25.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.174+0000 7efc017fa640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efbe4078b90 0x7efbe407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.174+0000 7efc017fa640 1 -- 172.21.15.104:0/10030073 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7efbec09b800 con 0x7efc040b3700 2024-09-17T02:58:25.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.174+0000 7efc08f56640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efbe4078b90 0x7efbe407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.175+0000 7efc08f56640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efbe4078b90 0x7efbe407b0a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc040740d0 tx=0x7efbf40067d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:25.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.179+0000 7efc017fa640 1 -- 172.21.15.104:0/10030073 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efbec020020 con 0x7efc040b3700 2024-09-17T02:58:25.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.349+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc040b1640 con 0x7efbe4078b90 2024-09-17T02:58:25.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.353+0000 7efc017fa640 1 -- 172.21.15.104:0/10030073 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242336 (secure 0 0 0) 0x7efc040b1640 con 0x7efbe4078b90 2024-09-17T02:58:25.355 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:25.356 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.356+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efbe4078b90 msgr2=0x7efbe407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.356+0000 7efc0b1ba640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efbe4078b90 0x7efbe407b0a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc040740d0 tx=0x7efbf40067d0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.356+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc040b3700 msgr2=0x7efc04143280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.356+0000 7efc0b1ba640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc040b3700 0x7efc04143280 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efbec003f50 tx=0x7efbec0016f0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.357+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 shutdown_connections 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.357+0000 7efc0b1ba640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efbe4078b90 0x7efbe407b0a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.357+0000 7efc0b1ba640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc041437c0 0x7efc041f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.357+0000 7efc0b1ba640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efc040b3700 0x7efc04143280 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.357+0000 7efc0b1ba640 1 --2- 172.21.15.104:0/10030073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efbf0004d90 0x7efc04142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.357+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 >> 172.21.15.104:0/10030073 conn(0x7efc0406d200 msgr2=0x7efc040b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.357+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 shutdown_connections 2024-09-17T02:58:25.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.357+0000 7efc0b1ba640 1 -- 172.21.15.104:0/10030073 wait complete. 2024-09-17T02:58:25.367 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-17T02:58:23.674451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4432,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558067,"statfs":{"total":1600000000,"available":1595461170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001077"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002072+0000","last_change":"2024-09-17T02:58:21.002072+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002072+0000","last_undegraded":"2024-09-17T02:58:21.002072+0000","last_fullsized":"2024-09-17T02:58:21.002072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995746+0000","last_change":"2024-09-17T02:58:20.995746+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995746+0000","last_undegraded":"2024-09-17T02:58:20.995746+0000","last_fullsized":"2024-09-17T02:58:20.995746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000391+0000","last_change":"2024-09-17T02:58:21.000391+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000391+0000","last_undegraded":"2024-09-17T02:58:21.000391+0000","last_fullsized":"2024-09-17T02:58:21.000391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995861+0000","last_change":"2024-09-17T02:58:20.995861+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995861+0000","last_undegraded":"2024-09-17T02:58:20.995861+0000","last_fullsized":"2024-09-17T02:58:20.995861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001855+0000","last_change":"2024-09-17T02:58:21.001855+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001855+0000","last_undegraded":"2024-09-17T02:58:21.001855+0000","last_fullsized":"2024-09-17T02:58:21.001855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.997223+0000","last_change":"2024-09-17T02:58:20.997223+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.997223+0000","last_undegraded":"2024-09-17T02:58:20.997223+0000","last_fullsized":"2024-09-17T02:58:20.997223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002013+0000","last_change":"2024-09-17T02:58:21.002013+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002013+0000","last_undegraded":"2024-09-17T02:58:21.002013+0000","last_fullsized":"2024-09-17T02:58:21.002013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996890+0000","last_change":"2024-09-17T02:58:20.996890+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996890+0000","last_undegraded":"2024-09-17T02:58:20.996890+0000","last_fullsized":"2024-09-17T02:58:20.996890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001414+0000","last_change":"2024-09-17T02:58:21.001414+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001414+0000","last_undegraded":"2024-09-17T02:58:21.001414+0000","last_fullsized":"2024-09-17T02:58:21.001414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000432+0000","last_change":"2024-09-17T02:58:21.000432+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000432+0000","last_undegraded":"2024-09-17T02:58:21.000432+0000","last_fullsized":"2024-09-17T02:58:21.000432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000798+0000","last_change":"2024-09-17T02:58:21.000798+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000798+0000","last_undegraded":"2024-09-17T02:58:21.000798+0000","last_fullsized":"2024-09-17T02:58:21.000798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995223+0000","last_change":"2024-09-17T02:58:20.995223+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995223+0000","last_undegraded":"2024-09-17T02:58:20.995223+0000","last_fullsized":"2024-09-17T02:58:20.995223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000052+0000","last_change":"2024-09-17T02:58:21.000052+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000052+0000","last_undegraded":"2024-09-17T02:58:21.000052+0000","last_fullsized":"2024-09-17T02:58:21.000052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001039+0000","last_change":"2024-09-17T02:58:21.001039+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001039+0000","last_undegraded":"2024-09-17T02:58:21.001039+0000","last_fullsized":"2024-09-17T02:58:21.001039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999256+0000","last_change":"2024-09-17T02:58:20.999256+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999256+0000","last_undegraded":"2024-09-17T02:58:20.999256+0000","last_fullsized":"2024-09-17T02:58:20.999256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998080+0000","last_change":"2024-09-17T02:58:20.998080+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998080+0000","last_undegraded":"2024-09-17T02:58:20.998080+0000","last_fullsized":"2024-09-17T02:58:20.998080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000794+0000","last_change":"2024-09-17T02:58:21.000794+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000794+0000","last_undegraded":"2024-09-17T02:58:21.000794+0000","last_fullsized":"2024-09-17T02:58:21.000794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994683+0000","last_change":"2024-09-17T02:58:20.994683+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994683+0000","last_undegraded":"2024-09-17T02:58:20.994683+0000","last_fullsized":"2024-09-17T02:58:20.994683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996614+0000","last_change":"2024-09-17T02:58:20.996614+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996614+0000","last_undegraded":"2024-09-17T02:58:20.996614+0000","last_fullsized":"2024-09-17T02:58:20.996614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998650+0000","last_change":"2024-09-17T02:58:20.998650+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998650+0000","last_undegraded":"2024-09-17T02:58:20.998650+0000","last_fullsized":"2024-09-17T02:58:20.998650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998483+0000","last_change":"2024-09-17T02:58:20.998483+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998483+0000","last_undegraded":"2024-09-17T02:58:20.998483+0000","last_fullsized":"2024-09-17T02:58:20.998483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998864+0000","last_change":"2024-09-17T02:58:20.998864+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998864+0000","last_undegraded":"2024-09-17T02:58:20.998864+0000","last_fullsized":"2024-09-17T02:58:20.998864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999615+0000","last_change":"2024-09-17T02:58:20.999615+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999615+0000","last_undegraded":"2024-09-17T02:58:20.999615+0000","last_fullsized":"2024-09-17T02:58:20.999615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000939+0000","last_change":"2024-09-17T02:58:21.000939+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000939+0000","last_undegraded":"2024-09-17T02:58:21.000939+0000","last_fullsized":"2024-09-17T02:58:21.000939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000094+0000","last_change":"2024-09-17T02:58:21.000094+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000094+0000","last_undegraded":"2024-09-17T02:58:21.000094+0000","last_fullsized":"2024-09-17T02:58:21.000094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002578+0000","last_change":"2024-09-17T02:58:21.002578+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002578+0000","last_undegraded":"2024-09-17T02:58:21.002578+0000","last_fullsized":"2024-09-17T02:58:21.002578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000635+0000","last_change":"2024-09-17T02:58:21.000635+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000635+0000","last_undegraded":"2024-09-17T02:58:21.000635+0000","last_fullsized":"2024-09-17T02:58:21.000635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000804+0000","last_change":"2024-09-17T02:58:21.000804+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000804+0000","last_undegraded":"2024-09-17T02:58:21.000804+0000","last_fullsized":"2024-09-17T02:58:21.000804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999738+0000","last_change":"2024-09-17T02:58:20.999738+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999738+0000","last_undegraded":"2024-09-17T02:58:20.999738+0000","last_fullsized":"2024-09-17T02:58:20.999738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000762+0000","last_change":"2024-09-17T02:58:21.000762+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000762+0000","last_undegraded":"2024-09-17T02:58:21.000762+0000","last_fullsized":"2024-09-17T02:58:21.000762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001100+0000","last_change":"2024-09-17T02:58:21.001100+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001100+0000","last_undegraded":"2024-09-17T02:58:21.001100+0000","last_fullsized":"2024-09-17T02:58:21.001100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995225+0000","last_change":"2024-09-17T02:58:20.995225+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995225+0000","last_undegraded":"2024-09-17T02:58:20.995225+0000","last_fullsized":"2024-09-17T02:58:20.995225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000172+0000","last_change":"2024-09-17T02:58:21.000172+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000172+0000","last_undegraded":"2024-09-17T02:58:21.000172+0000","last_fullsized":"2024-09-17T02:58:21.000172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006499+0000","last_change":"2024-09-17T02:58:21.003281+0000","last_active":"2024-09-17T02:58:21.006499+0000","last_peered":"2024-09-17T02:58:21.006499+0000","last_clean":"2024-09-17T02:58:21.006499+0000","last_became_active":"2024-09-17T02:58:21.002339+0000","last_became_peered":"2024-09-17T02:58:21.002339+0000","last_unstale":"2024-09-17T02:58:21.006499+0000","last_undegraded":"2024-09-17T02:58:21.006499+0000","last_fullsized":"2024-09-17T02:58:21.006499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:34.463154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001135+0000","last_change":"2024-09-17T02:58:21.001135+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001135+0000","last_undegraded":"2024-09-17T02:58:21.001135+0000","last_fullsized":"2024-09-17T02:58:21.001135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006875+0000","last_change":"2024-09-17T02:58:21.006659+0000","last_active":"2024-09-17T02:58:21.006875+0000","last_peered":"2024-09-17T02:58:21.006875+0000","last_clean":"2024-09-17T02:58:21.006875+0000","last_became_active":"2024-09-17T02:58:21.005416+0000","last_became_peered":"2024-09-17T02:58:21.005416+0000","last_unstale":"2024-09-17T02:58:21.006875+0000","last_undegraded":"2024-09-17T02:58:21.006875+0000","last_fullsized":"2024-09-17T02:58:21.006875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:43.841299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996769+0000","last_change":"2024-09-17T02:58:20.996769+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996769+0000","last_undegraded":"2024-09-17T02:58:20.996769+0000","last_fullsized":"2024-09-17T02:58:20.996769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006369+0000","last_change":"2024-09-17T02:58:21.006096+0000","last_active":"2024-09-17T02:58:21.006369+0000","last_peered":"2024-09-17T02:58:21.006369+0000","last_clean":"2024-09-17T02:58:21.006369+0000","last_became_active":"2024-09-17T02:58:21.005526+0000","last_became_peered":"2024-09-17T02:58:21.005526+0000","last_unstale":"2024-09-17T02:58:21.006369+0000","last_undegraded":"2024-09-17T02:58:21.006369+0000","last_fullsized":"2024-09-17T02:58:21.006369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:24.299267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001412+0000","last_change":"2024-09-17T02:58:21.001412+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001412+0000","last_undegraded":"2024-09-17T02:58:21.001412+0000","last_fullsized":"2024-09-17T02:58:21.001412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006476+0000","last_change":"2024-09-17T02:58:21.006163+0000","last_active":"2024-09-17T02:58:21.006476+0000","last_peered":"2024-09-17T02:58:21.006476+0000","last_clean":"2024-09-17T02:58:21.006476+0000","last_became_active":"2024-09-17T02:58:21.005823+0000","last_became_peered":"2024-09-17T02:58:21.005823+0000","last_unstale":"2024-09-17T02:58:21.006476+0000","last_undegraded":"2024-09-17T02:58:21.006476+0000","last_fullsized":"2024-09-17T02:58:21.006476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:01.885292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001792+0000","last_change":"2024-09-17T02:58:21.001792+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001792+0000","last_undegraded":"2024-09-17T02:58:21.001792+0000","last_fullsized":"2024-09-17T02:58:21.001792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.007658+0000","last_change":"2024-09-17T02:58:21.007467+0000","last_active":"2024-09-17T02:58:21.007658+0000","last_peered":"2024-09-17T02:58:21.007658+0000","last_clean":"2024-09-17T02:58:21.007658+0000","last_became_active":"2024-09-17T02:58:21.007127+0000","last_became_peered":"2024-09-17T02:58:21.007127+0000","last_unstale":"2024-09-17T02:58:21.007658+0000","last_undegraded":"2024-09-17T02:58:21.007658+0000","last_fullsized":"2024-09-17T02:58:21.007658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:55.372211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.997904+0000","last_change":"2024-09-17T02:58:20.997904+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.997904+0000","last_undegraded":"2024-09-17T02:58:20.997904+0000","last_fullsized":"2024-09-17T02:58:20.997904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006579+0000","last_change":"2024-09-17T02:58:21.006408+0000","last_active":"2024-09-17T02:58:21.006579+0000","last_peered":"2024-09-17T02:58:21.006579+0000","last_clean":"2024-09-17T02:58:21.006579+0000","last_became_active":"2024-09-17T02:58:21.005945+0000","last_became_peered":"2024-09-17T02:58:21.005945+0000","last_unstale":"2024-09-17T02:58:21.006579+0000","last_undegraded":"2024-09-17T02:58:21.006579+0000","last_fullsized":"2024-09-17T02:58:21.006579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.041280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001169+0000","last_change":"2024-09-17T02:58:21.001169+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001169+0000","last_undegraded":"2024-09-17T02:58:21.001169+0000","last_fullsized":"2024-09-17T02:58:21.001169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.001098+0000","last_change":"2024-09-17T02:58:21.000894+0000","last_active":"2024-09-17T02:58:21.001098+0000","last_peered":"2024-09-17T02:58:21.001098+0000","last_clean":"2024-09-17T02:58:21.001098+0000","last_became_active":"2024-09-17T02:58:21.000611+0000","last_became_peered":"2024-09-17T02:58:21.000611+0000","last_unstale":"2024-09-17T02:58:21.001098+0000","last_undegraded":"2024-09-17T02:58:21.001098+0000","last_fullsized":"2024-09-17T02:58:21.001098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:02.722779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999633+0000","last_change":"2024-09-17T02:58:20.999633+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999633+0000","last_undegraded":"2024-09-17T02:58:20.999633+0000","last_fullsized":"2024-09-17T02:58:20.999633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.996658+0000","last_change":"2024-09-17T02:58:20.996167+0000","last_active":"2024-09-17T02:58:20.996658+0000","last_peered":"2024-09-17T02:58:20.996658+0000","last_clean":"2024-09-17T02:58:20.996658+0000","last_became_active":"2024-09-17T02:58:20.995880+0000","last_became_peered":"2024-09-17T02:58:20.995880+0000","last_unstale":"2024-09-17T02:58:20.996658+0000","last_undegraded":"2024-09-17T02:58:20.996658+0000","last_fullsized":"2024-09-17T02:58:20.996658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:30.834624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001635+0000","last_change":"2024-09-17T02:58:21.001635+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001635+0000","last_undegraded":"2024-09-17T02:58:21.001635+0000","last_fullsized":"2024-09-17T02:58:21.001635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003653+0000","last_change":"2024-09-17T02:58:21.003450+0000","last_active":"2024-09-17T02:58:21.003653+0000","last_peered":"2024-09-17T02:58:21.003653+0000","last_clean":"2024-09-17T02:58:21.003653+0000","last_became_active":"2024-09-17T02:58:21.002955+0000","last_became_peered":"2024-09-17T02:58:21.002955+0000","last_unstale":"2024-09-17T02:58:21.003653+0000","last_undegraded":"2024-09-17T02:58:21.003653+0000","last_fullsized":"2024-09-17T02:58:21.003653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:10.589201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999815+0000","last_change":"2024-09-17T02:58:20.999815+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999815+0000","last_undegraded":"2024-09-17T02:58:20.999815+0000","last_fullsized":"2024-09-17T02:58:20.999815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005759+0000","last_change":"2024-09-17T02:58:21.005548+0000","last_active":"2024-09-17T02:58:21.005759+0000","last_peered":"2024-09-17T02:58:21.005759+0000","last_clean":"2024-09-17T02:58:21.005759+0000","last_became_active":"2024-09-17T02:58:21.005071+0000","last_became_peered":"2024-09-17T02:58:21.005071+0000","last_unstale":"2024-09-17T02:58:21.005759+0000","last_undegraded":"2024-09-17T02:58:21.005759+0000","last_fullsized":"2024-09-17T02:58:21.005759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:03.004891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996225+0000","last_change":"2024-09-17T02:58:20.996225+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996225+0000","last_undegraded":"2024-09-17T02:58:20.996225+0000","last_fullsized":"2024-09-17T02:58:20.996225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.004646+0000","last_change":"2024-09-17T02:58:21.004399+0000","last_active":"2024-09-17T02:58:21.004646+0000","last_peered":"2024-09-17T02:58:21.004646+0000","last_clean":"2024-09-17T02:58:21.004646+0000","last_became_active":"2024-09-17T02:58:21.004078+0000","last_became_peered":"2024-09-17T02:58:21.004078+0000","last_unstale":"2024-09-17T02:58:21.004646+0000","last_undegraded":"2024-09-17T02:58:21.004646+0000","last_fullsized":"2024-09-17T02:58:21.004646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:11.089885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000415+0000","last_change":"2024-09-17T02:58:21.000415+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000415+0000","last_undegraded":"2024-09-17T02:58:21.000415+0000","last_fullsized":"2024-09-17T02:58:21.000415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.997632+0000","last_change":"2024-09-17T02:58:20.997321+0000","last_active":"2024-09-17T02:58:20.997632+0000","last_peered":"2024-09-17T02:58:20.997632+0000","last_clean":"2024-09-17T02:58:20.997632+0000","last_became_active":"2024-09-17T02:58:20.996864+0000","last_became_peered":"2024-09-17T02:58:20.996864+0000","last_unstale":"2024-09-17T02:58:20.997632+0000","last_undegraded":"2024-09-17T02:58:20.997632+0000","last_fullsized":"2024-09-17T02:58:20.997632+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:29.400328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998665+0000","last_change":"2024-09-17T02:58:20.998665+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998665+0000","last_undegraded":"2024-09-17T02:58:20.998665+0000","last_fullsized":"2024-09-17T02:58:20.998665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003212+0000","last_change":"2024-09-17T02:58:21.002715+0000","last_active":"2024-09-17T02:58:21.003212+0000","last_peered":"2024-09-17T02:58:21.003212+0000","last_clean":"2024-09-17T02:58:21.003212+0000","last_became_active":"2024-09-17T02:58:21.002427+0000","last_became_peered":"2024-09-17T02:58:21.002427+0000","last_unstale":"2024-09-17T02:58:21.003212+0000","last_undegraded":"2024-09-17T02:58:21.003212+0000","last_fullsized":"2024-09-17T02:58:21.003212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:10.359392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000312+0000","last_change":"2024-09-17T02:58:21.000312+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000312+0000","last_undegraded":"2024-09-17T02:58:21.000312+0000","last_fullsized":"2024-09-17T02:58:21.000312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.998907+0000","last_change":"2024-09-17T02:58:20.998480+0000","last_active":"2024-09-17T02:58:20.998907+0000","last_peered":"2024-09-17T02:58:20.998907+0000","last_clean":"2024-09-17T02:58:20.998907+0000","last_became_active":"2024-09-17T02:58:20.998192+0000","last_became_peered":"2024-09-17T02:58:20.998192+0000","last_unstale":"2024-09-17T02:58:20.998907+0000","last_undegraded":"2024-09-17T02:58:20.998907+0000","last_fullsized":"2024-09-17T02:58:20.998907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:40.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999432+0000","last_change":"2024-09-17T02:58:20.999432+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999432+0000","last_undegraded":"2024-09-17T02:58:20.999432+0000","last_fullsized":"2024-09-17T02:58:20.999432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003964+0000","last_change":"2024-09-17T02:58:21.003758+0000","last_active":"2024-09-17T02:58:21.003964+0000","last_peered":"2024-09-17T02:58:21.003964+0000","last_clean":"2024-09-17T02:58:21.003964+0000","last_became_active":"2024-09-17T02:58:21.003431+0000","last_became_peered":"2024-09-17T02:58:21.003431+0000","last_unstale":"2024-09-17T02:58:21.003964+0000","last_undegraded":"2024-09-17T02:58:21.003964+0000","last_fullsized":"2024-09-17T02:58:21.003964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:21.198235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999984+0000","last_change":"2024-09-17T02:58:20.999984+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999984+0000","last_undegraded":"2024-09-17T02:58:20.999984+0000","last_fullsized":"2024-09-17T02:58:20.999984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009396+0000","last_change":"2024-09-17T02:58:21.009192+0000","last_active":"2024-09-17T02:58:21.009396+0000","last_peered":"2024-09-17T02:58:21.009396+0000","last_clean":"2024-09-17T02:58:21.009396+0000","last_became_active":"2024-09-17T02:58:21.008557+0000","last_became_peered":"2024-09-17T02:58:21.008557+0000","last_unstale":"2024-09-17T02:58:21.009396+0000","last_undegraded":"2024-09-17T02:58:21.009396+0000","last_fullsized":"2024-09-17T02:58:21.009396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:56.121586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999700+0000","last_change":"2024-09-17T02:58:20.999700+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999700+0000","last_undegraded":"2024-09-17T02:58:20.999700+0000","last_fullsized":"2024-09-17T02:58:20.999700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009306+0000","last_change":"2024-09-17T02:58:21.009117+0000","last_active":"2024-09-17T02:58:21.009306+0000","last_peered":"2024-09-17T02:58:21.009306+0000","last_clean":"2024-09-17T02:58:21.009306+0000","last_became_active":"2024-09-17T02:58:21.007266+0000","last_became_peered":"2024-09-17T02:58:21.007266+0000","last_unstale":"2024-09-17T02:58:21.009306+0000","last_undegraded":"2024-09-17T02:58:21.009306+0000","last_fullsized":"2024-09-17T02:58:21.009306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:59.064669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999778+0000","last_change":"2024-09-17T02:58:20.999778+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999778+0000","last_undegraded":"2024-09-17T02:58:20.999778+0000","last_fullsized":"2024-09-17T02:58:20.999778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005991+0000","last_change":"2024-09-17T02:58:21.005789+0000","last_active":"2024-09-17T02:58:21.005991+0000","last_peered":"2024-09-17T02:58:21.005991+0000","last_clean":"2024-09-17T02:58:21.005991+0000","last_became_active":"2024-09-17T02:58:21.005141+0000","last_became_peered":"2024-09-17T02:58:21.005141+0000","last_unstale":"2024-09-17T02:58:21.005991+0000","last_undegraded":"2024-09-17T02:58:21.005991+0000","last_fullsized":"2024-09-17T02:58:21.005991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:24.161214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994603+0000","last_change":"2024-09-17T02:58:20.994603+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994603+0000","last_undegraded":"2024-09-17T02:58:20.994603+0000","last_fullsized":"2024-09-17T02:58:20.994603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.002600+0000","last_change":"2024-09-17T02:58:21.002316+0000","last_active":"2024-09-17T02:58:21.002600+0000","last_peered":"2024-09-17T02:58:21.002600+0000","last_clean":"2024-09-17T02:58:21.002600+0000","last_became_active":"2024-09-17T02:58:21.002050+0000","last_became_peered":"2024-09-17T02:58:21.002050+0000","last_unstale":"2024-09-17T02:58:21.002600+0000","last_undegraded":"2024-09-17T02:58:21.002600+0000","last_fullsized":"2024-09-17T02:58:21.002600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:51.431907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000134+0000","last_change":"2024-09-17T02:58:21.000134+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000134+0000","last_undegraded":"2024-09-17T02:58:21.000134+0000","last_fullsized":"2024-09-17T02:58:21.000134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.007687+0000","last_change":"2024-09-17T02:58:21.007482+0000","last_active":"2024-09-17T02:58:21.007687+0000","last_peered":"2024-09-17T02:58:21.007687+0000","last_clean":"2024-09-17T02:58:21.007687+0000","last_became_active":"2024-09-17T02:58:21.007194+0000","last_became_peered":"2024-09-17T02:58:21.007194+0000","last_unstale":"2024-09-17T02:58:21.007687+0000","last_undegraded":"2024-09-17T02:58:21.007687+0000","last_fullsized":"2024-09-17T02:58:21.007687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.437518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999410+0000","last_change":"2024-09-17T02:58:20.999410+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999410+0000","last_undegraded":"2024-09-17T02:58:20.999410+0000","last_fullsized":"2024-09-17T02:58:20.999410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009612+0000","last_change":"2024-09-17T02:58:21.009391+0000","last_active":"2024-09-17T02:58:21.009612+0000","last_peered":"2024-09-17T02:58:21.009612+0000","last_clean":"2024-09-17T02:58:21.009612+0000","last_became_active":"2024-09-17T02:58:21.007661+0000","last_became_peered":"2024-09-17T02:58:21.007661+0000","last_unstale":"2024-09-17T02:58:21.009612+0000","last_undegraded":"2024-09-17T02:58:21.009612+0000","last_fullsized":"2024-09-17T02:58:21.009612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:15.787004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998495+0000","last_change":"2024-09-17T02:58:20.998495+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998495+0000","last_undegraded":"2024-09-17T02:58:20.998495+0000","last_fullsized":"2024-09-17T02:58:20.998495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005602+0000","last_change":"2024-09-17T02:58:21.005375+0000","last_active":"2024-09-17T02:58:21.005602+0000","last_peered":"2024-09-17T02:58:21.005602+0000","last_clean":"2024-09-17T02:58:21.005602+0000","last_became_active":"2024-09-17T02:58:21.004679+0000","last_became_peered":"2024-09-17T02:58:21.004679+0000","last_unstale":"2024-09-17T02:58:21.005602+0000","last_undegraded":"2024-09-17T02:58:21.005602+0000","last_fullsized":"2024-09-17T02:58:21.005602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:41.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998958+0000","last_change":"2024-09-17T02:58:20.998958+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998958+0000","last_undegraded":"2024-09-17T02:58:20.998958+0000","last_fullsized":"2024-09-17T02:58:20.998958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003294+0000","last_change":"2024-09-17T02:58:21.002742+0000","last_active":"2024-09-17T02:58:21.003294+0000","last_peered":"2024-09-17T02:58:21.003294+0000","last_clean":"2024-09-17T02:58:21.003294+0000","last_became_active":"2024-09-17T02:58:21.002199+0000","last_became_peered":"2024-09-17T02:58:21.002199+0000","last_unstale":"2024-09-17T02:58:21.003294+0000","last_undegraded":"2024-09-17T02:58:21.003294+0000","last_fullsized":"2024-09-17T02:58:21.003294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:24.839326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998998+0000","last_change":"2024-09-17T02:58:20.998998+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998998+0000","last_undegraded":"2024-09-17T02:58:20.998998+0000","last_fullsized":"2024-09-17T02:58:20.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006502+0000","last_change":"2024-09-17T02:58:21.006274+0000","last_active":"2024-09-17T02:58:21.006502+0000","last_peered":"2024-09-17T02:58:21.006502+0000","last_clean":"2024-09-17T02:58:21.006502+0000","last_became_active":"2024-09-17T02:58:21.006012+0000","last_became_peered":"2024-09-17T02:58:21.006012+0000","last_unstale":"2024-09-17T02:58:21.006502+0000","last_undegraded":"2024-09-17T02:58:21.006502+0000","last_fullsized":"2024-09-17T02:58:21.006502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:59.618395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000750+0000","last_change":"2024-09-17T02:58:21.000750+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000750+0000","last_undegraded":"2024-09-17T02:58:21.000750+0000","last_fullsized":"2024-09-17T02:58:21.000750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006597+0000","last_change":"2024-09-17T02:58:21.006384+0000","last_active":"2024-09-17T02:58:21.006597+0000","last_peered":"2024-09-17T02:58:21.006597+0000","last_clean":"2024-09-17T02:58:21.006597+0000","last_became_active":"2024-09-17T02:58:21.006070+0000","last_became_peered":"2024-09-17T02:58:21.006070+0000","last_unstale":"2024-09-17T02:58:21.006597+0000","last_undegraded":"2024-09-17T02:58:21.006597+0000","last_fullsized":"2024-09-17T02:58:21.006597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:22.028745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000505+0000","last_change":"2024-09-17T02:58:21.000505+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000505+0000","last_undegraded":"2024-09-17T02:58:21.000505+0000","last_fullsized":"2024-09-17T02:58:21.000505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.004707+0000","last_change":"2024-09-17T02:58:21.004339+0000","last_active":"2024-09-17T02:58:21.004707+0000","last_peered":"2024-09-17T02:58:21.004707+0000","last_clean":"2024-09-17T02:58:21.004707+0000","last_became_active":"2024-09-17T02:58:21.004045+0000","last_became_peered":"2024-09-17T02:58:21.004045+0000","last_unstale":"2024-09-17T02:58:21.004707+0000","last_undegraded":"2024-09-17T02:58:21.004707+0000","last_fullsized":"2024-09-17T02:58:21.004707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:00.083016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999105+0000","last_change":"2024-09-17T02:58:20.999105+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999105+0000","last_undegraded":"2024-09-17T02:58:20.999105+0000","last_fullsized":"2024-09-17T02:58:20.999105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003882+0000","last_change":"2024-09-17T02:58:21.003230+0000","last_active":"2024-09-17T02:58:21.003882+0000","last_peered":"2024-09-17T02:58:21.003882+0000","last_clean":"2024-09-17T02:58:21.003882+0000","last_became_active":"2024-09-17T02:58:21.002944+0000","last_became_peered":"2024-09-17T02:58:21.002944+0000","last_unstale":"2024-09-17T02:58:21.003882+0000","last_undegraded":"2024-09-17T02:58:21.003882+0000","last_fullsized":"2024-09-17T02:58:21.003882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:00.076084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999501+0000","last_change":"2024-09-17T02:58:20.999501+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999501+0000","last_undegraded":"2024-09-17T02:58:20.999501+0000","last_fullsized":"2024-09-17T02:58:20.999501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006158+0000","last_change":"2024-09-17T02:58:21.005929+0000","last_active":"2024-09-17T02:58:21.006158+0000","last_peered":"2024-09-17T02:58:21.006158+0000","last_clean":"2024-09-17T02:58:21.006158+0000","last_became_active":"2024-09-17T02:58:21.005655+0000","last_became_peered":"2024-09-17T02:58:21.005655+0000","last_unstale":"2024-09-17T02:58:21.006158+0000","last_undegraded":"2024-09-17T02:58:21.006158+0000","last_fullsized":"2024-09-17T02:58:21.006158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:06.615787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996385+0000","last_change":"2024-09-17T02:58:20.996385+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996385+0000","last_undegraded":"2024-09-17T02:58:20.996385+0000","last_fullsized":"2024-09-17T02:58:20.996385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.001191+0000","last_change":"2024-09-17T02:58:21.000999+0000","last_active":"2024-09-17T02:58:21.001191+0000","last_peered":"2024-09-17T02:58:21.001191+0000","last_clean":"2024-09-17T02:58:21.001191+0000","last_became_active":"2024-09-17T02:58:21.000691+0000","last_became_peered":"2024-09-17T02:58:21.000691+0000","last_unstale":"2024-09-17T02:58:21.001191+0000","last_undegraded":"2024-09-17T02:58:21.001191+0000","last_fullsized":"2024-09-17T02:58:21.001191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:19.598276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994898+0000","last_change":"2024-09-17T02:58:20.994898+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994898+0000","last_undegraded":"2024-09-17T02:58:20.994898+0000","last_fullsized":"2024-09-17T02:58:20.994898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009045+0000","last_change":"2024-09-17T02:58:21.008825+0000","last_active":"2024-09-17T02:58:21.009045+0000","last_peered":"2024-09-17T02:58:21.009045+0000","last_clean":"2024-09-17T02:58:21.009045+0000","last_became_active":"2024-09-17T02:58:21.008199+0000","last_became_peered":"2024-09-17T02:58:21.008199+0000","last_unstale":"2024-09-17T02:58:21.009045+0000","last_undegraded":"2024-09-17T02:58:21.009045+0000","last_fullsized":"2024-09-17T02:58:21.009045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:58.095824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996361+0000","last_change":"2024-09-17T02:58:20.996361+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996361+0000","last_undegraded":"2024-09-17T02:58:20.996361+0000","last_fullsized":"2024-09-17T02:58:20.996361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009037+0000","last_change":"2024-09-17T02:58:21.008811+0000","last_active":"2024-09-17T02:58:21.009037+0000","last_peered":"2024-09-17T02:58:21.009037+0000","last_clean":"2024-09-17T02:58:21.009037+0000","last_became_active":"2024-09-17T02:58:21.006905+0000","last_became_peered":"2024-09-17T02:58:21.006905+0000","last_unstale":"2024-09-17T02:58:21.009037+0000","last_undegraded":"2024-09-17T02:58:21.009037+0000","last_fullsized":"2024-09-17T02:58:21.009037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:26.616807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999381+0000","last_change":"2024-09-17T02:58:20.999381+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999381+0000","last_undegraded":"2024-09-17T02:58:20.999381+0000","last_fullsized":"2024-09-17T02:58:20.999381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.008520+0000","last_change":"2024-09-17T02:58:21.008132+0000","last_active":"2024-09-17T02:58:21.008520+0000","last_peered":"2024-09-17T02:58:21.008520+0000","last_clean":"2024-09-17T02:58:21.008520+0000","last_became_active":"2024-09-17T02:58:21.007404+0000","last_became_peered":"2024-09-17T02:58:21.007404+0000","last_unstale":"2024-09-17T02:58:21.008520+0000","last_undegraded":"2024-09-17T02:58:21.008520+0000","last_fullsized":"2024-09-17T02:58:21.008520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:31.189583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":228,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.998167+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:58:20.998167+0000","last_peered":"2024-09-17T02:58:20.998167+0000","last_clean":"2024-09-17T02:58:20.998167+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:58:20.998167+0000","last_undegraded":"2024-09-17T02:58:20.998167+0000","last_fullsized":"2024-09-17T02:58:20.998167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:58.696508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991439,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194897,"statfs":{"total":200000000,"available":199575532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194897,"statfs":{"total":200000000,"available":199575532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991439,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:58:25.371 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:58:25.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.520+0000 7fc7bc486640 1 -- 172.21.15.104:0/1292638337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a0005350 msgr2=0x7fc7a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.520+0000 7fc7bc486640 1 --2- 172.21.15.104:0/1292638337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a0005350 0x7fc7a000b9c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac006fd0 tx=0x7fc7a0005830 comp rx=0 tx=0).stop 2024-09-17T02:58:25.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.520+0000 7fc7bc486640 1 -- 172.21.15.104:0/1292638337 shutdown_connections 2024-09-17T02:58:25.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.520+0000 7fc7bc486640 1 --2- 172.21.15.104:0/1292638337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7a0005350 0x7fc7a000b9c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.520+0000 7fc7bc486640 1 -- 172.21.15.104:0/1292638337 >> 172.21.15.104:0/1292638337 conn(0x7fc7b4069120 msgr2=0x7fc7b4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:25.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.520+0000 7fc7bc486640 1 -- 172.21.15.104:0/1292638337 shutdown_connections 2024-09-17T02:58:25.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.520+0000 7fc7bc486640 1 -- 172.21.15.104:0/1292638337 wait complete. 2024-09-17T02:58:25.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.521+0000 7fc7bc486640 1 Processor -- start 2024-09-17T02:58:25.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.521+0000 7fc7bc486640 1 -- start start 2024-09-17T02:58:25.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7bc486640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a0005350 0x7fc7b41f9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7bc486640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b41f9980 0x7fc7b40ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7bc486640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b40ce660 0x7fc7b41598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7bc486640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b40b6930 con 0x7fc7b40ce660 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7bc486640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b40b67b0 con 0x7fc7b41f9980 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7bc486640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b40b6ab0 con 0x7fc7a0005350 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b40ce660 0x7fc7b41598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b40ce660 0x7fc7b41598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60916/0 (socket says 172.21.15.104:60916) 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 -- 172.21.15.104:0/3290079028 learned_addr learned my addr 172.21.15.104:0/3290079028 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7ba222640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a0005350 0x7fc7b41f9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7b9a21640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b41f9980 0x7fc7b40ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 -- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a0005350 msgr2=0x7fc7b41f9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a0005350 0x7fc7b41f9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 -- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b41f9980 msgr2=0x7fc7b40ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b41f9980 0x7fc7b40ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 -- 172.21.15.104:0/3290079028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b4152840 con 0x7fc7b40ce660 2024-09-17T02:58:25.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7baa23640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b40ce660 0x7fc7b41598c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac02b0f0 tx=0x7fc7ac006670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:25.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7aaffd640 1 -- 172.21.15.104:0/3290079028 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac031050 con 0x7fc7b40ce660 2024-09-17T02:58:25.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7aaffd640 1 -- 172.21.15.104:0/3290079028 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7ac036660 con 0x7fc7b40ce660 2024-09-17T02:58:25.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.523+0000 7fc7aaffd640 1 -- 172.21.15.104:0/3290079028 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac036a90 con 0x7fc7b40ce660 2024-09-17T02:58:25.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.524+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b4159160 con 0x7fc7b40ce660 2024-09-17T02:58:25.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.524+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b41585e0 con 0x7fc7b40ce660 2024-09-17T02:58:25.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.525+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b41611d0 con 0x7fc7b40ce660 2024-09-17T02:58:25.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.525+0000 7fc7aaffd640 1 -- 172.21.15.104:0/3290079028 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7ac034070 con 0x7fc7b40ce660 2024-09-17T02:58:25.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.526+0000 7fc7aaffd640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc798078b90 0x7fc79807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.526+0000 7fc7aaffd640 1 -- 172.21.15.104:0/3290079028 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fc7ac0ba800 con 0x7fc7b40ce660 2024-09-17T02:58:25.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.526+0000 7fc7ba222640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc798078b90 0x7fc79807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.527+0000 7fc7ba222640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc798078b90 0x7fc79807b0a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0006110 tx=0x7fc7b0006cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:25.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.530+0000 7fc7aaffd640 1 -- 172.21.15.104:0/3290079028 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc7ac082c40 con 0x7fc7b40ce660 2024-09-17T02:58:25.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.702+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7b4158370 con 0x7fc798078b90 2024-09-17T02:58:25.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.706+0000 7fc7aaffd640 1 -- 172.21.15.104:0/3290079028 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242336 (secure 0 0 0) 0x7fc7b4158370 con 0x7fc798078b90 2024-09-17T02:58:25.709 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:25.711 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:58:25.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc798078b90 msgr2=0x7fc79807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc798078b90 0x7fc79807b0a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0006110 tx=0x7fc7b0006cf0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b40ce660 msgr2=0x7fc7b41598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b40ce660 0x7fc7b41598c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac02b0f0 tx=0x7fc7ac006670 comp rx=0 tx=0).stop 2024-09-17T02:58:25.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 shutdown_connections 2024-09-17T02:58:25.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc798078b90 0x7fc79807b0a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7b41f9980 0x7fc7b40ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc7b40ce660 0x7fc7b41598c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 --2- 172.21.15.104:0/3290079028 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc7a0005350 0x7fc7b41f9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 >> 172.21.15.104:0/3290079028 conn(0x7fc7b4069120 msgr2=0x7fc7b415d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:25.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 shutdown_connections 2024-09-17T02:58:25.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.710+0000 7fc7bc486640 1 -- 172.21.15.104:0/3290079028 wait complete. 2024-09-17T02:58:25.721 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-17T02:58:25.674870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4432,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558067,"statfs":{"total":1600000000,"available":1595461170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.683539"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002072+0000","last_change":"2024-09-17T02:58:21.002072+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002072+0000","last_undegraded":"2024-09-17T02:58:21.002072+0000","last_fullsized":"2024-09-17T02:58:21.002072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995746+0000","last_change":"2024-09-17T02:58:20.995746+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995746+0000","last_undegraded":"2024-09-17T02:58:20.995746+0000","last_fullsized":"2024-09-17T02:58:20.995746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000391+0000","last_change":"2024-09-17T02:58:21.000391+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000391+0000","last_undegraded":"2024-09-17T02:58:21.000391+0000","last_fullsized":"2024-09-17T02:58:21.000391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995861+0000","last_change":"2024-09-17T02:58:20.995861+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995861+0000","last_undegraded":"2024-09-17T02:58:20.995861+0000","last_fullsized":"2024-09-17T02:58:20.995861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001855+0000","last_change":"2024-09-17T02:58:21.001855+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001855+0000","last_undegraded":"2024-09-17T02:58:21.001855+0000","last_fullsized":"2024-09-17T02:58:21.001855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.997223+0000","last_change":"2024-09-17T02:58:20.997223+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.997223+0000","last_undegraded":"2024-09-17T02:58:20.997223+0000","last_fullsized":"2024-09-17T02:58:20.997223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002013+0000","last_change":"2024-09-17T02:58:21.002013+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002013+0000","last_undegraded":"2024-09-17T02:58:21.002013+0000","last_fullsized":"2024-09-17T02:58:21.002013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996890+0000","last_change":"2024-09-17T02:58:20.996890+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996890+0000","last_undegraded":"2024-09-17T02:58:20.996890+0000","last_fullsized":"2024-09-17T02:58:20.996890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001414+0000","last_change":"2024-09-17T02:58:21.001414+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001414+0000","last_undegraded":"2024-09-17T02:58:21.001414+0000","last_fullsized":"2024-09-17T02:58:21.001414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000432+0000","last_change":"2024-09-17T02:58:21.000432+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000432+0000","last_undegraded":"2024-09-17T02:58:21.000432+0000","last_fullsized":"2024-09-17T02:58:21.000432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000798+0000","last_change":"2024-09-17T02:58:21.000798+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000798+0000","last_undegraded":"2024-09-17T02:58:21.000798+0000","last_fullsized":"2024-09-17T02:58:21.000798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995223+0000","last_change":"2024-09-17T02:58:20.995223+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995223+0000","last_undegraded":"2024-09-17T02:58:20.995223+0000","last_fullsized":"2024-09-17T02:58:20.995223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000052+0000","last_change":"2024-09-17T02:58:21.000052+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000052+0000","last_undegraded":"2024-09-17T02:58:21.000052+0000","last_fullsized":"2024-09-17T02:58:21.000052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001039+0000","last_change":"2024-09-17T02:58:21.001039+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001039+0000","last_undegraded":"2024-09-17T02:58:21.001039+0000","last_fullsized":"2024-09-17T02:58:21.001039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999256+0000","last_change":"2024-09-17T02:58:20.999256+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999256+0000","last_undegraded":"2024-09-17T02:58:20.999256+0000","last_fullsized":"2024-09-17T02:58:20.999256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998080+0000","last_change":"2024-09-17T02:58:20.998080+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998080+0000","last_undegraded":"2024-09-17T02:58:20.998080+0000","last_fullsized":"2024-09-17T02:58:20.998080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000794+0000","last_change":"2024-09-17T02:58:21.000794+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000794+0000","last_undegraded":"2024-09-17T02:58:21.000794+0000","last_fullsized":"2024-09-17T02:58:21.000794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994683+0000","last_change":"2024-09-17T02:58:20.994683+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994683+0000","last_undegraded":"2024-09-17T02:58:20.994683+0000","last_fullsized":"2024-09-17T02:58:20.994683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996614+0000","last_change":"2024-09-17T02:58:20.996614+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996614+0000","last_undegraded":"2024-09-17T02:58:20.996614+0000","last_fullsized":"2024-09-17T02:58:20.996614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998650+0000","last_change":"2024-09-17T02:58:20.998650+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998650+0000","last_undegraded":"2024-09-17T02:58:20.998650+0000","last_fullsized":"2024-09-17T02:58:20.998650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998483+0000","last_change":"2024-09-17T02:58:20.998483+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998483+0000","last_undegraded":"2024-09-17T02:58:20.998483+0000","last_fullsized":"2024-09-17T02:58:20.998483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998864+0000","last_change":"2024-09-17T02:58:20.998864+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998864+0000","last_undegraded":"2024-09-17T02:58:20.998864+0000","last_fullsized":"2024-09-17T02:58:20.998864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999615+0000","last_change":"2024-09-17T02:58:20.999615+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999615+0000","last_undegraded":"2024-09-17T02:58:20.999615+0000","last_fullsized":"2024-09-17T02:58:20.999615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000939+0000","last_change":"2024-09-17T02:58:21.000939+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000939+0000","last_undegraded":"2024-09-17T02:58:21.000939+0000","last_fullsized":"2024-09-17T02:58:21.000939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000094+0000","last_change":"2024-09-17T02:58:21.000094+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000094+0000","last_undegraded":"2024-09-17T02:58:21.000094+0000","last_fullsized":"2024-09-17T02:58:21.000094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002578+0000","last_change":"2024-09-17T02:58:21.002578+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002578+0000","last_undegraded":"2024-09-17T02:58:21.002578+0000","last_fullsized":"2024-09-17T02:58:21.002578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000635+0000","last_change":"2024-09-17T02:58:21.000635+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000635+0000","last_undegraded":"2024-09-17T02:58:21.000635+0000","last_fullsized":"2024-09-17T02:58:21.000635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000804+0000","last_change":"2024-09-17T02:58:21.000804+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000804+0000","last_undegraded":"2024-09-17T02:58:21.000804+0000","last_fullsized":"2024-09-17T02:58:21.000804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999738+0000","last_change":"2024-09-17T02:58:20.999738+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999738+0000","last_undegraded":"2024-09-17T02:58:20.999738+0000","last_fullsized":"2024-09-17T02:58:20.999738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000762+0000","last_change":"2024-09-17T02:58:21.000762+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000762+0000","last_undegraded":"2024-09-17T02:58:21.000762+0000","last_fullsized":"2024-09-17T02:58:21.000762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001100+0000","last_change":"2024-09-17T02:58:21.001100+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001100+0000","last_undegraded":"2024-09-17T02:58:21.001100+0000","last_fullsized":"2024-09-17T02:58:21.001100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995225+0000","last_change":"2024-09-17T02:58:20.995225+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995225+0000","last_undegraded":"2024-09-17T02:58:20.995225+0000","last_fullsized":"2024-09-17T02:58:20.995225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000172+0000","last_change":"2024-09-17T02:58:21.000172+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000172+0000","last_undegraded":"2024-09-17T02:58:21.000172+0000","last_fullsized":"2024-09-17T02:58:21.000172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006499+0000","last_change":"2024-09-17T02:58:21.003281+0000","last_active":"2024-09-17T02:58:21.006499+0000","last_peered":"2024-09-17T02:58:21.006499+0000","last_clean":"2024-09-17T02:58:21.006499+0000","last_became_active":"2024-09-17T02:58:21.002339+0000","last_became_peered":"2024-09-17T02:58:21.002339+0000","last_unstale":"2024-09-17T02:58:21.006499+0000","last_undegraded":"2024-09-17T02:58:21.006499+0000","last_fullsized":"2024-09-17T02:58:21.006499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:34.463154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001135+0000","last_change":"2024-09-17T02:58:21.001135+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001135+0000","last_undegraded":"2024-09-17T02:58:21.001135+0000","last_fullsized":"2024-09-17T02:58:21.001135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006875+0000","last_change":"2024-09-17T02:58:21.006659+0000","last_active":"2024-09-17T02:58:21.006875+0000","last_peered":"2024-09-17T02:58:21.006875+0000","last_clean":"2024-09-17T02:58:21.006875+0000","last_became_active":"2024-09-17T02:58:21.005416+0000","last_became_peered":"2024-09-17T02:58:21.005416+0000","last_unstale":"2024-09-17T02:58:21.006875+0000","last_undegraded":"2024-09-17T02:58:21.006875+0000","last_fullsized":"2024-09-17T02:58:21.006875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:43.841299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996769+0000","last_change":"2024-09-17T02:58:20.996769+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996769+0000","last_undegraded":"2024-09-17T02:58:20.996769+0000","last_fullsized":"2024-09-17T02:58:20.996769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006369+0000","last_change":"2024-09-17T02:58:21.006096+0000","last_active":"2024-09-17T02:58:21.006369+0000","last_peered":"2024-09-17T02:58:21.006369+0000","last_clean":"2024-09-17T02:58:21.006369+0000","last_became_active":"2024-09-17T02:58:21.005526+0000","last_became_peered":"2024-09-17T02:58:21.005526+0000","last_unstale":"2024-09-17T02:58:21.006369+0000","last_undegraded":"2024-09-17T02:58:21.006369+0000","last_fullsized":"2024-09-17T02:58:21.006369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:24.299267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001412+0000","last_change":"2024-09-17T02:58:21.001412+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001412+0000","last_undegraded":"2024-09-17T02:58:21.001412+0000","last_fullsized":"2024-09-17T02:58:21.001412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006476+0000","last_change":"2024-09-17T02:58:21.006163+0000","last_active":"2024-09-17T02:58:21.006476+0000","last_peered":"2024-09-17T02:58:21.006476+0000","last_clean":"2024-09-17T02:58:21.006476+0000","last_became_active":"2024-09-17T02:58:21.005823+0000","last_became_peered":"2024-09-17T02:58:21.005823+0000","last_unstale":"2024-09-17T02:58:21.006476+0000","last_undegraded":"2024-09-17T02:58:21.006476+0000","last_fullsized":"2024-09-17T02:58:21.006476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:01.885292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001792+0000","last_change":"2024-09-17T02:58:21.001792+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001792+0000","last_undegraded":"2024-09-17T02:58:21.001792+0000","last_fullsized":"2024-09-17T02:58:21.001792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.007658+0000","last_change":"2024-09-17T02:58:21.007467+0000","last_active":"2024-09-17T02:58:21.007658+0000","last_peered":"2024-09-17T02:58:21.007658+0000","last_clean":"2024-09-17T02:58:21.007658+0000","last_became_active":"2024-09-17T02:58:21.007127+0000","last_became_peered":"2024-09-17T02:58:21.007127+0000","last_unstale":"2024-09-17T02:58:21.007658+0000","last_undegraded":"2024-09-17T02:58:21.007658+0000","last_fullsized":"2024-09-17T02:58:21.007658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:55.372211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.997904+0000","last_change":"2024-09-17T02:58:20.997904+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.997904+0000","last_undegraded":"2024-09-17T02:58:20.997904+0000","last_fullsized":"2024-09-17T02:58:20.997904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006579+0000","last_change":"2024-09-17T02:58:21.006408+0000","last_active":"2024-09-17T02:58:21.006579+0000","last_peered":"2024-09-17T02:58:21.006579+0000","last_clean":"2024-09-17T02:58:21.006579+0000","last_became_active":"2024-09-17T02:58:21.005945+0000","last_became_peered":"2024-09-17T02:58:21.005945+0000","last_unstale":"2024-09-17T02:58:21.006579+0000","last_undegraded":"2024-09-17T02:58:21.006579+0000","last_fullsized":"2024-09-17T02:58:21.006579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.041280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001169+0000","last_change":"2024-09-17T02:58:21.001169+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001169+0000","last_undegraded":"2024-09-17T02:58:21.001169+0000","last_fullsized":"2024-09-17T02:58:21.001169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.001098+0000","last_change":"2024-09-17T02:58:21.000894+0000","last_active":"2024-09-17T02:58:21.001098+0000","last_peered":"2024-09-17T02:58:21.001098+0000","last_clean":"2024-09-17T02:58:21.001098+0000","last_became_active":"2024-09-17T02:58:21.000611+0000","last_became_peered":"2024-09-17T02:58:21.000611+0000","last_unstale":"2024-09-17T02:58:21.001098+0000","last_undegraded":"2024-09-17T02:58:21.001098+0000","last_fullsized":"2024-09-17T02:58:21.001098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:02.722779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999633+0000","last_change":"2024-09-17T02:58:20.999633+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999633+0000","last_undegraded":"2024-09-17T02:58:20.999633+0000","last_fullsized":"2024-09-17T02:58:20.999633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.996658+0000","last_change":"2024-09-17T02:58:20.996167+0000","last_active":"2024-09-17T02:58:20.996658+0000","last_peered":"2024-09-17T02:58:20.996658+0000","last_clean":"2024-09-17T02:58:20.996658+0000","last_became_active":"2024-09-17T02:58:20.995880+0000","last_became_peered":"2024-09-17T02:58:20.995880+0000","last_unstale":"2024-09-17T02:58:20.996658+0000","last_undegraded":"2024-09-17T02:58:20.996658+0000","last_fullsized":"2024-09-17T02:58:20.996658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:30.834624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001635+0000","last_change":"2024-09-17T02:58:21.001635+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001635+0000","last_undegraded":"2024-09-17T02:58:21.001635+0000","last_fullsized":"2024-09-17T02:58:21.001635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003653+0000","last_change":"2024-09-17T02:58:21.003450+0000","last_active":"2024-09-17T02:58:21.003653+0000","last_peered":"2024-09-17T02:58:21.003653+0000","last_clean":"2024-09-17T02:58:21.003653+0000","last_became_active":"2024-09-17T02:58:21.002955+0000","last_became_peered":"2024-09-17T02:58:21.002955+0000","last_unstale":"2024-09-17T02:58:21.003653+0000","last_undegraded":"2024-09-17T02:58:21.003653+0000","last_fullsized":"2024-09-17T02:58:21.003653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:10.589201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999815+0000","last_change":"2024-09-17T02:58:20.999815+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999815+0000","last_undegraded":"2024-09-17T02:58:20.999815+0000","last_fullsized":"2024-09-17T02:58:20.999815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005759+0000","last_change":"2024-09-17T02:58:21.005548+0000","last_active":"2024-09-17T02:58:21.005759+0000","last_peered":"2024-09-17T02:58:21.005759+0000","last_clean":"2024-09-17T02:58:21.005759+0000","last_became_active":"2024-09-17T02:58:21.005071+0000","last_became_peered":"2024-09-17T02:58:21.005071+0000","last_unstale":"2024-09-17T02:58:21.005759+0000","last_undegraded":"2024-09-17T02:58:21.005759+0000","last_fullsized":"2024-09-17T02:58:21.005759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:03.004891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996225+0000","last_change":"2024-09-17T02:58:20.996225+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996225+0000","last_undegraded":"2024-09-17T02:58:20.996225+0000","last_fullsized":"2024-09-17T02:58:20.996225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.004646+0000","last_change":"2024-09-17T02:58:21.004399+0000","last_active":"2024-09-17T02:58:21.004646+0000","last_peered":"2024-09-17T02:58:21.004646+0000","last_clean":"2024-09-17T02:58:21.004646+0000","last_became_active":"2024-09-17T02:58:21.004078+0000","last_became_peered":"2024-09-17T02:58:21.004078+0000","last_unstale":"2024-09-17T02:58:21.004646+0000","last_undegraded":"2024-09-17T02:58:21.004646+0000","last_fullsized":"2024-09-17T02:58:21.004646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:11.089885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000415+0000","last_change":"2024-09-17T02:58:21.000415+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000415+0000","last_undegraded":"2024-09-17T02:58:21.000415+0000","last_fullsized":"2024-09-17T02:58:21.000415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.997632+0000","last_change":"2024-09-17T02:58:20.997321+0000","last_active":"2024-09-17T02:58:20.997632+0000","last_peered":"2024-09-17T02:58:20.997632+0000","last_clean":"2024-09-17T02:58:20.997632+0000","last_became_active":"2024-09-17T02:58:20.996864+0000","last_became_peered":"2024-09-17T02:58:20.996864+0000","last_unstale":"2024-09-17T02:58:20.997632+0000","last_undegraded":"2024-09-17T02:58:20.997632+0000","last_fullsized":"2024-09-17T02:58:20.997632+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:29.400328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998665+0000","last_change":"2024-09-17T02:58:20.998665+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998665+0000","last_undegraded":"2024-09-17T02:58:20.998665+0000","last_fullsized":"2024-09-17T02:58:20.998665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003212+0000","last_change":"2024-09-17T02:58:21.002715+0000","last_active":"2024-09-17T02:58:21.003212+0000","last_peered":"2024-09-17T02:58:21.003212+0000","last_clean":"2024-09-17T02:58:21.003212+0000","last_became_active":"2024-09-17T02:58:21.002427+0000","last_became_peered":"2024-09-17T02:58:21.002427+0000","last_unstale":"2024-09-17T02:58:21.003212+0000","last_undegraded":"2024-09-17T02:58:21.003212+0000","last_fullsized":"2024-09-17T02:58:21.003212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:10.359392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000312+0000","last_change":"2024-09-17T02:58:21.000312+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000312+0000","last_undegraded":"2024-09-17T02:58:21.000312+0000","last_fullsized":"2024-09-17T02:58:21.000312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.998907+0000","last_change":"2024-09-17T02:58:20.998480+0000","last_active":"2024-09-17T02:58:20.998907+0000","last_peered":"2024-09-17T02:58:20.998907+0000","last_clean":"2024-09-17T02:58:20.998907+0000","last_became_active":"2024-09-17T02:58:20.998192+0000","last_became_peered":"2024-09-17T02:58:20.998192+0000","last_unstale":"2024-09-17T02:58:20.998907+0000","last_undegraded":"2024-09-17T02:58:20.998907+0000","last_fullsized":"2024-09-17T02:58:20.998907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:40.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999432+0000","last_change":"2024-09-17T02:58:20.999432+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999432+0000","last_undegraded":"2024-09-17T02:58:20.999432+0000","last_fullsized":"2024-09-17T02:58:20.999432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003964+0000","last_change":"2024-09-17T02:58:21.003758+0000","last_active":"2024-09-17T02:58:21.003964+0000","last_peered":"2024-09-17T02:58:21.003964+0000","last_clean":"2024-09-17T02:58:21.003964+0000","last_became_active":"2024-09-17T02:58:21.003431+0000","last_became_peered":"2024-09-17T02:58:21.003431+0000","last_unstale":"2024-09-17T02:58:21.003964+0000","last_undegraded":"2024-09-17T02:58:21.003964+0000","last_fullsized":"2024-09-17T02:58:21.003964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:21.198235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999984+0000","last_change":"2024-09-17T02:58:20.999984+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999984+0000","last_undegraded":"2024-09-17T02:58:20.999984+0000","last_fullsized":"2024-09-17T02:58:20.999984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009396+0000","last_change":"2024-09-17T02:58:21.009192+0000","last_active":"2024-09-17T02:58:21.009396+0000","last_peered":"2024-09-17T02:58:21.009396+0000","last_clean":"2024-09-17T02:58:21.009396+0000","last_became_active":"2024-09-17T02:58:21.008557+0000","last_became_peered":"2024-09-17T02:58:21.008557+0000","last_unstale":"2024-09-17T02:58:21.009396+0000","last_undegraded":"2024-09-17T02:58:21.009396+0000","last_fullsized":"2024-09-17T02:58:21.009396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:56.121586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999700+0000","last_change":"2024-09-17T02:58:20.999700+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999700+0000","last_undegraded":"2024-09-17T02:58:20.999700+0000","last_fullsized":"2024-09-17T02:58:20.999700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009306+0000","last_change":"2024-09-17T02:58:21.009117+0000","last_active":"2024-09-17T02:58:21.009306+0000","last_peered":"2024-09-17T02:58:21.009306+0000","last_clean":"2024-09-17T02:58:21.009306+0000","last_became_active":"2024-09-17T02:58:21.007266+0000","last_became_peered":"2024-09-17T02:58:21.007266+0000","last_unstale":"2024-09-17T02:58:21.009306+0000","last_undegraded":"2024-09-17T02:58:21.009306+0000","last_fullsized":"2024-09-17T02:58:21.009306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:59.064669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999778+0000","last_change":"2024-09-17T02:58:20.999778+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999778+0000","last_undegraded":"2024-09-17T02:58:20.999778+0000","last_fullsized":"2024-09-17T02:58:20.999778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005991+0000","last_change":"2024-09-17T02:58:21.005789+0000","last_active":"2024-09-17T02:58:21.005991+0000","last_peered":"2024-09-17T02:58:21.005991+0000","last_clean":"2024-09-17T02:58:21.005991+0000","last_became_active":"2024-09-17T02:58:21.005141+0000","last_became_peered":"2024-09-17T02:58:21.005141+0000","last_unstale":"2024-09-17T02:58:21.005991+0000","last_undegraded":"2024-09-17T02:58:21.005991+0000","last_fullsized":"2024-09-17T02:58:21.005991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:24.161214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994603+0000","last_change":"2024-09-17T02:58:20.994603+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994603+0000","last_undegraded":"2024-09-17T02:58:20.994603+0000","last_fullsized":"2024-09-17T02:58:20.994603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.002600+0000","last_change":"2024-09-17T02:58:21.002316+0000","last_active":"2024-09-17T02:58:21.002600+0000","last_peered":"2024-09-17T02:58:21.002600+0000","last_clean":"2024-09-17T02:58:21.002600+0000","last_became_active":"2024-09-17T02:58:21.002050+0000","last_became_peered":"2024-09-17T02:58:21.002050+0000","last_unstale":"2024-09-17T02:58:21.002600+0000","last_undegraded":"2024-09-17T02:58:21.002600+0000","last_fullsized":"2024-09-17T02:58:21.002600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:51.431907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000134+0000","last_change":"2024-09-17T02:58:21.000134+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000134+0000","last_undegraded":"2024-09-17T02:58:21.000134+0000","last_fullsized":"2024-09-17T02:58:21.000134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.007687+0000","last_change":"2024-09-17T02:58:21.007482+0000","last_active":"2024-09-17T02:58:21.007687+0000","last_peered":"2024-09-17T02:58:21.007687+0000","last_clean":"2024-09-17T02:58:21.007687+0000","last_became_active":"2024-09-17T02:58:21.007194+0000","last_became_peered":"2024-09-17T02:58:21.007194+0000","last_unstale":"2024-09-17T02:58:21.007687+0000","last_undegraded":"2024-09-17T02:58:21.007687+0000","last_fullsized":"2024-09-17T02:58:21.007687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.437518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999410+0000","last_change":"2024-09-17T02:58:20.999410+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999410+0000","last_undegraded":"2024-09-17T02:58:20.999410+0000","last_fullsized":"2024-09-17T02:58:20.999410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009612+0000","last_change":"2024-09-17T02:58:21.009391+0000","last_active":"2024-09-17T02:58:21.009612+0000","last_peered":"2024-09-17T02:58:21.009612+0000","last_clean":"2024-09-17T02:58:21.009612+0000","last_became_active":"2024-09-17T02:58:21.007661+0000","last_became_peered":"2024-09-17T02:58:21.007661+0000","last_unstale":"2024-09-17T02:58:21.009612+0000","last_undegraded":"2024-09-17T02:58:21.009612+0000","last_fullsized":"2024-09-17T02:58:21.009612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:15.787004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998495+0000","last_change":"2024-09-17T02:58:20.998495+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998495+0000","last_undegraded":"2024-09-17T02:58:20.998495+0000","last_fullsized":"2024-09-17T02:58:20.998495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005602+0000","last_change":"2024-09-17T02:58:21.005375+0000","last_active":"2024-09-17T02:58:21.005602+0000","last_peered":"2024-09-17T02:58:21.005602+0000","last_clean":"2024-09-17T02:58:21.005602+0000","last_became_active":"2024-09-17T02:58:21.004679+0000","last_became_peered":"2024-09-17T02:58:21.004679+0000","last_unstale":"2024-09-17T02:58:21.005602+0000","last_undegraded":"2024-09-17T02:58:21.005602+0000","last_fullsized":"2024-09-17T02:58:21.005602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:41.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998958+0000","last_change":"2024-09-17T02:58:20.998958+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998958+0000","last_undegraded":"2024-09-17T02:58:20.998958+0000","last_fullsized":"2024-09-17T02:58:20.998958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003294+0000","last_change":"2024-09-17T02:58:21.002742+0000","last_active":"2024-09-17T02:58:21.003294+0000","last_peered":"2024-09-17T02:58:21.003294+0000","last_clean":"2024-09-17T02:58:21.003294+0000","last_became_active":"2024-09-17T02:58:21.002199+0000","last_became_peered":"2024-09-17T02:58:21.002199+0000","last_unstale":"2024-09-17T02:58:21.003294+0000","last_undegraded":"2024-09-17T02:58:21.003294+0000","last_fullsized":"2024-09-17T02:58:21.003294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:24.839326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998998+0000","last_change":"2024-09-17T02:58:20.998998+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998998+0000","last_undegraded":"2024-09-17T02:58:20.998998+0000","last_fullsized":"2024-09-17T02:58:20.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006502+0000","last_change":"2024-09-17T02:58:21.006274+0000","last_active":"2024-09-17T02:58:21.006502+0000","last_peered":"2024-09-17T02:58:21.006502+0000","last_clean":"2024-09-17T02:58:21.006502+0000","last_became_active":"2024-09-17T02:58:21.006012+0000","last_became_peered":"2024-09-17T02:58:21.006012+0000","last_unstale":"2024-09-17T02:58:21.006502+0000","last_undegraded":"2024-09-17T02:58:21.006502+0000","last_fullsized":"2024-09-17T02:58:21.006502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:59.618395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000750+0000","last_change":"2024-09-17T02:58:21.000750+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000750+0000","last_undegraded":"2024-09-17T02:58:21.000750+0000","last_fullsized":"2024-09-17T02:58:21.000750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006597+0000","last_change":"2024-09-17T02:58:21.006384+0000","last_active":"2024-09-17T02:58:21.006597+0000","last_peered":"2024-09-17T02:58:21.006597+0000","last_clean":"2024-09-17T02:58:21.006597+0000","last_became_active":"2024-09-17T02:58:21.006070+0000","last_became_peered":"2024-09-17T02:58:21.006070+0000","last_unstale":"2024-09-17T02:58:21.006597+0000","last_undegraded":"2024-09-17T02:58:21.006597+0000","last_fullsized":"2024-09-17T02:58:21.006597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:22.028745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000505+0000","last_change":"2024-09-17T02:58:21.000505+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000505+0000","last_undegraded":"2024-09-17T02:58:21.000505+0000","last_fullsized":"2024-09-17T02:58:21.000505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.004707+0000","last_change":"2024-09-17T02:58:21.004339+0000","last_active":"2024-09-17T02:58:21.004707+0000","last_peered":"2024-09-17T02:58:21.004707+0000","last_clean":"2024-09-17T02:58:21.004707+0000","last_became_active":"2024-09-17T02:58:21.004045+0000","last_became_peered":"2024-09-17T02:58:21.004045+0000","last_unstale":"2024-09-17T02:58:21.004707+0000","last_undegraded":"2024-09-17T02:58:21.004707+0000","last_fullsized":"2024-09-17T02:58:21.004707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:00.083016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999105+0000","last_change":"2024-09-17T02:58:20.999105+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999105+0000","last_undegraded":"2024-09-17T02:58:20.999105+0000","last_fullsized":"2024-09-17T02:58:20.999105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003882+0000","last_change":"2024-09-17T02:58:21.003230+0000","last_active":"2024-09-17T02:58:21.003882+0000","last_peered":"2024-09-17T02:58:21.003882+0000","last_clean":"2024-09-17T02:58:21.003882+0000","last_became_active":"2024-09-17T02:58:21.002944+0000","last_became_peered":"2024-09-17T02:58:21.002944+0000","last_unstale":"2024-09-17T02:58:21.003882+0000","last_undegraded":"2024-09-17T02:58:21.003882+0000","last_fullsized":"2024-09-17T02:58:21.003882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:00.076084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999501+0000","last_change":"2024-09-17T02:58:20.999501+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999501+0000","last_undegraded":"2024-09-17T02:58:20.999501+0000","last_fullsized":"2024-09-17T02:58:20.999501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006158+0000","last_change":"2024-09-17T02:58:21.005929+0000","last_active":"2024-09-17T02:58:21.006158+0000","last_peered":"2024-09-17T02:58:21.006158+0000","last_clean":"2024-09-17T02:58:21.006158+0000","last_became_active":"2024-09-17T02:58:21.005655+0000","last_became_peered":"2024-09-17T02:58:21.005655+0000","last_unstale":"2024-09-17T02:58:21.006158+0000","last_undegraded":"2024-09-17T02:58:21.006158+0000","last_fullsized":"2024-09-17T02:58:21.006158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:06.615787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996385+0000","last_change":"2024-09-17T02:58:20.996385+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996385+0000","last_undegraded":"2024-09-17T02:58:20.996385+0000","last_fullsized":"2024-09-17T02:58:20.996385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.001191+0000","last_change":"2024-09-17T02:58:21.000999+0000","last_active":"2024-09-17T02:58:21.001191+0000","last_peered":"2024-09-17T02:58:21.001191+0000","last_clean":"2024-09-17T02:58:21.001191+0000","last_became_active":"2024-09-17T02:58:21.000691+0000","last_became_peered":"2024-09-17T02:58:21.000691+0000","last_unstale":"2024-09-17T02:58:21.001191+0000","last_undegraded":"2024-09-17T02:58:21.001191+0000","last_fullsized":"2024-09-17T02:58:21.001191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:19.598276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994898+0000","last_change":"2024-09-17T02:58:20.994898+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994898+0000","last_undegraded":"2024-09-17T02:58:20.994898+0000","last_fullsized":"2024-09-17T02:58:20.994898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009045+0000","last_change":"2024-09-17T02:58:21.008825+0000","last_active":"2024-09-17T02:58:21.009045+0000","last_peered":"2024-09-17T02:58:21.009045+0000","last_clean":"2024-09-17T02:58:21.009045+0000","last_became_active":"2024-09-17T02:58:21.008199+0000","last_became_peered":"2024-09-17T02:58:21.008199+0000","last_unstale":"2024-09-17T02:58:21.009045+0000","last_undegraded":"2024-09-17T02:58:21.009045+0000","last_fullsized":"2024-09-17T02:58:21.009045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:58.095824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996361+0000","last_change":"2024-09-17T02:58:20.996361+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996361+0000","last_undegraded":"2024-09-17T02:58:20.996361+0000","last_fullsized":"2024-09-17T02:58:20.996361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009037+0000","last_change":"2024-09-17T02:58:21.008811+0000","last_active":"2024-09-17T02:58:21.009037+0000","last_peered":"2024-09-17T02:58:21.009037+0000","last_clean":"2024-09-17T02:58:21.009037+0000","last_became_active":"2024-09-17T02:58:21.006905+0000","last_became_peered":"2024-09-17T02:58:21.006905+0000","last_unstale":"2024-09-17T02:58:21.009037+0000","last_undegraded":"2024-09-17T02:58:21.009037+0000","last_fullsized":"2024-09-17T02:58:21.009037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:26.616807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999381+0000","last_change":"2024-09-17T02:58:20.999381+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999381+0000","last_undegraded":"2024-09-17T02:58:20.999381+0000","last_fullsized":"2024-09-17T02:58:20.999381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.008520+0000","last_change":"2024-09-17T02:58:21.008132+0000","last_active":"2024-09-17T02:58:21.008520+0000","last_peered":"2024-09-17T02:58:21.008520+0000","last_clean":"2024-09-17T02:58:21.008520+0000","last_became_active":"2024-09-17T02:58:21.007404+0000","last_became_peered":"2024-09-17T02:58:21.007404+0000","last_unstale":"2024-09-17T02:58:21.008520+0000","last_undegraded":"2024-09-17T02:58:21.008520+0000","last_fullsized":"2024-09-17T02:58:21.008520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:31.189583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":228,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.998167+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:58:20.998167+0000","last_peered":"2024-09-17T02:58:20.998167+0000","last_clean":"2024-09-17T02:58:20.998167+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:58:20.998167+0000","last_undegraded":"2024-09-17T02:58:20.998167+0000","last_fullsized":"2024-09-17T02:58:20.998167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:58.696508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991439,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194897,"statfs":{"total":200000000,"available":199575532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194897,"statfs":{"total":200000000,"available":199575532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991439,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:58:25.725 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-17T02:58:25.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.002072+0000', 'last_change': '2024-09-17T02:58:21.002072+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.002072+0000', 'last_undegraded': '2024-09-17T02:58:21.002072+0000', 'last_fullsized': '2024-09-17T02:58:21.002072+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.725 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3e is not active+clean 2024-09-17T02:58:25.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.995746+0000', 'last_change': '2024-09-17T02:58:20.995746+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.995746+0000', 'last_undegraded': '2024-09-17T02:58:20.995746+0000', 'last_fullsized': '2024-09-17T02:58:20.995746+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.725 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3d is not active+clean 2024-09-17T02:58:25.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000391+0000', 'last_change': '2024-09-17T02:58:21.000391+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000391+0000', 'last_undegraded': '2024-09-17T02:58:21.000391+0000', 'last_fullsized': '2024-09-17T02:58:21.000391+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:58:25.725 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3c is not active+clean 2024-09-17T02:58:25.725 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.995861+0000', 'last_change': '2024-09-17T02:58:20.995861+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.995861+0000', 'last_undegraded': '2024-09-17T02:58:20.995861+0000', 'last_fullsized': '2024-09-17T02:58:20.995861+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001855+0000', 'last_change': '2024-09-17T02:58:21.001855+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001855+0000', 'last_undegraded': '2024-09-17T02:58:21.001855+0000', 'last_fullsized': '2024-09-17T02:58:21.001855+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.997223+0000', 'last_change': '2024-09-17T02:58:20.997223+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.997223+0000', 'last_undegraded': '2024-09-17T02:58:20.997223+0000', 'last_fullsized': '2024-09-17T02:58:20.997223+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.002013+0000', 'last_change': '2024-09-17T02:58:21.002013+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.002013+0000', 'last_undegraded': '2024-09-17T02:58:21.002013+0000', 'last_fullsized': '2024-09-17T02:58:21.002013+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.996890+0000', 'last_change': '2024-09-17T02:58:20.996890+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.996890+0000', 'last_undegraded': '2024-09-17T02:58:20.996890+0000', 'last_fullsized': '2024-09-17T02:58:20.996890+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-09-17T02:58:25.726 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001414+0000', 'last_change': '2024-09-17T02:58:21.001414+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001414+0000', 'last_undegraded': '2024-09-17T02:58:21.001414+0000', 'last_fullsized': '2024-09-17T02:58:21.001414+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000432+0000', 'last_change': '2024-09-17T02:58:21.000432+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000432+0000', 'last_undegraded': '2024-09-17T02:58:21.000432+0000', 'last_fullsized': '2024-09-17T02:58:21.000432+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000798+0000', 'last_change': '2024-09-17T02:58:21.000798+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000798+0000', 'last_undegraded': '2024-09-17T02:58:21.000798+0000', 'last_fullsized': '2024-09-17T02:58:21.000798+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:PG 11.34 is not active+clean 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.995223+0000', 'last_change': '2024-09-17T02:58:20.995223+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.995223+0000', 'last_undegraded': '2024-09-17T02:58:20.995223+0000', 'last_fullsized': '2024-09-17T02:58:20.995223+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:PG 11.33 is not active+clean 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000052+0000', 'last_change': '2024-09-17T02:58:21.000052+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000052+0000', 'last_undegraded': '2024-09-17T02:58:21.000052+0000', 'last_fullsized': '2024-09-17T02:58:21.000052+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:PG 11.32 is not active+clean 2024-09-17T02:58:25.727 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001039+0000', 'last_change': '2024-09-17T02:58:21.001039+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001039+0000', 'last_undegraded': '2024-09-17T02:58:21.001039+0000', 'last_fullsized': '2024-09-17T02:58:21.001039+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:PG 11.31 is not active+clean 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999256+0000', 'last_change': '2024-09-17T02:58:20.999256+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999256+0000', 'last_undegraded': '2024-09-17T02:58:20.999256+0000', 'last_fullsized': '2024-09-17T02:58:20.999256+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.998080+0000', 'last_change': '2024-09-17T02:58:20.998080+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.998080+0000', 'last_undegraded': '2024-09-17T02:58:20.998080+0000', 'last_fullsized': '2024-09-17T02:58:20.998080+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000794+0000', 'last_change': '2024-09-17T02:58:21.000794+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000794+0000', 'last_undegraded': '2024-09-17T02:58:21.000794+0000', 'last_fullsized': '2024-09-17T02:58:21.000794+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2e is not active+clean 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.994683+0000', 'last_change': '2024-09-17T02:58:20.994683+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.994683+0000', 'last_undegraded': '2024-09-17T02:58:20.994683+0000', 'last_fullsized': '2024-09-17T02:58:20.994683+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-09-17T02:58:25.728 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.996614+0000', 'last_change': '2024-09-17T02:58:20.996614+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.996614+0000', 'last_undegraded': '2024-09-17T02:58:20.996614+0000', 'last_fullsized': '2024-09-17T02:58:20.996614+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2c is not active+clean 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.998650+0000', 'last_change': '2024-09-17T02:58:20.998650+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.998650+0000', 'last_undegraded': '2024-09-17T02:58:20.998650+0000', 'last_fullsized': '2024-09-17T02:58:20.998650+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.998483+0000', 'last_change': '2024-09-17T02:58:20.998483+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.998483+0000', 'last_undegraded': '2024-09-17T02:58:20.998483+0000', 'last_fullsized': '2024-09-17T02:58:20.998483+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.998864+0000', 'last_change': '2024-09-17T02:58:20.998864+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.998864+0000', 'last_undegraded': '2024-09-17T02:58:20.998864+0000', 'last_fullsized': '2024-09-17T02:58:20.998864+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999615+0000', 'last_change': '2024-09-17T02:58:20.999615+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999615+0000', 'last_undegraded': '2024-09-17T02:58:20.999615+0000', 'last_fullsized': '2024-09-17T02:58:20.999615+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-17T02:58:25.729 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000939+0000', 'last_change': '2024-09-17T02:58:21.000939+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000939+0000', 'last_undegraded': '2024-09-17T02:58:21.000939+0000', 'last_fullsized': '2024-09-17T02:58:21.000939+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000094+0000', 'last_change': '2024-09-17T02:58:21.000094+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000094+0000', 'last_undegraded': '2024-09-17T02:58:21.000094+0000', 'last_fullsized': '2024-09-17T02:58:21.000094+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.002578+0000', 'last_change': '2024-09-17T02:58:21.002578+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.002578+0000', 'last_undegraded': '2024-09-17T02:58:21.002578+0000', 'last_fullsized': '2024-09-17T02:58:21.002578+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:PG 11.25 is not active+clean 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000635+0000', 'last_change': '2024-09-17T02:58:21.000635+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000635+0000', 'last_undegraded': '2024-09-17T02:58:21.000635+0000', 'last_fullsized': '2024-09-17T02:58:21.000635+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000804+0000', 'last_change': '2024-09-17T02:58:21.000804+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000804+0000', 'last_undegraded': '2024-09-17T02:58:21.000804+0000', 'last_fullsized': '2024-09-17T02:58:21.000804+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:58:25.730 INFO:tasks.ceph.ceph_manager.ceph:PG 11.23 is not active+clean 2024-09-17T02:58:25.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999738+0000', 'last_change': '2024-09-17T02:58:20.999738+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999738+0000', 'last_undegraded': '2024-09-17T02:58:20.999738+0000', 'last_fullsized': '2024-09-17T02:58:20.999738+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:58:25.731 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-17T02:58:25.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000762+0000', 'last_change': '2024-09-17T02:58:21.000762+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000762+0000', 'last_undegraded': '2024-09-17T02:58:21.000762+0000', 'last_fullsized': '2024-09-17T02:58:21.000762+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:58:25.731 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-17T02:58:25.731 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001100+0000', 'last_change': '2024-09-17T02:58:21.001100+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001100+0000', 'last_undegraded': '2024-09-17T02:58:21.001100+0000', 'last_fullsized': '2024-09-17T02:58:21.001100+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:58:25.732 INFO:tasks.ceph.ceph_manager.ceph:PG 11.20 is not active+clean 2024-09-17T02:58:25.732 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.995225+0000', 'last_change': '2024-09-17T02:58:20.995225+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.995225+0000', 'last_undegraded': '2024-09-17T02:58:20.995225+0000', 'last_fullsized': '2024-09-17T02:58:20.995225+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.733 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-17T02:58:25.733 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000172+0000', 'last_change': '2024-09-17T02:58:21.000172+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000172+0000', 'last_undegraded': '2024-09-17T02:58:21.000172+0000', 'last_fullsized': '2024-09-17T02:58:21.000172+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.733 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-09-17T02:58:25.733 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001135+0000', 'last_change': '2024-09-17T02:58:21.001135+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001135+0000', 'last_undegraded': '2024-09-17T02:58:21.001135+0000', 'last_fullsized': '2024-09-17T02:58:21.001135+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.734 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-17T02:58:25.734 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.996769+0000', 'last_change': '2024-09-17T02:58:20.996769+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.996769+0000', 'last_undegraded': '2024-09-17T02:58:20.996769+0000', 'last_fullsized': '2024-09-17T02:58:20.996769+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.734 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-17T02:58:25.734 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001412+0000', 'last_change': '2024-09-17T02:58:21.001412+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001412+0000', 'last_undegraded': '2024-09-17T02:58:21.001412+0000', 'last_fullsized': '2024-09-17T02:58:21.001412+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.734 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-17T02:58:25.734 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001792+0000', 'last_change': '2024-09-17T02:58:21.001792+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001792+0000', 'last_undegraded': '2024-09-17T02:58:21.001792+0000', 'last_fullsized': '2024-09-17T02:58:21.001792+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:58:25.734 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-17T02:58:25.735 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.997904+0000', 'last_change': '2024-09-17T02:58:20.997904+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.997904+0000', 'last_undegraded': '2024-09-17T02:58:20.997904+0000', 'last_fullsized': '2024-09-17T02:58:20.997904+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:58:25.735 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-09-17T02:58:25.735 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001169+0000', 'last_change': '2024-09-17T02:58:21.001169+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001169+0000', 'last_undegraded': '2024-09-17T02:58:21.001169+0000', 'last_fullsized': '2024-09-17T02:58:21.001169+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.735 INFO:tasks.ceph.ceph_manager.ceph:PG 11.19 is not active+clean 2024-09-17T02:58:25.735 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999633+0000', 'last_change': '2024-09-17T02:58:20.999633+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999633+0000', 'last_undegraded': '2024-09-17T02:58:20.999633+0000', 'last_fullsized': '2024-09-17T02:58:20.999633+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:58:25.735 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-17T02:58:25.735 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.001635+0000', 'last_change': '2024-09-17T02:58:21.001635+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.001635+0000', 'last_undegraded': '2024-09-17T02:58:21.001635+0000', 'last_fullsized': '2024-09-17T02:58:21.001635+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:58:25.736 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-17T02:58:25.736 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999815+0000', 'last_change': '2024-09-17T02:58:20.999815+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999815+0000', 'last_undegraded': '2024-09-17T02:58:20.999815+0000', 'last_fullsized': '2024-09-17T02:58:20.999815+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.736 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-17T02:58:25.736 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.996225+0000', 'last_change': '2024-09-17T02:58:20.996225+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.996225+0000', 'last_undegraded': '2024-09-17T02:58:20.996225+0000', 'last_fullsized': '2024-09-17T02:58:20.996225+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.736 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000415+0000', 'last_change': '2024-09-17T02:58:21.000415+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000415+0000', 'last_undegraded': '2024-09-17T02:58:21.000415+0000', 'last_fullsized': '2024-09-17T02:58:21.000415+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.998665+0000', 'last_change': '2024-09-17T02:58:20.998665+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.998665+0000', 'last_undegraded': '2024-09-17T02:58:20.998665+0000', 'last_fullsized': '2024-09-17T02:58:20.998665+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000312+0000', 'last_change': '2024-09-17T02:58:21.000312+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000312+0000', 'last_undegraded': '2024-09-17T02:58:21.000312+0000', 'last_fullsized': '2024-09-17T02:58:21.000312+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:PG 11.10 is not active+clean 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999432+0000', 'last_change': '2024-09-17T02:58:20.999432+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999432+0000', 'last_undegraded': '2024-09-17T02:58:20.999432+0000', 'last_fullsized': '2024-09-17T02:58:20.999432+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999984+0000', 'last_change': '2024-09-17T02:58:20.999984+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999984+0000', 'last_undegraded': '2024-09-17T02:58:20.999984+0000', 'last_fullsized': '2024-09-17T02:58:20.999984+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-17T02:58:25.737 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999700+0000', 'last_change': '2024-09-17T02:58:20.999700+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999700+0000', 'last_undegraded': '2024-09-17T02:58:20.999700+0000', 'last_fullsized': '2024-09-17T02:58:20.999700+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999778+0000', 'last_change': '2024-09-17T02:58:20.999778+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999778+0000', 'last_undegraded': '2024-09-17T02:58:20.999778+0000', 'last_fullsized': '2024-09-17T02:58:20.999778+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:PG 11.c is not active+clean 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.994603+0000', 'last_change': '2024-09-17T02:58:20.994603+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.994603+0000', 'last_undegraded': '2024-09-17T02:58:20.994603+0000', 'last_fullsized': '2024-09-17T02:58:20.994603+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000134+0000', 'last_change': '2024-09-17T02:58:21.000134+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000134+0000', 'last_undegraded': '2024-09-17T02:58:21.000134+0000', 'last_fullsized': '2024-09-17T02:58:21.000134+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:PG 11.b is not active+clean 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999410+0000', 'last_change': '2024-09-17T02:58:20.999410+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999410+0000', 'last_undegraded': '2024-09-17T02:58:20.999410+0000', 'last_fullsized': '2024-09-17T02:58:20.999410+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:PG 11.8 is not active+clean 2024-09-17T02:58:25.738 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.998495+0000', 'last_change': '2024-09-17T02:58:20.998495+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.998495+0000', 'last_undegraded': '2024-09-17T02:58:20.998495+0000', 'last_fullsized': '2024-09-17T02:58:20.998495+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:PG 11.9 is not active+clean 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.998958+0000', 'last_change': '2024-09-17T02:58:20.998958+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.998958+0000', 'last_undegraded': '2024-09-17T02:58:20.998958+0000', 'last_fullsized': '2024-09-17T02:58:20.998958+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:PG 11.6 is not active+clean 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.998998+0000', 'last_change': '2024-09-17T02:58:20.998998+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.998998+0000', 'last_undegraded': '2024-09-17T02:58:20.998998+0000', 'last_fullsized': '2024-09-17T02:58:20.998998+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000750+0000', 'last_change': '2024-09-17T02:58:21.000750+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000750+0000', 'last_undegraded': '2024-09-17T02:58:21.000750+0000', 'last_fullsized': '2024-09-17T02:58:21.000750+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:21.000505+0000', 'last_change': '2024-09-17T02:58:21.000505+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:21.000505+0000', 'last_undegraded': '2024-09-17T02:58:21.000505+0000', 'last_fullsized': '2024-09-17T02:58:21.000505+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999105+0000', 'last_change': '2024-09-17T02:58:20.999105+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999105+0000', 'last_undegraded': '2024-09-17T02:58:20.999105+0000', 'last_fullsized': '2024-09-17T02:58:20.999105+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-09-17T02:58:25.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999501+0000', 'last_change': '2024-09-17T02:58:20.999501+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999501+0000', 'last_undegraded': '2024-09-17T02:58:20.999501+0000', 'last_fullsized': '2024-09-17T02:58:20.999501+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:58:25.740 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-17T02:58:25.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.996385+0000', 'last_change': '2024-09-17T02:58:20.996385+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.996385+0000', 'last_undegraded': '2024-09-17T02:58:20.996385+0000', 'last_fullsized': '2024-09-17T02:58:20.996385+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.740 INFO:tasks.ceph.ceph_manager.ceph:PG 11.0 is not active+clean 2024-09-17T02:58:25.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.994898+0000', 'last_change': '2024-09-17T02:58:20.994898+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.994898+0000', 'last_undegraded': '2024-09-17T02:58:20.994898+0000', 'last_fullsized': '2024-09-17T02:58:20.994898+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:58:25.740 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-09-17T02:58:25.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.996361+0000', 'last_change': '2024-09-17T02:58:20.996361+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.996361+0000', 'last_undegraded': '2024-09-17T02:58:20.996361+0000', 'last_fullsized': '2024-09-17T02:58:20.996361+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:58:25.740 INFO:tasks.ceph.ceph_manager.ceph:PG 11.a is not active+clean 2024-09-17T02:58:25.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:58:20.999381+0000', 'last_change': '2024-09-17T02:58:20.999381+0000', 'last_active': '2024-09-17T02:58:20.989939+0000', 'last_peered': '2024-09-17T02:58:20.989939+0000', 'last_clean': '2024-09-17T02:58:20.989939+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:58:20.999381+0000', 'last_undegraded': '2024-09-17T02:58:20.999381+0000', 'last_fullsized': '2024-09-17T02:58:20.999381+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'last_clean_scrub_stamp': '2024-09-17T02:58:20.989939+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:58:25.741 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T02:58:25.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.872+0000 7f018ee38640 1 -- 172.21.15.104:0/1165053668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b5d20 msgr2=0x7f01880cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.872+0000 7f018ee38640 1 --2- 172.21.15.104:0/1165053668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b5d20 0x7f01880cfa80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f01880d3a70 tx=0x7f018002aa30 comp rx=0 tx=0).stop 2024-09-17T02:58:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.872+0000 7f018ee38640 1 -- 172.21.15.104:0/1165053668 shutdown_connections 2024-09-17T02:58:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.872+0000 7f018ee38640 1 --2- 172.21.15.104:0/1165053668 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b5d20 0x7f01880cfa80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.872+0000 7f018ee38640 1 --2- 172.21.15.104:0/1165053668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01880b3f00 0x7f01880b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.872+0000 7f018ee38640 1 --2- 172.21.15.104:0/1165053668 >> v2:172.21.15.192:3300/0 conn(0x7f01880b4fc0 0x7f01880b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.872+0000 7f018ee38640 1 -- 172.21.15.104:0/1165053668 >> 172.21.15.104:0/1165053668 conn(0x7f01880b44a0 msgr2=0x7f01880b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.873+0000 7f018ee38640 1 -- 172.21.15.104:0/1165053668 shutdown_connections 2024-09-17T02:58:25.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.873+0000 7f018ee38640 1 -- 172.21.15.104:0/1165053668 wait complete. 2024-09-17T02:58:25.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.874+0000 7f018ee38640 1 Processor -- start 2024-09-17T02:58:25.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.874+0000 7f018ee38640 1 -- start start 2024-09-17T02:58:25.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f018ee38640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880b3f00 0x7f01881f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f018ee38640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b4fc0 0x7f01881f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f018ee38640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01880b5d20 0x7f01880b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f018ee38640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f01880cdf10 con 0x7f01880b4fc0 2024-09-17T02:58:25.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f018ee38640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f01880d02f0 con 0x7f01880b3f00 2024-09-17T02:58:25.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f018ee38640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f01880ce090 con 0x7f01880b5d20 2024-09-17T02:58:25.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b4fc0 0x7f01881f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b4fc0 0x7f01881f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60938/0 (socket says 172.21.15.104:60938) 2024-09-17T02:58:25.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 -- 172.21.15.104:0/1299594326 learned_addr learned my addr 172.21.15.104:0/1299594326 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:25.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f018d3d5640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01880b5d20 0x7f01880b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f018cbd4640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880b3f00 0x7f01881f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 -- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01880b5d20 msgr2=0x7f01880b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01880b5d20 0x7f01880b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 -- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880b3f00 msgr2=0x7f01881f7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880b3f00 0x7f01881f7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 -- 172.21.15.104:0/1299594326 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018815c7c0 con 0x7f01880b4fc0 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f0187fff640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b4fc0 0x7f01881f3120 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f017400c9a0 tx=0x7f017400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.876+0000 7f01857fa640 1 -- 172.21.15.104:0/1299594326 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174007b50 con 0x7f01880b4fc0 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.877+0000 7f01857fa640 1 -- 172.21.15.104:0/1299594326 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0174007e00 con 0x7f01880b4fc0 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.877+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01881f7fb0 con 0x7f01880b4fc0 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.877+0000 7f01857fa640 1 -- 172.21.15.104:0/1299594326 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174005280 con 0x7f01880b4fc0 2024-09-17T02:58:25.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.877+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01880c99e0 con 0x7f01880b4fc0 2024-09-17T02:58:25.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.878+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01880cead0 con 0x7f01880b4fc0 2024-09-17T02:58:25.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.878+0000 7f01857fa640 1 -- 172.21.15.104:0/1299594326 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0174005420 con 0x7f01880b4fc0 2024-09-17T02:58:25.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.879+0000 7f01857fa640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f016c078b90 0x7f016c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:25.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.879+0000 7f01857fa640 1 -- 172.21.15.104:0/1299594326 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f017409b050 con 0x7f01880b4fc0 2024-09-17T02:58:25.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.879+0000 7f018cbd4640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f016c078b90 0x7f016c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:25.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.879+0000 7f018cbd4640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f016c078b90 0x7f016c07b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f017c00a490 tx=0x7f017c00a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:25.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:25.883+0000 7f01857fa640 1 -- 172.21.15.104:0/1299594326 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01881f7fb0 con 0x7f01880b4fc0 2024-09-17T02:58:26.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.129+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0188072200 con 0x7f01880b4fc0 2024-09-17T02:58:26.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.130+0000 7f01857fa640 1 -- 172.21.15.104:0/1299594326 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1070 (secure 0 0 0) 0x7f018815c7c0 con 0x7f01880b4fc0 2024-09-17T02:58:26.130 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:26.130 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":242,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":83,"num_osds":8,"num_up_osds":8,"osd_up_since":1726541670,"num_in_osds":8,"osd_in_since":1726541667,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":4538830,"bytes_avail":1595461170,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":34,"btime":"2024-09-17T02:58:24:019923+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":5958}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-17T02:57:47.665159+0000","services":{}},"progress_events":{}} 2024-09-17T02:58:26.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f016c078b90 msgr2=0x7f016c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:26.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f016c078b90 0x7f016c07b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f017c00a490 tx=0x7f017c00a420 comp rx=0 tx=0).stop 2024-09-17T02:58:26.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b4fc0 msgr2=0x7f01881f3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:26.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b4fc0 0x7f01881f3120 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f017400c9a0 tx=0x7f017400ce60 comp rx=0 tx=0).stop 2024-09-17T02:58:26.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 shutdown_connections 2024-09-17T02:58:26.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f016c078b90 0x7f016c07b0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01880b5d20 0x7f01880b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01880b4fc0 0x7f01881f3120 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 --2- 172.21.15.104:0/1299594326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01880b3f00 0x7f01881f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 >> 172.21.15.104:0/1299594326 conn(0x7f01880b44a0 msgr2=0x7f01880b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:26.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 shutdown_connections 2024-09-17T02:58:26.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.132+0000 7f018ee38640 1 -- 172.21.15.104:0/1299594326 wait complete. 2024-09-17T02:58:26.144 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T02:58:26.144 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:58:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.256+0000 7f19f1313640 1 -- 172.21.15.104:0/2368852062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 msgr2=0x7f19ec0b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.256+0000 7f19f1313640 1 --2- 172.21.15.104:0/2368852062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 0x7f19ec0b57e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f19ec0d3a70 tx=0x7f19e002a530 comp rx=0 tx=0).stop 2024-09-17T02:58:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.256+0000 7f19f1313640 1 -- 172.21.15.104:0/2368852062 shutdown_connections 2024-09-17T02:58:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.256+0000 7f19f1313640 1 --2- 172.21.15.104:0/2368852062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 0x7f19ec0b57e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.256+0000 7f19f1313640 1 --2- 172.21.15.104:0/2368852062 >> v2:172.21.15.192:3300/0 conn(0x7f19ec0b4fc0 0x7f19ec0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.256+0000 7f19f1313640 1 -- 172.21.15.104:0/2368852062 >> 172.21.15.104:0/2368852062 conn(0x7f19ec0b44a0 msgr2=0x7f19ec0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.256+0000 7f19f1313640 1 -- 172.21.15.104:0/2368852062 shutdown_connections 2024-09-17T02:58:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.256+0000 7f19f1313640 1 -- 172.21.15.104:0/2368852062 wait complete. 2024-09-17T02:58:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.258+0000 7f19f1313640 1 Processor -- start 2024-09-17T02:58:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.258+0000 7f19f1313640 1 -- start start 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19f1313640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 0x7f19ec155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19f1313640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19ec0b4fc0 0x7f19ec0c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19f1313640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19ec0b5d20 0x7f19ec06e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19f1313640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec0ce120 con 0x7f19ec0b3f00 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19f1313640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec0d0320 con 0x7f19ec0b5d20 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19f1313640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec0c6e30 con 0x7f19ec0b4fc0 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19eaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 0x7f19ec155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19eaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 0x7f19ec155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60954/0 (socket says 172.21.15.104:60954) 2024-09-17T02:58:26.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.259+0000 7f19eaffd640 1 -- 172.21.15.104:0/2733881676 learned_addr learned my addr 172.21.15.104:0/2733881676 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19ea7fc640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19ec0b4fc0 0x7f19ec0c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19eb7fe640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19ec0b5d20 0x7f19ec06e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19eaffd640 1 -- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19ec0b4fc0 msgr2=0x7f19ec0c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19eaffd640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19ec0b4fc0 0x7f19ec0c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19eaffd640 1 -- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19ec0b5d20 msgr2=0x7f19ec06e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19eaffd640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19ec0b5d20 0x7f19ec06e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19eaffd640 1 -- 172.21.15.104:0/2733881676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec0c9fa0 con 0x7f19ec0b3f00 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19eaffd640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 0x7f19ec155070 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00ea50 tx=0x7f19dc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19d37fe640 1 -- 172.21.15.104:0/2733881676 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00cdc0 con 0x7f19ec0b3f00 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19d37fe640 1 -- 172.21.15.104:0/2733881676 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19dc011560 con 0x7f19ec0b3f00 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec06daf0 con 0x7f19ec0b3f00 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19d37fe640 1 -- 172.21.15.104:0/2733881676 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc011990 con 0x7f19ec0b3f00 2024-09-17T02:58:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.260+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec06e0b0 con 0x7f19ec0b3f00 2024-09-17T02:58:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.261+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ec0b57e0 con 0x7f19ec0b3f00 2024-09-17T02:58:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.262+0000 7f19d37fe640 1 -- 172.21.15.104:0/2733881676 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19dc011b30 con 0x7f19ec0b3f00 2024-09-17T02:58:26.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.262+0000 7f19d37fe640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f19d8078b90 0x7f19d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:26.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.262+0000 7f19d37fe640 1 -- 172.21.15.104:0/2733881676 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f19dc09b880 con 0x7f19ec0b3f00 2024-09-17T02:58:26.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.263+0000 7f19ea7fc640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f19d8078b90 0x7f19d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:26.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.263+0000 7f19ea7fc640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f19d8078b90 0x7f19d807b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f19e0034000 tx=0x7f19e0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:26.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.267+0000 7f19d37fe640 1 -- 172.21.15.104:0/2733881676 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f19dc016030 con 0x7f19ec0b3f00 2024-09-17T02:58:26.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.436+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19ec0cead0 con 0x7f19d8078b90 2024-09-17T02:58:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.441+0000 7f19d37fe640 1 -- 172.21.15.104:0/2733881676 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242336 (secure 0 0 0) 0x7f19ec0cead0 con 0x7f19d8078b90 2024-09-17T02:58:26.443 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:26.444 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:58:26.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f19d8078b90 msgr2=0x7f19d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f19d8078b90 0x7f19d807b0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f19e0034000 tx=0x7f19e0004730 comp rx=0 tx=0).stop 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 msgr2=0x7f19ec155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 0x7f19ec155070 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00ea50 tx=0x7f19dc00ef10 comp rx=0 tx=0).stop 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 shutdown_connections 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f19d8078b90 0x7f19d807b0a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19ec0b5d20 0x7f19ec06e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f19ec0b4fc0 0x7f19ec0c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 --2- 172.21.15.104:0/2733881676 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f19ec0b3f00 0x7f19ec155070 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 >> 172.21.15.104:0/2733881676 conn(0x7f19ec0b44a0 msgr2=0x7f19ec0b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 shutdown_connections 2024-09-17T02:58:26.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:26.444+0000 7f19f1313640 1 -- 172.21.15.104:0/2733881676 wait complete. 2024-09-17T02:58:26.455 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-17T02:58:25.674870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4432,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558067,"statfs":{"total":1600000000,"available":1595461170,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.683539"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002072+0000","last_change":"2024-09-17T02:58:21.002072+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002072+0000","last_undegraded":"2024-09-17T02:58:21.002072+0000","last_fullsized":"2024-09-17T02:58:21.002072+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995746+0000","last_change":"2024-09-17T02:58:20.995746+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995746+0000","last_undegraded":"2024-09-17T02:58:20.995746+0000","last_fullsized":"2024-09-17T02:58:20.995746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000391+0000","last_change":"2024-09-17T02:58:21.000391+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000391+0000","last_undegraded":"2024-09-17T02:58:21.000391+0000","last_fullsized":"2024-09-17T02:58:21.000391+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995861+0000","last_change":"2024-09-17T02:58:20.995861+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995861+0000","last_undegraded":"2024-09-17T02:58:20.995861+0000","last_fullsized":"2024-09-17T02:58:20.995861+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001855+0000","last_change":"2024-09-17T02:58:21.001855+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001855+0000","last_undegraded":"2024-09-17T02:58:21.001855+0000","last_fullsized":"2024-09-17T02:58:21.001855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.997223+0000","last_change":"2024-09-17T02:58:20.997223+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.997223+0000","last_undegraded":"2024-09-17T02:58:20.997223+0000","last_fullsized":"2024-09-17T02:58:20.997223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002013+0000","last_change":"2024-09-17T02:58:21.002013+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002013+0000","last_undegraded":"2024-09-17T02:58:21.002013+0000","last_fullsized":"2024-09-17T02:58:21.002013+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996890+0000","last_change":"2024-09-17T02:58:20.996890+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996890+0000","last_undegraded":"2024-09-17T02:58:20.996890+0000","last_fullsized":"2024-09-17T02:58:20.996890+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001414+0000","last_change":"2024-09-17T02:58:21.001414+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001414+0000","last_undegraded":"2024-09-17T02:58:21.001414+0000","last_fullsized":"2024-09-17T02:58:21.001414+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000432+0000","last_change":"2024-09-17T02:58:21.000432+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000432+0000","last_undegraded":"2024-09-17T02:58:21.000432+0000","last_fullsized":"2024-09-17T02:58:21.000432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000798+0000","last_change":"2024-09-17T02:58:21.000798+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000798+0000","last_undegraded":"2024-09-17T02:58:21.000798+0000","last_fullsized":"2024-09-17T02:58:21.000798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995223+0000","last_change":"2024-09-17T02:58:20.995223+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995223+0000","last_undegraded":"2024-09-17T02:58:20.995223+0000","last_fullsized":"2024-09-17T02:58:20.995223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000052+0000","last_change":"2024-09-17T02:58:21.000052+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000052+0000","last_undegraded":"2024-09-17T02:58:21.000052+0000","last_fullsized":"2024-09-17T02:58:21.000052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001039+0000","last_change":"2024-09-17T02:58:21.001039+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001039+0000","last_undegraded":"2024-09-17T02:58:21.001039+0000","last_fullsized":"2024-09-17T02:58:21.001039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999256+0000","last_change":"2024-09-17T02:58:20.999256+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999256+0000","last_undegraded":"2024-09-17T02:58:20.999256+0000","last_fullsized":"2024-09-17T02:58:20.999256+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998080+0000","last_change":"2024-09-17T02:58:20.998080+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998080+0000","last_undegraded":"2024-09-17T02:58:20.998080+0000","last_fullsized":"2024-09-17T02:58:20.998080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000794+0000","last_change":"2024-09-17T02:58:21.000794+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000794+0000","last_undegraded":"2024-09-17T02:58:21.000794+0000","last_fullsized":"2024-09-17T02:58:21.000794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994683+0000","last_change":"2024-09-17T02:58:20.994683+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994683+0000","last_undegraded":"2024-09-17T02:58:20.994683+0000","last_fullsized":"2024-09-17T02:58:20.994683+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996614+0000","last_change":"2024-09-17T02:58:20.996614+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996614+0000","last_undegraded":"2024-09-17T02:58:20.996614+0000","last_fullsized":"2024-09-17T02:58:20.996614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998650+0000","last_change":"2024-09-17T02:58:20.998650+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998650+0000","last_undegraded":"2024-09-17T02:58:20.998650+0000","last_fullsized":"2024-09-17T02:58:20.998650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998483+0000","last_change":"2024-09-17T02:58:20.998483+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998483+0000","last_undegraded":"2024-09-17T02:58:20.998483+0000","last_fullsized":"2024-09-17T02:58:20.998483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998864+0000","last_change":"2024-09-17T02:58:20.998864+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998864+0000","last_undegraded":"2024-09-17T02:58:20.998864+0000","last_fullsized":"2024-09-17T02:58:20.998864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999615+0000","last_change":"2024-09-17T02:58:20.999615+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999615+0000","last_undegraded":"2024-09-17T02:58:20.999615+0000","last_fullsized":"2024-09-17T02:58:20.999615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000939+0000","last_change":"2024-09-17T02:58:21.000939+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000939+0000","last_undegraded":"2024-09-17T02:58:21.000939+0000","last_fullsized":"2024-09-17T02:58:21.000939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000094+0000","last_change":"2024-09-17T02:58:21.000094+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000094+0000","last_undegraded":"2024-09-17T02:58:21.000094+0000","last_fullsized":"2024-09-17T02:58:21.000094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.002578+0000","last_change":"2024-09-17T02:58:21.002578+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.002578+0000","last_undegraded":"2024-09-17T02:58:21.002578+0000","last_fullsized":"2024-09-17T02:58:21.002578+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000635+0000","last_change":"2024-09-17T02:58:21.000635+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000635+0000","last_undegraded":"2024-09-17T02:58:21.000635+0000","last_fullsized":"2024-09-17T02:58:21.000635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000804+0000","last_change":"2024-09-17T02:58:21.000804+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000804+0000","last_undegraded":"2024-09-17T02:58:21.000804+0000","last_fullsized":"2024-09-17T02:58:21.000804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999738+0000","last_change":"2024-09-17T02:58:20.999738+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999738+0000","last_undegraded":"2024-09-17T02:58:20.999738+0000","last_fullsized":"2024-09-17T02:58:20.999738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000762+0000","last_change":"2024-09-17T02:58:21.000762+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000762+0000","last_undegraded":"2024-09-17T02:58:21.000762+0000","last_fullsized":"2024-09-17T02:58:21.000762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001100+0000","last_change":"2024-09-17T02:58:21.001100+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001100+0000","last_undegraded":"2024-09-17T02:58:21.001100+0000","last_fullsized":"2024-09-17T02:58:21.001100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.995225+0000","last_change":"2024-09-17T02:58:20.995225+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.995225+0000","last_undegraded":"2024-09-17T02:58:20.995225+0000","last_fullsized":"2024-09-17T02:58:20.995225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000172+0000","last_change":"2024-09-17T02:58:21.000172+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000172+0000","last_undegraded":"2024-09-17T02:58:21.000172+0000","last_fullsized":"2024-09-17T02:58:21.000172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006499+0000","last_change":"2024-09-17T02:58:21.003281+0000","last_active":"2024-09-17T02:58:21.006499+0000","last_peered":"2024-09-17T02:58:21.006499+0000","last_clean":"2024-09-17T02:58:21.006499+0000","last_became_active":"2024-09-17T02:58:21.002339+0000","last_became_peered":"2024-09-17T02:58:21.002339+0000","last_unstale":"2024-09-17T02:58:21.006499+0000","last_undegraded":"2024-09-17T02:58:21.006499+0000","last_fullsized":"2024-09-17T02:58:21.006499+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:34.463154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001135+0000","last_change":"2024-09-17T02:58:21.001135+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001135+0000","last_undegraded":"2024-09-17T02:58:21.001135+0000","last_fullsized":"2024-09-17T02:58:21.001135+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006875+0000","last_change":"2024-09-17T02:58:21.006659+0000","last_active":"2024-09-17T02:58:21.006875+0000","last_peered":"2024-09-17T02:58:21.006875+0000","last_clean":"2024-09-17T02:58:21.006875+0000","last_became_active":"2024-09-17T02:58:21.005416+0000","last_became_peered":"2024-09-17T02:58:21.005416+0000","last_unstale":"2024-09-17T02:58:21.006875+0000","last_undegraded":"2024-09-17T02:58:21.006875+0000","last_fullsized":"2024-09-17T02:58:21.006875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:43.841299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996769+0000","last_change":"2024-09-17T02:58:20.996769+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996769+0000","last_undegraded":"2024-09-17T02:58:20.996769+0000","last_fullsized":"2024-09-17T02:58:20.996769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006369+0000","last_change":"2024-09-17T02:58:21.006096+0000","last_active":"2024-09-17T02:58:21.006369+0000","last_peered":"2024-09-17T02:58:21.006369+0000","last_clean":"2024-09-17T02:58:21.006369+0000","last_became_active":"2024-09-17T02:58:21.005526+0000","last_became_peered":"2024-09-17T02:58:21.005526+0000","last_unstale":"2024-09-17T02:58:21.006369+0000","last_undegraded":"2024-09-17T02:58:21.006369+0000","last_fullsized":"2024-09-17T02:58:21.006369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:35:24.299267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001412+0000","last_change":"2024-09-17T02:58:21.001412+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001412+0000","last_undegraded":"2024-09-17T02:58:21.001412+0000","last_fullsized":"2024-09-17T02:58:21.001412+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006476+0000","last_change":"2024-09-17T02:58:21.006163+0000","last_active":"2024-09-17T02:58:21.006476+0000","last_peered":"2024-09-17T02:58:21.006476+0000","last_clean":"2024-09-17T02:58:21.006476+0000","last_became_active":"2024-09-17T02:58:21.005823+0000","last_became_peered":"2024-09-17T02:58:21.005823+0000","last_unstale":"2024-09-17T02:58:21.006476+0000","last_undegraded":"2024-09-17T02:58:21.006476+0000","last_fullsized":"2024-09-17T02:58:21.006476+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:01.885292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001792+0000","last_change":"2024-09-17T02:58:21.001792+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001792+0000","last_undegraded":"2024-09-17T02:58:21.001792+0000","last_fullsized":"2024-09-17T02:58:21.001792+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.007658+0000","last_change":"2024-09-17T02:58:21.007467+0000","last_active":"2024-09-17T02:58:21.007658+0000","last_peered":"2024-09-17T02:58:21.007658+0000","last_clean":"2024-09-17T02:58:21.007658+0000","last_became_active":"2024-09-17T02:58:21.007127+0000","last_became_peered":"2024-09-17T02:58:21.007127+0000","last_unstale":"2024-09-17T02:58:21.007658+0000","last_undegraded":"2024-09-17T02:58:21.007658+0000","last_fullsized":"2024-09-17T02:58:21.007658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:55.372211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.997904+0000","last_change":"2024-09-17T02:58:20.997904+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.997904+0000","last_undegraded":"2024-09-17T02:58:20.997904+0000","last_fullsized":"2024-09-17T02:58:20.997904+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006579+0000","last_change":"2024-09-17T02:58:21.006408+0000","last_active":"2024-09-17T02:58:21.006579+0000","last_peered":"2024-09-17T02:58:21.006579+0000","last_clean":"2024-09-17T02:58:21.006579+0000","last_became_active":"2024-09-17T02:58:21.005945+0000","last_became_peered":"2024-09-17T02:58:21.005945+0000","last_unstale":"2024-09-17T02:58:21.006579+0000","last_undegraded":"2024-09-17T02:58:21.006579+0000","last_fullsized":"2024-09-17T02:58:21.006579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:14.041280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001169+0000","last_change":"2024-09-17T02:58:21.001169+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001169+0000","last_undegraded":"2024-09-17T02:58:21.001169+0000","last_fullsized":"2024-09-17T02:58:21.001169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.001098+0000","last_change":"2024-09-17T02:58:21.000894+0000","last_active":"2024-09-17T02:58:21.001098+0000","last_peered":"2024-09-17T02:58:21.001098+0000","last_clean":"2024-09-17T02:58:21.001098+0000","last_became_active":"2024-09-17T02:58:21.000611+0000","last_became_peered":"2024-09-17T02:58:21.000611+0000","last_unstale":"2024-09-17T02:58:21.001098+0000","last_undegraded":"2024-09-17T02:58:21.001098+0000","last_fullsized":"2024-09-17T02:58:21.001098+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:02.722779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999633+0000","last_change":"2024-09-17T02:58:20.999633+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999633+0000","last_undegraded":"2024-09-17T02:58:20.999633+0000","last_fullsized":"2024-09-17T02:58:20.999633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.996658+0000","last_change":"2024-09-17T02:58:20.996167+0000","last_active":"2024-09-17T02:58:20.996658+0000","last_peered":"2024-09-17T02:58:20.996658+0000","last_clean":"2024-09-17T02:58:20.996658+0000","last_became_active":"2024-09-17T02:58:20.995880+0000","last_became_peered":"2024-09-17T02:58:20.995880+0000","last_unstale":"2024-09-17T02:58:20.996658+0000","last_undegraded":"2024-09-17T02:58:20.996658+0000","last_fullsized":"2024-09-17T02:58:20.996658+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:30.834624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.001635+0000","last_change":"2024-09-17T02:58:21.001635+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.001635+0000","last_undegraded":"2024-09-17T02:58:21.001635+0000","last_fullsized":"2024-09-17T02:58:21.001635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003653+0000","last_change":"2024-09-17T02:58:21.003450+0000","last_active":"2024-09-17T02:58:21.003653+0000","last_peered":"2024-09-17T02:58:21.003653+0000","last_clean":"2024-09-17T02:58:21.003653+0000","last_became_active":"2024-09-17T02:58:21.002955+0000","last_became_peered":"2024-09-17T02:58:21.002955+0000","last_unstale":"2024-09-17T02:58:21.003653+0000","last_undegraded":"2024-09-17T02:58:21.003653+0000","last_fullsized":"2024-09-17T02:58:21.003653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:10.589201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999815+0000","last_change":"2024-09-17T02:58:20.999815+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999815+0000","last_undegraded":"2024-09-17T02:58:20.999815+0000","last_fullsized":"2024-09-17T02:58:20.999815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005759+0000","last_change":"2024-09-17T02:58:21.005548+0000","last_active":"2024-09-17T02:58:21.005759+0000","last_peered":"2024-09-17T02:58:21.005759+0000","last_clean":"2024-09-17T02:58:21.005759+0000","last_became_active":"2024-09-17T02:58:21.005071+0000","last_became_peered":"2024-09-17T02:58:21.005071+0000","last_unstale":"2024-09-17T02:58:21.005759+0000","last_undegraded":"2024-09-17T02:58:21.005759+0000","last_fullsized":"2024-09-17T02:58:21.005759+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:03.004891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996225+0000","last_change":"2024-09-17T02:58:20.996225+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996225+0000","last_undegraded":"2024-09-17T02:58:20.996225+0000","last_fullsized":"2024-09-17T02:58:20.996225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.004646+0000","last_change":"2024-09-17T02:58:21.004399+0000","last_active":"2024-09-17T02:58:21.004646+0000","last_peered":"2024-09-17T02:58:21.004646+0000","last_clean":"2024-09-17T02:58:21.004646+0000","last_became_active":"2024-09-17T02:58:21.004078+0000","last_became_peered":"2024-09-17T02:58:21.004078+0000","last_unstale":"2024-09-17T02:58:21.004646+0000","last_undegraded":"2024-09-17T02:58:21.004646+0000","last_fullsized":"2024-09-17T02:58:21.004646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:20:11.089885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000415+0000","last_change":"2024-09-17T02:58:21.000415+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000415+0000","last_undegraded":"2024-09-17T02:58:21.000415+0000","last_fullsized":"2024-09-17T02:58:21.000415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.997632+0000","last_change":"2024-09-17T02:58:20.997321+0000","last_active":"2024-09-17T02:58:20.997632+0000","last_peered":"2024-09-17T02:58:20.997632+0000","last_clean":"2024-09-17T02:58:20.997632+0000","last_became_active":"2024-09-17T02:58:20.996864+0000","last_became_peered":"2024-09-17T02:58:20.996864+0000","last_unstale":"2024-09-17T02:58:20.997632+0000","last_undegraded":"2024-09-17T02:58:20.997632+0000","last_fullsized":"2024-09-17T02:58:20.997632+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:29.400328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998665+0000","last_change":"2024-09-17T02:58:20.998665+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998665+0000","last_undegraded":"2024-09-17T02:58:20.998665+0000","last_fullsized":"2024-09-17T02:58:20.998665+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003212+0000","last_change":"2024-09-17T02:58:21.002715+0000","last_active":"2024-09-17T02:58:21.003212+0000","last_peered":"2024-09-17T02:58:21.003212+0000","last_clean":"2024-09-17T02:58:21.003212+0000","last_became_active":"2024-09-17T02:58:21.002427+0000","last_became_peered":"2024-09-17T02:58:21.002427+0000","last_unstale":"2024-09-17T02:58:21.003212+0000","last_undegraded":"2024-09-17T02:58:21.003212+0000","last_fullsized":"2024-09-17T02:58:21.003212+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:10.359392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000312+0000","last_change":"2024-09-17T02:58:21.000312+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000312+0000","last_undegraded":"2024-09-17T02:58:21.000312+0000","last_fullsized":"2024-09-17T02:58:21.000312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.998907+0000","last_change":"2024-09-17T02:58:20.998480+0000","last_active":"2024-09-17T02:58:20.998907+0000","last_peered":"2024-09-17T02:58:20.998907+0000","last_clean":"2024-09-17T02:58:20.998907+0000","last_became_active":"2024-09-17T02:58:20.998192+0000","last_became_peered":"2024-09-17T02:58:20.998192+0000","last_unstale":"2024-09-17T02:58:20.998907+0000","last_undegraded":"2024-09-17T02:58:20.998907+0000","last_fullsized":"2024-09-17T02:58:20.998907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:40.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999432+0000","last_change":"2024-09-17T02:58:20.999432+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999432+0000","last_undegraded":"2024-09-17T02:58:20.999432+0000","last_fullsized":"2024-09-17T02:58:20.999432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003964+0000","last_change":"2024-09-17T02:58:21.003758+0000","last_active":"2024-09-17T02:58:21.003964+0000","last_peered":"2024-09-17T02:58:21.003964+0000","last_clean":"2024-09-17T02:58:21.003964+0000","last_became_active":"2024-09-17T02:58:21.003431+0000","last_became_peered":"2024-09-17T02:58:21.003431+0000","last_unstale":"2024-09-17T02:58:21.003964+0000","last_undegraded":"2024-09-17T02:58:21.003964+0000","last_fullsized":"2024-09-17T02:58:21.003964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:21.198235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999984+0000","last_change":"2024-09-17T02:58:20.999984+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999984+0000","last_undegraded":"2024-09-17T02:58:20.999984+0000","last_fullsized":"2024-09-17T02:58:20.999984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009396+0000","last_change":"2024-09-17T02:58:21.009192+0000","last_active":"2024-09-17T02:58:21.009396+0000","last_peered":"2024-09-17T02:58:21.009396+0000","last_clean":"2024-09-17T02:58:21.009396+0000","last_became_active":"2024-09-17T02:58:21.008557+0000","last_became_peered":"2024-09-17T02:58:21.008557+0000","last_unstale":"2024-09-17T02:58:21.009396+0000","last_undegraded":"2024-09-17T02:58:21.009396+0000","last_fullsized":"2024-09-17T02:58:21.009396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:56.121586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999700+0000","last_change":"2024-09-17T02:58:20.999700+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999700+0000","last_undegraded":"2024-09-17T02:58:20.999700+0000","last_fullsized":"2024-09-17T02:58:20.999700+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009306+0000","last_change":"2024-09-17T02:58:21.009117+0000","last_active":"2024-09-17T02:58:21.009306+0000","last_peered":"2024-09-17T02:58:21.009306+0000","last_clean":"2024-09-17T02:58:21.009306+0000","last_became_active":"2024-09-17T02:58:21.007266+0000","last_became_peered":"2024-09-17T02:58:21.007266+0000","last_unstale":"2024-09-17T02:58:21.009306+0000","last_undegraded":"2024-09-17T02:58:21.009306+0000","last_fullsized":"2024-09-17T02:58:21.009306+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:59.064669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999778+0000","last_change":"2024-09-17T02:58:20.999778+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999778+0000","last_undegraded":"2024-09-17T02:58:20.999778+0000","last_fullsized":"2024-09-17T02:58:20.999778+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005991+0000","last_change":"2024-09-17T02:58:21.005789+0000","last_active":"2024-09-17T02:58:21.005991+0000","last_peered":"2024-09-17T02:58:21.005991+0000","last_clean":"2024-09-17T02:58:21.005991+0000","last_became_active":"2024-09-17T02:58:21.005141+0000","last_became_peered":"2024-09-17T02:58:21.005141+0000","last_unstale":"2024-09-17T02:58:21.005991+0000","last_undegraded":"2024-09-17T02:58:21.005991+0000","last_fullsized":"2024-09-17T02:58:21.005991+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:24.161214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994603+0000","last_change":"2024-09-17T02:58:20.994603+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994603+0000","last_undegraded":"2024-09-17T02:58:20.994603+0000","last_fullsized":"2024-09-17T02:58:20.994603+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.002600+0000","last_change":"2024-09-17T02:58:21.002316+0000","last_active":"2024-09-17T02:58:21.002600+0000","last_peered":"2024-09-17T02:58:21.002600+0000","last_clean":"2024-09-17T02:58:21.002600+0000","last_became_active":"2024-09-17T02:58:21.002050+0000","last_became_peered":"2024-09-17T02:58:21.002050+0000","last_unstale":"2024-09-17T02:58:21.002600+0000","last_undegraded":"2024-09-17T02:58:21.002600+0000","last_fullsized":"2024-09-17T02:58:21.002600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:51.431907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000134+0000","last_change":"2024-09-17T02:58:21.000134+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000134+0000","last_undegraded":"2024-09-17T02:58:21.000134+0000","last_fullsized":"2024-09-17T02:58:21.000134+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.007687+0000","last_change":"2024-09-17T02:58:21.007482+0000","last_active":"2024-09-17T02:58:21.007687+0000","last_peered":"2024-09-17T02:58:21.007687+0000","last_clean":"2024-09-17T02:58:21.007687+0000","last_became_active":"2024-09-17T02:58:21.007194+0000","last_became_peered":"2024-09-17T02:58:21.007194+0000","last_unstale":"2024-09-17T02:58:21.007687+0000","last_undegraded":"2024-09-17T02:58:21.007687+0000","last_fullsized":"2024-09-17T02:58:21.007687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:04.437518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999410+0000","last_change":"2024-09-17T02:58:20.999410+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999410+0000","last_undegraded":"2024-09-17T02:58:20.999410+0000","last_fullsized":"2024-09-17T02:58:20.999410+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009612+0000","last_change":"2024-09-17T02:58:21.009391+0000","last_active":"2024-09-17T02:58:21.009612+0000","last_peered":"2024-09-17T02:58:21.009612+0000","last_clean":"2024-09-17T02:58:21.009612+0000","last_became_active":"2024-09-17T02:58:21.007661+0000","last_became_peered":"2024-09-17T02:58:21.007661+0000","last_unstale":"2024-09-17T02:58:21.009612+0000","last_undegraded":"2024-09-17T02:58:21.009612+0000","last_fullsized":"2024-09-17T02:58:21.009612+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:15.787004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998495+0000","last_change":"2024-09-17T02:58:20.998495+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998495+0000","last_undegraded":"2024-09-17T02:58:20.998495+0000","last_fullsized":"2024-09-17T02:58:20.998495+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.005602+0000","last_change":"2024-09-17T02:58:21.005375+0000","last_active":"2024-09-17T02:58:21.005602+0000","last_peered":"2024-09-17T02:58:21.005602+0000","last_clean":"2024-09-17T02:58:21.005602+0000","last_became_active":"2024-09-17T02:58:21.004679+0000","last_became_peered":"2024-09-17T02:58:21.004679+0000","last_unstale":"2024-09-17T02:58:21.005602+0000","last_undegraded":"2024-09-17T02:58:21.005602+0000","last_fullsized":"2024-09-17T02:58:21.005602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:41.993695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998958+0000","last_change":"2024-09-17T02:58:20.998958+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998958+0000","last_undegraded":"2024-09-17T02:58:20.998958+0000","last_fullsized":"2024-09-17T02:58:20.998958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003294+0000","last_change":"2024-09-17T02:58:21.002742+0000","last_active":"2024-09-17T02:58:21.003294+0000","last_peered":"2024-09-17T02:58:21.003294+0000","last_clean":"2024-09-17T02:58:21.003294+0000","last_became_active":"2024-09-17T02:58:21.002199+0000","last_became_peered":"2024-09-17T02:58:21.002199+0000","last_unstale":"2024-09-17T02:58:21.003294+0000","last_undegraded":"2024-09-17T02:58:21.003294+0000","last_fullsized":"2024-09-17T02:58:21.003294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:24.839326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.998998+0000","last_change":"2024-09-17T02:58:20.998998+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.998998+0000","last_undegraded":"2024-09-17T02:58:20.998998+0000","last_fullsized":"2024-09-17T02:58:20.998998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006502+0000","last_change":"2024-09-17T02:58:21.006274+0000","last_active":"2024-09-17T02:58:21.006502+0000","last_peered":"2024-09-17T02:58:21.006502+0000","last_clean":"2024-09-17T02:58:21.006502+0000","last_became_active":"2024-09-17T02:58:21.006012+0000","last_became_peered":"2024-09-17T02:58:21.006012+0000","last_unstale":"2024-09-17T02:58:21.006502+0000","last_undegraded":"2024-09-17T02:58:21.006502+0000","last_fullsized":"2024-09-17T02:58:21.006502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:59.618395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000750+0000","last_change":"2024-09-17T02:58:21.000750+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000750+0000","last_undegraded":"2024-09-17T02:58:21.000750+0000","last_fullsized":"2024-09-17T02:58:21.000750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006597+0000","last_change":"2024-09-17T02:58:21.006384+0000","last_active":"2024-09-17T02:58:21.006597+0000","last_peered":"2024-09-17T02:58:21.006597+0000","last_clean":"2024-09-17T02:58:21.006597+0000","last_became_active":"2024-09-17T02:58:21.006070+0000","last_became_peered":"2024-09-17T02:58:21.006070+0000","last_unstale":"2024-09-17T02:58:21.006597+0000","last_undegraded":"2024-09-17T02:58:21.006597+0000","last_fullsized":"2024-09-17T02:58:21.006597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:22.028745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:21.000505+0000","last_change":"2024-09-17T02:58:21.000505+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:21.000505+0000","last_undegraded":"2024-09-17T02:58:21.000505+0000","last_fullsized":"2024-09-17T02:58:21.000505+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.004707+0000","last_change":"2024-09-17T02:58:21.004339+0000","last_active":"2024-09-17T02:58:21.004707+0000","last_peered":"2024-09-17T02:58:21.004707+0000","last_clean":"2024-09-17T02:58:21.004707+0000","last_became_active":"2024-09-17T02:58:21.004045+0000","last_became_peered":"2024-09-17T02:58:21.004045+0000","last_unstale":"2024-09-17T02:58:21.004707+0000","last_undegraded":"2024-09-17T02:58:21.004707+0000","last_fullsized":"2024-09-17T02:58:21.004707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:00.083016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999105+0000","last_change":"2024-09-17T02:58:20.999105+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999105+0000","last_undegraded":"2024-09-17T02:58:20.999105+0000","last_fullsized":"2024-09-17T02:58:20.999105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.003882+0000","last_change":"2024-09-17T02:58:21.003230+0000","last_active":"2024-09-17T02:58:21.003882+0000","last_peered":"2024-09-17T02:58:21.003882+0000","last_clean":"2024-09-17T02:58:21.003882+0000","last_became_active":"2024-09-17T02:58:21.002944+0000","last_became_peered":"2024-09-17T02:58:21.002944+0000","last_unstale":"2024-09-17T02:58:21.003882+0000","last_undegraded":"2024-09-17T02:58:21.003882+0000","last_fullsized":"2024-09-17T02:58:21.003882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:04:00.076084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999501+0000","last_change":"2024-09-17T02:58:20.999501+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999501+0000","last_undegraded":"2024-09-17T02:58:20.999501+0000","last_fullsized":"2024-09-17T02:58:20.999501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.006158+0000","last_change":"2024-09-17T02:58:21.005929+0000","last_active":"2024-09-17T02:58:21.006158+0000","last_peered":"2024-09-17T02:58:21.006158+0000","last_clean":"2024-09-17T02:58:21.006158+0000","last_became_active":"2024-09-17T02:58:21.005655+0000","last_became_peered":"2024-09-17T02:58:21.005655+0000","last_unstale":"2024-09-17T02:58:21.006158+0000","last_undegraded":"2024-09-17T02:58:21.006158+0000","last_fullsized":"2024-09-17T02:58:21.006158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:06.615787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996385+0000","last_change":"2024-09-17T02:58:20.996385+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996385+0000","last_undegraded":"2024-09-17T02:58:20.996385+0000","last_fullsized":"2024-09-17T02:58:20.996385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.001191+0000","last_change":"2024-09-17T02:58:21.000999+0000","last_active":"2024-09-17T02:58:21.001191+0000","last_peered":"2024-09-17T02:58:21.001191+0000","last_clean":"2024-09-17T02:58:21.001191+0000","last_became_active":"2024-09-17T02:58:21.000691+0000","last_became_peered":"2024-09-17T02:58:21.000691+0000","last_unstale":"2024-09-17T02:58:21.001191+0000","last_undegraded":"2024-09-17T02:58:21.001191+0000","last_fullsized":"2024-09-17T02:58:21.001191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:19.598276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.994898+0000","last_change":"2024-09-17T02:58:20.994898+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.994898+0000","last_undegraded":"2024-09-17T02:58:20.994898+0000","last_fullsized":"2024-09-17T02:58:20.994898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009045+0000","last_change":"2024-09-17T02:58:21.008825+0000","last_active":"2024-09-17T02:58:21.009045+0000","last_peered":"2024-09-17T02:58:21.009045+0000","last_clean":"2024-09-17T02:58:21.009045+0000","last_became_active":"2024-09-17T02:58:21.008199+0000","last_became_peered":"2024-09-17T02:58:21.008199+0000","last_unstale":"2024-09-17T02:58:21.009045+0000","last_undegraded":"2024-09-17T02:58:21.009045+0000","last_fullsized":"2024-09-17T02:58:21.009045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:58.095824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.996361+0000","last_change":"2024-09-17T02:58:20.996361+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.996361+0000","last_undegraded":"2024-09-17T02:58:20.996361+0000","last_fullsized":"2024-09-17T02:58:20.996361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.009037+0000","last_change":"2024-09-17T02:58:21.008811+0000","last_active":"2024-09-17T02:58:21.009037+0000","last_peered":"2024-09-17T02:58:21.009037+0000","last_clean":"2024-09-17T02:58:21.009037+0000","last_became_active":"2024-09-17T02:58:21.006905+0000","last_became_peered":"2024-09-17T02:58:21.006905+0000","last_unstale":"2024-09-17T02:58:21.009037+0000","last_undegraded":"2024-09-17T02:58:21.009037+0000","last_fullsized":"2024-09-17T02:58:21.009037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:26.616807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-17T02:58:20.999381+0000","last_change":"2024-09-17T02:58:20.999381+0000","last_active":"2024-09-17T02:58:20.989939+0000","last_peered":"2024-09-17T02:58:20.989939+0000","last_clean":"2024-09-17T02:58:20.989939+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:58:20.999381+0000","last_undegraded":"2024-09-17T02:58:20.999381+0000","last_fullsized":"2024-09-17T02:58:20.999381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:21.008520+0000","last_change":"2024-09-17T02:58:21.008132+0000","last_active":"2024-09-17T02:58:21.008520+0000","last_peered":"2024-09-17T02:58:21.008520+0000","last_clean":"2024-09-17T02:58:21.008520+0000","last_became_active":"2024-09-17T02:58:21.007404+0000","last_became_peered":"2024-09-17T02:58:21.007404+0000","last_unstale":"2024-09-17T02:58:21.008520+0000","last_undegraded":"2024-09-17T02:58:21.008520+0000","last_fullsized":"2024-09-17T02:58:21.008520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:31.189583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":228,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T02:58:20.998167+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:58:20.998167+0000","last_peered":"2024-09-17T02:58:20.998167+0000","last_clean":"2024-09-17T02:58:20.998167+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:58:20.998167+0000","last_undegraded":"2024-09-17T02:58:20.998167+0000","last_fullsized":"2024-09-17T02:58:20.998167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:58.696508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991439,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194897,"statfs":{"total":200000000,"available":199575532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":408,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194904,"statfs":{"total":200000000,"available":199581807,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":414,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194897,"statfs":{"total":200000000,"available":199575532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":984,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194327,"statfs":{"total":200000000,"available":198991439,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:58:29.460 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:58:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.588+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3414254864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a64003c30 msgr2=0x7f2a64004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.588+0000 7f2a7fd83640 1 --2- 172.21.15.104:0/3414254864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a64003c30 0x7f2a64004080 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2a74001830 tx=0x7f2a64005830 comp rx=0 tx=0).stop 2024-09-17T02:58:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.588+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3414254864 shutdown_connections 2024-09-17T02:58:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.588+0000 7f2a7fd83640 1 --2- 172.21.15.104:0/3414254864 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a64003c30 0x7f2a64004080 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.588+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3414254864 >> 172.21.15.104:0/3414254864 conn(0x7f2a780d0f90 msgr2=0x7f2a780d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.588+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3414254864 shutdown_connections 2024-09-17T02:58:29.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.588+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3414254864 wait complete. 2024-09-17T02:58:29.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.590+0000 7f2a7fd83640 1 Processor -- start 2024-09-17T02:58:29.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.590+0000 7f2a7fd83640 1 -- start start 2024-09-17T02:58:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7fd83640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a64003c30 0x7f2a78149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7fd83640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a78073790 0x7f2a78073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7fd83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a780b1890 0x7f2a780b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7fd83640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2a780ce040 con 0x7f2a780b1890 2024-09-17T02:58:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7fd83640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a780cdec0 con 0x7f2a78073790 2024-09-17T02:58:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7fd83640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2a780ce1c0 con 0x7f2a64003c30 2024-09-17T02:58:29.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7e320640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a780b1890 0x7f2a780b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7e320640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a780b1890 0x7f2a780b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60960/0 (socket says 172.21.15.104:60960) 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7e320640 1 -- 172.21.15.104:0/3224265210 learned_addr learned my addr 172.21.15.104:0/3224265210 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7db1f640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a64003c30 0x7f2a78149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.591+0000 7f2a7d31e640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a78073790 0x7f2a78073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a7e320640 1 -- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a64003c30 msgr2=0x7f2a78149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a7e320640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a64003c30 0x7f2a78149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a7e320640 1 -- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a78073790 msgr2=0x7f2a78073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a7e320640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a78073790 0x7f2a78073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a7e320640 1 -- 172.21.15.104:0/3224265210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a780aeb90 con 0x7f2a780b1890 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a7e320640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a780b1890 0x7f2a780b1ca0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2a640057e0 tx=0x7f2a7000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a6e7fc640 1 -- 172.21.15.104:0/3224265210 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000c920 con 0x7f2a780b1890 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a6e7fc640 1 -- 172.21.15.104:0/3224265210 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a70017070 con 0x7f2a780b1890 2024-09-17T02:58:29.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a6e7fc640 1 -- 172.21.15.104:0/3224265210 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000ce30 con 0x7f2a780b1890 2024-09-17T02:58:29.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a780aee70 con 0x7f2a780b1890 2024-09-17T02:58:29.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.592+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a780af430 con 0x7f2a780b1890 2024-09-17T02:58:29.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.593+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a78070d80 con 0x7f2a780b1890 2024-09-17T02:58:29.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.594+0000 7f2a6e7fc640 1 -- 172.21.15.104:0/3224265210 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a7001c460 con 0x7f2a780b1890 2024-09-17T02:58:29.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.594+0000 7f2a6e7fc640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2a5c078bc0 0x7f2a5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:29.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.594+0000 7f2a6e7fc640 1 -- 172.21.15.104:0/3224265210 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7f2a7009b000 con 0x7f2a780b1890 2024-09-17T02:58:29.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.594+0000 7f2a7db1f640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2a5c078bc0 0x7f2a5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:29.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.595+0000 7f2a7db1f640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2a5c078bc0 0x7f2a5c07b0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a74032000 tx=0x7f2a74001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:29.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.599+0000 7f2a6e7fc640 1 -- 172.21.15.104:0/3224265210 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2a70062e40 con 0x7f2a780b1890 2024-09-17T02:58:29.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.769+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a780ae920 con 0x7f2a5c078bc0 2024-09-17T02:58:29.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.774+0000 7f2a6e7fc640 1 -- 172.21.15.104:0/3224265210 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247581 (secure 0 0 0) 0x7f2a780ae920 con 0x7f2a5c078bc0 2024-09-17T02:58:29.776 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:29.777 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2a5c078bc0 msgr2=0x7f2a5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2a5c078bc0 0x7f2a5c07b0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a74032000 tx=0x7f2a74001360 comp rx=0 tx=0).stop 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a780b1890 msgr2=0x7f2a780b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a780b1890 0x7f2a780b1ca0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2a640057e0 tx=0x7f2a7000ed10 comp rx=0 tx=0).stop 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 shutdown_connections 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2a5c078bc0 0x7f2a5c07b0d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a78073790 0x7f2a78073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a780b1890 0x7f2a780b1ca0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 --2- 172.21.15.104:0/3224265210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a64003c30 0x7f2a78149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 >> 172.21.15.104:0/3224265210 conn(0x7f2a780d0f90 msgr2=0x7f2a780cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:29.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 shutdown_connections 2024-09-17T02:58:29.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.777+0000 7f2a7fd83640 1 -- 172.21.15.104:0/3224265210 wait complete. 2024-09-17T02:58:29.788 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-09-17T02:58:29.676037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4576,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557923,"statfs":{"total":1600000000,"available":1595314100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.670070"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007822+0000","last_change":"2024-09-17T02:58:22.014502+0000","last_active":"2024-09-17T02:58:23.007822+0000","last_peered":"2024-09-17T02:58:23.007822+0000","last_clean":"2024-09-17T02:58:23.007822+0000","last_became_active":"2024-09-17T02:58:22.014122+0000","last_became_peered":"2024-09-17T02:58:22.014122+0000","last_unstale":"2024-09-17T02:58:23.007822+0000","last_undegraded":"2024-09-17T02:58:23.007822+0000","last_fullsized":"2024-09-17T02:58:23.007822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:26.698859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006615+0000","last_change":"2024-09-17T02:58:22.019278+0000","last_active":"2024-09-17T02:58:23.006615+0000","last_peered":"2024-09-17T02:58:23.006615+0000","last_clean":"2024-09-17T02:58:23.006615+0000","last_became_active":"2024-09-17T02:58:22.018211+0000","last_became_peered":"2024-09-17T02:58:22.018211+0000","last_unstale":"2024-09-17T02:58:23.006615+0000","last_undegraded":"2024-09-17T02:58:23.006615+0000","last_fullsized":"2024-09-17T02:58:23.006615+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:11.357533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182588+0000","last_change":"2024-09-17T02:58:22.014118+0000","last_active":"2024-09-17T02:58:23.182588+0000","last_peered":"2024-09-17T02:58:23.182588+0000","last_clean":"2024-09-17T02:58:23.182588+0000","last_became_active":"2024-09-17T02:58:22.013443+0000","last_became_peered":"2024-09-17T02:58:22.013443+0000","last_unstale":"2024-09-17T02:58:23.182588+0000","last_undegraded":"2024-09-17T02:58:23.182588+0000","last_fullsized":"2024-09-17T02:58:23.182588+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:35.946086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006538+0000","last_change":"2024-09-17T02:58:22.030535+0000","last_active":"2024-09-17T02:58:23.006538+0000","last_peered":"2024-09-17T02:58:23.006538+0000","last_clean":"2024-09-17T02:58:23.006538+0000","last_became_active":"2024-09-17T02:58:22.029904+0000","last_became_peered":"2024-09-17T02:58:22.029904+0000","last_unstale":"2024-09-17T02:58:23.006538+0000","last_undegraded":"2024-09-17T02:58:23.006538+0000","last_fullsized":"2024-09-17T02:58:23.006538+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:36.059570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182540+0000","last_change":"2024-09-17T02:58:22.014534+0000","last_active":"2024-09-17T02:58:23.182540+0000","last_peered":"2024-09-17T02:58:23.182540+0000","last_clean":"2024-09-17T02:58:23.182540+0000","last_became_active":"2024-09-17T02:58:22.014016+0000","last_became_peered":"2024-09-17T02:58:22.014016+0000","last_unstale":"2024-09-17T02:58:23.182540+0000","last_undegraded":"2024-09-17T02:58:23.182540+0000","last_fullsized":"2024-09-17T02:58:23.182540+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:44.964594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007307+0000","last_change":"2024-09-17T02:58:22.018976+0000","last_active":"2024-09-17T02:58:23.007307+0000","last_peered":"2024-09-17T02:58:23.007307+0000","last_clean":"2024-09-17T02:58:23.007307+0000","last_became_active":"2024-09-17T02:58:22.016245+0000","last_became_peered":"2024-09-17T02:58:22.016245+0000","last_unstale":"2024-09-17T02:58:23.007307+0000","last_undegraded":"2024-09-17T02:58:23.007307+0000","last_fullsized":"2024-09-17T02:58:23.007307+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:14.846237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.023763+0000","last_change":"2024-09-17T02:58:22.022663+0000","last_active":"2024-09-17T02:58:23.023763+0000","last_peered":"2024-09-17T02:58:23.023763+0000","last_clean":"2024-09-17T02:58:23.023763+0000","last_became_active":"2024-09-17T02:58:22.021931+0000","last_became_peered":"2024-09-17T02:58:22.021931+0000","last_unstale":"2024-09-17T02:58:23.023763+0000","last_undegraded":"2024-09-17T02:58:23.023763+0000","last_fullsized":"2024-09-17T02:58:23.023763+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:21:19.223478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008221+0000","last_change":"2024-09-17T02:58:22.023325+0000","last_active":"2024-09-17T02:58:23.008221+0000","last_peered":"2024-09-17T02:58:23.008221+0000","last_clean":"2024-09-17T02:58:23.008221+0000","last_became_active":"2024-09-17T02:58:22.022753+0000","last_became_peered":"2024-09-17T02:58:22.022753+0000","last_unstale":"2024-09-17T02:58:23.008221+0000","last_undegraded":"2024-09-17T02:58:23.008221+0000","last_fullsized":"2024-09-17T02:58:23.008221+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:16.001527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181492+0000","last_change":"2024-09-17T02:58:22.018474+0000","last_active":"2024-09-17T02:58:23.181492+0000","last_peered":"2024-09-17T02:58:23.181492+0000","last_clean":"2024-09-17T02:58:23.181492+0000","last_became_active":"2024-09-17T02:58:22.018219+0000","last_became_peered":"2024-09-17T02:58:22.018219+0000","last_unstale":"2024-09-17T02:58:23.181492+0000","last_undegraded":"2024-09-17T02:58:23.181492+0000","last_fullsized":"2024-09-17T02:58:23.181492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:14.770788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.087756+0000","last_change":"2024-09-17T02:58:22.016094+0000","last_active":"2024-09-17T02:58:23.087756+0000","last_peered":"2024-09-17T02:58:23.087756+0000","last_clean":"2024-09-17T02:58:23.087756+0000","last_became_active":"2024-09-17T02:58:22.015254+0000","last_became_peered":"2024-09-17T02:58:22.015254+0000","last_unstale":"2024-09-17T02:58:23.087756+0000","last_undegraded":"2024-09-17T02:58:23.087756+0000","last_fullsized":"2024-09-17T02:58:23.087756+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:06.209745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008532+0000","last_change":"2024-09-17T02:58:22.015820+0000","last_active":"2024-09-17T02:58:23.008532+0000","last_peered":"2024-09-17T02:58:23.008532+0000","last_clean":"2024-09-17T02:58:23.008532+0000","last_became_active":"2024-09-17T02:58:22.015526+0000","last_became_peered":"2024-09-17T02:58:22.015526+0000","last_unstale":"2024-09-17T02:58:23.008532+0000","last_undegraded":"2024-09-17T02:58:23.008532+0000","last_fullsized":"2024-09-17T02:58:23.008532+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:41.986084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006591+0000","last_change":"2024-09-17T02:58:22.012956+0000","last_active":"2024-09-17T02:58:23.006591+0000","last_peered":"2024-09-17T02:58:23.006591+0000","last_clean":"2024-09-17T02:58:23.006591+0000","last_became_active":"2024-09-17T02:58:22.012668+0000","last_became_peered":"2024-09-17T02:58:22.012668+0000","last_unstale":"2024-09-17T02:58:23.006591+0000","last_undegraded":"2024-09-17T02:58:23.006591+0000","last_fullsized":"2024-09-17T02:58:23.006591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:50.348255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025241+0000","last_change":"2024-09-17T02:58:22.026077+0000","last_active":"2024-09-17T02:58:23.025241+0000","last_peered":"2024-09-17T02:58:23.025241+0000","last_clean":"2024-09-17T02:58:23.025241+0000","last_became_active":"2024-09-17T02:58:22.025421+0000","last_became_peered":"2024-09-17T02:58:22.025421+0000","last_unstale":"2024-09-17T02:58:23.025241+0000","last_undegraded":"2024-09-17T02:58:23.025241+0000","last_fullsized":"2024-09-17T02:58:23.025241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:57.431015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181741+0000","last_change":"2024-09-17T02:58:22.014256+0000","last_active":"2024-09-17T02:58:23.181741+0000","last_peered":"2024-09-17T02:58:23.181741+0000","last_clean":"2024-09-17T02:58:23.181741+0000","last_became_active":"2024-09-17T02:58:22.013966+0000","last_became_peered":"2024-09-17T02:58:22.013966+0000","last_unstale":"2024-09-17T02:58:23.181741+0000","last_undegraded":"2024-09-17T02:58:23.181741+0000","last_fullsized":"2024-09-17T02:58:23.181741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:31.515575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025153+0000","last_change":"2024-09-17T02:58:22.019118+0000","last_active":"2024-09-17T02:58:23.025153+0000","last_peered":"2024-09-17T02:58:23.025153+0000","last_clean":"2024-09-17T02:58:23.025153+0000","last_became_active":"2024-09-17T02:58:22.018855+0000","last_became_peered":"2024-09-17T02:58:22.018855+0000","last_unstale":"2024-09-17T02:58:23.025153+0000","last_undegraded":"2024-09-17T02:58:23.025153+0000","last_fullsized":"2024-09-17T02:58:23.025153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:57.932613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.088014+0000","last_change":"2024-09-17T02:58:22.018952+0000","last_active":"2024-09-17T02:58:23.088014+0000","last_peered":"2024-09-17T02:58:23.088014+0000","last_clean":"2024-09-17T02:58:23.088014+0000","last_became_active":"2024-09-17T02:58:22.018653+0000","last_became_peered":"2024-09-17T02:58:22.018653+0000","last_unstale":"2024-09-17T02:58:23.088014+0000","last_undegraded":"2024-09-17T02:58:23.088014+0000","last_fullsized":"2024-09-17T02:58:23.088014+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:19.686054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181605+0000","last_change":"2024-09-17T02:58:22.016402+0000","last_active":"2024-09-17T02:58:23.181605+0000","last_peered":"2024-09-17T02:58:23.181605+0000","last_clean":"2024-09-17T02:58:23.181605+0000","last_became_active":"2024-09-17T02:58:22.016117+0000","last_became_peered":"2024-09-17T02:58:22.016117+0000","last_unstale":"2024-09-17T02:58:23.181605+0000","last_undegraded":"2024-09-17T02:58:23.181605+0000","last_fullsized":"2024-09-17T02:58:23.181605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:25.588247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006748+0000","last_change":"2024-09-17T02:58:22.024606+0000","last_active":"2024-09-17T02:58:23.006748+0000","last_peered":"2024-09-17T02:58:23.006748+0000","last_clean":"2024-09-17T02:58:23.006748+0000","last_became_active":"2024-09-17T02:58:22.024259+0000","last_became_peered":"2024-09-17T02:58:22.024259+0000","last_unstale":"2024-09-17T02:58:23.006748+0000","last_undegraded":"2024-09-17T02:58:23.006748+0000","last_fullsized":"2024-09-17T02:58:23.006748+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:43.131375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007415+0000","last_change":"2024-09-17T02:58:22.029148+0000","last_active":"2024-09-17T02:58:23.007415+0000","last_peered":"2024-09-17T02:58:23.007415+0000","last_clean":"2024-09-17T02:58:23.007415+0000","last_became_active":"2024-09-17T02:58:22.027579+0000","last_became_peered":"2024-09-17T02:58:22.027579+0000","last_unstale":"2024-09-17T02:58:23.007415+0000","last_undegraded":"2024-09-17T02:58:23.007415+0000","last_fullsized":"2024-09-17T02:58:23.007415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:47.287654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025301+0000","last_change":"2024-09-17T02:58:22.013350+0000","last_active":"2024-09-17T02:58:23.025301+0000","last_peered":"2024-09-17T02:58:23.025301+0000","last_clean":"2024-09-17T02:58:23.025301+0000","last_became_active":"2024-09-17T02:58:22.013078+0000","last_became_peered":"2024-09-17T02:58:22.013078+0000","last_unstale":"2024-09-17T02:58:23.025301+0000","last_undegraded":"2024-09-17T02:58:23.025301+0000","last_fullsized":"2024-09-17T02:58:23.025301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:06.566910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.087726+0000","last_change":"2024-09-17T02:58:22.008621+0000","last_active":"2024-09-17T02:58:23.087726+0000","last_peered":"2024-09-17T02:58:23.087726+0000","last_clean":"2024-09-17T02:58:23.087726+0000","last_became_active":"2024-09-17T02:58:22.008344+0000","last_became_peered":"2024-09-17T02:58:22.008344+0000","last_unstale":"2024-09-17T02:58:23.087726+0000","last_undegraded":"2024-09-17T02:58:23.087726+0000","last_fullsized":"2024-09-17T02:58:23.087726+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:34.971913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.087613+0000","last_change":"2024-09-17T02:58:22.012963+0000","last_active":"2024-09-17T02:58:23.087613+0000","last_peered":"2024-09-17T02:58:23.087613+0000","last_clean":"2024-09-17T02:58:23.087613+0000","last_became_active":"2024-09-17T02:58:22.010631+0000","last_became_peered":"2024-09-17T02:58:22.010631+0000","last_unstale":"2024-09-17T02:58:23.087613+0000","last_undegraded":"2024-09-17T02:58:23.087613+0000","last_fullsized":"2024-09-17T02:58:23.087613+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:55.889753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007239+0000","last_change":"2024-09-17T02:58:22.021134+0000","last_active":"2024-09-17T02:58:23.007239+0000","last_peered":"2024-09-17T02:58:23.007239+0000","last_clean":"2024-09-17T02:58:23.007239+0000","last_became_active":"2024-09-17T02:58:22.020842+0000","last_became_peered":"2024-09-17T02:58:22.020842+0000","last_unstale":"2024-09-17T02:58:23.007239+0000","last_undegraded":"2024-09-17T02:58:23.007239+0000","last_fullsized":"2024-09-17T02:58:23.007239+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:17.067962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007040+0000","last_change":"2024-09-17T02:58:22.025695+0000","last_active":"2024-09-17T02:58:23.007040+0000","last_peered":"2024-09-17T02:58:23.007040+0000","last_clean":"2024-09-17T02:58:23.007040+0000","last_became_active":"2024-09-17T02:58:22.025383+0000","last_became_peered":"2024-09-17T02:58:22.025383+0000","last_unstale":"2024-09-17T02:58:23.007040+0000","last_undegraded":"2024-09-17T02:58:23.007040+0000","last_fullsized":"2024-09-17T02:58:23.007040+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:33.760436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.087939+0000","last_change":"2024-09-17T02:58:22.011926+0000","last_active":"2024-09-17T02:58:23.087939+0000","last_peered":"2024-09-17T02:58:23.087939+0000","last_clean":"2024-09-17T02:58:23.087939+0000","last_became_active":"2024-09-17T02:58:22.011158+0000","last_became_peered":"2024-09-17T02:58:22.011158+0000","last_unstale":"2024-09-17T02:58:23.087939+0000","last_undegraded":"2024-09-17T02:58:23.087939+0000","last_fullsized":"2024-09-17T02:58:23.087939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:14.364987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.023811+0000","last_change":"2024-09-17T02:58:22.025822+0000","last_active":"2024-09-17T02:58:23.023811+0000","last_peered":"2024-09-17T02:58:23.023811+0000","last_clean":"2024-09-17T02:58:23.023811+0000","last_became_active":"2024-09-17T02:58:22.025540+0000","last_became_peered":"2024-09-17T02:58:22.025540+0000","last_unstale":"2024-09-17T02:58:23.023811+0000","last_undegraded":"2024-09-17T02:58:23.023811+0000","last_fullsized":"2024-09-17T02:58:23.023811+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:16.086078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181706+0000","last_change":"2024-09-17T02:58:22.014610+0000","last_active":"2024-09-17T02:58:23.181706+0000","last_peered":"2024-09-17T02:58:23.181706+0000","last_clean":"2024-09-17T02:58:23.181706+0000","last_became_active":"2024-09-17T02:58:22.012331+0000","last_became_peered":"2024-09-17T02:58:22.012331+0000","last_unstale":"2024-09-17T02:58:23.181706+0000","last_undegraded":"2024-09-17T02:58:23.181706+0000","last_fullsized":"2024-09-17T02:58:23.181706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:52.230200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.087406+0000","last_change":"2024-09-17T02:58:22.012113+0000","last_active":"2024-09-17T02:58:23.087406+0000","last_peered":"2024-09-17T02:58:23.087406+0000","last_clean":"2024-09-17T02:58:23.087406+0000","last_became_active":"2024-09-17T02:58:22.011815+0000","last_became_peered":"2024-09-17T02:58:22.011815+0000","last_unstale":"2024-09-17T02:58:23.087406+0000","last_undegraded":"2024-09-17T02:58:23.087406+0000","last_fullsized":"2024-09-17T02:58:23.087406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:15:44.666877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181574+0000","last_change":"2024-09-17T02:58:22.015521+0000","last_active":"2024-09-17T02:58:23.181574+0000","last_peered":"2024-09-17T02:58:23.181574+0000","last_clean":"2024-09-17T02:58:23.181574+0000","last_became_active":"2024-09-17T02:58:22.014424+0000","last_became_peered":"2024-09-17T02:58:22.014424+0000","last_unstale":"2024-09-17T02:58:23.181574+0000","last_undegraded":"2024-09-17T02:58:23.181574+0000","last_fullsized":"2024-09-17T02:58:23.181574+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:16.406435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.023959+0000","last_change":"2024-09-17T02:58:22.021363+0000","last_active":"2024-09-17T02:58:23.023959+0000","last_peered":"2024-09-17T02:58:23.023959+0000","last_clean":"2024-09-17T02:58:23.023959+0000","last_became_active":"2024-09-17T02:58:22.021093+0000","last_became_peered":"2024-09-17T02:58:22.021093+0000","last_unstale":"2024-09-17T02:58:23.023959+0000","last_undegraded":"2024-09-17T02:58:23.023959+0000","last_fullsized":"2024-09-17T02:58:23.023959+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:08.020751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.024106+0000","last_change":"2024-09-17T02:58:22.024447+0000","last_active":"2024-09-17T02:58:23.024106+0000","last_peered":"2024-09-17T02:58:23.024106+0000","last_clean":"2024-09-17T02:58:23.024106+0000","last_became_active":"2024-09-17T02:58:22.024180+0000","last_became_peered":"2024-09-17T02:58:22.024180+0000","last_unstale":"2024-09-17T02:58:23.024106+0000","last_undegraded":"2024-09-17T02:58:23.024106+0000","last_fullsized":"2024-09-17T02:58:23.024106+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:10.584983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006942+0000","last_change":"2024-09-17T02:58:22.018461+0000","last_active":"2024-09-17T02:58:23.006942+0000","last_peered":"2024-09-17T02:58:23.006942+0000","last_clean":"2024-09-17T02:58:23.006942+0000","last_became_active":"2024-09-17T02:58:22.017861+0000","last_became_peered":"2024-09-17T02:58:22.017861+0000","last_unstale":"2024-09-17T02:58:23.006942+0000","last_undegraded":"2024-09-17T02:58:23.006942+0000","last_fullsized":"2024-09-17T02:58:23.006942+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:47.244319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007337+0000","last_change":"2024-09-17T02:58:22.028758+0000","last_active":"2024-09-17T02:58:23.007337+0000","last_peered":"2024-09-17T02:58:23.007337+0000","last_clean":"2024-09-17T02:58:23.007337+0000","last_became_active":"2024-09-17T02:58:22.028503+0000","last_became_peered":"2024-09-17T02:58:22.028503+0000","last_unstale":"2024-09-17T02:58:23.007337+0000","last_undegraded":"2024-09-17T02:58:23.007337+0000","last_fullsized":"2024-09-17T02:58:23.007337+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:37.374151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007423+0000","last_change":"2024-09-17T02:58:21.003281+0000","last_active":"2024-09-17T02:58:23.007423+0000","last_peered":"2024-09-17T02:58:23.007423+0000","last_clean":"2024-09-17T02:58:23.007423+0000","last_became_active":"2024-09-17T02:58:21.002339+0000","last_became_peered":"2024-09-17T02:58:21.002339+0000","last_unstale":"2024-09-17T02:58:23.007423+0000","last_undegraded":"2024-09-17T02:58:23.007423+0000","last_fullsized":"2024-09-17T02:58:23.007423+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:41.490798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181567+0000","last_change":"2024-09-17T02:58:22.020116+0000","last_active":"2024-09-17T02:58:23.181567+0000","last_peered":"2024-09-17T02:58:23.181567+0000","last_clean":"2024-09-17T02:58:23.181567+0000","last_became_active":"2024-09-17T02:58:22.019535+0000","last_became_peered":"2024-09-17T02:58:22.019535+0000","last_unstale":"2024-09-17T02:58:23.181567+0000","last_undegraded":"2024-09-17T02:58:23.181567+0000","last_fullsized":"2024-09-17T02:58:23.181567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:13.405175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025372+0000","last_change":"2024-09-17T02:58:21.006659+0000","last_active":"2024-09-17T02:58:23.025372+0000","last_peered":"2024-09-17T02:58:23.025372+0000","last_clean":"2024-09-17T02:58:23.025372+0000","last_became_active":"2024-09-17T02:58:21.005416+0000","last_became_peered":"2024-09-17T02:58:21.005416+0000","last_unstale":"2024-09-17T02:58:23.025372+0000","last_undegraded":"2024-09-17T02:58:23.025372+0000","last_fullsized":"2024-09-17T02:58:23.025372+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:23.053641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007579+0000","last_change":"2024-09-17T02:58:22.016923+0000","last_active":"2024-09-17T02:58:23.007579+0000","last_peered":"2024-09-17T02:58:23.007579+0000","last_clean":"2024-09-17T02:58:23.007579+0000","last_became_active":"2024-09-17T02:58:22.015804+0000","last_became_peered":"2024-09-17T02:58:22.015804+0000","last_unstale":"2024-09-17T02:58:23.007579+0000","last_undegraded":"2024-09-17T02:58:23.007579+0000","last_fullsized":"2024-09-17T02:58:23.007579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:25:04.572229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.088193+0000","last_change":"2024-09-17T02:58:21.006096+0000","last_active":"2024-09-17T02:58:23.088193+0000","last_peered":"2024-09-17T02:58:23.088193+0000","last_clean":"2024-09-17T02:58:23.088193+0000","last_became_active":"2024-09-17T02:58:21.005526+0000","last_became_peered":"2024-09-17T02:58:21.005526+0000","last_unstale":"2024-09-17T02:58:23.088193+0000","last_undegraded":"2024-09-17T02:58:23.088193+0000","last_fullsized":"2024-09-17T02:58:23.088193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:08.774178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007784+0000","last_change":"2024-09-17T02:58:22.014951+0000","last_active":"2024-09-17T02:58:23.007784+0000","last_peered":"2024-09-17T02:58:23.007784+0000","last_clean":"2024-09-17T02:58:23.007784+0000","last_became_active":"2024-09-17T02:58:22.014629+0000","last_became_peered":"2024-09-17T02:58:22.014629+0000","last_unstale":"2024-09-17T02:58:23.007784+0000","last_undegraded":"2024-09-17T02:58:23.007784+0000","last_fullsized":"2024-09-17T02:58:23.007784+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:37.206174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008209+0000","last_change":"2024-09-17T02:58:21.006163+0000","last_active":"2024-09-17T02:58:23.008209+0000","last_peered":"2024-09-17T02:58:23.008209+0000","last_clean":"2024-09-17T02:58:23.008209+0000","last_became_active":"2024-09-17T02:58:21.005823+0000","last_became_peered":"2024-09-17T02:58:21.005823+0000","last_unstale":"2024-09-17T02:58:23.008209+0000","last_undegraded":"2024-09-17T02:58:23.008209+0000","last_fullsized":"2024-09-17T02:58:23.008209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:19.026519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.023885+0000","last_change":"2024-09-17T02:58:22.017959+0000","last_active":"2024-09-17T02:58:23.023885+0000","last_peered":"2024-09-17T02:58:23.023885+0000","last_clean":"2024-09-17T02:58:23.023885+0000","last_became_active":"2024-09-17T02:58:22.017710+0000","last_became_peered":"2024-09-17T02:58:22.017710+0000","last_unstale":"2024-09-17T02:58:23.023885+0000","last_undegraded":"2024-09-17T02:58:23.023885+0000","last_fullsized":"2024-09-17T02:58:23.023885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:17.512948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181969+0000","last_change":"2024-09-17T02:58:21.007467+0000","last_active":"2024-09-17T02:58:23.181969+0000","last_peered":"2024-09-17T02:58:23.181969+0000","last_clean":"2024-09-17T02:58:23.181969+0000","last_became_active":"2024-09-17T02:58:21.007127+0000","last_became_peered":"2024-09-17T02:58:21.007127+0000","last_unstale":"2024-09-17T02:58:23.181969+0000","last_undegraded":"2024-09-17T02:58:23.181969+0000","last_fullsized":"2024-09-17T02:58:23.181969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:42.670192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.087793+0000","last_change":"2024-09-17T02:58:22.013419+0000","last_active":"2024-09-17T02:58:23.087793+0000","last_peered":"2024-09-17T02:58:23.087793+0000","last_clean":"2024-09-17T02:58:23.087793+0000","last_became_active":"2024-09-17T02:58:22.011390+0000","last_became_peered":"2024-09-17T02:58:22.011390+0000","last_unstale":"2024-09-17T02:58:23.087793+0000","last_undegraded":"2024-09-17T02:58:23.087793+0000","last_fullsized":"2024-09-17T02:58:23.087793+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:27.337157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008618+0000","last_change":"2024-09-17T02:58:21.006408+0000","last_active":"2024-09-17T02:58:23.008618+0000","last_peered":"2024-09-17T02:58:23.008618+0000","last_clean":"2024-09-17T02:58:23.008618+0000","last_became_active":"2024-09-17T02:58:21.005945+0000","last_became_peered":"2024-09-17T02:58:21.005945+0000","last_unstale":"2024-09-17T02:58:23.008618+0000","last_undegraded":"2024-09-17T02:58:23.008618+0000","last_fullsized":"2024-09-17T02:58:23.008618+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:59:08.363806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182823+0000","last_change":"2024-09-17T02:58:22.013513+0000","last_active":"2024-09-17T02:58:23.182823+0000","last_peered":"2024-09-17T02:58:23.182823+0000","last_clean":"2024-09-17T02:58:23.182823+0000","last_became_active":"2024-09-17T02:58:22.012697+0000","last_became_peered":"2024-09-17T02:58:22.012697+0000","last_unstale":"2024-09-17T02:58:23.182823+0000","last_undegraded":"2024-09-17T02:58:23.182823+0000","last_fullsized":"2024-09-17T02:58:23.182823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:30.870145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006776+0000","last_change":"2024-09-17T02:58:21.000894+0000","last_active":"2024-09-17T02:58:23.006776+0000","last_peered":"2024-09-17T02:58:23.006776+0000","last_clean":"2024-09-17T02:58:23.006776+0000","last_became_active":"2024-09-17T02:58:21.000611+0000","last_became_peered":"2024-09-17T02:58:21.000611+0000","last_unstale":"2024-09-17T02:58:23.006776+0000","last_undegraded":"2024-09-17T02:58:23.006776+0000","last_fullsized":"2024-09-17T02:58:23.006776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:28.699121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025069+0000","last_change":"2024-09-17T02:58:22.014493+0000","last_active":"2024-09-17T02:58:23.025069+0000","last_peered":"2024-09-17T02:58:23.025069+0000","last_clean":"2024-09-17T02:58:23.025069+0000","last_became_active":"2024-09-17T02:58:22.012982+0000","last_became_peered":"2024-09-17T02:58:22.012982+0000","last_unstale":"2024-09-17T02:58:23.025069+0000","last_undegraded":"2024-09-17T02:58:23.025069+0000","last_fullsized":"2024-09-17T02:58:23.025069+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:23.146297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182963+0000","last_change":"2024-09-17T02:58:20.996167+0000","last_active":"2024-09-17T02:58:23.182963+0000","last_peered":"2024-09-17T02:58:23.182963+0000","last_clean":"2024-09-17T02:58:23.182963+0000","last_became_active":"2024-09-17T02:58:20.995880+0000","last_became_peered":"2024-09-17T02:58:20.995880+0000","last_unstale":"2024-09-17T02:58:23.182963+0000","last_undegraded":"2024-09-17T02:58:23.182963+0000","last_fullsized":"2024-09-17T02:58:23.182963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:57.855186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.024011+0000","last_change":"2024-09-17T02:58:22.023414+0000","last_active":"2024-09-17T02:58:23.024011+0000","last_peered":"2024-09-17T02:58:23.024011+0000","last_clean":"2024-09-17T02:58:23.024011+0000","last_became_active":"2024-09-17T02:58:22.023109+0000","last_became_peered":"2024-09-17T02:58:22.023109+0000","last_unstale":"2024-09-17T02:58:23.024011+0000","last_undegraded":"2024-09-17T02:58:23.024011+0000","last_fullsized":"2024-09-17T02:58:23.024011+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:53.363976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.088288+0000","last_change":"2024-09-17T02:58:21.003450+0000","last_active":"2024-09-17T02:58:23.088288+0000","last_peered":"2024-09-17T02:58:23.088288+0000","last_clean":"2024-09-17T02:58:23.088288+0000","last_became_active":"2024-09-17T02:58:21.002955+0000","last_became_peered":"2024-09-17T02:58:21.002955+0000","last_unstale":"2024-09-17T02:58:23.088288+0000","last_undegraded":"2024-09-17T02:58:23.088288+0000","last_fullsized":"2024-09-17T02:58:23.088288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:10.104158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008123+0000","last_change":"2024-09-17T02:58:22.020210+0000","last_active":"2024-09-17T02:58:23.008123+0000","last_peered":"2024-09-17T02:58:23.008123+0000","last_clean":"2024-09-17T02:58:23.008123+0000","last_became_active":"2024-09-17T02:58:22.019064+0000","last_became_peered":"2024-09-17T02:58:22.019064+0000","last_unstale":"2024-09-17T02:58:23.008123+0000","last_undegraded":"2024-09-17T02:58:23.008123+0000","last_fullsized":"2024-09-17T02:58:23.008123+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:54.875920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007146+0000","last_change":"2024-09-17T02:58:21.005548+0000","last_active":"2024-09-17T02:58:23.007146+0000","last_peered":"2024-09-17T02:58:23.007146+0000","last_clean":"2024-09-17T02:58:23.007146+0000","last_became_active":"2024-09-17T02:58:21.005071+0000","last_became_peered":"2024-09-17T02:58:21.005071+0000","last_unstale":"2024-09-17T02:58:23.007146+0000","last_undegraded":"2024-09-17T02:58:23.007146+0000","last_fullsized":"2024-09-17T02:58:23.007146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:15.258275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007570+0000","last_change":"2024-09-17T02:58:22.028647+0000","last_active":"2024-09-17T02:58:23.007570+0000","last_peered":"2024-09-17T02:58:23.007570+0000","last_clean":"2024-09-17T02:58:23.007570+0000","last_became_active":"2024-09-17T02:58:22.025945+0000","last_became_peered":"2024-09-17T02:58:22.025945+0000","last_unstale":"2024-09-17T02:58:23.007570+0000","last_undegraded":"2024-09-17T02:58:23.007570+0000","last_fullsized":"2024-09-17T02:58:23.007570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:57.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182974+0000","last_change":"2024-09-17T02:58:21.004399+0000","last_active":"2024-09-17T02:58:23.182974+0000","last_peered":"2024-09-17T02:58:23.182974+0000","last_clean":"2024-09-17T02:58:23.182974+0000","last_became_active":"2024-09-17T02:58:21.004078+0000","last_became_peered":"2024-09-17T02:58:21.004078+0000","last_unstale":"2024-09-17T02:58:23.182974+0000","last_undegraded":"2024-09-17T02:58:23.182974+0000","last_fullsized":"2024-09-17T02:58:23.182974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:47.916358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181781+0000","last_change":"2024-09-17T02:58:22.016479+0000","last_active":"2024-09-17T02:58:23.181781+0000","last_peered":"2024-09-17T02:58:23.181781+0000","last_clean":"2024-09-17T02:58:23.181781+0000","last_became_active":"2024-09-17T02:58:22.015804+0000","last_became_peered":"2024-09-17T02:58:22.015804+0000","last_unstale":"2024-09-17T02:58:23.181781+0000","last_undegraded":"2024-09-17T02:58:23.181781+0000","last_fullsized":"2024-09-17T02:58:23.181781+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:45.659607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"82'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006876+0000","last_change":"2024-09-17T02:58:20.997321+0000","last_active":"2024-09-17T02:58:23.006876+0000","last_peered":"2024-09-17T02:58:23.006876+0000","last_clean":"2024-09-17T02:58:23.006876+0000","last_became_active":"2024-09-17T02:58:20.996864+0000","last_became_peered":"2024-09-17T02:58:20.996864+0000","last_unstale":"2024-09-17T02:58:23.006876+0000","last_undegraded":"2024-09-17T02:58:23.006876+0000","last_fullsized":"2024-09-17T02:58:23.006876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:27.100060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008342+0000","last_change":"2024-09-17T02:58:22.019573+0000","last_active":"2024-09-17T02:58:23.008342+0000","last_peered":"2024-09-17T02:58:23.008342+0000","last_clean":"2024-09-17T02:58:23.008342+0000","last_became_active":"2024-09-17T02:58:22.017684+0000","last_became_peered":"2024-09-17T02:58:22.017684+0000","last_unstale":"2024-09-17T02:58:23.008342+0000","last_undegraded":"2024-09-17T02:58:23.008342+0000","last_fullsized":"2024-09-17T02:58:23.008342+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:33.584354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006597+0000","last_change":"2024-09-17T02:58:21.002715+0000","last_active":"2024-09-17T02:58:23.006597+0000","last_peered":"2024-09-17T02:58:23.006597+0000","last_clean":"2024-09-17T02:58:23.006597+0000","last_became_active":"2024-09-17T02:58:21.002427+0000","last_became_peered":"2024-09-17T02:58:21.002427+0000","last_unstale":"2024-09-17T02:58:23.006597+0000","last_undegraded":"2024-09-17T02:58:23.006597+0000","last_fullsized":"2024-09-17T02:58:23.006597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:00.016652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.024224+0000","last_change":"2024-09-17T02:58:22.012837+0000","last_active":"2024-09-17T02:58:23.024224+0000","last_peered":"2024-09-17T02:58:23.024224+0000","last_clean":"2024-09-17T02:58:23.024224+0000","last_became_active":"2024-09-17T02:58:22.012567+0000","last_became_peered":"2024-09-17T02:58:22.012567+0000","last_unstale":"2024-09-17T02:58:23.024224+0000","last_undegraded":"2024-09-17T02:58:23.024224+0000","last_fullsized":"2024-09-17T02:58:23.024224+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:24.908781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008338+0000","last_change":"2024-09-17T02:58:20.998480+0000","last_active":"2024-09-17T02:58:23.008338+0000","last_peered":"2024-09-17T02:58:23.008338+0000","last_clean":"2024-09-17T02:58:23.008338+0000","last_became_active":"2024-09-17T02:58:20.998192+0000","last_became_peered":"2024-09-17T02:58:20.998192+0000","last_unstale":"2024-09-17T02:58:23.008338+0000","last_undegraded":"2024-09-17T02:58:23.008338+0000","last_fullsized":"2024-09-17T02:58:23.008338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:21.987535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025388+0000","last_change":"2024-09-17T02:58:22.025703+0000","last_active":"2024-09-17T02:58:23.025388+0000","last_peered":"2024-09-17T02:58:23.025388+0000","last_clean":"2024-09-17T02:58:23.025388+0000","last_became_active":"2024-09-17T02:58:22.025024+0000","last_became_peered":"2024-09-17T02:58:22.025024+0000","last_unstale":"2024-09-17T02:58:23.025388+0000","last_undegraded":"2024-09-17T02:58:23.025388+0000","last_fullsized":"2024-09-17T02:58:23.025388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:51.527384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.024341+0000","last_change":"2024-09-17T02:58:21.003758+0000","last_active":"2024-09-17T02:58:23.024341+0000","last_peered":"2024-09-17T02:58:23.024341+0000","last_clean":"2024-09-17T02:58:23.024341+0000","last_became_active":"2024-09-17T02:58:21.003431+0000","last_became_peered":"2024-09-17T02:58:21.003431+0000","last_unstale":"2024-09-17T02:58:23.024341+0000","last_undegraded":"2024-09-17T02:58:23.024341+0000","last_fullsized":"2024-09-17T02:58:23.024341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:18.973798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181804+0000","last_change":"2024-09-17T02:58:22.017143+0000","last_active":"2024-09-17T02:58:23.181804+0000","last_peered":"2024-09-17T02:58:23.181804+0000","last_clean":"2024-09-17T02:58:23.181804+0000","last_became_active":"2024-09-17T02:58:22.016887+0000","last_became_peered":"2024-09-17T02:58:22.016887+0000","last_unstale":"2024-09-17T02:58:23.181804+0000","last_undegraded":"2024-09-17T02:58:23.181804+0000","last_fullsized":"2024-09-17T02:58:23.181804+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:42.138602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"82'8","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.087622+0000","last_change":"2024-09-17T02:58:21.009192+0000","last_active":"2024-09-17T02:58:23.087622+0000","last_peered":"2024-09-17T02:58:23.087622+0000","last_clean":"2024-09-17T02:58:23.087622+0000","last_became_active":"2024-09-17T02:58:21.008557+0000","last_became_peered":"2024-09-17T02:58:21.008557+0000","last_unstale":"2024-09-17T02:58:23.087622+0000","last_undegraded":"2024-09-17T02:58:23.087622+0000","last_fullsized":"2024-09-17T02:58:23.087622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:29.618275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.088077+0000","last_change":"2024-09-17T02:58:22.016410+0000","last_active":"2024-09-17T02:58:23.088077+0000","last_peered":"2024-09-17T02:58:23.088077+0000","last_clean":"2024-09-17T02:58:23.088077+0000","last_became_active":"2024-09-17T02:58:22.015817+0000","last_became_peered":"2024-09-17T02:58:22.015817+0000","last_unstale":"2024-09-17T02:58:23.088077+0000","last_undegraded":"2024-09-17T02:58:23.088077+0000","last_fullsized":"2024-09-17T02:58:23.088077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:01.110880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007714+0000","last_change":"2024-09-17T02:58:21.009117+0000","last_active":"2024-09-17T02:58:23.007714+0000","last_peered":"2024-09-17T02:58:23.007714+0000","last_clean":"2024-09-17T02:58:23.007714+0000","last_became_active":"2024-09-17T02:58:21.007266+0000","last_became_peered":"2024-09-17T02:58:21.007266+0000","last_unstale":"2024-09-17T02:58:23.007714+0000","last_undegraded":"2024-09-17T02:58:23.007714+0000","last_fullsized":"2024-09-17T02:58:23.007714+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:04.664044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007579+0000","last_change":"2024-09-17T02:58:22.016507+0000","last_active":"2024-09-17T02:58:23.007579+0000","last_peered":"2024-09-17T02:58:23.007579+0000","last_clean":"2024-09-17T02:58:23.007579+0000","last_became_active":"2024-09-17T02:58:22.016245+0000","last_became_peered":"2024-09-17T02:58:22.016245+0000","last_unstale":"2024-09-17T02:58:23.007579+0000","last_undegraded":"2024-09-17T02:58:23.007579+0000","last_fullsized":"2024-09-17T02:58:23.007579+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:12.179605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.088263+0000","last_change":"2024-09-17T02:58:21.005789+0000","last_active":"2024-09-17T02:58:23.088263+0000","last_peered":"2024-09-17T02:58:23.088263+0000","last_clean":"2024-09-17T02:58:23.088263+0000","last_became_active":"2024-09-17T02:58:21.005141+0000","last_became_peered":"2024-09-17T02:58:21.005141+0000","last_unstale":"2024-09-17T02:58:23.088263+0000","last_undegraded":"2024-09-17T02:58:23.088263+0000","last_fullsized":"2024-09-17T02:58:23.088263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:27.522956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006738+0000","last_change":"2024-09-17T02:58:22.011898+0000","last_active":"2024-09-17T02:58:23.006738+0000","last_peered":"2024-09-17T02:58:23.006738+0000","last_clean":"2024-09-17T02:58:23.006738+0000","last_became_active":"2024-09-17T02:58:22.011574+0000","last_became_peered":"2024-09-17T02:58:22.011574+0000","last_unstale":"2024-09-17T02:58:23.006738+0000","last_undegraded":"2024-09-17T02:58:23.006738+0000","last_fullsized":"2024-09-17T02:58:23.006738+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:36.681971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008524+0000","last_change":"2024-09-17T02:58:21.002316+0000","last_active":"2024-09-17T02:58:23.008524+0000","last_peered":"2024-09-17T02:58:23.008524+0000","last_clean":"2024-09-17T02:58:23.008524+0000","last_became_active":"2024-09-17T02:58:21.002050+0000","last_became_peered":"2024-09-17T02:58:21.002050+0000","last_unstale":"2024-09-17T02:58:23.008524+0000","last_undegraded":"2024-09-17T02:58:23.008524+0000","last_fullsized":"2024-09-17T02:58:23.008524+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:38:57.633869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182622+0000","last_change":"2024-09-17T02:58:22.012351+0000","last_active":"2024-09-17T02:58:23.182622+0000","last_peered":"2024-09-17T02:58:23.182622+0000","last_clean":"2024-09-17T02:58:23.182622+0000","last_became_active":"2024-09-17T02:58:22.011429+0000","last_became_peered":"2024-09-17T02:58:22.011429+0000","last_unstale":"2024-09-17T02:58:23.182622+0000","last_undegraded":"2024-09-17T02:58:23.182622+0000","last_fullsized":"2024-09-17T02:58:23.182622+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:06.419978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007250+0000","last_change":"2024-09-17T02:58:21.007482+0000","last_active":"2024-09-17T02:58:23.007250+0000","last_peered":"2024-09-17T02:58:23.007250+0000","last_clean":"2024-09-17T02:58:23.007250+0000","last_became_active":"2024-09-17T02:58:21.007194+0000","last_became_peered":"2024-09-17T02:58:21.007194+0000","last_unstale":"2024-09-17T02:58:23.007250+0000","last_undegraded":"2024-09-17T02:58:23.007250+0000","last_fullsized":"2024-09-17T02:58:23.007250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:27.060851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182808+0000","last_change":"2024-09-17T02:58:22.015435+0000","last_active":"2024-09-17T02:58:23.182808+0000","last_peered":"2024-09-17T02:58:23.182808+0000","last_clean":"2024-09-17T02:58:23.182808+0000","last_became_active":"2024-09-17T02:58:22.015130+0000","last_became_peered":"2024-09-17T02:58:22.015130+0000","last_unstale":"2024-09-17T02:58:23.182808+0000","last_undegraded":"2024-09-17T02:58:23.182808+0000","last_fullsized":"2024-09-17T02:58:23.182808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:26.219284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007863+0000","last_change":"2024-09-17T02:58:21.009391+0000","last_active":"2024-09-17T02:58:23.007863+0000","last_peered":"2024-09-17T02:58:23.007863+0000","last_clean":"2024-09-17T02:58:23.007863+0000","last_became_active":"2024-09-17T02:58:21.007661+0000","last_became_peered":"2024-09-17T02:58:21.007661+0000","last_unstale":"2024-09-17T02:58:23.007863+0000","last_undegraded":"2024-09-17T02:58:23.007863+0000","last_fullsized":"2024-09-17T02:58:23.007863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:04.678750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182173+0000","last_change":"2024-09-17T02:58:22.024686+0000","last_active":"2024-09-17T02:58:23.182173+0000","last_peered":"2024-09-17T02:58:23.182173+0000","last_clean":"2024-09-17T02:58:23.182173+0000","last_became_active":"2024-09-17T02:58:22.024439+0000","last_became_peered":"2024-09-17T02:58:22.024439+0000","last_unstale":"2024-09-17T02:58:23.182173+0000","last_undegraded":"2024-09-17T02:58:23.182173+0000","last_fullsized":"2024-09-17T02:58:23.182173+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:23.849243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.024410+0000","last_change":"2024-09-17T02:58:21.005375+0000","last_active":"2024-09-17T02:58:23.024410+0000","last_peered":"2024-09-17T02:58:23.024410+0000","last_clean":"2024-09-17T02:58:23.024410+0000","last_became_active":"2024-09-17T02:58:21.004679+0000","last_became_peered":"2024-09-17T02:58:21.004679+0000","last_unstale":"2024-09-17T02:58:23.024410+0000","last_undegraded":"2024-09-17T02:58:23.024410+0000","last_fullsized":"2024-09-17T02:58:23.024410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:59.243846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182406+0000","last_change":"2024-09-17T02:58:22.024020+0000","last_active":"2024-09-17T02:58:23.182406+0000","last_peered":"2024-09-17T02:58:23.182406+0000","last_clean":"2024-09-17T02:58:23.182406+0000","last_became_active":"2024-09-17T02:58:22.023691+0000","last_became_peered":"2024-09-17T02:58:22.023691+0000","last_unstale":"2024-09-17T02:58:23.182406+0000","last_undegraded":"2024-09-17T02:58:23.182406+0000","last_fullsized":"2024-09-17T02:58:23.182406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:40.797108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025117+0000","last_change":"2024-09-17T02:58:21.002742+0000","last_active":"2024-09-17T02:58:23.025117+0000","last_peered":"2024-09-17T02:58:23.025117+0000","last_clean":"2024-09-17T02:58:23.025117+0000","last_became_active":"2024-09-17T02:58:21.002199+0000","last_became_peered":"2024-09-17T02:58:21.002199+0000","last_unstale":"2024-09-17T02:58:23.025117+0000","last_undegraded":"2024-09-17T02:58:23.025117+0000","last_fullsized":"2024-09-17T02:58:23.025117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:06.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025539+0000","last_change":"2024-09-17T02:58:22.014596+0000","last_active":"2024-09-17T02:58:23.025539+0000","last_peered":"2024-09-17T02:58:23.025539+0000","last_clean":"2024-09-17T02:58:23.025539+0000","last_became_active":"2024-09-17T02:58:22.014278+0000","last_became_peered":"2024-09-17T02:58:22.014278+0000","last_unstale":"2024-09-17T02:58:23.025539+0000","last_undegraded":"2024-09-17T02:58:23.025539+0000","last_fullsized":"2024-09-17T02:58:23.025539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:48.244312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007277+0000","last_change":"2024-09-17T02:58:21.006274+0000","last_active":"2024-09-17T02:58:23.007277+0000","last_peered":"2024-09-17T02:58:23.007277+0000","last_clean":"2024-09-17T02:58:23.007277+0000","last_became_active":"2024-09-17T02:58:21.006012+0000","last_became_peered":"2024-09-17T02:58:21.006012+0000","last_unstale":"2024-09-17T02:58:23.007277+0000","last_undegraded":"2024-09-17T02:58:23.007277+0000","last_fullsized":"2024-09-17T02:58:23.007277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:33.492313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.024176+0000","last_change":"2024-09-17T02:58:22.022273+0000","last_active":"2024-09-17T02:58:23.024176+0000","last_peered":"2024-09-17T02:58:23.024176+0000","last_clean":"2024-09-17T02:58:23.024176+0000","last_became_active":"2024-09-17T02:58:22.021529+0000","last_became_peered":"2024-09-17T02:58:22.021529+0000","last_unstale":"2024-09-17T02:58:23.024176+0000","last_undegraded":"2024-09-17T02:58:23.024176+0000","last_fullsized":"2024-09-17T02:58:23.024176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:18.367187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"83'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.024102+0000","last_change":"2024-09-17T02:58:21.006384+0000","last_active":"2024-09-17T02:58:23.024102+0000","last_peered":"2024-09-17T02:58:23.024102+0000","last_clean":"2024-09-17T02:58:23.024102+0000","last_became_active":"2024-09-17T02:58:21.006070+0000","last_became_peered":"2024-09-17T02:58:21.006070+0000","last_unstale":"2024-09-17T02:58:23.024102+0000","last_undegraded":"2024-09-17T02:58:23.024102+0000","last_fullsized":"2024-09-17T02:58:23.024102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:19.774702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008029+0000","last_change":"2024-09-17T02:58:22.018137+0000","last_active":"2024-09-17T02:58:23.008029+0000","last_peered":"2024-09-17T02:58:23.008029+0000","last_clean":"2024-09-17T02:58:23.008029+0000","last_became_active":"2024-09-17T02:58:22.017800+0000","last_became_peered":"2024-09-17T02:58:22.017800+0000","last_unstale":"2024-09-17T02:58:23.008029+0000","last_undegraded":"2024-09-17T02:58:23.008029+0000","last_fullsized":"2024-09-17T02:58:23.008029+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:06.906865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181975+0000","last_change":"2024-09-17T02:58:21.004339+0000","last_active":"2024-09-17T02:58:23.181975+0000","last_peered":"2024-09-17T02:58:23.181975+0000","last_clean":"2024-09-17T02:58:23.181975+0000","last_became_active":"2024-09-17T02:58:21.004045+0000","last_became_peered":"2024-09-17T02:58:21.004045+0000","last_unstale":"2024-09-17T02:58:23.181975+0000","last_undegraded":"2024-09-17T02:58:23.181975+0000","last_fullsized":"2024-09-17T02:58:23.181975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:43.411441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007817+0000","last_change":"2024-09-17T02:58:22.013292+0000","last_active":"2024-09-17T02:58:23.007817+0000","last_peered":"2024-09-17T02:58:23.007817+0000","last_clean":"2024-09-17T02:58:23.007817+0000","last_became_active":"2024-09-17T02:58:22.012991+0000","last_became_peered":"2024-09-17T02:58:22.012991+0000","last_unstale":"2024-09-17T02:58:23.007817+0000","last_undegraded":"2024-09-17T02:58:23.007817+0000","last_fullsized":"2024-09-17T02:58:23.007817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:56.437825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.025443+0000","last_change":"2024-09-17T02:58:21.003230+0000","last_active":"2024-09-17T02:58:23.025443+0000","last_peered":"2024-09-17T02:58:23.025443+0000","last_clean":"2024-09-17T02:58:23.025443+0000","last_became_active":"2024-09-17T02:58:21.002944+0000","last_became_peered":"2024-09-17T02:58:21.002944+0000","last_unstale":"2024-09-17T02:58:23.025443+0000","last_undegraded":"2024-09-17T02:58:23.025443+0000","last_fullsized":"2024-09-17T02:58:23.025443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:17.772603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182003+0000","last_change":"2024-09-17T02:58:22.018140+0000","last_active":"2024-09-17T02:58:23.182003+0000","last_peered":"2024-09-17T02:58:23.182003+0000","last_clean":"2024-09-17T02:58:23.182003+0000","last_became_active":"2024-09-17T02:58:22.017562+0000","last_became_peered":"2024-09-17T02:58:22.017562+0000","last_unstale":"2024-09-17T02:58:23.182003+0000","last_undegraded":"2024-09-17T02:58:23.182003+0000","last_fullsized":"2024-09-17T02:58:23.182003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:31.607899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.182884+0000","last_change":"2024-09-17T02:58:21.005929+0000","last_active":"2024-09-17T02:58:23.182884+0000","last_peered":"2024-09-17T02:58:23.182884+0000","last_clean":"2024-09-17T02:58:23.182884+0000","last_became_active":"2024-09-17T02:58:21.005655+0000","last_became_peered":"2024-09-17T02:58:21.005655+0000","last_unstale":"2024-09-17T02:58:23.182884+0000","last_undegraded":"2024-09-17T02:58:23.182884+0000","last_fullsized":"2024-09-17T02:58:23.182884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:15.416489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.007864+0000","last_change":"2024-09-17T02:58:22.022109+0000","last_active":"2024-09-17T02:58:23.007864+0000","last_peered":"2024-09-17T02:58:23.007864+0000","last_clean":"2024-09-17T02:58:23.007864+0000","last_became_active":"2024-09-17T02:58:22.021319+0000","last_became_peered":"2024-09-17T02:58:22.021319+0000","last_unstale":"2024-09-17T02:58:23.007864+0000","last_undegraded":"2024-09-17T02:58:23.007864+0000","last_fullsized":"2024-09-17T02:58:23.007864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:48.040337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006834+0000","last_change":"2024-09-17T02:58:21.000999+0000","last_active":"2024-09-17T02:58:23.006834+0000","last_peered":"2024-09-17T02:58:23.006834+0000","last_clean":"2024-09-17T02:58:23.006834+0000","last_became_active":"2024-09-17T02:58:21.000691+0000","last_became_peered":"2024-09-17T02:58:21.000691+0000","last_unstale":"2024-09-17T02:58:23.006834+0000","last_undegraded":"2024-09-17T02:58:23.006834+0000","last_fullsized":"2024-09-17T02:58:23.006834+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:11.987864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.006688+0000","last_change":"2024-09-17T02:58:22.016898+0000","last_active":"2024-09-17T02:58:23.006688+0000","last_peered":"2024-09-17T02:58:23.006688+0000","last_clean":"2024-09-17T02:58:23.006688+0000","last_became_active":"2024-09-17T02:58:22.016639+0000","last_became_peered":"2024-09-17T02:58:22.016639+0000","last_unstale":"2024-09-17T02:58:23.006688+0000","last_undegraded":"2024-09-17T02:58:23.006688+0000","last_fullsized":"2024-09-17T02:58:23.006688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:21.236272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.087712+0000","last_change":"2024-09-17T02:58:21.008825+0000","last_active":"2024-09-17T02:58:23.087712+0000","last_peered":"2024-09-17T02:58:23.087712+0000","last_clean":"2024-09-17T02:58:23.087712+0000","last_became_active":"2024-09-17T02:58:21.008199+0000","last_became_peered":"2024-09-17T02:58:21.008199+0000","last_unstale":"2024-09-17T02:58:23.087712+0000","last_undegraded":"2024-09-17T02:58:23.087712+0000","last_fullsized":"2024-09-17T02:58:23.087712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:12.348885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008458+0000","last_change":"2024-09-17T02:58:22.028722+0000","last_active":"2024-09-17T02:58:23.008458+0000","last_peered":"2024-09-17T02:58:23.008458+0000","last_clean":"2024-09-17T02:58:23.008458+0000","last_became_active":"2024-09-17T02:58:22.027903+0000","last_became_peered":"2024-09-17T02:58:22.027903+0000","last_unstale":"2024-09-17T02:58:23.008458+0000","last_undegraded":"2024-09-17T02:58:23.008458+0000","last_fullsized":"2024-09-17T02:58:23.008458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:59.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008076+0000","last_change":"2024-09-17T02:58:21.008811+0000","last_active":"2024-09-17T02:58:23.008076+0000","last_peered":"2024-09-17T02:58:23.008076+0000","last_clean":"2024-09-17T02:58:23.008076+0000","last_became_active":"2024-09-17T02:58:21.006905+0000","last_became_peered":"2024-09-17T02:58:21.006905+0000","last_unstale":"2024-09-17T02:58:23.008076+0000","last_undegraded":"2024-09-17T02:58:23.008076+0000","last_fullsized":"2024-09-17T02:58:23.008076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:39.037036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.181800+0000","last_change":"2024-09-17T02:58:22.030375+0000","last_active":"2024-09-17T02:58:23.181800+0000","last_peered":"2024-09-17T02:58:23.181800+0000","last_clean":"2024-09-17T02:58:23.181800+0000","last_became_active":"2024-09-17T02:58:22.029856+0000","last_became_peered":"2024-09-17T02:58:22.029856+0000","last_unstale":"2024-09-17T02:58:23.181800+0000","last_undegraded":"2024-09-17T02:58:23.181800+0000","last_fullsized":"2024-09-17T02:58:23.181800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:20.989939+0000","last_clean_scrub_stamp":"2024-09-17T02:58:20.989939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:33.941555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008813+0000","last_change":"2024-09-17T02:58:21.008132+0000","last_active":"2024-09-17T02:58:23.008813+0000","last_peered":"2024-09-17T02:58:23.008813+0000","last_clean":"2024-09-17T02:58:23.008813+0000","last_became_active":"2024-09-17T02:58:21.007404+0000","last_became_peered":"2024-09-17T02:58:21.007404+0000","last_unstale":"2024-09-17T02:58:23.008813+0000","last_undegraded":"2024-09-17T02:58:23.008813+0000","last_fullsized":"2024-09-17T02:58:23.008813+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:58:19.983662+0000","last_clean_scrub_stamp":"2024-09-17T02:58:19.983662+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:32.534951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T02:58:23.008027+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:58:23.008027+0000","last_peered":"2024-09-17T02:58:23.008027+0000","last_clean":"2024-09-17T02:58:23.008027+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:58:23.008027+0000","last_undegraded":"2024-09-17T02:58:23.008027+0000","last_fullsized":"2024-09-17T02:58:23.008027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:58.696508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1004,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194308,"statfs":{"total":200000000,"available":198971473,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199562365,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199562367,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199562387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194885,"statfs":{"total":200000000,"available":199562345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":428,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199560845,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":429,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194883,"statfs":{"total":200000000,"available":199560229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1003,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194308,"statfs":{"total":200000000,"available":198972089,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:58:29.792 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:58:29.792 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T02:58:29.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.950+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3889587228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c00d18e0 msgr2=0x7fc8c00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.950+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3889587228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c00d18e0 0x7fc8c00d34f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8005fd0 tx=0x7fc8b802a8a0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.950+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3889587228 shutdown_connections 2024-09-17T02:58:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.950+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3889587228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c00d18e0 0x7fc8c00d34f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.950+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3889587228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c00b6f70 0x7fc8c015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.950+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3889587228 >> 172.21.15.104:0/3889587228 conn(0x7fc8c0073df0 msgr2=0x7fc8c0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.950+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3889587228 shutdown_connections 2024-09-17T02:58:29.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.950+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3889587228 wait complete. 2024-09-17T02:58:29.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.951+0000 7fc8c6ac5640 1 Processor -- start 2024-09-17T02:58:29.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.951+0000 7fc8c6ac5640 1 -- start start 2024-09-17T02:58:29.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c6ac5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c00b3b00 0x7fc8c0160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:29.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c6ac5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c00b6f70 0x7fc8c00b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c6ac5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8c00d18e0 0x7fc8c00b9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c6ac5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00d3dc0 con 0x7fc8c00d18e0 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c6ac5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00d3c40 con 0x7fc8c00b3b00 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c6ac5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c00d3f40 con 0x7fc8c00b6f70 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c5062640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8c00d18e0 0x7fc8c00b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c5062640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8c00d18e0 0x7fc8c00b9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60972/0 (socket says 172.21.15.104:60972) 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c5062640 1 -- 172.21.15.104:0/3379674531 learned_addr learned my addr 172.21.15.104:0/3379674531 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c4861640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c00b3b00 0x7fc8c0160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8b7fff640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c00b6f70 0x7fc8c00b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c5062640 1 -- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c00b6f70 msgr2=0x7fc8c00b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c5062640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c00b6f70 0x7fc8c00b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c5062640 1 -- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c00b3b00 msgr2=0x7fc8c0160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:29.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c5062640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c00b3b00 0x7fc8c0160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.953+0000 7fc8c5062640 1 -- 172.21.15.104:0/3379674531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c01f9170 con 0x7fc8c00d18e0 2024-09-17T02:58:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.954+0000 7fc8c5062640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8c00d18e0 0x7fc8c00b9820 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc8b802ae90 tx=0x7fc8b8032db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.954+0000 7fc8b57fa640 1 -- 172.21.15.104:0/3379674531 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8041070 con 0x7fc8c00d18e0 2024-09-17T02:58:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.954+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c01f5b60 con 0x7fc8c00d18e0 2024-09-17T02:58:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.954+0000 7fc8b57fa640 1 -- 172.21.15.104:0/3379674531 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8b8004450 con 0x7fc8c00d18e0 2024-09-17T02:58:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.954+0000 7fc8b57fa640 1 -- 172.21.15.104:0/3379674531 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8031430 con 0x7fc8c00d18e0 2024-09-17T02:58:29.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.954+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c01f9920 con 0x7fc8c00d18e0 2024-09-17T02:58:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.955+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c01f93b0 con 0x7fc8c00d18e0 2024-09-17T02:58:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.955+0000 7fc8b57fa640 1 -- 172.21.15.104:0/3379674531 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8b8044070 con 0x7fc8c00d18e0 2024-09-17T02:58:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.956+0000 7fc8b57fa640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8ac078b90 0x7fc8ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.956+0000 7fc8b57fa640 1 -- 172.21.15.104:0/3379674531 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7fc8b802e020 con 0x7fc8c00d18e0 2024-09-17T02:58:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.956+0000 7fc8c4861640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8ac078b90 0x7fc8ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:29.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.957+0000 7fc8c4861640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8ac078b90 0x7fc8ac07b0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0095f0 tx=0x7fc8bc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:29.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:29.960+0000 7fc8b57fa640 1 -- 172.21.15.104:0/3379674531 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8b804b020 con 0x7fc8c00d18e0 2024-09-17T02:58:30.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.207+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc8c00d4460 con 0x7fc8c00d18e0 2024-09-17T02:58:30.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.210+0000 7fc8b57fa640 1 -- 172.21.15.104:0/3379674531 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) ==== 190+0+147 (secure 0 0 0) 0x7fc8b8083da0 con 0x7fc8c00d18e0 2024-09-17T02:58:30.209 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T02:58:30.210 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T02:58:30.210 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T02:58:30.210 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T02:58:30.210 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T02:58:30.210 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T02:58:30.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8ac078b90 msgr2=0x7fc8ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:30.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8ac078b90 0x7fc8ac07b0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0095f0 tx=0x7fc8bc005f90 comp rx=0 tx=0).stop 2024-09-17T02:58:30.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8c00d18e0 msgr2=0x7fc8c00b9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:30.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8c00d18e0 0x7fc8c00b9820 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc8b802ae90 tx=0x7fc8b8032db0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 shutdown_connections 2024-09-17T02:58:30.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc8ac078b90 0x7fc8ac07b0a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8c00d18e0 0x7fc8c00b9820 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c00b6f70 0x7fc8c00b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 --2- 172.21.15.104:0/3379674531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c00b3b00 0x7fc8c0160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 >> 172.21.15.104:0/3379674531 conn(0x7fc8c0073df0 msgr2=0x7fc8c00d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:30.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 shutdown_connections 2024-09-17T02:58:30.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.212+0000 7fc8c6ac5640 1 -- 172.21.15.104:0/3379674531 wait complete. 2024-09-17T02:58:30.223 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:58:30.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.335+0000 7f8268c9b640 1 -- 172.21.15.104:0/2613351725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 msgr2=0x7f8250004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:30.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.335+0000 7f8268c9b640 1 --2- 172.21.15.104:0/2613351725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 0x7f8250004800 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f824c001690 tx=0x7f8250005830 comp rx=0 tx=0).stop 2024-09-17T02:58:30.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.335+0000 7f8262d9d640 1 -- 172.21.15.104:0/2613351725 reap_dead start 2024-09-17T02:58:30.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.335+0000 7f8268c9b640 1 -- 172.21.15.104:0/2613351725 shutdown_connections 2024-09-17T02:58:30.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.335+0000 7f8268c9b640 1 -- 172.21.15.104:0/2613351725 >> 172.21.15.104:0/2613351725 conn(0x7f826406d200 msgr2=0x7f826406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:30.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.335+0000 7f8268c9b640 1 -- 172.21.15.104:0/2613351725 shutdown_connections 2024-09-17T02:58:30.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.335+0000 7f8268c9b640 1 -- 172.21.15.104:0/2613351725 wait complete. 2024-09-17T02:58:30.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.337+0000 7f8268c9b640 1 Processor -- start 2024-09-17T02:58:30.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.338+0000 7f8268c9b640 1 -- start start 2024-09-17T02:58:30.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8268c9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 0x7f8264158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:30.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8268c9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f826415d080 0x7f82640b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:30.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8268c9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f826415d490 0x7f82640b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:30.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8268c9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f826406f550 con 0x7f8250004000 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8268c9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f82640b6250 con 0x7f826415d490 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8268c9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f826406f6d0 con 0x7f826415d080 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 0x7f8264158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 0x7f8264158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60990/0 (socket says 172.21.15.104:60990) 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 -- 172.21.15.104:0/4007016223 learned_addr learned my addr 172.21.15.104:0/4007016223 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8259d9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f826415d080 0x7f82640b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8262d9d640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f826415d490 0x7f82640b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 -- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f826415d080 msgr2=0x7f82640b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f826415d080 0x7f82640b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 -- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f826415d490 msgr2=0x7f82640b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f826415d490 0x7f82640b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 -- 172.21.15.104:0/4007016223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826415fb10 con 0x7f8250004000 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8259d9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f826415d080 0x7f82640b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f8262d9d640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f826415d490 0x7f82640b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.339+0000 7f826259c640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 0x7f8264158b40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8254011a50 tx=0x7f8254011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.340+0000 7f825b7fe640 1 -- 172.21.15.104:0/4007016223 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825401f070 con 0x7f8250004000 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.340+0000 7f825b7fe640 1 -- 172.21.15.104:0/4007016223 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f825400fe80 con 0x7f8250004000 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.340+0000 7f825b7fe640 1 -- 172.21.15.104:0/4007016223 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8254012690 con 0x7f8250004000 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.340+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826415fdf0 con 0x7f8250004000 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.340+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82641603b0 con 0x7f8250004000 2024-09-17T02:58:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.341+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82640b0910 con 0x7f8250004000 2024-09-17T02:58:30.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.341+0000 7f825b7fe640 1 -- 172.21.15.104:0/4007016223 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8254022070 con 0x7f8250004000 2024-09-17T02:58:30.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.342+0000 7f825b7fe640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8244078b90 0x7f824407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:30.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.342+0000 7f825b7fe640 1 -- 172.21.15.104:0/4007016223 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7f825409b880 con 0x7f8250004000 2024-09-17T02:58:30.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.342+0000 7f8259d9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8244078b90 0x7f824407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:30.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.343+0000 7f8259d9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8244078b90 0x7f824407b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f824c032000 tx=0x7f824c001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:30.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.346+0000 7f825b7fe640 1 -- 172.21.15.104:0/4007016223 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8254063630 con 0x7f8250004000 2024-09-17T02:58:30.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.553+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82641605f0 con 0x7f8250004000 2024-09-17T02:58:30.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.553+0000 7f825b7fe640 1 -- 172.21.15.104:0/4007016223 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5234 (secure 0 0 0) 0x7f8254068060 con 0x7f8250004000 2024-09-17T02:58:30.553 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:30.553 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"btime":"2024-09-17T02:58:24:019923+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2179511021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2179511021},{"type":"v1","addr":"172.21.15.192:6836","nonce":2179511021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1325951818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1325951818},{"type":"v1","addr":"172.21.15.192:6837","nonce":1325951818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3545243059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3545243059},{"type":"v1","addr":"172.21.15.104:6834","nonce":3545243059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:58:21.353636+0000","modified":"2024-09-17T02:58:23.373377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/233806124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":233806124},{"type":"v1","addr":"172.21.15.104:6835","nonce":233806124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":5}]} 2024-09-17T02:58:30.553 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 34 2024-09-17T02:58:30.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8244078b90 msgr2=0x7f824407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:30.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8244078b90 0x7f824407b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f824c032000 tx=0x7f824c001190 comp rx=0 tx=0).stop 2024-09-17T02:58:30.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 msgr2=0x7f8264158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:30.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 0x7f8264158b40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8254011a50 tx=0x7f8254011f10 comp rx=0 tx=0).stop 2024-09-17T02:58:30.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 shutdown_connections 2024-09-17T02:58:30.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8244078b90 0x7f824407b0a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f826415d490 0x7f82640b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f826415d080 0x7f82640b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 --2- 172.21.15.104:0/4007016223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8250004000 0x7f8264158b40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:30.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 >> 172.21.15.104:0/4007016223 conn(0x7f826406d200 msgr2=0x7f8264155400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:30.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 shutdown_connections 2024-09-17T02:58:30.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:30.555+0000 7f8268c9b640 1 -- 172.21.15.104:0/4007016223 wait complete. 2024-09-17T02:58:30.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T02:58:21.353636+0000', 'modified': '2024-09-17T02:58:23.373377+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5958}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5958': {'gid': 5958, 'name': 'a', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/233806124', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6833', 'nonce': 233806124}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 233806124}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5958, 'qdb_cluster': [5958]} 2024-09-17T02:58:30.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T02:58:30.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 -- 172.21.15.104:0/3952234058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100d1750 msgr2=0x7f62100d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 --2- 172.21.15.104:0/3952234058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100d1750 0x7f62100d1b60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f6210069c30 tx=0x7f620802a980 comp rx=0 tx=0).stop 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 -- 172.21.15.104:0/3952234058 shutdown_connections 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 --2- 172.21.15.104:0/3952234058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100d1750 0x7f62100d1b60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 --2- 172.21.15.104:0/3952234058 >> v2:172.21.15.192:3300/0 conn(0x7f62100cf8d0 0x7f62100cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 --2- 172.21.15.104:0/3952234058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100ba100 0x7f62100b80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 -- 172.21.15.104:0/3952234058 >> 172.21.15.104:0/3952234058 conn(0x7f6210068ee0 msgr2=0x7f62100692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 -- 172.21.15.104:0/3952234058 shutdown_connections 2024-09-17T02:58:31.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.085+0000 7f621519d640 1 -- 172.21.15.104:0/3952234058 wait complete. 2024-09-17T02:58:31.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.087+0000 7f621519d640 1 Processor -- start 2024-09-17T02:58:31.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.087+0000 7f621519d640 1 -- start start 2024-09-17T02:58:31.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f621519d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100ba100 0x7f62100af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f621519d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100cf8d0 0x7f6210151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f621519d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100d1750 0x7f6210151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f621519d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f62100d3d20 con 0x7f62100cf8d0 2024-09-17T02:58:31.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f621519d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f62100d3ba0 con 0x7f62100ba100 2024-09-17T02:58:31.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f621519d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f62100d3ea0 con 0x7f62100d1750 2024-09-17T02:58:31.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100cf8d0 0x7f6210151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100cf8d0 0x7f6210151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32780/0 (socket says 172.21.15.104:32780) 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f620f7fe640 1 -- 172.21.15.104:0/3212713677 learned_addr learned my addr 172.21.15.104:0/3212713677 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.088+0000 7f620ffff640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100ba100 0x7f62100af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f621499c640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100d1750 0x7f6210151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620f7fe640 1 -- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100d1750 msgr2=0x7f6210151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620f7fe640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100d1750 0x7f6210151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620f7fe640 1 -- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100ba100 msgr2=0x7f62100af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620f7fe640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100ba100 0x7f62100af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620f7fe640 1 -- 172.21.15.104:0/3212713677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100ae430 con 0x7f62100cf8d0 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620ffff640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100ba100 0x7f62100af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620f7fe640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100cf8d0 0x7f6210151680 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f620400d740 tx=0x7f620400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620cff9640 1 -- 172.21.15.104:0/3212713677 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204017070 con 0x7f62100cf8d0 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620cff9640 1 -- 172.21.15.104:0/3212713677 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6204009d20 con 0x7f62100cf8d0 2024-09-17T02:58:31.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f620cff9640 1 -- 172.21.15.104:0/3212713677 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040106c0 con 0x7f62100cf8d0 2024-09-17T02:58:31.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f621519d640 1 -- 172.21.15.104:0/3212713677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62100ae710 con 0x7f62100cf8d0 2024-09-17T02:58:31.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.089+0000 7f621519d640 1 -- 172.21.15.104:0/3212713677 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62100aecd0 con 0x7f62100cf8d0 2024-09-17T02:58:31.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.091+0000 7f620cff9640 1 -- 172.21.15.104:0/3212713677 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f620401a070 con 0x7f62100cf8d0 2024-09-17T02:58:31.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.091+0000 7f620cff9640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61fc078b90 0x7f61fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.092+0000 7f620cff9640 1 -- 172.21.15.104:0/3212713677 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7f620409ad80 con 0x7f62100cf8d0 2024-09-17T02:58:31.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.092+0000 7f620ffff640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61fc078b90 0x7f61fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.092+0000 7f621d445740 1 Processor -- start 2024-09-17T02:58:31.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.092+0000 7f621d445740 1 -- start start 2024-09-17T02:58:31.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.092+0000 7f620ffff640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61fc078b90 0x7f61fc07b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6200005fd0 tx=0x7f620000f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621d445740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 0x561fa5e75170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621d445740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a7a3b0 0x561fa5e756b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621d445740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621d445740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561fa5dbd820 con 0x561fa5a82590 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621d445740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561fa5dacc50 con 0x561fa5a7a3b0 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621d445740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x561fa5db0a60 con 0x561fa5aa3270 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e925b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32788/0 (socket says 172.21.15.104:32788) 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 -- 172.21.15.104:0/93427161 learned_addr learned my addr 172.21.15.104:0/93427161 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f620ffff640 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 0x561fa5e75170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f620f7fe640 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a7a3b0 0x561fa5e756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 -- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 msgr2=0x561fa5e75170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 0x561fa5e75170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 -- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a7a3b0 msgr2=0x561fa5e756b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a7a3b0 0x561fa5e756b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 -- 172.21.15.104:0/93427161 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa5b0e850 con 0x561fa5a82590 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f620f7fe640 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a7a3b0 0x561fa5e756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f621499c640 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e925b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6208033040 tx=0x7f6208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d8d4745b6612bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f61f5ffb640 1 -- 172.21.15.104:0/93427161 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208048070 con 0x561fa5a82590 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f61f5ffb640 1 -- 172.21.15.104:0/93427161 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6208030a30 con 0x561fa5a82590 2024-09-17T02:58:31.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.094+0000 7f61f5ffb640 1 -- 172.21.15.104:0/93427161 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208034040 con 0x561fa5a82590 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 -- 172.21.15.104:0/93427161 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 msgr2=0x561fa5e925b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e925b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6208033040 tx=0x7f6208004a40 comp rx=0 tx=0).stop 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 -- 172.21.15.104:0/93427161 shutdown_connections 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a7a3b0 0x561fa5e756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e925b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 --2- 172.21.15.104:0/93427161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 0x561fa5e75170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 -- 172.21.15.104:0/93427161 >> 172.21.15.104:0/93427161 conn(0x561fa5a973c0 msgr2=0x561fa5e4b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 -- 172.21.15.104:0/93427161 shutdown_connections 2024-09-17T02:58:31.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.095+0000 7f621d445740 1 -- 172.21.15.104:0/93427161 wait complete. 2024-09-17T02:58:31.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.096+0000 7f621d445740 1 -- start start 2024-09-17T02:58:31.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.096+0000 7f621d445740 1 Processor -- start 2024-09-17T02:58:31.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 0x561fa5e923f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e92930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5aa3270 0x561fa5e9fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561fa5b1d620 con 0x561fa5a82590 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561fa5d525f0 con 0x561fa5aa3270 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x561fa5e75bf0 con 0x561fa5a7a3b0 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 10 client.0 _ll_register_callbacks cb 0x561fa5d560a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e92930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e92930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32798/0 (socket says 172.21.15.104:32798) 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 -- 172.21.15.104:0/1241163082 learned_addr learned my addr 172.21.15.104:0/1241163082 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620ffff640 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 0x561fa5e923f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621499c640 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5aa3270 0x561fa5e9fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 -- 172.21.15.104:0/1241163082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 msgr2=0x561fa5e923f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 0x561fa5e923f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 -- 172.21.15.104:0/1241163082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5aa3270 msgr2=0x561fa5e9fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5aa3270 0x561fa5e9fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 -- 172.21.15.104:0/1241163082 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa5b856b0 con 0x561fa5a82590 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f620f7fe640 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e92930 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f620405feb0 tx=0x7f62040623b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9008f0763919c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f61eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f61eeffd640 1 -- 172.21.15.104:0/1241163082 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204021030 con 0x561fa5a82590 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f61eeffd640 1 -- 172.21.15.104:0/1241163082 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7f6204067100 con 0x561fa5a82590 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 1 -- 172.21.15.104:0/1241163082 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6208030a30 con 0x561fa5a82590 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f61eeffd640 1 -- 172.21.15.104:0/1241163082 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f620404e1b0 con 0x561fa5a82590 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 10 client.6111 fetch_fsmap learned FSMap version 34 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.098+0000 7f621d445740 1 -- 172.21.15.104:0/1241163082 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x561fa5e9f7e0 con 0x561fa5a82590 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f61eeffd640 1 -- 172.21.15.104:0/1241163082 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6208030a30 con 0x561fa5a82590 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f61eeffd640 1 -- 172.21.15.104:0/1241163082 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7f620405e590 con 0x561fa5a82590 2024-09-17T02:58:31.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f621d445740 10 client.6111 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f621d445740 10 client.6111 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f621d445740 20 client.6111 populate_metadata read hostname 'smithi104' 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f621d445740 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] conn(0x561fa5a61e40 0x561fa5ea2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f621d445740 4 client.6111 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f621d445740 1 -- 172.21.15.104:0/1241163082 --> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fa5dbf770 con 0x561fa5a61e40 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f620ffff640 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] conn(0x561fa5a61e40 0x561fa5ea2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f61eeffd640 10 client.6111 ms_handle_connect on v2:172.21.15.104:6833/233806124 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.099+0000 7f620ffff640 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] conn(0x561fa5a61e40 0x561fa5ea2550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adb113d7d25a03cb server_cookie=6be84bc10feb5fb8 in_seq=0 out_seq=0 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f61eeffd640 1 -- 172.21.15.104:0/1241163082 <== mds.0 v2:172.21.15.104:6833/233806124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561fa5dbf770 con 0x561fa5a61e40 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f61eeffd640 10 client.6111 handle_command_reply: tid=0 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 client.6111 shutdown 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 -- 172.21.15.104:0/1241163082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 msgr2=0x561fa5e92930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e92930 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f620405feb0 tx=0x7f62040623b0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 -- 172.21.15.104:0/1241163082 shutdown_connections 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] conn(0x561fa5a61e40 0x561fa5ea2550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5aa3270 0x561fa5e9fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f61eeffd640 0 client.6111 ms_handle_reset on v2:172.21.15.104:6833/233806124 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a82590 0x561fa5e92930 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 --2- 172.21.15.104:0/1241163082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 0x561fa5e923f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 -- 172.21.15.104:0/1241163082 >> 172.21.15.104:0/1241163082 conn(0x561fa5a973c0 msgr2=0x561fa5e45ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 -- 172.21.15.104:0/1241163082 shutdown_connections 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.100+0000 7f621d445740 1 -- 172.21.15.104:0/1241163082 wait complete. 2024-09-17T02:58:31.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.101+0000 7f621d445740 20 client.6111 trim_cache size 0 max 16384 2024-09-17T02:58:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.118+0000 7f621d445740 1 Processor -- start 2024-09-17T02:58:31.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.119+0000 7f621d445740 1 -- start start 2024-09-17T02:58:31.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f621d445740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a7a3b0 0x561fa5e44950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f621d445740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 0x561fa5eb2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f621d445740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 0x561fa5eb2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f621d445740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6210202520 con 0x561fa5a7a3b0 2024-09-17T02:58:31.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f621d445740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f62102015e0 con 0x561fa5a82590 2024-09-17T02:58:31.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f621d445740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f621006e620 con 0x561fa5aa3270 2024-09-17T02:58:31.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a7a3b0 0x561fa5e44950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a7a3b0 0x561fa5e44950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32812/0 (socket says 172.21.15.104:32812) 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 -- 172.21.15.104:0/3684191003 learned_addr learned my addr 172.21.15.104:0/3684191003 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 -- 172.21.15.104:0/3684191003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 msgr2=0x561fa5eb2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 --2- 172.21.15.104:0/3684191003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 0x561fa5eb2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 -- 172.21.15.104:0/3684191003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 msgr2=0x561fa5eb2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 --2- 172.21.15.104:0/3684191003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 0x561fa5eb2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 -- 172.21.15.104:0/3684191003 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa5e9ec70 con 0x561fa5a7a3b0 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f620ffff640 1 --2- 172.21.15.104:0/3684191003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a7a3b0 0x561fa5e44950 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6200011600 tx=0x7f6200012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa70e5610a05ad0f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f61f57fa640 1 -- 172.21.15.104:0/3684191003 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200021190 con 0x561fa5a7a3b0 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f61f57fa640 1 -- 172.21.15.104:0/3684191003 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6200021510 con 0x561fa5a7a3b0 2024-09-17T02:58:31.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.120+0000 7f61f57fa640 1 -- 172.21.15.104:0/3684191003 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200021960 con 0x561fa5a7a3b0 2024-09-17T02:58:31.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 -- 172.21.15.104:0/3684191003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a7a3b0 msgr2=0x561fa5e44950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 --2- 172.21.15.104:0/3684191003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a7a3b0 0x561fa5e44950 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6200011600 tx=0x7f6200012000 comp rx=0 tx=0).stop 2024-09-17T02:58:31.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 -- 172.21.15.104:0/3684191003 shutdown_connections 2024-09-17T02:58:31.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 --2- 172.21.15.104:0/3684191003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 0x561fa5eb2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 --2- 172.21.15.104:0/3684191003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5aa3270 0x561fa5eb2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 --2- 172.21.15.104:0/3684191003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5a7a3b0 0x561fa5e44950 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 -- 172.21.15.104:0/3684191003 >> 172.21.15.104:0/3684191003 conn(0x561fa5a973c0 msgr2=0x561fa5e640a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:31.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 -- 172.21.15.104:0/3684191003 shutdown_connections 2024-09-17T02:58:31.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.121+0000 7f621d445740 1 -- 172.21.15.104:0/3684191003 wait complete. 2024-09-17T02:58:31.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.122+0000 7f621d445740 1 -- start start 2024-09-17T02:58:31.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.122+0000 7f621d445740 1 Processor -- start 2024-09-17T02:58:31.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621d445740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 0x561fa5ea8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621d445740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 0x561fa5e91c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621d445740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5aa3270 0x561fa5e921b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621d445740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561fa5e88ca0 con 0x561fa5aa3270 2024-09-17T02:58:31.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621d445740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6210154ae0 con 0x561fa5a82590 2024-09-17T02:58:31.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621d445740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x561fa5e63db0 con 0x561fa5a7a3b0 2024-09-17T02:58:31.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621d445740 10 client.0 _ll_register_callbacks cb 0x7f620400b5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5aa3270 0x561fa5e921b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5aa3270 0x561fa5e921b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32818/0 (socket says 172.21.15.104:32818) 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 -- 172.21.15.104:0/679089516 learned_addr learned my addr 172.21.15.104:0/679089516 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f620f7fe640 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 0x561fa5e91c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f620ffff640 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 0x561fa5ea8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 -- 172.21.15.104:0/679089516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 msgr2=0x561fa5ea8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 0x561fa5ea8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 -- 172.21.15.104:0/679089516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 msgr2=0x561fa5e91c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 0x561fa5e91c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 -- 172.21.15.104:0/679089516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa5e92a10 con 0x561fa5aa3270 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621499c640 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5aa3270 0x561fa5e921b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d60 tx=0x7f6208003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516f5eba87ac2b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f61eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:58:31.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f61eeffd640 1 -- 172.21.15.104:0/679089516 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208048070 con 0x561fa5aa3270 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f61eeffd640 1 -- 172.21.15.104:0/679089516 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7f6208030680 con 0x561fa5aa3270 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.124+0000 7f621d445740 1 -- 172.21.15.104:0/679089516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6200021510 con 0x561fa5aa3270 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f61eeffd640 1 -- 172.21.15.104:0/679089516 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6208034040 con 0x561fa5aa3270 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f621d445740 10 client.6117 fetch_fsmap learned FSMap version 34 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f621d445740 1 -- 172.21.15.104:0/679089516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x561fa5f0edc0 con 0x561fa5aa3270 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f61eeffd640 1 -- 172.21.15.104:0/679089516 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6200021510 con 0x561fa5aa3270 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f61eeffd640 1 -- 172.21.15.104:0/679089516 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 34) ==== 3502+0+0 (secure 0 0 0) 0x7f6208004040 con 0x561fa5aa3270 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f621d445740 10 client.6117 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f621d445740 10 client.6117 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f621d445740 20 client.6117 populate_metadata read hostname 'smithi104' 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f621d445740 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] conn(0x561fa5f12d90 0x561fa5e648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f621d445740 4 client.6117 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T02:58:31.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f621d445740 1 -- 172.21.15.104:0/679089516 --> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] -- command(tid 0: {"prefix": "status"}) -- 0x561fa5dbb220 con 0x561fa5f12d90 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f620ffff640 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] conn(0x561fa5f12d90 0x561fa5e648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.125+0000 7f61eeffd640 10 client.6117 ms_handle_connect on v2:172.21.15.104:6833/233806124 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f620ffff640 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] conn(0x561fa5f12d90 0x561fa5e648c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3b0bb0aa0e5a65 server_cookie=5519235b765d68d6 in_seq=0 out_seq=0 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f61eeffd640 1 -- 172.21.15.104:0/679089516 <== mds.0 v2:172.21.15.104:6833/233806124 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x561fa5dbb220 con 0x561fa5f12d90 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f61eeffd640 10 client.6117 handle_command_reply: tid=0 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 client.6117 shutdown 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 -- 172.21.15.104:0/679089516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5aa3270 msgr2=0x561fa5e921b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5aa3270 0x561fa5e921b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6208009d60 tx=0x7f6208003ba0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 -- 172.21.15.104:0/679089516 shutdown_connections 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.104:6833/233806124,v1:172.21.15.104:6835/233806124] conn(0x561fa5f12d90 0x561fa5e648c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561fa5a82590 0x561fa5e91c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f61eeffd640 0 client.6117 ms_handle_reset on v2:172.21.15.104:6833/233806124 2024-09-17T02:58:31.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561fa5aa3270 0x561fa5e921b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 --2- 172.21.15.104:0/679089516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561fa5a7a3b0 0x561fa5ea8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 -- 172.21.15.104:0/679089516 >> 172.21.15.104:0/679089516 conn(0x561fa5a973c0 msgr2=0x561fa5e63f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 -- 172.21.15.104:0/679089516 shutdown_connections 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 1 -- 172.21.15.104:0/679089516 wait complete. 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.126+0000 7f621d445740 20 client.6117 trim_cache size 0 max 16384 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 5958, 2024-09-17T02:58:31.131 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T02:58:31.132 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T02:58:31.132 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T02:58:31.132 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.1112727420000006, 2024-09-17T02:58:31.132 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 34, 2024-09-17T02:58:31.132 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 85, 2024-09-17T02:58:31.132 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 83, 2024-09-17T02:58:31.132 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 13.692155604 2024-09-17T02:58:31.132 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:58:31.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 -- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61fc078b90 msgr2=0x7f61fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61fc078b90 0x7f61fc07b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6200005fd0 tx=0x7f620000f360 comp rx=0 tx=0).stop 2024-09-17T02:58:31.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 -- 172.21.15.104:0/3212713677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100cf8d0 msgr2=0x7f6210151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100cf8d0 0x7f6210151680 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f620400d740 tx=0x7f620400dc00 comp rx=0 tx=0).stop 2024-09-17T02:58:31.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 -- 172.21.15.104:0/3212713677 shutdown_connections 2024-09-17T02:58:31.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61fc078b90 0x7f61fc07b0a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62100d1750 0x7f6210151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62100cf8d0 0x7f6210151680 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 --2- 172.21.15.104:0/3212713677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62100ba100 0x7f62100af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 -- 172.21.15.104:0/3212713677 >> 172.21.15.104:0/3212713677 conn(0x7f6210068ee0 msgr2=0x7f62100cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:31.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 -- 172.21.15.104:0/3212713677 shutdown_connections 2024-09-17T02:58:31.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.127+0000 7f621519d640 1 -- 172.21.15.104:0/3212713677 wait complete. 2024-09-17T02:58:31.137 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:58:31.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.249+0000 7f75ed81d640 1 -- 172.21.15.104:0/3325866129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75d4004d40 msgr2=0x7f75d4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.249+0000 7f75ed81d640 1 --2- 172.21.15.104:0/3325866129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75d4004d40 0x7f75d4005190 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009e20 tx=0x7f75d4005830 comp rx=0 tx=0).stop 2024-09-17T02:58:31.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.249+0000 7f75e77fe640 1 -- 172.21.15.104:0/3325866129 reap_dead start 2024-09-17T02:58:31.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.249+0000 7f75ed81d640 1 -- 172.21.15.104:0/3325866129 shutdown_connections 2024-09-17T02:58:31.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.249+0000 7f75ed81d640 1 -- 172.21.15.104:0/3325866129 >> 172.21.15.104:0/3325866129 conn(0x7f75e8073df0 msgr2=0x7f75e8068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:31.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.249+0000 7f75ed81d640 1 -- 172.21.15.104:0/3325866129 shutdown_connections 2024-09-17T02:58:31.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.249+0000 7f75ed81d640 1 -- 172.21.15.104:0/3325866129 wait complete. 2024-09-17T02:58:31.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.251+0000 7f75ed81d640 1 Processor -- start 2024-09-17T02:58:31.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.251+0000 7f75ed81d640 1 -- start start 2024-09-17T02:58:31.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75ed81d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75d4004d40 0x7f75e80cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75ed81d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e80cec00 0x7f75e81f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75ed81d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e815b0e0 0x7f75e81f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75ed81d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f75e80d3880 con 0x7f75e815b0e0 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75ed81d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f75e80d3700 con 0x7f75e80cec00 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75ed81d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f75e80d3a00 con 0x7f75d4004d40 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e815b0e0 0x7f75e81f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e815b0e0 0x7f75e81f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32832/0 (socket says 172.21.15.104:32832) 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 -- 172.21.15.104:0/4156992264 learned_addr learned my addr 172.21.15.104:0/4156992264 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 -- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75d4004d40 msgr2=0x7f75e80cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75d4004d40 0x7f75e80cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 -- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e80cec00 msgr2=0x7f75e81f9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e80cec00 0x7f75e81f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 -- 172.21.15.104:0/4156992264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e80cc640 con 0x7f75e815b0e0 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e77fe640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e815b0e0 0x7f75e81f5b50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f75e0036040 tx=0x7f75e0034680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e4ff9640 1 -- 172.21.15.104:0/4156992264 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0043070 con 0x7f75e815b0e0 2024-09-17T02:58:31.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e4ff9640 1 -- 172.21.15.104:0/4156992264 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75e0003970 con 0x7f75e815b0e0 2024-09-17T02:58:31.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e80cc8e0 con 0x7f75e815b0e0 2024-09-17T02:58:31.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75e4ff9640 1 -- 172.21.15.104:0/4156992264 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0038040 con 0x7f75e815b0e0 2024-09-17T02:58:31.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.253+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e81f95c0 con 0x7f75e815b0e0 2024-09-17T02:58:31.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.254+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e815ef90 con 0x7f75e815b0e0 2024-09-17T02:58:31.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.255+0000 7f75e4ff9640 1 -- 172.21.15.104:0/4156992264 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75e0046070 con 0x7f75e815b0e0 2024-09-17T02:58:31.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.256+0000 7f75e4ff9640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f75c8078b90 0x7f75c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:31.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.256+0000 7f75e4ff9640 1 -- 172.21.15.104:0/4156992264 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7f75e00ba8f0 con 0x7f75e815b0e0 2024-09-17T02:58:31.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.256+0000 7f75e6ffd640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f75c8078b90 0x7f75c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:31.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.257+0000 7f75e6ffd640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f75c8078b90 0x7f75c807b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f75d80058c0 tx=0x7f75d8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:31.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.260+0000 7f75e4ff9640 1 -- 172.21.15.104:0/4156992264 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75e00826a0 con 0x7f75e815b0e0 2024-09-17T02:58:31.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.471+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f75e80cf800 con 0x7f75e815b0e0 2024-09-17T02:58:31.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.471+0000 7f75e4ff9640 1 -- 172.21.15.104:0/4156992264 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7f75e00870d0 con 0x7f75e815b0e0 2024-09-17T02:58:31.471 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:58:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f75c8078b90 msgr2=0x7f75c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f75c8078b90 0x7f75c807b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f75d80058c0 tx=0x7f75d8005850 comp rx=0 tx=0).stop 2024-09-17T02:58:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e815b0e0 msgr2=0x7f75e81f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e815b0e0 0x7f75e81f5b50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f75e0036040 tx=0x7f75e0034680 comp rx=0 tx=0).stop 2024-09-17T02:58:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 shutdown_connections 2024-09-17T02:58:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f75c8078b90 0x7f75c807b0a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75e80cec00 0x7f75e81f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75e815b0e0 0x7f75e81f5b50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 --2- 172.21.15.104:0/4156992264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75d4004d40 0x7f75e80cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 >> 172.21.15.104:0/4156992264 conn(0x7f75e8073df0 msgr2=0x7f75e80b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 shutdown_connections 2024-09-17T02:58:31.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31.473+0000 7f75ed81d640 1 -- 172.21.15.104:0/4156992264 wait complete. 2024-09-17T02:58:31.484 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:58:31.484 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:58:31.484 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T02:58:31.484 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T02:58:31.484 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T02:58:31.484 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:58:31.485 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:58:31.485 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:58:31.485 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:58:31.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:31.485 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T02:58:31.501 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:58:31.501 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:58:31.501 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:58:31.501 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:31.501 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:58:31.501 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:31.501 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:58:31.501 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42587sec preferred_lft 42587sec 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:58:31.502 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T02:58:31.503 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:31.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:31.504 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:58:31.565 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T02:58:31.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:31.566 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T02:58:31.622 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T02:58:31.622 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:58:31.622 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:58:31.623 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:58:31.623 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:58:31.623 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:58:31.623 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:58:31.623 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:58:31.623 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:58:31.623 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:58:31.623 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:58:31.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:58:31.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:58:31.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:31.748 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:58:31.763 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T02:58:31.763 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T02:58:31.764 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:58:31.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:31.764 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T02:58:31.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:58:31.829 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T02:58:31.885 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:58:31.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:58:31.885 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:58:31.940 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:58:31.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:31.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:58:32.035 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:58:32.035 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:58:32.035 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:58:32.047 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:58:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:58:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:58:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:58:32.048 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:58:32.050 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:58:32.050 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:58:32.051 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:58:32.051 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:58:32.051 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:58:32.051 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:58:32.051 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:58:32.051 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:58:32.051 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T02:58:32.051 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:58:32.052 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:58:32.052 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:58:32.052 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:58:32.053 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:58:32.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:32.053 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:58:32.078 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:58:32.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:58:32.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:58:32.181 INFO:teuthology.orchestra.run.smithi104.stdout:client5378 2024-09-17T02:58:32.182 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:58:32.182 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:32.198 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:58:32.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.352+0000 7fc10cf13640 1 -- 172.21.15.104:0/1528113803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc10815c220 msgr2=0x7fc10806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:32.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.352+0000 7fc10cf13640 1 --2- 172.21.15.104:0/1528113803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc10815c220 0x7fc10806f550 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc1080ce050 tx=0x7fc0f802a560 comp rx=0 tx=0).stop 2024-09-17T02:58:32.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.352+0000 7fc10cf13640 1 -- 172.21.15.104:0/1528113803 shutdown_connections 2024-09-17T02:58:32.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.352+0000 7fc10cf13640 1 --2- 172.21.15.104:0/1528113803 >> v2:172.21.15.192:3300/0 conn(0x7fc1080734f0 0x7fc108073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.352+0000 7fc10cf13640 1 --2- 172.21.15.104:0/1528113803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc10815c220 0x7fc10806f550 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.352+0000 7fc10cf13640 1 -- 172.21.15.104:0/1528113803 >> 172.21.15.104:0/1528113803 conn(0x7fc10806d200 msgr2=0x7fc10806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:32.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.352+0000 7fc10cf13640 1 -- 172.21.15.104:0/1528113803 shutdown_connections 2024-09-17T02:58:32.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.352+0000 7fc10cf13640 1 -- 172.21.15.104:0/1528113803 wait complete. 2024-09-17T02:58:32.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.354+0000 7fc10cf13640 1 Processor -- start 2024-09-17T02:58:32.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.354+0000 7fc10cf13640 1 -- start start 2024-09-17T02:58:32.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10cf13640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1080734f0 0x7fc1081411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10cf13640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1080b0500 0x7fc1080ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10cf13640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc10815c220 0x7fc1081fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10cf13640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080b4f20 con 0x7fc1080734f0 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10cf13640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc1080b1230 con 0x7fc10815c220 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10cf13640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc1080b50a0 con 0x7fc1080b0500 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1080734f0 0x7fc1081411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1080734f0 0x7fc1081411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32846/0 (socket says 172.21.15.104:32846) 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc10659c640 1 -- 172.21.15.104:0/2576285817 learned_addr learned my addr 172.21.15.104:0/2576285817 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc0fdd9b640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1080b0500 0x7fc1080ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:32.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.355+0000 7fc106d9d640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc10815c220 0x7fc1081fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc10659c640 1 -- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1080b0500 msgr2=0x7fc1080ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc10659c640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1080b0500 0x7fc1080ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc10659c640 1 -- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc10815c220 msgr2=0x7fc1081fa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc10659c640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc10815c220 0x7fc1081fa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc10659c640 1 -- 172.21.15.104:0/2576285817 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc108141ad0 con 0x7fc1080734f0 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc10659c640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1080734f0 0x7fc1081411d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8034040 tx=0x7fc0f80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc0ff7fe640 1 -- 172.21.15.104:0/2576285817 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f803e030 con 0x7fc1080734f0 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc0ff7fe640 1 -- 172.21.15.104:0/2576285817 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0f80047a0 con 0x7fc1080734f0 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc108141db0 con 0x7fc1080734f0 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc0ff7fe640 1 -- 172.21.15.104:0/2576285817 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8035040 con 0x7fc1080734f0 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.356+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1081f9930 con 0x7fc1080734f0 2024-09-17T02:58:32.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.357+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc108160620 con 0x7fc1080734f0 2024-09-17T02:58:32.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.358+0000 7fc0ff7fe640 1 -- 172.21.15.104:0/2576285817 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0f8041030 con 0x7fc1080734f0 2024-09-17T02:58:32.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.358+0000 7fc0ff7fe640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0e8078b90 0x7fc0e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:32.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.358+0000 7fc0ff7fe640 1 -- 172.21.15.104:0/2576285817 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7fc0f80bb5e0 con 0x7fc1080734f0 2024-09-17T02:58:32.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.358+0000 7fc0fdd9b640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0e8078b90 0x7fc0e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:32.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.359+0000 7fc0fdd9b640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0e8078b90 0x7fc0e807b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc1080b33f0 tx=0x7fc0f0005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:32.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.362+0000 7fc0ff7fe640 1 -- 172.21.15.104:0/2576285817 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc108073e40 con 0x7fc1080734f0 2024-09-17T02:58:32.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.571+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc108070810 con 0x7fc1080734f0 2024-09-17T02:58:32.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.572+0000 7fc0ff7fe640 1 -- 172.21.15.104:0/2576285817 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7fc0f8083390 con 0x7fc1080734f0 2024-09-17T02:58:32.572 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0e8078b90 msgr2=0x7fc0e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0e8078b90 0x7fc0e807b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc1080b33f0 tx=0x7fc0f0005f60 comp rx=0 tx=0).stop 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1080734f0 msgr2=0x7fc1081411d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1080734f0 0x7fc1081411d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8034040 tx=0x7fc0f80039e0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 shutdown_connections 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc0e8078b90 0x7fc0e807b0a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc10815c220 0x7fc1081fa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1080b0500 0x7fc1080ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 --2- 172.21.15.104:0/2576285817 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1080734f0 0x7fc1081411d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:32.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 >> 172.21.15.104:0/2576285817 conn(0x7fc10806d200 msgr2=0x7fc1080d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:32.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 shutdown_connections 2024-09-17T02:58:32.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:32.574+0000 7fc10cf13640 1 -- 172.21.15.104:0/2576285817 wait complete. 2024-09-17T02:58:32.585 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:58:32.585 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:58:32.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T02:58:32.585 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T02:58:32.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T02:58:32.585 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:58:32.586 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:58:32.586 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:58:32.586 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:58:32.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:32.586 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T02:58:32.606 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:58:32.606 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:58:32.606 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:58:32.607 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42582sec preferred_lft 42582sec 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T02:58:32.608 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T02:58:32.609 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:32.609 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:58:32.609 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T02:58:32.609 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T02:58:32.609 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:58:32.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:32.609 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:58:32.675 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T02:58:32.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:32.677 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T02:58:32.736 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T02:58:32.737 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:58:32.737 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:58:32.737 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:58:32.737 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:58:32.737 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:58:32.737 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:58:32.737 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:58:32.737 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:58:32.738 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:58:32.738 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:58:32.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:58:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:58:32.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:58:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:58:32.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:32.871 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:58:32.886 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T02:58:32.887 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T02:58:32.887 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:58:32.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:32.887 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T02:58:32.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:58:32.953 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T02:58:33.008 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:58:33.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:58:33.009 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:58:33.064 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:58:33.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:33.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:58:33.158 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:58:33.159 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:58:33.159 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:58:33.170 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:58:33.170 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:58:33.170 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:58:33.170 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:58:33.170 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:58:33.175 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:58:33.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:58:33.175 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:58:33.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:58:33.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:58:33.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:58:33.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:58:33.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:58:33.176 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T02:58:33.176 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:58:33.176 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:58:33.176 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:58:33.176 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:58:33.177 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:58:33.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:58:33.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:58:33.201 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:58:33.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:58:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:58:33.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:58:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:58:33.298 INFO:teuthology.orchestra.run.smithi192.stdout:client5384 2024-09-17T02:58:33.299 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:58:33.299 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:58:33.315 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:58:33.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.432+0000 7f0bcd77b640 1 -- 172.21.15.104:0/814737365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb0003a50 msgr2=0x7f0bb0003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:33.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.432+0000 7f0bcd77b640 1 --2- 172.21.15.104:0/814737365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb0003a50 0x7f0bb0003ee0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c260 tx=0x7f0bb0005830 comp rx=0 tx=0).stop 2024-09-17T02:58:33.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.433+0000 7f0bcd77b640 1 -- 172.21.15.104:0/814737365 shutdown_connections 2024-09-17T02:58:33.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.433+0000 7f0bcd77b640 1 --2- 172.21.15.104:0/814737365 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb0003a50 0x7f0bb0003ee0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:33.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.433+0000 7f0bcd77b640 1 -- 172.21.15.104:0/814737365 >> 172.21.15.104:0/814737365 conn(0x7f0bc8069120 msgr2=0x7f0bc8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:33.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.433+0000 7f0bcd77b640 1 -- 172.21.15.104:0/814737365 shutdown_connections 2024-09-17T02:58:33.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.433+0000 7f0bcd77b640 1 -- 172.21.15.104:0/814737365 wait complete. 2024-09-17T02:58:33.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.434+0000 7f0bcd77b640 1 Processor -- start 2024-09-17T02:58:33.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.434+0000 7f0bcd77b640 1 -- start start 2024-09-17T02:58:33.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bcd77b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb0003a50 0x7f0bc81f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:33.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bcd77b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bc8154210 0x7f0bc80cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:33.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bcd77b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bc8154620 0x7f0bc80cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:33.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bcd77b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc80b69f0 con 0x7f0bc8154620 2024-09-17T02:58:33.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bcd77b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc815fa90 con 0x7f0bb0003a50 2024-09-17T02:58:33.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bcd77b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc80b6b70 con 0x7f0bc8154210 2024-09-17T02:58:33.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bc8154620 0x7f0bc80cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:33.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bc8154620 0x7f0bc80cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:32864/0 (socket says 172.21.15.104:32864) 2024-09-17T02:58:33.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 -- 172.21.15.104:0/3498474569 learned_addr learned my addr 172.21.15.104:0/3498474569 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:58:33.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc6ffd640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb0003a50 0x7f0bc81f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:33.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc67fc640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bc8154210 0x7f0bc80cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:33.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 -- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bc8154210 msgr2=0x7f0bc80cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:33.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bc8154210 0x7f0bc80cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:33.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 -- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb0003a50 msgr2=0x7f0bc81f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:33.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb0003a50 0x7f0bc81f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:33.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 -- 172.21.15.104:0/3498474569 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc8155f10 con 0x7f0bc8154620 2024-09-17T02:58:33.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0bc77fe640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bc8154620 0x7f0bc80cd620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80b7bb0 tx=0x7f0bc000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:33.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.436+0000 7f0baf7fe640 1 -- 172.21.15.104:0/3498474569 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000eea0 con 0x7f0bc8154620 2024-09-17T02:58:33.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.437+0000 7f0baf7fe640 1 -- 172.21.15.104:0/3498474569 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bc0015070 con 0x7f0bc8154620 2024-09-17T02:58:33.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.437+0000 7f0baf7fe640 1 -- 172.21.15.104:0/3498474569 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0010e90 con 0x7f0bc8154620 2024-09-17T02:58:33.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.437+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc815a8c0 con 0x7f0bc8154620 2024-09-17T02:58:33.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.437+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc815ab80 con 0x7f0bc8154620 2024-09-17T02:58:33.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.437+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc8158690 con 0x7f0bc8154620 2024-09-17T02:58:33.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.438+0000 7f0baf7fe640 1 -- 172.21.15.104:0/3498474569 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bc0004030 con 0x7f0bc8154620 2024-09-17T02:58:33.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.439+0000 7f0baf7fe640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bb4078d60 0x7f0bb407b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:58:33.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.439+0000 7f0baf7fe640 1 -- 172.21.15.104:0/3498474569 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5767+0+0 (secure 0 0 0) 0x7f0bc009b8e0 con 0x7f0bc8154620 2024-09-17T02:58:33.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.439+0000 7f0bc6ffd640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bb4078d60 0x7f0bb407b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:58:33.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.439+0000 7f0bc6ffd640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bb4078d60 0x7f0bb407b270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8033000 tx=0x7f0bc8160730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:58:33.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.443+0000 7f0baf7fe640 1 -- 172.21.15.104:0/3498474569 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0bc0063720 con 0x7f0bc8154620 2024-09-17T02:58:33.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.653+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bc80b7e80 con 0x7f0bc8154620 2024-09-17T02:58:33.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.654+0000 7f0baf7fe640 1 -- 172.21.15.104:0/3498474569 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5234 (secure 0 0 0) 0x7f0bc80b7e80 con 0x7f0bc8154620 2024-09-17T02:58:33.653 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:58:33.653 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"btime":"2024-09-17T02:58:24:019923+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2179511021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2179511021},{"type":"v1","addr":"172.21.15.192:6836","nonce":2179511021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1325951818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1325951818},{"type":"v1","addr":"172.21.15.192:6837","nonce":1325951818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3545243059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3545243059},{"type":"v1","addr":"172.21.15.104:6834","nonce":3545243059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:58:21.353636+0000","modified":"2024-09-17T02:58:23.373377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/233806124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":233806124},{"type":"v1","addr":"172.21.15.104:6835","nonce":233806124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":5}]} 2024-09-17T02:58:33.654 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 34 2024-09-17T02:58:33.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bb4078d60 msgr2=0x7f0bb407b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:33.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bb4078d60 0x7f0bb407b270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8033000 tx=0x7f0bc8160730 comp rx=0 tx=0).stop 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bc8154620 msgr2=0x7f0bc80cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bc8154620 0x7f0bc80cd620 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80b7bb0 tx=0x7f0bc000e720 comp rx=0 tx=0).stop 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 shutdown_connections 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bb4078d60 0x7f0bb407b270 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bc8154620 0x7f0bc80cd620 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bc8154210 0x7f0bc80cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 --2- 172.21.15.104:0/3498474569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb0003a50 0x7f0bc81f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 >> 172.21.15.104:0/3498474569 conn(0x7f0bc8069120 msgr2=0x7f0bc8161310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 shutdown_connections 2024-09-17T02:58:33.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:58:33.656+0000 7f0bcd77b640 1 -- 172.21.15.104:0/3498474569 wait complete. 2024-09-17T02:58:33.667 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-17T02:58:33.791 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":5958,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.768495998000001,"mdsmap_epoch":34,"osdmap_epoch":85,"osdmap_epoch_barrier":83,"uptime":16.349379881000001} 2024-09-17T02:58:33.792 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 5958, "mdsmap_epoch": 34, "osdmap_epoch": 85, "osdmap_epoch_barrier": 83, "rank_uptime": 11.768495998, "state": "up:active", "uptime": 16.349379881, "want_state": "up:active", "whoami": 0 } 2024-09-17T02:58:33.793 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-17T02:58:33.913 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_mon_report_interval":"5"} 2024-09-17T02:58:33.913 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-17T02:58:33.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-17T02:58:34.026 INFO:teuthology.orchestra.run.smithi104.stdout:{"mon_tick_interval":"5"} 2024-09-17T02:58:34.026 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-17T02:58:34.026 INFO:tasks.cephfs.test_full:pool capacity 557082176, 531MB should be enough to fill it 2024-09-17T02:58:34.026 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> import time 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> import datetime 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> # Write some buffered data through before going full, all should be well 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> print("writing some data through which we expect to succeed") 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> bytes = 0 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(f) 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-17T02:58:34.027 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> # buffered IO, the error should always only appear from fsync and not 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> # from write 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> full = False 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> for n in range(0, int(531 * 1.1)): 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> try: 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> except OSError as e: 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> if False: 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> raise 2024-09-17T02:58:34.028 DEBUG:teuthology.orchestra.run.smithi104:> else: 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> full = True 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> break 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> try: 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(f) 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> print("fsync'"'"'ed successfully") 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> except OSError as e: 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> full = True 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> break 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> else: 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:58:34.029 DEBUG:teuthology.orchestra.run.smithi104:> if n > 531 * 0.9: 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> # Be cautious in the last region where we expect to hit 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> time.sleep(15.0) 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> if not full: 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> # close() should not raise an error because we already caught it in 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> # since then because all IOs got cancelled on the full flag. 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> print("calling close") 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> os.close(f) 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> print("close() did not raise error") 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T02:58:34.030 DEBUG:teuthology.orchestra.run.smithi104:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-17T02:58:34.031 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T02:58:35.589 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:58:35.592 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:58:37.673 INFO:teuthology.orchestra.run.smithi104.stdout:writing some data through which we expect to succeed 2024-09-17T02:58:37.673 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-17T02:58:37.673 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.673 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.673 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 1.00 MB 2024-09-17T02:58:37.673 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.673 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 2.00 MB 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 3.00 MB 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 4.00 MB 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 5.00 MB 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.674 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 6.00 MB 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 7.00 MB 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 8.00 MB 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 9.00 MB 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 10.00 MB 2024-09-17T02:58:37.675 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 11.00 MB 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 12.00 MB 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 13.00 MB 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 14.00 MB 2024-09-17T02:58:37.676 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 15.00 MB 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 16.00 MB 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 17.00 MB 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 18.00 MB 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.677 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 19.00 MB 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 20.00 MB 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 21.00 MB 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 22.00 MB 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 23.00 MB 2024-09-17T02:58:37.678 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 24.00 MB 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 25.00 MB 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 26.00 MB 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 27.00 MB 2024-09-17T02:58:37.679 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 28.00 MB 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 29.00 MB 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 30.00 MB 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.680 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 31.00 MB 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 32.00 MB 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 33.00 MB 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.681 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 34.00 MB 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 35.00 MB 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 36.00 MB 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 37.00 MB 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.682 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 38.00 MB 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 39.00 MB 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 40.00 MB 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 41.00 MB 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.683 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 42.00 MB 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 43.00 MB 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 44.00 MB 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 45.00 MB 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 46.00 MB 2024-09-17T02:58:37.684 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 47.00 MB 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 48.00 MB 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 49.00 MB 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 50.00 MB 2024-09-17T02:58:37.685 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 51.00 MB 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 52.00 MB 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 53.00 MB 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 54.00 MB 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.686 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 55.00 MB 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 56.00 MB 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 57.00 MB 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 58.00 MB 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.687 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 59.00 MB 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 60.00 MB 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 61.00 MB 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 62.00 MB 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.688 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 63.00 MB 2024-09-17T02:58:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 64.00 MB 2024-09-17T02:58:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 65.00 MB 2024-09-17T02:58:37.689 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 66.00 MB 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 67.00 MB 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 68.00 MB 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 69.00 MB 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.690 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 70.00 MB 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 71.00 MB 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 72.00 MB 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 73.00 MB 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.691 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 74.00 MB 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 75.00 MB 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 76.00 MB 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 77.00 MB 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 78.00 MB 2024-09-17T02:58:37.692 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.693 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.693 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 79.00 MB 2024-09-17T02:58:37.693 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.693 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.693 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 80.00 MB 2024-09-17T02:58:37.881 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.881 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.881 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 81.00 MB 2024-09-17T02:58:37.881 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.881 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.881 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 82.00 MB 2024-09-17T02:58:37.881 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.881 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.882 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 83.00 MB 2024-09-17T02:58:37.882 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.882 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.882 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 84.00 MB 2024-09-17T02:58:37.882 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.882 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.882 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 85.00 MB 2024-09-17T02:58:37.882 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 86.00 MB 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 87.00 MB 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 88.00 MB 2024-09-17T02:58:37.883 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.884 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.884 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 89.00 MB 2024-09-17T02:58:37.884 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.884 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.884 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 90.00 MB 2024-09-17T02:58:37.884 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.884 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 91.00 MB 2024-09-17T02:58:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 92.00 MB 2024-09-17T02:58:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 93.00 MB 2024-09-17T02:58:37.885 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.886 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.886 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 94.00 MB 2024-09-17T02:58:37.886 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.886 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.886 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 95.00 MB 2024-09-17T02:58:37.886 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.886 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 96.00 MB 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 97.00 MB 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 98.00 MB 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.887 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 99.00 MB 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 100.00 MB 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 101.00 MB 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.888 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 102.00 MB 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 103.00 MB 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 104.00 MB 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 105.00 MB 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.889 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 106.00 MB 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 107.00 MB 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 108.00 MB 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 109.00 MB 2024-09-17T02:58:37.890 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 110.00 MB 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 111.00 MB 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 112.00 MB 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 113.00 MB 2024-09-17T02:58:37.891 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 114.00 MB 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 115.00 MB 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 116.00 MB 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 117.00 MB 2024-09-17T02:58:37.892 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 118.00 MB 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 119.00 MB 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 120.00 MB 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.893 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.894 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 121.00 MB 2024-09-17T02:58:37.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.894 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.894 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 122.00 MB 2024-09-17T02:58:37.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.894 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.894 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 123.00 MB 2024-09-17T02:58:37.894 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 124.00 MB 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 125.00 MB 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 126.00 MB 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.895 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 127.00 MB 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 128.00 MB 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 129.00 MB 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 130.00 MB 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.896 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.897 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 131.00 MB 2024-09-17T02:58:37.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.897 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.897 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 132.00 MB 2024-09-17T02:58:37.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.897 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.897 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 133.00 MB 2024-09-17T02:58:37.897 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 134.00 MB 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 135.00 MB 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 136.00 MB 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.898 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 137.00 MB 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 138.00 MB 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 139.00 MB 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 140.00 MB 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.899 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 141.00 MB 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 142.00 MB 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 143.00 MB 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 144.00 MB 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.900 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 145.00 MB 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 146.00 MB 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 147.00 MB 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 148.00 MB 2024-09-17T02:58:37.901 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 149.00 MB 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 150.00 MB 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 151.00 MB 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.902 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 152.00 MB 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 153.00 MB 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 154.00 MB 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 155.00 MB 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.903 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 156.00 MB 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 157.00 MB 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 158.00 MB 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.904 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 159.00 MB 2024-09-17T02:58:37.905 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:37.905 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:37.905 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 160.00 MB 2024-09-17T02:58:37.905 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 161.00 MB 2024-09-17T02:58:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 162.00 MB 2024-09-17T02:58:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.091 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 163.00 MB 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 164.00 MB 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 165.00 MB 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 166.00 MB 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.092 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 167.00 MB 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 168.00 MB 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 169.00 MB 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 170.00 MB 2024-09-17T02:58:38.093 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 171.00 MB 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 172.00 MB 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 173.00 MB 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.094 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 174.00 MB 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 175.00 MB 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 176.00 MB 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 177.00 MB 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.095 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 178.00 MB 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 179.00 MB 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 180.00 MB 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 181.00 MB 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 182.00 MB 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 183.00 MB 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 184.00 MB 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 185.00 MB 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 186.00 MB 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 187.00 MB 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 188.00 MB 2024-09-17T02:58:38.098 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 189.00 MB 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 190.00 MB 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 191.00 MB 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.099 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 192.00 MB 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 193.00 MB 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 194.00 MB 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 195.00 MB 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.100 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 196.00 MB 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 197.00 MB 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 198.00 MB 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 199.00 MB 2024-09-17T02:58:38.101 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 200.00 MB 2024-09-17T02:58:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 201.00 MB 2024-09-17T02:58:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.102 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 202.00 MB 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 203.00 MB 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 204.00 MB 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 205.00 MB 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.103 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 206.00 MB 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 207.00 MB 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 208.00 MB 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 209.00 MB 2024-09-17T02:58:38.104 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 210.00 MB 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 211.00 MB 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 212.00 MB 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.105 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 213.00 MB 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 214.00 MB 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 215.00 MB 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 216.00 MB 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.106 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 217.00 MB 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 218.00 MB 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 219.00 MB 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 220.00 MB 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.107 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 221.00 MB 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 222.00 MB 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 223.00 MB 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.108 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 224.00 MB 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 225.00 MB 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 226.00 MB 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 227.00 MB 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.109 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 228.00 MB 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 229.00 MB 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 230.00 MB 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 231.00 MB 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.110 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 232.00 MB 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 233.00 MB 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 234.00 MB 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 235.00 MB 2024-09-17T02:58:38.111 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 236.00 MB 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 237.00 MB 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 238.00 MB 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.112 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.113 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 239.00 MB 2024-09-17T02:58:38.113 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.113 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.113 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 240.00 MB 2024-09-17T02:58:38.113 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.113 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.291 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 241.00 MB 2024-09-17T02:58:38.292 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.292 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.292 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 242.00 MB 2024-09-17T02:58:38.292 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.292 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.292 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 243.00 MB 2024-09-17T02:58:38.292 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 244.00 MB 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 245.00 MB 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 246.00 MB 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.293 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 247.00 MB 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 248.00 MB 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 249.00 MB 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.294 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 250.00 MB 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 251.00 MB 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 252.00 MB 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 253.00 MB 2024-09-17T02:58:38.295 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 254.00 MB 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 255.00 MB 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 256.00 MB 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.296 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 257.00 MB 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 258.00 MB 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 259.00 MB 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.297 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 260.00 MB 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 261.00 MB 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 262.00 MB 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 263.00 MB 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.298 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.299 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 264.00 MB 2024-09-17T02:58:38.299 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.299 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.299 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 265.00 MB 2024-09-17T02:58:38.299 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.299 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.299 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 266.00 MB 2024-09-17T02:58:38.299 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.300 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.300 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 267.00 MB 2024-09-17T02:58:38.300 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.300 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.300 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 268.00 MB 2024-09-17T02:58:38.300 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.300 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 269.00 MB 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 270.00 MB 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 271.00 MB 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 272.00 MB 2024-09-17T02:58:38.301 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 273.00 MB 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 274.00 MB 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 275.00 MB 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.302 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 276.00 MB 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 277.00 MB 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 278.00 MB 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 279.00 MB 2024-09-17T02:58:38.303 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.304 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.304 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 280.00 MB 2024-09-17T02:58:38.304 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.304 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.304 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 281.00 MB 2024-09-17T02:58:38.304 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.304 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.304 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 282.00 MB 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 283.00 MB 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 284.00 MB 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 285.00 MB 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.305 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 286.00 MB 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 287.00 MB 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 288.00 MB 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.306 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 289.00 MB 2024-09-17T02:58:38.307 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.307 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.307 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 290.00 MB 2024-09-17T02:58:38.307 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.307 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.307 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 291.00 MB 2024-09-17T02:58:38.307 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.307 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 292.00 MB 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 293.00 MB 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 294.00 MB 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 295.00 MB 2024-09-17T02:58:38.308 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 296.00 MB 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 297.00 MB 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 298.00 MB 2024-09-17T02:58:38.309 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.310 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.310 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 299.00 MB 2024-09-17T02:58:38.310 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.310 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.310 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 300.00 MB 2024-09-17T02:58:38.310 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.310 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 301.00 MB 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 302.00 MB 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 303.00 MB 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.311 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 304.00 MB 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 305.00 MB 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 306.00 MB 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.312 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 307.00 MB 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 308.00 MB 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 309.00 MB 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.313 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 310.00 MB 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 311.00 MB 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 312.00 MB 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 313.00 MB 2024-09-17T02:58:38.314 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 314.00 MB 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 315.00 MB 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 316.00 MB 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 317.00 MB 2024-09-17T02:58:38.315 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 318.00 MB 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 319.00 MB 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 320.00 MB 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.316 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 321.00 MB 2024-09-17T02:58:38.501 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.501 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.501 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 322.00 MB 2024-09-17T02:58:38.501 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.501 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 323.00 MB 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 324.00 MB 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 325.00 MB 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 326.00 MB 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.502 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 327.00 MB 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 328.00 MB 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 329.00 MB 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 330.00 MB 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 331.00 MB 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.503 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 332.00 MB 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 333.00 MB 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 334.00 MB 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 335.00 MB 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.504 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 336.00 MB 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 337.00 MB 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 338.00 MB 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 339.00 MB 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 340.00 MB 2024-09-17T02:58:38.505 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 341.00 MB 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 342.00 MB 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 343.00 MB 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 344.00 MB 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.506 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 345.00 MB 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 346.00 MB 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 347.00 MB 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 348.00 MB 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 349.00 MB 2024-09-17T02:58:38.507 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 350.00 MB 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 351.00 MB 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 352.00 MB 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 353.00 MB 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.508 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 354.00 MB 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 355.00 MB 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 356.00 MB 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 357.00 MB 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.509 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 358.00 MB 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 359.00 MB 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 360.00 MB 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 361.00 MB 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 362.00 MB 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.510 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 363.00 MB 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 364.00 MB 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 365.00 MB 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 366.00 MB 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.511 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 367.00 MB 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 368.00 MB 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 369.00 MB 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 370.00 MB 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 371.00 MB 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.512 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 372.00 MB 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 373.00 MB 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 374.00 MB 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 375.00 MB 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.513 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 376.00 MB 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 377.00 MB 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 378.00 MB 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 379.00 MB 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 380.00 MB 2024-09-17T02:58:38.514 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 381.00 MB 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 382.00 MB 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 383.00 MB 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 384.00 MB 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.515 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 385.00 MB 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 386.00 MB 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 387.00 MB 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 388.00 MB 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.516 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 389.00 MB 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 390.00 MB 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 391.00 MB 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 392.00 MB 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 393.00 MB 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.517 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 394.00 MB 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 395.00 MB 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 396.00 MB 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 397.00 MB 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.518 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 398.00 MB 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 399.00 MB 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 400.00 MB 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:58:38.519 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 401.00 MB 2024-09-17T02:58:41.131 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:58:41.132+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-17T02:58:48.116 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:58:48.116+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-17T02:59:05.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:59:05.764 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:59:08.735 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.735 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.735 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 402.00 MB 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 403.00 MB 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 404.00 MB 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 405.00 MB 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 406.00 MB 2024-09-17T02:59:08.736 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 407.00 MB 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 408.00 MB 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 409.00 MB 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 410.00 MB 2024-09-17T02:59:08.737 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 411.00 MB 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 412.00 MB 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 413.00 MB 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 414.00 MB 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.738 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 415.00 MB 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 416.00 MB 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 417.00 MB 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 418.00 MB 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 419.00 MB 2024-09-17T02:59:08.739 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 420.00 MB 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 421.00 MB 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 422.00 MB 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.740 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 423.00 MB 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 424.00 MB 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 425.00 MB 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 426.00 MB 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.741 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 427.00 MB 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 428.00 MB 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 429.00 MB 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.742 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 430.00 MB 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 431.00 MB 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 432.00 MB 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 433.00 MB 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.744 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 434.00 MB 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 435.00 MB 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 436.00 MB 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 437.00 MB 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 438.00 MB 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.745 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 439.00 MB 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 440.00 MB 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 441.00 MB 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 442.00 MB 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.746 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 443.00 MB 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 444.00 MB 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 445.00 MB 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 446.00 MB 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 447.00 MB 2024-09-17T02:59:08.747 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 448.00 MB 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 449.00 MB 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 450.00 MB 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 451.00 MB 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.748 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 452.00 MB 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 453.00 MB 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 454.00 MB 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 455.00 MB 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.749 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 456.00 MB 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 457.00 MB 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 458.00 MB 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 459.00 MB 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.750 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 460.00 MB 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 461.00 MB 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 462.00 MB 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 463.00 MB 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 464.00 MB 2024-09-17T02:59:08.751 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.752 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.752 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 465.00 MB 2024-09-17T02:59:08.752 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.752 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 466.00 MB 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 467.00 MB 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 468.00 MB 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 469.00 MB 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.753 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 470.00 MB 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 471.00 MB 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 472.00 MB 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 473.00 MB 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 474.00 MB 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.754 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 475.00 MB 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 476.00 MB 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 477.00 MB 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 478.00 MB 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.755 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.756 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 479.00 MB 2024-09-17T02:59:08.756 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T02:59:08.756 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T02:59:08.756 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T02:59:08.756 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 480.00 MB 2024-09-17T02:59:08.756 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T02:59:08.763 INFO:teuthology.orchestra.run.smithi104.stdout:Reached fullness after 480.00 MB 2024-09-17T02:59:08.764 INFO:teuthology.orchestra.run.smithi104.stdout:calling close 2024-09-17T02:59:08.764 INFO:teuthology.orchestra.run.smithi104.stdout:close() did not raise error 2024-09-17T02:59:08.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:59:08.776 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:59:08.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:59:08.819 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:59:08.868 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:59:08.868 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:59:08.868 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:08.868 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:08.885 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:08.885 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:08.942 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:59:09.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.103+0000 7fb97a557640 1 -- 172.21.15.104:0/607484870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c003fd0 msgr2=0x7fb95c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.103+0000 7fb97a557640 1 --2- 172.21.15.104:0/607484870 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb95c003fd0 0x7fb95c004800 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb96800c260 tx=0x7fb95c005830 comp rx=0 tx=0).stop 2024-09-17T02:59:09.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.103+0000 7fb978af4640 1 -- 172.21.15.104:0/607484870 reap_dead start 2024-09-17T02:59:09.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.103+0000 7fb97a557640 1 -- 172.21.15.104:0/607484870 shutdown_connections 2024-09-17T02:59:09.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.103+0000 7fb97a557640 1 -- 172.21.15.104:0/607484870 >> 172.21.15.104:0/607484870 conn(0x7fb9740b2450 msgr2=0x7fb9740b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:09.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.103+0000 7fb97a557640 1 -- 172.21.15.104:0/607484870 shutdown_connections 2024-09-17T02:59:09.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.103+0000 7fb97a557640 1 -- 172.21.15.104:0/607484870 wait complete. 2024-09-17T02:59:09.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.105+0000 7fb97a557640 1 Processor -- start 2024-09-17T02:59:09.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.105+0000 7fb97a557640 1 -- start start 2024-09-17T02:59:09.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.106+0000 7fb97a557640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c003fd0 0x7fb9740aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:09.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.106+0000 7fb97a557640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9740aefd0 0x7fb9741ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:09.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.106+0000 7fb97a557640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9741efb40 0x7fb9741591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:09.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.106+0000 7fb97a557640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb9740ce940 con 0x7fb9741efb40 2024-09-17T02:59:09.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.106+0000 7fb97a557640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb9740ce7c0 con 0x7fb9740aefd0 2024-09-17T02:59:09.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.106+0000 7fb97a557640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb9740ceac0 con 0x7fb95c003fd0 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.106+0000 7fb978af4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9741efb40 0x7fb9741591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb978af4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9741efb40 0x7fb9741591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41970/0 (socket says 172.21.15.104:41970) 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb978af4640 1 -- 172.21.15.104:0/2987849710 learned_addr learned my addr 172.21.15.104:0/2987849710 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb9737fe640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9740aefd0 0x7fb9741ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb973fff640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c003fd0 0x7fb9740aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb978af4640 1 -- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c003fd0 msgr2=0x7fb9740aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb978af4640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c003fd0 0x7fb9740aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb978af4640 1 -- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9740aefd0 msgr2=0x7fb9741ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb978af4640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9740aefd0 0x7fb9741ef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb978af4640 1 -- 172.21.15.104:0/2987849710 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97415c490 con 0x7fb9741efb40 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb978af4640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9741efb40 0x7fb9741591f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb96c005fd0 tx=0x7fb96c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb970ff9640 1 -- 172.21.15.104:0/2987849710 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00fcb0 con 0x7fb9741efb40 2024-09-17T02:59:09.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb970ff9640 1 -- 172.21.15.104:0/2987849710 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb96c00fe50 con 0x7fb9741efb40 2024-09-17T02:59:09.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97415c770 con 0x7fb9741efb40 2024-09-17T02:59:09.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb970ff9640 1 -- 172.21.15.104:0/2987849710 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96c004d60 con 0x7fb9741efb40 2024-09-17T02:59:09.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.107+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97415cd30 con 0x7fb9741efb40 2024-09-17T02:59:09.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.108+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97415c1f0 con 0x7fb9741efb40 2024-09-17T02:59:09.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.109+0000 7fb970ff9640 1 -- 172.21.15.104:0/2987849710 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb96c020020 con 0x7fb9741efb40 2024-09-17T02:59:09.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.109+0000 7fb970ff9640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb960078bc0 0x7fb96007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:09.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.110+0000 7fb970ff9640 1 -- 172.21.15.104:0/2987849710 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7fb96c09b160 con 0x7fb9741efb40 2024-09-17T02:59:09.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.110+0000 7fb970ff9640 1 -- 172.21.15.104:0/2987849710 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7fb960080800 con 0x7fb9741efb40 2024-09-17T02:59:09.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.110+0000 7fb973fff640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb960078bc0 0x7fb96007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:09.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.110+0000 7fb973fff640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb960078bc0 0x7fb96007b0d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb964009cd0 tx=0x7fb964005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:09.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.114+0000 7fb970ff9640 1 -- 172.21.15.104:0/2987849710 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb97415c1f0 con 0x7fb9741efb40 2024-09-17T02:59:09.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.300+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb97415bc00 con 0x7fb9741efb40 2024-09-17T02:59:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.300+0000 7fb970ff9640 1 -- 172.21.15.104:0/2987849710 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) ==== 80+0+0 (secure 0 0 0) 0x7fb96c063560 con 0x7fb9741efb40 2024-09-17T02:59:09.300 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb960078bc0 msgr2=0x7fb96007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb960078bc0 0x7fb96007b0d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb964009cd0 tx=0x7fb964005f90 comp rx=0 tx=0).stop 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9741efb40 msgr2=0x7fb9741591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9741efb40 0x7fb9741591f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb96c005fd0 tx=0x7fb96c011ed0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 shutdown_connections 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb960078bc0 0x7fb96007b0d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9740aefd0 0x7fb9741ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9741efb40 0x7fb9741591f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 --2- 172.21.15.104:0/2987849710 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c003fd0 0x7fb9740aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 >> 172.21.15.104:0/2987849710 conn(0x7fb9740b2450 msgr2=0x7fb974073480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:09.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 shutdown_connections 2024-09-17T02:59:09.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.302+0000 7fb97a557640 1 -- 172.21.15.104:0/2987849710 wait complete. 2024-09-17T02:59:09.313 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T02:59:09.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:09.313 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T02:59:09.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T02:59:09.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:09.343 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T02:59:09.399 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:59:09.399 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:59:09.399 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:09.419 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:59:09.419 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:09.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T02:59:09.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.593+0000 7f562d894640 1 -- 172.21.15.104:0/659532623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5628162cb0 msgr2=0x7f56280b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.593+0000 7f562d894640 1 --2- 172.21.15.104:0/659532623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5628162cb0 0x7f56280b65a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5618009820 tx=0x7f561802a510 comp rx=0 tx=0).stop 2024-09-17T02:59:09.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.593+0000 7f562d894640 1 -- 172.21.15.104:0/659532623 shutdown_connections 2024-09-17T02:59:09.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.593+0000 7f562d894640 1 --2- 172.21.15.104:0/659532623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56281630c0 0x7f56280b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.593+0000 7f562d894640 1 --2- 172.21.15.104:0/659532623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5628162cb0 0x7f56280b65a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.593+0000 7f562d894640 1 -- 172.21.15.104:0/659532623 >> 172.21.15.104:0/659532623 conn(0x7f5628069120 msgr2=0x7f5628069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.593+0000 7f562d894640 1 -- 172.21.15.104:0/659532623 shutdown_connections 2024-09-17T02:59:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.593+0000 7f562d894640 1 -- 172.21.15.104:0/659532623 wait complete. 2024-09-17T02:59:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.595+0000 7f562d894640 1 Processor -- start 2024-09-17T02:59:09.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.595+0000 7f562d894640 1 -- start start 2024-09-17T02:59:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f562d894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56281611d0 0x7f5628156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f562d894640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5628162cb0 0x7f5628153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f562d894640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56281630c0 0x7f5628154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f562d894640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5628161cf0 con 0x7f56281611d0 2024-09-17T02:59:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f562d894640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f56281605e0 con 0x7f5628162cb0 2024-09-17T02:59:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f562d894640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5628161e70 con 0x7f56281630c0 2024-09-17T02:59:09.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f5626ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56281611d0 0x7f5628156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f5626ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56281611d0 0x7f5628156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41982/0 (socket says 172.21.15.104:41982) 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.596+0000 7f5626ffd640 1 -- 172.21.15.104:0/3412007357 learned_addr learned my addr 172.21.15.104:0/3412007357 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f56277fe640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56281630c0 0x7f5628154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f561e7fc640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5628162cb0 0x7f5628153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5626ffd640 1 -- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56281630c0 msgr2=0x7f5628154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5626ffd640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56281630c0 0x7f5628154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5626ffd640 1 -- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5628162cb0 msgr2=0x7f5628153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5626ffd640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5628162cb0 0x7f5628153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5626ffd640 1 -- 172.21.15.104:0/3412007357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5628156db0 con 0x7f56281611d0 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5626ffd640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56281611d0 0x7f5628156440 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5618000c00 tx=0x7f5618005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5624ff9640 1 -- 172.21.15.104:0/3412007357 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561803f070 con 0x7f56281611d0 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5624ff9640 1 -- 172.21.15.104:0/3412007357 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5618004340 con 0x7f56281611d0 2024-09-17T02:59:09.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f5624ff9640 1 -- 172.21.15.104:0/3412007357 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618031bb0 con 0x7f56281611d0 2024-09-17T02:59:09.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5628157090 con 0x7f56281611d0 2024-09-17T02:59:09.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.597+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56280cbb60 con 0x7f56281611d0 2024-09-17T02:59:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.598+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5628161810 con 0x7f56281611d0 2024-09-17T02:59:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.599+0000 7f5624ff9640 1 -- 172.21.15.104:0/3412007357 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5618042070 con 0x7f56281611d0 2024-09-17T02:59:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.600+0000 7f5624ff9640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5608078b90 0x7f560807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.600+0000 7f5624ff9640 1 -- 172.21.15.104:0/3412007357 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7f56180bbf30 con 0x7f56281611d0 2024-09-17T02:59:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.600+0000 7f5624ff9640 1 -- 172.21.15.104:0/3412007357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7f56080807d0 con 0x7f56281611d0 2024-09-17T02:59:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.600+0000 7f561e7fc640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5608078b90 0x7f560807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:09.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.600+0000 7f561e7fc640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5608078b90 0x7f560807b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5628162800 tx=0x7f5610005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:09.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.604+0000 7f5624ff9640 1 -- 172.21.15.104:0/3412007357 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5628161810 con 0x7f56281611d0 2024-09-17T02:59:09.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.789+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5628162320 con 0x7f56281611d0 2024-09-17T02:59:09.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.789+0000 7f5624ff9640 1 -- 172.21.15.104:0/3412007357 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) ==== 80+0+0 (secure 0 0 0) 0x7f5618031770 con 0x7f56281611d0 2024-09-17T02:59:09.789 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T02:59:09.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.791+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5608078b90 msgr2=0x7f560807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.791+0000 7f562d894640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5608078b90 0x7f560807b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5628162800 tx=0x7f5610005f90 comp rx=0 tx=0).stop 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.791+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56281611d0 msgr2=0x7f5628156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.791+0000 7f562d894640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56281611d0 0x7f5628156440 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5618000c00 tx=0x7f5618005270 comp rx=0 tx=0).stop 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.792+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 shutdown_connections 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.792+0000 7f562d894640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5608078b90 0x7f560807b0a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.792+0000 7f562d894640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5628162cb0 0x7f5628153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.792+0000 7f562d894640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56281630c0 0x7f5628154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.792+0000 7f562d894640 1 --2- 172.21.15.104:0/3412007357 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f56281611d0 0x7f5628156440 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.792+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 >> 172.21.15.104:0/3412007357 conn(0x7f5628069120 msgr2=0x7f56280b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.792+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 shutdown_connections 2024-09-17T02:59:09.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:09.792+0000 7f562d894640 1 -- 172.21.15.104:0/3412007357 wait complete. 2024-09-17T02:59:09.803 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T02:59:09.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:09.803 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T02:59:09.836 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T02:59:09.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:09.836 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T02:59:09.895 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:59:09.896 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:09.896 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:09.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:59:09.912 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T02:59:09.912 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:59:09.912 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:09.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:59:09.953 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.089+0000 7ff92eca9640 1 -- 172.21.15.104:0/4281777854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff928068d00 msgr2=0x7ff928069110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.089+0000 7ff92eca9640 1 --2- 172.21.15.104:0/4281777854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff928068d00 0x7ff928069110 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009830 tx=0x7ff91c02a4a0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.089+0000 7ff92eca9640 1 -- 172.21.15.104:0/4281777854 shutdown_connections 2024-09-17T02:59:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.089+0000 7ff92eca9640 1 --2- 172.21.15.104:0/4281777854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff92815f300 0x7ff92815f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.089+0000 7ff92eca9640 1 --2- 172.21.15.104:0/4281777854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff928068d00 0x7ff928069110 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.089+0000 7ff92eca9640 1 -- 172.21.15.104:0/4281777854 >> 172.21.15.104:0/4281777854 conn(0x7ff9280b3640 msgr2=0x7ff9280b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.089+0000 7ff92eca9640 1 -- 172.21.15.104:0/4281777854 shutdown_connections 2024-09-17T02:59:10.089 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.089+0000 7ff92eca9640 1 -- 172.21.15.104:0/4281777854 wait complete. 2024-09-17T02:59:10.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.092+0000 7ff92eca9640 1 Processor -- start 2024-09-17T02:59:10.091 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.092+0000 7ff92eca9640 1 -- start start 2024-09-17T02:59:10.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.094+0000 7ff92eca9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff928068d00 0x7ff9281f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff92eca9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff928073580 0x7ff928157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff92eca9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff92815f300 0x7ff9281f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff92eca9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff92815fe50 con 0x7ff92815f300 2024-09-17T02:59:10.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff92eca9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff9280713e0 con 0x7ff928068d00 2024-09-17T02:59:10.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff92eca9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff9280740a0 con 0x7ff928073580 2024-09-17T02:59:10.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff927fff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff928073580 0x7ff928157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff927fff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff928073580 0x7ff928157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.104:49386/0 (socket says 172.21.15.104:49386) 2024-09-17T02:59:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff927fff640 1 -- 172.21.15.104:0/1395844370 learned_addr learned my addr 172.21.15.104:0/1395844370 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff92ca45640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff928068d00 0x7ff9281f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.095+0000 7ff92d246640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff92815f300 0x7ff9281f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.096+0000 7ff927fff640 1 -- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff928068d00 msgr2=0x7ff9281f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.096+0000 7ff927fff640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff928068d00 0x7ff9281f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.096+0000 7ff927fff640 1 -- 172.21.15.104:0/1395844370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff92815f300 msgr2=0x7ff9281f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.096+0000 7ff927fff640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff92815f300 0x7ff9281f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.096+0000 7ff927fff640 1 -- 172.21.15.104:0/1395844370 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92815c400 con 0x7ff928073580 2024-09-17T02:59:10.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.097+0000 7ff927fff640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff928073580 0x7ff928157a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff91400ea20 tx=0x7ff91400eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:10.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.097+0000 7ff9257fa640 1 -- 172.21.15.104:0/1395844370 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91400cd50 con 0x7ff928073580 2024-09-17T02:59:10.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.097+0000 7ff9257fa640 1 -- 172.21.15.104:0/1395844370 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff914004020 con 0x7ff928073580 2024-09-17T02:59:10.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.097+0000 7ff9257fa640 1 -- 172.21.15.104:0/1395844370 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914004450 con 0x7ff928073580 2024-09-17T02:59:10.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.098+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92815b880 con 0x7ff928073580 2024-09-17T02:59:10.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.098+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92815be40 con 0x7ff928073580 2024-09-17T02:59:10.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.099+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff928069110 con 0x7ff928073580 2024-09-17T02:59:10.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.101+0000 7ff9257fa640 1 -- 172.21.15.104:0/1395844370 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9140035f0 con 0x7ff928073580 2024-09-17T02:59:10.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.101+0000 7ff9257fa640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff90c078c10 0x7ff90c07b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.101+0000 7ff9257fa640 1 -- 172.21.15.104:0/1395844370 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7ff91409b560 con 0x7ff928073580 2024-09-17T02:59:10.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.101+0000 7ff9257fa640 1 -- 172.21.15.104:0/1395844370 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=90}) -- 0x7ff90c080850 con 0x7ff928073580 2024-09-17T02:59:10.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.101+0000 7ff92ca45640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff90c078c10 0x7ff90c07b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.102+0000 7ff92ca45640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff90c078c10 0x7ff90c07b120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff91c034000 tx=0x7ff91c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:10.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.110+0000 7ff9257fa640 1 -- 172.21.15.104:0/1395844370 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9140632f0 con 0x7ff928073580 2024-09-17T02:59:10.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.361+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff92815b610 con 0x7ff928073580 2024-09-17T02:59:10.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.362+0000 7ff9257fa640 1 -- 172.21.15.104:0/1395844370 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5234 (secure 0 0 0) 0x7ff914067d20 con 0x7ff928073580 2024-09-17T02:59:10.362 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:10.362 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"btime":"2024-09-17T02:58:24:019923+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2179511021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2179511021},{"type":"v1","addr":"172.21.15.192:6836","nonce":2179511021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1325951818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1325951818},{"type":"v1","addr":"172.21.15.192:6837","nonce":1325951818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3545243059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3545243059},{"type":"v1","addr":"172.21.15.104:6834","nonce":3545243059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:58:21.353636+0000","modified":"2024-09-17T02:58:23.373377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/233806124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":233806124},{"type":"v1","addr":"172.21.15.104:6835","nonce":233806124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":5}]} 2024-09-17T02:59:10.362 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 34 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff90c078c10 msgr2=0x7ff90c07b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff90c078c10 0x7ff90c07b120 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff91c034000 tx=0x7ff91c004730 comp rx=0 tx=0).stop 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff928073580 msgr2=0x7ff928157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff928073580 0x7ff928157a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff91400ea20 tx=0x7ff91400eee0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 shutdown_connections 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff90c078c10 0x7ff90c07b120 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff92815f300 0x7ff9281f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff928073580 0x7ff928157a50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 --2- 172.21.15.104:0/1395844370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff928068d00 0x7ff9281f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 >> 172.21.15.104:0/1395844370 conn(0x7ff9280b3640 msgr2=0x7ff9280b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:10.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 shutdown_connections 2024-09-17T02:59:10.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.364+0000 7ff92eca9640 1 -- 172.21.15.104:0/1395844370 wait complete. 2024-09-17T02:59:10.375 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.488+0000 7f15272ce640 1 -- 172.21.15.104:0/2207721085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15201621e0 msgr2=0x7f150c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.488+0000 7f15272ce640 1 --2- 172.21.15.104:0/2207721085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15201621e0 0x7f150c004800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15200bac20 tx=0x7f150c005830 comp rx=0 tx=0).stop 2024-09-17T02:59:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.488+0000 7f152586b640 1 -- 172.21.15.104:0/2207721085 reap_dead start 2024-09-17T02:59:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.488+0000 7f15272ce640 1 -- 172.21.15.104:0/2207721085 shutdown_connections 2024-09-17T02:59:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.488+0000 7f15272ce640 1 -- 172.21.15.104:0/2207721085 >> 172.21.15.104:0/2207721085 conn(0x7f1520069120 msgr2=0x7f1520069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.488+0000 7f15272ce640 1 -- 172.21.15.104:0/2207721085 shutdown_connections 2024-09-17T02:59:10.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.488+0000 7f15272ce640 1 -- 172.21.15.104:0/2207721085 wait complete. 2024-09-17T02:59:10.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.490+0000 7f15272ce640 1 Processor -- start 2024-09-17T02:59:10.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.490+0000 7f15272ce640 1 -- start start 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f15272ce640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15201621e0 0x7f15200caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f15272ce640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1520157950 0x7f15201f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f15272ce640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f152015c420 0x7f152015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f15272ce640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f152015fb50 con 0x7f152015c420 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f15272ce640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f152015f9d0 con 0x7f1520157950 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f15272ce640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f152015fcd0 con 0x7f15201621e0 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152586b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f152015c420 0x7f152015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152586b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f152015c420 0x7f152015c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42004/0 (socket says 172.21.15.104:42004) 2024-09-17T02:59:10.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152586b640 1 -- 172.21.15.104:0/364468416 learned_addr learned my addr 172.21.15.104:0/364468416 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152506a640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15201621e0 0x7f15200caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f1524869640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1520157950 0x7f15201f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152586b640 1 -- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15201621e0 msgr2=0x7f15200caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152586b640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15201621e0 0x7f15200caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152586b640 1 -- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1520157950 msgr2=0x7f15201f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152586b640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1520157950 0x7f15201f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.491+0000 7f152586b640 1 -- 172.21.15.104:0/364468416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f152015cd70 con 0x7f152015c420 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.492+0000 7f152586b640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f152015c420 0x7f152015c830 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f15200b7bc0 tx=0x7f151800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.492+0000 7f1515ffb640 1 -- 172.21.15.104:0/364468416 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518009ad0 con 0x7f152015c420 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.492+0000 7f1515ffb640 1 -- 172.21.15.104:0/364468416 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1518003b70 con 0x7f152015c420 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.492+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15201548f0 con 0x7f152015c420 2024-09-17T02:59:10.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.492+0000 7f1515ffb640 1 -- 172.21.15.104:0/364468416 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518004030 con 0x7f152015c420 2024-09-17T02:59:10.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.492+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15201f6890 con 0x7f152015c420 2024-09-17T02:59:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.493+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1520160210 con 0x7f152015c420 2024-09-17T02:59:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.494+0000 7f1515ffb640 1 -- 172.21.15.104:0/364468416 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f15180041d0 con 0x7f152015c420 2024-09-17T02:59:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.494+0000 7f1515ffb640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1504078b90 0x7f150407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.494+0000 7f1515ffb640 1 -- 172.21.15.104:0/364468416 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7f151809bbe0 con 0x7f152015c420 2024-09-17T02:59:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.494+0000 7f152506a640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1504078b90 0x7f150407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.494+0000 7f1515ffb640 1 -- 172.21.15.104:0/364468416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7f15040807d0 con 0x7f152015c420 2024-09-17T02:59:10.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.495+0000 7f152506a640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1504078b90 0x7f150407b0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f151c000ef0 tx=0x7f151c006b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:10.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.499+0000 7f1515ffb640 1 -- 172.21.15.104:0/364468416 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f152015cd70 con 0x7f152015c420 2024-09-17T02:59:10.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.707+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15201f62d0 con 0x7f152015c420 2024-09-17T02:59:10.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.707+0000 7f1515ffb640 1 -- 172.21.15.104:0/364468416 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5234 (secure 0 0 0) 0x7f1518063a30 con 0x7f152015c420 2024-09-17T02:59:10.707 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:10.707 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"btime":"2024-09-17T02:58:24:019923+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2179511021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2179511021},{"type":"v1","addr":"172.21.15.192:6836","nonce":2179511021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1325951818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1325951818},{"type":"v1","addr":"172.21.15.192:6837","nonce":1325951818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3545243059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3545243059},{"type":"v1","addr":"172.21.15.104:6834","nonce":3545243059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:58:21.353636+0000","modified":"2024-09-17T02:58:23.373377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/233806124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":233806124},{"type":"v1","addr":"172.21.15.104:6835","nonce":233806124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":5}]} 2024-09-17T02:59:10.707 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 34 2024-09-17T02:59:10.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1504078b90 msgr2=0x7f150407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1504078b90 0x7f150407b0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f151c000ef0 tx=0x7f151c006b60 comp rx=0 tx=0).stop 2024-09-17T02:59:10.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f152015c420 msgr2=0x7f152015c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f152015c420 0x7f152015c830 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f15200b7bc0 tx=0x7f151800f790 comp rx=0 tx=0).stop 2024-09-17T02:59:10.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 shutdown_connections 2024-09-17T02:59:10.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1504078b90 0x7f150407b0a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1520157950 0x7f15201f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f152015c420 0x7f152015c830 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 --2- 172.21.15.104:0/364468416 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15201621e0 0x7f15200caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.709+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 >> 172.21.15.104:0/364468416 conn(0x7f1520069120 msgr2=0x7f15200b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:10.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.710+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 shutdown_connections 2024-09-17T02:59:10.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.710+0000 7f15272ce640 1 -- 172.21.15.104:0/364468416 wait complete. 2024-09-17T02:59:10.720 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:59:10.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.832+0000 7fbb9d094640 1 -- 172.21.15.104:0/761255291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 msgr2=0x7fbb980b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.832+0000 7fbb9d094640 1 --2- 172.21.15.104:0/761255291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 0x7fbb980b7c80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbb88005fd0 tx=0x7fbb8802a540 comp rx=0 tx=0).stop 2024-09-17T02:59:10.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.832+0000 7fbb9d094640 1 -- 172.21.15.104:0/761255291 shutdown_connections 2024-09-17T02:59:10.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.832+0000 7fbb9d094640 1 --2- 172.21.15.104:0/761255291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb980d0fd0 0x7fbb98160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.832+0000 7fbb9d094640 1 --2- 172.21.15.104:0/761255291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 0x7fbb980b7c80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.832+0000 7fbb9d094640 1 -- 172.21.15.104:0/761255291 >> 172.21.15.104:0/761255291 conn(0x7fbb980d2970 msgr2=0x7fbb980d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:10.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.832+0000 7fbb9d094640 1 -- 172.21.15.104:0/761255291 shutdown_connections 2024-09-17T02:59:10.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.832+0000 7fbb9d094640 1 -- 172.21.15.104:0/761255291 wait complete. 2024-09-17T02:59:10.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.834+0000 7fbb9d094640 1 Processor -- start 2024-09-17T02:59:10.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.834+0000 7fbb9d094640 1 -- start start 2024-09-17T02:59:10.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9d094640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb980d0fd0 0x7fbb9815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9d094640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb980d13e0 0x7fbb9815ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9d094640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 0x7fbb981604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9d094640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbb980b6bd0 con 0x7fbb980d3490 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9d094640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbb980b6a50 con 0x7fbb980d13e0 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9d094640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbb980b6d50 con 0x7fbb980d0fd0 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 0x7fbb981604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 0x7fbb981604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42012/0 (socket says 172.21.15.104:42012) 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 -- 172.21.15.104:0/1874056500 learned_addr learned my addr 172.21.15.104:0/1874056500 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:10.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb96d9d640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb980d0fd0 0x7fbb9815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb8ffff640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb980d13e0 0x7fbb9815ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 -- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb980d0fd0 msgr2=0x7fbb9815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb980d0fd0 0x7fbb9815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 -- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb980d13e0 msgr2=0x7fbb9815ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb980d13e0 0x7fbb9815ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 -- 172.21.15.104:0/1874056500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb980c8ce0 con 0x7fbb980d3490 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb96d9d640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb980d0fd0 0x7fbb9815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9759e640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 0x7fbb981604a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c6c0 tx=0x7fbb9000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb8f7fe640 1 -- 172.21.15.104:0/1874056500 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90017070 con 0x7fbb980d3490 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb8f7fe640 1 -- 172.21.15.104:0/1874056500 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb90003c60 con 0x7fbb980d3490 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9815eec0 con 0x7fbb980d3490 2024-09-17T02:59:10.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb8f7fe640 1 -- 172.21.15.104:0/1874056500 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb900052d0 con 0x7fbb980d3490 2024-09-17T02:59:10.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.836+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9815f480 con 0x7fbb980d3490 2024-09-17T02:59:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.837+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9806ebb0 con 0x7fbb980d3490 2024-09-17T02:59:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.838+0000 7fbb8f7fe640 1 -- 172.21.15.104:0/1874056500 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb9001a070 con 0x7fbb980d3490 2024-09-17T02:59:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.839+0000 7fbb8f7fe640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb78078b90 0x7fbb7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.839+0000 7fbb8f7fe640 1 -- 172.21.15.104:0/1874056500 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7fbb9009a390 con 0x7fbb980d3490 2024-09-17T02:59:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.839+0000 7fbb96d9d640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb78078b90 0x7fbb7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.839+0000 7fbb8f7fe640 1 -- 172.21.15.104:0/1874056500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7fbb780807d0 con 0x7fbb980d3490 2024-09-17T02:59:10.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.840+0000 7fbb96d9d640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb78078b90 0x7fbb7807b0a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbb88033000 tx=0x7fbb88004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:10.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:10.844+0000 7fbb8f7fe640 1 -- 172.21.15.104:0/1874056500 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbb90062790 con 0x7fbb980d3490 2024-09-17T02:59:11.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.017+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb980d0900 con 0x7fbb980d3490 2024-09-17T02:59:11.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.018+0000 7fbb8f7fe640 1 -- 172.21.15.104:0/1874056500 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16916 (secure 0 0 0) 0x7fbb90062090 con 0x7fbb980d3490 2024-09-17T02:59:11.018 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:11.018 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":89,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:58:44.157411+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:58:18.993978+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T02:58:20.323190+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:59:11.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb78078b90 msgr2=0x7fbb7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb78078b90 0x7fbb7807b0a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbb88033000 tx=0x7fbb88004730 comp rx=0 tx=0).stop 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 msgr2=0x7fbb981604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 0x7fbb981604a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c6c0 tx=0x7fbb9000cb80 comp rx=0 tx=0).stop 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 shutdown_connections 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb78078b90 0x7fbb7807b0a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb980d13e0 0x7fbb9815ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb980d3490 0x7fbb981604a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 --2- 172.21.15.104:0/1874056500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb980d0fd0 0x7fbb9815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 >> 172.21.15.104:0/1874056500 conn(0x7fbb980d2970 msgr2=0x7fbb980ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:11.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 shutdown_connections 2024-09-17T02:59:11.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.021+0000 7fbb9d094640 1 -- 172.21.15.104:0/1874056500 wait complete. 2024-09-17T02:59:11.032 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T02:59:11.032 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:11.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.144+0000 7f68f5f5f640 1 -- 172.21.15.104:0/3064689487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f0073e00 msgr2=0x7f68f0156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.144+0000 7f68f5f5f640 1 --2- 172.21.15.104:0/3064689487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f0073e00 0x7f68f0156200 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005fd0 tx=0x7f68e002aa10 comp rx=0 tx=0).stop 2024-09-17T02:59:11.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.144+0000 7f68f5f5f640 1 -- 172.21.15.104:0/3064689487 shutdown_connections 2024-09-17T02:59:11.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.144+0000 7f68f5f5f640 1 --2- 172.21.15.104:0/3064689487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f0073e00 0x7f68f0156200 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.144+0000 7f68f5f5f640 1 -- 172.21.15.104:0/3064689487 >> 172.21.15.104:0/3064689487 conn(0x7f68f006eb90 msgr2=0x7f68f006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:11.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.144+0000 7f68f5f5f640 1 -- 172.21.15.104:0/3064689487 shutdown_connections 2024-09-17T02:59:11.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.144+0000 7f68f5f5f640 1 -- 172.21.15.104:0/3064689487 wait complete. 2024-09-17T02:59:11.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.145+0000 7f68f5f5f640 1 Processor -- start 2024-09-17T02:59:11.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.146+0000 7f68f5f5f640 1 -- start start 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68f5f5f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68f0073e00 0x7f68f014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68f5f5f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f015cc30 0x7f68f01e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68f5f5f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68f014e9f0 0x7f68f01e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68f5f5f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f68f00d03a0 con 0x7f68f015cc30 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68f5f5f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f68f015d420 con 0x7f68f014e9f0 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68f5f5f640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f68f00d0520 con 0x7f68f0073e00 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f015cc30 0x7f68f01e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f015cc30 0x7f68f01e5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42024/0 (socket says 172.21.15.104:42024) 2024-09-17T02:59:11.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 -- 172.21.15.104:0/1495320523 learned_addr learned my addr 172.21.15.104:0/1495320523 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68effff640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68f014e9f0 0x7f68f01e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68ef7fe640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68f0073e00 0x7f68f014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 -- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68f0073e00 msgr2=0x7f68f014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68f0073e00 0x7f68f014dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 -- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68f014e9f0 msgr2=0x7f68f01e60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68f014e9f0 0x7f68f01e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 -- 172.21.15.104:0/1495320523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f00cc500 con 0x7f68f015cc30 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.147+0000 7f68eeffd640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f015cc30 0x7f68f01e5bb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f68e400c3a0 tx=0x7f68e400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.148+0000 7f68d7fff640 1 -- 172.21.15.104:0/1495320523 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4017070 con 0x7f68f015cc30 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.148+0000 7f68d7fff640 1 -- 172.21.15.104:0/1495320523 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68e40053c0 con 0x7f68f015cc30 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.148+0000 7f68d7fff640 1 -- 172.21.15.104:0/1495320523 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4003850 con 0x7f68f015cc30 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.148+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f00cc7e0 con 0x7f68f015cc30 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.148+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f00ccda0 con 0x7f68f015cc30 2024-09-17T02:59:11.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.149+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f014e780 con 0x7f68f015cc30 2024-09-17T02:59:11.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.150+0000 7f68d7fff640 1 -- 172.21.15.104:0/1495320523 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f68e401a070 con 0x7f68f015cc30 2024-09-17T02:59:11.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.150+0000 7f68d7fff640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68dc078bc0 0x7f68dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.150+0000 7f68d7fff640 1 -- 172.21.15.104:0/1495320523 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7f68e409a110 con 0x7f68f015cc30 2024-09-17T02:59:11.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.150+0000 7f68d7fff640 1 -- 172.21.15.104:0/1495320523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7f68dc080860 con 0x7f68f015cc30 2024-09-17T02:59:11.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.150+0000 7f68ef7fe640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68dc078bc0 0x7f68dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.151+0000 7f68ef7fe640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68dc078bc0 0x7f68dc07b0d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f68e0035000 tx=0x7f68e0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:11.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.155+0000 7f68d7fff640 1 -- 172.21.15.104:0/1495320523 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f68e4062520 con 0x7f68f015cc30 2024-09-17T02:59:11.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.364+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68f00d09f0 con 0x7f68f015cc30 2024-09-17T02:59:11.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.364+0000 7f68d7fff640 1 -- 172.21.15.104:0/1495320523 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5234 (secure 0 0 0) 0x7f68e4061e20 con 0x7f68f015cc30 2024-09-17T02:59:11.364 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:11.364 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"btime":"2024-09-17T02:58:24:019923+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2179511021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2179511021},{"type":"v1","addr":"172.21.15.192:6836","nonce":2179511021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1325951818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1325951818},{"type":"v1","addr":"172.21.15.192:6837","nonce":1325951818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3545243059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3545243059},{"type":"v1","addr":"172.21.15.104:6834","nonce":3545243059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:58:21.353636+0000","modified":"2024-09-17T02:58:23.373377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/233806124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":233806124},{"type":"v1","addr":"172.21.15.104:6835","nonce":233806124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":5}]} 2024-09-17T02:59:11.365 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 34 2024-09-17T02:59:11.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68dc078bc0 msgr2=0x7f68dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68dc078bc0 0x7f68dc07b0d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f68e0035000 tx=0x7f68e0004ab0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f015cc30 msgr2=0x7f68f01e5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f015cc30 0x7f68f01e5bb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f68e400c3a0 tx=0x7f68e400c860 comp rx=0 tx=0).stop 2024-09-17T02:59:11.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 shutdown_connections 2024-09-17T02:59:11.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68dc078bc0 0x7f68dc07b0d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68f014e9f0 0x7f68f01e60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68f015cc30 0x7f68f01e5bb0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.366+0000 7f68f5f5f640 1 --2- 172.21.15.104:0/1495320523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68f0073e00 0x7f68f014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.367+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 >> 172.21.15.104:0/1495320523 conn(0x7f68f006eb90 msgr2=0x7f68f015ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:11.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.367+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 shutdown_connections 2024-09-17T02:59:11.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.367+0000 7f68f5f5f640 1 -- 172.21.15.104:0/1495320523 wait complete. 2024-09-17T02:59:11.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:11.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.489+0000 7fd31b0cc640 1 -- 172.21.15.104:0/375262406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 msgr2=0x7fd2fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.489+0000 7fd31b0cc640 1 --2- 172.21.15.104:0/375262406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 0x7fd2fc00b9c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd30c005fd0 tx=0x7fd2fc005830 comp rx=0 tx=0).stop 2024-09-17T02:59:11.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.489+0000 7fd31b0cc640 1 -- 172.21.15.104:0/375262406 shutdown_connections 2024-09-17T02:59:11.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.489+0000 7fd31b0cc640 1 --2- 172.21.15.104:0/375262406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 0x7fd2fc00b9c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.489+0000 7fd31b0cc640 1 -- 172.21.15.104:0/375262406 >> 172.21.15.104:0/375262406 conn(0x7fd31406eb90 msgr2=0x7fd31406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:11.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.489+0000 7fd31b0cc640 1 -- 172.21.15.104:0/375262406 shutdown_connections 2024-09-17T02:59:11.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.489+0000 7fd31b0cc640 1 -- 172.21.15.104:0/375262406 wait complete. 2024-09-17T02:59:11.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.491+0000 7fd31b0cc640 1 Processor -- start 2024-09-17T02:59:11.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.491+0000 7fd31b0cc640 1 -- start start 2024-09-17T02:59:11.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd31b0cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 0x7fd314159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd31b0cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3141f75c0 0x7fd3141517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd31b0cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd314072cf0 0x7fd314073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd31b0cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd31415cfc0 con 0x7fd2fc005350 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd31b0cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd31415ce40 con 0x7fd314072cf0 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd31b0cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd3140cd770 con 0x7fd3141f75c0 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 0x7fd314159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 0x7fd314159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42048/0 (socket says 172.21.15.104:42048) 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 -- 172.21.15.104:0/3564138753 learned_addr learned my addr 172.21.15.104:0/3564138753 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd313fff640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3141f75c0 0x7fd3141517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd319669640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd314072cf0 0x7fd314073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 -- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3141f75c0 msgr2=0x7fd3141517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3141f75c0 0x7fd3141517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 -- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd314072cf0 msgr2=0x7fd314073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd314072cf0 0x7fd314073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 -- 172.21.15.104:0/3564138753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd314073640 con 0x7fd2fc005350 2024-09-17T02:59:11.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd319669640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd314072cf0 0x7fd314073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:11.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd318e68640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 0x7fd314159050 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd304006450 tx=0x7fd3040039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:11.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd3117fa640 1 -- 172.21.15.104:0/3564138753 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304015070 con 0x7fd2fc005350 2024-09-17T02:59:11.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd3117fa640 1 -- 172.21.15.104:0/3564138753 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd304011840 con 0x7fd2fc005350 2024-09-17T02:59:11.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd314159950 con 0x7fd2fc005350 2024-09-17T02:59:11.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.493+0000 7fd3117fa640 1 -- 172.21.15.104:0/3564138753 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd304011c70 con 0x7fd2fc005350 2024-09-17T02:59:11.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.494+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3141f4240 con 0x7fd2fc005350 2024-09-17T02:59:11.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.494+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3140cdcd0 con 0x7fd2fc005350 2024-09-17T02:59:11.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.495+0000 7fd3117fa640 1 -- 172.21.15.104:0/3564138753 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd304018070 con 0x7fd2fc005350 2024-09-17T02:59:11.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.496+0000 7fd3117fa640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd300078b90 0x7fd30007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.496+0000 7fd3117fa640 1 -- 172.21.15.104:0/3564138753 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7fd30409b9f0 con 0x7fd2fc005350 2024-09-17T02:59:11.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.496+0000 7fd3117fa640 1 -- 172.21.15.104:0/3564138753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7fd3000807d0 con 0x7fd2fc005350 2024-09-17T02:59:11.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.496+0000 7fd313fff640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd300078b90 0x7fd30007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.496+0000 7fd313fff640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd300078b90 0x7fd30007b0a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd308000c00 tx=0x7fd308006310 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:11.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.501+0000 7fd3117fa640 1 -- 172.21.15.104:0/3564138753 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd314073640 con 0x7fd2fc005350 2024-09-17T02:59:11.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.708+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3140700f0 con 0x7fd2fc005350 2024-09-17T02:59:11.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.709+0000 7fd3117fa640 1 -- 172.21.15.104:0/3564138753 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5234 (secure 0 0 0) 0x7fd3040637b0 con 0x7fd2fc005350 2024-09-17T02:59:11.709 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:11.709 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":34,"btime":"2024-09-17T02:58:24:019923+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2179511021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2179511021},{"type":"v1","addr":"172.21.15.192:6836","nonce":2179511021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1325951818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1325951818},{"type":"v1","addr":"172.21.15.192:6837","nonce":1325951818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3545243059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3545243059},{"type":"v1","addr":"172.21.15.104:6834","nonce":3545243059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:58:21.353636+0000","modified":"2024-09-17T02:58:23.373377+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/233806124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":233806124},{"type":"v1","addr":"172.21.15.104:6835","nonce":233806124}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5958,"qdb_cluster":[5958]},"id":5}]} 2024-09-17T02:59:11.709 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 34 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd300078b90 msgr2=0x7fd30007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd300078b90 0x7fd30007b0a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd308000c00 tx=0x7fd308006310 comp rx=0 tx=0).stop 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 msgr2=0x7fd314159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 0x7fd314159050 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd304006450 tx=0x7fd3040039c0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 shutdown_connections 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd300078b90 0x7fd30007b0a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd314072cf0 0x7fd314073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3141f75c0 0x7fd3141517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 --2- 172.21.15.104:0/3564138753 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2fc005350 0x7fd314159050 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 >> 172.21.15.104:0/3564138753 conn(0x7fd31406eb90 msgr2=0x7fd31406f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:11.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 shutdown_connections 2024-09-17T02:59:11.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.711+0000 7fd31b0cc640 1 -- 172.21.15.104:0/3564138753 wait complete. 2024-09-17T02:59:11.722 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:59:11.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.834+0000 7faaecde6640 1 -- 172.21.15.104:0/1520044766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae815cc30 msgr2=0x7faae80cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.834+0000 7faaecde6640 1 --2- 172.21.15.104:0/1520044766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae815cc30 0x7faae80cd770 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7faae8071c20 tx=0x7faad002a560 comp rx=0 tx=0).stop 2024-09-17T02:59:11.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.834+0000 7faaecde6640 1 -- 172.21.15.104:0/1520044766 shutdown_connections 2024-09-17T02:59:11.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.834+0000 7faaecde6640 1 --2- 172.21.15.104:0/1520044766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae815cc30 0x7faae80cd770 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.834+0000 7faaecde6640 1 --2- 172.21.15.104:0/1520044766 >> v2:172.21.15.192:3300/0 conn(0x7faae8073e00 0x7faae8156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.834+0000 7faaecde6640 1 -- 172.21.15.104:0/1520044766 >> 172.21.15.104:0/1520044766 conn(0x7faae806eb90 msgr2=0x7faae806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:11.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.834+0000 7faaecde6640 1 -- 172.21.15.104:0/1520044766 shutdown_connections 2024-09-17T02:59:11.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.834+0000 7faaecde6640 1 -- 172.21.15.104:0/1520044766 wait complete. 2024-09-17T02:59:11.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.836+0000 7faaecde6640 1 Processor -- start 2024-09-17T02:59:11.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.836+0000 7faaecde6640 1 -- start start 2024-09-17T02:59:11.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faaecde6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae8073e00 0x7faae81478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faaecde6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faae80cdcb0 0x7faae815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faaecde6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faae815cc30 0x7faae8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faaecde6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faae815feb0 con 0x7faae8073e00 2024-09-17T02:59:11.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faaecde6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faae815d2c0 con 0x7faae815cc30 2024-09-17T02:59:11.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faaecde6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faae8160030 con 0x7faae80cdcb0 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faae659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae8073e00 0x7faae81478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faae659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae8073e00 0x7faae81478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42076/0 (socket says 172.21.15.104:42076) 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faae659c640 1 -- 172.21.15.104:0/1782892592 learned_addr learned my addr 172.21.15.104:0/1782892592 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faaddd9b640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faae80cdcb0 0x7faae815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.837+0000 7faae6d9d640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faae815cc30 0x7faae8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faae659c640 1 -- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faae80cdcb0 msgr2=0x7faae815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faae659c640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faae80cdcb0 0x7faae815ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faae659c640 1 -- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faae815cc30 msgr2=0x7faae8072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faae659c640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faae815cc30 0x7faae8072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faae659c640 1 -- 172.21.15.104:0/1782892592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae81f72b0 con 0x7faae8073e00 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faae6d9d640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faae815cc30 0x7faae8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:11.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faae659c640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae8073e00 0x7faae81478b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7faad8009fd0 tx=0x7faad800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:11.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faadf7fe640 1 -- 172.21.15.104:0/1782892592 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad800ccc0 con 0x7faae8073e00 2024-09-17T02:59:11.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faadf7fe640 1 -- 172.21.15.104:0/1782892592 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faad800ee70 con 0x7faae8073e00 2024-09-17T02:59:11.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae815f370 con 0x7faae8073e00 2024-09-17T02:59:11.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faadf7fe640 1 -- 172.21.15.104:0/1782892592 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad800ce60 con 0x7faae8073e00 2024-09-17T02:59:11.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.838+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae81f7a90 con 0x7faae8073e00 2024-09-17T02:59:11.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.839+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae806af90 con 0x7faae8073e00 2024-09-17T02:59:11.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.840+0000 7faadf7fe640 1 -- 172.21.15.104:0/1782892592 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faad8004280 con 0x7faae8073e00 2024-09-17T02:59:11.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.840+0000 7faadf7fe640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faac8078b90 0x7faac807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:11.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.840+0000 7faadf7fe640 1 -- 172.21.15.104:0/1782892592 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7faad809b700 con 0x7faae8073e00 2024-09-17T02:59:11.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.841+0000 7faadf7fe640 1 -- 172.21.15.104:0/1782892592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7faac80807d0 con 0x7faae8073e00 2024-09-17T02:59:11.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.841+0000 7faaddd9b640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faac8078b90 0x7faac807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:11.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.841+0000 7faaddd9b640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faac8078b90 0x7faac807b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faad0033000 tx=0x7faad0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:11.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:11.845+0000 7faadf7fe640 1 -- 172.21.15.104:0/1782892592 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faae806af90 con 0x7faae8073e00 2024-09-17T02:59:12.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.019+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faae8160550 con 0x7faae8073e00 2024-09-17T02:59:12.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.021+0000 7faadf7fe640 1 -- 172.21.15.104:0/1782892592 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16916 (secure 0 0 0) 0x7faad8063b00 con 0x7faae8073e00 2024-09-17T02:59:12.021 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:12.021 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":89,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:58:44.157411+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:58:18.993978+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T02:58:20.323190+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.9","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:59:12.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faac8078b90 msgr2=0x7faac807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faac8078b90 0x7faac807b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faad0033000 tx=0x7faad0004730 comp rx=0 tx=0).stop 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae8073e00 msgr2=0x7faae81478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae8073e00 0x7faae81478b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7faad8009fd0 tx=0x7faad800ec20 comp rx=0 tx=0).stop 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 shutdown_connections 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faac8078b90 0x7faac807b0a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faae815cc30 0x7faae8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faae80cdcb0 0x7faae815ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 --2- 172.21.15.104:0/1782892592 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faae8073e00 0x7faae81478b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 >> 172.21.15.104:0/1782892592 conn(0x7faae806eb90 msgr2=0x7faae8154fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 shutdown_connections 2024-09-17T02:59:12.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.023+0000 7faaecde6640 1 -- 172.21.15.104:0/1782892592 wait complete. 2024-09-17T02:59:12.034 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T02:59:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.148+0000 7fd971550640 1 -- 172.21.15.104:0/3901401898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072470 msgr2=0x7fd96c072880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.148+0000 7fd971550640 1 --2- 172.21.15.104:0/3901401898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072470 0x7fd96c072880 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fd96c071f20 tx=0x7fd96002a4a0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.148+0000 7fd971550640 1 -- 172.21.15.104:0/3901401898 shutdown_connections 2024-09-17T02:59:12.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.148+0000 7fd971550640 1 --2- 172.21.15.104:0/3901401898 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072470 0x7fd96c072880 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.148+0000 7fd971550640 1 --2- 172.21.15.104:0/3901401898 >> v2:172.21.15.192:3300/0 conn(0x7fd96c15b7f0 0x7fd96c15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.148+0000 7fd971550640 1 -- 172.21.15.104:0/3901401898 >> 172.21.15.104:0/3901401898 conn(0x7fd96c0b2450 msgr2=0x7fd96c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:12.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.148+0000 7fd971550640 1 -- 172.21.15.104:0/3901401898 shutdown_connections 2024-09-17T02:59:12.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.148+0000 7fd971550640 1 -- 172.21.15.104:0/3901401898 wait complete. 2024-09-17T02:59:12.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.150+0000 7fd971550640 1 Processor -- start 2024-09-17T02:59:12.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.150+0000 7fd971550640 1 -- start start 2024-09-17T02:59:12.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.151+0000 7fd971550640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd96c072470 0x7fd96c14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.151+0000 7fd971550640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072dc0 0x7fd96c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.151+0000 7fd971550640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96c15b7f0 0x7fd96c0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.151+0000 7fd971550640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c15fe30 con 0x7fd96c072dc0 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.151+0000 7fd971550640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c0cf4a0 con 0x7fd96c072470 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.151+0000 7fd971550640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c15ffb0 con 0x7fd96c15b7f0 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.151+0000 7fd96a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072dc0 0x7fd96c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072dc0 0x7fd96c0b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42104/0 (socket says 172.21.15.104:42104) 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96a7fc640 1 -- 172.21.15.104:0/3949105647 learned_addr learned my addr 172.21.15.104:0/3949105647 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96affd640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd96c072470 0x7fd96c14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96b7fe640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96c15b7f0 0x7fd96c0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96a7fc640 1 -- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96c15b7f0 msgr2=0x7fd96c0b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96a7fc640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96c15b7f0 0x7fd96c0b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96a7fc640 1 -- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd96c072470 msgr2=0x7fd96c14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96a7fc640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd96c072470 0x7fd96c14c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96a7fc640 1 -- 172.21.15.104:0/3949105647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c14c760 con 0x7fd96c072dc0 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96b7fe640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96c15b7f0 0x7fd96c0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96affd640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd96c072470 0x7fd96c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd96a7fc640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072dc0 0x7fd96c0b0a40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd96002aa90 tx=0x7fd960033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960031d60 con 0x7fd96c072dc0 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd960033e10 con 0x7fd96c072dc0 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960005260 con 0x7fd96c072dc0 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96c1e7800 con 0x7fd96c072dc0 2024-09-17T02:59:12.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.152+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96c1e5620 con 0x7fd96c072dc0 2024-09-17T02:59:12.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.154+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96c1e7570 con 0x7fd96c072dc0 2024-09-17T02:59:12.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.154+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd960005400 con 0x7fd96c072dc0 2024-09-17T02:59:12.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.154+0000 7fd9537fe640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd958078b90 0x7fd95807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:12.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.155+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5767+0+0 (secure 0 0 0) 0x7fd9600bbf90 con 0x7fd96c072dc0 2024-09-17T02:59:12.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.155+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=90}) -- 0x7fd958080830 con 0x7fd96c072dc0 2024-09-17T02:59:12.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.155+0000 7fd96affd640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd958078b90 0x7fd95807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:12.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.155+0000 7fd96affd640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd958078b90 0x7fd95807b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd95c005fd0 tx=0x7fd95c0093f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:12.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.159+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd96003f030 con 0x7fd96c072dc0 2024-09-17T02:59:12.211 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:59:12.211+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-17T02:59:12.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.216+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 7 ==== osd_map(90..90 src has 1..90) ==== 304+0+0 (secure 0 0 0) 0x7fd9600f2d90 con 0x7fd96c072dc0 2024-09-17T02:59:12.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.216+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=91}) -- 0x7fd958081080 con 0x7fd96c072dc0 2024-09-17T02:59:12.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.373+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd96c1e7d20 con 0x7fd96c072dc0 2024-09-17T02:59:12.373 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:59:12.374+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T02:59:12.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.375+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7fd960005d00 con 0x7fd96c072dc0 2024-09-17T02:59:12.375 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T02:59:12.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.376+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 <== mon.0 v2:172.21.15.104:3300/0 9 ==== osd_map(91..91 src has 1..91) ==== 374+0+0 (secure 0 0 0) 0x7fd9600ba590 con 0x7fd96c072dc0 2024-09-17T02:59:12.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.376+0000 7fd9537fe640 1 -- 172.21.15.104:0/3949105647 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=92}) -- 0x7fd9580813a0 con 0x7fd96c072dc0 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd958078b90 msgr2=0x7fd95807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd958078b90 0x7fd95807b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd95c005fd0 tx=0x7fd95c0093f0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072dc0 msgr2=0x7fd96c0b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072dc0 0x7fd96c0b0a40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd96002aa90 tx=0x7fd960033c20 comp rx=0 tx=0).stop 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 shutdown_connections 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd958078b90 0x7fd95807b0a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd96c15b7f0 0x7fd96c0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd96c072dc0 0x7fd96c0b0a40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 --2- 172.21.15.104:0/3949105647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd96c072470 0x7fd96c14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 >> 172.21.15.104:0/3949105647 conn(0x7fd96c0b2450 msgr2=0x7fd96c0b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:12.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 shutdown_connections 2024-09-17T02:59:12.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.381+0000 7fd971550640 1 -- 172.21.15.104:0/3949105647 wait complete. 2024-09-17T02:59:12.393 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T02:59:12.440 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T02:59:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.510+0000 7fd213877640 1 -- 172.21.15.104:0/2555344384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 msgr2=0x7fd20c0cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.510+0000 7fd213877640 1 --2- 172.21.15.104:0/2555344384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 0x7fd20c0cef20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0d39e0 tx=0x7fd20802a4a0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.510+0000 7fd213877640 1 -- 172.21.15.104:0/2555344384 shutdown_connections 2024-09-17T02:59:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.510+0000 7fd213877640 1 --2- 172.21.15.104:0/2555344384 >> v2:172.21.15.192:3300/0 conn(0x7fd20c0cf460 0x7fd20c0cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.510+0000 7fd213877640 1 --2- 172.21.15.104:0/2555344384 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 0x7fd20c0cef20 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.510+0000 7fd213877640 1 -- 172.21.15.104:0/2555344384 >> 172.21.15.104:0/2555344384 conn(0x7fd20c0d28e0 msgr2=0x7fd20c0d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.510+0000 7fd213877640 1 -- 172.21.15.104:0/2555344384 shutdown_connections 2024-09-17T02:59:12.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.510+0000 7fd213877640 1 -- 172.21.15.104:0/2555344384 wait complete. 2024-09-17T02:59:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.512+0000 7fd213877640 1 Processor -- start 2024-09-17T02:59:12.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.512+0000 7fd213877640 1 -- start start 2024-09-17T02:59:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd213877640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd20c0cd3f0 0x7fd20c0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd213877640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd20c0cf460 0x7fd20c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd213877640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 0x7fd20c0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd213877640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0b6e40 con 0x7fd20c0d3400 2024-09-17T02:59:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd213877640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0b6cc0 con 0x7fd20c0cd3f0 2024-09-17T02:59:12.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd213877640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd20c0b6fc0 con 0x7fd20c0cf460 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 0x7fd20c0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 0x7fd20c0b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42144/0 (socket says 172.21.15.104:42144) 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 -- 172.21.15.104:0/601145466 learned_addr learned my addr 172.21.15.104:0/601145466 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd210e12640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd20c0cf460 0x7fd20c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211613640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd20c0cd3f0 0x7fd20c0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 -- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd20c0cf460 msgr2=0x7fd20c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd20c0cf460 0x7fd20c0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 -- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd20c0cd3f0 msgr2=0x7fd20c0ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd20c0cd3f0 0x7fd20c0ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 -- 172.21.15.104:0/601145466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c0cb750 con 0x7fd20c0d3400 2024-09-17T02:59:12.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd211e14640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 0x7fd20c0b39c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd20400c760 tx=0x7fd20400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:12.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd201ffb640 1 -- 172.21.15.104:0/601145466 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204003da0 con 0x7fd20c0d3400 2024-09-17T02:59:12.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd201ffb640 1 -- 172.21.15.104:0/601145466 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd20400ce10 con 0x7fd20c0d3400 2024-09-17T02:59:12.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd201ffb640 1 -- 172.21.15.104:0/601145466 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2040052d0 con 0x7fd20c0d3400 2024-09-17T02:59:12.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c0cba30 con 0x7fd20c0d3400 2024-09-17T02:59:12.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.514+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c0cbff0 con 0x7fd20c0d3400 2024-09-17T02:59:12.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.515+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c0ce220 con 0x7fd20c0d3400 2024-09-17T02:59:12.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.516+0000 7fd201ffb640 1 -- 172.21.15.104:0/601145466 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd204005470 con 0x7fd20c0d3400 2024-09-17T02:59:12.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.516+0000 7fd201ffb640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1f0078bc0 0x7fd1f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:12.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.516+0000 7fd201ffb640 1 -- 172.21.15.104:0/601145466 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5853+0+0 (secure 0 0 0) 0x7fd20409ab90 con 0x7fd20c0d3400 2024-09-17T02:59:12.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.516+0000 7fd211613640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1f0078bc0 0x7fd1f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:12.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.516+0000 7fd201ffb640 1 -- 172.21.15.104:0/601145466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=92}) -- 0x7fd1f0080900 con 0x7fd20c0d3400 2024-09-17T02:59:12.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.517+0000 7fd211613640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1f0078bc0 0x7fd1f007b0d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd208034000 tx=0x7fd208004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:12.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.521+0000 7fd201ffb640 1 -- 172.21.15.104:0/601145466 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd204062f40 con 0x7fd20c0d3400 2024-09-17T02:59:12.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:12.730+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd20c0cb4a0 con 0x7fd20c0d3400 2024-09-17T02:59:13.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.377+0000 7fd201ffb640 1 -- 172.21.15.104:0/601145466 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7fd204062840 con 0x7fd20c0d3400 2024-09-17T02:59:13.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1f0078bc0 msgr2=0x7fd1f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:13.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1f0078bc0 0x7fd1f007b0d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd208034000 tx=0x7fd208004730 comp rx=0 tx=0).stop 2024-09-17T02:59:13.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 msgr2=0x7fd20c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:13.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 0x7fd20c0b39c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd20400c760 tx=0x7fd20400cc20 comp rx=0 tx=0).stop 2024-09-17T02:59:13.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 shutdown_connections 2024-09-17T02:59:13.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1f0078bc0 0x7fd1f007b0d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:13.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd20c0d3400 0x7fd20c0b39c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:13.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd20c0cf460 0x7fd20c0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:13.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 --2- 172.21.15.104:0/601145466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd20c0cd3f0 0x7fd20c0ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:13.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 >> 172.21.15.104:0/601145466 conn(0x7fd20c0d28e0 msgr2=0x7fd20c0cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:13.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 shutdown_connections 2024-09-17T02:59:13.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.380+0000 7fd213877640 1 -- 172.21.15.104:0/601145466 wait complete. 2024-09-17T02:59:13.391 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T02:59:13.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.511+0000 7fa75ebad640 1 -- 172.21.15.104:0/1612701984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 msgr2=0x7fa7400051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:13.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.511+0000 7fa75ebad640 1 --2- 172.21.15.104:0/1612701984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 0x7fa7400051f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa7500016c0 tx=0x7fa740005830 comp rx=0 tx=0).stop 2024-09-17T02:59:13.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.511+0000 7fa75d14a640 1 -- 172.21.15.104:0/1612701984 reap_dead start 2024-09-17T02:59:13.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.511+0000 7fa75ebad640 1 -- 172.21.15.104:0/1612701984 shutdown_connections 2024-09-17T02:59:13.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.511+0000 7fa75ebad640 1 -- 172.21.15.104:0/1612701984 >> 172.21.15.104:0/1612701984 conn(0x7fa7580b3c70 msgr2=0x7fa7580d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:13.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.511+0000 7fa75ebad640 1 -- 172.21.15.104:0/1612701984 shutdown_connections 2024-09-17T02:59:13.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.511+0000 7fa75ebad640 1 -- 172.21.15.104:0/1612701984 wait complete. 2024-09-17T02:59:13.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.513+0000 7fa75ebad640 1 Processor -- start 2024-09-17T02:59:13.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.513+0000 7fa75ebad640 1 -- start start 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75ebad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 0x7fa758153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75ebad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75815c5d0 0x7fa7581f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75ebad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75815c100 0x7fa7581f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75ebad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa758162cd0 con 0x7fa740004d40 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75ebad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa758162b50 con 0x7fa75815c100 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75ebad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa758162e50 con 0x7fa75815c5d0 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75c949640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 0x7fa758153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75c949640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 0x7fa758153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:42168/0 (socket says 172.21.15.104:42168) 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75c949640 1 -- 172.21.15.104:0/4156781171 learned_addr learned my addr 172.21.15.104:0/4156781171 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:13.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa757fff640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75815c5d0 0x7fa7581f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75d14a640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75815c100 0x7fa7581f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75c949640 1 -- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75815c5d0 msgr2=0x7fa7581f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75c949640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75815c5d0 0x7fa7581f7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75c949640 1 -- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75815c100 msgr2=0x7fa7581f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.514+0000 7fa75c949640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75815c100 0x7fa7581f78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.515+0000 7fa75c949640 1 -- 172.21.15.104:0/4156781171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa758154870 con 0x7fa740004d40 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.515+0000 7fa75d14a640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75815c100 0x7fa7581f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.515+0000 7fa75c949640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 0x7fa758153fc0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa748000fb0 tx=0x7fa74800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.515+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748004440 con 0x7fa740004d40 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.515+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa748016070 con 0x7fa740004d40 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.515+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74800caa0 con 0x7fa740004d40 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.515+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75815e410 con 0x7fa740004d40 2024-09-17T02:59:13.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.515+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75815ca80 con 0x7fa740004d40 2024-09-17T02:59:13.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.516+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75815cce0 con 0x7fa740004d40 2024-09-17T02:59:13.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.517+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa74800cc40 con 0x7fa740004d40 2024-09-17T02:59:13.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.517+0000 7fa7557fa640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa744078b90 0x7fa74407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:13.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.517+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5853+0+0 (secure 0 0 0) 0x7fa74809b310 con 0x7fa740004d40 2024-09-17T02:59:13.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.517+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=92}) -- 0x7fa7440808d0 con 0x7fa740004d40 2024-09-17T02:59:13.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.517+0000 7fa757fff640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa744078b90 0x7fa74407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:13.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.518+0000 7fa757fff640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa744078b90 0x7fa74407b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa7580cdd20 tx=0x7fa74c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:13.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.522+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa74806ae20 con 0x7fa740004d40 2024-09-17T02:59:13.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:13.696+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa7580b5d40 con 0x7fa740004d40 2024-09-17T02:59:14.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.379+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7fa7480636c0 con 0x7fa740004d40 2024-09-17T02:59:14.378 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T02:59:14.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.380+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(92..92 src has 1..92) ==== 296+0+0 (secure 0 0 0) 0x7fa7480d1d90 con 0x7fa740004d40 2024-09-17T02:59:14.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.380+0000 7fa7557fa640 1 -- 172.21.15.104:0/4156781171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7fa74407ed00 con 0x7fa740004d40 2024-09-17T02:59:14.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.384+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa744078b90 msgr2=0x7fa74407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:14.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.384+0000 7fa75ebad640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa744078b90 0x7fa74407b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa7580cdd20 tx=0x7fa74c009500 comp rx=0 tx=0).stop 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.384+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 msgr2=0x7fa758153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.384+0000 7fa75ebad640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 0x7fa758153fc0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa748000fb0 tx=0x7fa74800eb60 comp rx=0 tx=0).stop 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.385+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 shutdown_connections 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.385+0000 7fa75ebad640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa744078b90 0x7fa74407b0a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.385+0000 7fa75ebad640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75815c100 0x7fa7581f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.385+0000 7fa75ebad640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75815c5d0 0x7fa7581f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.385+0000 7fa75ebad640 1 --2- 172.21.15.104:0/4156781171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa740004d40 0x7fa758153fc0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.385+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 >> 172.21.15.104:0/4156781171 conn(0x7fa7580b3c70 msgr2=0x7fa7580ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:14.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.385+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 shutdown_connections 2024-09-17T02:59:14.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.385+0000 7fa75ebad640 1 -- 172.21.15.104:0/4156781171 wait complete. 2024-09-17T02:59:14.399 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T02:59:14.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.521+0000 7fd94564d640 1 -- 172.21.15.104:0/1714597642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd940145f80 msgr2=0x7fd940145990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:14.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.521+0000 7fd94564d640 1 --2- 172.21.15.104:0/1714597642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd940145f80 0x7fd940145990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd928009830 tx=0x7fd92802a480 comp rx=0 tx=0).stop 2024-09-17T02:59:14.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.521+0000 7fd94564d640 1 -- 172.21.15.104:0/1714597642 shutdown_connections 2024-09-17T02:59:14.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.521+0000 7fd94564d640 1 --2- 172.21.15.104:0/1714597642 >> v2:172.21.15.192:3300/0 conn(0x7fd94006f6d0 0x7fd94006fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:14.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.521+0000 7fd94564d640 1 --2- 172.21.15.104:0/1714597642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd940145f80 0x7fd940145990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:14.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.521+0000 7fd94564d640 1 -- 172.21.15.104:0/1714597642 >> 172.21.15.104:0/1714597642 conn(0x7fd9400b3c70 msgr2=0x7fd9400d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:14.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.521+0000 7fd94564d640 1 -- 172.21.15.104:0/1714597642 shutdown_connections 2024-09-17T02:59:14.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.521+0000 7fd94564d640 1 -- 172.21.15.104:0/1714597642 wait complete. 2024-09-17T02:59:14.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.523+0000 7fd94564d640 1 Processor -- start 2024-09-17T02:59:14.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.523+0000 7fd94564d640 1 -- start start 2024-09-17T02:59:14.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd94564d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd94006f6d0 0x7fd9401f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:14.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd94564d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd940074080 0x7fd9401f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:14.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd94564d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd940145f80 0x7fd94013f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:14.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd94564d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd940068e80 con 0x7fd940145f80 2024-09-17T02:59:14.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd94564d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd940068d00 con 0x7fd940074080 2024-09-17T02:59:14.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd94564d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd940069000 con 0x7fd94006f6d0 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd93f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd940145f80 0x7fd94013f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd93f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd940145f80 0x7fd94013f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53576/0 (socket says 172.21.15.104:53576) 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd93f7fe640 1 -- 172.21.15.104:0/2543957037 learned_addr learned my addr 172.21.15.104:0/2543957037 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd93effd640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd94006f6d0 0x7fd9401f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.524+0000 7fd9367fc640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd940074080 0x7fd9401f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd93f7fe640 1 -- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd94006f6d0 msgr2=0x7fd9401f7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd93f7fe640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd94006f6d0 0x7fd9401f7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd93f7fe640 1 -- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd940074080 msgr2=0x7fd9401f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd93f7fe640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd940074080 0x7fd9401f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd93f7fe640 1 -- 172.21.15.104:0/2543957037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9401f49a0 con 0x7fd940145f80 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd93effd640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd94006f6d0 0x7fd9401f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd9367fc640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd940074080 0x7fd9401f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T02:59:14.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd93f7fe640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd940145f80 0x7fd94013f000 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd93800ebf0 tx=0x7fd93800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:14.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938003b70 con 0x7fd940145f80 2024-09-17T02:59:14.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd938003d10 con 0x7fd940145f80 2024-09-17T02:59:14.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd938004280 con 0x7fd940145f80 2024-09-17T02:59:14.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9401f7f70 con 0x7fd940145f80 2024-09-17T02:59:14.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.525+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9400afe70 con 0x7fd940145f80 2024-09-17T02:59:14.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.526+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9400b0d10 con 0x7fd940145f80 2024-09-17T02:59:14.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.527+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd938004420 con 0x7fd940145f80 2024-09-17T02:59:14.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.527+0000 7fd937fff640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd920078b90 0x7fd92007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:14.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.527+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5415+0+0 (secure 0 0 0) 0x7fd93809b800 con 0x7fd940145f80 2024-09-17T02:59:14.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.528+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7fd92007fa70 con 0x7fd940145f80 2024-09-17T02:59:14.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.528+0000 7fd93effd640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd920078b90 0x7fd92007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:14.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.528+0000 7fd93effd640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd920078b90 0x7fd92007b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd930001b10 tx=0x7fd930007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:14.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.532+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9400b0d10 con 0x7fd940145f80 2024-09-17T02:59:14.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:14.705+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd9400694d0 con 0x7fd940145f80 2024-09-17T02:59:15.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.389+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7fd938063710 con 0x7fd940145f80 2024-09-17T02:59:15.388 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T02:59:15.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.389+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(93..93 src has 1..93) ==== 338+0+0 (secure 0 0 0) 0x7fd938099f60 con 0x7fd940145f80 2024-09-17T02:59:15.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.389+0000 7fd937fff640 1 -- 172.21.15.104:0/2543957037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=94}) -- 0x7fd92007e800 con 0x7fd940145f80 2024-09-17T02:59:15.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.396+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd920078b90 msgr2=0x7fd92007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd920078b90 0x7fd92007b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd930001b10 tx=0x7fd930007e90 comp rx=0 tx=0).stop 2024-09-17T02:59:15.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd940145f80 msgr2=0x7fd94013f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd940145f80 0x7fd94013f000 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd93800ebf0 tx=0x7fd93800c6a0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 shutdown_connections 2024-09-17T02:59:15.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd920078b90 0x7fd92007b0a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd940074080 0x7fd9401f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd940145f80 0x7fd94013f000 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 --2- 172.21.15.104:0/2543957037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd94006f6d0 0x7fd9401f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.397+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 >> 172.21.15.104:0/2543957037 conn(0x7fd9400b3c70 msgr2=0x7fd9400b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:15.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.399+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 shutdown_connections 2024-09-17T02:59:15.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.399+0000 7fd94564d640 1 -- 172.21.15.104:0/2543957037 wait complete. 2024-09-17T02:59:15.421 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T02:59:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.537+0000 7f9697b69640 1 -- 172.21.15.104:0/272558803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9690072470 msgr2=0x7f9690072880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.537+0000 7f9697b69640 1 --2- 172.21.15.104:0/272558803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9690072470 0x7f9690072880 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f969006ecb0 tx=0x7f968002a480 comp rx=0 tx=0).stop 2024-09-17T02:59:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.537+0000 7f9697b69640 1 -- 172.21.15.104:0/272558803 shutdown_connections 2024-09-17T02:59:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.537+0000 7f9697b69640 1 --2- 172.21.15.104:0/272558803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9690072470 0x7f9690072880 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.537+0000 7f9697b69640 1 --2- 172.21.15.104:0/272558803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f969015b7f0 0x7f969015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.537+0000 7f9697b69640 1 -- 172.21.15.104:0/272558803 >> 172.21.15.104:0/272558803 conn(0x7f96900b2450 msgr2=0x7f96900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.537+0000 7f9697b69640 1 -- 172.21.15.104:0/272558803 shutdown_connections 2024-09-17T02:59:15.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.537+0000 7f9697b69640 1 -- 172.21.15.104:0/272558803 wait complete. 2024-09-17T02:59:15.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.539+0000 7f9697b69640 1 Processor -- start 2024-09-17T02:59:15.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.539+0000 7f9697b69640 1 -- start start 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9697b69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9690072470 0x7f969015d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9697b69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690072dc0 0x7f9690153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9697b69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969015b7f0 0x7f969014ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9697b69640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f969015fe30 con 0x7f969015b7f0 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9697b69640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f96900cf4a0 con 0x7f9690072dc0 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9697b69640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f969015ffb0 con 0x7f9690072470 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9696106640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969015b7f0 0x7f969014ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9696106640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969015b7f0 0x7f969014ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53598/0 (socket says 172.21.15.104:53598) 2024-09-17T02:59:15.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9696106640 1 -- 172.21.15.104:0/3536254764 learned_addr learned my addr 172.21.15.104:0/3536254764 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9695905640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9690072470 0x7f969015d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9695104640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690072dc0 0x7f9690153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9696106640 1 -- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9690072470 msgr2=0x7f969015d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9696106640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9690072470 0x7f969015d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9696106640 1 -- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690072dc0 msgr2=0x7f9690153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.540+0000 7f9696106640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690072dc0 0x7f9690153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.541+0000 7f9696106640 1 -- 172.21.15.104:0/3536254764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969015af60 con 0x7f969015b7f0 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.541+0000 7f9695905640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9690072470 0x7f969015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:15.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.541+0000 7f9696106640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969015b7f0 0x7f969014ceb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f968800c730 tx=0x7f968800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:15.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.541+0000 7f96867fc640 1 -- 172.21.15.104:0/3536254764 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688017070 con 0x7f969015b7f0 2024-09-17T02:59:15.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.541+0000 7f96867fc640 1 -- 172.21.15.104:0/3536254764 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9688003c60 con 0x7f969015b7f0 2024-09-17T02:59:15.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.541+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969015c3c0 con 0x7f969015b7f0 2024-09-17T02:59:15.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.541+0000 7f96867fc640 1 -- 172.21.15.104:0/3536254764 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96880052d0 con 0x7f969015b7f0 2024-09-17T02:59:15.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.541+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969015c980 con 0x7f969015b7f0 2024-09-17T02:59:15.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.542+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96901604d0 con 0x7f969015b7f0 2024-09-17T02:59:15.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.543+0000 7f96867fc640 1 -- 172.21.15.104:0/3536254764 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f968801a070 con 0x7f969015b7f0 2024-09-17T02:59:15.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.543+0000 7f96867fc640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9674078b90 0x7f967407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:15.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.543+0000 7f96867fc640 1 -- 172.21.15.104:0/3536254764 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7f968809a050 con 0x7f969015b7f0 2024-09-17T02:59:15.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.543+0000 7f96867fc640 1 -- 172.21.15.104:0/3536254764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=94}) -- 0x7f967407e3d0 con 0x7f969015b7f0 2024-09-17T02:59:15.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.543+0000 7f9695905640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9674078b90 0x7f967407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:15.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.544+0000 7f9695905640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9674078b90 0x7f967407b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f968c005fd0 tx=0x7f968c005e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:15.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.548+0000 7f96867fc640 1 -- 172.21.15.104:0/3536254764 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9688062790 con 0x7f969015b7f0 2024-09-17T02:59:15.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.724+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f96901548c0 con 0x7f969015b7f0 2024-09-17T02:59:15.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.728+0000 7f96867fc640 1 -- 172.21.15.104:0/3536254764 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7f9688062090 con 0x7f969015b7f0 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9674078b90 msgr2=0x7f967407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9674078b90 0x7f967407b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f968c005fd0 tx=0x7f968c005e20 comp rx=0 tx=0).stop 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969015b7f0 msgr2=0x7f969014ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969015b7f0 0x7f969014ceb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f968800c730 tx=0x7f968800cbf0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 shutdown_connections 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9674078b90 0x7f967407b0a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690072dc0 0x7f9690153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f969015b7f0 0x7f969014ceb0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 --2- 172.21.15.104:0/3536254764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9690072470 0x7f969015d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 >> 172.21.15.104:0/3536254764 conn(0x7f96900b2450 msgr2=0x7f9690075e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:15.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 shutdown_connections 2024-09-17T02:59:15.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.731+0000 7f9697b69640 1 -- 172.21.15.104:0/3536254764 wait complete. 2024-09-17T02:59:15.741 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-17T02:59:15.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.854+0000 7ffa5549b640 1 -- 172.21.15.104:0/2817054380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b6f70 msgr2=0x7ffa5015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.854+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2817054380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b6f70 0x7ffa5015ef90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009830 tx=0x7ffa4002a480 comp rx=0 tx=0).stop 2024-09-17T02:59:15.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.854+0000 7ffa5549b640 1 -- 172.21.15.104:0/2817054380 shutdown_connections 2024-09-17T02:59:15.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.854+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2817054380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa500b3b00 0x7ffa500d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.854+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2817054380 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b6f70 0x7ffa5015ef90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.854+0000 7ffa5549b640 1 -- 172.21.15.104:0/2817054380 >> 172.21.15.104:0/2817054380 conn(0x7ffa50073df0 msgr2=0x7ffa50068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:15.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.854+0000 7ffa5549b640 1 -- 172.21.15.104:0/2817054380 shutdown_connections 2024-09-17T02:59:15.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.854+0000 7ffa5549b640 1 -- 172.21.15.104:0/2817054380 wait complete. 2024-09-17T02:59:15.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.856+0000 7ffa5549b640 1 Processor -- start 2024-09-17T02:59:15.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.856+0000 7ffa5549b640 1 -- start start 2024-09-17T02:59:15.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa5549b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b3b00 0x7ffa500cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:15.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa5549b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa500b6f70 0x7ffa501f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa5549b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa500d1710 0x7ffa5015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa5549b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ffa500d01b0 con 0x7ffa500b3b00 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa5549b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffa500d0030 con 0x7ffa500b6f70 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa5549b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ffa500d0330 con 0x7ffa500d1710 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b3b00 0x7ffa500cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b3b00 0x7ffa500cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53620/0 (socket says 172.21.15.104:53620) 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4effd640 1 -- 172.21.15.104:0/2606422058 learned_addr learned my addr 172.21.15.104:0/2606422058 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4e7fc640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa500b6f70 0x7ffa501f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:15.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4f7fe640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa500d1710 0x7ffa5015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4effd640 1 -- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa500d1710 msgr2=0x7ffa5015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4effd640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa500d1710 0x7ffa5015ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4effd640 1 -- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa500b6f70 msgr2=0x7ffa501f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4effd640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa500b6f70 0x7ffa501f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.857+0000 7ffa4effd640 1 -- 172.21.15.104:0/2606422058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa500c85e0 con 0x7ffa500b3b00 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.858+0000 7ffa4effd640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b3b00 0x7ffa500cea50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000c00 tx=0x7ffa40033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.858+0000 7ffa377fe640 1 -- 172.21.15.104:0/2606422058 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40005c90 con 0x7ffa500b3b00 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.858+0000 7ffa377fe640 1 -- 172.21.15.104:0/2606422058 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa40031e50 con 0x7ffa500b3b00 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.858+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa500c88c0 con 0x7ffa500b3b00 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.858+0000 7ffa377fe640 1 -- 172.21.15.104:0/2606422058 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400332f0 con 0x7ffa500b3b00 2024-09-17T02:59:15.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.858+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa500c8e80 con 0x7ffa500b3b00 2024-09-17T02:59:15.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.859+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa500cf2f0 con 0x7ffa500b3b00 2024-09-17T02:59:15.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.859+0000 7ffa377fe640 1 -- 172.21.15.104:0/2606422058 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa40033490 con 0x7ffa500b3b00 2024-09-17T02:59:15.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.860+0000 7ffa377fe640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffa3c078b90 0x7ffa3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:15.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.860+0000 7ffa377fe640 1 -- 172.21.15.104:0/2606422058 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7ffa400bbd60 con 0x7ffa500b3b00 2024-09-17T02:59:15.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.860+0000 7ffa4e7fc640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffa3c078b90 0x7ffa3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:15.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.860+0000 7ffa377fe640 1 -- 172.21.15.104:0/2606422058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=94}) -- 0x7ffa3c07e3d0 con 0x7ffa500b3b00 2024-09-17T02:59:15.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.861+0000 7ffa4e7fc640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffa3c078b90 0x7ffa3c07b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffa500b3320 tx=0x7ffa4400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:15.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:15.865+0000 7ffa377fe640 1 -- 172.21.15.104:0/2606422058 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa4003f030 con 0x7ffa500b3b00 2024-09-17T02:59:16.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.105+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7ffa5006d3d0 con 0x7ffa500b3b00 2024-09-17T02:59:16.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.393+0000 7ffa377fe640 1 -- 172.21.15.104:0/2606422058 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v234) ==== 133+0+0 (secure 0 0 0) 0x7ffa40083e60 con 0x7ffa500b3b00 2024-09-17T02:59:16.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffa3c078b90 msgr2=0x7ffa3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffa3c078b90 0x7ffa3c07b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffa500b3320 tx=0x7ffa4400b2e0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b3b00 msgr2=0x7ffa500cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b3b00 0x7ffa500cea50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000c00 tx=0x7ffa40033c90 comp rx=0 tx=0).stop 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 shutdown_connections 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ffa3c078b90 0x7ffa3c07b0a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa500b6f70 0x7ffa501f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa500d1710 0x7ffa5015ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 --2- 172.21.15.104:0/2606422058 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ffa500b3b00 0x7ffa500cea50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 >> 172.21.15.104:0/2606422058 conn(0x7ffa50073df0 msgr2=0x7ffa500b83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 shutdown_connections 2024-09-17T02:59:16.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.396+0000 7ffa5549b640 1 -- 172.21.15.104:0/2606422058 wait complete. 2024-09-17T02:59:16.405 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-17T02:59:16.406 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-17T02:59:16.406 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:59:16.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.520+0000 7f2a09932640 1 -- 172.21.15.104:0/2685927381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040d18e0 msgr2=0x7f2a040d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.520+0000 7f2a09932640 1 --2- 172.21.15.104:0/2685927381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040d18e0 0x7f2a040d34f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f29fc005fd0 tx=0x7f29fc02a5c0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.520+0000 7f2a09932640 1 -- 172.21.15.104:0/2685927381 shutdown_connections 2024-09-17T02:59:16.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.520+0000 7f2a09932640 1 --2- 172.21.15.104:0/2685927381 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040d18e0 0x7f2a040d34f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.520+0000 7f2a09932640 1 --2- 172.21.15.104:0/2685927381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a040b6f70 0x7f2a0415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.520+0000 7f2a09932640 1 -- 172.21.15.104:0/2685927381 >> 172.21.15.104:0/2685927381 conn(0x7f2a04073df0 msgr2=0x7f2a04068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:16.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.520+0000 7f2a09932640 1 -- 172.21.15.104:0/2685927381 shutdown_connections 2024-09-17T02:59:16.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.520+0000 7f2a09932640 1 -- 172.21.15.104:0/2685927381 wait complete. 2024-09-17T02:59:16.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.521+0000 7f2a09932640 1 Processor -- start 2024-09-17T02:59:16.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.522+0000 7f2a09932640 1 -- start start 2024-09-17T02:59:16.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a09932640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a040b3b00 0x7f2a040c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:16.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a09932640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040b6f70 0x7f2a04151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a09932640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a040d18e0 0x7f2a041f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a09932640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2a040d3dc0 con 0x7f2a040b6f70 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a09932640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a040d3c40 con 0x7f2a040d18e0 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a09932640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2a040d3f40 con 0x7f2a040b3b00 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a027fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040b6f70 0x7f2a04151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a027fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040b6f70 0x7f2a04151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53642/0 (socket says 172.21.15.104:53642) 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a027fc640 1 -- 172.21.15.104:0/3295297042 learned_addr learned my addr 172.21.15.104:0/3295297042 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a02ffd640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a040b3b00 0x7f2a040c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a037fe640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a040d18e0 0x7f2a041f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a027fc640 1 -- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a040b3b00 msgr2=0x7f2a040c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a027fc640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a040b3b00 0x7f2a040c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a027fc640 1 -- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a040d18e0 msgr2=0x7f2a041f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a027fc640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a040d18e0 0x7f2a041f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.523+0000 7f2a027fc640 1 -- 172.21.15.104:0/3295297042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a04152470 con 0x7f2a040b6f70 2024-09-17T02:59:16.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.524+0000 7f2a027fc640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040b6f70 0x7f2a04151f30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c3f0 tx=0x7f29f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:16.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.524+0000 7f29ebfff640 1 -- 172.21.15.104:0/3295297042 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8017070 con 0x7f2a040b6f70 2024-09-17T02:59:16.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.524+0000 7f29ebfff640 1 -- 172.21.15.104:0/3295297042 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29f80035f0 con 0x7f2a040b6f70 2024-09-17T02:59:16.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.524+0000 7f29ebfff640 1 -- 172.21.15.104:0/3295297042 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8003a40 con 0x7f2a040b6f70 2024-09-17T02:59:16.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.524+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a040cb5c0 con 0x7f2a040b6f70 2024-09-17T02:59:16.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.524+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a04161010 con 0x7f2a040b6f70 2024-09-17T02:59:16.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.525+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a040d4460 con 0x7f2a040b6f70 2024-09-17T02:59:16.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.526+0000 7f29ebfff640 1 -- 172.21.15.104:0/3295297042 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29f801a070 con 0x7f2a040b6f70 2024-09-17T02:59:16.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.526+0000 7f29ebfff640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f0078b90 0x7f29f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:16.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.526+0000 7f29ebfff640 1 -- 172.21.15.104:0/3295297042 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 4943+0+0 (secure 0 0 0) 0x7f29f8099d30 con 0x7f2a040b6f70 2024-09-17T02:59:16.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.526+0000 7f29ebfff640 1 -- 172.21.15.104:0/3295297042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=94}) -- 0x7f29f007e3d0 con 0x7f2a040b6f70 2024-09-17T02:59:16.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.526+0000 7f2a02ffd640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f0078b90 0x7f29f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:16.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.527+0000 7f2a02ffd640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f0078b90 0x7f29f007b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f29f4005fd0 tx=0x7f29f40097d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:16.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.531+0000 7f29ebfff640 1 -- 172.21.15.104:0/3295297042 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29f8062500 con 0x7f2a040b6f70 2024-09-17T02:59:16.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.706+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a040ba770 con 0x7f2a040b6f70 2024-09-17T02:59:16.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.707+0000 7f29ebfff640 1 -- 172.21.15.104:0/3295297042 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+13093 (secure 0 0 0) 0x7f29f8061e00 con 0x7f2a040b6f70 2024-09-17T02:59:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:16.705 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":93,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:59:15.387974+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/233806124":"2024-09-18T02:59:12.375334+0000","172.21.15.104:6833/233806124":"2024-09-18T02:59:12.375334+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:59:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f0078b90 msgr2=0x7f29f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f0078b90 0x7f29f007b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f29f4005fd0 tx=0x7f29f40097d0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040b6f70 msgr2=0x7f2a04151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040b6f70 0x7f2a04151f30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c3f0 tx=0x7f29f800c8b0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 shutdown_connections 2024-09-17T02:59:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f0078b90 0x7f29f007b0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a040d18e0 0x7f2a041f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a040b6f70 0x7f2a04151f30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 --2- 172.21.15.104:0/3295297042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2a040b3b00 0x7f2a040c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 >> 172.21.15.104:0/3295297042 conn(0x7f2a04073df0 msgr2=0x7f2a040d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:16.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 shutdown_connections 2024-09-17T02:59:16.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.709+0000 7f2a09932640 1 -- 172.21.15.104:0/3295297042 wait complete. 2024-09-17T02:59:16.719 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T02:59:16.719 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T02:59:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.839+0000 7f179a7c6640 1 -- 172.21.15.104:0/1566530382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f177c005250 msgr2=0x7f177c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.839+0000 7f179a7c6640 1 --2- 172.21.15.104:0/1566530382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f177c005250 0x7f177c00b9c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c610 tx=0x7f177c005830 comp rx=0 tx=0).stop 2024-09-17T02:59:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.839+0000 7f179a7c6640 1 -- 172.21.15.104:0/1566530382 shutdown_connections 2024-09-17T02:59:16.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.839+0000 7f179a7c6640 1 --2- 172.21.15.104:0/1566530382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f177c005250 0x7f177c00b9c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.839+0000 7f179a7c6640 1 -- 172.21.15.104:0/1566530382 >> 172.21.15.104:0/1566530382 conn(0x7f17940b44a0 msgr2=0x7f17940b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:16.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.839+0000 7f179a7c6640 1 -- 172.21.15.104:0/1566530382 shutdown_connections 2024-09-17T02:59:16.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.839+0000 7f179a7c6640 1 -- 172.21.15.104:0/1566530382 wait complete. 2024-09-17T02:59:16.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.841+0000 7f179a7c6640 1 Processor -- start 2024-09-17T02:59:16.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.841+0000 7f179a7c6640 1 -- start start 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.842+0000 7f179a7c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f177c005250 0x7f1794150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f179a7c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17940b1100 0x7f179415ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f179a7c6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f179415f3a0 0x7f17941f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f179a7c6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f17941611e0 con 0x7f17940b1100 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f179a7c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1794161060 con 0x7f177c005250 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f179a7c6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1794161360 con 0x7f179415f3a0 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17940b1100 0x7f179415ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17940b1100 0x7f179415ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53660/0 (socket says 172.21.15.104:53660) 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 -- 172.21.15.104:0/3763685245 learned_addr learned my addr 172.21.15.104:0/3763685245 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 -- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f179415f3a0 msgr2=0x7f17941f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f179415f3a0 0x7f17941f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f1793fff640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f177c005250 0x7f1794150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 -- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f177c005250 msgr2=0x7f1794150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f177c005250 0x7f1794150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 -- 172.21.15.104:0/3763685245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17940c6560 con 0x7f17940b1100 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f17937fe640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17940b1100 0x7f179415ee60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1788003ef0 tx=0x7f1788001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f1790ff9640 1 -- 172.21.15.104:0/3763685245 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788015070 con 0x7f17940b1100 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f1790ff9640 1 -- 172.21.15.104:0/3763685245 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1788011840 con 0x7f17940b1100 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179415f7b0 con 0x7f17940b1100 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f1790ff9640 1 -- 172.21.15.104:0/3763685245 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788011c30 con 0x7f17940b1100 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.843+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17940c6ae0 con 0x7f17940b1100 2024-09-17T02:59:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.844+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17940b1930 con 0x7f17940b1100 2024-09-17T02:59:16.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.845+0000 7f1790ff9640 1 -- 172.21.15.104:0/3763685245 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1788018070 con 0x7f17940b1100 2024-09-17T02:59:16.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.845+0000 7f1790ff9640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1780078b90 0x7f178007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:16.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.846+0000 7f1790ff9640 1 -- 172.21.15.104:0/3763685245 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4943+0+0 (secure 0 0 0) 0x7f178809b650 con 0x7f17940b1100 2024-09-17T02:59:16.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.846+0000 7f1793fff640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1780078b90 0x7f178007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:16.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.846+0000 7f1793fff640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1780078b90 0x7f178007b0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1794074650 tx=0x7f1784005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:16.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:16.850+0000 7f1790ff9640 1 -- 172.21.15.104:0/3763685245 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1788063d90 con 0x7f17940b1100 2024-09-17T02:59:17.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.023+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f17941618c0 con 0x7f17940b1100 2024-09-17T02:59:17.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.023+0000 7f1790ff9640 1 -- 172.21.15.104:0/3763685245 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f1788063690 con 0x7f17940b1100 2024-09-17T02:59:17.022 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T02:59:17.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1780078b90 msgr2=0x7f178007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:17.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1780078b90 0x7f178007b0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1794074650 tx=0x7f1784005f90 comp rx=0 tx=0).stop 2024-09-17T02:59:17.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17940b1100 msgr2=0x7f179415ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17940b1100 0x7f179415ee60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1788003ef0 tx=0x7f1788001630 comp rx=0 tx=0).stop 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 shutdown_connections 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1780078b90 0x7f178007b0a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f179415f3a0 0x7f17941f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17940b1100 0x7f179415ee60 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.025+0000 7f179a7c6640 1 --2- 172.21.15.104:0/3763685245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f177c005250 0x7f1794150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.026+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 >> 172.21.15.104:0/3763685245 conn(0x7f17940b44a0 msgr2=0x7f17940ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.026+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 shutdown_connections 2024-09-17T02:59:17.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.026+0000 7f179a7c6640 1 -- 172.21.15.104:0/3763685245 wait complete. 2024-09-17T02:59:17.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-17T02:59:17.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.149+0000 7fa53f307640 1 -- 172.21.15.104:0/3004406731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5380ce280 msgr2=0x7fa5380ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:17.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.149+0000 7fa53f307640 1 --2- 172.21.15.104:0/3004406731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5380ce280 0x7fa5380ce690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa530005fd0 tx=0x7fa53002a820 comp rx=0 tx=0).stop 2024-09-17T02:59:17.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.149+0000 7fa53f307640 1 -- 172.21.15.104:0/3004406731 shutdown_connections 2024-09-17T02:59:17.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.149+0000 7fa53f307640 1 --2- 172.21.15.104:0/3004406731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5380ce280 0x7fa5380ce690 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:17.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.149+0000 7fa53f307640 1 --2- 172.21.15.104:0/3004406731 >> v2:172.21.15.192:3300/0 conn(0x7fa53815bc00 0x7fa538072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:17.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.149+0000 7fa53f307640 1 -- 172.21.15.104:0/3004406731 >> 172.21.15.104:0/3004406731 conn(0x7fa5380b2450 msgr2=0x7fa5380b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:17.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.150+0000 7fa53f307640 1 -- 172.21.15.104:0/3004406731 shutdown_connections 2024-09-17T02:59:17.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.150+0000 7fa53f307640 1 -- 172.21.15.104:0/3004406731 wait complete. 2024-09-17T02:59:17.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.151+0000 7fa53f307640 1 Processor -- start 2024-09-17T02:59:17.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.151+0000 7fa53f307640 1 -- start start 2024-09-17T02:59:17.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.152+0000 7fa53f307640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5380ce280 0x7fa538157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:17.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53f307640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53815b7f0 0x7fa53815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:17.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53f307640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa53815bc00 0x7fa53806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:17.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53f307640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa5380cebd0 con 0x7fa53815bc00 2024-09-17T02:59:17.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53f307640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa5380700c0 con 0x7fa5380ce280 2024-09-17T02:59:17.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53f307640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa5380ced50 con 0x7fa53815b7f0 2024-09-17T02:59:17.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa53815bc00 0x7fa53806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:17.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa53815bc00 0x7fa53806ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53668/0 (socket says 172.21.15.104:53668) 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 -- 172.21.15.104:0/915103567 learned_addr learned my addr 172.21.15.104:0/915103567 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53c8a2640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53815b7f0 0x7fa53815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d0a3640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5380ce280 0x7fa538157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 -- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53815b7f0 msgr2=0x7fa53815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53815b7f0 0x7fa53815ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 -- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5380ce280 msgr2=0x7fa538157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5380ce280 0x7fa538157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 -- 172.21.15.104:0/915103567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa538143e90 con 0x7fa53815bc00 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53d8a4640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa53815bc00 0x7fa53806ed60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa530035040 tx=0x7fa530032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa52dffb640 1 -- 172.21.15.104:0/915103567 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530037040 con 0x7fa53815bc00 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa52dffb640 1 -- 172.21.15.104:0/915103567 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa530032e50 con 0x7fa53815bc00 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5381f8020 con 0x7fa53815bc00 2024-09-17T02:59:17.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.153+0000 7fa52dffb640 1 -- 172.21.15.104:0/915103567 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530003e60 con 0x7fa53815bc00 2024-09-17T02:59:17.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.154+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5381f7540 con 0x7fa53815bc00 2024-09-17T02:59:17.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.155+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5380cf240 con 0x7fa53815bc00 2024-09-17T02:59:17.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.155+0000 7fa52dffb640 1 -- 172.21.15.104:0/915103567 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa530044020 con 0x7fa53815bc00 2024-09-17T02:59:17.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.156+0000 7fa52dffb640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa51c078bc0 0x7fa51c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:17.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.156+0000 7fa52dffb640 1 -- 172.21.15.104:0/915103567 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4943+0+0 (secure 0 0 0) 0x7fa5300bafc0 con 0x7fa53815bc00 2024-09-17T02:59:17.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.156+0000 7fa53d0a3640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa51c078bc0 0x7fa51c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:17.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.157+0000 7fa53d0a3640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa51c078bc0 0x7fa51c07b0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa538074300 tx=0x7fa534009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:17.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.161+0000 7fa52dffb640 1 -- 172.21.15.104:0/915103567 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa53004b020 con 0x7fa53815bc00 2024-09-17T02:59:17.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:17.410+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7fa5380ccbf0 con 0x7fa53815bc00 2024-09-17T02:59:18.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.408+0000 7fa52dffb640 1 -- 172.21.15.104:0/915103567 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v236) ==== 140+0+0 (secure 0 0 0) 0x7fa530083710 con 0x7fa53815bc00 2024-09-17T02:59:18.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa51c078bc0 msgr2=0x7fa51c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa51c078bc0 0x7fa51c07b0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa538074300 tx=0x7fa534009040 comp rx=0 tx=0).stop 2024-09-17T02:59:18.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa53815bc00 msgr2=0x7fa53806ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa53815bc00 0x7fa53806ed60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa530035040 tx=0x7fa530032c60 comp rx=0 tx=0).stop 2024-09-17T02:59:18.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 shutdown_connections 2024-09-17T02:59:18.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa51c078bc0 0x7fa51c07b0d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa53815bc00 0x7fa53806ed60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa53815b7f0 0x7fa53815ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.411+0000 7fa53f307640 1 --2- 172.21.15.104:0/915103567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5380ce280 0x7fa538157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.412+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 >> 172.21.15.104:0/915103567 conn(0x7fa5380b2450 msgr2=0x7fa5381575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:18.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.412+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 shutdown_connections 2024-09-17T02:59:18.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.412+0000 7fa53f307640 1 -- 172.21.15.104:0/915103567 wait complete. 2024-09-17T02:59:18.424 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-17T02:59:18.548 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_objectstore":"memstore"} 2024-09-17T02:59:18.549 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-17T02:59:18.549 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T02:59:18.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.661+0000 7fda64ca9640 1 -- 172.21.15.104:0/3106654487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600b7bb0 msgr2=0x7fda600cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.661+0000 7fda64ca9640 1 --2- 172.21.15.104:0/3106654487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600b7bb0 0x7fda600cde90 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fda500098e0 tx=0x7fda5002a410 comp rx=0 tx=0).stop 2024-09-17T02:59:18.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.661+0000 7fda64ca9640 1 -- 172.21.15.104:0/3106654487 shutdown_connections 2024-09-17T02:59:18.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.661+0000 7fda64ca9640 1 --2- 172.21.15.104:0/3106654487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda600d0470 0x7fda600d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.661+0000 7fda64ca9640 1 --2- 172.21.15.104:0/3106654487 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600b7bb0 0x7fda600cde90 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.661+0000 7fda64ca9640 1 -- 172.21.15.104:0/3106654487 >> 172.21.15.104:0/3106654487 conn(0x7fda600d28a0 msgr2=0x7fda600d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:18.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.662+0000 7fda64ca9640 1 -- 172.21.15.104:0/3106654487 shutdown_connections 2024-09-17T02:59:18.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.662+0000 7fda64ca9640 1 -- 172.21.15.104:0/3106654487 wait complete. 2024-09-17T02:59:18.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.663+0000 7fda64ca9640 1 Processor -- start 2024-09-17T02:59:18.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.664+0000 7fda64ca9640 1 -- start start 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda64ca9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda600b7bb0 0x7fda601e56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda64ca9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda600cefb0 0x7fda601d5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda64ca9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600d0470 0x7fda600c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda64ca9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fda600cfad0 con 0x7fda600d0470 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda64ca9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fda600ce5e0 con 0x7fda600cefb0 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda64ca9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fda600cfc50 con 0x7fda600b7bb0 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600d0470 0x7fda600c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600d0470 0x7fda600c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53676/0 (socket says 172.21.15.104:53676) 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 -- 172.21.15.104:0/42533392 learned_addr learned my addr 172.21.15.104:0/42533392 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5e59c640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda600b7bb0 0x7fda601e56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:18.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda57fff640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda600cefb0 0x7fda601d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 -- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda600b7bb0 msgr2=0x7fda601e56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda600b7bb0 0x7fda601e56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 -- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda600cefb0 msgr2=0x7fda601d5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda600cefb0 0x7fda601d5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 -- 172.21.15.104:0/42533392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda601d6100 con 0x7fda600d0470 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda57fff640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda600cefb0 0x7fda601d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.665+0000 7fda5ed9d640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600d0470 0x7fda600c6810 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fda5800b9e0 tx=0x7fda5800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.666+0000 7fda56ffd640 1 -- 172.21.15.104:0/42533392 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda58003b70 con 0x7fda600d0470 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.666+0000 7fda56ffd640 1 -- 172.21.15.104:0/42533392 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda58003e00 con 0x7fda600d0470 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.666+0000 7fda56ffd640 1 -- 172.21.15.104:0/42533392 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5800cb80 con 0x7fda600d0470 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.666+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda601f7ff0 con 0x7fda600d0470 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.666+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda601f85b0 con 0x7fda600d0470 2024-09-17T02:59:18.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.667+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda601f7d60 con 0x7fda600d0470 2024-09-17T02:59:18.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.667+0000 7fda56ffd640 1 -- 172.21.15.104:0/42533392 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda58004000 con 0x7fda600d0470 2024-09-17T02:59:18.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.668+0000 7fda56ffd640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda40078bc0 0x7fda4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:18.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.668+0000 7fda56ffd640 1 -- 172.21.15.104:0/42533392 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4943+0+0 (secure 0 0 0) 0x7fda5809a800 con 0x7fda600d0470 2024-09-17T02:59:18.667 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.668+0000 7fda5e59c640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda40078bc0 0x7fda4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:18.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.669+0000 7fda5e59c640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda40078bc0 0x7fda4007b0d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fda50034000 tx=0x7fda50004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:18.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.672+0000 7fda56ffd640 1 -- 172.21.15.104:0/42533392 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fda580628e0 con 0x7fda600d0470 2024-09-17T02:59:18.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.845+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fda600cde90 con 0x7fda600d0470 2024-09-17T02:59:18.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.845+0000 7fda56ffd640 1 -- 172.21.15.104:0/42533392 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+1472 (secure 0 0 0) 0x7fda58067310 con 0x7fda600d0470 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T02:59:18.844 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T02:59:18.845 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T02:59:18.846 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda40078bc0 msgr2=0x7fda4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda40078bc0 0x7fda4007b0d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fda50034000 tx=0x7fda50004730 comp rx=0 tx=0).stop 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600d0470 msgr2=0x7fda600c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600d0470 0x7fda600c6810 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fda5800b9e0 tx=0x7fda5800bea0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 shutdown_connections 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fda40078bc0 0x7fda4007b0d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda600cefb0 0x7fda601d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fda600d0470 0x7fda600c6810 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 --2- 172.21.15.104:0/42533392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda600b7bb0 0x7fda601e56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 >> 172.21.15.104:0/42533392 conn(0x7fda600d28a0 msgr2=0x7fda600d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 shutdown_connections 2024-09-17T02:59:18.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.847+0000 7fda64ca9640 1 -- 172.21.15.104:0/42533392 wait complete. 2024-09-17T02:59:18.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T02:59:18.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.974+0000 7f262d3e4640 1 -- 172.21.15.104:0/1149526824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2610004d40 msgr2=0x7f2610005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.974+0000 7f262d3e4640 1 --2- 172.21.15.104:0/1149526824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2610004d40 0x7f2610005150 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2620009ed0 tx=0x7f2610005830 comp rx=0 tx=0).stop 2024-09-17T02:59:18.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.974+0000 7f26277fe640 1 -- 172.21.15.104:0/1149526824 reap_dead start 2024-09-17T02:59:18.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.974+0000 7f262d3e4640 1 -- 172.21.15.104:0/1149526824 shutdown_connections 2024-09-17T02:59:18.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.974+0000 7f262d3e4640 1 -- 172.21.15.104:0/1149526824 >> 172.21.15.104:0/1149526824 conn(0x7f26280b3640 msgr2=0x7f26280b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:18.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.974+0000 7f262d3e4640 1 -- 172.21.15.104:0/1149526824 shutdown_connections 2024-09-17T02:59:18.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.974+0000 7f262d3e4640 1 -- 172.21.15.104:0/1149526824 wait complete. 2024-09-17T02:59:18.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.976+0000 7f262d3e4640 1 Processor -- start 2024-09-17T02:59:18.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.976+0000 7f262d3e4640 1 -- start start 2024-09-17T02:59:18.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f262d3e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2610004d40 0x7f26280cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:18.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f262d3e4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26281593a0 0x7f2628155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:18.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f262d3e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26281597b0 0x7f26281558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:18.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f262d3e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f26280b5270 con 0x7f26281597b0 2024-09-17T02:59:18.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f262d3e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f26280b50f0 con 0x7f2610004d40 2024-09-17T02:59:18.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f262d3e4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f26280b53f0 con 0x7f26281593a0 2024-09-17T02:59:18.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f26277fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26281597b0 0x7f26281558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:18.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f26277fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26281597b0 0x7f26281558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53702/0 (socket says 172.21.15.104:53702) 2024-09-17T02:59:18.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f26277fe640 1 -- 172.21.15.104:0/2203302106 learned_addr learned my addr 172.21.15.104:0/2203302106 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:18.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f2626ffd640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2610004d40 0x7f26280cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:18.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.977+0000 7f26267fc640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26281593a0 0x7f2628155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:18.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f26277fe640 1 -- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26281593a0 msgr2=0x7f2628155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f26277fe640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26281593a0 0x7f2628155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f26277fe640 1 -- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2610004d40 msgr2=0x7f26280cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:18.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f26277fe640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2610004d40 0x7f26280cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:18.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f26277fe640 1 -- 172.21.15.104:0/2203302106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26280caff0 con 0x7f26281597b0 2024-09-17T02:59:18.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f2626ffd640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2610004d40 0x7f26280cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:18.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f26277fe640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26281597b0 0x7f26281558d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2620009ed0 tx=0x7f2620033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:18.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f260f7fe640 1 -- 172.21.15.104:0/2203302106 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620038040 con 0x7f26281597b0 2024-09-17T02:59:18.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f260f7fe640 1 -- 172.21.15.104:0/2203302106 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2620033ca0 con 0x7f26281597b0 2024-09-17T02:59:18.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26281f6870 con 0x7f26281597b0 2024-09-17T02:59:18.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f260f7fe640 1 -- 172.21.15.104:0/2203302106 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620003bd0 con 0x7f26281597b0 2024-09-17T02:59:18.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.978+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26281f93b0 con 0x7f26281597b0 2024-09-17T02:59:18.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.979+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26280cde90 con 0x7f26281597b0 2024-09-17T02:59:18.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.980+0000 7f260f7fe640 1 -- 172.21.15.104:0/2203302106 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2620045060 con 0x7f26281597b0 2024-09-17T02:59:18.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.980+0000 7f260f7fe640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2614078bc0 0x7f261407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:18.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.980+0000 7f260f7fe640 1 -- 172.21.15.104:0/2203302106 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4943+0+0 (secure 0 0 0) 0x7f26200ba990 con 0x7f26281597b0 2024-09-17T02:59:18.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.980+0000 7f2626ffd640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2614078bc0 0x7f261407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:18.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.981+0000 7f2626ffd640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2614078bc0 0x7f261407b0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2618001dd0 tx=0x7f2618001d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:18.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:18.985+0000 7f260f7fe640 1 -- 172.21.15.104:0/2203302106 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f26280caff0 con 0x7f26281597b0 2024-09-17T02:59:19.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.159+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2628073990 con 0x7f26281597b0 2024-09-17T02:59:19.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.162+0000 7f260f7fe640 1 -- 172.21.15.104:0/2203302106 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f2620082a80 con 0x7f26281597b0 2024-09-17T02:59:19.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2614078bc0 msgr2=0x7f261407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:19.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2614078bc0 0x7f261407b0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2618001dd0 tx=0x7f2618001d60 comp rx=0 tx=0).stop 2024-09-17T02:59:19.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26281597b0 msgr2=0x7f26281558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:19.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26281597b0 0x7f26281558d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2620009ed0 tx=0x7f2620033c30 comp rx=0 tx=0).stop 2024-09-17T02:59:19.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 shutdown_connections 2024-09-17T02:59:19.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2614078bc0 0x7f261407b0d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f26281597b0 0x7f26281558d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26281593a0 0x7f2628155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 --2- 172.21.15.104:0/2203302106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2610004d40 0x7f26280cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 >> 172.21.15.104:0/2203302106 conn(0x7f26280b3640 msgr2=0x7f262815e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:19.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 shutdown_connections 2024-09-17T02:59:19.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.165+0000 7f262d3e4640 1 -- 172.21.15.104:0/2203302106 wait complete. 2024-09-17T02:59:19.174 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T02:59:19.175 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:59:19.211 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T02:59:19.253 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T02:59:19.254 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:19.254 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:19.269 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:59:19.270 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:59:19.270 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:19.311 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:59:19.312 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:19.312 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:19.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T02:59:19.327 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:59:19.327 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:19.370 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T02:59:19.370 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T02:59:19.370 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:19.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.483+0000 7ff609c20640 1 -- 172.21.15.104:0/3557330602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6040d1ba0 msgr2=0x7ff6040d1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:19.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.483+0000 7ff609c20640 1 --2- 172.21.15.104:0/3557330602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6040d1ba0 0x7ff6040d1fb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc005fd0 tx=0x7ff5fc02aa90 comp rx=0 tx=0).stop 2024-09-17T02:59:19.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.483+0000 7ff609c20640 1 -- 172.21.15.104:0/3557330602 shutdown_connections 2024-09-17T02:59:19.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.483+0000 7ff609c20640 1 --2- 172.21.15.104:0/3557330602 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6040d1ba0 0x7ff6040d1fb0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.483+0000 7ff609c20640 1 --2- 172.21.15.104:0/3557330602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6041457b0 0x7ff6041611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.483+0000 7ff609c20640 1 -- 172.21.15.104:0/3557330602 >> 172.21.15.104:0/3557330602 conn(0x7ff60406cfc0 msgr2=0x7ff60406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:19.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.484+0000 7ff609c20640 1 -- 172.21.15.104:0/3557330602 shutdown_connections 2024-09-17T02:59:19.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.484+0000 7ff609c20640 1 -- 172.21.15.104:0/3557330602 wait complete. 2024-09-17T02:59:19.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.485+0000 7ff609c20640 1 Processor -- start 2024-09-17T02:59:19.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.486+0000 7ff609c20640 1 -- start start 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff609c20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff604073d50 0x7ff6040b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff609c20640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6040d1ba0 0x7ff60415fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff609c20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6041457b0 0x7ff60415ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff609c20640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff6040d0ea0 con 0x7ff6041457b0 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff609c20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6040d0d20 con 0x7ff604073d50 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff609c20640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff6040d1020 con 0x7ff6040d1ba0 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff603fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6041457b0 0x7ff60415ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff603fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6041457b0 0x7ff60415ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53724/0 (socket says 172.21.15.104:53724) 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff603fff640 1 -- 172.21.15.104:0/1135738064 learned_addr learned my addr 172.21.15.104:0/1135738064 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff6037fe640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff604073d50 0x7ff6040b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff602ffd640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6040d1ba0 0x7ff60415fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:19.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff603fff640 1 -- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6040d1ba0 msgr2=0x7ff60415fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff603fff640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6040d1ba0 0x7ff60415fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff603fff640 1 -- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff604073d50 msgr2=0x7ff6040b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff603fff640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff604073d50 0x7ff6040b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.487+0000 7ff603fff640 1 -- 172.21.15.104:0/1135738064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6040afd20 con 0x7ff6041457b0 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.488+0000 7ff603fff640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6041457b0 0x7ff60415ddc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc006010 tx=0x7ff5fc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.488+0000 7ff5ebfff640 1 -- 172.21.15.104:0/1135738064 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc044070 con 0x7ff6041457b0 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.488+0000 7ff5ebfff640 1 -- 172.21.15.104:0/1135738064 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5fc02e7f0 con 0x7ff6041457b0 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.488+0000 7ff5ebfff640 1 -- 172.21.15.104:0/1135738064 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc0044b0 con 0x7ff6041457b0 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.488+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6040b0000 con 0x7ff6041457b0 2024-09-17T02:59:19.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.488+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60415d5c0 con 0x7ff6041457b0 2024-09-17T02:59:19.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.489+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff604145e30 con 0x7ff6041457b0 2024-09-17T02:59:19.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.490+0000 7ff5ebfff640 1 -- 172.21.15.104:0/1135738064 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5fc047070 con 0x7ff6041457b0 2024-09-17T02:59:19.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.490+0000 7ff5ebfff640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff5f0078b90 0x7ff5f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:19.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.491+0000 7ff5ebfff640 1 -- 172.21.15.104:0/1135738064 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4943+0+0 (secure 0 0 0) 0x7ff5fc0bb8f0 con 0x7ff6041457b0 2024-09-17T02:59:19.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.491+0000 7ff6037fe640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff5f0078b90 0x7ff5f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:19.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.491+0000 7ff6037fe640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff5f0078b90 0x7ff5f007b0a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff6040d1ad0 tx=0x7ff5f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:19.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.495+0000 7ff5ebfff640 1 -- 172.21.15.104:0/1135738064 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff604145e30 con 0x7ff6041457b0 2024-09-17T02:59:19.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.704+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff604144ca0 con 0x7ff6041457b0 2024-09-17T02:59:19.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.704+0000 7ff5ebfff640 1 -- 172.21.15.104:0/1135738064 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+3923 (secure 0 0 0) 0x7ff5fc032030 con 0x7ff6041457b0 2024-09-17T02:59:19.703 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:19.703 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":36,"btime":"2024-09-17T02:59:13:377177+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2179511021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2179511021},{"type":"v1","addr":"172.21.15.192:6836","nonce":2179511021}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5683,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1325951818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1325951818},{"type":"v1","addr":"172.21.15.192:6837","nonce":1325951818}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3545243059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3545243059},{"type":"v1","addr":"172.21.15.104:6834","nonce":3545243059}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/2082422406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":2082422406},{"type":"v1","addr":"172.21.15.104:6835","nonce":2082422406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[]} 2024-09-17T02:59:19.703 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 36 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.706+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff5f0078b90 msgr2=0x7ff5f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.706+0000 7ff609c20640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff5f0078b90 0x7ff5f007b0a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff6040d1ad0 tx=0x7ff5f4009040 comp rx=0 tx=0).stop 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6041457b0 msgr2=0x7ff60415ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6041457b0 0x7ff60415ddc0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc006010 tx=0x7ff5fc003f10 comp rx=0 tx=0).stop 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 shutdown_connections 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff5f0078b90 0x7ff5f007b0a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff6041457b0 0x7ff60415ddc0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6040d1ba0 0x7ff60415fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 --2- 172.21.15.104:0/1135738064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff604073d50 0x7ff6040b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 >> 172.21.15.104:0/1135738064 conn(0x7ff60406cfc0 msgr2=0x7ff604142e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:19.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 shutdown_connections 2024-09-17T02:59:19.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:19.707+0000 7ff609c20640 1 -- 172.21.15.104:0/1135738064 wait complete. 2024-09-17T02:59:19.717 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T02:59:19.717 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T02:59:19.717 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T02:59:19.717 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:59:19.717 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T02:59:19.717 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T02:59:19.718 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T02:59:19.718 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:59:19.718 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T02:59:19.718 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T02:59:19.718 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T02:59:19.718 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:59:19.718 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T02:59:19.718 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T02:59:19.719 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T02:59:19.719 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T02:59:19.728 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T02:59:19.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T02:59:19.730 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T02:59:19.730 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T02:59:19.731 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T02:59:19.732 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T02:59:19.772 INFO:tasks.ceph.mds.c:Started 2024-09-17T02:59:19.773 DEBUG:teuthology.parallel:result is None 2024-09-17T02:59:19.773 INFO:tasks.ceph.mds.a:Started 2024-09-17T02:59:19.774 DEBUG:teuthology.parallel:result is None 2024-09-17T02:59:19.774 INFO:tasks.ceph.mds.d:Started 2024-09-17T02:59:19.775 DEBUG:teuthology.parallel:result is None 2024-09-17T02:59:19.855 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T02:59:19.855 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T02:59:19.865 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T02:59:21.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-17T02:59:25.731 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T02:59:25.732 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T02:59:25.735 INFO:tasks.ceph.mds.b:Started 2024-09-17T02:59:25.735 DEBUG:teuthology.parallel:result is None 2024-09-17T02:59:25.735 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T02:59:25.829 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T02:59:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.865+0000 7f9cfd572640 1 -- 172.21.15.104:0/1460564934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80cefb0 msgr2=0x7f9cf80cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.865+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1460564934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80cefb0 0x7f9cf80cf3c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0005fd0 tx=0x7f9cf002a410 comp rx=0 tx=0).stop 2024-09-17T02:59:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.865+0000 7f9cfd572640 1 -- 172.21.15.104:0/1460564934 shutdown_connections 2024-09-17T02:59:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.865+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1460564934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80cefb0 0x7f9cf80cf3c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.865+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1460564934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cf80b7bb0 0x7f9cf80cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.865+0000 7f9cfd572640 1 -- 172.21.15.104:0/1460564934 >> 172.21.15.104:0/1460564934 conn(0x7f9cf80d28a0 msgr2=0x7f9cf80d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.865+0000 7f9cfd572640 1 -- 172.21.15.104:0/1460564934 shutdown_connections 2024-09-17T02:59:25.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.865+0000 7f9cfd572640 1 -- 172.21.15.104:0/1460564934 wait complete. 2024-09-17T02:59:25.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.867+0000 7f9cfd572640 1 Processor -- start 2024-09-17T02:59:25.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.867+0000 7f9cfd572640 1 -- start start 2024-09-17T02:59:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cfd572640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80b7bb0 0x7f9cf815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cfd572640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80cefb0 0x7f9cf80c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cfd572640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cf80d0470 0x7f9cf80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cfd572640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf80cfa80 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cfd572640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf80cf900 con 0x7f9cf80cefb0 2024-09-17T02:59:25.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cfd572640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf80cfc00 con 0x7f9cf80d0470 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cf6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80b7bb0 0x7f9cf815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cf6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80b7bb0 0x7f9cf815be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51918/0 (socket says 172.21.15.104:51918) 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cf6ffd640 1 -- 172.21.15.104:0/1640271280 learned_addr learned my addr 172.21.15.104:0/1640271280 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cf77fe640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cf80d0470 0x7f9cf80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.868+0000 7f9cf67fc640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80cefb0 0x7f9cf80c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cf6ffd640 1 -- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cf80d0470 msgr2=0x7f9cf80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cf6ffd640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cf80d0470 0x7f9cf80c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cf6ffd640 1 -- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80cefb0 msgr2=0x7f9cf80c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cf6ffd640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80cefb0 0x7f9cf80c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cf6ffd640 1 -- 172.21.15.104:0/1640271280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf80cc870 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cf67fc640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80cefb0 0x7f9cf80c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:25.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cf6ffd640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80b7bb0 0x7f9cf815be20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800ccb0 tx=0x7f9ce80075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cdf7fe640 1 -- 172.21.15.104:0/1640271280 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8004b20 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cdf7fe640 1 -- 172.21.15.104:0/1640271280 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ce8004dd0 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf80ccb50 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cdf7fe640 1 -- 172.21.15.104:0/1640271280 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8005280 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.869+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf815fd20 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.870+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf80cf6f0 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.871+0000 7f9cdf7fe640 1 -- 172.21.15.104:0/1640271280 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ce8005420 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.871+0000 7f9cdf7fe640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ce4078b90 0x7f9ce407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.872+0000 7f9cdf7fe640 1 -- 172.21.15.104:0/1640271280 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4943+0+0 (secure 0 0 0) 0x7f9ce809b180 con 0x7f9cf80b7bb0 2024-09-17T02:59:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.872+0000 7f9cf67fc640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ce4078b90 0x7f9ce407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:25.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.872+0000 7f9cf67fc640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ce4078b90 0x7f9ce407b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8167430 tx=0x7f9cec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:25.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:25.876+0000 7f9cdf7fe640 1 -- 172.21.15.104:0/1640271280 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9cf80cf6f0 con 0x7f9cf80b7bb0 2024-09-17T02:59:26.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:26.058+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9cf80cde90 con 0x7f9cf80b7bb0 2024-09-17T02:59:27.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.749+0000 7f9cdf7fe640 1 -- 172.21.15.104:0/1640271280 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) ==== 97+0+0 (secure 0 0 0) 0x7f9ce8014030 con 0x7f9cf80b7bb0 2024-09-17T02:59:27.748 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ce4078b90 msgr2=0x7f9ce407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ce4078b90 0x7f9ce407b0a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8167430 tx=0x7f9cec008040 comp rx=0 tx=0).stop 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80b7bb0 msgr2=0x7f9cf815be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80b7bb0 0x7f9cf815be20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800ccb0 tx=0x7f9ce80075f0 comp rx=0 tx=0).stop 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 shutdown_connections 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9ce4078b90 0x7f9ce407b0a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80cefb0 0x7f9cf80c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cf80d0470 0x7f9cf80c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 --2- 172.21.15.104:0/1640271280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9cf80b7bb0 0x7f9cf815be20 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:27.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 >> 172.21.15.104:0/1640271280 conn(0x7f9cf80d28a0 msgr2=0x7f9cf8071330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:27.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 shutdown_connections 2024-09-17T02:59:27.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.752+0000 7f9cfd572640 1 -- 172.21.15.104:0/1640271280 wait complete. 2024-09-17T02:59:27.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T02:59:27.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-17T02:59:27.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.886+0000 7f4dba6a9640 1 -- 172.21.15.104:0/1486619141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 msgr2=0x7f4d9c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:27.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.886+0000 7f4dba6a9640 1 --2- 172.21.15.104:0/1486619141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 0x7f4d9c003e30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4da400bb20 tx=0x7f4d9c005830 comp rx=0 tx=0).stop 2024-09-17T02:59:27.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.886+0000 7f4db8c46640 1 -- 172.21.15.104:0/1486619141 reap_dead start 2024-09-17T02:59:27.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.886+0000 7f4dba6a9640 1 -- 172.21.15.104:0/1486619141 shutdown_connections 2024-09-17T02:59:27.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.886+0000 7f4dba6a9640 1 -- 172.21.15.104:0/1486619141 >> 172.21.15.104:0/1486619141 conn(0x7f4db40b44a0 msgr2=0x7f4db40b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:27.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.886+0000 7f4dba6a9640 1 -- 172.21.15.104:0/1486619141 shutdown_connections 2024-09-17T02:59:27.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.886+0000 7f4dba6a9640 1 -- 172.21.15.104:0/1486619141 wait complete. 2024-09-17T02:59:27.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.888+0000 7f4dba6a9640 1 Processor -- start 2024-09-17T02:59:27.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.888+0000 7f4dba6a9640 1 -- start start 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4dba6a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 0x7f4db41f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4dba6a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4db40b1a40 0x7f4db415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4dba6a9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4db415d0a0 0x7f4db40b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4dba6a9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40b3b40 con 0x7f4d9c0039e0 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4dba6a9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40b39c0 con 0x7f4db40b1a40 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4dba6a9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4db40b3cc0 con 0x7f4db415d0a0 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4db3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 0x7f4db41f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4db3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 0x7f4db41f3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51940/0 (socket says 172.21.15.104:51940) 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4db3fff640 1 -- 172.21.15.104:0/3167555292 learned_addr learned my addr 172.21.15.104:0/3167555292 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:27.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4db8c46640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4db415d0a0 0x7f4db40b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.889+0000 7f4db37fe640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4db40b1a40 0x7f4db415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db3fff640 1 -- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4db415d0a0 msgr2=0x7f4db40b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db3fff640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4db415d0a0 0x7f4db40b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db3fff640 1 -- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4db40b1a40 msgr2=0x7f4db415cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db3fff640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4db40b1a40 0x7f4db415cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db3fff640 1 -- 172.21.15.104:0/3167555292 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db40b2220 con 0x7f4d9c0039e0 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db3fff640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 0x7f4db41f3940 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4da400ba40 tx=0x7f4da4005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db0ff9640 1 -- 172.21.15.104:0/3167555292 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4040070 con 0x7f4d9c0039e0 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db40af840 con 0x7f4d9c0039e0 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db0ff9640 1 -- 172.21.15.104:0/3167555292 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4da403a920 con 0x7f4d9c0039e0 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4db0ff9640 1 -- 172.21.15.104:0/3167555292 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4035040 con 0x7f4d9c0039e0 2024-09-17T02:59:27.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.890+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db40afae0 con 0x7f4d9c0039e0 2024-09-17T02:59:27.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.892+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db41f3f40 con 0x7f4d9c0039e0 2024-09-17T02:59:27.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.892+0000 7f4db0ff9640 1 -- 172.21.15.104:0/3167555292 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4da404b060 con 0x7f4d9c0039e0 2024-09-17T02:59:27.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.893+0000 7f4db0ff9640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4da0078b90 0x7f4da007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:27.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.893+0000 7f4db0ff9640 1 -- 172.21.15.104:0/3167555292 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7f4da40bb560 con 0x7f4d9c0039e0 2024-09-17T02:59:27.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.893+0000 7f4db37fe640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4da0078b90 0x7f4da007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:27.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.894+0000 7f4db37fe640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4da0078b90 0x7f4da007b0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4db40c8970 tx=0x7f4da8001bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:27.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:27.897+0000 7f4db0ff9640 1 -- 172.21.15.104:0/3167555292 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4da40836a0 con 0x7f4d9c0039e0 2024-09-17T02:59:28.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.139+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4db40b57e0 con 0x7f4d9c0039e0 2024-09-17T02:59:28.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.140+0000 7f4db0ff9640 1 -- 172.21.15.104:0/3167555292 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) ==== 80+0+5304 (secure 0 0 0) 0x7f4da40880d0 con 0x7f4d9c0039e0 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.139 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T02:59:28.141 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:59:28.142 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.143 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:59:28.144 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:59:28.146 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T02:59:28.147 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:59:28.148 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T02:59:28.149 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T02:59:28.150 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.151 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:28.152 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:59:28.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.142+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4da0078b90 msgr2=0x7f4da007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.142+0000 7f4dba6a9640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4da0078b90 0x7f4da007b0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4db40c8970 tx=0x7f4da8001bd0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.142+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 msgr2=0x7f4db41f3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.142+0000 7f4dba6a9640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 0x7f4db41f3940 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4da400ba40 tx=0x7f4da4005890 comp rx=0 tx=0).stop 2024-09-17T02:59:28.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.142+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 shutdown_connections 2024-09-17T02:59:28.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.142+0000 7f4dba6a9640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4da0078b90 0x7f4da007b0a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.142+0000 7f4dba6a9640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4db40b1a40 0x7f4db415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.142+0000 7f4dba6a9640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4db415d0a0 0x7f4db40b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.143+0000 7f4dba6a9640 1 --2- 172.21.15.104:0/3167555292 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4d9c0039e0 0x7f4db41f3940 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.143+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 >> 172.21.15.104:0/3167555292 conn(0x7f4db40b44a0 msgr2=0x7f4db40d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:28.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.143+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 shutdown_connections 2024-09-17T02:59:28.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.143+0000 7f4dba6a9640 1 -- 172.21.15.104:0/3167555292 wait complete. 2024-09-17T02:59:28.155 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T02:59:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.269+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3219593121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb61415c220 msgr2=0x7fb61406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.269+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3219593121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb61415c220 0x7fb61406f550 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb610005fd0 tx=0x7fb61002a5d0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.269+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3219593121 shutdown_connections 2024-09-17T02:59:28.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.269+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3219593121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6140734f0 0x7fb614073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.269+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3219593121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb61415c220 0x7fb61406f550 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.269+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3219593121 >> 172.21.15.104:0/3219593121 conn(0x7fb61406d200 msgr2=0x7fb61406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.269+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3219593121 shutdown_connections 2024-09-17T02:59:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.269+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3219593121 wait complete. 2024-09-17T02:59:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.271+0000 7fb61b9ad640 1 Processor -- start 2024-09-17T02:59:28.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.271+0000 7fb61b9ad640 1 -- start start 2024-09-17T02:59:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb61b9ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6140734f0 0x7fb6141441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb61b9ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6140b0500 0x7fb614156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:28.271 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb61b9ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb61415c220 0x7fb614156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb61b9ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb6140b4f20 con 0x7fb6140734f0 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb61b9ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb6140b1230 con 0x7fb6140b0500 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb61b9ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb6140b50a0 con 0x7fb61415c220 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619749640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6140734f0 0x7fb6141441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619749640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6140734f0 0x7fb6141441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51970/0 (socket says 172.21.15.104:51970) 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619749640 1 -- 172.21.15.104:0/3596788806 learned_addr learned my addr 172.21.15.104:0/3596788806 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619f4a640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb61415c220 0x7fb614156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb618f48640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6140b0500 0x7fb614156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619749640 1 -- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb61415c220 msgr2=0x7fb614156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619749640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb61415c220 0x7fb614156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619749640 1 -- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6140b0500 msgr2=0x7fb614156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619749640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6140b0500 0x7fb614156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.272+0000 7fb619749640 1 -- 172.21.15.104:0/3596788806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61415e320 con 0x7fb6140734f0 2024-09-17T02:59:28.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.273+0000 7fb619749640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6140734f0 0x7fb6141441e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb610034040 tx=0x7fb6100038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:28.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.273+0000 7fb609ffb640 1 -- 172.21.15.104:0/3596788806 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61003e030 con 0x7fb6140734f0 2024-09-17T02:59:28.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.273+0000 7fb609ffb640 1 -- 172.21.15.104:0/3596788806 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb610003ca0 con 0x7fb6140734f0 2024-09-17T02:59:28.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.273+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6141596a0 con 0x7fb6140734f0 2024-09-17T02:59:28.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.273+0000 7fb609ffb640 1 -- 172.21.15.104:0/3596788806 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb610035040 con 0x7fb6140734f0 2024-09-17T02:59:28.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.273+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6140b1d80 con 0x7fb6140734f0 2024-09-17T02:59:28.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.274+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6140b1fb0 con 0x7fb6140734f0 2024-09-17T02:59:28.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.275+0000 7fb609ffb640 1 -- 172.21.15.104:0/3596788806 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb610041030 con 0x7fb6140734f0 2024-09-17T02:59:28.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.275+0000 7fb609ffb640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5f8078b90 0x7fb5f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:28.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.276+0000 7fb609ffb640 1 -- 172.21.15.104:0/3596788806 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7fb6100baf90 con 0x7fb6140734f0 2024-09-17T02:59:28.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.276+0000 7fb618f48640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5f8078b90 0x7fb5f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:28.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.276+0000 7fb618f48640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5f8078b90 0x7fb5f807b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb6140b3e60 tx=0x7fb60400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:28.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.280+0000 7fb609ffb640 1 -- 172.21.15.104:0/3596788806 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6140b1fb0 con 0x7fb6140734f0 2024-09-17T02:59:28.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.459+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb614070810 con 0x7fb6140734f0 2024-09-17T02:59:28.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.459+0000 7fb609ffb640 1 -- 172.21.15.104:0/3596788806 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) ==== 84+0+65 (secure 0 0 0) 0x7fb6100830d0 con 0x7fb6140734f0 2024-09-17T02:59:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:28.458 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T02:59:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T02:59:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T02:59:28.458 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:28.458 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T02:59:28.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5f8078b90 msgr2=0x7fb5f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5f8078b90 0x7fb5f807b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb6140b3e60 tx=0x7fb60400b2e0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6140734f0 msgr2=0x7fb6141441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6140734f0 0x7fb6141441e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb610034040 tx=0x7fb6100038a0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 shutdown_connections 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5f8078b90 0x7fb5f807b0a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6140b0500 0x7fb614156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb61415c220 0x7fb614156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 --2- 172.21.15.104:0/3596788806 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6140734f0 0x7fb6141441e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 >> 172.21.15.104:0/3596788806 conn(0x7fb61406d200 msgr2=0x7fb6140b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:28.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 shutdown_connections 2024-09-17T02:59:28.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.462+0000 7fb61b9ad640 1 -- 172.21.15.104:0/3596788806 wait complete. 2024-09-17T02:59:28.471 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T02:59:28.471 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T02:59:28.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.589+0000 7f278b1f1640 1 -- 172.21.15.104:0/2513554703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278415f3f0 msgr2=0x7f27840d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.589+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2513554703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278415f3f0 0x7f27840d2a00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f278408d200 tx=0x7f277802a4a0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.589+0000 7f278b1f1640 1 -- 172.21.15.104:0/2513554703 shutdown_connections 2024-09-17T02:59:28.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.589+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2513554703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27840d2f40 0x7f27840cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.589+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2513554703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f278415f3f0 0x7f27840d2a00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.589+0000 7f278b1f1640 1 -- 172.21.15.104:0/2513554703 >> 172.21.15.104:0/2513554703 conn(0x7f27840d4c20 msgr2=0x7f27840d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:28.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.589+0000 7f278b1f1640 1 -- 172.21.15.104:0/2513554703 shutdown_connections 2024-09-17T02:59:28.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.589+0000 7f278b1f1640 1 -- 172.21.15.104:0/2513554703 wait complete. 2024-09-17T02:59:28.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.591+0000 7f278b1f1640 1 Processor -- start 2024-09-17T02:59:28.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.591+0000 7f278b1f1640 1 -- start start 2024-09-17T02:59:28.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.592+0000 7f278b1f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27840cfd90 0x7f27841570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:28.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f278b1f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27840d2f40 0x7f27840cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:28.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f278b1f1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f278415f3f0 0x7f27840ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:28.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f278b1f1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f27840d0e00 con 0x7f27840cfd90 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f278b1f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27840d0c80 con 0x7f27840d2f40 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f278b1f1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f27840b3810 con 0x7f278415f3f0 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27840cfd90 0x7f27841570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27840cfd90 0x7f27841570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51986/0 (socket says 172.21.15.104:51986) 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 -- 172.21.15.104:0/2036544830 learned_addr learned my addr 172.21.15.104:0/2036544830 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 -- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f278415f3f0 msgr2=0x7f27840ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2783fff640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27840d2f40 0x7f27840cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f278978e640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f278415f3f0 0x7f27840ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f278415f3f0 0x7f27840ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 -- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27840d2f40 msgr2=0x7f27840cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27840d2f40 0x7f27840cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 -- 172.21.15.104:0/2036544830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278406f350 con 0x7f27840cfd90 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f2788f8d640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27840cfd90 0x7f27841570f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2778000c00 tx=0x7f27780039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:28.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f27817fa640 1 -- 172.21.15.104:0/2036544830 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277803e030 con 0x7f27840cfd90 2024-09-17T02:59:28.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f27817fa640 1 -- 172.21.15.104:0/2036544830 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27780047a0 con 0x7f27840cfd90 2024-09-17T02:59:28.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2784161dc0 con 0x7f27840cfd90 2024-09-17T02:59:28.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f27817fa640 1 -- 172.21.15.104:0/2036544830 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778035040 con 0x7f27840cfd90 2024-09-17T02:59:28.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.593+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2784162380 con 0x7f27840cfd90 2024-09-17T02:59:28.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.594+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27840b3d00 con 0x7f27840cfd90 2024-09-17T02:59:28.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.595+0000 7f27817fa640 1 -- 172.21.15.104:0/2036544830 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2778041030 con 0x7f27840cfd90 2024-09-17T02:59:28.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.596+0000 7f27817fa640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2768078bc0 0x7f276807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:28.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.596+0000 7f27817fa640 1 -- 172.21.15.104:0/2036544830 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7f27780bb1c0 con 0x7f27840cfd90 2024-09-17T02:59:28.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.596+0000 7f2783fff640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2768078bc0 0x7f276807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:28.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.596+0000 7f2783fff640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2768078bc0 0x7f276807b0d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f278406dc20 tx=0x7f2770008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:28.599 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.600+0000 7f27817fa640 1 -- 172.21.15.104:0/2036544830 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f27780839e0 con 0x7f27840cfd90 2024-09-17T02:59:28.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:28.776+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f27840cef50 con 0x7f27840cfd90 2024-09-17T02:59:29.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.761+0000 7f27817fa640 1 -- 172.21.15.104:0/2036544830 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) ==== 138+0+0 (secure 0 0 0) 0x7f27780832e0 con 0x7f27840cfd90 2024-09-17T02:59:29.760 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T02:59:29.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2768078bc0 msgr2=0x7f276807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:29.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2768078bc0 0x7f276807b0d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f278406dc20 tx=0x7f2770008040 comp rx=0 tx=0).stop 2024-09-17T02:59:29.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27840cfd90 msgr2=0x7f27841570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:29.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27840cfd90 0x7f27841570f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2778000c00 tx=0x7f27780039e0 comp rx=0 tx=0).stop 2024-09-17T02:59:29.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 shutdown_connections 2024-09-17T02:59:29.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2768078bc0 0x7f276807b0d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:29.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27840d2f40 0x7f27840cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:29.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f278415f3f0 0x7f27840ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:29.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 --2- 172.21.15.104:0/2036544830 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27840cfd90 0x7f27841570f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:29.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 >> 172.21.15.104:0/2036544830 conn(0x7f27840d4c20 msgr2=0x7f278415c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:29.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.765+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 shutdown_connections 2024-09-17T02:59:29.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.766+0000 7f278b1f1640 1 -- 172.21.15.104:0/2036544830 wait complete. 2024-09-17T02:59:29.780 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T02:59:29.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.908+0000 7fd22113a640 1 -- 172.21.15.104:0/3569176585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd208005350 msgr2=0x7fd20800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:29.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.908+0000 7fd22113a640 1 --2- 172.21.15.104:0/3569176585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd208005350 0x7fd20800b9c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd21400c610 tx=0x7fd208005830 comp rx=0 tx=0).stop 2024-09-17T02:59:29.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.908+0000 7fd22113a640 1 -- 172.21.15.104:0/3569176585 shutdown_connections 2024-09-17T02:59:29.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.908+0000 7fd22113a640 1 --2- 172.21.15.104:0/3569176585 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd208005350 0x7fd20800b9c0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:29.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.908+0000 7fd22113a640 1 -- 172.21.15.104:0/3569176585 >> 172.21.15.104:0/3569176585 conn(0x7fd21c06eb90 msgr2=0x7fd21c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:29.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.908+0000 7fd22113a640 1 -- 172.21.15.104:0/3569176585 shutdown_connections 2024-09-17T02:59:29.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.908+0000 7fd22113a640 1 -- 172.21.15.104:0/3569176585 wait complete. 2024-09-17T02:59:29.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.910+0000 7fd22113a640 1 Processor -- start 2024-09-17T02:59:29.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.911+0000 7fd22113a640 1 -- start start 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd22113a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd208005350 0x7fd21c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd22113a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd21c072ed0 0x7fd21c0732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd22113a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd21c13c7b0 0x7fd21c13cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd22113a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c156590 con 0x7fd21c072ed0 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd22113a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c156410 con 0x7fd208005350 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd22113a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c0cd770 con 0x7fd21c13c7b0 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd21c072ed0 0x7fd21c0732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd21c072ed0 0x7fd21c0732e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51992/0 (socket says 172.21.15.104:51992) 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21259c640 1 -- 172.21.15.104:0/361281610 learned_addr learned my addr 172.21.15.104:0/361281610 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21ad9d640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd208005350 0x7fd21c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:29.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21b59e640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd21c13c7b0 0x7fd21c13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21259c640 1 -- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd21c13c7b0 msgr2=0x7fd21c13cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21259c640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd21c13c7b0 0x7fd21c13cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21259c640 1 -- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd208005350 msgr2=0x7fd21c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21259c640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd208005350 0x7fd21c0c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21259c640 1 -- 172.21.15.104:0/361281610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c0c9260 con 0x7fd21c072ed0 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.912+0000 7fd21ad9d640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd208005350 0x7fd21c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.913+0000 7fd21259c640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd21c072ed0 0x7fd21c0732e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd204004f00 tx=0x7fd204001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.913+0000 7fd213fff640 1 -- 172.21.15.104:0/361281610 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204015020 con 0x7fd21c072ed0 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.913+0000 7fd213fff640 1 -- 172.21.15.104:0/361281610 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd204011960 con 0x7fd21c072ed0 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.913+0000 7fd213fff640 1 -- 172.21.15.104:0/361281610 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204011d90 con 0x7fd21c072ed0 2024-09-17T02:59:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.913+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c153840 con 0x7fd21c072ed0 2024-09-17T02:59:29.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.913+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c153e00 con 0x7fd21c072ed0 2024-09-17T02:59:29.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.914+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c0cdcd0 con 0x7fd21c072ed0 2024-09-17T02:59:29.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.914+0000 7fd213fff640 1 -- 172.21.15.104:0/361281610 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd204018020 con 0x7fd21c072ed0 2024-09-17T02:59:29.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.915+0000 7fd213fff640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:29.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.915+0000 7fd213fff640 1 -- 172.21.15.104:0/361281610 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5227+0+0 (secure 0 0 0) 0x7fd20409b5d0 con 0x7fd21c072ed0 2024-09-17T02:59:29.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.915+0000 7fd21ad9d640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:29.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.916+0000 7fd21ad9d640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0b6710 tx=0x7fd20c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:29.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:29.920+0000 7fd213fff640 1 -- 172.21.15.104:0/361281610 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd20401f020 con 0x7fd21c072ed0 2024-09-17T02:59:30.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.094+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd21c1e3f00 con 0x7fd21c072ed0 2024-09-17T02:59:30.762 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.764+0000 7fd213fff640 1 -- 172.21.15.104:0/361281610 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) ==== 170+0+0 (secure 0 0 0) 0x7fd204063bf0 con 0x7fd21c072ed0 2024-09-17T02:59:30.762 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T02:59:30.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1fc078b90 msgr2=0x7fd1fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:30.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0b6710 tx=0x7fd20c005f90 comp rx=0 tx=0).stop 2024-09-17T02:59:30.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd21c072ed0 msgr2=0x7fd21c0732e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:30.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd21c072ed0 0x7fd21c0732e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd204004f00 tx=0x7fd204001630 comp rx=0 tx=0).stop 2024-09-17T02:59:30.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 shutdown_connections 2024-09-17T02:59:30.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:30.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd21c13c7b0 0x7fd21c13cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:30.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd21c072ed0 0x7fd21c0732e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:30.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 --2- 172.21.15.104:0/361281610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd208005350 0x7fd21c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:30.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.768+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 >> 172.21.15.104:0/361281610 conn(0x7fd21c06eb90 msgr2=0x7fd21c1e2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:30.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.771+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 shutdown_connections 2024-09-17T02:59:30.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.771+0000 7fd22113a640 1 -- 172.21.15.104:0/361281610 wait complete. 2024-09-17T02:59:30.790 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T02:59:30.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.908+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/625018612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540b7ae0 msgr2=0x7fbc540b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:30.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.908+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/625018612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540b7ae0 0x7fbc540b5730 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009820 tx=0x7fbc5002a470 comp rx=0 tx=0).stop 2024-09-17T02:59:30.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.908+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/625018612 shutdown_connections 2024-09-17T02:59:30.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.908+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/625018612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc540d1590 0x7fbc540ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:30.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.908+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/625018612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540b7ae0 0x7fbc540b5730 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:30.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.908+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/625018612 >> 172.21.15.104:0/625018612 conn(0x7fbc540d28e0 msgr2=0x7fbc540d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:30.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.908+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/625018612 shutdown_connections 2024-09-17T02:59:30.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.908+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/625018612 wait complete. 2024-09-17T02:59:30.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.910+0000 7fbc5bc7e640 1 Processor -- start 2024-09-17T02:59:30.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.910+0000 7fbc5bc7e640 1 -- start start 2024-09-17T02:59:30.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc5bc7e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc540b7ae0 0x7fbc54160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:30.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc5bc7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540d1180 0x7fbc54159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:30.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc5bc7e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc540d1590 0x7fbc5409c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:30.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc5bc7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540cf400 con 0x7fbc540d1180 2024-09-17T02:59:30.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc5bc7e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540cf280 con 0x7fbc540d1590 2024-09-17T02:59:30.911 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc5bc7e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbc540cf580 con 0x7fbc540b7ae0 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc59219640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540d1180 0x7fbc54159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc59219640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540d1180 0x7fbc54159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52010/0 (socket says 172.21.15.104:52010) 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc59219640 1 -- 172.21.15.104:0/4123438878 learned_addr learned my addr 172.21.15.104:0/4123438878 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc5a21b640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc540d1590 0x7fbc5409c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.911+0000 7fbc59a1a640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc540b7ae0 0x7fbc54160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc59219640 1 -- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc540b7ae0 msgr2=0x7fbc54160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc59219640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc540b7ae0 0x7fbc54160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc59219640 1 -- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc540d1590 msgr2=0x7fbc5409c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc59219640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc540d1590 0x7fbc5409c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc59219640 1 -- 172.21.15.104:0/4123438878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5409ff00 con 0x7fbc540d1180 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc59219640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540d1180 0x7fbc54159280 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400c3c0 tx=0x7fbc4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:30.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc4a7fc640 1 -- 172.21.15.104:0/4123438878 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44017070 con 0x7fbc540d1180 2024-09-17T02:59:30.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc4a7fc640 1 -- 172.21.15.104:0/4123438878 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc440035f0 con 0x7fbc540d1180 2024-09-17T02:59:30.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc540a01e0 con 0x7fbc540d1180 2024-09-17T02:59:30.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc4a7fc640 1 -- 172.21.15.104:0/4123438878 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44003a20 con 0x7fbc540d1180 2024-09-17T02:59:30.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.912+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc540a04c0 con 0x7fbc540d1180 2024-09-17T02:59:30.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.913+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc541599e0 con 0x7fbc540d1180 2024-09-17T02:59:30.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.914+0000 7fbc4a7fc640 1 -- 172.21.15.104:0/4123438878 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc4401a070 con 0x7fbc540d1180 2024-09-17T02:59:30.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.914+0000 7fbc4a7fc640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc38078bc0 0x7fbc3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:30.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.915+0000 7fbc4a7fc640 1 -- 172.21.15.104:0/4123438878 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5609+0+0 (secure 0 0 0) 0x7fbc4409a120 con 0x7fbc540d1180 2024-09-17T02:59:30.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.915+0000 7fbc59a1a640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc38078bc0 0x7fbc3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:30.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.915+0000 7fbc59a1a640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc38078bc0 0x7fbc3807b0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc50034000 tx=0x7fbc50004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:30.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:30.918+0000 7fbc4a7fc640 1 -- 172.21.15.104:0/4123438878 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc44021020 con 0x7fbc540d1180 2024-09-17T02:59:31.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.126+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbc54074eb0 con 0x7fbc540d1180 2024-09-17T02:59:31.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.791+0000 7fbc4a7fc640 1 -- 172.21.15.104:0/4123438878 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v40) ==== 174+0+0 (secure 0 0 0) 0x7fbc54074eb0 con 0x7fbc540d1180 2024-09-17T02:59:31.791 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 12 and data pool 13 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc38078bc0 msgr2=0x7fbc3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc38078bc0 0x7fbc3807b0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc50034000 tx=0x7fbc50004730 comp rx=0 tx=0).stop 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540d1180 msgr2=0x7fbc54159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540d1180 0x7fbc54159280 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400c3c0 tx=0x7fbc4400c880 comp rx=0 tx=0).stop 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 shutdown_connections 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc38078bc0 0x7fbc3807b0d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc540d1590 0x7fbc5409c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc540d1180 0x7fbc54159280 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 --2- 172.21.15.104:0/4123438878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc540b7ae0 0x7fbc54160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.799+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 >> 172.21.15.104:0/4123438878 conn(0x7fbc540d28e0 msgr2=0x7fbc540cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.800+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 shutdown_connections 2024-09-17T02:59:31.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.800+0000 7fbc5bc7e640 1 -- 172.21.15.104:0/4123438878 wait complete. 2024-09-17T02:59:31.814 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:59:31.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.930+0000 7f4b0317b640 1 -- 172.21.15.104:0/2361198121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 msgr2=0x7f4ae40051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:31.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.930+0000 7f4b0317b640 1 --2- 172.21.15.104:0/2361198121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 0x7f4ae40051f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0c98d0 tx=0x7f4ae4005830 comp rx=0 tx=0).stop 2024-09-17T02:59:31.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.930+0000 7f4b01718640 1 -- 172.21.15.104:0/2361198121 reap_dead start 2024-09-17T02:59:31.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.930+0000 7f4b0317b640 1 -- 172.21.15.104:0/2361198121 shutdown_connections 2024-09-17T02:59:31.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.930+0000 7f4b0317b640 1 -- 172.21.15.104:0/2361198121 >> 172.21.15.104:0/2361198121 conn(0x7f4afc0b44a0 msgr2=0x7f4afc0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:31.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.930+0000 7f4b0317b640 1 -- 172.21.15.104:0/2361198121 shutdown_connections 2024-09-17T02:59:31.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.930+0000 7f4b0317b640 1 -- 172.21.15.104:0/2361198121 wait complete. 2024-09-17T02:59:31.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.932+0000 7f4b0317b640 1 Processor -- start 2024-09-17T02:59:31.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.932+0000 7f4b0317b640 1 -- start start 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.933+0000 7f4b0317b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 0x7f4afc15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.933+0000 7f4b0317b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4afc0c8710 0x7f4afc0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.933+0000 7f4b0317b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4afc0cacb0 0x7f4afc0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.933+0000 7f4b0317b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc0b5960 con 0x7f4ae4004d40 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.933+0000 7f4b0317b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc0b57e0 con 0x7f4afc0cacb0 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.933+0000 7f4b0317b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4afc0b5ae0 con 0x7f4afc0c8710 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 0x7f4afc15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 0x7f4afc15bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52032/0 (socket says 172.21.15.104:52032) 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 -- 172.21.15.104:0/1968096417 learned_addr learned my addr 172.21.15.104:0/1968096417 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b01718640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4afc0cacb0 0x7f4afc0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:31.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4afbfff640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4afc0c8710 0x7f4afc0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 -- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4afc0c8710 msgr2=0x7f4afc0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4afc0c8710 0x7f4afc0c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 -- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4afc0cacb0 msgr2=0x7f4afc0cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4afc0cacb0 0x7f4afc0cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 -- 172.21.15.104:0/1968096417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc0ca240 con 0x7f4ae4004d40 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b01718640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4afc0cacb0 0x7f4afc0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4afbfff640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4afc0c8710 0x7f4afc0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b00f17640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 0x7f4afc15bb00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4aec003f80 tx=0x7f4aec0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4af97fa640 1 -- 172.21.15.104:0/1968096417 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011700 con 0x7f4ae4004d40 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4af97fa640 1 -- 172.21.15.104:0/1968096417 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4aec016020 con 0x7f4ae4004d40 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4afc0c9060 con 0x7f4ae4004d40 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4af97fa640 1 -- 172.21.15.104:0/1968096417 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec011b20 con 0x7f4ae4004d40 2024-09-17T02:59:31.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.934+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4afc09d1a0 con 0x7f4ae4004d40 2024-09-17T02:59:31.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.935+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4afc0b39c0 con 0x7f4ae4004d40 2024-09-17T02:59:31.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.936+0000 7f4af97fa640 1 -- 172.21.15.104:0/1968096417 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4aec011cc0 con 0x7f4ae4004d40 2024-09-17T02:59:31.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.936+0000 7f4af97fa640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4ae8078b90 0x7f4ae807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:31.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.936+0000 7f4af97fa640 1 -- 172.21.15.104:0/1968096417 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f4aec09ba20 con 0x7f4ae4004d40 2024-09-17T02:59:31.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.937+0000 7f4afbfff640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4ae8078b90 0x7f4ae807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:31.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.937+0000 7f4afbfff640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4ae8078b90 0x7f4ae807b0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b7f50 tx=0x7f4af0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:31.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:31.941+0000 7f4af97fa640 1 -- 172.21.15.104:0/1968096417 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4aec020020 con 0x7f4ae4004d40 2024-09-17T02:59:32.113 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.114+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4afc0cead0 con 0x7f4ae4004d40 2024-09-17T02:59:32.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.115+0000 7f4af97fa640 1 -- 172.21.15.104:0/1968096417 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16792 (secure 0 0 0) 0x7f4afc0c9060 con 0x7f4ae4004d40 2024-09-17T02:59:32.115 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:32.115 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":102,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:59:31.126906+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:59:28.780702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T02:59:30.098469+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:59:32.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.117+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4ae8078b90 msgr2=0x7f4ae807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.117+0000 7f4b0317b640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4ae8078b90 0x7f4ae807b0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b7f50 tx=0x7f4af0005f90 comp rx=0 tx=0).stop 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 msgr2=0x7f4afc15bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 0x7f4afc15bb00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4aec003f80 tx=0x7f4aec0016f0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 shutdown_connections 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4ae8078b90 0x7f4ae807b0a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4afc0cacb0 0x7f4afc0cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4afc0c8710 0x7f4afc0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 --2- 172.21.15.104:0/1968096417 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4ae4004d40 0x7f4afc15bb00 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 >> 172.21.15.104:0/1968096417 conn(0x7f4afc0b44a0 msgr2=0x7f4afc15cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 shutdown_connections 2024-09-17T02:59:32.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.118+0000 7f4b0317b640 1 -- 172.21.15.104:0/1968096417 wait complete. 2024-09-17T02:59:32.128 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:59:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.242+0000 7f0726c9b640 1 -- 172.21.15.104:0/3135380839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b4fc0 msgr2=0x7f07200b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.242+0000 7f0726c9b640 1 --2- 172.21.15.104:0/3135380839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b4fc0 0x7f07200b39c0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f07200cf770 tx=0x7f071c02a5c0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.242+0000 7f0726c9b640 1 -- 172.21.15.104:0/3135380839 shutdown_connections 2024-09-17T02:59:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.242+0000 7f0726c9b640 1 --2- 172.21.15.104:0/3135380839 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b4fc0 0x7f07200b39c0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.242+0000 7f0726c9b640 1 -- 172.21.15.104:0/3135380839 >> 172.21.15.104:0/3135380839 conn(0x7f07200b44a0 msgr2=0x7f07200b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.242+0000 7f0726c9b640 1 -- 172.21.15.104:0/3135380839 shutdown_connections 2024-09-17T02:59:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.242+0000 7f0726c9b640 1 -- 172.21.15.104:0/3135380839 wait complete. 2024-09-17T02:59:32.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.244+0000 7f0726c9b640 1 Processor -- start 2024-09-17T02:59:32.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.244+0000 7f0726c9b640 1 -- start start 2024-09-17T02:59:32.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0726c9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b3f00 0x7f07200718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0726c9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07200b4fc0 0x7f0720071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0726c9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07200cdf10 0x7f07200c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0726c9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0720168210 con 0x7f07200b3f00 2024-09-17T02:59:32.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0726c9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0720168390 con 0x7f07200cdf10 2024-09-17T02:59:32.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0726c9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0720168510 con 0x7f07200b4fc0 2024-09-17T02:59:32.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0724a37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b3f00 0x7f07200718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0724a37640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b3f00 0x7f07200718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52056/0 (socket says 172.21.15.104:52056) 2024-09-17T02:59:32.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0724a37640 1 -- 172.21.15.104:0/214122718 learned_addr learned my addr 172.21.15.104:0/214122718 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:32.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0725238640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07200cdf10 0x7f07200c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0717fff640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07200b4fc0 0x7f0720071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0724a37640 1 -- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07200b4fc0 msgr2=0x7f0720071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0724a37640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07200b4fc0 0x7f0720071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0724a37640 1 -- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07200cdf10 msgr2=0x7f07200c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.245+0000 7f0724a37640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07200cdf10 0x7f07200c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f0724a37640 1 -- 172.21.15.104:0/214122718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0720156480 con 0x7f07200b3f00 2024-09-17T02:59:32.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f0725238640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07200cdf10 0x7f07200c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:32.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f0717fff640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07200b4fc0 0x7f0720071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:32.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f0724a37640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b3f00 0x7f07200718c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f071c0098f0 tx=0x7f071c033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:32.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f07157fa640 1 -- 172.21.15.104:0/214122718 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c031d60 con 0x7f07200b3f00 2024-09-17T02:59:32.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f07157fa640 1 -- 172.21.15.104:0/214122718 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f071c0330d0 con 0x7f07200b3f00 2024-09-17T02:59:32.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07201f43c0 con 0x7f07200b3f00 2024-09-17T02:59:32.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f07157fa640 1 -- 172.21.15.104:0/214122718 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c033520 con 0x7f07200b3f00 2024-09-17T02:59:32.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.246+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07200c6840 con 0x7f07200b3f00 2024-09-17T02:59:32.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.247+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07200b39c0 con 0x7f07200b3f00 2024-09-17T02:59:32.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.248+0000 7f07157fa640 1 -- 172.21.15.104:0/214122718 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f071c0035f0 con 0x7f07200b3f00 2024-09-17T02:59:32.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.248+0000 7f07157fa640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f070c078bc0 0x7f070c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.248+0000 7f07157fa640 1 -- 172.21.15.104:0/214122718 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f071c0bc710 con 0x7f07200b3f00 2024-09-17T02:59:32.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.249+0000 7f0717fff640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f070c078bc0 0x7f070c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.249+0000 7f0717fff640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f070c078bc0 0x7f070c07b0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f07200c8f20 tx=0x7f0710009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:32.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.252+0000 7f07157fa640 1 -- 172.21.15.104:0/214122718 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f071c052080 con 0x7f07200b3f00 2024-09-17T02:59:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.426+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f072014e4e0 con 0x7f07200b3f00 2024-09-17T02:59:32.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.427+0000 7f07157fa640 1 -- 172.21.15.104:0/214122718 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16792 (secure 0 0 0) 0x7f071c03f030 con 0x7f07200b3f00 2024-09-17T02:59:32.426 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:32.426 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":102,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:59:31.126906+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:59:28.780702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T02:59:30.098469+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:59:32.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f070c078bc0 msgr2=0x7f070c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f070c078bc0 0x7f070c07b0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f07200c8f20 tx=0x7f0710009040 comp rx=0 tx=0).stop 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b3f00 msgr2=0x7f07200718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b3f00 0x7f07200718c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f071c0098f0 tx=0x7f071c033c90 comp rx=0 tx=0).stop 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 shutdown_connections 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f070c078bc0 0x7f070c07b0d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07200cdf10 0x7f07200c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f07200b4fc0 0x7f0720071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 --2- 172.21.15.104:0/214122718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f07200b3f00 0x7f07200718c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 >> 172.21.15.104:0/214122718 conn(0x7f07200b44a0 msgr2=0x7f07200d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:32.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 shutdown_connections 2024-09-17T02:59:32.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.429+0000 7f0726c9b640 1 -- 172.21.15.104:0/214122718 wait complete. 2024-09-17T02:59:32.440 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T02:59:32.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.556+0000 7f802c284640 1 -- 172.21.15.104:0/169417276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80240d1400 msgr2=0x7f8024161390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.556+0000 7f802c284640 1 --2- 172.21.15.104:0/169417276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80240d1400 0x7f8024161390 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8014009830 tx=0x7f801402a510 comp rx=0 tx=0).stop 2024-09-17T02:59:32.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.556+0000 7f802c284640 1 -- 172.21.15.104:0/169417276 shutdown_connections 2024-09-17T02:59:32.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.556+0000 7f802c284640 1 --2- 172.21.15.104:0/169417276 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80240d1400 0x7f8024161390 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.556+0000 7f802c284640 1 --2- 172.21.15.104:0/169417276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80240d0ff0 0x7f8024160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.556+0000 7f802c284640 1 -- 172.21.15.104:0/169417276 >> 172.21.15.104:0/169417276 conn(0x7f80240b44a0 msgr2=0x7f80240b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:32.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.556+0000 7f802c284640 1 -- 172.21.15.104:0/169417276 shutdown_connections 2024-09-17T02:59:32.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.556+0000 7f802c284640 1 -- 172.21.15.104:0/169417276 wait complete. 2024-09-17T02:59:32.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.558+0000 7f802c284640 1 Processor -- start 2024-09-17T02:59:32.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.558+0000 7f802c284640 1 -- start start 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802c284640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80240d0ff0 0x7f8024156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802c284640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240d1400 0x7f802414cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802c284640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241618d0 0x7f80240ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802c284640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f80240b7ab0 con 0x7f80241618d0 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802c284640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f80240b7930 con 0x7f80240d1400 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802c284640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f80240b7c30 con 0x7f80240d0ff0 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241618d0 0x7f80240ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241618d0 0x7f80240ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52082/0 (socket says 172.21.15.104:52082) 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 -- 172.21.15.104:0/1801546280 learned_addr learned my addr 172.21.15.104:0/1801546280 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802981f640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240d1400 0x7f802414cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a020640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80240d0ff0 0x7f8024156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 -- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80240d0ff0 msgr2=0x7f8024156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80240d0ff0 0x7f8024156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 -- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240d1400 msgr2=0x7f802414cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240d1400 0x7f802414cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 -- 172.21.15.104:0/1801546280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80240c7100 con 0x7f80241618d0 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a020640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80240d0ff0 0x7f8024156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.559+0000 7f802a821640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241618d0 0x7f80240ce780 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f801c00cae0 tx=0x7f801c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.560+0000 7f801affd640 1 -- 172.21.15.104:0/1801546280 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c016020 con 0x7f80241618d0 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.560+0000 7f801affd640 1 -- 172.21.15.104:0/1801546280 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f801c00ad30 con 0x7f80241618d0 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.560+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802415e7d0 con 0x7f80241618d0 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.560+0000 7f801affd640 1 -- 172.21.15.104:0/1801546280 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c012680 con 0x7f80241618d0 2024-09-17T02:59:32.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.560+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802415ed90 con 0x7f80241618d0 2024-09-17T02:59:32.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.561+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8024160e50 con 0x7f80241618d0 2024-09-17T02:59:32.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.561+0000 7f801affd640 1 -- 172.21.15.104:0/1801546280 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f801c019020 con 0x7f80241618d0 2024-09-17T02:59:32.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.562+0000 7f801affd640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8008078b90 0x7f800807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.562+0000 7f801affd640 1 -- 172.21.15.104:0/1801546280 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f801c09b040 con 0x7f80241618d0 2024-09-17T02:59:32.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.562+0000 7f802a020640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8008078b90 0x7f800807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.562+0000 7f802a020640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8008078b90 0x7f800807b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8024074650 tx=0x7f8020008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:32.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.566+0000 7f801affd640 1 -- 172.21.15.104:0/1801546280 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f801c020030 con 0x7f80241618d0 2024-09-17T02:59:32.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.775+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f80240d0920 con 0x7f80241618d0 2024-09-17T02:59:32.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.796+0000 7f801affd640 1 -- 172.21.15.104:0/1801546280 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) ==== 118+0+0 (secure 0 0 0) 0x7f801c063400 con 0x7f80241618d0 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.800+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8008078b90 msgr2=0x7f800807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.800+0000 7f802c284640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8008078b90 0x7f800807b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8024074650 tx=0x7f8020008040 comp rx=0 tx=0).stop 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.800+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241618d0 msgr2=0x7f80240ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.800+0000 7f802c284640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241618d0 0x7f80240ce780 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f801c00cae0 tx=0x7f801c00a060 comp rx=0 tx=0).stop 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.800+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 shutdown_connections 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.800+0000 7f802c284640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8008078b90 0x7f800807b0a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.800+0000 7f802c284640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240d1400 0x7f802414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.800+0000 7f802c284640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f80241618d0 0x7f80240ce780 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.801+0000 7f802c284640 1 --2- 172.21.15.104:0/1801546280 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f80240d0ff0 0x7f8024156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.801+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 >> 172.21.15.104:0/1801546280 conn(0x7f80240b44a0 msgr2=0x7f8024075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.801+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 shutdown_connections 2024-09-17T02:59:32.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.801+0000 7f802c284640 1 -- 172.21.15.104:0/1801546280 wait complete. 2024-09-17T02:59:32.811 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T02:59:32.811 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T02:59:32.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.928+0000 7fcc47782640 1 -- 172.21.15.104:0/1837590170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 msgr2=0x7fcc2c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.928+0000 7fcc47782640 1 --2- 172.21.15.104:0/1837590170 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 0x7fcc2c003ea0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c006fc0 tx=0x7fcc2c005830 comp rx=0 tx=0).stop 2024-09-17T02:59:32.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.928+0000 7fcc45d1f640 1 -- 172.21.15.104:0/1837590170 reap_dead start 2024-09-17T02:59:32.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.928+0000 7fcc47782640 1 -- 172.21.15.104:0/1837590170 shutdown_connections 2024-09-17T02:59:32.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.928+0000 7fcc47782640 1 -- 172.21.15.104:0/1837590170 >> 172.21.15.104:0/1837590170 conn(0x7fcc400d2970 msgr2=0x7fcc400d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.928+0000 7fcc47782640 1 -- 172.21.15.104:0/1837590170 shutdown_connections 2024-09-17T02:59:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.928+0000 7fcc47782640 1 -- 172.21.15.104:0/1837590170 wait complete. 2024-09-17T02:59:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.930+0000 7fcc47782640 1 Processor -- start 2024-09-17T02:59:32.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.930+0000 7fcc47782640 1 -- start start 2024-09-17T02:59:32.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.931+0000 7fcc47782640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 0x7fcc40156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.931+0000 7fcc47782640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc40152fc0 0x7fcc401533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.931+0000 7fcc47782640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc400cf5d0 0x7fcc400cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.931+0000 7fcc47782640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcc400b2270 con 0x7fcc2c003a30 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.931+0000 7fcc47782640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcc400b20f0 con 0x7fcc40152fc0 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.931+0000 7fcc47782640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcc400b23f0 con 0x7fcc400cf5d0 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.931+0000 7fcc4551e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 0x7fcc40156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc4551e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 0x7fcc40156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52108/0 (socket says 172.21.15.104:52108) 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc4551e640 1 -- 172.21.15.104:0/4051875102 learned_addr learned my addr 172.21.15.104:0/4051875102 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc4551e640 1 -- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc400cf5d0 msgr2=0x7fcc400cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc4551e640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc400cf5d0 0x7fcc400cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc4551e640 1 -- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc40152fc0 msgr2=0x7fcc401533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:32.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc4551e640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc40152fc0 0x7fcc401533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc4551e640 1 -- 172.21.15.104:0/4051875102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc400cff20 con 0x7fcc2c003a30 2024-09-17T02:59:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc4551e640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 0x7fcc40156a50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c02b0f0 tx=0x7fcc3c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc35ffb640 1 -- 172.21.15.104:0/4051875102 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c031040 con 0x7fcc2c003a30 2024-09-17T02:59:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc35ffb640 1 -- 172.21.15.104:0/4051875102 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc3c0035f0 con 0x7fcc2c003a30 2024-09-17T02:59:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc401f7880 con 0x7fcc2c003a30 2024-09-17T02:59:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc35ffb640 1 -- 172.21.15.104:0/4051875102 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c003a00 con 0x7fcc2c003a30 2024-09-17T02:59:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.932+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc401f4ea0 con 0x7fcc2c003a30 2024-09-17T02:59:32.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.933+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc400d0900 con 0x7fcc2c003a30 2024-09-17T02:59:32.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.934+0000 7fcc35ffb640 1 -- 172.21.15.104:0/4051875102 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc3c034070 con 0x7fcc2c003a30 2024-09-17T02:59:32.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.935+0000 7fcc35ffb640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc24078b90 0x7fcc2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:32.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.935+0000 7fcc35ffb640 1 -- 172.21.15.104:0/4051875102 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fcc3c0bb210 con 0x7fcc2c003a30 2024-09-17T02:59:32.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.935+0000 7fcc44d1d640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc24078b90 0x7fcc2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:32.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.935+0000 7fcc44d1d640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc24078b90 0x7fcc2407b0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcc401f8660 tx=0x7fcc30009dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:32.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:32.938+0000 7fcc35ffb640 1 -- 172.21.15.104:0/4051875102 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc3c04f080 con 0x7fcc2c003a30 2024-09-17T02:59:33.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.149+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcc40071450 con 0x7fcc2c003a30 2024-09-17T02:59:33.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.804+0000 7fcc35ffb640 1 -- 172.21.15.104:0/4051875102 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7fcc400cff20 con 0x7fcc2c003a30 2024-09-17T02:59:33.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.806+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc24078b90 msgr2=0x7fcc2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:33.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.806+0000 7fcc47782640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc24078b90 0x7fcc2407b0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcc401f8660 tx=0x7fcc30009dd0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.806+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 msgr2=0x7fcc40156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.806+0000 7fcc47782640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 0x7fcc40156a50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c02b0f0 tx=0x7fcc3c001cb0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.806+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 shutdown_connections 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.806+0000 7fcc47782640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcc24078b90 0x7fcc2407b0a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.806+0000 7fcc47782640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc40152fc0 0x7fcc401533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.807+0000 7fcc47782640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc400cf5d0 0x7fcc400cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.807+0000 7fcc47782640 1 --2- 172.21.15.104:0/4051875102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcc2c003a30 0x7fcc40156a50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.807+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 >> 172.21.15.104:0/4051875102 conn(0x7fcc400d2970 msgr2=0x7fcc40071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.807+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 shutdown_connections 2024-09-17T02:59:33.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.807+0000 7fcc47782640 1 -- 172.21.15.104:0/4051875102 wait complete. 2024-09-17T02:59:33.818 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T02:59:33.818 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:33.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.934+0000 7f80164fa640 1 -- 172.21.15.104:0/2403947833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff8005250 msgr2=0x7f7ff800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:33.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.934+0000 7f80164fa640 1 --2- 172.21.15.104:0/2403947833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff8005250 0x7f7ff800b9c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f80080013d0 tx=0x7f7ff8005830 comp rx=0 tx=0).stop 2024-09-17T02:59:33.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.934+0000 7f80164fa640 1 -- 172.21.15.104:0/2403947833 shutdown_connections 2024-09-17T02:59:33.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.934+0000 7f80164fa640 1 --2- 172.21.15.104:0/2403947833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff8005250 0x7f7ff800b9c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.934+0000 7f80164fa640 1 -- 172.21.15.104:0/2403947833 >> 172.21.15.104:0/2403947833 conn(0x7f801006d200 msgr2=0x7f801006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:33.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.934+0000 7f80164fa640 1 -- 172.21.15.104:0/2403947833 shutdown_connections 2024-09-17T02:59:33.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.934+0000 7f80164fa640 1 -- 172.21.15.104:0/2403947833 wait complete. 2024-09-17T02:59:33.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.936+0000 7f80164fa640 1 Processor -- start 2024-09-17T02:59:33.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.936+0000 7f80164fa640 1 -- start start 2024-09-17T02:59:33.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f80164fa640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff8005250 0x7f8010140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:33.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f80164fa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80100b0b90 0x7f80101f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:33.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f80164fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8010158940 0x7f8010158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f80164fa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f801006f6d0 con 0x7f8010158940 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f80164fa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f801006f550 con 0x7f80100b0b90 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f80164fa640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f801006f850 con 0x7f7ff8005250 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8010158940 0x7f8010158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8010158940 0x7f8010158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52132/0 (socket says 172.21.15.104:52132) 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 -- 172.21.15.104:0/2969553891 learned_addr learned my addr 172.21.15.104:0/2969553891 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f800ffff640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff8005250 0x7f8010140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f800f7fe640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80100b0b90 0x7f80101f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 -- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff8005250 msgr2=0x7f8010140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff8005250 0x7f8010140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 -- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80100b0b90 msgr2=0x7f80101f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:33.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80100b0b90 0x7f80101f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:33.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 -- 172.21.15.104:0/2969553891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8010159290 con 0x7f8010158940 2024-09-17T02:59:33.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f8014a97640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8010158940 0x7f8010158d50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f800800c700 tx=0x7f8008003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:33.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f800cff9640 1 -- 172.21.15.104:0/2969553891 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800802bbb0 con 0x7f8010158940 2024-09-17T02:59:33.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f800cff9640 1 -- 172.21.15.104:0/2969553891 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f800803a070 con 0x7f8010158940 2024-09-17T02:59:33.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f800cff9640 1 -- 172.21.15.104:0/2969553891 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800802be60 con 0x7f8010158940 2024-09-17T02:59:33.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80101433e0 con 0x7f8010158940 2024-09-17T02:59:33.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.938+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80101439a0 con 0x7f8010158940 2024-09-17T02:59:33.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.939+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80100b0910 con 0x7f8010158940 2024-09-17T02:59:33.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.940+0000 7f800cff9640 1 -- 172.21.15.104:0/2969553891 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f800803c020 con 0x7f8010158940 2024-09-17T02:59:33.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.941+0000 7f800cff9640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ffc078b90 0x7f7ffc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:33.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.941+0000 7f800cff9640 1 -- 172.21.15.104:0/2969553891 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f80080ba8b0 con 0x7f8010158940 2024-09-17T02:59:33.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.941+0000 7f800ffff640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ffc078b90 0x7f7ffc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:33.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.942+0000 7f800ffff640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ffc078b90 0x7f7ffc07b0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8000009bd0 tx=0x7f8000005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:33.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:33.945+0000 7f800cff9640 1 -- 172.21.15.104:0/2969553891 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8010159290 con 0x7f8010158940 2024-09-17T02:59:34.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.156+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8010070810 con 0x7f8010158940 2024-09-17T02:59:34.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.156+0000 7f800cff9640 1 -- 172.21.15.104:0/2969553891 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7f8008082ed0 con 0x7f8010158940 2024-09-17T02:59:34.155 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:34.155 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T02:59:34.156 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T02:59:34.157 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.158+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ffc078b90 msgr2=0x7f7ffc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.158+0000 7f80164fa640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ffc078b90 0x7f7ffc07b0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8000009bd0 tx=0x7f8000005f90 comp rx=0 tx=0).stop 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.158+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8010158940 msgr2=0x7f8010158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.158+0000 7f80164fa640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8010158940 0x7f8010158d50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f800800c700 tx=0x7f8008003ba0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.158+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 shutdown_connections 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.159+0000 7f80164fa640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7ffc078b90 0x7f7ffc07b0a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.159+0000 7f80164fa640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80100b0b90 0x7f80101f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.159+0000 7f80164fa640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8010158940 0x7f8010158d50 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.159+0000 7f80164fa640 1 --2- 172.21.15.104:0/2969553891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff8005250 0x7f8010140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.159+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 >> 172.21.15.104:0/2969553891 conn(0x7f801006d200 msgr2=0x7f80100d0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:34.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.159+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 shutdown_connections 2024-09-17T02:59:34.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.159+0000 7f80164fa640 1 -- 172.21.15.104:0/2969553891 wait complete. 2024-09-17T02:59:34.169 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T02:59:34.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.282+0000 7f771ae7e640 1 -- 172.21.15.104:0/1080942130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77140b65e0 msgr2=0x7f77140b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.282+0000 7f771ae7e640 1 --2- 172.21.15.104:0/1080942130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77140b65e0 0x7f77140b69f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7704009830 tx=0x7f770402a4b0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.282+0000 7f771ae7e640 1 -- 172.21.15.104:0/1080942130 shutdown_connections 2024-09-17T02:59:34.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.282+0000 7f771ae7e640 1 --2- 172.21.15.104:0/1080942130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77140b65e0 0x7f77140b69f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.282+0000 7f771ae7e640 1 -- 172.21.15.104:0/1080942130 >> 172.21.15.104:0/1080942130 conn(0x7f7714069120 msgr2=0x7f7714069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:34.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.282+0000 7f771ae7e640 1 -- 172.21.15.104:0/1080942130 shutdown_connections 2024-09-17T02:59:34.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.282+0000 7f771ae7e640 1 -- 172.21.15.104:0/1080942130 wait complete. 2024-09-17T02:59:34.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.284+0000 7f771ae7e640 1 Processor -- start 2024-09-17T02:59:34.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.284+0000 7f771ae7e640 1 -- start start 2024-09-17T02:59:34.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f771ae7e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77140b65e0 0x7f77140ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f771ae7e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f771415f1f0 0x7f7714152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f771ae7e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f771415fd10 0x7f77140ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f771ae7e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7714162010 con 0x7f771415f1f0 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f771ae7e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7714161e90 con 0x7f77140b65e0 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f771ae7e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7714162190 con 0x7f771415fd10 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f7713fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f771415f1f0 0x7f7714152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f7713fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f771415f1f0 0x7f7714152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43304/0 (socket says 172.21.15.104:43304) 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f7713fff640 1 -- 172.21.15.104:0/265425193 learned_addr learned my addr 172.21.15.104:0/265425193 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.285+0000 7f771941b640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f771415fd10 0x7f77140ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f7718c1a640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77140b65e0 0x7f77140ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f7713fff640 1 -- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f771415fd10 msgr2=0x7f77140ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f7713fff640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f771415fd10 0x7f77140ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f7713fff640 1 -- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77140b65e0 msgr2=0x7f77140ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f7713fff640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77140b65e0 0x7f77140ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f7713fff640 1 -- 172.21.15.104:0/265425193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7714153040 con 0x7f771415f1f0 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f7713fff640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f771415f1f0 0x7f7714152b00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f770800c4b0 tx=0x7f770800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f77117fa640 1 -- 172.21.15.104:0/265425193 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708016020 con 0x7f771415f1f0 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f77117fa640 1 -- 172.21.15.104:0/265425193 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7708012920 con 0x7f771415f1f0 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77141f67a0 con 0x7f771415f1f0 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f77117fa640 1 -- 172.21.15.104:0/265425193 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708012d70 con 0x7f771415f1f0 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.286+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77141f6d60 con 0x7f771415f1f0 2024-09-17T02:59:34.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.287+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771406afc0 con 0x7f771415f1f0 2024-09-17T02:59:34.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.288+0000 7f77117fa640 1 -- 172.21.15.104:0/265425193 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7708019020 con 0x7f771415f1f0 2024-09-17T02:59:34.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.288+0000 7f77117fa640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7700078b90 0x7f770007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.288+0000 7f77117fa640 1 -- 172.21.15.104:0/265425193 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f770809abf0 con 0x7f771415f1f0 2024-09-17T02:59:34.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.288+0000 7f7718c1a640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7700078b90 0x7f770007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.289+0000 7f7718c1a640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7700078b90 0x7f770007b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7704034000 tx=0x7f7704004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:34.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.293+0000 7f77117fa640 1 -- 172.21.15.104:0/265425193 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f771406afc0 con 0x7f771415f1f0 2024-09-17T02:59:34.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.468+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7714162660 con 0x7f771415f1f0 2024-09-17T02:59:34.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.470+0000 7f77117fa640 1 -- 172.21.15.104:0/265425193 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16779 (secure 0 0 0) 0x7f7708020020 con 0x7f771415f1f0 2024-09-17T02:59:34.468 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:34.468 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":103,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T02:59:32.779595+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:59:28.780702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T02:59:30.098469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T02:59:34.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7700078b90 msgr2=0x7f770007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7700078b90 0x7f770007b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7704034000 tx=0x7f7704004730 comp rx=0 tx=0).stop 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f771415f1f0 msgr2=0x7f7714152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f771415f1f0 0x7f7714152b00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f770800c4b0 tx=0x7f770800c970 comp rx=0 tx=0).stop 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 shutdown_connections 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7700078b90 0x7f770007b0a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f771415fd10 0x7f77140ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f771415f1f0 0x7f7714152b00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 --2- 172.21.15.104:0/265425193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77140b65e0 0x7f77140ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 >> 172.21.15.104:0/265425193 conn(0x7f7714069120 msgr2=0x7f77140b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 shutdown_connections 2024-09-17T02:59:34.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.472+0000 7f771ae7e640 1 -- 172.21.15.104:0/265425193 wait complete. 2024-09-17T02:59:34.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T02:59:34.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:59:34.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.597+0000 7fea82e27640 1 -- 172.21.15.104:0/1065636239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 msgr2=0x7fea7c0cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.597+0000 7fea82e27640 1 --2- 172.21.15.104:0/1065636239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 0x7fea7c0cfa80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0d3a70 tx=0x7fea7402aac0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.597+0000 7fea82e27640 1 -- 172.21.15.104:0/1065636239 shutdown_connections 2024-09-17T02:59:34.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.597+0000 7fea82e27640 1 --2- 172.21.15.104:0/1065636239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 0x7fea7c0cfa80 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.597+0000 7fea82e27640 1 --2- 172.21.15.104:0/1065636239 >> v2:172.21.15.192:3300/0 conn(0x7fea7c0b4fc0 0x7fea7c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.597+0000 7fea82e27640 1 -- 172.21.15.104:0/1065636239 >> 172.21.15.104:0/1065636239 conn(0x7fea7c0b44a0 msgr2=0x7fea7c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:34.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.597+0000 7fea82e27640 1 -- 172.21.15.104:0/1065636239 shutdown_connections 2024-09-17T02:59:34.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.597+0000 7fea82e27640 1 -- 172.21.15.104:0/1065636239 wait complete. 2024-09-17T02:59:34.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.599+0000 7fea82e27640 1 Processor -- start 2024-09-17T02:59:34.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.599+0000 7fea82e27640 1 -- start start 2024-09-17T02:59:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.600+0000 7fea82e27640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7c0b3f00 0x7fea7c159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.600+0000 7fea82e27640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea7c0b4fc0 0x7fea7c0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.600+0000 7fea82e27640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 0x7fea7c1f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.600+0000 7fea82e27640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c0d01d0 con 0x7fea7c0cdf10 2024-09-17T02:59:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.600+0000 7fea82e27640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c160f50 con 0x7fea7c0b3f00 2024-09-17T02:59:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.600+0000 7fea82e27640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c15deb0 con 0x7fea7c0b4fc0 2024-09-17T02:59:34.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.600+0000 7fea813c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 0x7fea7c1f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.600+0000 7fea813c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 0x7fea7c1f73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43312/0 (socket says 172.21.15.104:43312) 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea813c4640 1 -- 172.21.15.104:0/2483017688 learned_addr learned my addr 172.21.15.104:0/2483017688 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea80bc3640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7c0b3f00 0x7fea7c159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea7bfff640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea7c0b4fc0 0x7fea7c0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea813c4640 1 -- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea7c0b4fc0 msgr2=0x7fea7c0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea813c4640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea7c0b4fc0 0x7fea7c0b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea813c4640 1 -- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7c0b3f00 msgr2=0x7fea7c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea813c4640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7c0b3f00 0x7fea7c159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea813c4640 1 -- 172.21.15.104:0/2483017688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c15d9e0 con 0x7fea7c0cdf10 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea813c4640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 0x7fea7c1f73a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fea7402b0b0 tx=0x7fea74003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea797fa640 1 -- 172.21.15.104:0/2483017688 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74004250 con 0x7fea7c0cdf10 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea797fa640 1 -- 172.21.15.104:0/2483017688 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea740043f0 con 0x7fea7c0cdf10 2024-09-17T02:59:34.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c1605e0 con 0x7fea7c0cdf10 2024-09-17T02:59:34.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea797fa640 1 -- 172.21.15.104:0/2483017688 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74004820 con 0x7fea7c0cdf10 2024-09-17T02:59:34.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.601+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c0c9c10 con 0x7fea7c0cdf10 2024-09-17T02:59:34.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.602+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7c160350 con 0x7fea7c0cdf10 2024-09-17T02:59:34.602 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.603+0000 7fea797fa640 1 -- 172.21.15.104:0/2483017688 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea74049430 con 0x7fea7c0cdf10 2024-09-17T02:59:34.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.604+0000 7fea797fa640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea68078b90 0x7fea6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.604+0000 7fea797fa640 1 -- 172.21.15.104:0/2483017688 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fea740bba90 con 0x7fea7c0cdf10 2024-09-17T02:59:34.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.604+0000 7fea80bc3640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea68078b90 0x7fea6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.605+0000 7fea80bc3640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea68078b90 0x7fea6807b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fea6c004630 tx=0x7fea6c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:34.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.608+0000 7fea797fa640 1 -- 172.21.15.104:0/2483017688 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea74032030 con 0x7fea7c0cdf10 2024-09-17T02:59:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.778+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea7c0d18a0 con 0x7fea68078b90 2024-09-17T02:59:34.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.782+0000 7fea797fa640 1 -- 172.21.15.104:0/2483017688 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242659 (secure 0 0 0) 0x7fea6c00b800 con 0x7fea68078b90 2024-09-17T02:59:34.783 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:34.785 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:59:34.786 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea68078b90 msgr2=0x7fea6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea68078b90 0x7fea6807b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fea6c004630 tx=0x7fea6c00b2e0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 msgr2=0x7fea7c1f73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 0x7fea7c1f73a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fea7402b0b0 tx=0x7fea74003f10 comp rx=0 tx=0).stop 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 shutdown_connections 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea68078b90 0x7fea6807b0a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7c0cdf10 0x7fea7c1f73a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea7c0b4fc0 0x7fea7c0b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 --2- 172.21.15.104:0/2483017688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7c0b3f00 0x7fea7c159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 >> 172.21.15.104:0/2483017688 conn(0x7fea7c0b44a0 msgr2=0x7fea7c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 shutdown_connections 2024-09-17T02:59:34.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.785+0000 7fea82e27640 1 -- 172.21.15.104:0/2483017688 wait complete. 2024-09-17T02:59:34.795 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-17T02:59:33.692781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5388,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557111,"statfs":{"total":1600000000,"available":1594482299,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001080"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769630+0000","last_change":"2024-09-17T02:59:30.769630+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769630+0000","last_undegraded":"2024-09-17T02:59:30.769630+0000","last_fullsized":"2024-09-17T02:59:30.769630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768274+0000","last_change":"2024-09-17T02:59:30.768274+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768274+0000","last_undegraded":"2024-09-17T02:59:30.768274+0000","last_fullsized":"2024-09-17T02:59:30.768274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.776107+0000","last_change":"2024-09-17T02:59:30.776107+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.776107+0000","last_undegraded":"2024-09-17T02:59:30.776107+0000","last_fullsized":"2024-09-17T02:59:30.776107+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774812+0000","last_change":"2024-09-17T02:59:30.774812+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774812+0000","last_undegraded":"2024-09-17T02:59:30.774812+0000","last_fullsized":"2024-09-17T02:59:30.774812+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774947+0000","last_change":"2024-09-17T02:59:30.774947+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774947+0000","last_undegraded":"2024-09-17T02:59:30.774947+0000","last_fullsized":"2024-09-17T02:59:30.774947+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770155+0000","last_change":"2024-09-17T02:59:30.770155+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770155+0000","last_undegraded":"2024-09-17T02:59:30.770155+0000","last_fullsized":"2024-09-17T02:59:30.770155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772088+0000","last_change":"2024-09-17T02:59:30.772088+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772088+0000","last_undegraded":"2024-09-17T02:59:30.772088+0000","last_fullsized":"2024-09-17T02:59:30.772088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770954+0000","last_change":"2024-09-17T02:59:30.770954+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770954+0000","last_undegraded":"2024-09-17T02:59:30.770954+0000","last_fullsized":"2024-09-17T02:59:30.770954+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769403+0000","last_change":"2024-09-17T02:59:30.769403+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769403+0000","last_undegraded":"2024-09-17T02:59:30.769403+0000","last_fullsized":"2024-09-17T02:59:30.769403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769130+0000","last_change":"2024-09-17T02:59:30.769130+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769130+0000","last_undegraded":"2024-09-17T02:59:30.769130+0000","last_fullsized":"2024-09-17T02:59:30.769130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766608+0000","last_change":"2024-09-17T02:59:30.766608+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766608+0000","last_undegraded":"2024-09-17T02:59:30.766608+0000","last_fullsized":"2024-09-17T02:59:30.766608+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768715+0000","last_change":"2024-09-17T02:59:30.768715+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768715+0000","last_undegraded":"2024-09-17T02:59:30.768715+0000","last_fullsized":"2024-09-17T02:59:30.768715+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774916+0000","last_change":"2024-09-17T02:59:30.774916+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774916+0000","last_undegraded":"2024-09-17T02:59:30.774916+0000","last_fullsized":"2024-09-17T02:59:30.774916+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773067+0000","last_change":"2024-09-17T02:59:30.773067+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773067+0000","last_undegraded":"2024-09-17T02:59:30.773067+0000","last_fullsized":"2024-09-17T02:59:30.773067+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772931+0000","last_change":"2024-09-17T02:59:30.772931+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772931+0000","last_undegraded":"2024-09-17T02:59:30.772931+0000","last_fullsized":"2024-09-17T02:59:30.772931+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775509+0000","last_change":"2024-09-17T02:59:30.775509+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775509+0000","last_undegraded":"2024-09-17T02:59:30.775509+0000","last_fullsized":"2024-09-17T02:59:30.775509+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775875+0000","last_change":"2024-09-17T02:59:30.775875+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775875+0000","last_undegraded":"2024-09-17T02:59:30.775875+0000","last_fullsized":"2024-09-17T02:59:30.775875+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772388+0000","last_change":"2024-09-17T02:59:30.772388+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772388+0000","last_undegraded":"2024-09-17T02:59:30.772388+0000","last_fullsized":"2024-09-17T02:59:30.772388+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774595+0000","last_change":"2024-09-17T02:59:30.774595+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774595+0000","last_undegraded":"2024-09-17T02:59:30.774595+0000","last_fullsized":"2024-09-17T02:59:30.774595+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771404+0000","last_change":"2024-09-17T02:59:30.771404+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771404+0000","last_undegraded":"2024-09-17T02:59:30.771404+0000","last_fullsized":"2024-09-17T02:59:30.771404+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772025+0000","last_change":"2024-09-17T02:59:30.772025+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772025+0000","last_undegraded":"2024-09-17T02:59:30.772025+0000","last_fullsized":"2024-09-17T02:59:30.772025+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767915+0000","last_change":"2024-09-17T02:59:30.767915+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767915+0000","last_undegraded":"2024-09-17T02:59:30.767915+0000","last_fullsized":"2024-09-17T02:59:30.767915+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773448+0000","last_change":"2024-09-17T02:59:30.773448+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773448+0000","last_undegraded":"2024-09-17T02:59:30.773448+0000","last_fullsized":"2024-09-17T02:59:30.773448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772722+0000","last_change":"2024-09-17T02:59:30.772722+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772722+0000","last_undegraded":"2024-09-17T02:59:30.772722+0000","last_fullsized":"2024-09-17T02:59:30.772722+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767625+0000","last_change":"2024-09-17T02:59:30.767625+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767625+0000","last_undegraded":"2024-09-17T02:59:30.767625+0000","last_fullsized":"2024-09-17T02:59:30.767625+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773958+0000","last_change":"2024-09-17T02:59:30.773958+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773958+0000","last_undegraded":"2024-09-17T02:59:30.773958+0000","last_fullsized":"2024-09-17T02:59:30.773958+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772185+0000","last_change":"2024-09-17T02:59:30.772185+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772185+0000","last_undegraded":"2024-09-17T02:59:30.772185+0000","last_fullsized":"2024-09-17T02:59:30.772185+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772228+0000","last_change":"2024-09-17T02:59:30.772228+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772228+0000","last_undegraded":"2024-09-17T02:59:30.772228+0000","last_fullsized":"2024-09-17T02:59:30.772228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766854+0000","last_change":"2024-09-17T02:59:30.766854+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766854+0000","last_undegraded":"2024-09-17T02:59:30.766854+0000","last_fullsized":"2024-09-17T02:59:30.766854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767208+0000","last_change":"2024-09-17T02:59:30.767208+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767208+0000","last_undegraded":"2024-09-17T02:59:30.767208+0000","last_fullsized":"2024-09-17T02:59:30.767208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775142+0000","last_change":"2024-09-17T02:59:30.775142+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775142+0000","last_undegraded":"2024-09-17T02:59:30.775142+0000","last_fullsized":"2024-09-17T02:59:30.775142+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768159+0000","last_change":"2024-09-17T02:59:30.768159+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768159+0000","last_undegraded":"2024-09-17T02:59:30.768159+0000","last_fullsized":"2024-09-17T02:59:30.768159+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774015+0000","last_change":"2024-09-17T02:59:30.774015+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774015+0000","last_undegraded":"2024-09-17T02:59:30.774015+0000","last_fullsized":"2024-09-17T02:59:30.774015+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778236+0000","last_change":"2024-09-17T02:59:30.777486+0000","last_active":"2024-09-17T02:59:30.778236+0000","last_peered":"2024-09-17T02:59:30.778236+0000","last_clean":"2024-09-17T02:59:30.778236+0000","last_became_active":"2024-09-17T02:59:30.775598+0000","last_became_peered":"2024-09-17T02:59:30.775598+0000","last_unstale":"2024-09-17T02:59:30.778236+0000","last_undegraded":"2024-09-17T02:59:30.778236+0000","last_fullsized":"2024-09-17T02:59:30.778236+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:36.245807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771844+0000","last_change":"2024-09-17T02:59:30.771844+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771844+0000","last_undegraded":"2024-09-17T02:59:30.771844+0000","last_fullsized":"2024-09-17T02:59:30.771844+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779952+0000","last_change":"2024-09-17T02:59:30.779490+0000","last_active":"2024-09-17T02:59:30.779952+0000","last_peered":"2024-09-17T02:59:30.779952+0000","last_clean":"2024-09-17T02:59:30.779952+0000","last_became_active":"2024-09-17T02:59:30.779028+0000","last_became_peered":"2024-09-17T02:59:30.779028+0000","last_unstale":"2024-09-17T02:59:30.779952+0000","last_undegraded":"2024-09-17T02:59:30.779952+0000","last_fullsized":"2024-09-17T02:59:30.779952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:13.099529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768334+0000","last_change":"2024-09-17T02:59:30.768334+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768334+0000","last_undegraded":"2024-09-17T02:59:30.768334+0000","last_fullsized":"2024-09-17T02:59:30.768334+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779699+0000","last_change":"2024-09-17T02:59:30.779494+0000","last_active":"2024-09-17T02:59:30.779699+0000","last_peered":"2024-09-17T02:59:30.779699+0000","last_clean":"2024-09-17T02:59:30.779699+0000","last_became_active":"2024-09-17T02:59:30.779228+0000","last_became_peered":"2024-09-17T02:59:30.779228+0000","last_unstale":"2024-09-17T02:59:30.779699+0000","last_undegraded":"2024-09-17T02:59:30.779699+0000","last_fullsized":"2024-09-17T02:59:30.779699+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:33.231498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774238+0000","last_change":"2024-09-17T02:59:30.774238+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774238+0000","last_undegraded":"2024-09-17T02:59:30.774238+0000","last_fullsized":"2024-09-17T02:59:30.774238+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779019+0000","last_change":"2024-09-17T02:59:30.778833+0000","last_active":"2024-09-17T02:59:30.779019+0000","last_peered":"2024-09-17T02:59:30.779019+0000","last_clean":"2024-09-17T02:59:30.779019+0000","last_became_active":"2024-09-17T02:59:30.778564+0000","last_became_peered":"2024-09-17T02:59:30.778564+0000","last_unstale":"2024-09-17T02:59:30.779019+0000","last_undegraded":"2024-09-17T02:59:30.779019+0000","last_fullsized":"2024-09-17T02:59:30.779019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:11.787274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767216+0000","last_change":"2024-09-17T02:59:30.767216+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767216+0000","last_undegraded":"2024-09-17T02:59:30.767216+0000","last_fullsized":"2024-09-17T02:59:30.767216+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777602+0000","last_change":"2024-09-17T02:59:30.777197+0000","last_active":"2024-09-17T02:59:30.777602+0000","last_peered":"2024-09-17T02:59:30.777602+0000","last_clean":"2024-09-17T02:59:30.777602+0000","last_became_active":"2024-09-17T02:59:30.776871+0000","last_became_peered":"2024-09-17T02:59:30.776871+0000","last_unstale":"2024-09-17T02:59:30.777602+0000","last_undegraded":"2024-09-17T02:59:30.777602+0000","last_fullsized":"2024-09-17T02:59:30.777602+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:04.943705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775438+0000","last_change":"2024-09-17T02:59:30.775438+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775438+0000","last_undegraded":"2024-09-17T02:59:30.775438+0000","last_fullsized":"2024-09-17T02:59:30.775438+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778425+0000","last_change":"2024-09-17T02:59:30.778211+0000","last_active":"2024-09-17T02:59:30.778425+0000","last_peered":"2024-09-17T02:59:30.778425+0000","last_clean":"2024-09-17T02:59:30.778425+0000","last_became_active":"2024-09-17T02:59:30.777940+0000","last_became_peered":"2024-09-17T02:59:30.777940+0000","last_unstale":"2024-09-17T02:59:30.778425+0000","last_undegraded":"2024-09-17T02:59:30.778425+0000","last_fullsized":"2024-09-17T02:59:30.778425+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:29.903145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773883+0000","last_change":"2024-09-17T02:59:30.773883+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773883+0000","last_undegraded":"2024-09-17T02:59:30.773883+0000","last_fullsized":"2024-09-17T02:59:30.773883+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777690+0000","last_change":"2024-09-17T02:59:30.776643+0000","last_active":"2024-09-17T02:59:30.777690+0000","last_peered":"2024-09-17T02:59:30.777690+0000","last_clean":"2024-09-17T02:59:30.777690+0000","last_became_active":"2024-09-17T02:59:30.776137+0000","last_became_peered":"2024-09-17T02:59:30.776137+0000","last_unstale":"2024-09-17T02:59:30.777690+0000","last_undegraded":"2024-09-17T02:59:30.777690+0000","last_fullsized":"2024-09-17T02:59:30.777690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773278+0000","last_change":"2024-09-17T02:59:30.773278+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773278+0000","last_undegraded":"2024-09-17T02:59:30.773278+0000","last_fullsized":"2024-09-17T02:59:30.773278+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777174+0000","last_change":"2024-09-17T02:59:30.776607+0000","last_active":"2024-09-17T02:59:30.777174+0000","last_peered":"2024-09-17T02:59:30.777174+0000","last_clean":"2024-09-17T02:59:30.777174+0000","last_became_active":"2024-09-17T02:59:30.775981+0000","last_became_peered":"2024-09-17T02:59:30.775981+0000","last_unstale":"2024-09-17T02:59:30.777174+0000","last_undegraded":"2024-09-17T02:59:30.777174+0000","last_fullsized":"2024-09-17T02:59:30.777174+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:15.789926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772999+0000","last_change":"2024-09-17T02:59:30.772999+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772999+0000","last_undegraded":"2024-09-17T02:59:30.772999+0000","last_fullsized":"2024-09-17T02:59:30.772999+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773379+0000","last_change":"2024-09-17T02:59:30.773108+0000","last_active":"2024-09-17T02:59:30.773379+0000","last_peered":"2024-09-17T02:59:30.773379+0000","last_clean":"2024-09-17T02:59:30.773379+0000","last_became_active":"2024-09-17T02:59:30.772831+0000","last_became_peered":"2024-09-17T02:59:30.772831+0000","last_unstale":"2024-09-17T02:59:30.773379+0000","last_undegraded":"2024-09-17T02:59:30.773379+0000","last_fullsized":"2024-09-17T02:59:30.773379+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:41.156681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768995+0000","last_change":"2024-09-17T02:59:30.768995+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768995+0000","last_undegraded":"2024-09-17T02:59:30.768995+0000","last_fullsized":"2024-09-17T02:59:30.768995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778994+0000","last_change":"2024-09-17T02:59:30.778763+0000","last_active":"2024-09-17T02:59:30.778994+0000","last_peered":"2024-09-17T02:59:30.778994+0000","last_clean":"2024-09-17T02:59:30.778994+0000","last_became_active":"2024-09-17T02:59:30.778425+0000","last_became_peered":"2024-09-17T02:59:30.778425+0000","last_unstale":"2024-09-17T02:59:30.778994+0000","last_undegraded":"2024-09-17T02:59:30.778994+0000","last_fullsized":"2024-09-17T02:59:30.778994+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:55.570417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774189+0000","last_change":"2024-09-17T02:59:30.774189+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774189+0000","last_undegraded":"2024-09-17T02:59:30.774189+0000","last_fullsized":"2024-09-17T02:59:30.774189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.775014+0000","last_change":"2024-09-17T02:59:30.774130+0000","last_active":"2024-09-17T02:59:30.775014+0000","last_peered":"2024-09-17T02:59:30.775014+0000","last_clean":"2024-09-17T02:59:30.775014+0000","last_became_active":"2024-09-17T02:59:30.773829+0000","last_became_peered":"2024-09-17T02:59:30.773829+0000","last_unstale":"2024-09-17T02:59:30.775014+0000","last_undegraded":"2024-09-17T02:59:30.775014+0000","last_fullsized":"2024-09-17T02:59:30.775014+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:30.784203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772682+0000","last_change":"2024-09-17T02:59:30.772682+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772682+0000","last_undegraded":"2024-09-17T02:59:30.772682+0000","last_fullsized":"2024-09-17T02:59:30.772682+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.775685+0000","last_change":"2024-09-17T02:59:30.774809+0000","last_active":"2024-09-17T02:59:30.775685+0000","last_peered":"2024-09-17T02:59:30.775685+0000","last_clean":"2024-09-17T02:59:30.775685+0000","last_became_active":"2024-09-17T02:59:30.774443+0000","last_became_peered":"2024-09-17T02:59:30.774443+0000","last_unstale":"2024-09-17T02:59:30.775685+0000","last_undegraded":"2024-09-17T02:59:30.775685+0000","last_fullsized":"2024-09-17T02:59:30.775685+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:38.509170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773410+0000","last_change":"2024-09-17T02:59:30.773410+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773410+0000","last_undegraded":"2024-09-17T02:59:30.773410+0000","last_fullsized":"2024-09-17T02:59:30.773410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777203+0000","last_change":"2024-09-17T02:59:30.776880+0000","last_active":"2024-09-17T02:59:30.777203+0000","last_peered":"2024-09-17T02:59:30.777203+0000","last_clean":"2024-09-17T02:59:30.777203+0000","last_became_active":"2024-09-17T02:59:30.776353+0000","last_became_peered":"2024-09-17T02:59:30.776353+0000","last_unstale":"2024-09-17T02:59:30.777203+0000","last_undegraded":"2024-09-17T02:59:30.777203+0000","last_fullsized":"2024-09-17T02:59:30.777203+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:20.916511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773496+0000","last_change":"2024-09-17T02:59:30.773496+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773496+0000","last_undegraded":"2024-09-17T02:59:30.773496+0000","last_fullsized":"2024-09-17T02:59:30.773496+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.772053+0000","last_change":"2024-09-17T02:59:30.770755+0000","last_active":"2024-09-17T02:59:30.772053+0000","last_peered":"2024-09-17T02:59:30.772053+0000","last_clean":"2024-09-17T02:59:30.772053+0000","last_became_active":"2024-09-17T02:59:30.770479+0000","last_became_peered":"2024-09-17T02:59:30.770479+0000","last_unstale":"2024-09-17T02:59:30.772053+0000","last_undegraded":"2024-09-17T02:59:30.772053+0000","last_fullsized":"2024-09-17T02:59:30.772053+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:09.064606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766841+0000","last_change":"2024-09-17T02:59:30.766841+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766841+0000","last_undegraded":"2024-09-17T02:59:30.766841+0000","last_fullsized":"2024-09-17T02:59:30.766841+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777276+0000","last_change":"2024-09-17T02:59:30.777012+0000","last_active":"2024-09-17T02:59:30.777276+0000","last_peered":"2024-09-17T02:59:30.777276+0000","last_clean":"2024-09-17T02:59:30.777276+0000","last_became_active":"2024-09-17T02:59:30.776717+0000","last_became_peered":"2024-09-17T02:59:30.776717+0000","last_unstale":"2024-09-17T02:59:30.777276+0000","last_undegraded":"2024-09-17T02:59:30.777276+0000","last_fullsized":"2024-09-17T02:59:30.777276+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:20.672235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767485+0000","last_change":"2024-09-17T02:59:30.767485+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767485+0000","last_undegraded":"2024-09-17T02:59:30.767485+0000","last_fullsized":"2024-09-17T02:59:30.767485+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777719+0000","last_change":"2024-09-17T02:59:30.776961+0000","last_active":"2024-09-17T02:59:30.777719+0000","last_peered":"2024-09-17T02:59:30.777719+0000","last_clean":"2024-09-17T02:59:30.777719+0000","last_became_active":"2024-09-17T02:59:30.776641+0000","last_became_peered":"2024-09-17T02:59:30.776641+0000","last_unstale":"2024-09-17T02:59:30.777719+0000","last_undegraded":"2024-09-17T02:59:30.777719+0000","last_fullsized":"2024-09-17T02:59:30.777719+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:39.085294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772989+0000","last_change":"2024-09-17T02:59:30.772989+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772989+0000","last_undegraded":"2024-09-17T02:59:30.772989+0000","last_fullsized":"2024-09-17T02:59:30.772989+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.771811+0000","last_change":"2024-09-17T02:59:30.771535+0000","last_active":"2024-09-17T02:59:30.771811+0000","last_peered":"2024-09-17T02:59:30.771811+0000","last_clean":"2024-09-17T02:59:30.771811+0000","last_became_active":"2024-09-17T02:59:30.771231+0000","last_became_peered":"2024-09-17T02:59:30.771231+0000","last_unstale":"2024-09-17T02:59:30.771811+0000","last_undegraded":"2024-09-17T02:59:30.771811+0000","last_fullsized":"2024-09-17T02:59:30.771811+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:45.853629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769153+0000","last_change":"2024-09-17T02:59:30.769153+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769153+0000","last_undegraded":"2024-09-17T02:59:30.769153+0000","last_fullsized":"2024-09-17T02:59:30.769153+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778792+0000","last_change":"2024-09-17T02:59:30.778406+0000","last_active":"2024-09-17T02:59:30.778792+0000","last_peered":"2024-09-17T02:59:30.778792+0000","last_clean":"2024-09-17T02:59:30.778792+0000","last_became_active":"2024-09-17T02:59:30.778023+0000","last_became_peered":"2024-09-17T02:59:30.778023+0000","last_unstale":"2024-09-17T02:59:30.778792+0000","last_undegraded":"2024-09-17T02:59:30.778792+0000","last_fullsized":"2024-09-17T02:59:30.778792+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:07.037176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772078+0000","last_change":"2024-09-17T02:59:30.772078+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772078+0000","last_undegraded":"2024-09-17T02:59:30.772078+0000","last_fullsized":"2024-09-17T02:59:30.772078+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773841+0000","last_change":"2024-09-17T02:59:30.773650+0000","last_active":"2024-09-17T02:59:30.773841+0000","last_peered":"2024-09-17T02:59:30.773841+0000","last_clean":"2024-09-17T02:59:30.773841+0000","last_became_active":"2024-09-17T02:59:30.773409+0000","last_became_peered":"2024-09-17T02:59:30.773409+0000","last_unstale":"2024-09-17T02:59:30.773841+0000","last_undegraded":"2024-09-17T02:59:30.773841+0000","last_fullsized":"2024-09-17T02:59:30.773841+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:10.640195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772312+0000","last_change":"2024-09-17T02:59:30.772312+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772312+0000","last_undegraded":"2024-09-17T02:59:30.772312+0000","last_fullsized":"2024-09-17T02:59:30.772312+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779658+0000","last_change":"2024-09-17T02:59:30.779136+0000","last_active":"2024-09-17T02:59:30.779658+0000","last_peered":"2024-09-17T02:59:30.779658+0000","last_clean":"2024-09-17T02:59:30.779658+0000","last_became_active":"2024-09-17T02:59:30.778832+0000","last_became_peered":"2024-09-17T02:59:30.778832+0000","last_unstale":"2024-09-17T02:59:30.779658+0000","last_undegraded":"2024-09-17T02:59:30.779658+0000","last_fullsized":"2024-09-17T02:59:30.779658+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:52.479307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770363+0000","last_change":"2024-09-17T02:59:30.770363+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770363+0000","last_undegraded":"2024-09-17T02:59:30.770363+0000","last_fullsized":"2024-09-17T02:59:30.770363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.776274+0000","last_change":"2024-09-17T02:59:30.776068+0000","last_active":"2024-09-17T02:59:30.776274+0000","last_peered":"2024-09-17T02:59:30.776274+0000","last_clean":"2024-09-17T02:59:30.776274+0000","last_became_active":"2024-09-17T02:59:30.775809+0000","last_became_peered":"2024-09-17T02:59:30.775809+0000","last_unstale":"2024-09-17T02:59:30.776274+0000","last_undegraded":"2024-09-17T02:59:30.776274+0000","last_fullsized":"2024-09-17T02:59:30.776274+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:50.054957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771644+0000","last_change":"2024-09-17T02:59:30.771644+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771644+0000","last_undegraded":"2024-09-17T02:59:30.771644+0000","last_fullsized":"2024-09-17T02:59:30.771644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773906+0000","last_change":"2024-09-17T02:59:30.773128+0000","last_active":"2024-09-17T02:59:30.773906+0000","last_peered":"2024-09-17T02:59:30.773906+0000","last_clean":"2024-09-17T02:59:30.773906+0000","last_became_active":"2024-09-17T02:59:30.772857+0000","last_became_peered":"2024-09-17T02:59:30.772857+0000","last_unstale":"2024-09-17T02:59:30.773906+0000","last_undegraded":"2024-09-17T02:59:30.773906+0000","last_fullsized":"2024-09-17T02:59:30.773906+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770002+0000","last_change":"2024-09-17T02:59:30.770002+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770002+0000","last_undegraded":"2024-09-17T02:59:30.770002+0000","last_fullsized":"2024-09-17T02:59:30.770002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.774956+0000","last_change":"2024-09-17T02:59:30.774353+0000","last_active":"2024-09-17T02:59:30.774956+0000","last_peered":"2024-09-17T02:59:30.774956+0000","last_clean":"2024-09-17T02:59:30.774956+0000","last_became_active":"2024-09-17T02:59:30.774048+0000","last_became_peered":"2024-09-17T02:59:30.774048+0000","last_unstale":"2024-09-17T02:59:30.774956+0000","last_undegraded":"2024-09-17T02:59:30.774956+0000","last_fullsized":"2024-09-17T02:59:30.774956+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:19.762892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771858+0000","last_change":"2024-09-17T02:59:30.771858+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771858+0000","last_undegraded":"2024-09-17T02:59:30.771858+0000","last_fullsized":"2024-09-17T02:59:30.771858+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.769682+0000","last_change":"2024-09-17T02:59:30.769448+0000","last_active":"2024-09-17T02:59:30.769682+0000","last_peered":"2024-09-17T02:59:30.769682+0000","last_clean":"2024-09-17T02:59:30.769682+0000","last_became_active":"2024-09-17T02:59:30.769161+0000","last_became_peered":"2024-09-17T02:59:30.769161+0000","last_unstale":"2024-09-17T02:59:30.769682+0000","last_undegraded":"2024-09-17T02:59:30.769682+0000","last_fullsized":"2024-09-17T02:59:30.769682+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:20.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773339+0000","last_change":"2024-09-17T02:59:30.773339+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773339+0000","last_undegraded":"2024-09-17T02:59:30.773339+0000","last_fullsized":"2024-09-17T02:59:30.773339+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773097+0000","last_change":"2024-09-17T02:59:30.772398+0000","last_active":"2024-09-17T02:59:30.773097+0000","last_peered":"2024-09-17T02:59:30.773097+0000","last_clean":"2024-09-17T02:59:30.773097+0000","last_became_active":"2024-09-17T02:59:30.772121+0000","last_became_peered":"2024-09-17T02:59:30.772121+0000","last_unstale":"2024-09-17T02:59:30.773097+0000","last_undegraded":"2024-09-17T02:59:30.773097+0000","last_fullsized":"2024-09-17T02:59:30.773097+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:43.182077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767594+0000","last_change":"2024-09-17T02:59:30.767594+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767594+0000","last_undegraded":"2024-09-17T02:59:30.767594+0000","last_fullsized":"2024-09-17T02:59:30.767594+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779116+0000","last_change":"2024-09-17T02:59:30.778774+0000","last_active":"2024-09-17T02:59:30.779116+0000","last_peered":"2024-09-17T02:59:30.779116+0000","last_clean":"2024-09-17T02:59:30.779116+0000","last_became_active":"2024-09-17T02:59:30.776595+0000","last_became_peered":"2024-09-17T02:59:30.776595+0000","last_unstale":"2024-09-17T02:59:30.779116+0000","last_undegraded":"2024-09-17T02:59:30.779116+0000","last_fullsized":"2024-09-17T02:59:30.779116+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:09.933214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772374+0000","last_change":"2024-09-17T02:59:30.772374+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772374+0000","last_undegraded":"2024-09-17T02:59:30.772374+0000","last_fullsized":"2024-09-17T02:59:30.772374+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.771073+0000","last_change":"2024-09-17T02:59:30.770863+0000","last_active":"2024-09-17T02:59:30.771073+0000","last_peered":"2024-09-17T02:59:30.771073+0000","last_clean":"2024-09-17T02:59:30.771073+0000","last_became_active":"2024-09-17T02:59:30.770422+0000","last_became_peered":"2024-09-17T02:59:30.770422+0000","last_unstale":"2024-09-17T02:59:30.771073+0000","last_undegraded":"2024-09-17T02:59:30.771073+0000","last_fullsized":"2024-09-17T02:59:30.771073+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.357285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770797+0000","last_change":"2024-09-17T02:59:30.770797+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770797+0000","last_undegraded":"2024-09-17T02:59:30.770797+0000","last_fullsized":"2024-09-17T02:59:30.770797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.776563+0000","last_change":"2024-09-17T02:59:30.776358+0000","last_active":"2024-09-17T02:59:30.776563+0000","last_peered":"2024-09-17T02:59:30.776563+0000","last_clean":"2024-09-17T02:59:30.776563+0000","last_became_active":"2024-09-17T02:59:30.776058+0000","last_became_peered":"2024-09-17T02:59:30.776058+0000","last_unstale":"2024-09-17T02:59:30.776563+0000","last_undegraded":"2024-09-17T02:59:30.776563+0000","last_fullsized":"2024-09-17T02:59:30.776563+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:22.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773000+0000","last_change":"2024-09-17T02:59:30.773000+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773000+0000","last_undegraded":"2024-09-17T02:59:30.773000+0000","last_fullsized":"2024-09-17T02:59:30.773000+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.780393+0000","last_change":"2024-09-17T02:59:30.780170+0000","last_active":"2024-09-17T02:59:30.780393+0000","last_peered":"2024-09-17T02:59:30.780393+0000","last_clean":"2024-09-17T02:59:30.780393+0000","last_became_active":"2024-09-17T02:59:30.779554+0000","last_became_peered":"2024-09-17T02:59:30.779554+0000","last_unstale":"2024-09-17T02:59:30.780393+0000","last_undegraded":"2024-09-17T02:59:30.780393+0000","last_fullsized":"2024-09-17T02:59:30.780393+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:41.248521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772980+0000","last_change":"2024-09-17T02:59:30.772980+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772980+0000","last_undegraded":"2024-09-17T02:59:30.772980+0000","last_fullsized":"2024-09-17T02:59:30.772980+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777191+0000","last_change":"2024-09-17T02:59:30.775937+0000","last_active":"2024-09-17T02:59:30.777191+0000","last_peered":"2024-09-17T02:59:30.777191+0000","last_clean":"2024-09-17T02:59:30.777191+0000","last_became_active":"2024-09-17T02:59:30.775233+0000","last_became_peered":"2024-09-17T02:59:30.775233+0000","last_unstale":"2024-09-17T02:59:30.777191+0000","last_undegraded":"2024-09-17T02:59:30.777191+0000","last_fullsized":"2024-09-17T02:59:30.777191+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:49.133219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771138+0000","last_change":"2024-09-17T02:59:30.771138+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771138+0000","last_undegraded":"2024-09-17T02:59:30.771138+0000","last_fullsized":"2024-09-17T02:59:30.771138+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.780492+0000","last_change":"2024-09-17T02:59:30.780334+0000","last_active":"2024-09-17T02:59:30.780492+0000","last_peered":"2024-09-17T02:59:30.780492+0000","last_clean":"2024-09-17T02:59:30.780492+0000","last_became_active":"2024-09-17T02:59:30.780082+0000","last_became_peered":"2024-09-17T02:59:30.780082+0000","last_unstale":"2024-09-17T02:59:30.780492+0000","last_undegraded":"2024-09-17T02:59:30.780492+0000","last_fullsized":"2024-09-17T02:59:30.780492+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:47.433713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767115+0000","last_change":"2024-09-17T02:59:30.767115+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767115+0000","last_undegraded":"2024-09-17T02:59:30.767115+0000","last_fullsized":"2024-09-17T02:59:30.767115+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.768299+0000","last_change":"2024-09-17T02:59:30.768062+0000","last_active":"2024-09-17T02:59:30.768299+0000","last_peered":"2024-09-17T02:59:30.768299+0000","last_clean":"2024-09-17T02:59:30.768299+0000","last_became_active":"2024-09-17T02:59:30.767771+0000","last_became_peered":"2024-09-17T02:59:30.767771+0000","last_unstale":"2024-09-17T02:59:30.768299+0000","last_undegraded":"2024-09-17T02:59:30.768299+0000","last_fullsized":"2024-09-17T02:59:30.768299+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:37.720017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":272,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.765357+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:59:30.765357+0000","last_peered":"2024-09-17T02:59:30.765357+0000","last_clean":"2024-09-17T02:59:30.765357+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:59:30.765357+0000","last_undegraded":"2024-09-17T02:59:30.765357+0000","last_fullsized":"2024-09-17T02:59:30.765357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:51.183978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":524,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194788,"statfs":{"total":200000000,"available":199463370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:59:34.800 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:59:34.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.950+0000 7fb821ec4640 1 -- 172.21.15.104:0/2014497983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0cdf10 msgr2=0x7fb81c0b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.950+0000 7fb821ec4640 1 --2- 172.21.15.104:0/2014497983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0cdf10 0x7fb81c0b57e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb810005fd0 tx=0x7fb81002a5d0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.950+0000 7fb821ec4640 1 -- 172.21.15.104:0/2014497983 shutdown_connections 2024-09-17T02:59:34.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.950+0000 7fb821ec4640 1 --2- 172.21.15.104:0/2014497983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb81c0b5d20 0x7fb81c0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.950+0000 7fb821ec4640 1 --2- 172.21.15.104:0/2014497983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0cdf10 0x7fb81c0b57e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.950+0000 7fb821ec4640 1 -- 172.21.15.104:0/2014497983 >> 172.21.15.104:0/2014497983 conn(0x7fb81c0b44a0 msgr2=0x7fb81c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:34.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.950+0000 7fb821ec4640 1 -- 172.21.15.104:0/2014497983 shutdown_connections 2024-09-17T02:59:34.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.950+0000 7fb821ec4640 1 -- 172.21.15.104:0/2014497983 wait complete. 2024-09-17T02:59:34.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.952+0000 7fb821ec4640 1 Processor -- start 2024-09-17T02:59:34.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.952+0000 7fb821ec4640 1 -- start start 2024-09-17T02:59:34.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb821ec4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0b4fc0 0x7fb81c15e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb821ec4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb81c0b5d20 0x7fb81c1f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb821ec4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb81c0cdf10 0x7fb81c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb821ec4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c160f50 con 0x7fb81c0cdf10 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb821ec4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c0d0210 con 0x7fb81c0b4fc0 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb821ec4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb81c1610d0 con 0x7fb81c0b5d20 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb81c0cdf10 0x7fb81c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb81c0cdf10 0x7fb81c155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43324/0 (socket says 172.21.15.104:43324) 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 -- 172.21.15.104:0/3799805150 learned_addr learned my addr 172.21.15.104:0/3799805150 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81b7fe640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0b4fc0 0x7fb81c15e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81affd640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb81c0b5d20 0x7fb81c1f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 -- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb81c0b5d20 msgr2=0x7fb81c1f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb81c0b5d20 0x7fb81c1f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 -- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0b4fc0 msgr2=0x7fb81c15e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0b4fc0 0x7fb81c15e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 -- 172.21.15.104:0/3799805150 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c1f4aa0 con 0x7fb81c0cdf10 2024-09-17T02:59:34.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81b7fe640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0b4fc0 0x7fb81c15e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:34.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb81bfff640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb81c0cdf10 0x7fb81c155aa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb81400ea70 tx=0x7fb81400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:34.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb803fff640 1 -- 172.21.15.104:0/3799805150 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81400ce40 con 0x7fb81c0cdf10 2024-09-17T02:59:34.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb803fff640 1 -- 172.21.15.104:0/3799805150 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb814004c10 con 0x7fb81c0cdf10 2024-09-17T02:59:34.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.954+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c160180 con 0x7fb81c0cdf10 2024-09-17T02:59:34.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.955+0000 7fb803fff640 1 -- 172.21.15.104:0/3799805150 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814005020 con 0x7fb81c0cdf10 2024-09-17T02:59:34.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.955+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c160730 con 0x7fb81c0cdf10 2024-09-17T02:59:34.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.956+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c0cfa80 con 0x7fb81c0cdf10 2024-09-17T02:59:34.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.956+0000 7fb803fff640 1 -- 172.21.15.104:0/3799805150 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8140051c0 con 0x7fb81c0cdf10 2024-09-17T02:59:34.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.957+0000 7fb803fff640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb808078b90 0x7fb80807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:34.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.957+0000 7fb803fff640 1 -- 172.21.15.104:0/3799805150 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fb81409bc40 con 0x7fb81c0cdf10 2024-09-17T02:59:34.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.957+0000 7fb81b7fe640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb808078b90 0x7fb80807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:34.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.958+0000 7fb81b7fe640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb808078b90 0x7fb80807b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb80c007fd0 tx=0x7fb80c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:34.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:34.961+0000 7fb803fff640 1 -- 172.21.15.104:0/3799805150 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb81c1f4aa0 con 0x7fb81c0cdf10 2024-09-17T02:59:35.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.133+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb81c0cead0 con 0x7fb808078b90 2024-09-17T02:59:35.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.137+0000 7fb803fff640 1 -- 172.21.15.104:0/3799805150 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242659 (secure 0 0 0) 0x7fb81c0cead0 con 0x7fb808078b90 2024-09-17T02:59:35.138 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:35.139 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb808078b90 msgr2=0x7fb80807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb808078b90 0x7fb80807b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb80c007fd0 tx=0x7fb80c009040 comp rx=0 tx=0).stop 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb81c0cdf10 msgr2=0x7fb81c155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb81c0cdf10 0x7fb81c155aa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb81400ea70 tx=0x7fb81400ef30 comp rx=0 tx=0).stop 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 shutdown_connections 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb808078b90 0x7fb80807b0a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb81c0cdf10 0x7fb81c155aa0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb81c0b5d20 0x7fb81c1f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 --2- 172.21.15.104:0/3799805150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb81c0b4fc0 0x7fb81c15e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.140+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 >> 172.21.15.104:0/3799805150 conn(0x7fb81c0b44a0 msgr2=0x7fb81c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:35.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.141+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 shutdown_connections 2024-09-17T02:59:35.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.141+0000 7fb821ec4640 1 -- 172.21.15.104:0/3799805150 wait complete. 2024-09-17T02:59:35.150 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-17T02:59:33.692781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5388,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557111,"statfs":{"total":1600000000,"available":1594482299,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001080"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769630+0000","last_change":"2024-09-17T02:59:30.769630+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769630+0000","last_undegraded":"2024-09-17T02:59:30.769630+0000","last_fullsized":"2024-09-17T02:59:30.769630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768274+0000","last_change":"2024-09-17T02:59:30.768274+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768274+0000","last_undegraded":"2024-09-17T02:59:30.768274+0000","last_fullsized":"2024-09-17T02:59:30.768274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.776107+0000","last_change":"2024-09-17T02:59:30.776107+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.776107+0000","last_undegraded":"2024-09-17T02:59:30.776107+0000","last_fullsized":"2024-09-17T02:59:30.776107+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774812+0000","last_change":"2024-09-17T02:59:30.774812+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774812+0000","last_undegraded":"2024-09-17T02:59:30.774812+0000","last_fullsized":"2024-09-17T02:59:30.774812+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774947+0000","last_change":"2024-09-17T02:59:30.774947+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774947+0000","last_undegraded":"2024-09-17T02:59:30.774947+0000","last_fullsized":"2024-09-17T02:59:30.774947+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770155+0000","last_change":"2024-09-17T02:59:30.770155+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770155+0000","last_undegraded":"2024-09-17T02:59:30.770155+0000","last_fullsized":"2024-09-17T02:59:30.770155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772088+0000","last_change":"2024-09-17T02:59:30.772088+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772088+0000","last_undegraded":"2024-09-17T02:59:30.772088+0000","last_fullsized":"2024-09-17T02:59:30.772088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770954+0000","last_change":"2024-09-17T02:59:30.770954+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770954+0000","last_undegraded":"2024-09-17T02:59:30.770954+0000","last_fullsized":"2024-09-17T02:59:30.770954+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769403+0000","last_change":"2024-09-17T02:59:30.769403+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769403+0000","last_undegraded":"2024-09-17T02:59:30.769403+0000","last_fullsized":"2024-09-17T02:59:30.769403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769130+0000","last_change":"2024-09-17T02:59:30.769130+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769130+0000","last_undegraded":"2024-09-17T02:59:30.769130+0000","last_fullsized":"2024-09-17T02:59:30.769130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766608+0000","last_change":"2024-09-17T02:59:30.766608+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766608+0000","last_undegraded":"2024-09-17T02:59:30.766608+0000","last_fullsized":"2024-09-17T02:59:30.766608+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768715+0000","last_change":"2024-09-17T02:59:30.768715+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768715+0000","last_undegraded":"2024-09-17T02:59:30.768715+0000","last_fullsized":"2024-09-17T02:59:30.768715+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774916+0000","last_change":"2024-09-17T02:59:30.774916+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774916+0000","last_undegraded":"2024-09-17T02:59:30.774916+0000","last_fullsized":"2024-09-17T02:59:30.774916+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773067+0000","last_change":"2024-09-17T02:59:30.773067+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773067+0000","last_undegraded":"2024-09-17T02:59:30.773067+0000","last_fullsized":"2024-09-17T02:59:30.773067+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772931+0000","last_change":"2024-09-17T02:59:30.772931+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772931+0000","last_undegraded":"2024-09-17T02:59:30.772931+0000","last_fullsized":"2024-09-17T02:59:30.772931+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775509+0000","last_change":"2024-09-17T02:59:30.775509+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775509+0000","last_undegraded":"2024-09-17T02:59:30.775509+0000","last_fullsized":"2024-09-17T02:59:30.775509+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775875+0000","last_change":"2024-09-17T02:59:30.775875+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775875+0000","last_undegraded":"2024-09-17T02:59:30.775875+0000","last_fullsized":"2024-09-17T02:59:30.775875+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772388+0000","last_change":"2024-09-17T02:59:30.772388+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772388+0000","last_undegraded":"2024-09-17T02:59:30.772388+0000","last_fullsized":"2024-09-17T02:59:30.772388+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774595+0000","last_change":"2024-09-17T02:59:30.774595+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774595+0000","last_undegraded":"2024-09-17T02:59:30.774595+0000","last_fullsized":"2024-09-17T02:59:30.774595+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771404+0000","last_change":"2024-09-17T02:59:30.771404+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771404+0000","last_undegraded":"2024-09-17T02:59:30.771404+0000","last_fullsized":"2024-09-17T02:59:30.771404+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772025+0000","last_change":"2024-09-17T02:59:30.772025+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772025+0000","last_undegraded":"2024-09-17T02:59:30.772025+0000","last_fullsized":"2024-09-17T02:59:30.772025+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767915+0000","last_change":"2024-09-17T02:59:30.767915+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767915+0000","last_undegraded":"2024-09-17T02:59:30.767915+0000","last_fullsized":"2024-09-17T02:59:30.767915+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773448+0000","last_change":"2024-09-17T02:59:30.773448+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773448+0000","last_undegraded":"2024-09-17T02:59:30.773448+0000","last_fullsized":"2024-09-17T02:59:30.773448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772722+0000","last_change":"2024-09-17T02:59:30.772722+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772722+0000","last_undegraded":"2024-09-17T02:59:30.772722+0000","last_fullsized":"2024-09-17T02:59:30.772722+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767625+0000","last_change":"2024-09-17T02:59:30.767625+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767625+0000","last_undegraded":"2024-09-17T02:59:30.767625+0000","last_fullsized":"2024-09-17T02:59:30.767625+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773958+0000","last_change":"2024-09-17T02:59:30.773958+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773958+0000","last_undegraded":"2024-09-17T02:59:30.773958+0000","last_fullsized":"2024-09-17T02:59:30.773958+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772185+0000","last_change":"2024-09-17T02:59:30.772185+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772185+0000","last_undegraded":"2024-09-17T02:59:30.772185+0000","last_fullsized":"2024-09-17T02:59:30.772185+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772228+0000","last_change":"2024-09-17T02:59:30.772228+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772228+0000","last_undegraded":"2024-09-17T02:59:30.772228+0000","last_fullsized":"2024-09-17T02:59:30.772228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766854+0000","last_change":"2024-09-17T02:59:30.766854+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766854+0000","last_undegraded":"2024-09-17T02:59:30.766854+0000","last_fullsized":"2024-09-17T02:59:30.766854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767208+0000","last_change":"2024-09-17T02:59:30.767208+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767208+0000","last_undegraded":"2024-09-17T02:59:30.767208+0000","last_fullsized":"2024-09-17T02:59:30.767208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775142+0000","last_change":"2024-09-17T02:59:30.775142+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775142+0000","last_undegraded":"2024-09-17T02:59:30.775142+0000","last_fullsized":"2024-09-17T02:59:30.775142+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768159+0000","last_change":"2024-09-17T02:59:30.768159+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768159+0000","last_undegraded":"2024-09-17T02:59:30.768159+0000","last_fullsized":"2024-09-17T02:59:30.768159+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774015+0000","last_change":"2024-09-17T02:59:30.774015+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774015+0000","last_undegraded":"2024-09-17T02:59:30.774015+0000","last_fullsized":"2024-09-17T02:59:30.774015+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778236+0000","last_change":"2024-09-17T02:59:30.777486+0000","last_active":"2024-09-17T02:59:30.778236+0000","last_peered":"2024-09-17T02:59:30.778236+0000","last_clean":"2024-09-17T02:59:30.778236+0000","last_became_active":"2024-09-17T02:59:30.775598+0000","last_became_peered":"2024-09-17T02:59:30.775598+0000","last_unstale":"2024-09-17T02:59:30.778236+0000","last_undegraded":"2024-09-17T02:59:30.778236+0000","last_fullsized":"2024-09-17T02:59:30.778236+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:36.245807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771844+0000","last_change":"2024-09-17T02:59:30.771844+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771844+0000","last_undegraded":"2024-09-17T02:59:30.771844+0000","last_fullsized":"2024-09-17T02:59:30.771844+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779952+0000","last_change":"2024-09-17T02:59:30.779490+0000","last_active":"2024-09-17T02:59:30.779952+0000","last_peered":"2024-09-17T02:59:30.779952+0000","last_clean":"2024-09-17T02:59:30.779952+0000","last_became_active":"2024-09-17T02:59:30.779028+0000","last_became_peered":"2024-09-17T02:59:30.779028+0000","last_unstale":"2024-09-17T02:59:30.779952+0000","last_undegraded":"2024-09-17T02:59:30.779952+0000","last_fullsized":"2024-09-17T02:59:30.779952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:13.099529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768334+0000","last_change":"2024-09-17T02:59:30.768334+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768334+0000","last_undegraded":"2024-09-17T02:59:30.768334+0000","last_fullsized":"2024-09-17T02:59:30.768334+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779699+0000","last_change":"2024-09-17T02:59:30.779494+0000","last_active":"2024-09-17T02:59:30.779699+0000","last_peered":"2024-09-17T02:59:30.779699+0000","last_clean":"2024-09-17T02:59:30.779699+0000","last_became_active":"2024-09-17T02:59:30.779228+0000","last_became_peered":"2024-09-17T02:59:30.779228+0000","last_unstale":"2024-09-17T02:59:30.779699+0000","last_undegraded":"2024-09-17T02:59:30.779699+0000","last_fullsized":"2024-09-17T02:59:30.779699+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:33.231498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774238+0000","last_change":"2024-09-17T02:59:30.774238+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774238+0000","last_undegraded":"2024-09-17T02:59:30.774238+0000","last_fullsized":"2024-09-17T02:59:30.774238+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779019+0000","last_change":"2024-09-17T02:59:30.778833+0000","last_active":"2024-09-17T02:59:30.779019+0000","last_peered":"2024-09-17T02:59:30.779019+0000","last_clean":"2024-09-17T02:59:30.779019+0000","last_became_active":"2024-09-17T02:59:30.778564+0000","last_became_peered":"2024-09-17T02:59:30.778564+0000","last_unstale":"2024-09-17T02:59:30.779019+0000","last_undegraded":"2024-09-17T02:59:30.779019+0000","last_fullsized":"2024-09-17T02:59:30.779019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:11.787274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767216+0000","last_change":"2024-09-17T02:59:30.767216+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767216+0000","last_undegraded":"2024-09-17T02:59:30.767216+0000","last_fullsized":"2024-09-17T02:59:30.767216+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777602+0000","last_change":"2024-09-17T02:59:30.777197+0000","last_active":"2024-09-17T02:59:30.777602+0000","last_peered":"2024-09-17T02:59:30.777602+0000","last_clean":"2024-09-17T02:59:30.777602+0000","last_became_active":"2024-09-17T02:59:30.776871+0000","last_became_peered":"2024-09-17T02:59:30.776871+0000","last_unstale":"2024-09-17T02:59:30.777602+0000","last_undegraded":"2024-09-17T02:59:30.777602+0000","last_fullsized":"2024-09-17T02:59:30.777602+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:04.943705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775438+0000","last_change":"2024-09-17T02:59:30.775438+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775438+0000","last_undegraded":"2024-09-17T02:59:30.775438+0000","last_fullsized":"2024-09-17T02:59:30.775438+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778425+0000","last_change":"2024-09-17T02:59:30.778211+0000","last_active":"2024-09-17T02:59:30.778425+0000","last_peered":"2024-09-17T02:59:30.778425+0000","last_clean":"2024-09-17T02:59:30.778425+0000","last_became_active":"2024-09-17T02:59:30.777940+0000","last_became_peered":"2024-09-17T02:59:30.777940+0000","last_unstale":"2024-09-17T02:59:30.778425+0000","last_undegraded":"2024-09-17T02:59:30.778425+0000","last_fullsized":"2024-09-17T02:59:30.778425+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:29.903145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773883+0000","last_change":"2024-09-17T02:59:30.773883+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773883+0000","last_undegraded":"2024-09-17T02:59:30.773883+0000","last_fullsized":"2024-09-17T02:59:30.773883+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777690+0000","last_change":"2024-09-17T02:59:30.776643+0000","last_active":"2024-09-17T02:59:30.777690+0000","last_peered":"2024-09-17T02:59:30.777690+0000","last_clean":"2024-09-17T02:59:30.777690+0000","last_became_active":"2024-09-17T02:59:30.776137+0000","last_became_peered":"2024-09-17T02:59:30.776137+0000","last_unstale":"2024-09-17T02:59:30.777690+0000","last_undegraded":"2024-09-17T02:59:30.777690+0000","last_fullsized":"2024-09-17T02:59:30.777690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773278+0000","last_change":"2024-09-17T02:59:30.773278+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773278+0000","last_undegraded":"2024-09-17T02:59:30.773278+0000","last_fullsized":"2024-09-17T02:59:30.773278+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777174+0000","last_change":"2024-09-17T02:59:30.776607+0000","last_active":"2024-09-17T02:59:30.777174+0000","last_peered":"2024-09-17T02:59:30.777174+0000","last_clean":"2024-09-17T02:59:30.777174+0000","last_became_active":"2024-09-17T02:59:30.775981+0000","last_became_peered":"2024-09-17T02:59:30.775981+0000","last_unstale":"2024-09-17T02:59:30.777174+0000","last_undegraded":"2024-09-17T02:59:30.777174+0000","last_fullsized":"2024-09-17T02:59:30.777174+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:15.789926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772999+0000","last_change":"2024-09-17T02:59:30.772999+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772999+0000","last_undegraded":"2024-09-17T02:59:30.772999+0000","last_fullsized":"2024-09-17T02:59:30.772999+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773379+0000","last_change":"2024-09-17T02:59:30.773108+0000","last_active":"2024-09-17T02:59:30.773379+0000","last_peered":"2024-09-17T02:59:30.773379+0000","last_clean":"2024-09-17T02:59:30.773379+0000","last_became_active":"2024-09-17T02:59:30.772831+0000","last_became_peered":"2024-09-17T02:59:30.772831+0000","last_unstale":"2024-09-17T02:59:30.773379+0000","last_undegraded":"2024-09-17T02:59:30.773379+0000","last_fullsized":"2024-09-17T02:59:30.773379+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:41.156681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768995+0000","last_change":"2024-09-17T02:59:30.768995+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768995+0000","last_undegraded":"2024-09-17T02:59:30.768995+0000","last_fullsized":"2024-09-17T02:59:30.768995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778994+0000","last_change":"2024-09-17T02:59:30.778763+0000","last_active":"2024-09-17T02:59:30.778994+0000","last_peered":"2024-09-17T02:59:30.778994+0000","last_clean":"2024-09-17T02:59:30.778994+0000","last_became_active":"2024-09-17T02:59:30.778425+0000","last_became_peered":"2024-09-17T02:59:30.778425+0000","last_unstale":"2024-09-17T02:59:30.778994+0000","last_undegraded":"2024-09-17T02:59:30.778994+0000","last_fullsized":"2024-09-17T02:59:30.778994+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:55.570417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774189+0000","last_change":"2024-09-17T02:59:30.774189+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774189+0000","last_undegraded":"2024-09-17T02:59:30.774189+0000","last_fullsized":"2024-09-17T02:59:30.774189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.775014+0000","last_change":"2024-09-17T02:59:30.774130+0000","last_active":"2024-09-17T02:59:30.775014+0000","last_peered":"2024-09-17T02:59:30.775014+0000","last_clean":"2024-09-17T02:59:30.775014+0000","last_became_active":"2024-09-17T02:59:30.773829+0000","last_became_peered":"2024-09-17T02:59:30.773829+0000","last_unstale":"2024-09-17T02:59:30.775014+0000","last_undegraded":"2024-09-17T02:59:30.775014+0000","last_fullsized":"2024-09-17T02:59:30.775014+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:30.784203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772682+0000","last_change":"2024-09-17T02:59:30.772682+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772682+0000","last_undegraded":"2024-09-17T02:59:30.772682+0000","last_fullsized":"2024-09-17T02:59:30.772682+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.775685+0000","last_change":"2024-09-17T02:59:30.774809+0000","last_active":"2024-09-17T02:59:30.775685+0000","last_peered":"2024-09-17T02:59:30.775685+0000","last_clean":"2024-09-17T02:59:30.775685+0000","last_became_active":"2024-09-17T02:59:30.774443+0000","last_became_peered":"2024-09-17T02:59:30.774443+0000","last_unstale":"2024-09-17T02:59:30.775685+0000","last_undegraded":"2024-09-17T02:59:30.775685+0000","last_fullsized":"2024-09-17T02:59:30.775685+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:38.509170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773410+0000","last_change":"2024-09-17T02:59:30.773410+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773410+0000","last_undegraded":"2024-09-17T02:59:30.773410+0000","last_fullsized":"2024-09-17T02:59:30.773410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777203+0000","last_change":"2024-09-17T02:59:30.776880+0000","last_active":"2024-09-17T02:59:30.777203+0000","last_peered":"2024-09-17T02:59:30.777203+0000","last_clean":"2024-09-17T02:59:30.777203+0000","last_became_active":"2024-09-17T02:59:30.776353+0000","last_became_peered":"2024-09-17T02:59:30.776353+0000","last_unstale":"2024-09-17T02:59:30.777203+0000","last_undegraded":"2024-09-17T02:59:30.777203+0000","last_fullsized":"2024-09-17T02:59:30.777203+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:20.916511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773496+0000","last_change":"2024-09-17T02:59:30.773496+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773496+0000","last_undegraded":"2024-09-17T02:59:30.773496+0000","last_fullsized":"2024-09-17T02:59:30.773496+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.772053+0000","last_change":"2024-09-17T02:59:30.770755+0000","last_active":"2024-09-17T02:59:30.772053+0000","last_peered":"2024-09-17T02:59:30.772053+0000","last_clean":"2024-09-17T02:59:30.772053+0000","last_became_active":"2024-09-17T02:59:30.770479+0000","last_became_peered":"2024-09-17T02:59:30.770479+0000","last_unstale":"2024-09-17T02:59:30.772053+0000","last_undegraded":"2024-09-17T02:59:30.772053+0000","last_fullsized":"2024-09-17T02:59:30.772053+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:09.064606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766841+0000","last_change":"2024-09-17T02:59:30.766841+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766841+0000","last_undegraded":"2024-09-17T02:59:30.766841+0000","last_fullsized":"2024-09-17T02:59:30.766841+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777276+0000","last_change":"2024-09-17T02:59:30.777012+0000","last_active":"2024-09-17T02:59:30.777276+0000","last_peered":"2024-09-17T02:59:30.777276+0000","last_clean":"2024-09-17T02:59:30.777276+0000","last_became_active":"2024-09-17T02:59:30.776717+0000","last_became_peered":"2024-09-17T02:59:30.776717+0000","last_unstale":"2024-09-17T02:59:30.777276+0000","last_undegraded":"2024-09-17T02:59:30.777276+0000","last_fullsized":"2024-09-17T02:59:30.777276+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:20.672235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767485+0000","last_change":"2024-09-17T02:59:30.767485+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767485+0000","last_undegraded":"2024-09-17T02:59:30.767485+0000","last_fullsized":"2024-09-17T02:59:30.767485+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777719+0000","last_change":"2024-09-17T02:59:30.776961+0000","last_active":"2024-09-17T02:59:30.777719+0000","last_peered":"2024-09-17T02:59:30.777719+0000","last_clean":"2024-09-17T02:59:30.777719+0000","last_became_active":"2024-09-17T02:59:30.776641+0000","last_became_peered":"2024-09-17T02:59:30.776641+0000","last_unstale":"2024-09-17T02:59:30.777719+0000","last_undegraded":"2024-09-17T02:59:30.777719+0000","last_fullsized":"2024-09-17T02:59:30.777719+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:39.085294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772989+0000","last_change":"2024-09-17T02:59:30.772989+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772989+0000","last_undegraded":"2024-09-17T02:59:30.772989+0000","last_fullsized":"2024-09-17T02:59:30.772989+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.771811+0000","last_change":"2024-09-17T02:59:30.771535+0000","last_active":"2024-09-17T02:59:30.771811+0000","last_peered":"2024-09-17T02:59:30.771811+0000","last_clean":"2024-09-17T02:59:30.771811+0000","last_became_active":"2024-09-17T02:59:30.771231+0000","last_became_peered":"2024-09-17T02:59:30.771231+0000","last_unstale":"2024-09-17T02:59:30.771811+0000","last_undegraded":"2024-09-17T02:59:30.771811+0000","last_fullsized":"2024-09-17T02:59:30.771811+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:45.853629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769153+0000","last_change":"2024-09-17T02:59:30.769153+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769153+0000","last_undegraded":"2024-09-17T02:59:30.769153+0000","last_fullsized":"2024-09-17T02:59:30.769153+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778792+0000","last_change":"2024-09-17T02:59:30.778406+0000","last_active":"2024-09-17T02:59:30.778792+0000","last_peered":"2024-09-17T02:59:30.778792+0000","last_clean":"2024-09-17T02:59:30.778792+0000","last_became_active":"2024-09-17T02:59:30.778023+0000","last_became_peered":"2024-09-17T02:59:30.778023+0000","last_unstale":"2024-09-17T02:59:30.778792+0000","last_undegraded":"2024-09-17T02:59:30.778792+0000","last_fullsized":"2024-09-17T02:59:30.778792+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:07.037176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772078+0000","last_change":"2024-09-17T02:59:30.772078+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772078+0000","last_undegraded":"2024-09-17T02:59:30.772078+0000","last_fullsized":"2024-09-17T02:59:30.772078+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773841+0000","last_change":"2024-09-17T02:59:30.773650+0000","last_active":"2024-09-17T02:59:30.773841+0000","last_peered":"2024-09-17T02:59:30.773841+0000","last_clean":"2024-09-17T02:59:30.773841+0000","last_became_active":"2024-09-17T02:59:30.773409+0000","last_became_peered":"2024-09-17T02:59:30.773409+0000","last_unstale":"2024-09-17T02:59:30.773841+0000","last_undegraded":"2024-09-17T02:59:30.773841+0000","last_fullsized":"2024-09-17T02:59:30.773841+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:10.640195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772312+0000","last_change":"2024-09-17T02:59:30.772312+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772312+0000","last_undegraded":"2024-09-17T02:59:30.772312+0000","last_fullsized":"2024-09-17T02:59:30.772312+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779658+0000","last_change":"2024-09-17T02:59:30.779136+0000","last_active":"2024-09-17T02:59:30.779658+0000","last_peered":"2024-09-17T02:59:30.779658+0000","last_clean":"2024-09-17T02:59:30.779658+0000","last_became_active":"2024-09-17T02:59:30.778832+0000","last_became_peered":"2024-09-17T02:59:30.778832+0000","last_unstale":"2024-09-17T02:59:30.779658+0000","last_undegraded":"2024-09-17T02:59:30.779658+0000","last_fullsized":"2024-09-17T02:59:30.779658+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:52.479307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770363+0000","last_change":"2024-09-17T02:59:30.770363+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770363+0000","last_undegraded":"2024-09-17T02:59:30.770363+0000","last_fullsized":"2024-09-17T02:59:30.770363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.776274+0000","last_change":"2024-09-17T02:59:30.776068+0000","last_active":"2024-09-17T02:59:30.776274+0000","last_peered":"2024-09-17T02:59:30.776274+0000","last_clean":"2024-09-17T02:59:30.776274+0000","last_became_active":"2024-09-17T02:59:30.775809+0000","last_became_peered":"2024-09-17T02:59:30.775809+0000","last_unstale":"2024-09-17T02:59:30.776274+0000","last_undegraded":"2024-09-17T02:59:30.776274+0000","last_fullsized":"2024-09-17T02:59:30.776274+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:50.054957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771644+0000","last_change":"2024-09-17T02:59:30.771644+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771644+0000","last_undegraded":"2024-09-17T02:59:30.771644+0000","last_fullsized":"2024-09-17T02:59:30.771644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773906+0000","last_change":"2024-09-17T02:59:30.773128+0000","last_active":"2024-09-17T02:59:30.773906+0000","last_peered":"2024-09-17T02:59:30.773906+0000","last_clean":"2024-09-17T02:59:30.773906+0000","last_became_active":"2024-09-17T02:59:30.772857+0000","last_became_peered":"2024-09-17T02:59:30.772857+0000","last_unstale":"2024-09-17T02:59:30.773906+0000","last_undegraded":"2024-09-17T02:59:30.773906+0000","last_fullsized":"2024-09-17T02:59:30.773906+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770002+0000","last_change":"2024-09-17T02:59:30.770002+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770002+0000","last_undegraded":"2024-09-17T02:59:30.770002+0000","last_fullsized":"2024-09-17T02:59:30.770002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.774956+0000","last_change":"2024-09-17T02:59:30.774353+0000","last_active":"2024-09-17T02:59:30.774956+0000","last_peered":"2024-09-17T02:59:30.774956+0000","last_clean":"2024-09-17T02:59:30.774956+0000","last_became_active":"2024-09-17T02:59:30.774048+0000","last_became_peered":"2024-09-17T02:59:30.774048+0000","last_unstale":"2024-09-17T02:59:30.774956+0000","last_undegraded":"2024-09-17T02:59:30.774956+0000","last_fullsized":"2024-09-17T02:59:30.774956+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:19.762892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771858+0000","last_change":"2024-09-17T02:59:30.771858+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771858+0000","last_undegraded":"2024-09-17T02:59:30.771858+0000","last_fullsized":"2024-09-17T02:59:30.771858+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.769682+0000","last_change":"2024-09-17T02:59:30.769448+0000","last_active":"2024-09-17T02:59:30.769682+0000","last_peered":"2024-09-17T02:59:30.769682+0000","last_clean":"2024-09-17T02:59:30.769682+0000","last_became_active":"2024-09-17T02:59:30.769161+0000","last_became_peered":"2024-09-17T02:59:30.769161+0000","last_unstale":"2024-09-17T02:59:30.769682+0000","last_undegraded":"2024-09-17T02:59:30.769682+0000","last_fullsized":"2024-09-17T02:59:30.769682+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:20.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773339+0000","last_change":"2024-09-17T02:59:30.773339+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773339+0000","last_undegraded":"2024-09-17T02:59:30.773339+0000","last_fullsized":"2024-09-17T02:59:30.773339+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773097+0000","last_change":"2024-09-17T02:59:30.772398+0000","last_active":"2024-09-17T02:59:30.773097+0000","last_peered":"2024-09-17T02:59:30.773097+0000","last_clean":"2024-09-17T02:59:30.773097+0000","last_became_active":"2024-09-17T02:59:30.772121+0000","last_became_peered":"2024-09-17T02:59:30.772121+0000","last_unstale":"2024-09-17T02:59:30.773097+0000","last_undegraded":"2024-09-17T02:59:30.773097+0000","last_fullsized":"2024-09-17T02:59:30.773097+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:43.182077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767594+0000","last_change":"2024-09-17T02:59:30.767594+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767594+0000","last_undegraded":"2024-09-17T02:59:30.767594+0000","last_fullsized":"2024-09-17T02:59:30.767594+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779116+0000","last_change":"2024-09-17T02:59:30.778774+0000","last_active":"2024-09-17T02:59:30.779116+0000","last_peered":"2024-09-17T02:59:30.779116+0000","last_clean":"2024-09-17T02:59:30.779116+0000","last_became_active":"2024-09-17T02:59:30.776595+0000","last_became_peered":"2024-09-17T02:59:30.776595+0000","last_unstale":"2024-09-17T02:59:30.779116+0000","last_undegraded":"2024-09-17T02:59:30.779116+0000","last_fullsized":"2024-09-17T02:59:30.779116+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:09.933214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772374+0000","last_change":"2024-09-17T02:59:30.772374+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772374+0000","last_undegraded":"2024-09-17T02:59:30.772374+0000","last_fullsized":"2024-09-17T02:59:30.772374+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.771073+0000","last_change":"2024-09-17T02:59:30.770863+0000","last_active":"2024-09-17T02:59:30.771073+0000","last_peered":"2024-09-17T02:59:30.771073+0000","last_clean":"2024-09-17T02:59:30.771073+0000","last_became_active":"2024-09-17T02:59:30.770422+0000","last_became_peered":"2024-09-17T02:59:30.770422+0000","last_unstale":"2024-09-17T02:59:30.771073+0000","last_undegraded":"2024-09-17T02:59:30.771073+0000","last_fullsized":"2024-09-17T02:59:30.771073+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.357285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770797+0000","last_change":"2024-09-17T02:59:30.770797+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770797+0000","last_undegraded":"2024-09-17T02:59:30.770797+0000","last_fullsized":"2024-09-17T02:59:30.770797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.776563+0000","last_change":"2024-09-17T02:59:30.776358+0000","last_active":"2024-09-17T02:59:30.776563+0000","last_peered":"2024-09-17T02:59:30.776563+0000","last_clean":"2024-09-17T02:59:30.776563+0000","last_became_active":"2024-09-17T02:59:30.776058+0000","last_became_peered":"2024-09-17T02:59:30.776058+0000","last_unstale":"2024-09-17T02:59:30.776563+0000","last_undegraded":"2024-09-17T02:59:30.776563+0000","last_fullsized":"2024-09-17T02:59:30.776563+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:22.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773000+0000","last_change":"2024-09-17T02:59:30.773000+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773000+0000","last_undegraded":"2024-09-17T02:59:30.773000+0000","last_fullsized":"2024-09-17T02:59:30.773000+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.780393+0000","last_change":"2024-09-17T02:59:30.780170+0000","last_active":"2024-09-17T02:59:30.780393+0000","last_peered":"2024-09-17T02:59:30.780393+0000","last_clean":"2024-09-17T02:59:30.780393+0000","last_became_active":"2024-09-17T02:59:30.779554+0000","last_became_peered":"2024-09-17T02:59:30.779554+0000","last_unstale":"2024-09-17T02:59:30.780393+0000","last_undegraded":"2024-09-17T02:59:30.780393+0000","last_fullsized":"2024-09-17T02:59:30.780393+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:41.248521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772980+0000","last_change":"2024-09-17T02:59:30.772980+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772980+0000","last_undegraded":"2024-09-17T02:59:30.772980+0000","last_fullsized":"2024-09-17T02:59:30.772980+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777191+0000","last_change":"2024-09-17T02:59:30.775937+0000","last_active":"2024-09-17T02:59:30.777191+0000","last_peered":"2024-09-17T02:59:30.777191+0000","last_clean":"2024-09-17T02:59:30.777191+0000","last_became_active":"2024-09-17T02:59:30.775233+0000","last_became_peered":"2024-09-17T02:59:30.775233+0000","last_unstale":"2024-09-17T02:59:30.777191+0000","last_undegraded":"2024-09-17T02:59:30.777191+0000","last_fullsized":"2024-09-17T02:59:30.777191+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:49.133219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771138+0000","last_change":"2024-09-17T02:59:30.771138+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771138+0000","last_undegraded":"2024-09-17T02:59:30.771138+0000","last_fullsized":"2024-09-17T02:59:30.771138+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.780492+0000","last_change":"2024-09-17T02:59:30.780334+0000","last_active":"2024-09-17T02:59:30.780492+0000","last_peered":"2024-09-17T02:59:30.780492+0000","last_clean":"2024-09-17T02:59:30.780492+0000","last_became_active":"2024-09-17T02:59:30.780082+0000","last_became_peered":"2024-09-17T02:59:30.780082+0000","last_unstale":"2024-09-17T02:59:30.780492+0000","last_undegraded":"2024-09-17T02:59:30.780492+0000","last_fullsized":"2024-09-17T02:59:30.780492+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:47.433713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767115+0000","last_change":"2024-09-17T02:59:30.767115+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767115+0000","last_undegraded":"2024-09-17T02:59:30.767115+0000","last_fullsized":"2024-09-17T02:59:30.767115+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.768299+0000","last_change":"2024-09-17T02:59:30.768062+0000","last_active":"2024-09-17T02:59:30.768299+0000","last_peered":"2024-09-17T02:59:30.768299+0000","last_clean":"2024-09-17T02:59:30.768299+0000","last_became_active":"2024-09-17T02:59:30.767771+0000","last_became_peered":"2024-09-17T02:59:30.767771+0000","last_unstale":"2024-09-17T02:59:30.768299+0000","last_undegraded":"2024-09-17T02:59:30.768299+0000","last_fullsized":"2024-09-17T02:59:30.768299+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:37.720017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":272,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.765357+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:59:30.765357+0000","last_peered":"2024-09-17T02:59:30.765357+0000","last_clean":"2024-09-17T02:59:30.765357+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:59:30.765357+0000","last_undegraded":"2024-09-17T02:59:30.765357+0000","last_fullsized":"2024-09-17T02:59:30.765357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:51.183978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":524,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194788,"statfs":{"total":200000000,"available":199463370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:59:35.154 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:59:35.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.306+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/921562815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e20003a00 msgr2=0x7f9e20003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.306+0000 7f9e3ec8b640 1 --2- 172.21.15.104:0/921562815 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e20003a00 0x7f9e20003e70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800baf0 tx=0x7f9e20005830 comp rx=0 tx=0).stop 2024-09-17T02:59:35.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.306+0000 7f9e3d228640 1 -- 172.21.15.104:0/921562815 reap_dead start 2024-09-17T02:59:35.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.306+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/921562815 shutdown_connections 2024-09-17T02:59:35.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.306+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/921562815 >> 172.21.15.104:0/921562815 conn(0x7f9e38069120 msgr2=0x7f9e38069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:35.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.306+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/921562815 shutdown_connections 2024-09-17T02:59:35.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.306+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/921562815 wait complete. 2024-09-17T02:59:35.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.308+0000 7f9e3ec8b640 1 Processor -- start 2024-09-17T02:59:35.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.308+0000 7f9e3ec8b640 1 -- start start 2024-09-17T02:59:35.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.309+0000 7f9e3ec8b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e20003a00 0x7f9e38153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:35.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.309+0000 7f9e3ec8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e381543a0 0x7f9e380cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.309+0000 7f9e3ec8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e380cd870 0x7f9e381572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.309+0000 7f9e3ec8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9e381618c0 con 0x7f9e381543a0 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.309+0000 7f9e3ec8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e380b6c80 con 0x7f9e380cd870 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.309+0000 7f9e3ec8b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9e38161a40 con 0x7f9e20003a00 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.309+0000 7f9e37fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e381543a0 0x7f9e380cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e37fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e381543a0 0x7f9e380cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43346/0 (socket says 172.21.15.104:43346) 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e37fff640 1 -- 172.21.15.104:0/2662506401 learned_addr learned my addr 172.21.15.104:0/2662506401 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e3ca27640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e20003a00 0x7f9e38153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e3d228640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e380cd870 0x7f9e381572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e37fff640 1 -- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e20003a00 msgr2=0x7f9e38153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e37fff640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e20003a00 0x7f9e38153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e37fff640 1 -- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e380cd870 msgr2=0x7f9e381572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.310 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e37fff640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e380cd870 0x7f9e381572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e37fff640 1 -- 172.21.15.104:0/2662506401 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e380cdc80 con 0x7f9e381543a0 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e3d228640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e380cd870 0x7f9e381572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e37fff640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e381543a0 0x7f9e380cd330 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c001410 tx=0x7f9e2c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e357fa640 1 -- 172.21.15.104:0/2662506401 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c015020 con 0x7f9e381543a0 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e357fa640 1 -- 172.21.15.104:0/2662506401 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e2c011980 con 0x7f9e381543a0 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e357fa640 1 -- 172.21.15.104:0/2662506401 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c011dd0 con 0x7f9e381543a0 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e381f9c40 con 0x7f9e381543a0 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.310+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e381fa200 con 0x7f9e381543a0 2024-09-17T02:59:35.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.311+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3806a720 con 0x7f9e381543a0 2024-09-17T02:59:35.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.312+0000 7f9e357fa640 1 -- 172.21.15.104:0/2662506401 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e2c018020 con 0x7f9e381543a0 2024-09-17T02:59:35.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.312+0000 7f9e357fa640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e24078bc0 0x7f9e2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:35.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.313+0000 7f9e357fa640 1 -- 172.21.15.104:0/2662506401 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f9e2c09b840 con 0x7f9e381543a0 2024-09-17T02:59:35.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.313+0000 7f9e3ca27640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e24078bc0 0x7f9e2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:35.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.313+0000 7f9e3ca27640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e24078bc0 0x7f9e2407b0d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9e28036000 tx=0x7f9e2803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:35.315 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.317+0000 7f9e357fa640 1 -- 172.21.15.104:0/2662506401 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e3806a720 con 0x7f9e381543a0 2024-09-17T02:59:35.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.486+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e38159400 con 0x7f9e24078bc0 2024-09-17T02:59:35.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.491+0000 7f9e357fa640 1 -- 172.21.15.104:0/2662506401 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242659 (secure 0 0 0) 0x7f9e38159400 con 0x7f9e24078bc0 2024-09-17T02:59:35.491 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:35.492 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:59:35.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e24078bc0 msgr2=0x7f9e2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e24078bc0 0x7f9e2407b0d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9e28036000 tx=0x7f9e2803c040 comp rx=0 tx=0).stop 2024-09-17T02:59:35.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e381543a0 msgr2=0x7f9e380cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e381543a0 0x7f9e380cd330 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c001410 tx=0x7f9e2c0049d0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 shutdown_connections 2024-09-17T02:59:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e24078bc0 0x7f9e2407b0d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e380cd870 0x7f9e381572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e381543a0 0x7f9e380cd330 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 --2- 172.21.15.104:0/2662506401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e20003a00 0x7f9e38153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 >> 172.21.15.104:0/2662506401 conn(0x7f9e38069120 msgr2=0x7f9e380d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 shutdown_connections 2024-09-17T02:59:35.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.494+0000 7f9e3ec8b640 1 -- 172.21.15.104:0/2662506401 wait complete. 2024-09-17T02:59:35.504 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-17T02:59:33.692781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5388,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557111,"statfs":{"total":1600000000,"available":1594482299,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001080"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769630+0000","last_change":"2024-09-17T02:59:30.769630+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769630+0000","last_undegraded":"2024-09-17T02:59:30.769630+0000","last_fullsized":"2024-09-17T02:59:30.769630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768274+0000","last_change":"2024-09-17T02:59:30.768274+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768274+0000","last_undegraded":"2024-09-17T02:59:30.768274+0000","last_fullsized":"2024-09-17T02:59:30.768274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.776107+0000","last_change":"2024-09-17T02:59:30.776107+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.776107+0000","last_undegraded":"2024-09-17T02:59:30.776107+0000","last_fullsized":"2024-09-17T02:59:30.776107+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774812+0000","last_change":"2024-09-17T02:59:30.774812+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774812+0000","last_undegraded":"2024-09-17T02:59:30.774812+0000","last_fullsized":"2024-09-17T02:59:30.774812+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774947+0000","last_change":"2024-09-17T02:59:30.774947+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774947+0000","last_undegraded":"2024-09-17T02:59:30.774947+0000","last_fullsized":"2024-09-17T02:59:30.774947+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770155+0000","last_change":"2024-09-17T02:59:30.770155+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770155+0000","last_undegraded":"2024-09-17T02:59:30.770155+0000","last_fullsized":"2024-09-17T02:59:30.770155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772088+0000","last_change":"2024-09-17T02:59:30.772088+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772088+0000","last_undegraded":"2024-09-17T02:59:30.772088+0000","last_fullsized":"2024-09-17T02:59:30.772088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770954+0000","last_change":"2024-09-17T02:59:30.770954+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770954+0000","last_undegraded":"2024-09-17T02:59:30.770954+0000","last_fullsized":"2024-09-17T02:59:30.770954+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769403+0000","last_change":"2024-09-17T02:59:30.769403+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769403+0000","last_undegraded":"2024-09-17T02:59:30.769403+0000","last_fullsized":"2024-09-17T02:59:30.769403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769130+0000","last_change":"2024-09-17T02:59:30.769130+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769130+0000","last_undegraded":"2024-09-17T02:59:30.769130+0000","last_fullsized":"2024-09-17T02:59:30.769130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766608+0000","last_change":"2024-09-17T02:59:30.766608+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766608+0000","last_undegraded":"2024-09-17T02:59:30.766608+0000","last_fullsized":"2024-09-17T02:59:30.766608+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768715+0000","last_change":"2024-09-17T02:59:30.768715+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768715+0000","last_undegraded":"2024-09-17T02:59:30.768715+0000","last_fullsized":"2024-09-17T02:59:30.768715+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774916+0000","last_change":"2024-09-17T02:59:30.774916+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774916+0000","last_undegraded":"2024-09-17T02:59:30.774916+0000","last_fullsized":"2024-09-17T02:59:30.774916+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773067+0000","last_change":"2024-09-17T02:59:30.773067+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773067+0000","last_undegraded":"2024-09-17T02:59:30.773067+0000","last_fullsized":"2024-09-17T02:59:30.773067+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772931+0000","last_change":"2024-09-17T02:59:30.772931+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772931+0000","last_undegraded":"2024-09-17T02:59:30.772931+0000","last_fullsized":"2024-09-17T02:59:30.772931+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775509+0000","last_change":"2024-09-17T02:59:30.775509+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775509+0000","last_undegraded":"2024-09-17T02:59:30.775509+0000","last_fullsized":"2024-09-17T02:59:30.775509+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775875+0000","last_change":"2024-09-17T02:59:30.775875+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775875+0000","last_undegraded":"2024-09-17T02:59:30.775875+0000","last_fullsized":"2024-09-17T02:59:30.775875+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772388+0000","last_change":"2024-09-17T02:59:30.772388+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772388+0000","last_undegraded":"2024-09-17T02:59:30.772388+0000","last_fullsized":"2024-09-17T02:59:30.772388+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774595+0000","last_change":"2024-09-17T02:59:30.774595+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774595+0000","last_undegraded":"2024-09-17T02:59:30.774595+0000","last_fullsized":"2024-09-17T02:59:30.774595+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771404+0000","last_change":"2024-09-17T02:59:30.771404+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771404+0000","last_undegraded":"2024-09-17T02:59:30.771404+0000","last_fullsized":"2024-09-17T02:59:30.771404+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772025+0000","last_change":"2024-09-17T02:59:30.772025+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772025+0000","last_undegraded":"2024-09-17T02:59:30.772025+0000","last_fullsized":"2024-09-17T02:59:30.772025+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767915+0000","last_change":"2024-09-17T02:59:30.767915+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767915+0000","last_undegraded":"2024-09-17T02:59:30.767915+0000","last_fullsized":"2024-09-17T02:59:30.767915+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773448+0000","last_change":"2024-09-17T02:59:30.773448+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773448+0000","last_undegraded":"2024-09-17T02:59:30.773448+0000","last_fullsized":"2024-09-17T02:59:30.773448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772722+0000","last_change":"2024-09-17T02:59:30.772722+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772722+0000","last_undegraded":"2024-09-17T02:59:30.772722+0000","last_fullsized":"2024-09-17T02:59:30.772722+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767625+0000","last_change":"2024-09-17T02:59:30.767625+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767625+0000","last_undegraded":"2024-09-17T02:59:30.767625+0000","last_fullsized":"2024-09-17T02:59:30.767625+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773958+0000","last_change":"2024-09-17T02:59:30.773958+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773958+0000","last_undegraded":"2024-09-17T02:59:30.773958+0000","last_fullsized":"2024-09-17T02:59:30.773958+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772185+0000","last_change":"2024-09-17T02:59:30.772185+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772185+0000","last_undegraded":"2024-09-17T02:59:30.772185+0000","last_fullsized":"2024-09-17T02:59:30.772185+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772228+0000","last_change":"2024-09-17T02:59:30.772228+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772228+0000","last_undegraded":"2024-09-17T02:59:30.772228+0000","last_fullsized":"2024-09-17T02:59:30.772228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766854+0000","last_change":"2024-09-17T02:59:30.766854+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766854+0000","last_undegraded":"2024-09-17T02:59:30.766854+0000","last_fullsized":"2024-09-17T02:59:30.766854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767208+0000","last_change":"2024-09-17T02:59:30.767208+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767208+0000","last_undegraded":"2024-09-17T02:59:30.767208+0000","last_fullsized":"2024-09-17T02:59:30.767208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775142+0000","last_change":"2024-09-17T02:59:30.775142+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775142+0000","last_undegraded":"2024-09-17T02:59:30.775142+0000","last_fullsized":"2024-09-17T02:59:30.775142+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768159+0000","last_change":"2024-09-17T02:59:30.768159+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768159+0000","last_undegraded":"2024-09-17T02:59:30.768159+0000","last_fullsized":"2024-09-17T02:59:30.768159+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774015+0000","last_change":"2024-09-17T02:59:30.774015+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774015+0000","last_undegraded":"2024-09-17T02:59:30.774015+0000","last_fullsized":"2024-09-17T02:59:30.774015+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778236+0000","last_change":"2024-09-17T02:59:30.777486+0000","last_active":"2024-09-17T02:59:30.778236+0000","last_peered":"2024-09-17T02:59:30.778236+0000","last_clean":"2024-09-17T02:59:30.778236+0000","last_became_active":"2024-09-17T02:59:30.775598+0000","last_became_peered":"2024-09-17T02:59:30.775598+0000","last_unstale":"2024-09-17T02:59:30.778236+0000","last_undegraded":"2024-09-17T02:59:30.778236+0000","last_fullsized":"2024-09-17T02:59:30.778236+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:36.245807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771844+0000","last_change":"2024-09-17T02:59:30.771844+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771844+0000","last_undegraded":"2024-09-17T02:59:30.771844+0000","last_fullsized":"2024-09-17T02:59:30.771844+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779952+0000","last_change":"2024-09-17T02:59:30.779490+0000","last_active":"2024-09-17T02:59:30.779952+0000","last_peered":"2024-09-17T02:59:30.779952+0000","last_clean":"2024-09-17T02:59:30.779952+0000","last_became_active":"2024-09-17T02:59:30.779028+0000","last_became_peered":"2024-09-17T02:59:30.779028+0000","last_unstale":"2024-09-17T02:59:30.779952+0000","last_undegraded":"2024-09-17T02:59:30.779952+0000","last_fullsized":"2024-09-17T02:59:30.779952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:13.099529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768334+0000","last_change":"2024-09-17T02:59:30.768334+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768334+0000","last_undegraded":"2024-09-17T02:59:30.768334+0000","last_fullsized":"2024-09-17T02:59:30.768334+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779699+0000","last_change":"2024-09-17T02:59:30.779494+0000","last_active":"2024-09-17T02:59:30.779699+0000","last_peered":"2024-09-17T02:59:30.779699+0000","last_clean":"2024-09-17T02:59:30.779699+0000","last_became_active":"2024-09-17T02:59:30.779228+0000","last_became_peered":"2024-09-17T02:59:30.779228+0000","last_unstale":"2024-09-17T02:59:30.779699+0000","last_undegraded":"2024-09-17T02:59:30.779699+0000","last_fullsized":"2024-09-17T02:59:30.779699+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:33.231498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774238+0000","last_change":"2024-09-17T02:59:30.774238+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774238+0000","last_undegraded":"2024-09-17T02:59:30.774238+0000","last_fullsized":"2024-09-17T02:59:30.774238+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779019+0000","last_change":"2024-09-17T02:59:30.778833+0000","last_active":"2024-09-17T02:59:30.779019+0000","last_peered":"2024-09-17T02:59:30.779019+0000","last_clean":"2024-09-17T02:59:30.779019+0000","last_became_active":"2024-09-17T02:59:30.778564+0000","last_became_peered":"2024-09-17T02:59:30.778564+0000","last_unstale":"2024-09-17T02:59:30.779019+0000","last_undegraded":"2024-09-17T02:59:30.779019+0000","last_fullsized":"2024-09-17T02:59:30.779019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:11.787274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767216+0000","last_change":"2024-09-17T02:59:30.767216+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767216+0000","last_undegraded":"2024-09-17T02:59:30.767216+0000","last_fullsized":"2024-09-17T02:59:30.767216+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777602+0000","last_change":"2024-09-17T02:59:30.777197+0000","last_active":"2024-09-17T02:59:30.777602+0000","last_peered":"2024-09-17T02:59:30.777602+0000","last_clean":"2024-09-17T02:59:30.777602+0000","last_became_active":"2024-09-17T02:59:30.776871+0000","last_became_peered":"2024-09-17T02:59:30.776871+0000","last_unstale":"2024-09-17T02:59:30.777602+0000","last_undegraded":"2024-09-17T02:59:30.777602+0000","last_fullsized":"2024-09-17T02:59:30.777602+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:04.943705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775438+0000","last_change":"2024-09-17T02:59:30.775438+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775438+0000","last_undegraded":"2024-09-17T02:59:30.775438+0000","last_fullsized":"2024-09-17T02:59:30.775438+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778425+0000","last_change":"2024-09-17T02:59:30.778211+0000","last_active":"2024-09-17T02:59:30.778425+0000","last_peered":"2024-09-17T02:59:30.778425+0000","last_clean":"2024-09-17T02:59:30.778425+0000","last_became_active":"2024-09-17T02:59:30.777940+0000","last_became_peered":"2024-09-17T02:59:30.777940+0000","last_unstale":"2024-09-17T02:59:30.778425+0000","last_undegraded":"2024-09-17T02:59:30.778425+0000","last_fullsized":"2024-09-17T02:59:30.778425+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:29.903145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773883+0000","last_change":"2024-09-17T02:59:30.773883+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773883+0000","last_undegraded":"2024-09-17T02:59:30.773883+0000","last_fullsized":"2024-09-17T02:59:30.773883+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777690+0000","last_change":"2024-09-17T02:59:30.776643+0000","last_active":"2024-09-17T02:59:30.777690+0000","last_peered":"2024-09-17T02:59:30.777690+0000","last_clean":"2024-09-17T02:59:30.777690+0000","last_became_active":"2024-09-17T02:59:30.776137+0000","last_became_peered":"2024-09-17T02:59:30.776137+0000","last_unstale":"2024-09-17T02:59:30.777690+0000","last_undegraded":"2024-09-17T02:59:30.777690+0000","last_fullsized":"2024-09-17T02:59:30.777690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773278+0000","last_change":"2024-09-17T02:59:30.773278+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773278+0000","last_undegraded":"2024-09-17T02:59:30.773278+0000","last_fullsized":"2024-09-17T02:59:30.773278+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777174+0000","last_change":"2024-09-17T02:59:30.776607+0000","last_active":"2024-09-17T02:59:30.777174+0000","last_peered":"2024-09-17T02:59:30.777174+0000","last_clean":"2024-09-17T02:59:30.777174+0000","last_became_active":"2024-09-17T02:59:30.775981+0000","last_became_peered":"2024-09-17T02:59:30.775981+0000","last_unstale":"2024-09-17T02:59:30.777174+0000","last_undegraded":"2024-09-17T02:59:30.777174+0000","last_fullsized":"2024-09-17T02:59:30.777174+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:15.789926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772999+0000","last_change":"2024-09-17T02:59:30.772999+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772999+0000","last_undegraded":"2024-09-17T02:59:30.772999+0000","last_fullsized":"2024-09-17T02:59:30.772999+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773379+0000","last_change":"2024-09-17T02:59:30.773108+0000","last_active":"2024-09-17T02:59:30.773379+0000","last_peered":"2024-09-17T02:59:30.773379+0000","last_clean":"2024-09-17T02:59:30.773379+0000","last_became_active":"2024-09-17T02:59:30.772831+0000","last_became_peered":"2024-09-17T02:59:30.772831+0000","last_unstale":"2024-09-17T02:59:30.773379+0000","last_undegraded":"2024-09-17T02:59:30.773379+0000","last_fullsized":"2024-09-17T02:59:30.773379+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:41.156681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768995+0000","last_change":"2024-09-17T02:59:30.768995+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768995+0000","last_undegraded":"2024-09-17T02:59:30.768995+0000","last_fullsized":"2024-09-17T02:59:30.768995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778994+0000","last_change":"2024-09-17T02:59:30.778763+0000","last_active":"2024-09-17T02:59:30.778994+0000","last_peered":"2024-09-17T02:59:30.778994+0000","last_clean":"2024-09-17T02:59:30.778994+0000","last_became_active":"2024-09-17T02:59:30.778425+0000","last_became_peered":"2024-09-17T02:59:30.778425+0000","last_unstale":"2024-09-17T02:59:30.778994+0000","last_undegraded":"2024-09-17T02:59:30.778994+0000","last_fullsized":"2024-09-17T02:59:30.778994+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:55.570417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774189+0000","last_change":"2024-09-17T02:59:30.774189+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774189+0000","last_undegraded":"2024-09-17T02:59:30.774189+0000","last_fullsized":"2024-09-17T02:59:30.774189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.775014+0000","last_change":"2024-09-17T02:59:30.774130+0000","last_active":"2024-09-17T02:59:30.775014+0000","last_peered":"2024-09-17T02:59:30.775014+0000","last_clean":"2024-09-17T02:59:30.775014+0000","last_became_active":"2024-09-17T02:59:30.773829+0000","last_became_peered":"2024-09-17T02:59:30.773829+0000","last_unstale":"2024-09-17T02:59:30.775014+0000","last_undegraded":"2024-09-17T02:59:30.775014+0000","last_fullsized":"2024-09-17T02:59:30.775014+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:30.784203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772682+0000","last_change":"2024-09-17T02:59:30.772682+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772682+0000","last_undegraded":"2024-09-17T02:59:30.772682+0000","last_fullsized":"2024-09-17T02:59:30.772682+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.775685+0000","last_change":"2024-09-17T02:59:30.774809+0000","last_active":"2024-09-17T02:59:30.775685+0000","last_peered":"2024-09-17T02:59:30.775685+0000","last_clean":"2024-09-17T02:59:30.775685+0000","last_became_active":"2024-09-17T02:59:30.774443+0000","last_became_peered":"2024-09-17T02:59:30.774443+0000","last_unstale":"2024-09-17T02:59:30.775685+0000","last_undegraded":"2024-09-17T02:59:30.775685+0000","last_fullsized":"2024-09-17T02:59:30.775685+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:38.509170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773410+0000","last_change":"2024-09-17T02:59:30.773410+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773410+0000","last_undegraded":"2024-09-17T02:59:30.773410+0000","last_fullsized":"2024-09-17T02:59:30.773410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777203+0000","last_change":"2024-09-17T02:59:30.776880+0000","last_active":"2024-09-17T02:59:30.777203+0000","last_peered":"2024-09-17T02:59:30.777203+0000","last_clean":"2024-09-17T02:59:30.777203+0000","last_became_active":"2024-09-17T02:59:30.776353+0000","last_became_peered":"2024-09-17T02:59:30.776353+0000","last_unstale":"2024-09-17T02:59:30.777203+0000","last_undegraded":"2024-09-17T02:59:30.777203+0000","last_fullsized":"2024-09-17T02:59:30.777203+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:20.916511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773496+0000","last_change":"2024-09-17T02:59:30.773496+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773496+0000","last_undegraded":"2024-09-17T02:59:30.773496+0000","last_fullsized":"2024-09-17T02:59:30.773496+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.772053+0000","last_change":"2024-09-17T02:59:30.770755+0000","last_active":"2024-09-17T02:59:30.772053+0000","last_peered":"2024-09-17T02:59:30.772053+0000","last_clean":"2024-09-17T02:59:30.772053+0000","last_became_active":"2024-09-17T02:59:30.770479+0000","last_became_peered":"2024-09-17T02:59:30.770479+0000","last_unstale":"2024-09-17T02:59:30.772053+0000","last_undegraded":"2024-09-17T02:59:30.772053+0000","last_fullsized":"2024-09-17T02:59:30.772053+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:09.064606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766841+0000","last_change":"2024-09-17T02:59:30.766841+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766841+0000","last_undegraded":"2024-09-17T02:59:30.766841+0000","last_fullsized":"2024-09-17T02:59:30.766841+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777276+0000","last_change":"2024-09-17T02:59:30.777012+0000","last_active":"2024-09-17T02:59:30.777276+0000","last_peered":"2024-09-17T02:59:30.777276+0000","last_clean":"2024-09-17T02:59:30.777276+0000","last_became_active":"2024-09-17T02:59:30.776717+0000","last_became_peered":"2024-09-17T02:59:30.776717+0000","last_unstale":"2024-09-17T02:59:30.777276+0000","last_undegraded":"2024-09-17T02:59:30.777276+0000","last_fullsized":"2024-09-17T02:59:30.777276+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:20.672235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767485+0000","last_change":"2024-09-17T02:59:30.767485+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767485+0000","last_undegraded":"2024-09-17T02:59:30.767485+0000","last_fullsized":"2024-09-17T02:59:30.767485+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777719+0000","last_change":"2024-09-17T02:59:30.776961+0000","last_active":"2024-09-17T02:59:30.777719+0000","last_peered":"2024-09-17T02:59:30.777719+0000","last_clean":"2024-09-17T02:59:30.777719+0000","last_became_active":"2024-09-17T02:59:30.776641+0000","last_became_peered":"2024-09-17T02:59:30.776641+0000","last_unstale":"2024-09-17T02:59:30.777719+0000","last_undegraded":"2024-09-17T02:59:30.777719+0000","last_fullsized":"2024-09-17T02:59:30.777719+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:39.085294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772989+0000","last_change":"2024-09-17T02:59:30.772989+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772989+0000","last_undegraded":"2024-09-17T02:59:30.772989+0000","last_fullsized":"2024-09-17T02:59:30.772989+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.771811+0000","last_change":"2024-09-17T02:59:30.771535+0000","last_active":"2024-09-17T02:59:30.771811+0000","last_peered":"2024-09-17T02:59:30.771811+0000","last_clean":"2024-09-17T02:59:30.771811+0000","last_became_active":"2024-09-17T02:59:30.771231+0000","last_became_peered":"2024-09-17T02:59:30.771231+0000","last_unstale":"2024-09-17T02:59:30.771811+0000","last_undegraded":"2024-09-17T02:59:30.771811+0000","last_fullsized":"2024-09-17T02:59:30.771811+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:45.853629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769153+0000","last_change":"2024-09-17T02:59:30.769153+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769153+0000","last_undegraded":"2024-09-17T02:59:30.769153+0000","last_fullsized":"2024-09-17T02:59:30.769153+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778792+0000","last_change":"2024-09-17T02:59:30.778406+0000","last_active":"2024-09-17T02:59:30.778792+0000","last_peered":"2024-09-17T02:59:30.778792+0000","last_clean":"2024-09-17T02:59:30.778792+0000","last_became_active":"2024-09-17T02:59:30.778023+0000","last_became_peered":"2024-09-17T02:59:30.778023+0000","last_unstale":"2024-09-17T02:59:30.778792+0000","last_undegraded":"2024-09-17T02:59:30.778792+0000","last_fullsized":"2024-09-17T02:59:30.778792+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:07.037176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772078+0000","last_change":"2024-09-17T02:59:30.772078+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772078+0000","last_undegraded":"2024-09-17T02:59:30.772078+0000","last_fullsized":"2024-09-17T02:59:30.772078+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773841+0000","last_change":"2024-09-17T02:59:30.773650+0000","last_active":"2024-09-17T02:59:30.773841+0000","last_peered":"2024-09-17T02:59:30.773841+0000","last_clean":"2024-09-17T02:59:30.773841+0000","last_became_active":"2024-09-17T02:59:30.773409+0000","last_became_peered":"2024-09-17T02:59:30.773409+0000","last_unstale":"2024-09-17T02:59:30.773841+0000","last_undegraded":"2024-09-17T02:59:30.773841+0000","last_fullsized":"2024-09-17T02:59:30.773841+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:10.640195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772312+0000","last_change":"2024-09-17T02:59:30.772312+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772312+0000","last_undegraded":"2024-09-17T02:59:30.772312+0000","last_fullsized":"2024-09-17T02:59:30.772312+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779658+0000","last_change":"2024-09-17T02:59:30.779136+0000","last_active":"2024-09-17T02:59:30.779658+0000","last_peered":"2024-09-17T02:59:30.779658+0000","last_clean":"2024-09-17T02:59:30.779658+0000","last_became_active":"2024-09-17T02:59:30.778832+0000","last_became_peered":"2024-09-17T02:59:30.778832+0000","last_unstale":"2024-09-17T02:59:30.779658+0000","last_undegraded":"2024-09-17T02:59:30.779658+0000","last_fullsized":"2024-09-17T02:59:30.779658+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:52.479307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770363+0000","last_change":"2024-09-17T02:59:30.770363+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770363+0000","last_undegraded":"2024-09-17T02:59:30.770363+0000","last_fullsized":"2024-09-17T02:59:30.770363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.776274+0000","last_change":"2024-09-17T02:59:30.776068+0000","last_active":"2024-09-17T02:59:30.776274+0000","last_peered":"2024-09-17T02:59:30.776274+0000","last_clean":"2024-09-17T02:59:30.776274+0000","last_became_active":"2024-09-17T02:59:30.775809+0000","last_became_peered":"2024-09-17T02:59:30.775809+0000","last_unstale":"2024-09-17T02:59:30.776274+0000","last_undegraded":"2024-09-17T02:59:30.776274+0000","last_fullsized":"2024-09-17T02:59:30.776274+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:50.054957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771644+0000","last_change":"2024-09-17T02:59:30.771644+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771644+0000","last_undegraded":"2024-09-17T02:59:30.771644+0000","last_fullsized":"2024-09-17T02:59:30.771644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773906+0000","last_change":"2024-09-17T02:59:30.773128+0000","last_active":"2024-09-17T02:59:30.773906+0000","last_peered":"2024-09-17T02:59:30.773906+0000","last_clean":"2024-09-17T02:59:30.773906+0000","last_became_active":"2024-09-17T02:59:30.772857+0000","last_became_peered":"2024-09-17T02:59:30.772857+0000","last_unstale":"2024-09-17T02:59:30.773906+0000","last_undegraded":"2024-09-17T02:59:30.773906+0000","last_fullsized":"2024-09-17T02:59:30.773906+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770002+0000","last_change":"2024-09-17T02:59:30.770002+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770002+0000","last_undegraded":"2024-09-17T02:59:30.770002+0000","last_fullsized":"2024-09-17T02:59:30.770002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.774956+0000","last_change":"2024-09-17T02:59:30.774353+0000","last_active":"2024-09-17T02:59:30.774956+0000","last_peered":"2024-09-17T02:59:30.774956+0000","last_clean":"2024-09-17T02:59:30.774956+0000","last_became_active":"2024-09-17T02:59:30.774048+0000","last_became_peered":"2024-09-17T02:59:30.774048+0000","last_unstale":"2024-09-17T02:59:30.774956+0000","last_undegraded":"2024-09-17T02:59:30.774956+0000","last_fullsized":"2024-09-17T02:59:30.774956+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:19.762892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771858+0000","last_change":"2024-09-17T02:59:30.771858+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771858+0000","last_undegraded":"2024-09-17T02:59:30.771858+0000","last_fullsized":"2024-09-17T02:59:30.771858+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.769682+0000","last_change":"2024-09-17T02:59:30.769448+0000","last_active":"2024-09-17T02:59:30.769682+0000","last_peered":"2024-09-17T02:59:30.769682+0000","last_clean":"2024-09-17T02:59:30.769682+0000","last_became_active":"2024-09-17T02:59:30.769161+0000","last_became_peered":"2024-09-17T02:59:30.769161+0000","last_unstale":"2024-09-17T02:59:30.769682+0000","last_undegraded":"2024-09-17T02:59:30.769682+0000","last_fullsized":"2024-09-17T02:59:30.769682+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:20.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773339+0000","last_change":"2024-09-17T02:59:30.773339+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773339+0000","last_undegraded":"2024-09-17T02:59:30.773339+0000","last_fullsized":"2024-09-17T02:59:30.773339+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773097+0000","last_change":"2024-09-17T02:59:30.772398+0000","last_active":"2024-09-17T02:59:30.773097+0000","last_peered":"2024-09-17T02:59:30.773097+0000","last_clean":"2024-09-17T02:59:30.773097+0000","last_became_active":"2024-09-17T02:59:30.772121+0000","last_became_peered":"2024-09-17T02:59:30.772121+0000","last_unstale":"2024-09-17T02:59:30.773097+0000","last_undegraded":"2024-09-17T02:59:30.773097+0000","last_fullsized":"2024-09-17T02:59:30.773097+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:43.182077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767594+0000","last_change":"2024-09-17T02:59:30.767594+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767594+0000","last_undegraded":"2024-09-17T02:59:30.767594+0000","last_fullsized":"2024-09-17T02:59:30.767594+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779116+0000","last_change":"2024-09-17T02:59:30.778774+0000","last_active":"2024-09-17T02:59:30.779116+0000","last_peered":"2024-09-17T02:59:30.779116+0000","last_clean":"2024-09-17T02:59:30.779116+0000","last_became_active":"2024-09-17T02:59:30.776595+0000","last_became_peered":"2024-09-17T02:59:30.776595+0000","last_unstale":"2024-09-17T02:59:30.779116+0000","last_undegraded":"2024-09-17T02:59:30.779116+0000","last_fullsized":"2024-09-17T02:59:30.779116+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:09.933214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772374+0000","last_change":"2024-09-17T02:59:30.772374+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772374+0000","last_undegraded":"2024-09-17T02:59:30.772374+0000","last_fullsized":"2024-09-17T02:59:30.772374+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.771073+0000","last_change":"2024-09-17T02:59:30.770863+0000","last_active":"2024-09-17T02:59:30.771073+0000","last_peered":"2024-09-17T02:59:30.771073+0000","last_clean":"2024-09-17T02:59:30.771073+0000","last_became_active":"2024-09-17T02:59:30.770422+0000","last_became_peered":"2024-09-17T02:59:30.770422+0000","last_unstale":"2024-09-17T02:59:30.771073+0000","last_undegraded":"2024-09-17T02:59:30.771073+0000","last_fullsized":"2024-09-17T02:59:30.771073+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.357285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770797+0000","last_change":"2024-09-17T02:59:30.770797+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770797+0000","last_undegraded":"2024-09-17T02:59:30.770797+0000","last_fullsized":"2024-09-17T02:59:30.770797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.776563+0000","last_change":"2024-09-17T02:59:30.776358+0000","last_active":"2024-09-17T02:59:30.776563+0000","last_peered":"2024-09-17T02:59:30.776563+0000","last_clean":"2024-09-17T02:59:30.776563+0000","last_became_active":"2024-09-17T02:59:30.776058+0000","last_became_peered":"2024-09-17T02:59:30.776058+0000","last_unstale":"2024-09-17T02:59:30.776563+0000","last_undegraded":"2024-09-17T02:59:30.776563+0000","last_fullsized":"2024-09-17T02:59:30.776563+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:22.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773000+0000","last_change":"2024-09-17T02:59:30.773000+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773000+0000","last_undegraded":"2024-09-17T02:59:30.773000+0000","last_fullsized":"2024-09-17T02:59:30.773000+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.780393+0000","last_change":"2024-09-17T02:59:30.780170+0000","last_active":"2024-09-17T02:59:30.780393+0000","last_peered":"2024-09-17T02:59:30.780393+0000","last_clean":"2024-09-17T02:59:30.780393+0000","last_became_active":"2024-09-17T02:59:30.779554+0000","last_became_peered":"2024-09-17T02:59:30.779554+0000","last_unstale":"2024-09-17T02:59:30.780393+0000","last_undegraded":"2024-09-17T02:59:30.780393+0000","last_fullsized":"2024-09-17T02:59:30.780393+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:41.248521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772980+0000","last_change":"2024-09-17T02:59:30.772980+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772980+0000","last_undegraded":"2024-09-17T02:59:30.772980+0000","last_fullsized":"2024-09-17T02:59:30.772980+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777191+0000","last_change":"2024-09-17T02:59:30.775937+0000","last_active":"2024-09-17T02:59:30.777191+0000","last_peered":"2024-09-17T02:59:30.777191+0000","last_clean":"2024-09-17T02:59:30.777191+0000","last_became_active":"2024-09-17T02:59:30.775233+0000","last_became_peered":"2024-09-17T02:59:30.775233+0000","last_unstale":"2024-09-17T02:59:30.777191+0000","last_undegraded":"2024-09-17T02:59:30.777191+0000","last_fullsized":"2024-09-17T02:59:30.777191+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:49.133219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771138+0000","last_change":"2024-09-17T02:59:30.771138+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771138+0000","last_undegraded":"2024-09-17T02:59:30.771138+0000","last_fullsized":"2024-09-17T02:59:30.771138+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.780492+0000","last_change":"2024-09-17T02:59:30.780334+0000","last_active":"2024-09-17T02:59:30.780492+0000","last_peered":"2024-09-17T02:59:30.780492+0000","last_clean":"2024-09-17T02:59:30.780492+0000","last_became_active":"2024-09-17T02:59:30.780082+0000","last_became_peered":"2024-09-17T02:59:30.780082+0000","last_unstale":"2024-09-17T02:59:30.780492+0000","last_undegraded":"2024-09-17T02:59:30.780492+0000","last_fullsized":"2024-09-17T02:59:30.780492+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:47.433713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767115+0000","last_change":"2024-09-17T02:59:30.767115+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767115+0000","last_undegraded":"2024-09-17T02:59:30.767115+0000","last_fullsized":"2024-09-17T02:59:30.767115+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.768299+0000","last_change":"2024-09-17T02:59:30.768062+0000","last_active":"2024-09-17T02:59:30.768299+0000","last_peered":"2024-09-17T02:59:30.768299+0000","last_clean":"2024-09-17T02:59:30.768299+0000","last_became_active":"2024-09-17T02:59:30.767771+0000","last_became_peered":"2024-09-17T02:59:30.767771+0000","last_unstale":"2024-09-17T02:59:30.768299+0000","last_undegraded":"2024-09-17T02:59:30.768299+0000","last_fullsized":"2024-09-17T02:59:30.768299+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:37.720017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":272,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.765357+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:59:30.765357+0000","last_peered":"2024-09-17T02:59:30.765357+0000","last_clean":"2024-09-17T02:59:30.765357+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:59:30.765357+0000","last_undegraded":"2024-09-17T02:59:30.765357+0000","last_fullsized":"2024-09-17T02:59:30.765357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:51.183978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":524,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194788,"statfs":{"total":200000000,"available":199463370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3f is not active+clean 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.769630+0000', 'last_change': '2024-09-17T02:59:30.769630+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.769630+0000', 'last_undegraded': '2024-09-17T02:59:30.769630+0000', 'last_fullsized': '2024-09-17T02:59:30.769630+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3e is not active+clean 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.768274+0000', 'last_change': '2024-09-17T02:59:30.768274+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.768274+0000', 'last_undegraded': '2024-09-17T02:59:30.768274+0000', 'last_fullsized': '2024-09-17T02:59:30.768274+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.776107+0000', 'last_change': '2024-09-17T02:59:30.776107+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.776107+0000', 'last_undegraded': '2024-09-17T02:59:30.776107+0000', 'last_fullsized': '2024-09-17T02:59:30.776107+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3c is not active+clean 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.774812+0000', 'last_change': '2024-09-17T02:59:30.774812+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.774812+0000', 'last_undegraded': '2024-09-17T02:59:30.774812+0000', 'last_fullsized': '2024-09-17T02:59:30.774812+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.508 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.774947+0000', 'last_change': '2024-09-17T02:59:30.774947+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.774947+0000', 'last_undegraded': '2024-09-17T02:59:30.774947+0000', 'last_fullsized': '2024-09-17T02:59:30.774947+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.770155+0000', 'last_change': '2024-09-17T02:59:30.770155+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.770155+0000', 'last_undegraded': '2024-09-17T02:59:30.770155+0000', 'last_fullsized': '2024-09-17T02:59:30.770155+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:PG 13.39 is not active+clean 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772088+0000', 'last_change': '2024-09-17T02:59:30.772088+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772088+0000', 'last_undegraded': '2024-09-17T02:59:30.772088+0000', 'last_fullsized': '2024-09-17T02:59:30.772088+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.770954+0000', 'last_change': '2024-09-17T02:59:30.770954+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.770954+0000', 'last_undegraded': '2024-09-17T02:59:30.770954+0000', 'last_fullsized': '2024-09-17T02:59:30.770954+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.769403+0000', 'last_change': '2024-09-17T02:59:30.769403+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.769403+0000', 'last_undegraded': '2024-09-17T02:59:30.769403+0000', 'last_fullsized': '2024-09-17T02:59:30.769403+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:PG 13.36 is not active+clean 2024-09-17T02:59:35.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.769130+0000', 'last_change': '2024-09-17T02:59:30.769130+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.769130+0000', 'last_undegraded': '2024-09-17T02:59:30.769130+0000', 'last_fullsized': '2024-09-17T02:59:30.769130+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:PG 13.35 is not active+clean 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.766608+0000', 'last_change': '2024-09-17T02:59:30.766608+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.766608+0000', 'last_undegraded': '2024-09-17T02:59:30.766608+0000', 'last_fullsized': '2024-09-17T02:59:30.766608+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:PG 13.34 is not active+clean 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.768715+0000', 'last_change': '2024-09-17T02:59:30.768715+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.768715+0000', 'last_undegraded': '2024-09-17T02:59:30.768715+0000', 'last_fullsized': '2024-09-17T02:59:30.768715+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.774916+0000', 'last_change': '2024-09-17T02:59:30.774916+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.774916+0000', 'last_undegraded': '2024-09-17T02:59:30.774916+0000', 'last_fullsized': '2024-09-17T02:59:30.774916+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:PG 13.32 is not active+clean 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773067+0000', 'last_change': '2024-09-17T02:59:30.773067+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773067+0000', 'last_undegraded': '2024-09-17T02:59:30.773067+0000', 'last_fullsized': '2024-09-17T02:59:30.773067+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-17T02:59:35.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772931+0000', 'last_change': '2024-09-17T02:59:30.772931+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772931+0000', 'last_undegraded': '2024-09-17T02:59:30.772931+0000', 'last_fullsized': '2024-09-17T02:59:30.772931+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.775509+0000', 'last_change': '2024-09-17T02:59:30.775509+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.775509+0000', 'last_undegraded': '2024-09-17T02:59:30.775509+0000', 'last_fullsized': '2024-09-17T02:59:30.775509+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.775875+0000', 'last_change': '2024-09-17T02:59:30.775875+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.775875+0000', 'last_undegraded': '2024-09-17T02:59:30.775875+0000', 'last_fullsized': '2024-09-17T02:59:30.775875+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2e is not active+clean 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772388+0000', 'last_change': '2024-09-17T02:59:30.772388+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772388+0000', 'last_undegraded': '2024-09-17T02:59:30.772388+0000', 'last_fullsized': '2024-09-17T02:59:30.772388+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2d is not active+clean 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.774595+0000', 'last_change': '2024-09-17T02:59:30.774595+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.774595+0000', 'last_undegraded': '2024-09-17T02:59:30.774595+0000', 'last_fullsized': '2024-09-17T02:59:30.774595+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2c is not active+clean 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.771404+0000', 'last_change': '2024-09-17T02:59:30.771404+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.771404+0000', 'last_undegraded': '2024-09-17T02:59:30.771404+0000', 'last_fullsized': '2024-09-17T02:59:30.771404+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.511 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2b is not active+clean 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772025+0000', 'last_change': '2024-09-17T02:59:30.772025+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772025+0000', 'last_undegraded': '2024-09-17T02:59:30.772025+0000', 'last_fullsized': '2024-09-17T02:59:30.772025+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2a is not active+clean 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.767915+0000', 'last_change': '2024-09-17T02:59:30.767915+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.767915+0000', 'last_undegraded': '2024-09-17T02:59:30.767915+0000', 'last_fullsized': '2024-09-17T02:59:30.767915+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:PG 13.29 is not active+clean 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773448+0000', 'last_change': '2024-09-17T02:59:30.773448+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773448+0000', 'last_undegraded': '2024-09-17T02:59:30.773448+0000', 'last_fullsized': '2024-09-17T02:59:30.773448+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:PG 13.28 is not active+clean 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772722+0000', 'last_change': '2024-09-17T02:59:30.772722+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772722+0000', 'last_undegraded': '2024-09-17T02:59:30.772722+0000', 'last_fullsized': '2024-09-17T02:59:30.772722+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:PG 13.27 is not active+clean 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.767625+0000', 'last_change': '2024-09-17T02:59:30.767625+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.767625+0000', 'last_undegraded': '2024-09-17T02:59:30.767625+0000', 'last_fullsized': '2024-09-17T02:59:30.767625+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.512 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773958+0000', 'last_change': '2024-09-17T02:59:30.773958+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773958+0000', 'last_undegraded': '2024-09-17T02:59:30.773958+0000', 'last_fullsized': '2024-09-17T02:59:30.773958+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772185+0000', 'last_change': '2024-09-17T02:59:30.772185+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772185+0000', 'last_undegraded': '2024-09-17T02:59:30.772185+0000', 'last_fullsized': '2024-09-17T02:59:30.772185+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:PG 13.24 is not active+clean 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772228+0000', 'last_change': '2024-09-17T02:59:30.772228+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772228+0000', 'last_undegraded': '2024-09-17T02:59:30.772228+0000', 'last_fullsized': '2024-09-17T02:59:30.772228+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:PG 13.23 is not active+clean 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.766854+0000', 'last_change': '2024-09-17T02:59:30.766854+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.766854+0000', 'last_undegraded': '2024-09-17T02:59:30.766854+0000', 'last_fullsized': '2024-09-17T02:59:30.766854+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:PG 13.22 is not active+clean 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.767208+0000', 'last_change': '2024-09-17T02:59:30.767208+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.767208+0000', 'last_undegraded': '2024-09-17T02:59:30.767208+0000', 'last_fullsized': '2024-09-17T02:59:30.767208+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-17T02:59:35.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.775142+0000', 'last_change': '2024-09-17T02:59:30.775142+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.775142+0000', 'last_undegraded': '2024-09-17T02:59:30.775142+0000', 'last_fullsized': '2024-09-17T02:59:30.775142+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.20 is not active+clean 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.768159+0000', 'last_change': '2024-09-17T02:59:30.768159+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.768159+0000', 'last_undegraded': '2024-09-17T02:59:30.768159+0000', 'last_fullsized': '2024-09-17T02:59:30.768159+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.774015+0000', 'last_change': '2024-09-17T02:59:30.774015+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.774015+0000', 'last_undegraded': '2024-09-17T02:59:30.774015+0000', 'last_fullsized': '2024-09-17T02:59:30.774015+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.771844+0000', 'last_change': '2024-09-17T02:59:30.771844+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.771844+0000', 'last_undegraded': '2024-09-17T02:59:30.771844+0000', 'last_fullsized': '2024-09-17T02:59:30.771844+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.768334+0000', 'last_change': '2024-09-17T02:59:30.768334+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.768334+0000', 'last_undegraded': '2024-09-17T02:59:30.768334+0000', 'last_fullsized': '2024-09-17T02:59:30.768334+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.774238+0000', 'last_change': '2024-09-17T02:59:30.774238+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.774238+0000', 'last_undegraded': '2024-09-17T02:59:30.774238+0000', 'last_fullsized': '2024-09-17T02:59:30.774238+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.514 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1a is not active+clean 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.767216+0000', 'last_change': '2024-09-17T02:59:30.767216+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.767216+0000', 'last_undegraded': '2024-09-17T02:59:30.767216+0000', 'last_fullsized': '2024-09-17T02:59:30.767216+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.775438+0000', 'last_change': '2024-09-17T02:59:30.775438+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.775438+0000', 'last_undegraded': '2024-09-17T02:59:30.775438+0000', 'last_fullsized': '2024-09-17T02:59:30.775438+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773883+0000', 'last_change': '2024-09-17T02:59:30.773883+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773883+0000', 'last_undegraded': '2024-09-17T02:59:30.773883+0000', 'last_fullsized': '2024-09-17T02:59:30.773883+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773278+0000', 'last_change': '2024-09-17T02:59:30.773278+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773278+0000', 'last_undegraded': '2024-09-17T02:59:30.773278+0000', 'last_fullsized': '2024-09-17T02:59:30.773278+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772999+0000', 'last_change': '2024-09-17T02:59:30.772999+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772999+0000', 'last_undegraded': '2024-09-17T02:59:30.772999+0000', 'last_fullsized': '2024-09-17T02:59:30.772999+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-17T02:59:35.515 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.768995+0000', 'last_change': '2024-09-17T02:59:30.768995+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.768995+0000', 'last_undegraded': '2024-09-17T02:59:30.768995+0000', 'last_fullsized': '2024-09-17T02:59:30.768995+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.774189+0000', 'last_change': '2024-09-17T02:59:30.774189+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.774189+0000', 'last_undegraded': '2024-09-17T02:59:30.774189+0000', 'last_fullsized': '2024-09-17T02:59:30.774189+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772682+0000', 'last_change': '2024-09-17T02:59:30.772682+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772682+0000', 'last_undegraded': '2024-09-17T02:59:30.772682+0000', 'last_fullsized': '2024-09-17T02:59:30.772682+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773410+0000', 'last_change': '2024-09-17T02:59:30.773410+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773410+0000', 'last_undegraded': '2024-09-17T02:59:30.773410+0000', 'last_fullsized': '2024-09-17T02:59:30.773410+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773496+0000', 'last_change': '2024-09-17T02:59:30.773496+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773496+0000', 'last_undegraded': '2024-09-17T02:59:30.773496+0000', 'last_fullsized': '2024-09-17T02:59:30.773496+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:PG 13.10 is not active+clean 2024-09-17T02:59:35.516 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.766841+0000', 'last_change': '2024-09-17T02:59:30.766841+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.766841+0000', 'last_undegraded': '2024-09-17T02:59:30.766841+0000', 'last_fullsized': '2024-09-17T02:59:30.766841+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:PG 13.11 is not active+clean 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.767485+0000', 'last_change': '2024-09-17T02:59:30.767485+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.767485+0000', 'last_undegraded': '2024-09-17T02:59:30.767485+0000', 'last_fullsized': '2024-09-17T02:59:30.767485+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772989+0000', 'last_change': '2024-09-17T02:59:30.772989+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772989+0000', 'last_undegraded': '2024-09-17T02:59:30.772989+0000', 'last_fullsized': '2024-09-17T02:59:30.772989+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.769153+0000', 'last_change': '2024-09-17T02:59:30.769153+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.769153+0000', 'last_undegraded': '2024-09-17T02:59:30.769153+0000', 'last_fullsized': '2024-09-17T02:59:30.769153+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772078+0000', 'last_change': '2024-09-17T02:59:30.772078+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772078+0000', 'last_undegraded': '2024-09-17T02:59:30.772078+0000', 'last_fullsized': '2024-09-17T02:59:30.772078+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:PG 13.a is not active+clean 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772312+0000', 'last_change': '2024-09-17T02:59:30.772312+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772312+0000', 'last_undegraded': '2024-09-17T02:59:30.772312+0000', 'last_fullsized': '2024-09-17T02:59:30.772312+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.517 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.770363+0000', 'last_change': '2024-09-17T02:59:30.770363+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.770363+0000', 'last_undegraded': '2024-09-17T02:59:30.770363+0000', 'last_fullsized': '2024-09-17T02:59:30.770363+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:PG 13.8 is not active+clean 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.771644+0000', 'last_change': '2024-09-17T02:59:30.771644+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.771644+0000', 'last_undegraded': '2024-09-17T02:59:30.771644+0000', 'last_fullsized': '2024-09-17T02:59:30.771644+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.770002+0000', 'last_change': '2024-09-17T02:59:30.770002+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.770002+0000', 'last_undegraded': '2024-09-17T02:59:30.770002+0000', 'last_fullsized': '2024-09-17T02:59:30.770002+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.771858+0000', 'last_change': '2024-09-17T02:59:30.771858+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.771858+0000', 'last_undegraded': '2024-09-17T02:59:30.771858+0000', 'last_fullsized': '2024-09-17T02:59:30.771858+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773339+0000', 'last_change': '2024-09-17T02:59:30.773339+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773339+0000', 'last_undegraded': '2024-09-17T02:59:30.773339+0000', 'last_fullsized': '2024-09-17T02:59:30.773339+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-09-17T02:59:35.518 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.767594+0000', 'last_change': '2024-09-17T02:59:30.767594+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.767594+0000', 'last_undegraded': '2024-09-17T02:59:30.767594+0000', 'last_fullsized': '2024-09-17T02:59:30.767594+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772374+0000', 'last_change': '2024-09-17T02:59:30.772374+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772374+0000', 'last_undegraded': '2024-09-17T02:59:30.772374+0000', 'last_fullsized': '2024-09-17T02:59:30.772374+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.770797+0000', 'last_change': '2024-09-17T02:59:30.770797+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.770797+0000', 'last_undegraded': '2024-09-17T02:59:30.770797+0000', 'last_fullsized': '2024-09-17T02:59:30.770797+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.773000+0000', 'last_change': '2024-09-17T02:59:30.773000+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.773000+0000', 'last_undegraded': '2024-09-17T02:59:30.773000+0000', 'last_fullsized': '2024-09-17T02:59:30.773000+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.772980+0000', 'last_change': '2024-09-17T02:59:30.772980+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.772980+0000', 'last_undegraded': '2024-09-17T02:59:30.772980+0000', 'last_fullsized': '2024-09-17T02:59:30.772980+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.771138+0000', 'last_change': '2024-09-17T02:59:30.771138+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.771138+0000', 'last_undegraded': '2024-09-17T02:59:30.771138+0000', 'last_fullsized': '2024-09-17T02:59:30.771138+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T02:59:35.519 INFO:tasks.ceph.ceph_manager.ceph:PG 13.c is not active+clean 2024-09-17T02:59:35.520 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 101, 'state': 'creating+peering', 'last_fresh': '2024-09-17T02:59:30.767115+0000', 'last_change': '2024-09-17T02:59:30.767115+0000', 'last_active': '2024-09-17T02:59:30.762055+0000', 'last_peered': '2024-09-17T02:59:30.762055+0000', 'last_clean': '2024-09-17T02:59:30.762055+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T02:59:30.767115+0000', 'last_undegraded': '2024-09-17T02:59:30.767115+0000', 'last_fullsized': '2024-09-17T02:59:30.767115+0000', 'mapping_epoch': 101, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 101, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'last_clean_scrub_stamp': '2024-09-17T02:59:30.762055+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T02:59:35.520 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T02:59:35.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.657+0000 7f5b46430640 1 -- 172.21.15.104:0/617821576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400b5d20 msgr2=0x7f5b400cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.657+0000 7f5b46430640 1 --2- 172.21.15.104:0/617821576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400b5d20 0x7f5b400cfa80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5b38005fd0 tx=0x7f5b3802a8b0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.657+0000 7f5b46430640 1 -- 172.21.15.104:0/617821576 shutdown_connections 2024-09-17T02:59:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.657+0000 7f5b46430640 1 --2- 172.21.15.104:0/617821576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400b5d20 0x7f5b400cfa80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.657+0000 7f5b46430640 1 --2- 172.21.15.104:0/617821576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b400cdf10 0x7f5b400b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.657+0000 7f5b46430640 1 -- 172.21.15.104:0/617821576 >> 172.21.15.104:0/617821576 conn(0x7f5b400b44a0 msgr2=0x7f5b400b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.657+0000 7f5b46430640 1 -- 172.21.15.104:0/617821576 shutdown_connections 2024-09-17T02:59:35.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.657+0000 7f5b46430640 1 -- 172.21.15.104:0/617821576 wait complete. 2024-09-17T02:59:35.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.659+0000 7f5b46430640 1 Processor -- start 2024-09-17T02:59:35.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.659+0000 7f5b46430640 1 -- start start 2024-09-17T02:59:35.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b46430640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b400b4fc0 0x7f5b400b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:35.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b46430640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b400b5d20 0x7f5b40155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:35.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b46430640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400cdf10 0x7f5b40070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b46430640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5b40160f50 con 0x7f5b400cdf10 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b46430640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b400d0210 con 0x7f5b400b5d20 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b46430640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5b401610d0 con 0x7f5b400b4fc0 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b449cd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400cdf10 0x7f5b40070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b449cd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400cdf10 0x7f5b40070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43356/0 (socket says 172.21.15.104:43356) 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b449cd640 1 -- 172.21.15.104:0/3643691109 learned_addr learned my addr 172.21.15.104:0/3643691109 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b3ffff640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b400b4fc0 0x7f5b400b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.660+0000 7f5b3f7fe640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b400b5d20 0x7f5b40155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b449cd640 1 -- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b400b4fc0 msgr2=0x7f5b400b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b449cd640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b400b4fc0 0x7f5b400b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b449cd640 1 -- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b400b5d20 msgr2=0x7f5b40155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b449cd640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b400b5d20 0x7f5b40155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b449cd640 1 -- 172.21.15.104:0/3643691109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b400b1200 con 0x7f5b400cdf10 2024-09-17T02:59:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b449cd640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400cdf10 0x7f5b40070740 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009cd0 tx=0x7f5b38003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b3cff9640 1 -- 172.21.15.104:0/3643691109 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38031b90 con 0x7f5b400cdf10 2024-09-17T02:59:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b3cff9640 1 -- 172.21.15.104:0/3643691109 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b38031e20 con 0x7f5b400cdf10 2024-09-17T02:59:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b3cff9640 1 -- 172.21.15.104:0/3643691109 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38033310 con 0x7f5b400cdf10 2024-09-17T02:59:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b400b14e0 con 0x7f5b400cdf10 2024-09-17T02:59:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.661+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4015df10 con 0x7f5b400cdf10 2024-09-17T02:59:35.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.662+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b400cfa80 con 0x7f5b400cdf10 2024-09-17T02:59:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.663+0000 7f5b3cff9640 1 -- 172.21.15.104:0/3643691109 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b38031660 con 0x7f5b400cdf10 2024-09-17T02:59:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.663+0000 7f5b3cff9640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.663+0000 7f5b3cff9640 1 -- 172.21.15.104:0/3643691109 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f5b380bc220 con 0x7f5b400cdf10 2024-09-17T02:59:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.663+0000 7f5b3ffff640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:35.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.664+0000 7f5b3ffff640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5b300046b0 tx=0x7f5b30007eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:35.666 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.668+0000 7f5b3cff9640 1 -- 172.21.15.104:0/3643691109 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b3803f030 con 0x7f5b400cdf10 2024-09-17T02:59:35.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:59:35.860 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T02:59:35.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.914+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5b400cead0 con 0x7f5b400cdf10 2024-09-17T02:59:35.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.914+0000 7f5b3cff9640 1 -- 172.21.15.104:0/3643691109 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1232 (secure 0 0 0) 0x7f5b380840a0 con 0x7f5b400cdf10 2024-09-17T02:59:35.913 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:35.913 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":312,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":103,"num_osds":8,"num_up_osds":8,"osd_up_since":1726541670,"num_in_osds":8,"osd_in_since":1726541667,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":5517701,"bytes_avail":1594482299,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6282}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-17T02:59:19.689622+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T02:59:35.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b2c078b90 msgr2=0x7f5b2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5b300046b0 tx=0x7f5b30007eb0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400cdf10 msgr2=0x7f5b40070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:35.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400cdf10 0x7f5b40070740 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009cd0 tx=0x7f5b38003ba0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 shutdown_connections 2024-09-17T02:59:35.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b2c078b90 0x7f5b2c07b0a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.915 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b400b5d20 0x7f5b40155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b400cdf10 0x7f5b40070740 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 --2- 172.21.15.104:0/3643691109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b400b4fc0 0x7f5b400b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:35.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 >> 172.21.15.104:0/3643691109 conn(0x7f5b400b44a0 msgr2=0x7f5b400b79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:35.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 shutdown_connections 2024-09-17T02:59:35.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:35.916+0000 7f5b46430640 1 -- 172.21.15.104:0/3643691109 wait complete. 2024-09-17T02:59:35.926 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T02:59:35.926 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:59:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.080+0000 7fa08b0cc640 1 -- 172.21.15.104:0/368148937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06c005250 msgr2=0x7fa06c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.080+0000 7fa08b0cc640 1 --2- 172.21.15.104:0/368148937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06c005250 0x7fa06c00b9c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa07c001dc0 tx=0x7fa06c005830 comp rx=0 tx=0).stop 2024-09-17T02:59:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.080+0000 7fa08b0cc640 1 -- 172.21.15.104:0/368148937 shutdown_connections 2024-09-17T02:59:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.080+0000 7fa08b0cc640 1 --2- 172.21.15.104:0/368148937 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa06c005250 0x7fa06c00b9c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.080+0000 7fa08b0cc640 1 -- 172.21.15.104:0/368148937 >> 172.21.15.104:0/368148937 conn(0x7fa08406d200 msgr2=0x7fa08406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.080+0000 7fa08b0cc640 1 -- 172.21.15.104:0/368148937 shutdown_connections 2024-09-17T02:59:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.080+0000 7fa08b0cc640 1 -- 172.21.15.104:0/368148937 wait complete. 2024-09-17T02:59:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.082+0000 7fa08b0cc640 1 Processor -- start 2024-09-17T02:59:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.082+0000 7fa08b0cc640 1 -- start start 2024-09-17T02:59:36.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa08b0cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa06c005250 0x7fa084068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:36.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa08b0cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840b33c0 0x7fa084069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa08b0cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa08415e470 0x7fa08415e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa08b0cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa08406f550 con 0x7fa08415e470 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa08b0cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa084073c70 con 0x7fa06c005250 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa08b0cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa08406f6d0 con 0x7fa0840b33c0 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa08415e470 0x7fa08415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa08415e470 0x7fa08415e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43366/0 (socket says 172.21.15.104:43366) 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 -- 172.21.15.104:0/4012372915 learned_addr learned my addr 172.21.15.104:0/4012372915 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa07bfff640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840b33c0 0x7fa084069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa088e68640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa06c005250 0x7fa084068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 -- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840b33c0 msgr2=0x7fa084069240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840b33c0 0x7fa084069240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 -- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa06c005250 msgr2=0x7fa084068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa06c005250 0x7fa084068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 -- 172.21.15.104:0/4012372915 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0840b3b00 con 0x7fa08415e470 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa088e68640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa06c005250 0x7fa084068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa07bfff640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840b33c0 0x7fa084069240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa089669640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa08415e470 0x7fa08415e880 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa07c02acc0 tx=0x7fa07c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa0797fa640 1 -- 172.21.15.104:0/4012372915 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c003d80 con 0x7fa08415e470 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa0797fa640 1 -- 172.21.15.104:0/4012372915 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa07c032470 con 0x7fa08415e470 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0840ae950 con 0x7fa08415e470 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.084+0000 7fa0797fa640 1 -- 172.21.15.104:0/4012372915 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c0328c0 con 0x7fa08415e470 2024-09-17T02:59:36.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.085+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0840aef10 con 0x7fa08415e470 2024-09-17T02:59:36.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.086+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0840b0910 con 0x7fa08415e470 2024-09-17T02:59:36.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.086+0000 7fa0797fa640 1 -- 172.21.15.104:0/4012372915 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa07c032a60 con 0x7fa08415e470 2024-09-17T02:59:36.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.087+0000 7fa0797fa640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa070078b90 0x7fa07007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:36.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.087+0000 7fa0797fa640 1 -- 172.21.15.104:0/4012372915 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fa07c0bab90 con 0x7fa08415e470 2024-09-17T02:59:36.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.087+0000 7fa088e68640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa070078b90 0x7fa07007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:36.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.088+0000 7fa088e68640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa070078b90 0x7fa07007b0a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa080004a60 tx=0x7fa080001250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:36.090 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.091+0000 7fa0797fa640 1 -- 172.21.15.104:0/4012372915 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa07c082fd0 con 0x7fa08415e470 2024-09-17T02:59:36.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.261+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0840d23c0 con 0x7fa070078b90 2024-09-17T02:59:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.265+0000 7fa0797fa640 1 -- 172.21.15.104:0/4012372915 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242659 (secure 0 0 0) 0x7fa0840d23c0 con 0x7fa070078b90 2024-09-17T02:59:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:36.267 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa070078b90 msgr2=0x7fa07007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa070078b90 0x7fa07007b0a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa080004a60 tx=0x7fa080001250 comp rx=0 tx=0).stop 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa08415e470 msgr2=0x7fa08415e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa08415e470 0x7fa08415e880 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa07c02acc0 tx=0x7fa07c001b00 comp rx=0 tx=0).stop 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 shutdown_connections 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa070078b90 0x7fa07007b0a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa08415e470 0x7fa08415e880 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0840b33c0 0x7fa084069240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 --2- 172.21.15.104:0/4012372915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa06c005250 0x7fa084068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:36.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 >> 172.21.15.104:0/4012372915 conn(0x7fa08406d200 msgr2=0x7fa0840d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:36.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 shutdown_connections 2024-09-17T02:59:36.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:36.268+0000 7fa08b0cc640 1 -- 172.21.15.104:0/4012372915 wait complete. 2024-09-17T02:59:36.278 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-17T02:59:35.693216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5388,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557111,"statfs":{"total":1600000000,"available":1594482299,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930207"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769630+0000","last_change":"2024-09-17T02:59:30.769630+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769630+0000","last_undegraded":"2024-09-17T02:59:30.769630+0000","last_fullsized":"2024-09-17T02:59:30.769630+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768274+0000","last_change":"2024-09-17T02:59:30.768274+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768274+0000","last_undegraded":"2024-09-17T02:59:30.768274+0000","last_fullsized":"2024-09-17T02:59:30.768274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.776107+0000","last_change":"2024-09-17T02:59:30.776107+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.776107+0000","last_undegraded":"2024-09-17T02:59:30.776107+0000","last_fullsized":"2024-09-17T02:59:30.776107+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774812+0000","last_change":"2024-09-17T02:59:30.774812+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774812+0000","last_undegraded":"2024-09-17T02:59:30.774812+0000","last_fullsized":"2024-09-17T02:59:30.774812+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774947+0000","last_change":"2024-09-17T02:59:30.774947+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774947+0000","last_undegraded":"2024-09-17T02:59:30.774947+0000","last_fullsized":"2024-09-17T02:59:30.774947+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770155+0000","last_change":"2024-09-17T02:59:30.770155+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770155+0000","last_undegraded":"2024-09-17T02:59:30.770155+0000","last_fullsized":"2024-09-17T02:59:30.770155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772088+0000","last_change":"2024-09-17T02:59:30.772088+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772088+0000","last_undegraded":"2024-09-17T02:59:30.772088+0000","last_fullsized":"2024-09-17T02:59:30.772088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770954+0000","last_change":"2024-09-17T02:59:30.770954+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770954+0000","last_undegraded":"2024-09-17T02:59:30.770954+0000","last_fullsized":"2024-09-17T02:59:30.770954+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769403+0000","last_change":"2024-09-17T02:59:30.769403+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769403+0000","last_undegraded":"2024-09-17T02:59:30.769403+0000","last_fullsized":"2024-09-17T02:59:30.769403+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769130+0000","last_change":"2024-09-17T02:59:30.769130+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769130+0000","last_undegraded":"2024-09-17T02:59:30.769130+0000","last_fullsized":"2024-09-17T02:59:30.769130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766608+0000","last_change":"2024-09-17T02:59:30.766608+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766608+0000","last_undegraded":"2024-09-17T02:59:30.766608+0000","last_fullsized":"2024-09-17T02:59:30.766608+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768715+0000","last_change":"2024-09-17T02:59:30.768715+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768715+0000","last_undegraded":"2024-09-17T02:59:30.768715+0000","last_fullsized":"2024-09-17T02:59:30.768715+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774916+0000","last_change":"2024-09-17T02:59:30.774916+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774916+0000","last_undegraded":"2024-09-17T02:59:30.774916+0000","last_fullsized":"2024-09-17T02:59:30.774916+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773067+0000","last_change":"2024-09-17T02:59:30.773067+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773067+0000","last_undegraded":"2024-09-17T02:59:30.773067+0000","last_fullsized":"2024-09-17T02:59:30.773067+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772931+0000","last_change":"2024-09-17T02:59:30.772931+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772931+0000","last_undegraded":"2024-09-17T02:59:30.772931+0000","last_fullsized":"2024-09-17T02:59:30.772931+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775509+0000","last_change":"2024-09-17T02:59:30.775509+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775509+0000","last_undegraded":"2024-09-17T02:59:30.775509+0000","last_fullsized":"2024-09-17T02:59:30.775509+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775875+0000","last_change":"2024-09-17T02:59:30.775875+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775875+0000","last_undegraded":"2024-09-17T02:59:30.775875+0000","last_fullsized":"2024-09-17T02:59:30.775875+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772388+0000","last_change":"2024-09-17T02:59:30.772388+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772388+0000","last_undegraded":"2024-09-17T02:59:30.772388+0000","last_fullsized":"2024-09-17T02:59:30.772388+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774595+0000","last_change":"2024-09-17T02:59:30.774595+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774595+0000","last_undegraded":"2024-09-17T02:59:30.774595+0000","last_fullsized":"2024-09-17T02:59:30.774595+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771404+0000","last_change":"2024-09-17T02:59:30.771404+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771404+0000","last_undegraded":"2024-09-17T02:59:30.771404+0000","last_fullsized":"2024-09-17T02:59:30.771404+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772025+0000","last_change":"2024-09-17T02:59:30.772025+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772025+0000","last_undegraded":"2024-09-17T02:59:30.772025+0000","last_fullsized":"2024-09-17T02:59:30.772025+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767915+0000","last_change":"2024-09-17T02:59:30.767915+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767915+0000","last_undegraded":"2024-09-17T02:59:30.767915+0000","last_fullsized":"2024-09-17T02:59:30.767915+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773448+0000","last_change":"2024-09-17T02:59:30.773448+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773448+0000","last_undegraded":"2024-09-17T02:59:30.773448+0000","last_fullsized":"2024-09-17T02:59:30.773448+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772722+0000","last_change":"2024-09-17T02:59:30.772722+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772722+0000","last_undegraded":"2024-09-17T02:59:30.772722+0000","last_fullsized":"2024-09-17T02:59:30.772722+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767625+0000","last_change":"2024-09-17T02:59:30.767625+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767625+0000","last_undegraded":"2024-09-17T02:59:30.767625+0000","last_fullsized":"2024-09-17T02:59:30.767625+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773958+0000","last_change":"2024-09-17T02:59:30.773958+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773958+0000","last_undegraded":"2024-09-17T02:59:30.773958+0000","last_fullsized":"2024-09-17T02:59:30.773958+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772185+0000","last_change":"2024-09-17T02:59:30.772185+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772185+0000","last_undegraded":"2024-09-17T02:59:30.772185+0000","last_fullsized":"2024-09-17T02:59:30.772185+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772228+0000","last_change":"2024-09-17T02:59:30.772228+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772228+0000","last_undegraded":"2024-09-17T02:59:30.772228+0000","last_fullsized":"2024-09-17T02:59:30.772228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766854+0000","last_change":"2024-09-17T02:59:30.766854+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766854+0000","last_undegraded":"2024-09-17T02:59:30.766854+0000","last_fullsized":"2024-09-17T02:59:30.766854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767208+0000","last_change":"2024-09-17T02:59:30.767208+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767208+0000","last_undegraded":"2024-09-17T02:59:30.767208+0000","last_fullsized":"2024-09-17T02:59:30.767208+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775142+0000","last_change":"2024-09-17T02:59:30.775142+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775142+0000","last_undegraded":"2024-09-17T02:59:30.775142+0000","last_fullsized":"2024-09-17T02:59:30.775142+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768159+0000","last_change":"2024-09-17T02:59:30.768159+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768159+0000","last_undegraded":"2024-09-17T02:59:30.768159+0000","last_fullsized":"2024-09-17T02:59:30.768159+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774015+0000","last_change":"2024-09-17T02:59:30.774015+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774015+0000","last_undegraded":"2024-09-17T02:59:30.774015+0000","last_fullsized":"2024-09-17T02:59:30.774015+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778236+0000","last_change":"2024-09-17T02:59:30.777486+0000","last_active":"2024-09-17T02:59:30.778236+0000","last_peered":"2024-09-17T02:59:30.778236+0000","last_clean":"2024-09-17T02:59:30.778236+0000","last_became_active":"2024-09-17T02:59:30.775598+0000","last_became_peered":"2024-09-17T02:59:30.775598+0000","last_unstale":"2024-09-17T02:59:30.778236+0000","last_undegraded":"2024-09-17T02:59:30.778236+0000","last_fullsized":"2024-09-17T02:59:30.778236+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:13:36.245807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771844+0000","last_change":"2024-09-17T02:59:30.771844+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771844+0000","last_undegraded":"2024-09-17T02:59:30.771844+0000","last_fullsized":"2024-09-17T02:59:30.771844+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779952+0000","last_change":"2024-09-17T02:59:30.779490+0000","last_active":"2024-09-17T02:59:30.779952+0000","last_peered":"2024-09-17T02:59:30.779952+0000","last_clean":"2024-09-17T02:59:30.779952+0000","last_became_active":"2024-09-17T02:59:30.779028+0000","last_became_peered":"2024-09-17T02:59:30.779028+0000","last_unstale":"2024-09-17T02:59:30.779952+0000","last_undegraded":"2024-09-17T02:59:30.779952+0000","last_fullsized":"2024-09-17T02:59:30.779952+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:13.099529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768334+0000","last_change":"2024-09-17T02:59:30.768334+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768334+0000","last_undegraded":"2024-09-17T02:59:30.768334+0000","last_fullsized":"2024-09-17T02:59:30.768334+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779699+0000","last_change":"2024-09-17T02:59:30.779494+0000","last_active":"2024-09-17T02:59:30.779699+0000","last_peered":"2024-09-17T02:59:30.779699+0000","last_clean":"2024-09-17T02:59:30.779699+0000","last_became_active":"2024-09-17T02:59:30.779228+0000","last_became_peered":"2024-09-17T02:59:30.779228+0000","last_unstale":"2024-09-17T02:59:30.779699+0000","last_undegraded":"2024-09-17T02:59:30.779699+0000","last_fullsized":"2024-09-17T02:59:30.779699+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:33.231498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774238+0000","last_change":"2024-09-17T02:59:30.774238+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774238+0000","last_undegraded":"2024-09-17T02:59:30.774238+0000","last_fullsized":"2024-09-17T02:59:30.774238+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779019+0000","last_change":"2024-09-17T02:59:30.778833+0000","last_active":"2024-09-17T02:59:30.779019+0000","last_peered":"2024-09-17T02:59:30.779019+0000","last_clean":"2024-09-17T02:59:30.779019+0000","last_became_active":"2024-09-17T02:59:30.778564+0000","last_became_peered":"2024-09-17T02:59:30.778564+0000","last_unstale":"2024-09-17T02:59:30.779019+0000","last_undegraded":"2024-09-17T02:59:30.779019+0000","last_fullsized":"2024-09-17T02:59:30.779019+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:11.787274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767216+0000","last_change":"2024-09-17T02:59:30.767216+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767216+0000","last_undegraded":"2024-09-17T02:59:30.767216+0000","last_fullsized":"2024-09-17T02:59:30.767216+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777602+0000","last_change":"2024-09-17T02:59:30.777197+0000","last_active":"2024-09-17T02:59:30.777602+0000","last_peered":"2024-09-17T02:59:30.777602+0000","last_clean":"2024-09-17T02:59:30.777602+0000","last_became_active":"2024-09-17T02:59:30.776871+0000","last_became_peered":"2024-09-17T02:59:30.776871+0000","last_unstale":"2024-09-17T02:59:30.777602+0000","last_undegraded":"2024-09-17T02:59:30.777602+0000","last_fullsized":"2024-09-17T02:59:30.777602+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:04.943705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.775438+0000","last_change":"2024-09-17T02:59:30.775438+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.775438+0000","last_undegraded":"2024-09-17T02:59:30.775438+0000","last_fullsized":"2024-09-17T02:59:30.775438+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778425+0000","last_change":"2024-09-17T02:59:30.778211+0000","last_active":"2024-09-17T02:59:30.778425+0000","last_peered":"2024-09-17T02:59:30.778425+0000","last_clean":"2024-09-17T02:59:30.778425+0000","last_became_active":"2024-09-17T02:59:30.777940+0000","last_became_peered":"2024-09-17T02:59:30.777940+0000","last_unstale":"2024-09-17T02:59:30.778425+0000","last_undegraded":"2024-09-17T02:59:30.778425+0000","last_fullsized":"2024-09-17T02:59:30.778425+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:29.903145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773883+0000","last_change":"2024-09-17T02:59:30.773883+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773883+0000","last_undegraded":"2024-09-17T02:59:30.773883+0000","last_fullsized":"2024-09-17T02:59:30.773883+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777690+0000","last_change":"2024-09-17T02:59:30.776643+0000","last_active":"2024-09-17T02:59:30.777690+0000","last_peered":"2024-09-17T02:59:30.777690+0000","last_clean":"2024-09-17T02:59:30.777690+0000","last_became_active":"2024-09-17T02:59:30.776137+0000","last_became_peered":"2024-09-17T02:59:30.776137+0000","last_unstale":"2024-09-17T02:59:30.777690+0000","last_undegraded":"2024-09-17T02:59:30.777690+0000","last_fullsized":"2024-09-17T02:59:30.777690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:11.615438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773278+0000","last_change":"2024-09-17T02:59:30.773278+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773278+0000","last_undegraded":"2024-09-17T02:59:30.773278+0000","last_fullsized":"2024-09-17T02:59:30.773278+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777174+0000","last_change":"2024-09-17T02:59:30.776607+0000","last_active":"2024-09-17T02:59:30.777174+0000","last_peered":"2024-09-17T02:59:30.777174+0000","last_clean":"2024-09-17T02:59:30.777174+0000","last_became_active":"2024-09-17T02:59:30.775981+0000","last_became_peered":"2024-09-17T02:59:30.775981+0000","last_unstale":"2024-09-17T02:59:30.777174+0000","last_undegraded":"2024-09-17T02:59:30.777174+0000","last_fullsized":"2024-09-17T02:59:30.777174+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:15.789926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772999+0000","last_change":"2024-09-17T02:59:30.772999+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772999+0000","last_undegraded":"2024-09-17T02:59:30.772999+0000","last_fullsized":"2024-09-17T02:59:30.772999+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773379+0000","last_change":"2024-09-17T02:59:30.773108+0000","last_active":"2024-09-17T02:59:30.773379+0000","last_peered":"2024-09-17T02:59:30.773379+0000","last_clean":"2024-09-17T02:59:30.773379+0000","last_became_active":"2024-09-17T02:59:30.772831+0000","last_became_peered":"2024-09-17T02:59:30.772831+0000","last_unstale":"2024-09-17T02:59:30.773379+0000","last_undegraded":"2024-09-17T02:59:30.773379+0000","last_fullsized":"2024-09-17T02:59:30.773379+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:41.156681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.768995+0000","last_change":"2024-09-17T02:59:30.768995+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.768995+0000","last_undegraded":"2024-09-17T02:59:30.768995+0000","last_fullsized":"2024-09-17T02:59:30.768995+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778994+0000","last_change":"2024-09-17T02:59:30.778763+0000","last_active":"2024-09-17T02:59:30.778994+0000","last_peered":"2024-09-17T02:59:30.778994+0000","last_clean":"2024-09-17T02:59:30.778994+0000","last_became_active":"2024-09-17T02:59:30.778425+0000","last_became_peered":"2024-09-17T02:59:30.778425+0000","last_unstale":"2024-09-17T02:59:30.778994+0000","last_undegraded":"2024-09-17T02:59:30.778994+0000","last_fullsized":"2024-09-17T02:59:30.778994+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:55.570417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.774189+0000","last_change":"2024-09-17T02:59:30.774189+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.774189+0000","last_undegraded":"2024-09-17T02:59:30.774189+0000","last_fullsized":"2024-09-17T02:59:30.774189+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.775014+0000","last_change":"2024-09-17T02:59:30.774130+0000","last_active":"2024-09-17T02:59:30.775014+0000","last_peered":"2024-09-17T02:59:30.775014+0000","last_clean":"2024-09-17T02:59:30.775014+0000","last_became_active":"2024-09-17T02:59:30.773829+0000","last_became_peered":"2024-09-17T02:59:30.773829+0000","last_unstale":"2024-09-17T02:59:30.775014+0000","last_undegraded":"2024-09-17T02:59:30.775014+0000","last_fullsized":"2024-09-17T02:59:30.775014+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:30.784203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772682+0000","last_change":"2024-09-17T02:59:30.772682+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772682+0000","last_undegraded":"2024-09-17T02:59:30.772682+0000","last_fullsized":"2024-09-17T02:59:30.772682+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.775685+0000","last_change":"2024-09-17T02:59:30.774809+0000","last_active":"2024-09-17T02:59:30.775685+0000","last_peered":"2024-09-17T02:59:30.775685+0000","last_clean":"2024-09-17T02:59:30.775685+0000","last_became_active":"2024-09-17T02:59:30.774443+0000","last_became_peered":"2024-09-17T02:59:30.774443+0000","last_unstale":"2024-09-17T02:59:30.775685+0000","last_undegraded":"2024-09-17T02:59:30.775685+0000","last_fullsized":"2024-09-17T02:59:30.775685+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:38.509170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773410+0000","last_change":"2024-09-17T02:59:30.773410+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773410+0000","last_undegraded":"2024-09-17T02:59:30.773410+0000","last_fullsized":"2024-09-17T02:59:30.773410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777203+0000","last_change":"2024-09-17T02:59:30.776880+0000","last_active":"2024-09-17T02:59:30.777203+0000","last_peered":"2024-09-17T02:59:30.777203+0000","last_clean":"2024-09-17T02:59:30.777203+0000","last_became_active":"2024-09-17T02:59:30.776353+0000","last_became_peered":"2024-09-17T02:59:30.776353+0000","last_unstale":"2024-09-17T02:59:30.777203+0000","last_undegraded":"2024-09-17T02:59:30.777203+0000","last_fullsized":"2024-09-17T02:59:30.777203+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:20.916511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773496+0000","last_change":"2024-09-17T02:59:30.773496+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773496+0000","last_undegraded":"2024-09-17T02:59:30.773496+0000","last_fullsized":"2024-09-17T02:59:30.773496+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.772053+0000","last_change":"2024-09-17T02:59:30.770755+0000","last_active":"2024-09-17T02:59:30.772053+0000","last_peered":"2024-09-17T02:59:30.772053+0000","last_clean":"2024-09-17T02:59:30.772053+0000","last_became_active":"2024-09-17T02:59:30.770479+0000","last_became_peered":"2024-09-17T02:59:30.770479+0000","last_unstale":"2024-09-17T02:59:30.772053+0000","last_undegraded":"2024-09-17T02:59:30.772053+0000","last_fullsized":"2024-09-17T02:59:30.772053+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:09.064606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.766841+0000","last_change":"2024-09-17T02:59:30.766841+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.766841+0000","last_undegraded":"2024-09-17T02:59:30.766841+0000","last_fullsized":"2024-09-17T02:59:30.766841+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777276+0000","last_change":"2024-09-17T02:59:30.777012+0000","last_active":"2024-09-17T02:59:30.777276+0000","last_peered":"2024-09-17T02:59:30.777276+0000","last_clean":"2024-09-17T02:59:30.777276+0000","last_became_active":"2024-09-17T02:59:30.776717+0000","last_became_peered":"2024-09-17T02:59:30.776717+0000","last_unstale":"2024-09-17T02:59:30.777276+0000","last_undegraded":"2024-09-17T02:59:30.777276+0000","last_fullsized":"2024-09-17T02:59:30.777276+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:20.672235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767485+0000","last_change":"2024-09-17T02:59:30.767485+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767485+0000","last_undegraded":"2024-09-17T02:59:30.767485+0000","last_fullsized":"2024-09-17T02:59:30.767485+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777719+0000","last_change":"2024-09-17T02:59:30.776961+0000","last_active":"2024-09-17T02:59:30.777719+0000","last_peered":"2024-09-17T02:59:30.777719+0000","last_clean":"2024-09-17T02:59:30.777719+0000","last_became_active":"2024-09-17T02:59:30.776641+0000","last_became_peered":"2024-09-17T02:59:30.776641+0000","last_unstale":"2024-09-17T02:59:30.777719+0000","last_undegraded":"2024-09-17T02:59:30.777719+0000","last_fullsized":"2024-09-17T02:59:30.777719+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:39.085294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772989+0000","last_change":"2024-09-17T02:59:30.772989+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772989+0000","last_undegraded":"2024-09-17T02:59:30.772989+0000","last_fullsized":"2024-09-17T02:59:30.772989+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.771811+0000","last_change":"2024-09-17T02:59:30.771535+0000","last_active":"2024-09-17T02:59:30.771811+0000","last_peered":"2024-09-17T02:59:30.771811+0000","last_clean":"2024-09-17T02:59:30.771811+0000","last_became_active":"2024-09-17T02:59:30.771231+0000","last_became_peered":"2024-09-17T02:59:30.771231+0000","last_unstale":"2024-09-17T02:59:30.771811+0000","last_undegraded":"2024-09-17T02:59:30.771811+0000","last_fullsized":"2024-09-17T02:59:30.771811+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:45.853629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.769153+0000","last_change":"2024-09-17T02:59:30.769153+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.769153+0000","last_undegraded":"2024-09-17T02:59:30.769153+0000","last_fullsized":"2024-09-17T02:59:30.769153+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.778792+0000","last_change":"2024-09-17T02:59:30.778406+0000","last_active":"2024-09-17T02:59:30.778792+0000","last_peered":"2024-09-17T02:59:30.778792+0000","last_clean":"2024-09-17T02:59:30.778792+0000","last_became_active":"2024-09-17T02:59:30.778023+0000","last_became_peered":"2024-09-17T02:59:30.778023+0000","last_unstale":"2024-09-17T02:59:30.778792+0000","last_undegraded":"2024-09-17T02:59:30.778792+0000","last_fullsized":"2024-09-17T02:59:30.778792+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:07.037176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772078+0000","last_change":"2024-09-17T02:59:30.772078+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772078+0000","last_undegraded":"2024-09-17T02:59:30.772078+0000","last_fullsized":"2024-09-17T02:59:30.772078+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773841+0000","last_change":"2024-09-17T02:59:30.773650+0000","last_active":"2024-09-17T02:59:30.773841+0000","last_peered":"2024-09-17T02:59:30.773841+0000","last_clean":"2024-09-17T02:59:30.773841+0000","last_became_active":"2024-09-17T02:59:30.773409+0000","last_became_peered":"2024-09-17T02:59:30.773409+0000","last_unstale":"2024-09-17T02:59:30.773841+0000","last_undegraded":"2024-09-17T02:59:30.773841+0000","last_fullsized":"2024-09-17T02:59:30.773841+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:10.640195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772312+0000","last_change":"2024-09-17T02:59:30.772312+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772312+0000","last_undegraded":"2024-09-17T02:59:30.772312+0000","last_fullsized":"2024-09-17T02:59:30.772312+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779658+0000","last_change":"2024-09-17T02:59:30.779136+0000","last_active":"2024-09-17T02:59:30.779658+0000","last_peered":"2024-09-17T02:59:30.779658+0000","last_clean":"2024-09-17T02:59:30.779658+0000","last_became_active":"2024-09-17T02:59:30.778832+0000","last_became_peered":"2024-09-17T02:59:30.778832+0000","last_unstale":"2024-09-17T02:59:30.779658+0000","last_undegraded":"2024-09-17T02:59:30.779658+0000","last_fullsized":"2024-09-17T02:59:30.779658+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:52.479307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770363+0000","last_change":"2024-09-17T02:59:30.770363+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770363+0000","last_undegraded":"2024-09-17T02:59:30.770363+0000","last_fullsized":"2024-09-17T02:59:30.770363+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.776274+0000","last_change":"2024-09-17T02:59:30.776068+0000","last_active":"2024-09-17T02:59:30.776274+0000","last_peered":"2024-09-17T02:59:30.776274+0000","last_clean":"2024-09-17T02:59:30.776274+0000","last_became_active":"2024-09-17T02:59:30.775809+0000","last_became_peered":"2024-09-17T02:59:30.775809+0000","last_unstale":"2024-09-17T02:59:30.776274+0000","last_undegraded":"2024-09-17T02:59:30.776274+0000","last_fullsized":"2024-09-17T02:59:30.776274+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:50.054957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771644+0000","last_change":"2024-09-17T02:59:30.771644+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771644+0000","last_undegraded":"2024-09-17T02:59:30.771644+0000","last_fullsized":"2024-09-17T02:59:30.771644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773906+0000","last_change":"2024-09-17T02:59:30.773128+0000","last_active":"2024-09-17T02:59:30.773906+0000","last_peered":"2024-09-17T02:59:30.773906+0000","last_clean":"2024-09-17T02:59:30.773906+0000","last_became_active":"2024-09-17T02:59:30.772857+0000","last_became_peered":"2024-09-17T02:59:30.772857+0000","last_unstale":"2024-09-17T02:59:30.773906+0000","last_undegraded":"2024-09-17T02:59:30.773906+0000","last_fullsized":"2024-09-17T02:59:30.773906+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:14.560363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770002+0000","last_change":"2024-09-17T02:59:30.770002+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770002+0000","last_undegraded":"2024-09-17T02:59:30.770002+0000","last_fullsized":"2024-09-17T02:59:30.770002+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.774956+0000","last_change":"2024-09-17T02:59:30.774353+0000","last_active":"2024-09-17T02:59:30.774956+0000","last_peered":"2024-09-17T02:59:30.774956+0000","last_clean":"2024-09-17T02:59:30.774956+0000","last_became_active":"2024-09-17T02:59:30.774048+0000","last_became_peered":"2024-09-17T02:59:30.774048+0000","last_unstale":"2024-09-17T02:59:30.774956+0000","last_undegraded":"2024-09-17T02:59:30.774956+0000","last_fullsized":"2024-09-17T02:59:30.774956+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:19.762892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771858+0000","last_change":"2024-09-17T02:59:30.771858+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771858+0000","last_undegraded":"2024-09-17T02:59:30.771858+0000","last_fullsized":"2024-09-17T02:59:30.771858+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.769682+0000","last_change":"2024-09-17T02:59:30.769448+0000","last_active":"2024-09-17T02:59:30.769682+0000","last_peered":"2024-09-17T02:59:30.769682+0000","last_clean":"2024-09-17T02:59:30.769682+0000","last_became_active":"2024-09-17T02:59:30.769161+0000","last_became_peered":"2024-09-17T02:59:30.769161+0000","last_unstale":"2024-09-17T02:59:30.769682+0000","last_undegraded":"2024-09-17T02:59:30.769682+0000","last_fullsized":"2024-09-17T02:59:30.769682+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:20.715495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773339+0000","last_change":"2024-09-17T02:59:30.773339+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773339+0000","last_undegraded":"2024-09-17T02:59:30.773339+0000","last_fullsized":"2024-09-17T02:59:30.773339+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.773097+0000","last_change":"2024-09-17T02:59:30.772398+0000","last_active":"2024-09-17T02:59:30.773097+0000","last_peered":"2024-09-17T02:59:30.773097+0000","last_clean":"2024-09-17T02:59:30.773097+0000","last_became_active":"2024-09-17T02:59:30.772121+0000","last_became_peered":"2024-09-17T02:59:30.772121+0000","last_unstale":"2024-09-17T02:59:30.773097+0000","last_undegraded":"2024-09-17T02:59:30.773097+0000","last_fullsized":"2024-09-17T02:59:30.773097+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:43.182077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767594+0000","last_change":"2024-09-17T02:59:30.767594+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767594+0000","last_undegraded":"2024-09-17T02:59:30.767594+0000","last_fullsized":"2024-09-17T02:59:30.767594+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.779116+0000","last_change":"2024-09-17T02:59:30.778774+0000","last_active":"2024-09-17T02:59:30.779116+0000","last_peered":"2024-09-17T02:59:30.779116+0000","last_clean":"2024-09-17T02:59:30.779116+0000","last_became_active":"2024-09-17T02:59:30.776595+0000","last_became_peered":"2024-09-17T02:59:30.776595+0000","last_unstale":"2024-09-17T02:59:30.779116+0000","last_undegraded":"2024-09-17T02:59:30.779116+0000","last_fullsized":"2024-09-17T02:59:30.779116+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:09.933214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772374+0000","last_change":"2024-09-17T02:59:30.772374+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772374+0000","last_undegraded":"2024-09-17T02:59:30.772374+0000","last_fullsized":"2024-09-17T02:59:30.772374+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.771073+0000","last_change":"2024-09-17T02:59:30.770863+0000","last_active":"2024-09-17T02:59:30.771073+0000","last_peered":"2024-09-17T02:59:30.771073+0000","last_clean":"2024-09-17T02:59:30.771073+0000","last_became_active":"2024-09-17T02:59:30.770422+0000","last_became_peered":"2024-09-17T02:59:30.770422+0000","last_unstale":"2024-09-17T02:59:30.771073+0000","last_undegraded":"2024-09-17T02:59:30.771073+0000","last_fullsized":"2024-09-17T02:59:30.771073+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:21.357285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.770797+0000","last_change":"2024-09-17T02:59:30.770797+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.770797+0000","last_undegraded":"2024-09-17T02:59:30.770797+0000","last_fullsized":"2024-09-17T02:59:30.770797+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.776563+0000","last_change":"2024-09-17T02:59:30.776358+0000","last_active":"2024-09-17T02:59:30.776563+0000","last_peered":"2024-09-17T02:59:30.776563+0000","last_clean":"2024-09-17T02:59:30.776563+0000","last_became_active":"2024-09-17T02:59:30.776058+0000","last_became_peered":"2024-09-17T02:59:30.776058+0000","last_unstale":"2024-09-17T02:59:30.776563+0000","last_undegraded":"2024-09-17T02:59:30.776563+0000","last_fullsized":"2024-09-17T02:59:30.776563+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:22.115376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.773000+0000","last_change":"2024-09-17T02:59:30.773000+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.773000+0000","last_undegraded":"2024-09-17T02:59:30.773000+0000","last_fullsized":"2024-09-17T02:59:30.773000+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.780393+0000","last_change":"2024-09-17T02:59:30.780170+0000","last_active":"2024-09-17T02:59:30.780393+0000","last_peered":"2024-09-17T02:59:30.780393+0000","last_clean":"2024-09-17T02:59:30.780393+0000","last_became_active":"2024-09-17T02:59:30.779554+0000","last_became_peered":"2024-09-17T02:59:30.779554+0000","last_unstale":"2024-09-17T02:59:30.780393+0000","last_undegraded":"2024-09-17T02:59:30.780393+0000","last_fullsized":"2024-09-17T02:59:30.780393+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:41.248521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.772980+0000","last_change":"2024-09-17T02:59:30.772980+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.772980+0000","last_undegraded":"2024-09-17T02:59:30.772980+0000","last_fullsized":"2024-09-17T02:59:30.772980+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.777191+0000","last_change":"2024-09-17T02:59:30.775937+0000","last_active":"2024-09-17T02:59:30.777191+0000","last_peered":"2024-09-17T02:59:30.777191+0000","last_clean":"2024-09-17T02:59:30.777191+0000","last_became_active":"2024-09-17T02:59:30.775233+0000","last_became_peered":"2024-09-17T02:59:30.775233+0000","last_unstale":"2024-09-17T02:59:30.777191+0000","last_undegraded":"2024-09-17T02:59:30.777191+0000","last_fullsized":"2024-09-17T02:59:30.777191+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:49.133219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.771138+0000","last_change":"2024-09-17T02:59:30.771138+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.771138+0000","last_undegraded":"2024-09-17T02:59:30.771138+0000","last_fullsized":"2024-09-17T02:59:30.771138+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.780492+0000","last_change":"2024-09-17T02:59:30.780334+0000","last_active":"2024-09-17T02:59:30.780492+0000","last_peered":"2024-09-17T02:59:30.780492+0000","last_clean":"2024-09-17T02:59:30.780492+0000","last_became_active":"2024-09-17T02:59:30.780082+0000","last_became_peered":"2024-09-17T02:59:30.780082+0000","last_unstale":"2024-09-17T02:59:30.780492+0000","last_undegraded":"2024-09-17T02:59:30.780492+0000","last_fullsized":"2024-09-17T02:59:30.780492+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:47.433713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":101,"state":"creating+peering","last_fresh":"2024-09-17T02:59:30.767115+0000","last_change":"2024-09-17T02:59:30.767115+0000","last_active":"2024-09-17T02:59:30.762055+0000","last_peered":"2024-09-17T02:59:30.762055+0000","last_clean":"2024-09-17T02:59:30.762055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T02:59:30.767115+0000","last_undegraded":"2024-09-17T02:59:30.767115+0000","last_fullsized":"2024-09-17T02:59:30.767115+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.768299+0000","last_change":"2024-09-17T02:59:30.768062+0000","last_active":"2024-09-17T02:59:30.768299+0000","last_peered":"2024-09-17T02:59:30.768299+0000","last_clean":"2024-09-17T02:59:30.768299+0000","last_became_active":"2024-09-17T02:59:30.767771+0000","last_became_peered":"2024-09-17T02:59:30.767771+0000","last_unstale":"2024-09-17T02:59:30.768299+0000","last_undegraded":"2024-09-17T02:59:30.768299+0000","last_fullsized":"2024-09-17T02:59:30.768299+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:37.720017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":272,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T02:59:30.765357+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:59:30.765357+0000","last_peered":"2024-09-17T02:59:30.765357+0000","last_clean":"2024-09-17T02:59:30.765357+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:59:30.765357+0000","last_undegraded":"2024-09-17T02:59:30.765357+0000","last_fullsized":"2024-09-17T02:59:30.765357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:51.183978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":524,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194788,"statfs":{"total":200000000,"available":199463370,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":530,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194782,"statfs":{"total":200000000,"available":199457095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1106,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194205,"statfs":{"total":200000000,"available":198866727,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:59:39.283 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T02:59:39.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.410+0000 7f42c4d89640 1 -- 172.21.15.104:0/1788880277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b4fc0 msgr2=0x7f42c00b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:39.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.410+0000 7f42c4d89640 1 --2- 172.21.15.104:0/1788880277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b4fc0 0x7f42c00b39c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f42c00c98b0 tx=0x7f42b002a8b0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.410+0000 7f42c4d89640 1 -- 172.21.15.104:0/1788880277 shutdown_connections 2024-09-17T02:59:39.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.410+0000 7f42c4d89640 1 --2- 172.21.15.104:0/1788880277 >> v2:172.21.15.192:3300/0 conn(0x7f42c00cdf10 0x7f42c00cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.410+0000 7f42c4d89640 1 --2- 172.21.15.104:0/1788880277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b4fc0 0x7f42c00b39c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.410+0000 7f42c4d89640 1 -- 172.21.15.104:0/1788880277 >> 172.21.15.104:0/1788880277 conn(0x7f42c00b44a0 msgr2=0x7f42c00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:39.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.410+0000 7f42c4d89640 1 -- 172.21.15.104:0/1788880277 shutdown_connections 2024-09-17T02:59:39.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.410+0000 7f42c4d89640 1 -- 172.21.15.104:0/1788880277 wait complete. 2024-09-17T02:59:39.411 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.412+0000 7f42c4d89640 1 Processor -- start 2024-09-17T02:59:39.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.412+0000 7f42c4d89640 1 -- start start 2024-09-17T02:59:39.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42c4d89640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b3f00 0x7f42c006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:39.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42c4d89640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c00b4fc0 0x7f42c00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42c4d89640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c00cdf10 0x7f42c01f9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42c4d89640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00d18c0 con 0x7f42c00b3f00 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42c4d89640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00d01d0 con 0x7f42c00cdf10 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42c4d89640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f42c0160f50 con 0x7f42c00b4fc0 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b3f00 0x7f42c006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b3f00 0x7f42c006cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43374/0 (socket says 172.21.15.104:43374) 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 -- 172.21.15.104:0/677144470 learned_addr learned my addr 172.21.15.104:0/677144470 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42bed9d640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c00cdf10 0x7f42c01f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 -- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c00b4fc0 msgr2=0x7f42c00cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c00b4fc0 0x7f42c00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 -- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c00cdf10 msgr2=0x7f42c01f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c00cdf10 0x7f42c01f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 -- 172.21.15.104:0/677144470 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c006d880 con 0x7f42c00b3f00 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42bed9d640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c00cdf10 0x7f42c01f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:39.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42be59c640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b3f00 0x7f42c006cde0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009ca0 tx=0x7f42b0003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:39.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42aeffd640 1 -- 172.21.15.104:0/677144470 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0031b90 con 0x7f42c00b3f00 2024-09-17T02:59:39.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42aeffd640 1 -- 172.21.15.104:0/677144470 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42b0031e20 con 0x7f42c00b3f00 2024-09-17T02:59:39.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c006db60 con 0x7f42c00b3f00 2024-09-17T02:59:39.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42aeffd640 1 -- 172.21.15.104:0/677144470 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0033330 con 0x7f42c00b3f00 2024-09-17T02:59:39.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.414+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c006e120 con 0x7f42c00b3f00 2024-09-17T02:59:39.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.416+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c00b39c0 con 0x7f42c00b3f00 2024-09-17T02:59:39.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.416+0000 7f42aeffd640 1 -- 172.21.15.104:0/677144470 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42b00334d0 con 0x7f42c00b3f00 2024-09-17T02:59:39.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.417+0000 7f42aeffd640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42a0078b90 0x7f42a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:39.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.417+0000 7f42aeffd640 1 -- 172.21.15.104:0/677144470 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f42b00bc240 con 0x7f42c00b3f00 2024-09-17T02:59:39.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.417+0000 7f42bdd9b640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42a0078b90 0x7f42a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:39.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.418+0000 7f42bdd9b640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42a0078b90 0x7f42a007b0a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f42c0160ac0 tx=0x7f42b40079f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:39.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.421+0000 7f42aeffd640 1 -- 172.21.15.104:0/677144470 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42b003f030 con 0x7f42c00b3f00 2024-09-17T02:59:39.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.592+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42c00cead0 con 0x7f42a0078b90 2024-09-17T02:59:39.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.598+0000 7f42aeffd640 1 -- 172.21.15.104:0/677144470 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7f42c00cead0 con 0x7f42a0078b90 2024-09-17T02:59:39.600 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:39.601 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42a0078b90 msgr2=0x7f42a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42a0078b90 0x7f42a007b0a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f42c0160ac0 tx=0x7f42b40079f0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b3f00 msgr2=0x7f42c006cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b3f00 0x7f42c006cde0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f42b0009ca0 tx=0x7f42b0003a10 comp rx=0 tx=0).stop 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 shutdown_connections 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42a0078b90 0x7f42a007b0a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c00cdf10 0x7f42c01f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42c00b4fc0 0x7f42c00cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 --2- 172.21.15.104:0/677144470 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42c00b3f00 0x7f42c006cde0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 >> 172.21.15.104:0/677144470 conn(0x7f42c00b44a0 msgr2=0x7f42c00b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:39.603 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 shutdown_connections 2024-09-17T02:59:39.604 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.601+0000 7f42c4d89640 1 -- 172.21.15.104:0/677144470 wait complete. 2024-09-17T02:59:39.612 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-17T02:59:37.693700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5501,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556998,"statfs":{"total":1600000000,"available":1594366604,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.928029"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784395+0000","last_change":"2024-09-17T02:59:31.791714+0000","last_active":"2024-09-17T02:59:32.784395+0000","last_peered":"2024-09-17T02:59:32.784395+0000","last_clean":"2024-09-17T02:59:32.784395+0000","last_became_active":"2024-09-17T02:59:31.791445+0000","last_became_peered":"2024-09-17T02:59:31.791445+0000","last_unstale":"2024-09-17T02:59:32.784395+0000","last_undegraded":"2024-09-17T02:59:32.784395+0000","last_fullsized":"2024-09-17T02:59:32.784395+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:20.361488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801179+0000","last_change":"2024-09-17T02:59:31.795110+0000","last_active":"2024-09-17T02:59:32.801179+0000","last_peered":"2024-09-17T02:59:32.801179+0000","last_clean":"2024-09-17T02:59:32.801179+0000","last_became_active":"2024-09-17T02:59:31.792370+0000","last_became_peered":"2024-09-17T02:59:31.792370+0000","last_unstale":"2024-09-17T02:59:32.801179+0000","last_undegraded":"2024-09-17T02:59:32.801179+0000","last_fullsized":"2024-09-17T02:59:32.801179+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:40.220658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.782316+0000","last_change":"2024-09-17T02:59:31.789094+0000","last_active":"2024-09-17T02:59:32.782316+0000","last_peered":"2024-09-17T02:59:32.782316+0000","last_clean":"2024-09-17T02:59:32.782316+0000","last_became_active":"2024-09-17T02:59:31.788806+0000","last_became_peered":"2024-09-17T02:59:31.788806+0000","last_unstale":"2024-09-17T02:59:32.782316+0000","last_undegraded":"2024-09-17T02:59:32.782316+0000","last_fullsized":"2024-09-17T02:59:32.782316+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:40.835015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799093+0000","last_change":"2024-09-17T02:59:31.792924+0000","last_active":"2024-09-17T02:59:32.799093+0000","last_peered":"2024-09-17T02:59:32.799093+0000","last_clean":"2024-09-17T02:59:32.799093+0000","last_became_active":"2024-09-17T02:59:31.791995+0000","last_became_peered":"2024-09-17T02:59:31.791995+0000","last_unstale":"2024-09-17T02:59:32.799093+0000","last_undegraded":"2024-09-17T02:59:32.799093+0000","last_fullsized":"2024-09-17T02:59:32.799093+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:59.378591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785344+0000","last_change":"2024-09-17T02:59:31.800764+0000","last_active":"2024-09-17T02:59:32.785344+0000","last_peered":"2024-09-17T02:59:32.785344+0000","last_clean":"2024-09-17T02:59:32.785344+0000","last_became_active":"2024-09-17T02:59:31.797416+0000","last_became_peered":"2024-09-17T02:59:31.797416+0000","last_unstale":"2024-09-17T02:59:32.785344+0000","last_undegraded":"2024-09-17T02:59:32.785344+0000","last_fullsized":"2024-09-17T02:59:32.785344+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:50.417734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798578+0000","last_change":"2024-09-17T02:59:31.800871+0000","last_active":"2024-09-17T02:59:32.798578+0000","last_peered":"2024-09-17T02:59:32.798578+0000","last_clean":"2024-09-17T02:59:32.798578+0000","last_became_active":"2024-09-17T02:59:31.800243+0000","last_became_peered":"2024-09-17T02:59:31.800243+0000","last_unstale":"2024-09-17T02:59:32.798578+0000","last_undegraded":"2024-09-17T02:59:32.798578+0000","last_fullsized":"2024-09-17T02:59:32.798578+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:11.049088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.797854+0000","last_change":"2024-09-17T02:59:31.787779+0000","last_active":"2024-09-17T02:59:32.797854+0000","last_peered":"2024-09-17T02:59:32.797854+0000","last_clean":"2024-09-17T02:59:32.797854+0000","last_became_active":"2024-09-17T02:59:31.787524+0000","last_became_peered":"2024-09-17T02:59:31.787524+0000","last_unstale":"2024-09-17T02:59:32.797854+0000","last_undegraded":"2024-09-17T02:59:32.797854+0000","last_fullsized":"2024-09-17T02:59:32.797854+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:02.835238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798516+0000","last_change":"2024-09-17T02:59:31.792677+0000","last_active":"2024-09-17T02:59:32.798516+0000","last_peered":"2024-09-17T02:59:32.798516+0000","last_clean":"2024-09-17T02:59:32.798516+0000","last_became_active":"2024-09-17T02:59:31.792342+0000","last_became_peered":"2024-09-17T02:59:31.792342+0000","last_unstale":"2024-09-17T02:59:32.798516+0000","last_undegraded":"2024-09-17T02:59:32.798516+0000","last_fullsized":"2024-09-17T02:59:32.798516+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:47.466479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798507+0000","last_change":"2024-09-17T02:59:31.798445+0000","last_active":"2024-09-17T02:59:32.798507+0000","last_peered":"2024-09-17T02:59:32.798507+0000","last_clean":"2024-09-17T02:59:32.798507+0000","last_became_active":"2024-09-17T02:59:31.798146+0000","last_became_peered":"2024-09-17T02:59:31.798146+0000","last_unstale":"2024-09-17T02:59:32.798507+0000","last_undegraded":"2024-09-17T02:59:32.798507+0000","last_fullsized":"2024-09-17T02:59:32.798507+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:39.820219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784252+0000","last_change":"2024-09-17T02:59:31.793694+0000","last_active":"2024-09-17T02:59:32.784252+0000","last_peered":"2024-09-17T02:59:32.784252+0000","last_clean":"2024-09-17T02:59:32.784252+0000","last_became_active":"2024-09-17T02:59:31.793279+0000","last_became_peered":"2024-09-17T02:59:31.793279+0000","last_unstale":"2024-09-17T02:59:32.784252+0000","last_undegraded":"2024-09-17T02:59:32.784252+0000","last_fullsized":"2024-09-17T02:59:32.784252+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:59.007351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798917+0000","last_change":"2024-09-17T02:59:31.786384+0000","last_active":"2024-09-17T02:59:32.798917+0000","last_peered":"2024-09-17T02:59:32.798917+0000","last_clean":"2024-09-17T02:59:32.798917+0000","last_became_active":"2024-09-17T02:59:31.785565+0000","last_became_peered":"2024-09-17T02:59:31.785565+0000","last_unstale":"2024-09-17T02:59:32.798917+0000","last_undegraded":"2024-09-17T02:59:32.798917+0000","last_fullsized":"2024-09-17T02:59:32.798917+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:50.047613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784221+0000","last_change":"2024-09-17T02:59:31.788917+0000","last_active":"2024-09-17T02:59:32.784221+0000","last_peered":"2024-09-17T02:59:32.784221+0000","last_clean":"2024-09-17T02:59:32.784221+0000","last_became_active":"2024-09-17T02:59:31.788639+0000","last_became_peered":"2024-09-17T02:59:31.788639+0000","last_unstale":"2024-09-17T02:59:32.784221+0000","last_undegraded":"2024-09-17T02:59:32.784221+0000","last_fullsized":"2024-09-17T02:59:32.784221+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:54.182553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.782633+0000","last_change":"2024-09-17T02:59:31.797455+0000","last_active":"2024-09-17T02:59:32.782633+0000","last_peered":"2024-09-17T02:59:32.782633+0000","last_clean":"2024-09-17T02:59:32.782633+0000","last_became_active":"2024-09-17T02:59:31.797188+0000","last_became_peered":"2024-09-17T02:59:31.797188+0000","last_unstale":"2024-09-17T02:59:32.782633+0000","last_undegraded":"2024-09-17T02:59:32.782633+0000","last_fullsized":"2024-09-17T02:59:32.782633+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:59:58.066369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799307+0000","last_change":"2024-09-17T02:59:31.793635+0000","last_active":"2024-09-17T02:59:32.799307+0000","last_peered":"2024-09-17T02:59:32.799307+0000","last_clean":"2024-09-17T02:59:32.799307+0000","last_became_active":"2024-09-17T02:59:31.792351+0000","last_became_peered":"2024-09-17T02:59:31.792351+0000","last_unstale":"2024-09-17T02:59:32.799307+0000","last_undegraded":"2024-09-17T02:59:32.799307+0000","last_fullsized":"2024-09-17T02:59:32.799307+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:50.321431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798504+0000","last_change":"2024-09-17T02:59:31.796680+0000","last_active":"2024-09-17T02:59:32.798504+0000","last_peered":"2024-09-17T02:59:32.798504+0000","last_clean":"2024-09-17T02:59:32.798504+0000","last_became_active":"2024-09-17T02:59:31.795403+0000","last_became_peered":"2024-09-17T02:59:31.795403+0000","last_unstale":"2024-09-17T02:59:32.798504+0000","last_undegraded":"2024-09-17T02:59:32.798504+0000","last_fullsized":"2024-09-17T02:59:32.798504+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:04.738738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785054+0000","last_change":"2024-09-17T02:59:31.797925+0000","last_active":"2024-09-17T02:59:32.785054+0000","last_peered":"2024-09-17T02:59:32.785054+0000","last_clean":"2024-09-17T02:59:32.785054+0000","last_became_active":"2024-09-17T02:59:31.796549+0000","last_became_peered":"2024-09-17T02:59:31.796549+0000","last_unstale":"2024-09-17T02:59:32.785054+0000","last_undegraded":"2024-09-17T02:59:32.785054+0000","last_fullsized":"2024-09-17T02:59:32.785054+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:46.327268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785669+0000","last_change":"2024-09-17T02:59:31.802025+0000","last_active":"2024-09-17T02:59:32.785669+0000","last_peered":"2024-09-17T02:59:32.785669+0000","last_clean":"2024-09-17T02:59:32.785669+0000","last_became_active":"2024-09-17T02:59:31.801378+0000","last_became_peered":"2024-09-17T02:59:31.801378+0000","last_unstale":"2024-09-17T02:59:32.785669+0000","last_undegraded":"2024-09-17T02:59:32.785669+0000","last_fullsized":"2024-09-17T02:59:32.785669+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:41.884791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798636+0000","last_change":"2024-09-17T02:59:31.791710+0000","last_active":"2024-09-17T02:59:32.798636+0000","last_peered":"2024-09-17T02:59:32.798636+0000","last_clean":"2024-09-17T02:59:32.798636+0000","last_became_active":"2024-09-17T02:59:31.791363+0000","last_became_peered":"2024-09-17T02:59:31.791363+0000","last_unstale":"2024-09-17T02:59:32.798636+0000","last_undegraded":"2024-09-17T02:59:32.798636+0000","last_fullsized":"2024-09-17T02:59:32.798636+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:36.779730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799691+0000","last_change":"2024-09-17T02:59:31.791086+0000","last_active":"2024-09-17T02:59:32.799691+0000","last_peered":"2024-09-17T02:59:32.799691+0000","last_clean":"2024-09-17T02:59:32.799691+0000","last_became_active":"2024-09-17T02:59:31.790785+0000","last_became_peered":"2024-09-17T02:59:31.790785+0000","last_unstale":"2024-09-17T02:59:32.799691+0000","last_undegraded":"2024-09-17T02:59:32.799691+0000","last_fullsized":"2024-09-17T02:59:32.799691+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:49.841191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799246+0000","last_change":"2024-09-17T02:59:31.789238+0000","last_active":"2024-09-17T02:59:32.799246+0000","last_peered":"2024-09-17T02:59:32.799246+0000","last_clean":"2024-09-17T02:59:32.799246+0000","last_became_active":"2024-09-17T02:59:31.789008+0000","last_became_peered":"2024-09-17T02:59:31.789008+0000","last_unstale":"2024-09-17T02:59:32.799246+0000","last_undegraded":"2024-09-17T02:59:32.799246+0000","last_fullsized":"2024-09-17T02:59:32.799246+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:57:17.665501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.797806+0000","last_change":"2024-09-17T02:59:31.789151+0000","last_active":"2024-09-17T02:59:32.797806+0000","last_peered":"2024-09-17T02:59:32.797806+0000","last_clean":"2024-09-17T02:59:32.797806+0000","last_became_active":"2024-09-17T02:59:31.788919+0000","last_became_peered":"2024-09-17T02:59:31.788919+0000","last_unstale":"2024-09-17T02:59:32.797806+0000","last_undegraded":"2024-09-17T02:59:32.797806+0000","last_fullsized":"2024-09-17T02:59:32.797806+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:55.943012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801401+0000","last_change":"2024-09-17T02:59:31.793097+0000","last_active":"2024-09-17T02:59:32.801401+0000","last_peered":"2024-09-17T02:59:32.801401+0000","last_clean":"2024-09-17T02:59:32.801401+0000","last_became_active":"2024-09-17T02:59:31.789302+0000","last_became_peered":"2024-09-17T02:59:31.789302+0000","last_unstale":"2024-09-17T02:59:32.801401+0000","last_undegraded":"2024-09-17T02:59:32.801401+0000","last_fullsized":"2024-09-17T02:59:32.801401+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:19.203559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785395+0000","last_change":"2024-09-17T02:59:31.795216+0000","last_active":"2024-09-17T02:59:32.785395+0000","last_peered":"2024-09-17T02:59:32.785395+0000","last_clean":"2024-09-17T02:59:32.785395+0000","last_became_active":"2024-09-17T02:59:31.794584+0000","last_became_peered":"2024-09-17T02:59:31.794584+0000","last_unstale":"2024-09-17T02:59:32.785395+0000","last_undegraded":"2024-09-17T02:59:32.785395+0000","last_fullsized":"2024-09-17T02:59:32.785395+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:05.942291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799537+0000","last_change":"2024-09-17T02:59:31.794056+0000","last_active":"2024-09-17T02:59:32.799537+0000","last_peered":"2024-09-17T02:59:32.799537+0000","last_clean":"2024-09-17T02:59:32.799537+0000","last_became_active":"2024-09-17T02:59:31.792675+0000","last_became_peered":"2024-09-17T02:59:31.792675+0000","last_unstale":"2024-09-17T02:59:32.799537+0000","last_undegraded":"2024-09-17T02:59:32.799537+0000","last_fullsized":"2024-09-17T02:59:32.799537+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:08.240441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798760+0000","last_change":"2024-09-17T02:59:31.788886+0000","last_active":"2024-09-17T02:59:32.798760+0000","last_peered":"2024-09-17T02:59:32.798760+0000","last_clean":"2024-09-17T02:59:32.798760+0000","last_became_active":"2024-09-17T02:59:31.788614+0000","last_became_peered":"2024-09-17T02:59:31.788614+0000","last_unstale":"2024-09-17T02:59:32.798760+0000","last_undegraded":"2024-09-17T02:59:32.798760+0000","last_fullsized":"2024-09-17T02:59:32.798760+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:14.175275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.782941+0000","last_change":"2024-09-17T02:59:31.783586+0000","last_active":"2024-09-17T02:59:32.782941+0000","last_peered":"2024-09-17T02:59:32.782941+0000","last_clean":"2024-09-17T02:59:32.782941+0000","last_became_active":"2024-09-17T02:59:31.783164+0000","last_became_peered":"2024-09-17T02:59:31.783164+0000","last_unstale":"2024-09-17T02:59:32.782941+0000","last_undegraded":"2024-09-17T02:59:32.782941+0000","last_fullsized":"2024-09-17T02:59:32.782941+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:18.103940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.786431+0000","last_change":"2024-09-17T02:59:31.790716+0000","last_active":"2024-09-17T02:59:32.786431+0000","last_peered":"2024-09-17T02:59:32.786431+0000","last_clean":"2024-09-17T02:59:32.786431+0000","last_became_active":"2024-09-17T02:59:31.790437+0000","last_became_peered":"2024-09-17T02:59:31.790437+0000","last_unstale":"2024-09-17T02:59:32.786431+0000","last_undegraded":"2024-09-17T02:59:32.786431+0000","last_fullsized":"2024-09-17T02:59:32.786431+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:00.038797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785659+0000","last_change":"2024-09-17T02:59:31.799561+0000","last_active":"2024-09-17T02:59:32.785659+0000","last_peered":"2024-09-17T02:59:32.785659+0000","last_clean":"2024-09-17T02:59:32.785659+0000","last_became_active":"2024-09-17T02:59:31.798796+0000","last_became_peered":"2024-09-17T02:59:31.798796+0000","last_unstale":"2024-09-17T02:59:32.785659+0000","last_undegraded":"2024-09-17T02:59:32.785659+0000","last_fullsized":"2024-09-17T02:59:32.785659+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:21.798475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799051+0000","last_change":"2024-09-17T02:59:31.791144+0000","last_active":"2024-09-17T02:59:32.799051+0000","last_peered":"2024-09-17T02:59:32.799051+0000","last_clean":"2024-09-17T02:59:32.799051+0000","last_became_active":"2024-09-17T02:59:31.790745+0000","last_became_peered":"2024-09-17T02:59:31.790745+0000","last_unstale":"2024-09-17T02:59:32.799051+0000","last_undegraded":"2024-09-17T02:59:32.799051+0000","last_fullsized":"2024-09-17T02:59:32.799051+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:02.743833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799046+0000","last_change":"2024-09-17T02:59:31.785700+0000","last_active":"2024-09-17T02:59:32.799046+0000","last_peered":"2024-09-17T02:59:32.799046+0000","last_clean":"2024-09-17T02:59:32.799046+0000","last_became_active":"2024-09-17T02:59:31.785425+0000","last_became_peered":"2024-09-17T02:59:31.785425+0000","last_unstale":"2024-09-17T02:59:32.799046+0000","last_undegraded":"2024-09-17T02:59:32.799046+0000","last_fullsized":"2024-09-17T02:59:32.799046+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:19.422126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785265+0000","last_change":"2024-09-17T02:59:31.797378+0000","last_active":"2024-09-17T02:59:32.785265+0000","last_peered":"2024-09-17T02:59:32.785265+0000","last_clean":"2024-09-17T02:59:32.785265+0000","last_became_active":"2024-09-17T02:59:31.796129+0000","last_became_peered":"2024-09-17T02:59:31.796129+0000","last_unstale":"2024-09-17T02:59:32.785265+0000","last_undegraded":"2024-09-17T02:59:32.785265+0000","last_fullsized":"2024-09-17T02:59:32.785265+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:27.725473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784494+0000","last_change":"2024-09-17T02:59:31.787947+0000","last_active":"2024-09-17T02:59:32.784494+0000","last_peered":"2024-09-17T02:59:32.784494+0000","last_clean":"2024-09-17T02:59:32.784494+0000","last_became_active":"2024-09-17T02:59:31.787595+0000","last_became_peered":"2024-09-17T02:59:31.787595+0000","last_unstale":"2024-09-17T02:59:32.784494+0000","last_undegraded":"2024-09-17T02:59:32.784494+0000","last_fullsized":"2024-09-17T02:59:32.784494+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:00.097894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.783385+0000","last_change":"2024-09-17T02:59:31.794329+0000","last_active":"2024-09-17T02:59:32.783385+0000","last_peered":"2024-09-17T02:59:32.783385+0000","last_clean":"2024-09-17T02:59:32.783385+0000","last_became_active":"2024-09-17T02:59:31.791960+0000","last_became_peered":"2024-09-17T02:59:31.791960+0000","last_unstale":"2024-09-17T02:59:32.783385+0000","last_undegraded":"2024-09-17T02:59:32.783385+0000","last_fullsized":"2024-09-17T02:59:32.783385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:18.513419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"102'4","reported_seq":19,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785933+0000","last_change":"2024-09-17T02:59:30.777486+0000","last_active":"2024-09-17T02:59:32.785933+0000","last_peered":"2024-09-17T02:59:32.785933+0000","last_clean":"2024-09-17T02:59:32.785933+0000","last_became_active":"2024-09-17T02:59:30.775598+0000","last_became_peered":"2024-09-17T02:59:30.775598+0000","last_unstale":"2024-09-17T02:59:32.785933+0000","last_undegraded":"2024-09-17T02:59:32.785933+0000","last_fullsized":"2024-09-17T02:59:32.785933+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:06.472336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785814+0000","last_change":"2024-09-17T02:59:31.794845+0000","last_active":"2024-09-17T02:59:32.785814+0000","last_peered":"2024-09-17T02:59:32.785814+0000","last_clean":"2024-09-17T02:59:32.785814+0000","last_became_active":"2024-09-17T02:59:31.794212+0000","last_became_peered":"2024-09-17T02:59:31.794212+0000","last_unstale":"2024-09-17T02:59:32.785814+0000","last_undegraded":"2024-09-17T02:59:32.785814+0000","last_fullsized":"2024-09-17T02:59:32.785814+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:17.919909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.783839+0000","last_change":"2024-09-17T02:59:30.779490+0000","last_active":"2024-09-17T02:59:32.783839+0000","last_peered":"2024-09-17T02:59:32.783839+0000","last_clean":"2024-09-17T02:59:32.783839+0000","last_became_active":"2024-09-17T02:59:30.779028+0000","last_became_peered":"2024-09-17T02:59:30.779028+0000","last_unstale":"2024-09-17T02:59:32.783839+0000","last_undegraded":"2024-09-17T02:59:32.783839+0000","last_fullsized":"2024-09-17T02:59:32.783839+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:35.027350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784639+0000","last_change":"2024-09-17T02:59:31.794609+0000","last_active":"2024-09-17T02:59:32.784639+0000","last_peered":"2024-09-17T02:59:32.784639+0000","last_clean":"2024-09-17T02:59:32.784639+0000","last_became_active":"2024-09-17T02:59:31.793132+0000","last_became_peered":"2024-09-17T02:59:31.793132+0000","last_unstale":"2024-09-17T02:59:32.784639+0000","last_undegraded":"2024-09-17T02:59:32.784639+0000","last_fullsized":"2024-09-17T02:59:32.784639+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:41.061162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"102'2","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.800921+0000","last_change":"2024-09-17T02:59:30.779494+0000","last_active":"2024-09-17T02:59:32.800921+0000","last_peered":"2024-09-17T02:59:32.800921+0000","last_clean":"2024-09-17T02:59:32.800921+0000","last_became_active":"2024-09-17T02:59:30.779228+0000","last_became_peered":"2024-09-17T02:59:30.779228+0000","last_unstale":"2024-09-17T02:59:32.800921+0000","last_undegraded":"2024-09-17T02:59:32.800921+0000","last_fullsized":"2024-09-17T02:59:32.800921+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:38.195001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.783538+0000","last_change":"2024-09-17T02:59:31.786485+0000","last_active":"2024-09-17T02:59:32.783538+0000","last_peered":"2024-09-17T02:59:32.783538+0000","last_clean":"2024-09-17T02:59:32.783538+0000","last_became_active":"2024-09-17T02:59:31.786144+0000","last_became_peered":"2024-09-17T02:59:31.786144+0000","last_unstale":"2024-09-17T02:59:32.783538+0000","last_undegraded":"2024-09-17T02:59:32.783538+0000","last_fullsized":"2024-09-17T02:59:32.783538+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:38.991503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"102'2","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799017+0000","last_change":"2024-09-17T02:59:30.778833+0000","last_active":"2024-09-17T02:59:32.799017+0000","last_peered":"2024-09-17T02:59:32.799017+0000","last_clean":"2024-09-17T02:59:32.799017+0000","last_became_active":"2024-09-17T02:59:30.778564+0000","last_became_peered":"2024-09-17T02:59:30.778564+0000","last_unstale":"2024-09-17T02:59:32.799017+0000","last_undegraded":"2024-09-17T02:59:32.799017+0000","last_fullsized":"2024-09-17T02:59:32.799017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:45.988887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801296+0000","last_change":"2024-09-17T02:59:31.786628+0000","last_active":"2024-09-17T02:59:32.801296+0000","last_peered":"2024-09-17T02:59:32.801296+0000","last_clean":"2024-09-17T02:59:32.801296+0000","last_became_active":"2024-09-17T02:59:31.786061+0000","last_became_peered":"2024-09-17T02:59:31.786061+0000","last_unstale":"2024-09-17T02:59:32.801296+0000","last_undegraded":"2024-09-17T02:59:32.801296+0000","last_fullsized":"2024-09-17T02:59:32.801296+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:28.707166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.786234+0000","last_change":"2024-09-17T02:59:30.777197+0000","last_active":"2024-09-17T02:59:32.786234+0000","last_peered":"2024-09-17T02:59:32.786234+0000","last_clean":"2024-09-17T02:59:32.786234+0000","last_became_active":"2024-09-17T02:59:30.776871+0000","last_became_peered":"2024-09-17T02:59:30.776871+0000","last_unstale":"2024-09-17T02:59:32.786234+0000","last_undegraded":"2024-09-17T02:59:32.786234+0000","last_fullsized":"2024-09-17T02:59:32.786234+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:43.219152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785912+0000","last_change":"2024-09-17T02:59:31.801702+0000","last_active":"2024-09-17T02:59:32.785912+0000","last_peered":"2024-09-17T02:59:32.785912+0000","last_clean":"2024-09-17T02:59:32.785912+0000","last_became_active":"2024-09-17T02:59:31.800784+0000","last_became_peered":"2024-09-17T02:59:31.800784+0000","last_unstale":"2024-09-17T02:59:32.785912+0000","last_undegraded":"2024-09-17T02:59:32.785912+0000","last_fullsized":"2024-09-17T02:59:32.785912+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:28.626535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785067+0000","last_change":"2024-09-17T02:59:30.778211+0000","last_active":"2024-09-17T02:59:32.785067+0000","last_peered":"2024-09-17T02:59:32.785067+0000","last_clean":"2024-09-17T02:59:32.785067+0000","last_became_active":"2024-09-17T02:59:30.777940+0000","last_became_peered":"2024-09-17T02:59:30.777940+0000","last_unstale":"2024-09-17T02:59:32.785067+0000","last_undegraded":"2024-09-17T02:59:32.785067+0000","last_fullsized":"2024-09-17T02:59:32.785067+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:33.906462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.782962+0000","last_change":"2024-09-17T02:59:31.788870+0000","last_active":"2024-09-17T02:59:32.782962+0000","last_peered":"2024-09-17T02:59:32.782962+0000","last_clean":"2024-09-17T02:59:32.782962+0000","last_became_active":"2024-09-17T02:59:31.788029+0000","last_became_peered":"2024-09-17T02:59:31.788029+0000","last_unstale":"2024-09-17T02:59:32.782962+0000","last_undegraded":"2024-09-17T02:59:32.782962+0000","last_fullsized":"2024-09-17T02:59:32.782962+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:01.254283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799999+0000","last_change":"2024-09-17T02:59:30.776643+0000","last_active":"2024-09-17T02:59:32.799999+0000","last_peered":"2024-09-17T02:59:32.799999+0000","last_clean":"2024-09-17T02:59:32.799999+0000","last_became_active":"2024-09-17T02:59:30.776137+0000","last_became_peered":"2024-09-17T02:59:30.776137+0000","last_unstale":"2024-09-17T02:59:32.799999+0000","last_undegraded":"2024-09-17T02:59:32.799999+0000","last_fullsized":"2024-09-17T02:59:32.799999+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:12:10.276610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801013+0000","last_change":"2024-09-17T02:59:31.794030+0000","last_active":"2024-09-17T02:59:32.801013+0000","last_peered":"2024-09-17T02:59:32.801013+0000","last_clean":"2024-09-17T02:59:32.801013+0000","last_became_active":"2024-09-17T02:59:31.793744+0000","last_became_peered":"2024-09-17T02:59:31.793744+0000","last_unstale":"2024-09-17T02:59:32.801013+0000","last_undegraded":"2024-09-17T02:59:32.801013+0000","last_fullsized":"2024-09-17T02:59:32.801013+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:15.954355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799213+0000","last_change":"2024-09-17T02:59:30.776607+0000","last_active":"2024-09-17T02:59:32.799213+0000","last_peered":"2024-09-17T02:59:32.799213+0000","last_clean":"2024-09-17T02:59:32.799213+0000","last_became_active":"2024-09-17T02:59:30.775981+0000","last_became_peered":"2024-09-17T02:59:30.775981+0000","last_unstale":"2024-09-17T02:59:32.799213+0000","last_undegraded":"2024-09-17T02:59:32.799213+0000","last_fullsized":"2024-09-17T02:59:32.799213+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:21.698704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.800614+0000","last_change":"2024-09-17T02:59:31.796890+0000","last_active":"2024-09-17T02:59:32.800614+0000","last_peered":"2024-09-17T02:59:32.800614+0000","last_clean":"2024-09-17T02:59:32.800614+0000","last_became_active":"2024-09-17T02:59:31.795936+0000","last_became_peered":"2024-09-17T02:59:31.795936+0000","last_unstale":"2024-09-17T02:59:32.800614+0000","last_undegraded":"2024-09-17T02:59:32.800614+0000","last_fullsized":"2024-09-17T02:59:32.800614+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:20.616436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784813+0000","last_change":"2024-09-17T02:59:30.773108+0000","last_active":"2024-09-17T02:59:32.784813+0000","last_peered":"2024-09-17T02:59:32.784813+0000","last_clean":"2024-09-17T02:59:32.784813+0000","last_became_active":"2024-09-17T02:59:30.772831+0000","last_became_peered":"2024-09-17T02:59:30.772831+0000","last_unstale":"2024-09-17T02:59:32.784813+0000","last_undegraded":"2024-09-17T02:59:32.784813+0000","last_fullsized":"2024-09-17T02:59:32.784813+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:20.758081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798785+0000","last_change":"2024-09-17T02:59:31.800570+0000","last_active":"2024-09-17T02:59:32.798785+0000","last_peered":"2024-09-17T02:59:32.798785+0000","last_clean":"2024-09-17T02:59:32.798785+0000","last_became_active":"2024-09-17T02:59:31.799814+0000","last_became_peered":"2024-09-17T02:59:31.799814+0000","last_unstale":"2024-09-17T02:59:32.798785+0000","last_undegraded":"2024-09-17T02:59:32.798785+0000","last_fullsized":"2024-09-17T02:59:32.798785+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:11.288605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784668+0000","last_change":"2024-09-17T02:59:30.778763+0000","last_active":"2024-09-17T02:59:32.784668+0000","last_peered":"2024-09-17T02:59:32.784668+0000","last_clean":"2024-09-17T02:59:32.784668+0000","last_became_active":"2024-09-17T02:59:30.778425+0000","last_became_peered":"2024-09-17T02:59:30.778425+0000","last_unstale":"2024-09-17T02:59:32.784668+0000","last_undegraded":"2024-09-17T02:59:32.784668+0000","last_fullsized":"2024-09-17T02:59:32.784668+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:06.901030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799390+0000","last_change":"2024-09-17T02:59:31.788876+0000","last_active":"2024-09-17T02:59:32.799390+0000","last_peered":"2024-09-17T02:59:32.799390+0000","last_clean":"2024-09-17T02:59:32.799390+0000","last_became_active":"2024-09-17T02:59:31.788533+0000","last_became_peered":"2024-09-17T02:59:31.788533+0000","last_unstale":"2024-09-17T02:59:32.799390+0000","last_undegraded":"2024-09-17T02:59:32.799390+0000","last_fullsized":"2024-09-17T02:59:32.799390+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:05.963217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"102'3","reported_seq":18,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.786182+0000","last_change":"2024-09-17T02:59:30.774130+0000","last_active":"2024-09-17T02:59:32.786182+0000","last_peered":"2024-09-17T02:59:32.786182+0000","last_clean":"2024-09-17T02:59:32.786182+0000","last_became_active":"2024-09-17T02:59:30.773829+0000","last_became_peered":"2024-09-17T02:59:30.773829+0000","last_unstale":"2024-09-17T02:59:32.786182+0000","last_undegraded":"2024-09-17T02:59:32.786182+0000","last_fullsized":"2024-09-17T02:59:32.786182+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:32:33.690980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784605+0000","last_change":"2024-09-17T02:59:31.798305+0000","last_active":"2024-09-17T02:59:32.784605+0000","last_peered":"2024-09-17T02:59:32.784605+0000","last_clean":"2024-09-17T02:59:32.784605+0000","last_became_active":"2024-09-17T02:59:31.798020+0000","last_became_peered":"2024-09-17T02:59:31.798020+0000","last_unstale":"2024-09-17T02:59:32.784605+0000","last_undegraded":"2024-09-17T02:59:32.784605+0000","last_fullsized":"2024-09-17T02:59:32.784605+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:47.522836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"102'6","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798887+0000","last_change":"2024-09-17T02:59:30.774809+0000","last_active":"2024-09-17T02:59:32.798887+0000","last_peered":"2024-09-17T02:59:32.798887+0000","last_clean":"2024-09-17T02:59:32.798887+0000","last_became_active":"2024-09-17T02:59:30.774443+0000","last_became_peered":"2024-09-17T02:59:30.774443+0000","last_unstale":"2024-09-17T02:59:32.798887+0000","last_undegraded":"2024-09-17T02:59:32.798887+0000","last_fullsized":"2024-09-17T02:59:32.798887+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:27.379479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798638+0000","last_change":"2024-09-17T02:59:31.799020+0000","last_active":"2024-09-17T02:59:32.798638+0000","last_peered":"2024-09-17T02:59:32.798638+0000","last_clean":"2024-09-17T02:59:32.798638+0000","last_became_active":"2024-09-17T02:59:31.798659+0000","last_became_peered":"2024-09-17T02:59:31.798659+0000","last_unstale":"2024-09-17T02:59:32.798638+0000","last_undegraded":"2024-09-17T02:59:32.798638+0000","last_fullsized":"2024-09-17T02:59:32.798638+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:02.560476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"102'2","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799329+0000","last_change":"2024-09-17T02:59:30.776880+0000","last_active":"2024-09-17T02:59:32.799329+0000","last_peered":"2024-09-17T02:59:32.799329+0000","last_clean":"2024-09-17T02:59:32.799329+0000","last_became_active":"2024-09-17T02:59:30.776353+0000","last_became_peered":"2024-09-17T02:59:30.776353+0000","last_unstale":"2024-09-17T02:59:32.799329+0000","last_undegraded":"2024-09-17T02:59:32.799329+0000","last_fullsized":"2024-09-17T02:59:32.799329+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:52.309356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.783234+0000","last_change":"2024-09-17T02:59:31.788349+0000","last_active":"2024-09-17T02:59:32.783234+0000","last_peered":"2024-09-17T02:59:32.783234+0000","last_clean":"2024-09-17T02:59:32.783234+0000","last_became_active":"2024-09-17T02:59:31.787665+0000","last_became_peered":"2024-09-17T02:59:31.787665+0000","last_unstale":"2024-09-17T02:59:32.783234+0000","last_undegraded":"2024-09-17T02:59:32.783234+0000","last_fullsized":"2024-09-17T02:59:32.783234+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:42.050637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798823+0000","last_change":"2024-09-17T02:59:30.770755+0000","last_active":"2024-09-17T02:59:32.798823+0000","last_peered":"2024-09-17T02:59:32.798823+0000","last_clean":"2024-09-17T02:59:32.798823+0000","last_became_active":"2024-09-17T02:59:30.770479+0000","last_became_peered":"2024-09-17T02:59:30.770479+0000","last_unstale":"2024-09-17T02:59:32.798823+0000","last_undegraded":"2024-09-17T02:59:32.798823+0000","last_fullsized":"2024-09-17T02:59:32.798823+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:58.607815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801067+0000","last_change":"2024-09-17T02:59:31.786335+0000","last_active":"2024-09-17T02:59:32.801067+0000","last_peered":"2024-09-17T02:59:32.801067+0000","last_clean":"2024-09-17T02:59:32.801067+0000","last_became_active":"2024-09-17T02:59:31.785660+0000","last_became_peered":"2024-09-17T02:59:31.785660+0000","last_unstale":"2024-09-17T02:59:32.801067+0000","last_undegraded":"2024-09-17T02:59:32.801067+0000","last_fullsized":"2024-09-17T02:59:32.801067+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:58.447021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798947+0000","last_change":"2024-09-17T02:59:30.777012+0000","last_active":"2024-09-17T02:59:32.798947+0000","last_peered":"2024-09-17T02:59:32.798947+0000","last_clean":"2024-09-17T02:59:32.798947+0000","last_became_active":"2024-09-17T02:59:30.776717+0000","last_became_peered":"2024-09-17T02:59:30.776717+0000","last_unstale":"2024-09-17T02:59:32.798947+0000","last_undegraded":"2024-09-17T02:59:32.798947+0000","last_fullsized":"2024-09-17T02:59:32.798947+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:00.020455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801740+0000","last_change":"2024-09-17T02:59:31.795462+0000","last_active":"2024-09-17T02:59:32.801740+0000","last_peered":"2024-09-17T02:59:32.801740+0000","last_clean":"2024-09-17T02:59:32.801740+0000","last_became_active":"2024-09-17T02:59:31.792758+0000","last_became_peered":"2024-09-17T02:59:31.792758+0000","last_unstale":"2024-09-17T02:59:32.801740+0000","last_undegraded":"2024-09-17T02:59:32.801740+0000","last_fullsized":"2024-09-17T02:59:32.801740+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:16.768069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"102'8","reported_seq":23,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.800354+0000","last_change":"2024-09-17T02:59:30.776961+0000","last_active":"2024-09-17T02:59:32.800354+0000","last_peered":"2024-09-17T02:59:32.800354+0000","last_clean":"2024-09-17T02:59:32.800354+0000","last_became_active":"2024-09-17T02:59:30.776641+0000","last_became_peered":"2024-09-17T02:59:30.776641+0000","last_unstale":"2024-09-17T02:59:32.800354+0000","last_undegraded":"2024-09-17T02:59:32.800354+0000","last_fullsized":"2024-09-17T02:59:32.800354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:26.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.783831+0000","last_change":"2024-09-17T02:59:31.796281+0000","last_active":"2024-09-17T02:59:32.783831+0000","last_peered":"2024-09-17T02:59:32.783831+0000","last_clean":"2024-09-17T02:59:32.783831+0000","last_became_active":"2024-09-17T02:59:31.795981+0000","last_became_peered":"2024-09-17T02:59:31.795981+0000","last_unstale":"2024-09-17T02:59:32.783831+0000","last_undegraded":"2024-09-17T02:59:32.783831+0000","last_fullsized":"2024-09-17T02:59:32.783831+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:24.213636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784888+0000","last_change":"2024-09-17T02:59:30.771535+0000","last_active":"2024-09-17T02:59:32.784888+0000","last_peered":"2024-09-17T02:59:32.784888+0000","last_clean":"2024-09-17T02:59:32.784888+0000","last_became_active":"2024-09-17T02:59:30.771231+0000","last_became_peered":"2024-09-17T02:59:30.771231+0000","last_unstale":"2024-09-17T02:59:32.784888+0000","last_undegraded":"2024-09-17T02:59:32.784888+0000","last_fullsized":"2024-09-17T02:59:32.784888+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:49.300325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784620+0000","last_change":"2024-09-17T02:59:31.790399+0000","last_active":"2024-09-17T02:59:32.784620+0000","last_peered":"2024-09-17T02:59:32.784620+0000","last_clean":"2024-09-17T02:59:32.784620+0000","last_became_active":"2024-09-17T02:59:31.789485+0000","last_became_peered":"2024-09-17T02:59:31.789485+0000","last_unstale":"2024-09-17T02:59:32.784620+0000","last_undegraded":"2024-09-17T02:59:32.784620+0000","last_fullsized":"2024-09-17T02:59:32.784620+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:40.839638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"102'2","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801041+0000","last_change":"2024-09-17T02:59:30.778406+0000","last_active":"2024-09-17T02:59:32.801041+0000","last_peered":"2024-09-17T02:59:32.801041+0000","last_clean":"2024-09-17T02:59:32.801041+0000","last_became_active":"2024-09-17T02:59:30.778023+0000","last_became_peered":"2024-09-17T02:59:30.778023+0000","last_unstale":"2024-09-17T02:59:32.801041+0000","last_undegraded":"2024-09-17T02:59:32.801041+0000","last_fullsized":"2024-09-17T02:59:32.801041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:38.249112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785518+0000","last_change":"2024-09-17T02:59:31.798232+0000","last_active":"2024-09-17T02:59:32.785518+0000","last_peered":"2024-09-17T02:59:32.785518+0000","last_clean":"2024-09-17T02:59:32.785518+0000","last_became_active":"2024-09-17T02:59:31.796948+0000","last_became_peered":"2024-09-17T02:59:31.796948+0000","last_unstale":"2024-09-17T02:59:32.785518+0000","last_undegraded":"2024-09-17T02:59:32.785518+0000","last_fullsized":"2024-09-17T02:59:32.785518+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:09.522223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798296+0000","last_change":"2024-09-17T02:59:30.773650+0000","last_active":"2024-09-17T02:59:32.798296+0000","last_peered":"2024-09-17T02:59:32.798296+0000","last_clean":"2024-09-17T02:59:32.798296+0000","last_became_active":"2024-09-17T02:59:30.773409+0000","last_became_peered":"2024-09-17T02:59:30.773409+0000","last_unstale":"2024-09-17T02:59:32.798296+0000","last_undegraded":"2024-09-17T02:59:32.798296+0000","last_fullsized":"2024-09-17T02:59:32.798296+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:44.900101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799766+0000","last_change":"2024-09-17T02:59:31.794388+0000","last_active":"2024-09-17T02:59:32.799766+0000","last_peered":"2024-09-17T02:59:32.799766+0000","last_clean":"2024-09-17T02:59:32.799766+0000","last_became_active":"2024-09-17T02:59:31.793385+0000","last_became_peered":"2024-09-17T02:59:31.793385+0000","last_unstale":"2024-09-17T02:59:32.799766+0000","last_undegraded":"2024-09-17T02:59:32.799766+0000","last_fullsized":"2024-09-17T02:59:32.799766+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:27.602950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"102'2","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799250+0000","last_change":"2024-09-17T02:59:30.779136+0000","last_active":"2024-09-17T02:59:32.799250+0000","last_peered":"2024-09-17T02:59:32.799250+0000","last_clean":"2024-09-17T02:59:32.799250+0000","last_became_active":"2024-09-17T02:59:30.778832+0000","last_became_peered":"2024-09-17T02:59:30.778832+0000","last_unstale":"2024-09-17T02:59:32.799250+0000","last_undegraded":"2024-09-17T02:59:32.799250+0000","last_fullsized":"2024-09-17T02:59:32.799250+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:52.903480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798841+0000","last_change":"2024-09-17T02:59:31.793719+0000","last_active":"2024-09-17T02:59:32.798841+0000","last_peered":"2024-09-17T02:59:32.798841+0000","last_clean":"2024-09-17T02:59:32.798841+0000","last_became_active":"2024-09-17T02:59:31.793445+0000","last_became_peered":"2024-09-17T02:59:31.793445+0000","last_unstale":"2024-09-17T02:59:32.798841+0000","last_undegraded":"2024-09-17T02:59:32.798841+0000","last_fullsized":"2024-09-17T02:59:32.798841+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:37.806696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.800000+0000","last_change":"2024-09-17T02:59:30.776068+0000","last_active":"2024-09-17T02:59:32.800000+0000","last_peered":"2024-09-17T02:59:32.800000+0000","last_clean":"2024-09-17T02:59:32.800000+0000","last_became_active":"2024-09-17T02:59:30.775809+0000","last_became_peered":"2024-09-17T02:59:30.775809+0000","last_unstale":"2024-09-17T02:59:32.800000+0000","last_undegraded":"2024-09-17T02:59:32.800000+0000","last_fullsized":"2024-09-17T02:59:32.800000+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:06.146273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798048+0000","last_change":"2024-09-17T02:59:31.798481+0000","last_active":"2024-09-17T02:59:32.798048+0000","last_peered":"2024-09-17T02:59:32.798048+0000","last_clean":"2024-09-17T02:59:32.798048+0000","last_became_active":"2024-09-17T02:59:31.798097+0000","last_became_peered":"2024-09-17T02:59:31.798097+0000","last_unstale":"2024-09-17T02:59:32.798048+0000","last_undegraded":"2024-09-17T02:59:32.798048+0000","last_fullsized":"2024-09-17T02:59:32.798048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:09.647590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799505+0000","last_change":"2024-09-17T02:59:30.773128+0000","last_active":"2024-09-17T02:59:32.799505+0000","last_peered":"2024-09-17T02:59:32.799505+0000","last_clean":"2024-09-17T02:59:32.799505+0000","last_became_active":"2024-09-17T02:59:30.772857+0000","last_became_peered":"2024-09-17T02:59:30.772857+0000","last_unstale":"2024-09-17T02:59:32.799505+0000","last_undegraded":"2024-09-17T02:59:32.799505+0000","last_fullsized":"2024-09-17T02:59:32.799505+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:16.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798612+0000","last_change":"2024-09-17T02:59:31.799401+0000","last_active":"2024-09-17T02:59:32.798612+0000","last_peered":"2024-09-17T02:59:32.798612+0000","last_clean":"2024-09-17T02:59:32.798612+0000","last_became_active":"2024-09-17T02:59:31.799099+0000","last_became_peered":"2024-09-17T02:59:31.799099+0000","last_unstale":"2024-09-17T02:59:32.798612+0000","last_undegraded":"2024-09-17T02:59:32.798612+0000","last_fullsized":"2024-09-17T02:59:32.798612+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:02.339204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798925+0000","last_change":"2024-09-17T02:59:30.774353+0000","last_active":"2024-09-17T02:59:32.798925+0000","last_peered":"2024-09-17T02:59:32.798925+0000","last_clean":"2024-09-17T02:59:32.798925+0000","last_became_active":"2024-09-17T02:59:30.774048+0000","last_became_peered":"2024-09-17T02:59:30.774048+0000","last_unstale":"2024-09-17T02:59:32.798925+0000","last_undegraded":"2024-09-17T02:59:32.798925+0000","last_fullsized":"2024-09-17T02:59:32.798925+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:37.989570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784882+0000","last_change":"2024-09-17T02:59:31.795552+0000","last_active":"2024-09-17T02:59:32.784882+0000","last_peered":"2024-09-17T02:59:32.784882+0000","last_clean":"2024-09-17T02:59:32.784882+0000","last_became_active":"2024-09-17T02:59:31.795288+0000","last_became_peered":"2024-09-17T02:59:31.795288+0000","last_unstale":"2024-09-17T02:59:32.784882+0000","last_undegraded":"2024-09-17T02:59:32.784882+0000","last_fullsized":"2024-09-17T02:59:32.784882+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:35.045209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"102'2","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.802051+0000","last_change":"2024-09-17T02:59:30.769448+0000","last_active":"2024-09-17T02:59:32.802051+0000","last_peered":"2024-09-17T02:59:32.802051+0000","last_clean":"2024-09-17T02:59:32.802051+0000","last_became_active":"2024-09-17T02:59:30.769161+0000","last_became_peered":"2024-09-17T02:59:30.769161+0000","last_unstale":"2024-09-17T02:59:32.802051+0000","last_undegraded":"2024-09-17T02:59:32.802051+0000","last_fullsized":"2024-09-17T02:59:32.802051+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:52.931670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.782449+0000","last_change":"2024-09-17T02:59:31.789824+0000","last_active":"2024-09-17T02:59:32.782449+0000","last_peered":"2024-09-17T02:59:32.782449+0000","last_clean":"2024-09-17T02:59:32.782449+0000","last_became_active":"2024-09-17T02:59:31.789566+0000","last_became_peered":"2024-09-17T02:59:31.789566+0000","last_unstale":"2024-09-17T02:59:32.782449+0000","last_undegraded":"2024-09-17T02:59:32.782449+0000","last_fullsized":"2024-09-17T02:59:32.782449+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:42:04.767837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"103'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801514+0000","last_change":"2024-09-17T02:59:30.772398+0000","last_active":"2024-09-17T02:59:32.801514+0000","last_peered":"2024-09-17T02:59:32.801514+0000","last_clean":"2024-09-17T02:59:32.801514+0000","last_became_active":"2024-09-17T02:59:30.772121+0000","last_became_peered":"2024-09-17T02:59:30.772121+0000","last_unstale":"2024-09-17T02:59:32.801514+0000","last_undegraded":"2024-09-17T02:59:32.801514+0000","last_fullsized":"2024-09-17T02:59:32.801514+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:09.918600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784594+0000","last_change":"2024-09-17T02:59:31.789435+0000","last_active":"2024-09-17T02:59:32.784594+0000","last_peered":"2024-09-17T02:59:32.784594+0000","last_clean":"2024-09-17T02:59:32.784594+0000","last_became_active":"2024-09-17T02:59:31.789141+0000","last_became_peered":"2024-09-17T02:59:31.789141+0000","last_unstale":"2024-09-17T02:59:32.784594+0000","last_undegraded":"2024-09-17T02:59:32.784594+0000","last_fullsized":"2024-09-17T02:59:32.784594+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:29.395521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.785001+0000","last_change":"2024-09-17T02:59:30.778774+0000","last_active":"2024-09-17T02:59:32.785001+0000","last_peered":"2024-09-17T02:59:32.785001+0000","last_clean":"2024-09-17T02:59:32.785001+0000","last_became_active":"2024-09-17T02:59:30.776595+0000","last_became_peered":"2024-09-17T02:59:30.776595+0000","last_unstale":"2024-09-17T02:59:32.785001+0000","last_undegraded":"2024-09-17T02:59:32.785001+0000","last_fullsized":"2024-09-17T02:59:32.785001+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:23.054929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.783609+0000","last_change":"2024-09-17T02:59:31.792286+0000","last_active":"2024-09-17T02:59:32.783609+0000","last_peered":"2024-09-17T02:59:32.783609+0000","last_clean":"2024-09-17T02:59:32.783609+0000","last_became_active":"2024-09-17T02:59:31.791229+0000","last_became_peered":"2024-09-17T02:59:31.791229+0000","last_unstale":"2024-09-17T02:59:32.783609+0000","last_undegraded":"2024-09-17T02:59:32.783609+0000","last_fullsized":"2024-09-17T02:59:32.783609+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:36.574186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784807+0000","last_change":"2024-09-17T02:59:30.770863+0000","last_active":"2024-09-17T02:59:32.784807+0000","last_peered":"2024-09-17T02:59:32.784807+0000","last_clean":"2024-09-17T02:59:32.784807+0000","last_became_active":"2024-09-17T02:59:30.770422+0000","last_became_peered":"2024-09-17T02:59:30.770422+0000","last_unstale":"2024-09-17T02:59:32.784807+0000","last_undegraded":"2024-09-17T02:59:32.784807+0000","last_fullsized":"2024-09-17T02:59:32.784807+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:30.384410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798702+0000","last_change":"2024-09-17T02:59:31.796443+0000","last_active":"2024-09-17T02:59:32.798702+0000","last_peered":"2024-09-17T02:59:32.798702+0000","last_clean":"2024-09-17T02:59:32.798702+0000","last_became_active":"2024-09-17T02:59:31.796062+0000","last_became_peered":"2024-09-17T02:59:31.796062+0000","last_unstale":"2024-09-17T02:59:32.798702+0000","last_undegraded":"2024-09-17T02:59:32.798702+0000","last_fullsized":"2024-09-17T02:59:32.798702+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:39.669419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.799132+0000","last_change":"2024-09-17T02:59:30.776358+0000","last_active":"2024-09-17T02:59:32.799132+0000","last_peered":"2024-09-17T02:59:32.799132+0000","last_clean":"2024-09-17T02:59:32.799132+0000","last_became_active":"2024-09-17T02:59:30.776058+0000","last_became_peered":"2024-09-17T02:59:30.776058+0000","last_unstale":"2024-09-17T02:59:32.799132+0000","last_undegraded":"2024-09-17T02:59:32.799132+0000","last_fullsized":"2024-09-17T02:59:32.799132+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:52.689008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.798858+0000","last_change":"2024-09-17T02:59:31.800057+0000","last_active":"2024-09-17T02:59:32.798858+0000","last_peered":"2024-09-17T02:59:32.798858+0000","last_clean":"2024-09-17T02:59:32.798858+0000","last_became_active":"2024-09-17T02:59:31.799572+0000","last_became_peered":"2024-09-17T02:59:31.799572+0000","last_unstale":"2024-09-17T02:59:32.798858+0000","last_undegraded":"2024-09-17T02:59:32.798858+0000","last_fullsized":"2024-09-17T02:59:32.798858+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:56.304645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.786650+0000","last_change":"2024-09-17T02:59:30.780170+0000","last_active":"2024-09-17T02:59:32.786650+0000","last_peered":"2024-09-17T02:59:32.786650+0000","last_clean":"2024-09-17T02:59:32.786650+0000","last_became_active":"2024-09-17T02:59:30.779554+0000","last_became_peered":"2024-09-17T02:59:30.779554+0000","last_unstale":"2024-09-17T02:59:32.786650+0000","last_undegraded":"2024-09-17T02:59:32.786650+0000","last_fullsized":"2024-09-17T02:59:32.786650+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:07:54.416460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.782501+0000","last_change":"2024-09-17T02:59:31.792720+0000","last_active":"2024-09-17T02:59:32.782501+0000","last_peered":"2024-09-17T02:59:32.782501+0000","last_clean":"2024-09-17T02:59:32.782501+0000","last_became_active":"2024-09-17T02:59:31.792261+0000","last_became_peered":"2024-09-17T02:59:31.792261+0000","last_unstale":"2024-09-17T02:59:32.782501+0000","last_undegraded":"2024-09-17T02:59:32.782501+0000","last_fullsized":"2024-09-17T02:59:32.782501+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:39.312366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.786283+0000","last_change":"2024-09-17T02:59:30.775937+0000","last_active":"2024-09-17T02:59:32.786283+0000","last_peered":"2024-09-17T02:59:32.786283+0000","last_clean":"2024-09-17T02:59:32.786283+0000","last_became_active":"2024-09-17T02:59:30.775233+0000","last_became_peered":"2024-09-17T02:59:30.775233+0000","last_unstale":"2024-09-17T02:59:32.786283+0000","last_undegraded":"2024-09-17T02:59:32.786283+0000","last_fullsized":"2024-09-17T02:59:32.786283+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:36.912798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.786038+0000","last_change":"2024-09-17T02:59:31.790876+0000","last_active":"2024-09-17T02:59:32.786038+0000","last_peered":"2024-09-17T02:59:32.786038+0000","last_clean":"2024-09-17T02:59:32.786038+0000","last_became_active":"2024-09-17T02:59:31.790502+0000","last_became_peered":"2024-09-17T02:59:31.790502+0000","last_unstale":"2024-09-17T02:59:32.786038+0000","last_undegraded":"2024-09-17T02:59:32.786038+0000","last_fullsized":"2024-09-17T02:59:32.786038+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:12.446304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.784234+0000","last_change":"2024-09-17T02:59:30.780334+0000","last_active":"2024-09-17T02:59:32.784234+0000","last_peered":"2024-09-17T02:59:32.784234+0000","last_clean":"2024-09-17T02:59:32.784234+0000","last_became_active":"2024-09-17T02:59:30.780082+0000","last_became_peered":"2024-09-17T02:59:30.780082+0000","last_unstale":"2024-09-17T02:59:32.784234+0000","last_undegraded":"2024-09-17T02:59:32.784234+0000","last_fullsized":"2024-09-17T02:59:32.784234+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:31.164287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.801954+0000","last_change":"2024-09-17T02:59:31.797080+0000","last_active":"2024-09-17T02:59:32.801954+0000","last_peered":"2024-09-17T02:59:32.801954+0000","last_clean":"2024-09-17T02:59:32.801954+0000","last_became_active":"2024-09-17T02:59:31.796773+0000","last_became_peered":"2024-09-17T02:59:31.796773+0000","last_unstale":"2024-09-17T02:59:32.801954+0000","last_undegraded":"2024-09-17T02:59:32.801954+0000","last_fullsized":"2024-09-17T02:59:32.801954+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:30.762055+0000","last_clean_scrub_stamp":"2024-09-17T02:59:30.762055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:01.893303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"102'1","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.783488+0000","last_change":"2024-09-17T02:59:30.768062+0000","last_active":"2024-09-17T02:59:32.783488+0000","last_peered":"2024-09-17T02:59:32.783488+0000","last_clean":"2024-09-17T02:59:32.783488+0000","last_became_active":"2024-09-17T02:59:30.767771+0000","last_became_peered":"2024-09-17T02:59:30.767771+0000","last_unstale":"2024-09-17T02:59:32.783488+0000","last_undegraded":"2024-09-17T02:59:32.783488+0000","last_fullsized":"2024-09-17T02:59:32.783488+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:59:29.755833+0000","last_clean_scrub_stamp":"2024-09-17T02:59:29.755833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:46.605490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":276,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-17T02:59:32.782748+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T02:59:32.782748+0000","last_peered":"2024-09-17T02:59:32.782748+0000","last_clean":"2024-09-17T02:59:32.782748+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T02:59:32.782748+0000","last_undegraded":"2024-09-17T02:59:32.782748+0000","last_fullsized":"2024-09-17T02:59:32.782748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:51.183978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1119,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194192,"statfs":{"total":200000000,"available":198853582,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194768,"statfs":{"total":200000000,"available":199443326,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":544,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194767,"statfs":{"total":200000000,"available":199442386,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":542,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194769,"statfs":{"total":200000000,"available":199444020,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":544,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194767,"statfs":{"total":200000000,"available":199442408,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194768,"statfs":{"total":200000000,"available":199443438,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":543,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194769,"statfs":{"total":200000000,"available":199443826,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1119,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194192,"statfs":{"total":200000000,"available":198853618,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T02:59:39.616 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T02:59:39.616 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T02:59:39.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.773+0000 7f8110158640 1 -- 172.21.15.104:0/2967994454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81080b7c80 msgr2=0x7f81080b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:39.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.773+0000 7f8110158640 1 --2- 172.21.15.104:0/2967994454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81080b7c80 0x7f81080b20f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f80fc005fd0 tx=0x7f80fc02a540 comp rx=0 tx=0).stop 2024-09-17T02:59:39.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.773+0000 7f8110158640 1 -- 172.21.15.104:0/2967994454 shutdown_connections 2024-09-17T02:59:39.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.773+0000 7f8110158640 1 --2- 172.21.15.104:0/2967994454 >> v2:172.21.15.192:3300/0 conn(0x7f81080b2630 0x7f81080b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.773+0000 7f8110158640 1 --2- 172.21.15.104:0/2967994454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81080b7c80 0x7f81080b20f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.773+0000 7f8110158640 1 -- 172.21.15.104:0/2967994454 >> 172.21.15.104:0/2967994454 conn(0x7f81080d2970 msgr2=0x7f81080d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:39.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.773+0000 7f8110158640 1 -- 172.21.15.104:0/2967994454 shutdown_connections 2024-09-17T02:59:39.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.773+0000 7f8110158640 1 -- 172.21.15.104:0/2967994454 wait complete. 2024-09-17T02:59:39.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.774+0000 7f8110158640 1 Processor -- start 2024-09-17T02:59:39.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.774+0000 7f8110158640 1 -- start start 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f8110158640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81080b2630 0x7f81081f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f8110158640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81080b7c80 0x7f810815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f8110158640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81080d3490 0x7f8108160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f8110158640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f81080b6bd0 con 0x7f81080d3490 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f8110158640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f81080b6a50 con 0x7f81080b7c80 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f8110158640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f81080b6d50 con 0x7f81080b2630 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81080d3490 0x7f8108160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81080d3490 0x7f8108160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43382/0 (socket says 172.21.15.104:43382) 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 -- 172.21.15.104:0/903931184 learned_addr learned my addr 172.21.15.104:0/903931184 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:39.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810def4640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81080b2630 0x7f81081f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810d6f3640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81080b7c80 0x7f810815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 -- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81080b2630 msgr2=0x7f81081f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81080b2630 0x7f81081f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 -- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81080b7c80 msgr2=0x7f810815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81080b7c80 0x7f810815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 -- 172.21.15.104:0/903931184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81081f4400 con 0x7f81080d3490 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.776+0000 7f810e6f5640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81080d3490 0x7f8108160140 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f810000e6d0 tx=0x7f810000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.777+0000 7f81067fc640 1 -- 172.21.15.104:0/903931184 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810000cab0 con 0x7f81080d3490 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.777+0000 7f81067fc640 1 -- 172.21.15.104:0/903931184 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f810000cc50 con 0x7f81080d3490 2024-09-17T02:59:39.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.777+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81081f46e0 con 0x7f81080d3490 2024-09-17T02:59:39.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.777+0000 7f81067fc640 1 -- 172.21.15.104:0/903931184 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100005280 con 0x7f81080d3490 2024-09-17T02:59:39.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.777+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81080c9940 con 0x7f81080d3490 2024-09-17T02:59:39.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.778+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81080b2a40 con 0x7f81080d3490 2024-09-17T02:59:39.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.779+0000 7f81067fc640 1 -- 172.21.15.104:0/903931184 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8100005420 con 0x7f81080d3490 2024-09-17T02:59:39.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.779+0000 7f81067fc640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f80f4078b90 0x7f80f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:39.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.779+0000 7f81067fc640 1 -- 172.21.15.104:0/903931184 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f810009b4b0 con 0x7f81080d3490 2024-09-17T02:59:39.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.779+0000 7f810def4640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f80f4078b90 0x7f80f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:39.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.780+0000 7f810def4640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f80f4078b90 0x7f80f407b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f80f8001e20 tx=0x7f80f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:39.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:39.783+0000 7f81067fc640 1 -- 172.21.15.104:0/903931184 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f810000ce20 con 0x7f81080d3490 2024-09-17T02:59:40.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.029+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f81080c9250 con 0x7f81080d3490 2024-09-17T02:59:40.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.032+0000 7f81067fc640 1 -- 172.21.15.104:0/903931184 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) ==== 190+0+147 (secure 0 0 0) 0x7f8100063330 con 0x7f81080d3490 2024-09-17T02:59:40.032 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T02:59:40.032 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T02:59:40.032 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T02:59:40.032 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T02:59:40.032 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T02:59:40.032 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T02:59:40.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.034+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f80f4078b90 msgr2=0x7f80f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.034+0000 7f8110158640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f80f4078b90 0x7f80f407b0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f80f8001e20 tx=0x7f80f8009040 comp rx=0 tx=0).stop 2024-09-17T02:59:40.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.034+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81080d3490 msgr2=0x7f8108160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.034+0000 7f8110158640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81080d3490 0x7f8108160140 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f810000e6d0 tx=0x7f810000eb90 comp rx=0 tx=0).stop 2024-09-17T02:59:40.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.035+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 shutdown_connections 2024-09-17T02:59:40.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.035+0000 7f8110158640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f80f4078b90 0x7f80f407b0a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.035+0000 7f8110158640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81080b7c80 0x7f810815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.035+0000 7f8110158640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f81080d3490 0x7f8108160140 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.035+0000 7f8110158640 1 --2- 172.21.15.104:0/903931184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81080b2630 0x7f81081f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.035+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 >> 172.21.15.104:0/903931184 conn(0x7f81080d2970 msgr2=0x7f81080b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.035+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 shutdown_connections 2024-09-17T02:59:40.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.035+0000 7f8110158640 1 -- 172.21.15.104:0/903931184 wait complete. 2024-09-17T02:59:40.045 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:40.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.158+0000 7f29e61e4640 1 -- 172.21.15.104:0/59054257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e015f1f0 msgr2=0x7f29e015f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.158+0000 7f29e61e4640 1 --2- 172.21.15.104:0/59054257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e015f1f0 0x7f29e015f600 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009830 tx=0x7f29c802a480 comp rx=0 tx=0).stop 2024-09-17T02:59:40.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.158+0000 7f29e61e4640 1 -- 172.21.15.104:0/59054257 shutdown_connections 2024-09-17T02:59:40.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.158+0000 7f29e61e4640 1 --2- 172.21.15.104:0/59054257 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e015f1f0 0x7f29e015f600 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.158+0000 7f29e61e4640 1 --2- 172.21.15.104:0/59054257 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29e00b65e0 0x7f29e00b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.158+0000 7f29e61e4640 1 -- 172.21.15.104:0/59054257 >> 172.21.15.104:0/59054257 conn(0x7f29e0069120 msgr2=0x7f29e0069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.158+0000 7f29e61e4640 1 -- 172.21.15.104:0/59054257 shutdown_connections 2024-09-17T02:59:40.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.158+0000 7f29e61e4640 1 -- 172.21.15.104:0/59054257 wait complete. 2024-09-17T02:59:40.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.160+0000 7f29e61e4640 1 Processor -- start 2024-09-17T02:59:40.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.160+0000 7f29e61e4640 1 -- start start 2024-09-17T02:59:40.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29e61e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e00b65e0 0x7f29e01540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29e61e4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29e015f1f0 0x7f29e00cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29e61e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29e015fb40 0x7f29e00ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29e61e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f29e0163490 con 0x7f29e00b65e0 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29e61e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29e01625a0 con 0x7f29e015fb40 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29e61e4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f29e0163610 con 0x7f29e015f1f0 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29df7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e00b65e0 0x7f29e01540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29df7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e00b65e0 0x7f29e01540f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43402/0 (socket says 172.21.15.104:43402) 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29df7fe640 1 -- 172.21.15.104:0/2382518630 learned_addr learned my addr 172.21.15.104:0/2382518630 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29d7fff640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29e015f1f0 0x7f29e00cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29dffff640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29e015fb40 0x7f29e00ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29df7fe640 1 -- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29e015f1f0 msgr2=0x7f29e00cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29df7fe640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29e015f1f0 0x7f29e00cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29df7fe640 1 -- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29e015fb40 msgr2=0x7f29e00ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29df7fe640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29e015fb40 0x7f29e00ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.161+0000 7f29df7fe640 1 -- 172.21.15.104:0/2382518630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e01f5e40 con 0x7f29e00b65e0 2024-09-17T02:59:40.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.162+0000 7f29df7fe640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e00b65e0 0x7f29e01540f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c970 tx=0x7f29d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:40.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.162+0000 7f29dcff9640 1 -- 172.21.15.104:0/2382518630 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0007b50 con 0x7f29e00b65e0 2024-09-17T02:59:40.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.162+0000 7f29dcff9640 1 -- 172.21.15.104:0/2382518630 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29d0007de0 con 0x7f29e00b65e0 2024-09-17T02:59:40.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.162+0000 7f29dcff9640 1 -- 172.21.15.104:0/2382518630 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d000f6b0 con 0x7f29e00b65e0 2024-09-17T02:59:40.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.162+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e01f60c0 con 0x7f29e00b65e0 2024-09-17T02:59:40.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.162+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e01f6680 con 0x7f29e00b65e0 2024-09-17T02:59:40.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.163+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e0163b30 con 0x7f29e00b65e0 2024-09-17T02:59:40.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.163+0000 7f29dcff9640 1 -- 172.21.15.104:0/2382518630 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29d000f850 con 0x7f29e00b65e0 2024-09-17T02:59:40.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.164+0000 7f29dcff9640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29c0078b90 0x7f29c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.164+0000 7f29dcff9640 1 -- 172.21.15.104:0/2382518630 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f29d009b420 con 0x7f29e00b65e0 2024-09-17T02:59:40.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.164+0000 7f29d7fff640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29c0078b90 0x7f29c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.165+0000 7f29d7fff640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29c0078b90 0x7f29c007b0a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f29c8034000 tx=0x7f29c8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:40.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.168+0000 7f29dcff9640 1 -- 172.21.15.104:0/2382518630 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29e01f5e40 con 0x7f29e00b65e0 2024-09-17T02:59:40.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.380+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29e00d1f80 con 0x7f29e00b65e0 2024-09-17T02:59:40.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.380+0000 7f29dcff9640 1 -- 172.21.15.104:0/2382518630 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7f29d0014030 con 0x7f29e00b65e0 2024-09-17T02:59:40.380 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:40.380 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T02:59:40.380 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T02:59:40.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.382+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29c0078b90 msgr2=0x7f29c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.382+0000 7f29e61e4640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29c0078b90 0x7f29c007b0a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f29c8034000 tx=0x7f29c8004730 comp rx=0 tx=0).stop 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.382+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e00b65e0 msgr2=0x7f29e01540f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.382+0000 7f29e61e4640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e00b65e0 0x7f29e01540f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c970 tx=0x7f29d000ce30 comp rx=0 tx=0).stop 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.383+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 shutdown_connections 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.383+0000 7f29e61e4640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29c0078b90 0x7f29c007b0a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.383+0000 7f29e61e4640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29e015fb40 0x7f29e00ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.383+0000 7f29e61e4640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29e015f1f0 0x7f29e00cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.383+0000 7f29e61e4640 1 --2- 172.21.15.104:0/2382518630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29e00b65e0 0x7f29e01540f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.383+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 >> 172.21.15.104:0/2382518630 conn(0x7f29e0069120 msgr2=0x7f29e00d23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.383+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 shutdown_connections 2024-09-17T02:59:40.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.383+0000 7f29e61e4640 1 -- 172.21.15.104:0/2382518630 wait complete. 2024-09-17T02:59:40.797 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T02:59:31.126864+0000', 'modified': '2024-09-17T02:59:33.150043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6282': {'gid': 6282, 'name': 'c', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.104:6834/515764261', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6832', 'nonce': 515764261}, {'type': 'v1', 'addr': '172.21.15.104:6834', 'nonce': 515764261}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6282, 'qdb_cluster': [6282]} 2024-09-17T02:59:40.797 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T02:59:40.797 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T02:59:40.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.913+0000 7f65d807e640 1 -- 172.21.15.104:0/1919244062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d00cff70 msgr2=0x7f65d015b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.913+0000 7f65d807e640 1 --2- 172.21.15.104:0/1919244062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d00cff70 0x7f65d015b170 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009830 tx=0x7f65c802a510 comp rx=0 tx=0).stop 2024-09-17T02:59:40.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.913+0000 7f65d807e640 1 -- 172.21.15.104:0/1919244062 shutdown_connections 2024-09-17T02:59:40.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.913+0000 7f65d807e640 1 --2- 172.21.15.104:0/1919244062 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d00cff70 0x7f65d015b170 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.913+0000 7f65d807e640 1 -- 172.21.15.104:0/1919244062 >> 172.21.15.104:0/1919244062 conn(0x7f65d00b2450 msgr2=0x7f65d00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.913+0000 7f65d807e640 1 -- 172.21.15.104:0/1919244062 shutdown_connections 2024-09-17T02:59:40.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.913+0000 7f65d807e640 1 -- 172.21.15.104:0/1919244062 wait complete. 2024-09-17T02:59:40.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.915+0000 7f65d807e640 1 Processor -- start 2024-09-17T02:59:40.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.915+0000 7f65d807e640 1 -- start start 2024-09-17T02:59:40.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d807e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65d006f840 0x7f65d01f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d807e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d0073540 0x7f65d00abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d807e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65d00cff70 0x7f65d00b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d807e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f65d00d0570 con 0x7f65d0073540 2024-09-17T02:59:40.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d807e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65d006fe60 con 0x7f65d00cff70 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d807e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f65d00b3e60 con 0x7f65d006f840 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d5619640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d0073540 0x7f65d00abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d5619640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d0073540 0x7f65d00abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43434/0 (socket says 172.21.15.104:43434) 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d5619640 1 -- 172.21.15.104:0/3326832442 learned_addr learned my addr 172.21.15.104:0/3326832442 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65d006f840 0x7f65d01f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.916+0000 7f65d661b640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65d00cff70 0x7f65d00b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65d5619640 1 -- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65d006f840 msgr2=0x7f65d01f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65d5619640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65d006f840 0x7f65d01f7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65d5619640 1 -- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65d00cff70 msgr2=0x7f65d00b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65d5619640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65d00cff70 0x7f65d00b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65d5619640 1 -- 172.21.15.104:0/3326832442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d01f3f60 con 0x7f65d0073540 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65d5619640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d0073540 0x7f65d00abb80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f65c400b3c0 tx=0x7f65c400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:40.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65ce7fc640 1 -- 172.21.15.104:0/3326832442 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011830 con 0x7f65d0073540 2024-09-17T02:59:40.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65ce7fc640 1 -- 172.21.15.104:0/3326832442 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c4016070 con 0x7f65d0073540 2024-09-17T02:59:40.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65d807e640 1 -- 172.21.15.104:0/3326832442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d0158620 con 0x7f65d0073540 2024-09-17T02:59:40.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65ce7fc640 1 -- 172.21.15.104:0/3326832442 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011d40 con 0x7f65d0073540 2024-09-17T02:59:40.919 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.917+0000 7f65d807e640 1 -- 172.21.15.104:0/3326832442 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d01f4500 con 0x7f65d0073540 2024-09-17T02:59:40.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.919+0000 7f65ce7fc640 1 -- 172.21.15.104:0/3326832442 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f65c4004020 con 0x7f65d0073540 2024-09-17T02:59:40.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.919+0000 7f65ce7fc640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f65bc078bc0 0x7f65bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.919+0000 7f65ce7fc640 1 -- 172.21.15.104:0/3326832442 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f65c409a660 con 0x7f65d0073540 2024-09-17T02:59:40.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.920+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f65bc078bc0 0x7f65bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.920+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f65bc078bc0 0x7f65bc07b0d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f65c8034000 tx=0x7f65c8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:40.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.920+0000 7f65defe6740 1 Processor -- start 2024-09-17T02:59:40.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.920+0000 7f65defe6740 1 -- start start 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.921+0000 7f65defe6740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a2efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.921+0000 7f65defe6740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e7886343b0 0x55e788a2f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65defe6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e78863c590 0x55e788a4c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65defe6740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e788977820 con 0x55e78865d270 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65defe6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e788966c50 con 0x55e78863c590 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65defe6740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55e78896aa60 con 0x55e7886343b0 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a2efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a2efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43436/0 (socket says 172.21.15.104:43436) 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 -- 172.21.15.104:0/2228393972 learned_addr learned my addr 172.21.15.104:0/2228393972 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:40.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5619640 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e7886343b0 0x55e788a2f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d661b640 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e78863c590 0x55e788a4c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 -- 172.21.15.104:0/2228393972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e7886343b0 msgr2=0x55e788a2f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e7886343b0 0x55e788a2f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 -- 172.21.15.104:0/2228393972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e78863c590 msgr2=0x55e788a4c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e78863c590 0x55e788a4c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 -- 172.21.15.104:0/2228393972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7886c8850 con 0x55e78865d270 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a2efa0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009780 tx=0x7f65c803e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752d66d41abff5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65b77fe640 1 -- 172.21.15.104:0/2228393972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8047420 con 0x55e78865d270 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65b77fe640 1 -- 172.21.15.104:0/2228393972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c80476d0 con 0x55e78865d270 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.922+0000 7f65b77fe640 1 -- 172.21.15.104:0/2228393972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8047b20 con 0x55e78865d270 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 -- 172.21.15.104:0/2228393972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 msgr2=0x55e788a2efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a2efa0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009780 tx=0x7f65c803e070 comp rx=0 tx=0).stop 2024-09-17T02:59:40.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 -- 172.21.15.104:0/2228393972 shutdown_connections 2024-09-17T02:59:40.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e78863c590 0x55e788a4c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e7886343b0 0x55e788a2f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 --2- 172.21.15.104:0/2228393972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a2efa0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 -- 172.21.15.104:0/2228393972 >> 172.21.15.104:0/2228393972 conn(0x55e7886513c0 msgr2=0x55e788a05260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 -- 172.21.15.104:0/2228393972 shutdown_connections 2024-09-17T02:59:40.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.923+0000 7f65defe6740 1 -- 172.21.15.104:0/2228393972 wait complete. 2024-09-17T02:59:40.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.924+0000 7f65defe6740 1 -- start start 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.924+0000 7f65defe6740 1 Processor -- start 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65defe6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e788a0b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65defe6740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788a0db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65defe6740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a0e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65defe6740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e7886d7620 con 0x55e78865d270 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65defe6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e78890c5f0 con 0x55e7886343b0 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65defe6740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55e788a2fa20 con 0x55e78863c590 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65defe6740 10 client.0 _ll_register_callbacks cb 0x55e7889100a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a0e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a0e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43442/0 (socket says 172.21.15.104:43442) 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 -- 172.21.15.104:0/3558161201 learned_addr learned my addr 172.21.15.104:0/3558161201 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e788a0b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d5619640 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788a0db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 -- 172.21.15.104:0/3558161201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 msgr2=0x55e788a0db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788a0db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 -- 172.21.15.104:0/3558161201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 msgr2=0x55e788a0b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e788a0b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 -- 172.21.15.104:0/3558161201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e78873f6b0 con 0x55e78865d270 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65d661b640 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a0e080 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f65c0012d50 tx=0x7f65c0010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4abc90fc18e6734 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.926+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3558161201 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c001a070 con 0x55e78865d270 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3558161201 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f65c0001ec0 con 0x55e78865d270 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 1 -- 172.21.15.104:0/3558161201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65c80476d0 con 0x55e78865d270 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3558161201 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f65c0025050 con 0x55e78865d270 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 10 client.6444 fetch_fsmap learned FSMap version 42 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 1 -- 172.21.15.104:0/3558161201 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x55e788a59d30 con 0x55e78865d270 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3558161201 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c80476d0 con 0x55e78865d270 2024-09-17T02:59:40.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3558161201 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 42) ==== 3502+0+0 (secure 0 0 0) 0x7f65c0028020 con 0x55e78865d270 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 10 client.6444 fetch_fsmap finished waiting for FSMap version 42 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 10 client.6444 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 20 client.6444 populate_metadata read hostname 'smithi104' 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] conn(0x55e78861be40 0x55e788a4d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 4 client.6444 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65defe6740 1 -- 172.21.15.104:0/3558161201 --> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e788979770 con 0x55e78861be40 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.927+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] conn(0x55e78861be40 0x55e788a4d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65b4ff9640 10 client.6444 ms_handle_connect on v2:172.21.15.104:6832/515764261 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] conn(0x55e78861be40 0x55e788a4d200 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adba3577013218ca server_cookie=50eb0ee02c904659 in_seq=0 out_seq=0 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3558161201 <== mds.0 v2:172.21.15.104:6832/515764261 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e788979770 con 0x55e78861be40 2024-09-17T02:59:40.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65b4ff9640 10 client.6444 handle_command_reply: tid=0 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 client.6444 shutdown 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 -- 172.21.15.104:0/3558161201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 msgr2=0x55e788a0e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a0e080 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f65c0012d50 tx=0x7f65c0010610 comp rx=0 tx=0).stop 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 -- 172.21.15.104:0/3558161201 shutdown_connections 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] conn(0x55e78861be40 0x55e788a4d200 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a0e080 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788a0db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65b4ff9640 0 client.6444 ms_handle_reset on v2:172.21.15.104:6832/515764261 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 --2- 172.21.15.104:0/3558161201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e788a0b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.928+0000 7f65defe6740 1 -- 172.21.15.104:0/3558161201 >> 172.21.15.104:0/3558161201 conn(0x55e7886513c0 msgr2=0x55e788a4b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.929+0000 7f65defe6740 1 -- 172.21.15.104:0/3558161201 shutdown_connections 2024-09-17T02:59:40.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.929+0000 7f65defe6740 1 -- 172.21.15.104:0/3558161201 wait complete. 2024-09-17T02:59:40.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.929+0000 7f65defe6740 20 client.6444 trim_cache size 0 max 16384 2024-09-17T02:59:40.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.947+0000 7f65defe6740 1 Processor -- start 2024-09-17T02:59:40.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.947+0000 7f65defe6740 1 -- start start 2024-09-17T02:59:40.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65defe6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e788a1ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65defe6740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788a28080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65defe6740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a285c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65defe6740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f65d0155a30 con 0x55e78865d270 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65defe6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65d0154d90 con 0x55e7886343b0 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65defe6740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f65d01553e0 con 0x55e78863c590 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65d661b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65d661b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a285c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43450/0 (socket says 172.21.15.104:43450) 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.948+0000 7f65d661b640 1 -- 172.21.15.104:0/3465579552 learned_addr learned my addr 172.21.15.104:0/3465579552 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65d5619640 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788a28080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e788a1ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65d661b640 1 -- 172.21.15.104:0/3465579552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 msgr2=0x55e788a28080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65d661b640 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788a28080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65d661b640 1 -- 172.21.15.104:0/3465579552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 msgr2=0x55e788a1ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65d661b640 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e788a1ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.950 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65d661b640 1 -- 172.21.15.104:0/3465579552 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e788a1e410 con 0x55e78865d270 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65d661b640 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a285c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f65c0012a40 tx=0x7f65c001f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efba9359c559afc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65b6ffd640 1 -- 172.21.15.104:0/3465579552 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c001a050 con 0x55e78865d270 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65b6ffd640 1 -- 172.21.15.104:0/3465579552 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c0004a00 con 0x55e78865d270 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.949+0000 7f65b6ffd640 1 -- 172.21.15.104:0/3465579552 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0004e50 con 0x55e78865d270 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 -- 172.21.15.104:0/3465579552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 msgr2=0x55e788a285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a285c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f65c0012a40 tx=0x7f65c001f490 comp rx=0 tx=0).stop 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 -- 172.21.15.104:0/3465579552 shutdown_connections 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e788a285c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788a28080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 --2- 172.21.15.104:0/3465579552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e788a1ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 -- 172.21.15.104:0/3465579552 >> 172.21.15.104:0/3465579552 conn(0x55e7886513c0 msgr2=0x55e788a26d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 -- 172.21.15.104:0/3465579552 shutdown_connections 2024-09-17T02:59:40.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.950+0000 7f65defe6740 1 -- 172.21.15.104:0/3465579552 wait complete. 2024-09-17T02:59:40.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.951+0000 7f65defe6740 1 -- start start 2024-09-17T02:59:40.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.951+0000 7f65defe6740 1 Processor -- start 2024-09-17T02:59:40.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65defe6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e7889febf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65defe6740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788accad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65defe6740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e7889fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65defe6740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55e788a1ecb0 con 0x55e78865d270 2024-09-17T02:59:40.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65defe6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e788a1e810 con 0x55e7886343b0 2024-09-17T02:59:40.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65defe6740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55e788a43290 con 0x55e78863c590 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65defe6740 10 client.0 _ll_register_callbacks cb 0x7f65c0001e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d661b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e7889fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d661b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e7889fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43454/0 (socket says 172.21.15.104:43454) 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d661b640 1 -- 172.21.15.104:0/3064174088 learned_addr learned my addr 172.21.15.104:0/3064174088 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e7889febf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d5619640 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788accad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d661b640 1 -- 172.21.15.104:0/3064174088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 msgr2=0x55e788accad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d661b640 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788accad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d661b640 1 -- 172.21.15.104:0/3064174088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 msgr2=0x55e7889febf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d661b640 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e7889febf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.952+0000 7f65d661b640 1 -- 172.21.15.104:0/3064174088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e788a289b0 con 0x55e78865d270 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65d661b640 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e7889fe290 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f65c0012d20 tx=0x7f65c0004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421eaeaa5040c58f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:40.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3064174088 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0038060 con 0x55e78865d270 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3064174088 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f65c0001ec0 con 0x55e78865d270 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 1 -- 172.21.15.104:0/3064174088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65c0004a00 con 0x55e78865d270 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3064174088 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f65c003e050 con 0x55e78865d270 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 10 client.6450 fetch_fsmap learned FSMap version 42 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 1 -- 172.21.15.104:0/3064174088 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x55e788a6e410 con 0x55e78865d270 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3064174088 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65c0004a00 con 0x55e78865d270 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3064174088 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 42) ==== 3502+0+0 (secure 0 0 0) 0x7f65c0041020 con 0x55e78865d270 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 10 client.6450 fetch_fsmap finished waiting for FSMap version 42 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 10 client.6450 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 20 client.6450 populate_metadata read hostname 'smithi104' 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] conn(0x55e788a25c30 0x55e788a6c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 4 client.6450 mds_command: new command op to 6282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T02:59:40.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65defe6740 1 -- 172.21.15.104:0/3064174088 --> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] -- command(tid 0: {"prefix": "status"}) -- 0x55e788975220 con 0x55e788a25c30 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.953+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] conn(0x55e788a25c30 0x55e788a6c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65b4ff9640 10 client.6450 ms_handle_connect on v2:172.21.15.104:6832/515764261 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65d5e1a640 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] conn(0x55e788a25c30 0x55e788a6c9a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2d37acde91f950 server_cookie=25f1de0f3c8c878e in_seq=0 out_seq=0 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65b4ff9640 1 -- 172.21.15.104:0/3064174088 <== mds.0 v2:172.21.15.104:6832/515764261 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e788975220 con 0x55e788a25c30 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65b4ff9640 10 client.6450 handle_command_reply: tid=0 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 client.6450 shutdown 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 -- 172.21.15.104:0/3064174088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 msgr2=0x55e7889fe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e7889fe290 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f65c0012d20 tx=0x7f65c0004f90 comp rx=0 tx=0).stop 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 -- 172.21.15.104:0/3064174088 shutdown_connections 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.104:6832/515764261,v1:172.21.15.104:6834/515764261] conn(0x55e788a25c30 0x55e788a6c9a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55e78865d270 0x55e7889fe290 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65b4ff9640 0 client.6450 ms_handle_reset on v2:172.21.15.104:6832/515764261 2024-09-17T02:59:40.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55e78863c590 0x55e788accad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 --2- 172.21.15.104:0/3064174088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e7886343b0 0x55e7889febf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 -- 172.21.15.104:0/3064174088 >> 172.21.15.104:0/3064174088 conn(0x55e7886513c0 msgr2=0x55e788a28050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 -- 172.21.15.104:0/3064174088 shutdown_connections 2024-09-17T02:59:40.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 1 -- 172.21.15.104:0/3064174088 wait complete. 2024-09-17T02:59:40.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.954+0000 7f65defe6740 20 client.6450 trim_cache size 0 max 16384 2024-09-17T02:59:40.960 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 6282, 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.1631272859999999, 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 42, 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 103, 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 103, 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 21.097295053 2024-09-17T02:59:40.961 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 -- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f65bc078bc0 msgr2=0x7f65bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f65bc078bc0 0x7f65bc07b0d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f65c8034000 tx=0x7f65c8004730 comp rx=0 tx=0).stop 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 -- 172.21.15.104:0/3326832442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d0073540 msgr2=0x7f65d00abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d0073540 0x7f65d00abb80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f65c400b3c0 tx=0x7f65c400b880 comp rx=0 tx=0).stop 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 -- 172.21.15.104:0/3326832442 shutdown_connections 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f65bc078bc0 0x7f65bc07b0d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65d00cff70 0x7f65d00b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f65d0073540 0x7f65d00abb80 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 --2- 172.21.15.104:0/3326832442 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65d006f840 0x7f65d01f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 -- 172.21.15.104:0/3326832442 >> 172.21.15.104:0/3326832442 conn(0x7f65d00b2450 msgr2=0x7f65d00afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 -- 172.21.15.104:0/3326832442 shutdown_connections 2024-09-17T02:59:40.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:40.955+0000 7f65d807e640 1 -- 172.21.15.104:0/3326832442 wait complete. 2024-09-17T02:59:40.966 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:59:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.077+0000 7f136aa9b640 1 -- 172.21.15.104:0/1773452891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f134c003c10 msgr2=0x7f134c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.077+0000 7f136aa9b640 1 --2- 172.21.15.104:0/1773452891 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f134c003c10 0x7f134c004060 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1360009b50 tx=0x7f134c005830 comp rx=0 tx=0).stop 2024-09-17T02:59:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.077+0000 7f1369038640 1 -- 172.21.15.104:0/1773452891 reap_dead start 2024-09-17T02:59:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.077+0000 7f136aa9b640 1 -- 172.21.15.104:0/1773452891 shutdown_connections 2024-09-17T02:59:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.077+0000 7f136aa9b640 1 -- 172.21.15.104:0/1773452891 >> 172.21.15.104:0/1773452891 conn(0x7f13640b2450 msgr2=0x7f13640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.077+0000 7f136aa9b640 1 -- 172.21.15.104:0/1773452891 shutdown_connections 2024-09-17T02:59:41.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.077+0000 7f136aa9b640 1 -- 172.21.15.104:0/1773452891 wait complete. 2024-09-17T02:59:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.079+0000 7f136aa9b640 1 Processor -- start 2024-09-17T02:59:41.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.079+0000 7f136aa9b640 1 -- start start 2024-09-17T02:59:41.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f136aa9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f134c003c10 0x7f13641f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:41.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f136aa9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1364150310 0x7f1364150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:41.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f136aa9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13641557a0 0x7f1364155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:41.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f136aa9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f13640ce990 con 0x7f13641557a0 2024-09-17T02:59:41.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f136aa9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f136415bef0 con 0x7f134c003c10 2024-09-17T02:59:41.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f136aa9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f13640ceb10 con 0x7f1364150310 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f1369038640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13641557a0 0x7f1364155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f1369038640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13641557a0 0x7f1364155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43468/0 (socket says 172.21.15.104:43468) 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f1369038640 1 -- 172.21.15.104:0/3940529799 learned_addr learned my addr 172.21.15.104:0/3940529799 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f135bfff640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1364150310 0x7f1364150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.080+0000 7f1368837640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f134c003c10 0x7f13641f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f1369038640 1 -- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1364150310 msgr2=0x7f1364150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f1369038640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1364150310 0x7f1364150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f1369038640 1 -- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f134c003c10 msgr2=0x7f13641f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f1369038640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f134c003c10 0x7f13641f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f1369038640 1 -- 172.21.15.104:0/3940529799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13641560f0 con 0x7f13641557a0 2024-09-17T02:59:41.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f1369038640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13641557a0 0x7f1364155bb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1364071f20 tx=0x7f135c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:41.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f13597fa640 1 -- 172.21.15.104:0/3940529799 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c010890 con 0x7f13641557a0 2024-09-17T02:59:41.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f13597fa640 1 -- 172.21.15.104:0/3940529799 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f135c018070 con 0x7f13641557a0 2024-09-17T02:59:41.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13641f3bb0 con 0x7f13641557a0 2024-09-17T02:59:41.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f13597fa640 1 -- 172.21.15.104:0/3940529799 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c010dc0 con 0x7f13641557a0 2024-09-17T02:59:41.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.081+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13641f4170 con 0x7f13641557a0 2024-09-17T02:59:41.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.082+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1364150c60 con 0x7f13641557a0 2024-09-17T02:59:41.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.083+0000 7f13597fa640 1 -- 172.21.15.104:0/3940529799 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f135c01d460 con 0x7f13641557a0 2024-09-17T02:59:41.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.083+0000 7f13597fa640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1350078b90 0x7f135007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:41.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.083+0000 7f13597fa640 1 -- 172.21.15.104:0/3940529799 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f135c09b560 con 0x7f13641557a0 2024-09-17T02:59:41.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.084+0000 7f1368837640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1350078b90 0x7f135007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:41.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.084+0000 7f1368837640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1350078b90 0x7f135007b0a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1360035000 tx=0x7f136002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:41.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.087+0000 7f13597fa640 1 -- 172.21.15.104:0/3940529799 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1364150c60 con 0x7f13641557a0 2024-09-17T02:59:41.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.293+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f13640cf0a0 con 0x7f13641557a0 2024-09-17T02:59:41.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.294+0000 7f13597fa640 1 -- 172.21.15.104:0/3940529799 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) ==== 53+0+73 (secure 0 0 0) 0x7f13640cf0a0 con 0x7f13641557a0 2024-09-17T02:59:41.293 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:59:41.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1350078b90 msgr2=0x7f135007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:41.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1350078b90 0x7f135007b0a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1360035000 tx=0x7f136002d040 comp rx=0 tx=0).stop 2024-09-17T02:59:41.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13641557a0 msgr2=0x7f1364155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:41.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13641557a0 0x7f1364155bb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1364071f20 tx=0x7f135c00ea10 comp rx=0 tx=0).stop 2024-09-17T02:59:41.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 shutdown_connections 2024-09-17T02:59:41.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1350078b90 0x7f135007b0a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:41.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f13641557a0 0x7f1364155bb0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:41.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1364150310 0x7f1364150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:41.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 --2- 172.21.15.104:0/3940529799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f134c003c10 0x7f13641f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:41.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 >> 172.21.15.104:0/3940529799 conn(0x7f13640b2450 msgr2=0x7f13640b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:41.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 shutdown_connections 2024-09-17T02:59:41.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41.296+0000 7f136aa9b640 1 -- 172.21.15.104:0/3940529799 wait complete. 2024-09-17T02:59:41.307 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:59:41.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:59:41.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T02:59:41.307 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T02:59:41.307 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T02:59:41.307 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:59:41.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:59:41.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:59:41.308 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:59:41.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:41.308 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T02:59:41.324 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:59:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:59:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:59:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T02:59:41.324 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42518sec preferred_lft 42518sec 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T02:59:41.325 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T02:59:41.326 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T02:59:41.327 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:41.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:41.327 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:59:41.388 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T02:59:41.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:41.389 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T02:59:41.445 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T02:59:41.445 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:59:41.445 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:59:41.446 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:59:41.446 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:59:41.446 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:59:41.446 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T02:59:41.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:59:41.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:59:41.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:59:41.446 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T02:59:41.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:59:41.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:59:41.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:41.571 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T02:59:41.586 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T02:59:41.586 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T02:59:41.586 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:59:41.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:41.587 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T02:59:41.651 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:59:41.651 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T02:59:41.706 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T02:59:41.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:59:41.707 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:59:41.762 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:59:41.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:41.762 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:59:41.858 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:59:41.858 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:59:41.858 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:59:41.869 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:59:41.869 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:59:41.869 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:59:41.869 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:59:41.869 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:59:41.874 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T02:59:41.874 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T02:59:41.874 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T02:59:41.874 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:59:41.875 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:59:41.875 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:59:41.875 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:59:41.875 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:59:41.875 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T02:59:41.875 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:59:41.875 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:59:41.875 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:59:41.876 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:59:41.877 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:59:41.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:41.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T02:59:41.902 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:59:41.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:59:41.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:59:42.003 INFO:teuthology.orchestra.run.smithi104.stdout:client6088 2024-09-17T02:59:42.003 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:42.003 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:42.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T02:59:42.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.172+0000 7f643c084640 1 -- 172.21.15.104:0/4009409577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 msgr2=0x7f6420004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:42.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.172+0000 7f643c084640 1 --2- 172.21.15.104:0/4009409577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 0x7f6420004c10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6424009b20 tx=0x7f6420005830 comp rx=0 tx=0).stop 2024-09-17T02:59:42.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.172+0000 7f643c084640 1 -- 172.21.15.104:0/4009409577 shutdown_connections 2024-09-17T02:59:42.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.172+0000 7f643c084640 1 --2- 172.21.15.104:0/4009409577 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 0x7f6420004c10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:42.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.172+0000 7f643c084640 1 -- 172.21.15.104:0/4009409577 >> 172.21.15.104:0/4009409577 conn(0x7f64340b44a0 msgr2=0x7f64340b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:42.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.173+0000 7f643c084640 1 -- 172.21.15.104:0/4009409577 shutdown_connections 2024-09-17T02:59:42.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.173+0000 7f643c084640 1 -- 172.21.15.104:0/4009409577 wait complete. 2024-09-17T02:59:42.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.174+0000 7f643c084640 1 Processor -- start 2024-09-17T02:59:42.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.174+0000 7f643c084640 1 -- start start 2024-09-17T02:59:42.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643c084640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 0x7f64340cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643c084640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64341f4920 0x7f6434153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643c084640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64340c9900 0x7f64340b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643c084640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64340b39c0 con 0x7f6420004800 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643c084640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64340b5a40 con 0x7f64340c9900 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643c084640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f64340b3b40 con 0x7f64341f4920 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 0x7f64340cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 0x7f64340cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43490/0 (socket says 172.21.15.104:43490) 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 -- 172.21.15.104:0/1567075166 learned_addr learned my addr 172.21.15.104:0/1567075166 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643a621640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64340c9900 0x7f64340b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643961f640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64341f4920 0x7f6434153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:42.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 -- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64341f4920 msgr2=0x7f6434153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64341f4920 0x7f6434153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 -- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64340c9900 msgr2=0x7f64340b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64340c9900 0x7f64340b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 -- 172.21.15.104:0/1567075166 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64340cca80 con 0x7f6420004800 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643961f640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64341f4920 0x7f6434153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f6439e20640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 0x7f64340cc230 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6430000f60 tx=0x7f643000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f642a7fc640 1 -- 172.21.15.104:0/1567075166 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430004500 con 0x7f6420004800 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f642a7fc640 1 -- 172.21.15.104:0/1567075166 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6430016070 con 0x7f6420004800 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64341f3e40 con 0x7f6420004800 2024-09-17T02:59:42.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f642a7fc640 1 -- 172.21.15.104:0/1567075166 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430003980 con 0x7f6420004800 2024-09-17T02:59:42.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.176+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64341f4400 con 0x7f6420004800 2024-09-17T02:59:42.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.177+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64340b40a0 con 0x7f6420004800 2024-09-17T02:59:42.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.178+0000 7f642a7fc640 1 -- 172.21.15.104:0/1567075166 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6430003b20 con 0x7f6420004800 2024-09-17T02:59:42.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.179+0000 7f642a7fc640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6418078b90 0x7f641807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:42.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.179+0000 7f642a7fc640 1 -- 172.21.15.104:0/1567075166 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f643009b2c0 con 0x7f6420004800 2024-09-17T02:59:42.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.179+0000 7f643961f640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6418078b90 0x7f641807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:42.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.180+0000 7f643961f640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6418078b90 0x7f641807b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6424035000 tx=0x7f642402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:42.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.183+0000 7f642a7fc640 1 -- 172.21.15.104:0/1567075166 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6430063700 con 0x7f6420004800 2024-09-17T02:59:42.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.392+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f64340cead0 con 0x7f6420004800 2024-09-17T02:59:42.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.392+0000 7f642a7fc640 1 -- 172.21.15.104:0/1567075166 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) ==== 53+0+73 (secure 0 0 0) 0x7f6430063000 con 0x7f6420004800 2024-09-17T02:59:42.392 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T02:59:42.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6418078b90 msgr2=0x7f641807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:42.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6418078b90 0x7f641807b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6424035000 tx=0x7f642402d040 comp rx=0 tx=0).stop 2024-09-17T02:59:42.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 msgr2=0x7f64340cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:42.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 0x7f64340cc230 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6430000f60 tx=0x7f643000eaf0 comp rx=0 tx=0).stop 2024-09-17T02:59:42.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 shutdown_connections 2024-09-17T02:59:42.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6418078b90 0x7f641807b0a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:42.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64340c9900 0x7f64340b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:42.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64341f4920 0x7f6434153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:42.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 --2- 172.21.15.104:0/1567075166 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6420004800 0x7f64340cc230 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:42.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 >> 172.21.15.104:0/1567075166 conn(0x7f64340b44a0 msgr2=0x7f643415d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:42.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 shutdown_connections 2024-09-17T02:59:42.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:42.394+0000 7f643c084640 1 -- 172.21.15.104:0/1567075166 wait complete. 2024-09-17T02:59:42.405 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T02:59:42.405 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T02:59:42.405 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T02:59:42.405 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T02:59:42.405 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T02:59:42.405 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T02:59:42.405 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T02:59:42.406 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T02:59:42.406 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:59:42.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:42.406 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T02:59:42.426 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T02:59:42.426 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T02:59:42.426 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T02:59:42.426 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:42.426 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T02:59:42.426 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:42.426 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:59:42.426 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42512sec preferred_lft 42512sec 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T02:59:42.427 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T02:59:42.428 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T02:59:42.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:42.429 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T02:59:42.495 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T02:59:42.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:42.497 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T02:59:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T02:59:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T02:59:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T02:59:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T02:59:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T02:59:42.556 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T02:59:42.556 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T02:59:42.556 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T02:59:42.556 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T02:59:42.556 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T02:59:42.556 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T02:59:42.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:59:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T02:59:42.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:59:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:59:42.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:42.687 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T02:59:42.702 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T02:59:42.702 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T02:59:42.702 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:59:42.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:42.702 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T02:59:42.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:59:42.769 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T02:59:42.824 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T02:59:42.824 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T02:59:42.824 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:59:42.879 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T02:59:42.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:42.879 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:59:42.973 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:59:42.974 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:59:42.974 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:59:42.985 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:59:42.985 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:59:42.985 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:59:42.985 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:59:42.985 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:59:42.991 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T02:59:42.991 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T02:59:42.991 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T02:59:42.991 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T02:59:42.992 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T02:59:42.992 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T02:59:42.992 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T02:59:42.992 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T02:59:42.992 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T02:59:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T02:59:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T02:59:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T02:59:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T02:59:42.994 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T02:59:42.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:42.994 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T02:59:43.018 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T02:59:43.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:59:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T02:59:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T02:59:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T02:59:43.113 INFO:teuthology.orchestra.run.smithi192.stdout:client6465 2024-09-17T02:59:43.114 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T02:59:43.114 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:43.129 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 -- 172.21.15.104:0/1303697705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea40b0500 msgr2=0x7f5ea40b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/1303697705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea40b0500 0x7f5ea40b0910 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4074020 tx=0x7f5e9c02aa30 comp rx=0 tx=0).stop 2024-09-17T02:59:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 -- 172.21.15.104:0/1303697705 shutdown_connections 2024-09-17T02:59:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/1303697705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea40b0500 0x7f5ea40b0910 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/1303697705 >> v2:172.21.15.192:3300/0 conn(0x7f5ea40734f0 0x7f5ea4073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/1303697705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ea415c220 0x7f5ea406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 -- 172.21.15.104:0/1303697705 >> 172.21.15.104:0/1303697705 conn(0x7f5ea406d200 msgr2=0x7f5ea406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:43.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 -- 172.21.15.104:0/1303697705 shutdown_connections 2024-09-17T02:59:43.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.251+0000 7f5eaa80a640 1 -- 172.21.15.104:0/1303697705 wait complete. 2024-09-17T02:59:43.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.253+0000 7f5eaa80a640 1 Processor -- start 2024-09-17T02:59:43.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.253+0000 7f5eaa80a640 1 -- start start 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5eaa80a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ea40734f0 0x7f5ea4155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5eaa80a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ea40b0500 0x7f5ea41f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5eaa80a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea415c220 0x7f5ea41f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5eaa80a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40b11e0 con 0x7f5ea415c220 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5eaa80a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40b1060 con 0x7f5ea40b0500 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5eaa80a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea415f6f0 con 0x7f5ea40734f0 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5ea8da7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea415c220 0x7f5ea41f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5ea8da7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea415c220 0x7f5ea41f7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:43502/0 (socket says 172.21.15.104:43502) 2024-09-17T02:59:43.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5ea3fff640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ea40734f0 0x7f5ea4155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5ea8da7640 1 -- 172.21.15.104:0/4027384738 learned_addr learned my addr 172.21.15.104:0/4027384738 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.254+0000 7f5ea37fe640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ea40b0500 0x7f5ea41f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea8da7640 1 -- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ea40734f0 msgr2=0x7f5ea4155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea8da7640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ea40734f0 0x7f5ea4155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea8da7640 1 -- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ea40b0500 msgr2=0x7f5ea41f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea8da7640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ea40b0500 0x7f5ea41f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea8da7640 1 -- 172.21.15.104:0/4027384738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea4151c00 con 0x7f5ea415c220 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea8da7640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea415c220 0x7f5ea41f7c90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c02b020 tx=0x7f5e9c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea0ff9640 1 -- 172.21.15.104:0/4027384738 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c033050 con 0x7f5ea415c220 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea0ff9640 1 -- 172.21.15.104:0/4027384738 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e9c004450 con 0x7f5ea415c220 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea4150e40 con 0x7f5ea415c220 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5ea0ff9640 1 -- 172.21.15.104:0/4027384738 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c004840 con 0x7f5ea415c220 2024-09-17T02:59:43.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.255+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea4151400 con 0x7f5ea415c220 2024-09-17T02:59:43.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.256+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea40b0910 con 0x7f5ea415c220 2024-09-17T02:59:43.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.257+0000 7f5ea0ff9640 1 -- 172.21.15.104:0/4027384738 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e9c036070 con 0x7f5ea415c220 2024-09-17T02:59:43.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.257+0000 7f5ea0ff9640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e90078bc0 0x7f5e9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:43.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.257+0000 7f5ea0ff9640 1 -- 172.21.15.104:0/4027384738 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f5e9c0bc1b0 con 0x7f5ea415c220 2024-09-17T02:59:43.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.257+0000 7f5ea3fff640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e90078bc0 0x7f5e9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:43.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.258+0000 7f5ea3fff640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e90078bc0 0x7f5e9007b0d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400bb50 tx=0x7f5e9400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:43.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.262+0000 7f5ea0ff9640 1 -- 172.21.15.104:0/4027384738 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e9c083fa0 con 0x7f5ea415c220 2024-09-17T02:59:43.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.470+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ea4070810 con 0x7f5ea415c220 2024-09-17T02:59:43.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.471+0000 7f5ea0ff9640 1 -- 172.21.15.104:0/4027384738 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7f5e9c0889d0 con 0x7f5ea415c220 2024-09-17T02:59:43.470 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:43.471 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T02:59:43.471 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T02:59:43.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e90078bc0 msgr2=0x7f5e9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:43.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e90078bc0 0x7f5e9007b0d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400bb50 tx=0x7f5e9400b2e0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea415c220 msgr2=0x7f5ea41f7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:43.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea415c220 0x7f5ea41f7c90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c02b020 tx=0x7f5e9c003f10 comp rx=0 tx=0).stop 2024-09-17T02:59:43.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 shutdown_connections 2024-09-17T02:59:43.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e90078bc0 0x7f5e9007b0d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ea40b0500 0x7f5ea41f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5ea415c220 0x7f5ea41f7c90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 --2- 172.21.15.104:0/4027384738 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5ea40734f0 0x7f5ea4155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:43.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 >> 172.21.15.104:0/4027384738 conn(0x7f5ea406d200 msgr2=0x7f5ea40cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:43.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 shutdown_connections 2024-09-17T02:59:43.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:43.473+0000 7f5eaa80a640 1 -- 172.21.15.104:0/4027384738 wait complete. 2024-09-17T02:59:43.484 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T02:59:43.608 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":6282,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.808091669,"mdsmap_epoch":42,"osdmap_epoch":103,"osdmap_epoch_barrier":103,"uptime":23.742265148000001} 2024-09-17T02:59:43.608 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 6282, "mdsmap_epoch": 42, "osdmap_epoch": 103, "osdmap_epoch_barrier": 103, "rank_uptime": 11.808091669, "state": "up:active", "uptime": 23.742265148, "want_state": "up:active", "whoami": 0 } 2024-09-17T02:59:43.608 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-17T02:59:43.727 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_mon_report_interval":"5"} 2024-09-17T02:59:43.728 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-17T02:59:43.728 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-17T02:59:43.728 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:43.728 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:43.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:43.744 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-17T02:59:44.681 INFO:teuthology.orchestra.run.smithi104.stderr:265+0 records in 2024-09-17T02:59:44.681 INFO:teuthology.orchestra.run.smithi104.stderr:265+0 records out 2024-09-17T02:59:44.681 INFO:teuthology.orchestra.run.smithi104.stderr:277872640 bytes (278 MB, 265 MiB) copied, 0.878036 s, 316 MB/s 2024-09-17T02:59:44.682 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:44.682 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:44.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:44.698 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-17T02:59:45.745 INFO:teuthology.orchestra.run.smithi104.stderr:292+0 records in 2024-09-17T02:59:45.746 INFO:teuthology.orchestra.run.smithi104.stderr:292+0 records out 2024-09-17T02:59:45.746 INFO:teuthology.orchestra.run.smithi104.stderr:306184192 bytes (306 MB, 292 MiB) copied, 0.991595 s, 309 MB/s 2024-09-17T02:59:45.746 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-17T02:59:45.746 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:59:45.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.860+0000 7f939f7ad640 1 -- 172.21.15.104:0/3305940066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93980cff70 msgr2=0x7f939815b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:45.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.860+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3305940066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93980cff70 0x7f939815b170 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9394005fd0 tx=0x7f939402a540 comp rx=0 tx=0).stop 2024-09-17T02:59:45.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.860+0000 7f939f7ad640 1 -- 172.21.15.104:0/3305940066 shutdown_connections 2024-09-17T02:59:45.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.860+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3305940066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9398073540 0x7f93980b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:45.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.860+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3305940066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93980cff70 0x7f939815b170 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:45.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.860+0000 7f939f7ad640 1 -- 172.21.15.104:0/3305940066 >> 172.21.15.104:0/3305940066 conn(0x7f93980b2450 msgr2=0x7f93980b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:45.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.860+0000 7f939f7ad640 1 -- 172.21.15.104:0/3305940066 shutdown_connections 2024-09-17T02:59:45.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.860+0000 7f939f7ad640 1 -- 172.21.15.104:0/3305940066 wait complete. 2024-09-17T02:59:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.862+0000 7f939f7ad640 1 Processor -- start 2024-09-17T02:59:45.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.862+0000 7f939f7ad640 1 -- start start 2024-09-17T02:59:45.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939f7ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939806f840 0x7f9398142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:45.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939f7ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9398073540 0x7f939813fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939f7ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980cff70 0x7f9398167050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939f7ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f93980b3c90 con 0x7f93980cff70 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939f7ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f939806fe90 con 0x7f939806f840 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939f7ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f93980b3e10 con 0x7f9398073540 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939dd4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980cff70 0x7f9398167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939dd4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980cff70 0x7f9398167050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55344/0 (socket says 172.21.15.104:55344) 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939dd4a640 1 -- 172.21.15.104:0/3038093801 learned_addr learned my addr 172.21.15.104:0/3038093801 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939d549640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939806f840 0x7f9398142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939cd48640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9398073540 0x7f939813fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939dd4a640 1 -- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9398073540 msgr2=0x7f939813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939dd4a640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9398073540 0x7f939813fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939dd4a640 1 -- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939806f840 msgr2=0x7f9398142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939dd4a640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939806f840 0x7f9398142fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.863+0000 7f939dd4a640 1 -- 172.21.15.104:0/3038093801 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93981434e0 con 0x7f93980cff70 2024-09-17T02:59:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.864+0000 7f939dd4a640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980cff70 0x7f9398167050 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f939000ec20 tx=0x7f939000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.864+0000 7f938dffb640 1 -- 172.21.15.104:0/3038093801 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390003b70 con 0x7f93980cff70 2024-09-17T02:59:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.864+0000 7f938dffb640 1 -- 172.21.15.104:0/3038093801 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9390003d10 con 0x7f93980cff70 2024-09-17T02:59:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.864+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9398154c00 con 0x7f93980cff70 2024-09-17T02:59:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.864+0000 7f938dffb640 1 -- 172.21.15.104:0/3038093801 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390004280 con 0x7f93980cff70 2024-09-17T02:59:45.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.864+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93981551c0 con 0x7f93980cff70 2024-09-17T02:59:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.865+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9398154970 con 0x7f93980cff70 2024-09-17T02:59:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.866+0000 7f938dffb640 1 -- 172.21.15.104:0/3038093801 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9390004420 con 0x7f93980cff70 2024-09-17T02:59:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.866+0000 7f938dffb640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f937c078bc0 0x7f937c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.867+0000 7f938dffb640 1 -- 172.21.15.104:0/3038093801 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f939009b890 con 0x7f93980cff70 2024-09-17T02:59:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.867+0000 7f939d549640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f937c078bc0 0x7f937c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.867+0000 7f939d549640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f937c078bc0 0x7f937c07b0d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9394033000 tx=0x7f9394004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:45.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:45.871+0000 7f938dffb640 1 -- 172.21.15.104:0/3038093801 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9390063680 con 0x7f93980cff70 2024-09-17T02:59:46.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.046+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f93980b3750 con 0x7f93980cff70 2024-09-17T02:59:46.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.047+0000 7f938dffb640 1 -- 172.21.15.104:0/3038093801 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) ==== 81+0+34310 (secure 0 0 0) 0x7f93900680b0 con 0x7f93980cff70 2024-09-17T02:59:46.047 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:46.047 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 103, 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:59:32.779595+0000", 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:59:46.048 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:59:46.049 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 13, 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:59:46.050 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:46.051 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:46.052 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:46.052 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:46.052 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:59:46.052 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:59:46.052 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:59:46.052 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:59:46.052 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.053 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "94", 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:46.054 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:46.055 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:46.056 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:59:46.057 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 12, 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:28.780702+0000", 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:46.059 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:59:46.060 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "102", 2024-09-17T02:59:46.061 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:46.062 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:46.063 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:46.064 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:46.065 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.066 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 13, 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:30.098469+0000", 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:46.067 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:59:46.068 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "103", 2024-09-17T02:59:46.069 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:46.070 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:46.071 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:46.072 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:46.073 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:46.074 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:46.075 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.076 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.077 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:46.078 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.079 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.080 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:59:46.080 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:46.080 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.080 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.080 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:46.080 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.081 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.081 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:59:46.081 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:46.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.081 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:59:46.082 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:46.083 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.086 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:46.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.088 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:59:46.089 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:46.090 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.092 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.093 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:59:46.094 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.095 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.097 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:46.098 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:59:46.100 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:46.103 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.104 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.104 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:59:46.104 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:59:46.104 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:59:46.104 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:46.105 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.106 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.108 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:59:46.109 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:59:46.110 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:59:46.111 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:46.112 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:46.113 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:46.113 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:46.113 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:46.113 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:46.113 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:46.113 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:46.113 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:46.155 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:46.155 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.155 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.156 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.157 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:59:46.158 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:46.159 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:46.160 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:46.161 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.162 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.163 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.164 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.165 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.166 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:46.167 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.168 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.170 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:46.171 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:46.172 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:46.173 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:46.174 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.175 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:46.176 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:46.177 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:46.178 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:59:46.179 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:59:46.180 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:59:46.181 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:59:46.181 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:46.181 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.049+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f937c078bc0 msgr2=0x7f937c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.049+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f937c078bc0 0x7f937c07b0d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9394033000 tx=0x7f9394004730 comp rx=0 tx=0).stop 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.049+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980cff70 msgr2=0x7f9398167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.049+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980cff70 0x7f9398167050 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f939000ec20 tx=0x7f939000c6a0 comp rx=0 tx=0).stop 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.050+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 shutdown_connections 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.050+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f937c078bc0 0x7f937c07b0d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.050+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93980cff70 0x7f9398167050 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.050+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9398073540 0x7f939813fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.050+0000 7f939f7ad640 1 --2- 172.21.15.104:0/3038093801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f939806f840 0x7f9398142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.050+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 >> 172.21.15.104:0/3038093801 conn(0x7f93980b2450 msgr2=0x7f93980b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:46.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.050+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 shutdown_connections 2024-09-17T02:59:46.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:46.050+0000 7f939f7ad640 1 -- 172.21.15.104:0/3038093801 wait complete. 2024-09-17T02:59:46.184 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T02:59:47.842 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:59:47.840+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check failed: 4 full osd(s) (OSD_FULL) 2024-09-17T02:59:51.185 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:59:51.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.311+0000 7fa7982de640 1 -- 172.21.15.104:0/4226522965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 msgr2=0x7fa79015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:51.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.311+0000 7fa7982de640 1 --2- 172.21.15.104:0/4226522965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 0x7fa79015ef90 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa78c005fd0 tx=0x7fa78c02a5d0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.311+0000 7fa7982de640 1 -- 172.21.15.104:0/4226522965 shutdown_connections 2024-09-17T02:59:51.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.311+0000 7fa7982de640 1 --2- 172.21.15.104:0/4226522965 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7900d18e0 0x7fa7900d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.311+0000 7fa7982de640 1 --2- 172.21.15.104:0/4226522965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 0x7fa79015ef90 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.311+0000 7fa7982de640 1 -- 172.21.15.104:0/4226522965 >> 172.21.15.104:0/4226522965 conn(0x7fa790073df0 msgr2=0x7fa790068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:51.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.312+0000 7fa7982de640 1 -- 172.21.15.104:0/4226522965 shutdown_connections 2024-09-17T02:59:51.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.312+0000 7fa7982de640 1 -- 172.21.15.104:0/4226522965 wait complete. 2024-09-17T02:59:51.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.313+0000 7fa7982de640 1 Processor -- start 2024-09-17T02:59:51.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.313+0000 7fa7982de640 1 -- start start 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.314+0000 7fa7982de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7900b3b00 0x7fa7900cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.314+0000 7fa7982de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 0x7fa790162000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa7982de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7900d18e0 0x7fa7900c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa7982de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa7900d3dc0 con 0x7fa7900b6f70 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa7982de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa7900d3c40 con 0x7fa7900b3b00 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa7982de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa7900d3f40 con 0x7fa7900d18e0 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 0x7fa790162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 0x7fa790162000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55354/0 (socket says 172.21.15.104:55354) 2024-09-17T02:59:51.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 -- 172.21.15.104:0/3005300967 learned_addr learned my addr 172.21.15.104:0/3005300967 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa79687b640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7900d18e0 0x7fa7900c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 -- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7900d18e0 msgr2=0x7fa7900c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa79607a640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7900b3b00 0x7fa7900cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7900d18e0 0x7fa7900c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 -- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7900b3b00 msgr2=0x7fa7900cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7900b3b00 0x7fa7900cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 -- 172.21.15.104:0/3005300967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7901f9e80 con 0x7fa7900b6f70 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa79687b640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7900d18e0 0x7fa7900c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa79607a640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7900b3b00 0x7fa7900cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:51.317 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa795879640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 0x7fa790162000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa78000c370 tx=0x7fa78000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:51.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa786ffd640 1 -- 172.21.15.104:0/3005300967 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780017070 con 0x7fa7900b6f70 2024-09-17T02:59:51.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa786ffd640 1 -- 172.21.15.104:0/3005300967 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7800035f0 con 0x7fa7900b6f70 2024-09-17T02:59:51.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7901f9300 con 0x7fa7900b6f70 2024-09-17T02:59:51.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa786ffd640 1 -- 172.21.15.104:0/3005300967 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780003a40 con 0x7fa7900b6f70 2024-09-17T02:59:51.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.315+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7901f98c0 con 0x7fa7900b6f70 2024-09-17T02:59:51.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.316+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7900d4490 con 0x7fa7900b6f70 2024-09-17T02:59:51.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.317+0000 7fa786ffd640 1 -- 172.21.15.104:0/3005300967 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa78001a070 con 0x7fa7900b6f70 2024-09-17T02:59:51.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.317+0000 7fa786ffd640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa774078b90 0x7fa77407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:51.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.318+0000 7fa786ffd640 1 -- 172.21.15.104:0/3005300967 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7fa78009a0d0 con 0x7fa7900b6f70 2024-09-17T02:59:51.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.318+0000 7fa786ffd640 1 -- 172.21.15.104:0/3005300967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=107}) -- 0x7fa774080770 con 0x7fa7900b6f70 2024-09-17T02:59:51.319 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.318+0000 7fa79607a640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa774078b90 0x7fa77407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:51.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.318+0000 7fa79607a640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa774078b90 0x7fa77407b0a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa78c033000 tx=0x7fa78c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:51.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.322+0000 7fa786ffd640 1 -- 172.21.15.104:0/3005300967 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa780062490 con 0x7fa7900b6f70 2024-09-17T02:59:51.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.496+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fa7900cf1d0 con 0x7fa7900b6f70 2024-09-17T02:59:51.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.497+0000 7fa786ffd640 1 -- 172.21.15.104:0/3005300967 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) ==== 81+0+34478 (secure 0 0 0) 0x7fa780061d90 con 0x7fa7900b6f70 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 106, 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:59:50.904227+0000", 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:59:51.498 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:59:51.499 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 13, 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:59:51.500 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:51.501 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:51.502 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:51.503 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:51.504 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:51.505 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:59:51.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:51.507 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 12, 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:28.780702+0000", 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:51.508 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:59:51.509 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:51.510 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:51.511 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:51.512 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:51.513 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:51.514 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:51.515 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 13, 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:30.098469+0000", 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:51.516 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:59:51.517 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:51.518 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:51.519 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:51.520 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:51.521 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:51.522 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:51.523 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:51.524 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.525 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:51.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.527 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:51.530 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:51.531 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:59:51.532 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:51.533 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.534 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.535 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:59:51.536 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:59:51.537 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:51.538 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:51.539 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:51.540 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.541 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:51.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.543 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:59:51.544 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:51.545 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.546 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:51.547 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.549 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.550 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:51.551 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:51.552 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.554 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:51.555 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.556 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:51.557 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.558 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:51.559 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.560 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:51.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.562 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.565 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:51.566 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:51.567 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.568 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:51.569 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:59:51.571 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:51.572 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:51.573 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.574 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:51.575 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.576 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:59:51.577 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:59:51.578 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull", 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:51.579 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:51.580 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:51.581 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:59:51.582 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.583 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.584 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:51.585 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:59:51.586 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.587 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:59:51.588 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:51.589 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:59:51.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.499+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa774078b90 msgr2=0x7fa77407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:51.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.499+0000 7fa7982de640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa774078b90 0x7fa77407b0a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa78c033000 tx=0x7fa78c004730 comp rx=0 tx=0).stop 2024-09-17T02:59:51.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 msgr2=0x7fa790162000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 0x7fa790162000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa78000c370 tx=0x7fa78000c830 comp rx=0 tx=0).stop 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 shutdown_connections 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa774078b90 0x7fa77407b0a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7900d18e0 0x7fa7900c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa7900b6f70 0x7fa790162000 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 --2- 172.21.15.104:0/3005300967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7900b3b00 0x7fa7900cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 >> 172.21.15.104:0/3005300967 conn(0x7fa790073df0 msgr2=0x7fa790068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 shutdown_connections 2024-09-17T02:59:51.591 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.500+0000 7fa7982de640 1 -- 172.21.15.104:0/3005300967 wait complete. 2024-09-17T02:59:51.592 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T02:59:51.592 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:51.592 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:51.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:51.608 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-17T02:59:51.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:59:51.808 INFO:teuthology.orchestra.run.smithi104.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-17T02:59:51.808 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records in 2024-09-17T02:59:51.809 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records out 2024-09-17T02:59:51.809 INFO:teuthology.orchestra.run.smithi104.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.138909 s, 377 MB/s 2024-09-17T02:59:51.809 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:59:51.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.925+0000 7eff36ede640 1 -- 172.21.15.104:0/298094310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3015f1f0 msgr2=0x7eff3015f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:51.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.925+0000 7eff36ede640 1 --2- 172.21.15.104:0/298094310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3015f1f0 0x7eff3015f600 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7eff3008d840 tx=0x7eff2002a4a0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.925+0000 7eff36ede640 1 -- 172.21.15.104:0/298094310 shutdown_connections 2024-09-17T02:59:51.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.925+0000 7eff36ede640 1 --2- 172.21.15.104:0/298094310 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff3015f1f0 0x7eff3015f600 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.925+0000 7eff36ede640 1 --2- 172.21.15.104:0/298094310 >> v2:172.21.15.192:3300/0 conn(0x7eff300b65e0 0x7eff300b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.925+0000 7eff36ede640 1 -- 172.21.15.104:0/298094310 >> 172.21.15.104:0/298094310 conn(0x7eff30069120 msgr2=0x7eff30069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:51.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.925+0000 7eff36ede640 1 -- 172.21.15.104:0/298094310 shutdown_connections 2024-09-17T02:59:51.925 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.925+0000 7eff36ede640 1 -- 172.21.15.104:0/298094310 wait complete. 2024-09-17T02:59:51.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.927+0000 7eff36ede640 1 Processor -- start 2024-09-17T02:59:51.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.927+0000 7eff36ede640 1 -- start start 2024-09-17T02:59:51.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff36ede640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff300b65e0 0x7eff300cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:51.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff36ede640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3015f1f0 0x7eff3014af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:51.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff36ede640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3015fb40 0x7eff301f9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff36ede640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7eff30163490 con 0x7eff300b65e0 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff36ede640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7eff301625a0 con 0x7eff3015fb40 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff36ede640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7eff30163610 con 0x7eff3015f1f0 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff34c7a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff300b65e0 0x7eff300cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff34c7a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff300b65e0 0x7eff300cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55370/0 (socket says 172.21.15.104:55370) 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.928+0000 7eff34c7a640 1 -- 172.21.15.104:0/1804740047 learned_addr learned my addr 172.21.15.104:0/1804740047 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff3547b640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3015fb40 0x7eff301f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff27fff640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3015f1f0 0x7eff3014af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff34c7a640 1 -- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3015f1f0 msgr2=0x7eff3014af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff34c7a640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3015f1f0 0x7eff3014af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff34c7a640 1 -- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3015fb40 msgr2=0x7eff301f9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff34c7a640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3015fb40 0x7eff301f9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff34c7a640 1 -- 172.21.15.104:0/1804740047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3014b4a0 con 0x7eff300b65e0 2024-09-17T02:59:51.930 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff3547b640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3015fb40 0x7eff301f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T02:59:51.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff34c7a640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff300b65e0 0x7eff300cd5c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00d700 tx=0x7eff2c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:51.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff257fa640 1 -- 172.21.15.104:0/1804740047 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c017070 con 0x7eff300b65e0 2024-09-17T02:59:51.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff257fa640 1 -- 172.21.15.104:0/1804740047 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff2c004310 con 0x7eff300b65e0 2024-09-17T02:59:51.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff300c8660 con 0x7eff300b65e0 2024-09-17T02:59:51.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff257fa640 1 -- 172.21.15.104:0/1804740047 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c009a80 con 0x7eff300b65e0 2024-09-17T02:59:51.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.929+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff300c8be0 con 0x7eff300b65e0 2024-09-17T02:59:51.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.930+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff30163b30 con 0x7eff300b65e0 2024-09-17T02:59:51.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.931+0000 7eff257fa640 1 -- 172.21.15.104:0/1804740047 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff2c009c20 con 0x7eff300b65e0 2024-09-17T02:59:51.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.931+0000 7eff257fa640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff1c078bc0 0x7eff1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:51.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.931+0000 7eff257fa640 1 -- 172.21.15.104:0/1804740047 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7eff2c09ae40 con 0x7eff300b65e0 2024-09-17T02:59:51.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.931+0000 7eff257fa640 1 -- 172.21.15.104:0/1804740047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=107}) -- 0x7eff1c080740 con 0x7eff300b65e0 2024-09-17T02:59:51.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.932+0000 7eff27fff640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff1c078bc0 0x7eff1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:51.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.932+0000 7eff27fff640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff1c078bc0 0x7eff1c07b0d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7eff20034000 tx=0x7eff20004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:51.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:51.936+0000 7eff257fa640 1 -- 172.21.15.104:0/1804740047 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff3014b4a0 con 0x7eff300b65e0 2024-09-17T02:59:52.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.109+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7eff3015b970 con 0x7eff300b65e0 2024-09-17T02:59:52.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.110+0000 7eff257fa640 1 -- 172.21.15.104:0/1804740047 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) ==== 81+0+34478 (secure 0 0 0) 0x7eff2c063280 con 0x7eff300b65e0 2024-09-17T02:59:52.111 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:52.111 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:59:52.111 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 106, 2024-09-17T02:59:52.111 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:59:52.112 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:59:52.112 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:59:50.904227+0000", 2024-09-17T02:59:52.112 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:59:52.112 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:59:52.112 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:59:52.112 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:59:52.113 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:59:52.113 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:59:52.113 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:59:52.113 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:59:52.113 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:59:52.113 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:52.114 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:59:52.114 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:59:52.114 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:59:52.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:59:52.114 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:59:52.115 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 13, 2024-09-17T02:59:52.115 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:59:52.115 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:59:52.115 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:59:52.115 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:59:52.115 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:59:52.116 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:59:52.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.116 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:59:52.116 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:59:52.116 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:59:52.116 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:52.117 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:52.117 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:52.117 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:52.117 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:52.117 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:52.117 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:52.118 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:52.118 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:52.118 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:52.118 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:52.118 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:52.118 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:52.119 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:59:52.119 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:59:52.119 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:59:52.119 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:59:52.119 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:59:52.119 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:52.120 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:52.120 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:52.120 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:52.120 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:52.120 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:52.120 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:52.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.121 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:52.121 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:52.121 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:52.121 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:52.121 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:52.122 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:52.122 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:52.122 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:52.122 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:52.122 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:52.122 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:52.123 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:52.123 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:52.123 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:52.123 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:52.123 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:52.124 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:52.124 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:52.124 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:52.124 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:52.124 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:52.125 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:52.125 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:52.125 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:52.125 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:52.125 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:52.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:52.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.126 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:52.126 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:52.126 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:52.126 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:52.127 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:52.127 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:52.127 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:52.127 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:52.127 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:52.128 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:52.128 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:52.128 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:52.128 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:59:52.128 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:59:52.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.129 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:52.129 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:59:52.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.129 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:52.129 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:52.130 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:59:52.130 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:59:52.130 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:59:52.130 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:52.130 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:52.130 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:52.131 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:52.131 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:52.131 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.131 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 12, 2024-09-17T02:59:52.132 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:59:52.132 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:28.780702+0000", 2024-09-17T02:59:52.132 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:52.132 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:52.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:52.133 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:52.133 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:52.133 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:52.133 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:52.133 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:52.133 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:52.134 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:52.134 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:52.134 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:52.134 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:52.134 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:59:52.135 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:59:52.135 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:59:52.135 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:59:52.135 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:59:52.135 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:52.135 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:52.136 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:52.136 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:52.136 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:52.136 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:52.136 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:52.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.137 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:52.137 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:52.137 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:52.137 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:52.137 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:52.138 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:52.138 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:52.138 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:52.138 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:52.138 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:52.138 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:52.139 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:52.139 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:52.139 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:52.139 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:52.139 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:52.139 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:52.140 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:52.140 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:52.140 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:52.140 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:52.140 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:52.141 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:52.141 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:52.141 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:52.141 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:52.141 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:52.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.142 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:52.142 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:52.142 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:52.142 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:52.142 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:52.143 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:52.143 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:52.143 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:52.143 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:52.143 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:52.143 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:52.143 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:52.144 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:59:52.144 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:59:52.144 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:59:52.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.144 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:52.145 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:52.145 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:59:52.145 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.145 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:52.145 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T02:59:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T02:59:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:52.147 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:52.147 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:52.147 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.147 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 13, 2024-09-17T02:59:52.148 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:59:52.148 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:30.098469+0000", 2024-09-17T02:59:52.148 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:52.148 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:52.148 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:52.148 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:52.149 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:52.149 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:52.149 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:52.149 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:52.149 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:52.150 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:52.150 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:52.150 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:52.150 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:52.151 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:59:52.151 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:59:52.151 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:59:52.151 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:59:52.152 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:59:52.152 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:52.152 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:52.152 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:52.152 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:52.153 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:52.154 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:52.155 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:52.156 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:52.157 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:59:52.157 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.157 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:52.157 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:52.157 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T02:59:52.158 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T02:59:52.158 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:52.158 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T02:59:52.158 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:52.159 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:52.160 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.162 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.164 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:59:52.165 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:52.166 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.167 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:52.168 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:52.169 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.170 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:59:52.171 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:52.172 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:52.173 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.174 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.175 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:52.176 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.177 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.178 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.179 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:52.180 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.181 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:59:52.182 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:52.183 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.183 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.183 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.183 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:59:52.183 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:52.183 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.184 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.184 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.184 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:52.184 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.184 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.184 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.185 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:59:52.185 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:52.185 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.185 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.185 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.185 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:59:52.185 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:52.186 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.186 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.186 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.186 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:59:52.186 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:59:52.186 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:59:52.186 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:59:52.186 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:52.187 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:52.187 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:52.187 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.187 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.187 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.187 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:52.187 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:52.188 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:52.188 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:52.188 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:52.188 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:52.188 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:52.188 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:52.189 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:52.190 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:52.191 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.192 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.192 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.192 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:52.192 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.192 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.192 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.192 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:59:52.192 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:59:52.193 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:59:52.194 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:52.195 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:52.196 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:59:52.197 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:59:52.198 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:59:52.199 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:59:52.200 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:52.201 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.202 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.203 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.204 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.205 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:52.206 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:52.207 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.208 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.209 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.210 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:59:52.211 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:52.211 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.211 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.211 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.211 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:52.211 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:52.211 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.212 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:52.212 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:59:52.212 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:52.212 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.212 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.212 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:52.213 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:59:52.213 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:52.213 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.213 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.213 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.214 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:59:52.214 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:59:52.214 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:59:52.214 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:59:52.214 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:52.214 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull", 2024-09-17T02:59:52.215 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:52.215 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:52.215 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:52.215 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.215 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:52.215 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:59:52.216 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.216 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:52.216 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:52.216 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:52.216 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:52.216 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:52.217 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:52.217 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:59:52.217 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:52.217 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.217 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.217 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:52.218 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:52.218 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:52.218 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:52.218 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:52.218 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:52.218 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:59:52.219 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:52.219 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.219 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.219 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:52.219 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:52.220 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:52.220 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:52.220 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:52.220 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:52.220 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:59:52.220 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:52.221 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.221 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.221 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:52.221 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:52.221 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:52.222 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:52.222 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:52.222 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:52.222 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:59:52.222 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:52.222 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.223 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.223 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:52.223 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:52.223 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:52.223 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:52.223 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:52.224 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:52.224 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:59:52.224 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:52.224 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.224 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.224 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:52.225 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:52.225 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:52.225 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:52.225 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:52.225 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:52.225 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:59:52.226 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:52.226 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.226 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.226 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:52.226 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:52.227 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:52.227 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:52.227 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:52.227 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:52.227 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:59:52.227 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:52.228 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.228 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:52.228 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:52.228 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:52.228 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:52.228 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:52.229 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:52.229 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:52.229 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:59:52.229 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:52.229 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.230 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:52.230 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:59:52.230 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:59:52.230 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:59:52.230 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:59:52.230 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:59:52.231 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:59:52.231 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:59:52.231 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:59:52.231 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:59:52.231 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:59:52.232 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:59:52.232 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:59:52.232 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:59:52.232 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:59:52.232 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:52.233 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:59:52.233 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:59:52.233 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:59:52.233 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:59:52.233 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:59:52.234 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:59:52.234 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:59:52.234 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:59:52.234 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:59:52.234 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:59:52.234 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:59:52.235 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:52.235 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff1c078bc0 msgr2=0x7eff1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff1c078bc0 0x7eff1c07b0d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7eff20034000 tx=0x7eff20004730 comp rx=0 tx=0).stop 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff300b65e0 msgr2=0x7eff300cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff300b65e0 0x7eff300cd5c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00d700 tx=0x7eff2c00dbc0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 shutdown_connections 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7eff1c078bc0 0x7eff1c07b0d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff3015fb40 0x7eff301f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff3015f1f0 0x7eff3014af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 --2- 172.21.15.104:0/1804740047 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff300b65e0 0x7eff300cd5c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 >> 172.21.15.104:0/1804740047 conn(0x7eff30069120 msgr2=0x7eff300d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 shutdown_connections 2024-09-17T02:59:52.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.113+0000 7eff36ede640 1 -- 172.21.15.104:0/1804740047 wait complete. 2024-09-17T02:59:52.239 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T02:59:52.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.353+0000 7f828b5c3640 1 -- 172.21.15.104:0/474740231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8284072470 msgr2=0x7f8284072880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:52.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.353+0000 7f828b5c3640 1 --2- 172.21.15.104:0/474740231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8284072470 0x7f8284072880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f828406ecb0 tx=0x7f827402a480 comp rx=0 tx=0).stop 2024-09-17T02:59:52.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.353+0000 7f828b5c3640 1 -- 172.21.15.104:0/474740231 shutdown_connections 2024-09-17T02:59:52.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.353+0000 7f828b5c3640 1 --2- 172.21.15.104:0/474740231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8284072470 0x7f8284072880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.353+0000 7f828b5c3640 1 --2- 172.21.15.104:0/474740231 >> v2:172.21.15.192:3300/0 conn(0x7f828415b7f0 0x7f828415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.353+0000 7f828b5c3640 1 -- 172.21.15.104:0/474740231 >> 172.21.15.104:0/474740231 conn(0x7f82840b2450 msgr2=0x7f82840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:52.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.353+0000 7f828b5c3640 1 -- 172.21.15.104:0/474740231 shutdown_connections 2024-09-17T02:59:52.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.353+0000 7f828b5c3640 1 -- 172.21.15.104:0/474740231 wait complete. 2024-09-17T02:59:52.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.355+0000 7f828b5c3640 1 Processor -- start 2024-09-17T02:59:52.354 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.355+0000 7f828b5c3640 1 -- start start 2024-09-17T02:59:52.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f828b5c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8284072470 0x7f828415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:52.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f828b5c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8284072dc0 0x7f828415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:52.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f828b5c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f828415b7f0 0x7f82840b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:52.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f828b5c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f828415fe30 con 0x7f8284072dc0 2024-09-17T02:59:52.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f828b5c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f82840cf4a0 con 0x7f8284072470 2024-09-17T02:59:52.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f828b5c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f828415ffb0 con 0x7f828415b7f0 2024-09-17T02:59:52.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8288b5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8284072dc0 0x7f828415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:52.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8288b5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8284072dc0 0x7f828415ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55386/0 (socket says 172.21.15.104:55386) 2024-09-17T02:59:52.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8288b5e640 1 -- 172.21.15.104:0/3538293444 learned_addr learned my addr 172.21.15.104:0/3538293444 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:52.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8289b60640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f828415b7f0 0x7f82840b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:52.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f828935f640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8284072470 0x7f828415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:52.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8288b5e640 1 -- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f828415b7f0 msgr2=0x7f82840b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:52.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8288b5e640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f828415b7f0 0x7f82840b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8288b5e640 1 -- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8284072470 msgr2=0x7f828415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8288b5e640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8284072470 0x7f828415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.356+0000 7f8288b5e640 1 -- 172.21.15.104:0/3538293444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828415d570 con 0x7f8284072dc0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.357+0000 7f8288b5e640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8284072dc0 0x7f828415ed70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8274009920 tx=0x7f8274033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.357+0000 7f8279ffb640 1 -- 172.21.15.104:0/3538293444 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274031d60 con 0x7f8284072dc0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.357+0000 7f8279ffb640 1 -- 172.21.15.104:0/3538293444 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8274033e10 con 0x7f8284072dc0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.357+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82841f2b00 con 0x7f8284072dc0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.357+0000 7f8279ffb640 1 -- 172.21.15.104:0/3538293444 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274005260 con 0x7f8284072dc0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.357+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82841f30c0 con 0x7f8284072dc0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.358+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82841604d0 con 0x7f8284072dc0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.359+0000 7f8279ffb640 1 -- 172.21.15.104:0/3538293444 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8274005400 con 0x7f8284072dc0 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.359+0000 7f8279ffb640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8268078bc0 0x7f826807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:52.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.359+0000 7f8279ffb640 1 -- 172.21.15.104:0/3538293444 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f82740bbe40 con 0x7f8284072dc0 2024-09-17T02:59:52.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.359+0000 7f828935f640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8268078bc0 0x7f826807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:52.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.359+0000 7f8279ffb640 1 -- 172.21.15.104:0/3538293444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=107}) -- 0x7f82680807a0 con 0x7f8284072dc0 2024-09-17T02:59:52.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.360+0000 7f828935f640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8268078bc0 0x7f826807b0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8280009530 tx=0x7f8280009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:52.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.364+0000 7f8279ffb640 1 -- 172.21.15.104:0/3538293444 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f827403f030 con 0x7f8284072dc0 2024-09-17T02:59:52.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.572+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8284157800 con 0x7f8284072dc0 2024-09-17T02:59:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.572+0000 7f8279ffb640 1 -- 172.21.15.104:0/3538293444 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7f8274083c30 con 0x7f8284072dc0 2024-09-17T02:59:52.572 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:52.572 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T02:59:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T02:59:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8268078bc0 msgr2=0x7f826807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8268078bc0 0x7f826807b0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8280009530 tx=0x7f8280009260 comp rx=0 tx=0).stop 2024-09-17T02:59:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8284072dc0 msgr2=0x7f828415ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8284072dc0 0x7f828415ed70 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8274009920 tx=0x7f8274033c20 comp rx=0 tx=0).stop 2024-09-17T02:59:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 shutdown_connections 2024-09-17T02:59:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8268078bc0 0x7f826807b0d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f828415b7f0 0x7f82840b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8284072dc0 0x7f828415ed70 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 --2- 172.21.15.104:0/3538293444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8284072470 0x7f828415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:52.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.574+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 >> 172.21.15.104:0/3538293444 conn(0x7f82840b2450 msgr2=0x7f8284075ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:52.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.575+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 shutdown_connections 2024-09-17T02:59:52.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:52.575+0000 7f828b5c3640 1 -- 172.21.15.104:0/3538293444 wait complete. 2024-09-17T02:59:52.585 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T02:59:52.709 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":6282,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.909738186999999,"mdsmap_epoch":42,"osdmap_epoch":106,"osdmap_epoch_barrier":106,"uptime":32.843909371999999} 2024-09-17T02:59:52.709 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 6282, "mdsmap_epoch": 42, "osdmap_epoch": 106, "osdmap_epoch_barrier": 106, "rank_uptime": 20.909738187, "state": "up:active", "uptime": 32.843909372, "want_state": "up:active", "whoami": 0 } 2024-09-17T02:59:52.709 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T02:59:52.710 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T02:59:52.710 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T02:59:52.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:52.725 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-17T02:59:52.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:59:52.781 INFO:teuthology.orchestra.run.smithi104.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-17T02:59:52.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:52.781 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-17T02:59:52.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T02:59:52.838 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-17T02:59:52.915 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:59:53.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.068+0000 7f1f190bd640 1 -- 172.21.15.104:0/3645490494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 msgr2=0x7f1f140cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.068+0000 7f1f190bd640 1 --2- 172.21.15.104:0/3645490494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 0x7f1f140cf870 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1f14073b50 tx=0x7f1efc02a4d0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.068+0000 7f1f190bd640 1 -- 172.21.15.104:0/3645490494 shutdown_connections 2024-09-17T02:59:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.068+0000 7f1f190bd640 1 --2- 172.21.15.104:0/3645490494 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 0x7f1f140cf870 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.068+0000 7f1f190bd640 1 --2- 172.21.15.104:0/3645490494 >> v2:172.21.15.192:3300/0 conn(0x7f1f140d3400 0x7f1f140cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.068+0000 7f1f190bd640 1 -- 172.21.15.104:0/3645490494 >> 172.21.15.104:0/3645490494 conn(0x7f1f140d28e0 msgr2=0x7f1f140d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.068+0000 7f1f190bd640 1 -- 172.21.15.104:0/3645490494 shutdown_connections 2024-09-17T02:59:53.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.068+0000 7f1f190bd640 1 -- 172.21.15.104:0/3645490494 wait complete. 2024-09-17T02:59:53.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.070+0000 7f1f190bd640 1 Processor -- start 2024-09-17T02:59:53.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.070+0000 7f1f190bd640 1 -- start start 2024-09-17T02:59:53.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f190bd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f140cd3f0 0x7f1f1409c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:53.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f190bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 0x7f1f14151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f190bd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f140d3400 0x7f1f140c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f190bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1f140b6e40 con 0x7f1f140cf460 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f190bd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1f140b6cc0 con 0x7f1f140cd3f0 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f190bd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1f140b6fc0 con 0x7f1f140d3400 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 0x7f1f14151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 0x7f1f14151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55406/0 (socket says 172.21.15.104:55406) 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 -- 172.21.15.104:0/23589845 learned_addr learned my addr 172.21.15.104:0/23589845 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f12d9d640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f140cd3f0 0x7f1f1409c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f1359e640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f140d3400 0x7f1f140c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 -- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f140d3400 msgr2=0x7f1f140c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f140d3400 0x7f1f140c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 -- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f140cd3f0 msgr2=0x7f1f1409c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f140cd3f0 0x7f1f1409c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 -- 172.21.15.104:0/23589845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f140cc8d0 con 0x7f1f140cf460 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f12d9d640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f140cd3f0 0x7f1f1409c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.071+0000 7f1f0bfff640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 0x7f1f14151de0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0099c0 tx=0x7f1efc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.072+0000 7f1f0b7fe640 1 -- 172.21.15.104:0/23589845 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc03e030 con 0x7f1f140cf460 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.072+0000 7f1f0b7fe640 1 -- 172.21.15.104:0/23589845 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1efc0047a0 con 0x7f1f140cf460 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.072+0000 7f1f0b7fe640 1 -- 172.21.15.104:0/23589845 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc035040 con 0x7f1f140cf460 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.072+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f140ccbb0 con 0x7f1f140cf460 2024-09-17T02:59:53.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.072+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1409fd90 con 0x7f1f140cf460 2024-09-17T02:59:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.073+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1406a720 con 0x7f1f140cf460 2024-09-17T02:59:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.074+0000 7f1f0b7fe640 1 -- 172.21.15.104:0/23589845 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1efc041030 con 0x7f1f140cf460 2024-09-17T02:59:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.074+0000 7f1f0b7fe640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ef4078bc0 0x7f1ef407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.074+0000 7f1f0b7fe640 1 -- 172.21.15.104:0/23589845 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5709+0+0 (secure 0 0 0) 0x7f1efc0bb5c0 con 0x7f1f140cf460 2024-09-17T02:59:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.074+0000 7f1f0b7fe640 1 -- 172.21.15.104:0/23589845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=107}) -- 0x7f1ef40807a0 con 0x7f1f140cf460 2024-09-17T02:59:53.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.074+0000 7f1f12d9d640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ef4078bc0 0x7f1ef407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:53.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.075+0000 7f1f12d9d640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ef4078bc0 0x7f1ef407b0d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1f04006fd0 tx=0x7f1f04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:53.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.079+0000 7f1f0b7fe640 1 -- 172.21.15.104:0/23589845 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f1406a720 con 0x7f1f140cf460 2024-09-17T02:59:53.127 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:59:53.127+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2024-09-17T02:59:53.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.254+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f1f14072440 con 0x7f1f140cf460 2024-09-17T02:59:53.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.255+0000 7f1f0b7fe640 1 -- 172.21.15.104:0/23589845 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v106) ==== 81+0+34478 (secure 0 0 0) 0x7f1efc083a10 con 0x7f1f140cf460 2024-09-17T02:59:53.255 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:53.255 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:59:53.255 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 106, 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:59:50.904227+0000", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:59:53.256 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 13, 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:59:53.257 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:53.258 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:59:53.259 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:53.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:53.261 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:53.262 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:53.262 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:53.262 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:53.262 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:53.262 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:53.262 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:53.263 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:53.264 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 12, 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:59:53.265 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:28.780702+0000", 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:53.266 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:53.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:53.268 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:53.269 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:53.270 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T02:59:53.271 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 13, 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:59:53.272 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:30.098469+0000", 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:59:53.273 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:53.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:53.275 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:53.276 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:59:53.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T02:59:53.278 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:53.279 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:53.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:53.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:59:53.284 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:53.285 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:59:53.286 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:59:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:53.291 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:53.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:59:53.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:53.296 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:53.297 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:59:53.298 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:59:53.302 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:53.303 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:53.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:53.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:53.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:53.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:59:53.308 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:53.309 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:53.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:53.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:53.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:59:53.313 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:53.314 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:53.315 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.316 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.317 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:53.320 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:53.321 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.323 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.324 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:53.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:59:53.326 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull", 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:53.327 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:53.328 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:53.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:53.330 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:53.331 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:53.332 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:53.333 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:59:53.334 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:59:53.335 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:59:53.336 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:59:53.336 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:53.336 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:59:53.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ef4078bc0 msgr2=0x7f1ef407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ef4078bc0 0x7f1ef407b0d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1f04006fd0 tx=0x7f1f04008040 comp rx=0 tx=0).stop 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 msgr2=0x7f1f14151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 0x7f1f14151de0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0099c0 tx=0x7f1efc0039e0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 shutdown_connections 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1ef4078bc0 0x7f1ef407b0d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f140d3400 0x7f1f140c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1f140cf460 0x7f1f14151de0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 --2- 172.21.15.104:0/23589845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f140cd3f0 0x7f1f1409c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 >> 172.21.15.104:0/23589845 conn(0x7f1f140d28e0 msgr2=0x7f1f140cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 shutdown_connections 2024-09-17T02:59:53.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:53.257+0000 7f1f190bd640 1 -- 172.21.15.104:0/23589845 wait complete. 2024-09-17T02:59:53.339 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T02:59:58.127 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:59:58.128+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-17T02:59:58.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T02:59:58.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.466+0000 7f16ae6de640 1 -- 172.21.15.104:0/1028676406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073510 msgr2=0x7f16a80d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:58.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.466+0000 7f16ae6de640 1 --2- 172.21.15.104:0/1028676406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073510 0x7f16a80d1bf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1690009830 tx=0x7f169002a4d0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.466+0000 7f16ae6de640 1 -- 172.21.15.104:0/1028676406 shutdown_connections 2024-09-17T02:59:58.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.466+0000 7f16ae6de640 1 --2- 172.21.15.104:0/1028676406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073510 0x7f16a80d1bf0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.466+0000 7f16ae6de640 1 --2- 172.21.15.104:0/1028676406 >> v2:172.21.15.192:3300/0 conn(0x7f16a815bff0 0x7f16a80cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.466+0000 7f16ae6de640 1 -- 172.21.15.104:0/1028676406 >> 172.21.15.104:0/1028676406 conn(0x7f16a806cfc0 msgr2=0x7f16a806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:58.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.466+0000 7f16ae6de640 1 -- 172.21.15.104:0/1028676406 shutdown_connections 2024-09-17T02:59:58.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.466+0000 7f16ae6de640 1 -- 172.21.15.104:0/1028676406 wait complete. 2024-09-17T02:59:58.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.468+0000 7f16ae6de640 1 Processor -- start 2024-09-17T02:59:58.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.468+0000 7f16ae6de640 1 -- start start 2024-09-17T02:59:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16ae6de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a8073510 0x7f16a815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16ae6de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073920 0x7f16a8141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16ae6de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a815bff0 0x7f16a8143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:58.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16ae6de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f16a80d22b0 con 0x7f16a8073920 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16ae6de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16a80d2130 con 0x7f16a8073510 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16ae6de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f16a80d2430 con 0x7f16a815bff0 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073920 0x7f16a8141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073920 0x7f16a8141200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52014/0 (socket says 172.21.15.104:52014) 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 -- 172.21.15.104:0/2984166715 learned_addr learned my addr 172.21.15.104:0/2984166715 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a7fff640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a8073510 0x7f16a815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16acc7b640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a815bff0 0x7f16a8143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 -- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a815bff0 msgr2=0x7f16a8143990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a815bff0 0x7f16a8143990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 -- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a8073510 msgr2=0x7f16a815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a8073510 0x7f16a815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 -- 172.21.15.104:0/2984166715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a81547d0 con 0x7f16a8073920 2024-09-17T02:59:58.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16acc7b640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a815bff0 0x7f16a8143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T02:59:58.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a77fe640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073920 0x7f16a8141200 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1690000c00 tx=0x7f1690033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:58.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a4ff9640 1 -- 172.21.15.104:0/2984166715 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690005c90 con 0x7f16a8073920 2024-09-17T02:59:58.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a4ff9640 1 -- 172.21.15.104:0/2984166715 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1690031e50 con 0x7f16a8073920 2024-09-17T02:59:58.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a8154ab0 con 0x7f16a8073920 2024-09-17T02:59:58.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.470+0000 7f16a4ff9640 1 -- 172.21.15.104:0/2984166715 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690033290 con 0x7f16a8073920 2024-09-17T02:59:58.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.471+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a8155070 con 0x7f16a8073920 2024-09-17T02:59:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.471+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a80d1bf0 con 0x7f16a8073920 2024-09-17T02:59:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.472+0000 7f16a4ff9640 1 -- 172.21.15.104:0/2984166715 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1690033430 con 0x7f16a8073920 2024-09-17T02:59:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.473+0000 7f16a4ff9640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1688078b90 0x7f168807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T02:59:58.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.473+0000 7f16a4ff9640 1 -- 172.21.15.104:0/2984166715 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5709+0+0 (secure 0 0 0) 0x7f16900bc170 con 0x7f16a8073920 2024-09-17T02:59:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.473+0000 7f16a4ff9640 1 -- 172.21.15.104:0/2984166715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=110}) -- 0x7f1688080770 con 0x7f16a8073920 2024-09-17T02:59:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.473+0000 7f16a7fff640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1688078b90 0x7f168807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T02:59:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.473+0000 7f16a7fff640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1688078b90 0x7f168807b0a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f169800bb50 tx=0x7f169800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T02:59:58.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.477+0000 7f16a4ff9640 1 -- 172.21.15.104:0/2984166715 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f169003f030 con 0x7f16a8073920 2024-09-17T02:59:58.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.652+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f16a81509a0 con 0x7f16a8073920 2024-09-17T02:59:58.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.653+0000 7f16a4ff9640 1 -- 172.21.15.104:0/2984166715 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v109) ==== 81+0+34430 (secure 0 0 0) 0x7f1690084640 con 0x7f16a8073920 2024-09-17T02:59:58.653 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T02:59:58.653 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T02:59:58.653 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 109, 2024-09-17T02:59:58.653 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T02:59:58.653 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T02:59:58.653 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T02:59:56.928696+0000", 2024-09-17T02:59:58.653 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T02:59:58.654 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 13, 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T02:59:58.655 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:58.656 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:58.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:58.658 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:58.659 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:58.660 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:58.661 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 12, 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:28.780702+0000", 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:58.662 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T02:59:58.663 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:58.664 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:58.665 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:58.666 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.667 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:58.668 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 13, 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:30.098469+0000", 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 3, 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full", 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T02:59:58.669 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T02:59:58.670 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "104", 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T02:59:58.671 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T02:59:58.672 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T02:59:58.673 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T02:59:58.674 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T02:59:58.675 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:58.676 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.677 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.678 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.679 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T02:59:58.680 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:58.681 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:58.682 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.685 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.686 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T02:59:58.687 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:58.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.689 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:58.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T02:59:58.692 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:58.693 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:58.694 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T02:59:58.695 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T02:59:58.696 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.698 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:58.699 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:58.700 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.701 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.702 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.703 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T02:59:58.704 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull", 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.705 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:58.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:58.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.710 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:58.711 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:58.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.715 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "full", 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:58.717 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.718 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T02:59:58.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T02:59:58.721 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.722 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:58.723 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:58.724 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:58.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:58.726 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:58.727 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T02:59:58.729 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T02:59:58.730 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T02:59:58.730 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T02:59:58.730 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T02:59:58.730 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T02:59:58.730 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T02:59:58.730 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T02:59:58.730 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T02:59:58.730 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T02:59:58.732 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T02:59:58.733 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T02:59:58.733 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T02:59:58.733 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T02:59:58.733 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T02:59:58.733 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T02:59:58.733 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T02:59:58.733 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T02:59:58.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1688078b90 msgr2=0x7f168807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:58.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1688078b90 0x7f168807b0a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f169800bb50 tx=0x7f169800b2e0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073920 msgr2=0x7f16a8141200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T02:59:58.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073920 0x7f16a8141200 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1690000c00 tx=0x7f1690033c90 comp rx=0 tx=0).stop 2024-09-17T02:59:58.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 shutdown_connections 2024-09-17T02:59:58.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1688078b90 0x7f168807b0a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16a815bff0 0x7f16a8143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f16a8073920 0x7f16a8141200 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 --2- 172.21.15.104:0/2984166715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a8073510 0x7f16a815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T02:59:58.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 >> 172.21.15.104:0/2984166715 conn(0x7f16a806cfc0 msgr2=0x7f16a80cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T02:59:58.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 shutdown_connections 2024-09-17T02:59:58.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T02:59:58.655+0000 7f16ae6de640 1 -- 172.21.15.104:0/2984166715 wait complete. 2024-09-17T02:59:58.736 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T02:59:59.998 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T02:59:59.998+0000 7f2706910640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 full osd(s); 3 pool(s) full 2024-09-17T03:00:03.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:00:03.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.866+0000 7f4551a4a640 1 -- 172.21.15.104:0/2622202810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 msgr2=0x7f454c0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:03.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.866+0000 7f4551a4a640 1 --2- 172.21.15.104:0/2622202810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 0x7f454c0d34f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f454c0b44d0 tx=0x7f454402a9c0 comp rx=0 tx=0).stop 2024-09-17T03:00:03.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.866+0000 7f4551a4a640 1 -- 172.21.15.104:0/2622202810 shutdown_connections 2024-09-17T03:00:03.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.866+0000 7f4551a4a640 1 --2- 172.21.15.104:0/2622202810 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 0x7f454c0d34f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:03.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.866+0000 7f4551a4a640 1 --2- 172.21.15.104:0/2622202810 >> v2:172.21.15.192:3300/0 conn(0x7f454c0d18e0 0x7f454c15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:03.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.866+0000 7f4551a4a640 1 -- 172.21.15.104:0/2622202810 >> 172.21.15.104:0/2622202810 conn(0x7f454c073df0 msgr2=0x7f454c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:03.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.866+0000 7f4551a4a640 1 -- 172.21.15.104:0/2622202810 shutdown_connections 2024-09-17T03:00:03.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.866+0000 7f4551a4a640 1 -- 172.21.15.104:0/2622202810 wait complete. 2024-09-17T03:00:03.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.868+0000 7f4551a4a640 1 Processor -- start 2024-09-17T03:00:03.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.868+0000 7f4551a4a640 1 -- start start 2024-09-17T03:00:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.869+0000 7f4551a4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 0x7f454c14af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.869+0000 7f4551a4a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f454c0b6f70 0x7f454c0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.869+0000 7f4551a4a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c0d18e0 0x7f454c1f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.869+0000 7f4551a4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f454c0d3dc0 con 0x7f454c0b3b00 2024-09-17T03:00:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.869+0000 7f4551a4a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f454c0d3c40 con 0x7f454c0d18e0 2024-09-17T03:00:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.869+0000 7f4551a4a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f454c0d3f40 con 0x7f454c0b6f70 2024-09-17T03:00:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.869+0000 7f454affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 0x7f454c14af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 0x7f454c14af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:52036/0 (socket says 172.21.15.104:52036) 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454affd640 1 -- 172.21.15.104:0/3815416297 learned_addr learned my addr 172.21.15.104:0/3815416297 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454b7fe640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c0d18e0 0x7f454c1f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454a7fc640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f454c0b6f70 0x7f454c0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454affd640 1 -- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f454c0b6f70 msgr2=0x7f454c0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454affd640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f454c0b6f70 0x7f454c0cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454affd640 1 -- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c0d18e0 msgr2=0x7f454c1f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454affd640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c0d18e0 0x7f454c1f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454affd640 1 -- 172.21.15.104:0/3815416297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c14b8e0 con 0x7f454c0b3b00 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454b7fe640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c0d18e0 0x7f454c1f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f454affd640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 0x7f454c14af00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f453c00b3f0 tx=0x7f453c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f4533fff640 1 -- 172.21.15.104:0/3815416297 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c015020 con 0x7f454c0b3b00 2024-09-17T03:00:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f4533fff640 1 -- 172.21.15.104:0/3815416297 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f453c011920 con 0x7f454c0b3b00 2024-09-17T03:00:03.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c14bbc0 con 0x7f454c0b3b00 2024-09-17T03:00:03.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f4533fff640 1 -- 172.21.15.104:0/3815416297 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c011d70 con 0x7f454c0b3b00 2024-09-17T03:00:03.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.870+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c0cbfa0 con 0x7f454c0b3b00 2024-09-17T03:00:03.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.871+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454c0d4410 con 0x7f454c0b3b00 2024-09-17T03:00:03.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.872+0000 7f4533fff640 1 -- 172.21.15.104:0/3815416297 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f453c018020 con 0x7f454c0b3b00 2024-09-17T03:00:03.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.872+0000 7f4533fff640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4538078b90 0x7f453807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:03.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.872+0000 7f4533fff640 1 -- 172.21.15.104:0/3815416297 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f453c09a920 con 0x7f454c0b3b00 2024-09-17T03:00:03.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.873+0000 7f454a7fc640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4538078b90 0x7f453807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:03.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.873+0000 7f454a7fc640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4538078b90 0x7f453807b0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f45400058c0 tx=0x7f4540005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:03.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:03.877+0000 7f4533fff640 1 -- 172.21.15.104:0/3815416297 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f453c01f030 con 0x7f454c0b3b00 2024-09-17T03:00:04.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.054+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f454c06d3d0 con 0x7f454c0b3b00 2024-09-17T03:00:04.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.055+0000 7f4533fff640 1 -- 172.21.15.104:0/3815416297 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) ==== 81+0+34311 (secure 0 0 0) 0x7f453c062e80 con 0x7f454c0b3b00 2024-09-17T03:00:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:04.055 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:00:04.055 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 111, 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:00:00.942611+0000", 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:00:04.056 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 13, 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:00:04.057 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:00:04.058 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:00:04.059 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:00:04.060 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:00:04.061 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:00:04.062 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:00:04.063 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.064 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 12, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:28.780702+0000", 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:00:04.065 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:00:04.066 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:00:04.067 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:00:04.068 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:00:04.069 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.070 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 13, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:30.098469+0000", 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:00:04.072 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:00:04.073 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:00:04.074 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:00:04.075 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:00:04.076 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:00:04.077 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:00:04.078 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.079 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.080 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:00:04.081 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.082 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.083 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:00:04.084 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.085 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.086 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:00:04.087 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:00:04.088 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.089 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.091 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.092 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.094 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.095 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:00:04.096 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.097 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.100 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.101 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:00:04.102 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.103 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:00:04.108 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.110 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:00:04.111 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:00:04.114 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.115 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.117 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.118 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:00:04.120 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.121 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.126 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:00:04.128 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.129 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:00:04.130 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:00:04.131 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.132 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:00:04.133 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:00:04.134 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:00:04.135 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:00:04.135 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:00:04.135 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:00:04.135 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:00:04.135 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:00:04.135 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:00:04.135 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.135 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:00:04.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4538078b90 msgr2=0x7f453807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4538078b90 0x7f453807b0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f45400058c0 tx=0x7f4540005850 comp rx=0 tx=0).stop 2024-09-17T03:00:04.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 msgr2=0x7f454c14af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 0x7f454c14af00 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f453c00b3f0 tx=0x7f453c00b8b0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 shutdown_connections 2024-09-17T03:00:04.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4538078b90 0x7f453807b0a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f454c0d18e0 0x7f454c1f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f454c0b6f70 0x7f454c0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 --2- 172.21.15.104:0/3815416297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f454c0b3b00 0x7f454c14af00 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.057+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 >> 172.21.15.104:0/3815416297 conn(0x7f454c073df0 msgr2=0x7f454c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:04.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.058+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 shutdown_connections 2024-09-17T03:00:04.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.058+0000 7f4551a4a640 1 -- 172.21.15.104:0/3815416297 wait complete. 2024-09-17T03:00:04.138 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-17T03:00:04.138 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:00:04.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.252+0000 7f7eb75da640 1 -- 172.21.15.104:0/2536197297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb00cff70 msgr2=0x7f7eb015b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.252+0000 7f7eb75da640 1 --2- 172.21.15.104:0/2536197297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb00cff70 0x7f7eb015b170 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f7eac005fd0 tx=0x7f7eac02b910 comp rx=0 tx=0).stop 2024-09-17T03:00:04.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.252+0000 7f7eb75da640 1 -- 172.21.15.104:0/2536197297 shutdown_connections 2024-09-17T03:00:04.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.252+0000 7f7eb75da640 1 --2- 172.21.15.104:0/2536197297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb00cff70 0x7f7eb015b170 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.252+0000 7f7eb75da640 1 -- 172.21.15.104:0/2536197297 >> 172.21.15.104:0/2536197297 conn(0x7f7eb00b2450 msgr2=0x7f7eb00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:04.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.252+0000 7f7eb75da640 1 -- 172.21.15.104:0/2536197297 shutdown_connections 2024-09-17T03:00:04.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.252+0000 7f7eb75da640 1 -- 172.21.15.104:0/2536197297 wait complete. 2024-09-17T03:00:04.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.254+0000 7f7eb75da640 1 Processor -- start 2024-09-17T03:00:04.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.254+0000 7f7eb75da640 1 -- start start 2024-09-17T03:00:04.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb75da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb006f840 0x7f7eb014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:04.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb75da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb0073540 0x7f7eb014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:04.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb75da640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb00cff70 0x7f7eb01f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:04.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb75da640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb006fdd0 con 0x7f7eb0073540 2024-09-17T03:00:04.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb75da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb006fc50 con 0x7f7eb006f840 2024-09-17T03:00:04.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb75da640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb00b3e60 con 0x7f7eb00cff70 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb4b75640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb0073540 0x7f7eb014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb4b75640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb0073540 0x7f7eb014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39204/0 (socket says 172.21.15.104:39204) 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.255+0000 7f7eb4b75640 1 -- 172.21.15.104:0/464340607 learned_addr learned my addr 172.21.15.104:0/464340607 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb4b75640 1 -- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb00cff70 msgr2=0x7f7eb01f7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb4b75640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb00cff70 0x7f7eb01f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb5376640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb006f840 0x7f7eb014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb4b75640 1 -- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb006f840 msgr2=0x7f7eb014e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb4b75640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb006f840 0x7f7eb014e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb4b75640 1 -- 172.21.15.104:0/464340607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb014f800 con 0x7f7eb0073540 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb4b75640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb0073540 0x7f7eb014ed60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000b3f0 tx=0x7f7ea000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7ea5ffb640 1 -- 172.21.15.104:0/464340607 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0015020 con 0x7f7eb0073540 2024-09-17T03:00:04.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7ea5ffb640 1 -- 172.21.15.104:0/464340607 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ea0011920 con 0x7f7eb0073540 2024-09-17T03:00:04.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eb014fae0 con 0x7f7eb0073540 2024-09-17T03:00:04.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7ea5ffb640 1 -- 172.21.15.104:0/464340607 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0011d70 con 0x7f7eb0073540 2024-09-17T03:00:04.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.256+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eb01500a0 con 0x7f7eb0073540 2024-09-17T03:00:04.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.257+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eb015b170 con 0x7f7eb0073540 2024-09-17T03:00:04.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.258+0000 7f7ea5ffb640 1 -- 172.21.15.104:0/464340607 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ea0018020 con 0x7f7eb0073540 2024-09-17T03:00:04.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.258+0000 7f7ea5ffb640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e94078b90 0x7f7e9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:04.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.259+0000 7f7ea5ffb640 1 -- 172.21.15.104:0/464340607 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f7ea009a920 con 0x7f7eb0073540 2024-09-17T03:00:04.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.259+0000 7f7eb5376640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e94078b90 0x7f7e9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:04.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.259+0000 7f7eb5376640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e94078b90 0x7f7e9407b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7eac035000 tx=0x7f7eac004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:04.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.263+0000 7f7ea5ffb640 1 -- 172.21.15.104:0/464340607 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ea001f030 con 0x7f7eb0073540 2024-09-17T03:00:04.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.436+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f7eb00b2fe0 con 0x7f7eb0073540 2024-09-17T03:00:04.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.437+0000 7f7ea5ffb640 1 -- 172.21.15.104:0/464340607 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) ==== 81+0+34311 (secure 0 0 0) 0x7f7ea0062d60 con 0x7f7eb0073540 2024-09-17T03:00:04.437 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:04.437 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:00:04.437 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 111, 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:00:00.942611+0000", 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:00:04.438 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 13, 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:00:04.439 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:00:04.440 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:00:04.441 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:00:04.442 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:00:04.443 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.444 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:00:04.445 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:00:04.445 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:00:04.445 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:00:04.445 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:00:04.445 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:00:04.446 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.447 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 12, 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:28.780702+0000", 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:00:04.448 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:00:04.449 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:00:04.450 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:00:04.451 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:00:04.452 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:00:04.453 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:00:04.454 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 13, 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:59:30.098469+0000", 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:00:04.455 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:00:04.456 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:00:04.457 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:00:04.458 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:00:04.458 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:00:04.458 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:00:04.458 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:00:04.458 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:00:04.458 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:00:04.458 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:00:04.459 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:00:04.460 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:00:04.461 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:00:04.462 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:00:04.463 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.464 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.465 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.466 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:00:04.467 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.468 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:00:04.469 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.470 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:00:04.471 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.472 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.473 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.474 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.475 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.476 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:00:04.477 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.478 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.479 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.480 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.481 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.482 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.483 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.484 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.485 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:00:04.486 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.486 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.486 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.486 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.486 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.486 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.486 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.487 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:00:04.488 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.489 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.490 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.491 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.492 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.493 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:00:04.494 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.495 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.496 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.497 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:00:04.500 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.501 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.502 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.503 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:00:04.505 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:00:04.506 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:00:04.507 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 101, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:00:04.509 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:00:04.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.511 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:00:04.512 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:00:04.513 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:00:04.514 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.515 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:00:04.516 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:00:04.519 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:00:04.520 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:04.521 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:04.522 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:00:04.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e94078b90 msgr2=0x7f7e9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e94078b90 0x7f7e9407b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7eac035000 tx=0x7f7eac004730 comp rx=0 tx=0).stop 2024-09-17T03:00:04.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb0073540 msgr2=0x7f7eb014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb0073540 0x7f7eb014ed60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000b3f0 tx=0x7f7ea000b8b0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 shutdown_connections 2024-09-17T03:00:04.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e94078b90 0x7f7e9407b0a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb00cff70 0x7f7eb01f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7eb0073540 0x7f7eb014ed60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 --2- 172.21.15.104:0/464340607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb006f840 0x7f7eb014e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.439+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 >> 172.21.15.104:0/464340607 conn(0x7f7eb00b2450 msgr2=0x7f7eb0072d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:04.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.440+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 shutdown_connections 2024-09-17T03:00:04.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.440+0000 7f7eb75da640 1 -- 172.21.15.104:0/464340607 wait complete. 2024-09-17T03:00:04.526 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:04.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.640+0000 7f9dca08c640 1 -- 172.21.15.104:0/1500876822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc415c220 msgr2=0x7f9dc406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.640+0000 7f9dca08c640 1 --2- 172.21.15.104:0/1500876822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc415c220 0x7f9dc406f550 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9db4005fd0 tx=0x7f9db402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.640+0000 7f9dca08c640 1 -- 172.21.15.104:0/1500876822 shutdown_connections 2024-09-17T03:00:04.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.640+0000 7f9dca08c640 1 --2- 172.21.15.104:0/1500876822 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc40734f0 0x7f9dc4073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.640+0000 7f9dca08c640 1 --2- 172.21.15.104:0/1500876822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc415c220 0x7f9dc406f550 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.640+0000 7f9dca08c640 1 -- 172.21.15.104:0/1500876822 >> 172.21.15.104:0/1500876822 conn(0x7f9dc406d200 msgr2=0x7f9dc406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:04.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.640+0000 7f9dca08c640 1 -- 172.21.15.104:0/1500876822 shutdown_connections 2024-09-17T03:00:04.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.640+0000 7f9dca08c640 1 -- 172.21.15.104:0/1500876822 wait complete. 2024-09-17T03:00:04.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.642+0000 7f9dca08c640 1 Processor -- start 2024-09-17T03:00:04.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.642+0000 7f9dca08c640 1 -- start start 2024-09-17T03:00:04.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dca08c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc40734f0 0x7f9dc414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:04.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dca08c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc40b0500 0x7f9dc415f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dca08c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc415c220 0x7f9dc415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dca08c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc40b4f20 con 0x7f9dc40b0500 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dca08c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc40b1230 con 0x7f9dc40734f0 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dca08c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc40b50a0 con 0x7f9dc415c220 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dbbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc40b0500 0x7f9dc415f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dbbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc40b0500 0x7f9dc415f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39220/0 (socket says 172.21.15.104:39220) 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.643+0000 7f9dbbfff640 1 -- 172.21.15.104:0/2423941256 learned_addr learned my addr 172.21.15.104:0/2423941256 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dc37fe640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc40734f0 0x7f9dc414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dc3fff640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc415c220 0x7f9dc415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dbbfff640 1 -- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc415c220 msgr2=0x7f9dc415fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dbbfff640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc415c220 0x7f9dc415fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dbbfff640 1 -- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc40734f0 msgr2=0x7f9dc414d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dbbfff640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc40734f0 0x7f9dc414d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dbbfff640 1 -- 172.21.15.104:0/2423941256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc4150ac0 con 0x7f9dc40b0500 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dc3fff640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc415c220 0x7f9dc415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dbbfff640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc40b0500 0x7f9dc415f7d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009fd0 tx=0x7f9dac00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dc0ff9640 1 -- 172.21.15.104:0/2423941256 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00ccc0 con 0x7f9dc40b0500 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dc0ff9640 1 -- 172.21.15.104:0/2423941256 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dac00ee70 con 0x7f9dc40b0500 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc4150da0 con 0x7f9dc40b0500 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dc0ff9640 1 -- 172.21.15.104:0/2423941256 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac00ce60 con 0x7f9dc40b0500 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.644+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc41591b0 con 0x7f9dc40b0500 2024-09-17T03:00:04.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.645+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc4073900 con 0x7f9dc40b0500 2024-09-17T03:00:04.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.646+0000 7f9dc0ff9640 1 -- 172.21.15.104:0/2423941256 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9dac005260 con 0x7f9dc40b0500 2024-09-17T03:00:04.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.646+0000 7f9dc0ff9640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9da4078b90 0x7f9da407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:04.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.646+0000 7f9dc0ff9640 1 -- 172.21.15.104:0/2423941256 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f9dac09b9a0 con 0x7f9dc40b0500 2024-09-17T03:00:04.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.647+0000 7f9dc37fe640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9da4078b90 0x7f9da407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:04.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.647+0000 7f9dc37fe640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9da4078b90 0x7f9da407b0a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9db4033000 tx=0x7f9db4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:04.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.650+0000 7f9dc0ff9640 1 -- 172.21.15.104:0/2423941256 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9dac063f50 con 0x7f9dc40b0500 2024-09-17T03:00:04.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.857+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dc4070810 con 0x7f9dc40b0500 2024-09-17T03:00:04.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.858+0000 7f9dc0ff9640 1 -- 172.21.15.104:0/2423941256 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7f9dac063850 con 0x7f9dc40b0500 2024-09-17T03:00:04.858 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:04.858 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T03:00:04.858 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9da4078b90 msgr2=0x7f9da407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9da4078b90 0x7f9da407b0a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9db4033000 tx=0x7f9db4004730 comp rx=0 tx=0).stop 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc40b0500 msgr2=0x7f9dc415f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc40b0500 0x7f9dc415f7d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009fd0 tx=0x7f9dac00ec20 comp rx=0 tx=0).stop 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 shutdown_connections 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9da4078b90 0x7f9da407b0a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9dc415c220 0x7f9dc415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9dc40b0500 0x7f9dc415f7d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 --2- 172.21.15.104:0/2423941256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dc40734f0 0x7f9dc414d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:04.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 >> 172.21.15.104:0/2423941256 conn(0x7f9dc406d200 msgr2=0x7f9dc4155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:04.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 shutdown_connections 2024-09-17T03:00:04.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:04.860+0000 7f9dca08c640 1 -- 172.21.15.104:0/2423941256 wait complete. 2024-09-17T03:00:04.871 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T03:00:04.996 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":6282,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.196570440999999,"mdsmap_epoch":42,"osdmap_epoch":111,"osdmap_epoch_barrier":106,"uptime":45.130739650000002} 2024-09-17T03:00:04.996 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 6282, "mdsmap_epoch": 42, "osdmap_epoch": 111, "osdmap_epoch_barrier": 106, "rank_uptime": 33.196570441, "state": "up:active", "uptime": 45.13073965, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:00:04.996 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:00:04.996 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:04.997 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:05.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:05.013 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-17T03:00:05.248 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records in 2024-09-17T03:00:05.248 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records out 2024-09-17T03:00:05.249 INFO:teuthology.orchestra.run.smithi104.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.179409 s, 292 MB/s 2024-09-17T03:00:05.250 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:00:05.250 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:00:05.291 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:00:05.333 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:00:05.334 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:00:05.334 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:05.334 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:05.350 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:05.350 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:05.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:00:05.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.560+0000 7f2dc86cc640 1 -- 172.21.15.104:0/848008342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00b6f70 msgr2=0x7f2dc015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:05.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.560+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/848008342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00b6f70 0x7f2dc015ef90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc005fd0 tx=0x7f2dbc02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.560+0000 7f2dc86cc640 1 -- 172.21.15.104:0/848008342 shutdown_connections 2024-09-17T03:00:05.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.560+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/848008342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc00d18e0 0x7f2dc00d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.560+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/848008342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00b6f70 0x7f2dc015ef90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.560+0000 7f2dc86cc640 1 -- 172.21.15.104:0/848008342 >> 172.21.15.104:0/848008342 conn(0x7f2dc0073df0 msgr2=0x7f2dc0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:05.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.560+0000 7f2dc86cc640 1 -- 172.21.15.104:0/848008342 shutdown_connections 2024-09-17T03:00:05.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.560+0000 7f2dc86cc640 1 -- 172.21.15.104:0/848008342 wait complete. 2024-09-17T03:00:05.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.562+0000 7f2dc86cc640 1 Processor -- start 2024-09-17T03:00:05.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.562+0000 7f2dc86cc640 1 -- start start 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc86cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc00b3b00 0x7f2dc01501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc86cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc00b6f70 0x7f2dc00caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc86cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00d18e0 0x7f2dc00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc86cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc00d3e40 con 0x7f2dc00d18e0 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc86cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc00d3cc0 con 0x7f2dc00b3b00 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc86cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc00d3fc0 con 0x7f2dc00b6f70 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6c69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00d18e0 0x7f2dc00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6c69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00d18e0 0x7f2dc00ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39236/0 (socket says 172.21.15.104:39236) 2024-09-17T03:00:05.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6c69640 1 -- 172.21.15.104:0/4085612168 learned_addr learned my addr 172.21.15.104:0/4085612168 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6468640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc00b3b00 0x7f2dc01501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc5c67640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc00b6f70 0x7f2dc00caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6c69640 1 -- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc00b6f70 msgr2=0x7f2dc00caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6c69640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc00b6f70 0x7f2dc00caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6c69640 1 -- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc00b3b00 msgr2=0x7f2dc01501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6c69640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc00b3b00 0x7f2dc01501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc6c69640 1 -- 172.21.15.104:0/4085612168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc00cd3e0 con 0x7f2dc00d18e0 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.563+0000 7f2dc5c67640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc00b6f70 0x7f2dc00caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.564+0000 7f2dc6c69640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00d18e0 0x7f2dc00ccea0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2db800ea80 tx=0x7f2db800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.564+0000 7f2db6ffd640 1 -- 172.21.15.104:0/4085612168 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8004b20 con 0x7f2dc00d18e0 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.564+0000 7f2db6ffd640 1 -- 172.21.15.104:0/4085612168 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db8004ce0 con 0x7f2dc00d18e0 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.564+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc00cbe00 con 0x7f2dc00d18e0 2024-09-17T03:00:05.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.564+0000 7f2db6ffd640 1 -- 172.21.15.104:0/4085612168 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8005280 con 0x7f2dc00d18e0 2024-09-17T03:00:05.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.564+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc00cc3c0 con 0x7f2dc00d18e0 2024-09-17T03:00:05.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.565+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc00cbb70 con 0x7f2dc00d18e0 2024-09-17T03:00:05.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.565+0000 7f2db6ffd640 1 -- 172.21.15.104:0/4085612168 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2db8005420 con 0x7f2dc00d18e0 2024-09-17T03:00:05.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.566+0000 7f2db6ffd640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2da4078bc0 0x7f2da407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:05.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.566+0000 7f2db6ffd640 1 -- 172.21.15.104:0/4085612168 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f2db809b8f0 con 0x7f2dc00d18e0 2024-09-17T03:00:05.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.566+0000 7f2dc6468640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2da4078bc0 0x7f2da407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:05.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.567+0000 7f2dc6468640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2da4078bc0 0x7f2da407b0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc033000 tx=0x7f2dbc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:05.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.570+0000 7f2db6ffd640 1 -- 172.21.15.104:0/4085612168 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2db8063d30 con 0x7f2dc00d18e0 2024-09-17T03:00:05.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.755+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2dc00d44b0 con 0x7f2dc00d18e0 2024-09-17T03:00:05.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.756+0000 7f2db6ffd640 1 -- 172.21.15.104:0/4085612168 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) ==== 80+0+0 (secure 0 0 0) 0x7f2db8063630 con 0x7f2dc00d18e0 2024-09-17T03:00:05.755 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2da4078bc0 msgr2=0x7f2da407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2da4078bc0 0x7f2da407b0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc033000 tx=0x7f2dbc004730 comp rx=0 tx=0).stop 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00d18e0 msgr2=0x7f2dc00ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00d18e0 0x7f2dc00ccea0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2db800ea80 tx=0x7f2db800ef40 comp rx=0 tx=0).stop 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 shutdown_connections 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2da4078bc0 0x7f2da407b0d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2dc00d18e0 0x7f2dc00ccea0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2dc00b6f70 0x7f2dc00caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 --2- 172.21.15.104:0/4085612168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2dc00b3b00 0x7f2dc01501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 >> 172.21.15.104:0/4085612168 conn(0x7f2dc0073df0 msgr2=0x7f2dc0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 shutdown_connections 2024-09-17T03:00:05.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:05.758+0000 7f2dc86cc640 1 -- 172.21.15.104:0/4085612168 wait complete. 2024-09-17T03:00:05.768 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:00:05.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:05.768 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:00:05.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:00:05.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:05.820 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:00:05.843 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:00:05.843 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:05.843 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:05.860 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:05.860 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:05.918 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:00:05.921 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:00:05.963 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:00:06.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 -- 172.21.15.104:0/3717773821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd4162990 msgr2=0x7f6cd4162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 --2- 172.21.15.104:0/3717773821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd4162990 0x7f6cd4162da0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4073970 tx=0x7f6cc402a580 comp rx=0 tx=0).stop 2024-09-17T03:00:06.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 -- 172.21.15.104:0/3717773821 shutdown_connections 2024-09-17T03:00:06.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 --2- 172.21.15.104:0/3717773821 >> v2:172.21.15.192:3300/0 conn(0x7f6cd40d1c40 0x7f6cd40d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 --2- 172.21.15.104:0/3717773821 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd4162990 0x7f6cd4162da0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 --2- 172.21.15.104:0/3717773821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cd415feb0 0x7f6cd4155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 -- 172.21.15.104:0/3717773821 >> 172.21.15.104:0/3717773821 conn(0x7f6cd406d200 msgr2=0x7f6cd406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:06.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 -- 172.21.15.104:0/3717773821 shutdown_connections 2024-09-17T03:00:06.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.035+0000 7f6cdc015640 1 -- 172.21.15.104:0/3717773821 wait complete. 2024-09-17T03:00:06.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.037+0000 7f6cdc015640 1 Processor -- start 2024-09-17T03:00:06.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.037+0000 7f6cdc015640 1 -- start start 2024-09-17T03:00:06.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cdc015640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd40d1c40 0x7f6cd40b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cdc015640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cd415feb0 0x7f6cd4145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cdc015640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cd4162990 0x7f6cd41451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cdc015640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd40b4970 con 0x7f6cd40d1c40 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cdc015640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd40b47f0 con 0x7f6cd4162990 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cdc015640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd40b4af0 con 0x7f6cd415feb0 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd40d1c40 0x7f6cd40b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd40d1c40 0x7f6cd40b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39258/0 (socket says 172.21.15.104:39258) 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 -- 172.21.15.104:0/1761199043 learned_addr learned my addr 172.21.15.104:0/1761199043 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd95b0640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cd415feb0 0x7f6cd4145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cda5b2640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cd4162990 0x7f6cd41451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 -- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cd415feb0 msgr2=0x7f6cd4145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cd415feb0 0x7f6cd4145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 -- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cd4162990 msgr2=0x7f6cd41451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cd4162990 0x7f6cd41451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 -- 172.21.15.104:0/1761199043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd40b3780 con 0x7f6cd40d1c40 2024-09-17T03:00:06.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.038+0000 7f6cd9db1640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd40d1c40 0x7f6cd40b3ae0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000cce0 tx=0x7f6cd00075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:06.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.039+0000 7f6cca7fc640 1 -- 172.21.15.104:0/1761199043 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0004b20 con 0x7f6cd40d1c40 2024-09-17T03:00:06.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.039+0000 7f6cca7fc640 1 -- 172.21.15.104:0/1761199043 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cd0004db0 con 0x7f6cd40d1c40 2024-09-17T03:00:06.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.039+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd40b34a0 con 0x7f6cd40d1c40 2024-09-17T03:00:06.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.039+0000 7f6cca7fc640 1 -- 172.21.15.104:0/1761199043 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0005280 con 0x7f6cd40d1c40 2024-09-17T03:00:06.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.039+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd40cefe0 con 0x7f6cd40d1c40 2024-09-17T03:00:06.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.040+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd40746a0 con 0x7f6cd40d1c40 2024-09-17T03:00:06.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.040+0000 7f6cca7fc640 1 -- 172.21.15.104:0/1761199043 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cd0005420 con 0x7f6cd40d1c40 2024-09-17T03:00:06.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.041+0000 7f6cca7fc640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.041+0000 7f6cca7fc640 1 -- 172.21.15.104:0/1761199043 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f6cd009b440 con 0x7f6cd40d1c40 2024-09-17T03:00:06.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.041+0000 7f6cd95b0640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.042+0000 7f6cd95b0640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6cb8078b90 0x7f6cb807b0a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4033000 tx=0x7f6cc4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:06.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.045+0000 7f6cca7fc640 1 -- 172.21.15.104:0/1761199043 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6cd40746a0 con 0x7f6cd40d1c40 2024-09-17T03:00:06.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.232+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6cd4155c80 con 0x7f6cd40d1c40 2024-09-17T03:00:06.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.232+0000 7f6cca7fc640 1 -- 172.21.15.104:0/1761199043 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) ==== 80+0+0 (secure 0 0 0) 0x7f6cd0014030 con 0x7f6cd40d1c40 2024-09-17T03:00:06.232 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:00:06.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.234+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6cb8078b90 msgr2=0x7f6cb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.234+0000 7f6cdc015640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6cb8078b90 0x7f6cb807b0a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4033000 tx=0x7f6cc4004730 comp rx=0 tx=0).stop 2024-09-17T03:00:06.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.234+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd40d1c40 msgr2=0x7f6cd40b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.234+0000 7f6cdc015640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd40d1c40 0x7f6cd40b3ae0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000cce0 tx=0x7f6cd00075f0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.235+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 shutdown_connections 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.235+0000 7f6cdc015640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6cb8078b90 0x7f6cb807b0a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.235+0000 7f6cdc015640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cd4162990 0x7f6cd41451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.235+0000 7f6cdc015640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6cd415feb0 0x7f6cd4145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.235+0000 7f6cdc015640 1 --2- 172.21.15.104:0/1761199043 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6cd40d1c40 0x7f6cd40b3ae0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.235+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 >> 172.21.15.104:0/1761199043 conn(0x7f6cd406d200 msgr2=0x7f6cd41604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.235+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 shutdown_connections 2024-09-17T03:00:06.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.235+0000 7f6cdc015640 1 -- 172.21.15.104:0/1761199043 wait complete. 2024-09-17T03:00:06.245 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:00:06.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:06.245 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:00:06.274 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:00:06.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:06.274 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:00:06.330 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:00:06.330 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:06.330 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:06.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:00:06.346 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:00:06.346 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:06.346 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:06.386 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:00:06.386 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:06.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.498+0000 7fdbf02ec640 1 -- 172.21.15.104:0/3607601814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe806f840 msgr2=0x7fdbe8072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.498+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/3607601814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe806f840 0x7fdbe8072e30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8005fd0 tx=0x7fdbd802a540 comp rx=0 tx=0).stop 2024-09-17T03:00:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.498+0000 7fdbf02ec640 1 -- 172.21.15.104:0/3607601814 shutdown_connections 2024-09-17T03:00:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.498+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/3607601814 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbe8073370 0x7fdbe80b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.498+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/3607601814 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe806f840 0x7fdbe8072e30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.498+0000 7fdbf02ec640 1 -- 172.21.15.104:0/3607601814 >> 172.21.15.104:0/3607601814 conn(0x7fdbe80b2450 msgr2=0x7fdbe80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.498+0000 7fdbf02ec640 1 -- 172.21.15.104:0/3607601814 shutdown_connections 2024-09-17T03:00:06.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.498+0000 7fdbf02ec640 1 -- 172.21.15.104:0/3607601814 wait complete. 2024-09-17T03:00:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.499+0000 7fdbf02ec640 1 Processor -- start 2024-09-17T03:00:06.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.500+0000 7fdbf02ec640 1 -- start start 2024-09-17T03:00:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbf02ec640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbe806f840 0x7fdbe81f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbf02ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbe8073370 0x7fdbe814a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbf02ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe80cff70 0x7fdbe814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbf02ec640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe806fdd0 con 0x7fdbe80cff70 2024-09-17T03:00:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbf02ec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe806fc50 con 0x7fdbe8073370 2024-09-17T03:00:06.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbf02ec640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe80b3c90 con 0x7fdbe806f840 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe80cff70 0x7fdbe814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe80cff70 0x7fdbe814af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39276/0 (socket says 172.21.15.104:39276) 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 -- 172.21.15.104:0/2721872685 learned_addr learned my addr 172.21.15.104:0/2721872685 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee088640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbe806f840 0x7fdbe81f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbed887640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbe8073370 0x7fdbe814a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 -- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbe806f840 msgr2=0x7fdbe81f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbe806f840 0x7fdbe81f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 -- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbe8073370 msgr2=0x7fdbe814a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbe8073370 0x7fdbe814a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 -- 172.21.15.104:0/2721872685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe8148b90 con 0x7fdbe80cff70 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.501+0000 7fdbee889640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe80cff70 0x7fdbe814af10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000ec00 tx=0x7fdbe000b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:06.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.502+0000 7fdbdeffd640 1 -- 172.21.15.104:0/2721872685 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000be40 con 0x7fdbe80cff70 2024-09-17T03:00:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.502+0000 7fdbdeffd640 1 -- 172.21.15.104:0/2721872685 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbe0004b20 con 0x7fdbe80cff70 2024-09-17T03:00:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.502+0000 7fdbdeffd640 1 -- 172.21.15.104:0/2721872685 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0005020 con 0x7fdbe80cff70 2024-09-17T03:00:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.502+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe8148e70 con 0x7fdbe80cff70 2024-09-17T03:00:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.502+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe8149430 con 0x7fdbe80cff70 2024-09-17T03:00:06.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.503+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe815e390 con 0x7fdbe80cff70 2024-09-17T03:00:06.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.503+0000 7fdbdeffd640 1 -- 172.21.15.104:0/2721872685 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbe00051c0 con 0x7fdbe80cff70 2024-09-17T03:00:06.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.504+0000 7fdbdeffd640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbcc078bc0 0x7fdbcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.504+0000 7fdbdeffd640 1 -- 172.21.15.104:0/2721872685 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7fdbe009d270 con 0x7fdbe80cff70 2024-09-17T03:00:06.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.504+0000 7fdbee088640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbcc078bc0 0x7fdbcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.505+0000 7fdbee088640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbcc078bc0 0x7fdbcc07b0d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4001720 tx=0x7fdbe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:06.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.509+0000 7fdbdeffd640 1 -- 172.21.15.104:0/2721872685 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbe815e390 con 0x7fdbe80cff70 2024-09-17T03:00:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.717+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbe80c80c0 con 0x7fdbe80cff70 2024-09-17T03:00:06.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.718+0000 7fdbdeffd640 1 -- 172.21.15.104:0/2721872685 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7fdbe0065060 con 0x7fdbe80cff70 2024-09-17T03:00:06.717 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:06.718 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T03:00:06.718 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T03:00:06.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbcc078bc0 msgr2=0x7fdbcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbcc078bc0 0x7fdbcc07b0d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4001720 tx=0x7fdbe4009040 comp rx=0 tx=0).stop 2024-09-17T03:00:06.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe80cff70 msgr2=0x7fdbe814af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe80cff70 0x7fdbe814af10 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000ec00 tx=0x7fdbe000b690 comp rx=0 tx=0).stop 2024-09-17T03:00:06.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 shutdown_connections 2024-09-17T03:00:06.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdbcc078bc0 0x7fdbcc07b0d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbe8073370 0x7fdbe814a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdbe80cff70 0x7fdbe814af10 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 --2- 172.21.15.104:0/2721872685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdbe806f840 0x7fdbe81f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 >> 172.21.15.104:0/2721872685 conn(0x7fdbe80b2450 msgr2=0x7fdbe80b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 shutdown_connections 2024-09-17T03:00:06.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.720+0000 7fdbf02ec640 1 -- 172.21.15.104:0/2721872685 wait complete. 2024-09-17T03:00:06.731 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:06.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.843+0000 7f0acd313640 1 -- 172.21.15.104:0/4243315219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 msgr2=0x7f0ac815c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.843+0000 7f0acd313640 1 --2- 172.21.15.104:0/4243315219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 0x7f0ac815c470 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009830 tx=0x7f0abc02a480 comp rx=0 tx=0).stop 2024-09-17T03:00:06.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.843+0000 7f0acd313640 1 -- 172.21.15.104:0/4243315219 shutdown_connections 2024-09-17T03:00:06.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.843+0000 7f0acd313640 1 --2- 172.21.15.104:0/4243315219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 0x7f0ac815c470 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.843+0000 7f0acd313640 1 --2- 172.21.15.104:0/4243315219 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ac8152cd0 0x7f0ac80b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.843+0000 7f0acd313640 1 -- 172.21.15.104:0/4243315219 >> 172.21.15.104:0/4243315219 conn(0x7f0ac80b35d0 msgr2=0x7f0ac80b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:06.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.843+0000 7f0acd313640 1 -- 172.21.15.104:0/4243315219 shutdown_connections 2024-09-17T03:00:06.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.843+0000 7f0acd313640 1 -- 172.21.15.104:0/4243315219 wait complete. 2024-09-17T03:00:06.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.845+0000 7f0acd313640 1 Processor -- start 2024-09-17T03:00:06.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.845+0000 7f0acd313640 1 -- start start 2024-09-17T03:00:06.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.846+0000 7f0acd313640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ac8073560 0x7f0ac81f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.846+0000 7f0acd313640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ac8152cd0 0x7f0ac814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.846+0000 7f0acd313640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 0x7f0ac8155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.846+0000 7f0acd313640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac806f7d0 con 0x7f0ac815c060 2024-09-17T03:00:06.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.846+0000 7f0acd313640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac806f650 con 0x7f0ac8152cd0 2024-09-17T03:00:06.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.846+0000 7f0acd313640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac806f950 con 0x7f0ac8073560 2024-09-17T03:00:06.847 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 0x7f0ac8155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 0x7f0ac8155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39302/0 (socket says 172.21.15.104:39302) 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 -- 172.21.15.104:0/2491766336 learned_addr learned my addr 172.21.15.104:0/2491766336 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac67fc640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ac8152cd0 0x7f0ac814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac6ffd640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ac8073560 0x7f0ac81f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 -- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ac8073560 msgr2=0x7f0ac81f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ac8073560 0x7f0ac81f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 -- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ac8152cd0 msgr2=0x7f0ac814c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ac8152cd0 0x7f0ac814c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 -- 172.21.15.104:0/2491766336 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac81f40a0 con 0x7f0ac815c060 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac67fc640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ac8152cd0 0x7f0ac814c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac6ffd640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ac8073560 0x7f0ac81f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0ac77fe640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 0x7f0ac8155700 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000c3f0 tx=0x7f0ac000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0aaf7fe640 1 -- 172.21.15.104:0/2491766336 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0017070 con 0x7f0ac815c060 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0aaf7fe640 1 -- 172.21.15.104:0/2491766336 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ac00035f0 con 0x7f0ac815c060 2024-09-17T03:00:06.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac8153790 con 0x7f0ac815c060 2024-09-17T03:00:06.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0aaf7fe640 1 -- 172.21.15.104:0/2491766336 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0003a40 con 0x7f0ac815c060 2024-09-17T03:00:06.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.847+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac814ca60 con 0x7f0ac815c060 2024-09-17T03:00:06.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.848+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac8153d10 con 0x7f0ac815c060 2024-09-17T03:00:06.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.849+0000 7f0aaf7fe640 1 -- 172.21.15.104:0/2491766336 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ac001a070 con 0x7f0ac815c060 2024-09-17T03:00:06.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.850+0000 7f0aaf7fe640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ab4078bc0 0x7f0ab407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:06.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.850+0000 7f0aaf7fe640 1 -- 172.21.15.104:0/2491766336 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f0ac0099fb0 con 0x7f0ac815c060 2024-09-17T03:00:06.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.850+0000 7f0ac6ffd640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ab4078bc0 0x7f0ab407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:06.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.850+0000 7f0ac6ffd640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ab4078bc0 0x7f0ab407b0d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8005fd0 tx=0x7f0ab8009340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:06.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:06.854+0000 7f0aaf7fe640 1 -- 172.21.15.104:0/2491766336 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ac81f40a0 con 0x7f0ac815c060 2024-09-17T03:00:07.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.061+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ac806fe00 con 0x7f0ac815c060 2024-09-17T03:00:07.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.062+0000 7f0aaf7fe640 1 -- 172.21.15.104:0/2491766336 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7f0ac00624b0 con 0x7f0ac815c060 2024-09-17T03:00:07.061 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:07.062 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T03:00:07.062 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ab4078bc0 msgr2=0x7f0ab407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ab4078bc0 0x7f0ab407b0d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8005fd0 tx=0x7f0ab8009340 comp rx=0 tx=0).stop 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 msgr2=0x7f0ac8155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 0x7f0ac8155700 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000c3f0 tx=0x7f0ac000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 shutdown_connections 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ab4078bc0 0x7f0ab407b0d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ac8152cd0 0x7f0ac814c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ac815c060 0x7f0ac8155700 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 --2- 172.21.15.104:0/2491766336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ac8073560 0x7f0ac81f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 >> 172.21.15.104:0/2491766336 conn(0x7f0ac80b35d0 msgr2=0x7f0ac80b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:07.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 shutdown_connections 2024-09-17T03:00:07.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.064+0000 7f0acd313640 1 -- 172.21.15.104:0/2491766336 wait complete. 2024-09-17T03:00:07.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:07.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.188+0000 7f5d94694640 1 -- 172.21.15.104:0/1012629048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c072cf0 msgr2=0x7f5d8c073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.188+0000 7f5d94694640 1 --2- 172.21.15.104:0/1012629048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c072cf0 0x7f5d8c073100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c005fd0 tx=0x7f5d7c02a4b0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.188+0000 7f5d94694640 1 -- 172.21.15.104:0/1012629048 shutdown_connections 2024-09-17T03:00:07.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.188+0000 7f5d94694640 1 --2- 172.21.15.104:0/1012629048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c072cf0 0x7f5d8c073100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.188+0000 7f5d94694640 1 --2- 172.21.15.104:0/1012629048 >> v2:172.21.15.192:3300/0 conn(0x7f5d8c06f6b0 0x7f5d8c0ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.188+0000 7f5d94694640 1 -- 172.21.15.104:0/1012629048 >> 172.21.15.104:0/1012629048 conn(0x7f5d8c06eb90 msgr2=0x7f5d8c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:07.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.188+0000 7f5d94694640 1 -- 172.21.15.104:0/1012629048 shutdown_connections 2024-09-17T03:00:07.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.188+0000 7f5d94694640 1 -- 172.21.15.104:0/1012629048 wait complete. 2024-09-17T03:00:07.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.190+0000 7f5d94694640 1 Processor -- start 2024-09-17T03:00:07.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.190+0000 7f5d94694640 1 -- start start 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d94694640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c06f6b0 0x7f5d8c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d94694640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d8c072cf0 0x7f5d8c1f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d94694640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c1607f0 0x7f5d8c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d94694640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c15df90 con 0x7f5d8c072cf0 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d94694640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c15de10 con 0x7f5d8c1607f0 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d94694640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8c152350 con 0x7f5d8c06f6b0 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d91c2f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d8c072cf0 0x7f5d8c1f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d91c2f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d8c072cf0 0x7f5d8c1f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39318/0 (socket says 172.21.15.104:39318) 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d91c2f640 1 -- 172.21.15.104:0/1121064947 learned_addr learned my addr 172.21.15.104:0/1121064947 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d92430640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c06f6b0 0x7f5d8c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d92c31640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c1607f0 0x7f5d8c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d91c2f640 1 -- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c06f6b0 msgr2=0x7f5d8c1528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d91c2f640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c06f6b0 0x7f5d8c1528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d91c2f640 1 -- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c1607f0 msgr2=0x7f5d8c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d91c2f640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c1607f0 0x7f5d8c15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.191+0000 7f5d91c2f640 1 -- 172.21.15.104:0/1121064947 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c1599a0 con 0x7f5d8c072cf0 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.192+0000 7f5d91c2f640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d8c072cf0 0x7f5d8c1f40a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c034040 tx=0x7f5d7c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.192+0000 7f5d82ffd640 1 -- 172.21.15.104:0/1121064947 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c03e030 con 0x7f5d8c072cf0 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.192+0000 7f5d82ffd640 1 -- 172.21.15.104:0/1121064947 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d7c003d90 con 0x7f5d8c072cf0 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.192+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c159c80 con 0x7f5d8c072cf0 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.192+0000 7f5d82ffd640 1 -- 172.21.15.104:0/1121064947 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c035040 con 0x7f5d8c072cf0 2024-09-17T03:00:07.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.192+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c15a240 con 0x7f5d8c072cf0 2024-09-17T03:00:07.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.193+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8c1615d0 con 0x7f5d8c072cf0 2024-09-17T03:00:07.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.194+0000 7f5d82ffd640 1 -- 172.21.15.104:0/1121064947 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d7c041030 con 0x7f5d8c072cf0 2024-09-17T03:00:07.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.194+0000 7f5d82ffd640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d70078b90 0x7f5d7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.194+0000 7f5d82ffd640 1 -- 172.21.15.104:0/1121064947 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f5d7c0bb4a0 con 0x7f5d8c072cf0 2024-09-17T03:00:07.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.194+0000 7f5d92430640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d70078b90 0x7f5d7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.195 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.195+0000 7f5d92430640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d70078b90 0x7f5d7007b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009b30 tx=0x7f5d88005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:07.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.199+0000 7f5d82ffd640 1 -- 172.21.15.104:0/1121064947 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5d7c083210 con 0x7f5d8c072cf0 2024-09-17T03:00:07.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.375+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d8c160f80 con 0x7f5d8c072cf0 2024-09-17T03:00:07.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.376+0000 7f5d82ffd640 1 -- 172.21.15.104:0/1121064947 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+16780 (secure 0 0 0) 0x7f5d7c087c40 con 0x7f5d8c072cf0 2024-09-17T03:00:07.376 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:07.376 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":111,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:00.942611+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:59:28.780702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T02:59:30.098469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:07.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.378+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d70078b90 msgr2=0x7f5d7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.378+0000 7f5d94694640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d70078b90 0x7f5d7007b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009b30 tx=0x7f5d88005f90 comp rx=0 tx=0).stop 2024-09-17T03:00:07.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.378+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d8c072cf0 msgr2=0x7f5d8c1f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.378+0000 7f5d94694640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d8c072cf0 0x7f5d8c1f40a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c034040 tx=0x7f5d7c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.379+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 shutdown_connections 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.379+0000 7f5d94694640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5d70078b90 0x7f5d7007b0a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.379+0000 7f5d94694640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c1607f0 0x7f5d8c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.379+0000 7f5d94694640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5d8c072cf0 0x7f5d8c1f40a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.379+0000 7f5d94694640 1 --2- 172.21.15.104:0/1121064947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5d8c06f6b0 0x7f5d8c1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.379+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 >> 172.21.15.104:0/1121064947 conn(0x7f5d8c06eb90 msgr2=0x7f5d8c06ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.379+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 shutdown_connections 2024-09-17T03:00:07.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.379+0000 7f5d94694640 1 -- 172.21.15.104:0/1121064947 wait complete. 2024-09-17T03:00:07.390 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:00:07.390 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:07.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.503+0000 7f396ad57640 1 -- 172.21.15.104:0/2505341613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640b5d20 msgr2=0x7f39640cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.503+0000 7f396ad57640 1 --2- 172.21.15.104:0/2505341613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640b5d20 0x7f39640cfa80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f395c005fd0 tx=0x7f395c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:00:07.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.503+0000 7f396ad57640 1 -- 172.21.15.104:0/2505341613 shutdown_connections 2024-09-17T03:00:07.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.503+0000 7f396ad57640 1 --2- 172.21.15.104:0/2505341613 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640b5d20 0x7f39640cfa80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.503+0000 7f396ad57640 1 --2- 172.21.15.104:0/2505341613 >> v2:172.21.15.192:3300/0 conn(0x7f39640cdf10 0x7f39640b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.503+0000 7f396ad57640 1 -- 172.21.15.104:0/2505341613 >> 172.21.15.104:0/2505341613 conn(0x7f39640b44a0 msgr2=0x7f39640b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:07.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.503+0000 7f396ad57640 1 -- 172.21.15.104:0/2505341613 shutdown_connections 2024-09-17T03:00:07.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.503+0000 7f396ad57640 1 -- 172.21.15.104:0/2505341613 wait complete. 2024-09-17T03:00:07.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.505+0000 7f396ad57640 1 Processor -- start 2024-09-17T03:00:07.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.505+0000 7f396ad57640 1 -- start start 2024-09-17T03:00:07.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f396ad57640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39640b4fc0 0x7f39641f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f396ad57640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39640b5d20 0x7f3964153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f396ad57640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640cdf10 0x7f39640c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f396ad57640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3964160f50 con 0x7f39640b5d20 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f396ad57640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39640d0210 con 0x7f39640b4fc0 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f396ad57640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f39641610d0 con 0x7f39640cdf10 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f3963fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39640b5d20 0x7f3964153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f3963fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39640b5d20 0x7f3964153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39330/0 (socket says 172.21.15.104:39330) 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f3963fff640 1 -- 172.21.15.104:0/153155041 learned_addr learned my addr 172.21.15.104:0/153155041 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f39692f4640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640cdf10 0x7f39640c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.506+0000 7f3968af3640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39640b4fc0 0x7f39641f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f3963fff640 1 -- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640cdf10 msgr2=0x7f39640c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f3963fff640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640cdf10 0x7f39640c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f3963fff640 1 -- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39640b4fc0 msgr2=0x7f39641f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f3963fff640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39640b4fc0 0x7f39641f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f3963fff640 1 -- 172.21.15.104:0/153155041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3964153ea0 con 0x7f39640b5d20 2024-09-17T03:00:07.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f39692f4640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640cdf10 0x7f39640c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:07.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f3963fff640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39640b5d20 0x7f3964153960 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3958009fd0 tx=0x7f395800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:07.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f39617fa640 1 -- 172.21.15.104:0/153155041 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395800ccc0 con 0x7f39640b5d20 2024-09-17T03:00:07.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f39617fa640 1 -- 172.21.15.104:0/153155041 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f395800ee70 con 0x7f39640b5d20 2024-09-17T03:00:07.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f39617fa640 1 -- 172.21.15.104:0/153155041 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395800ce60 con 0x7f39640b5d20 2024-09-17T03:00:07.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39640caa60 con 0x7f39640b5d20 2024-09-17T03:00:07.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.507+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39641f7380 con 0x7f39640b5d20 2024-09-17T03:00:07.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.508+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39640ca7d0 con 0x7f39640b5d20 2024-09-17T03:00:07.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.509+0000 7f39617fa640 1 -- 172.21.15.104:0/153155041 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3958005260 con 0x7f39640b5d20 2024-09-17T03:00:07.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.509+0000 7f39617fa640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3950078b90 0x7f395007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.509+0000 7f39617fa640 1 -- 172.21.15.104:0/153155041 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f395809b700 con 0x7f39640b5d20 2024-09-17T03:00:07.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.509+0000 7f3968af3640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3950078b90 0x7f395007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.510+0000 7f3968af3640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3950078b90 0x7f395007b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f39540015e0 tx=0x7f3954009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:07.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.514+0000 7f39617fa640 1 -- 172.21.15.104:0/153155041 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3958063ab0 con 0x7f39640b5d20 2024-09-17T03:00:07.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.724+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39640cfa80 con 0x7f39640b5d20 2024-09-17T03:00:07.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.724+0000 7f39617fa640 1 -- 172.21.15.104:0/153155041 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7f39580633b0 con 0x7f39640b5d20 2024-09-17T03:00:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:07.724 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T03:00:07.725 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T03:00:07.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3950078b90 msgr2=0x7f395007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3950078b90 0x7f395007b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f39540015e0 tx=0x7f3954009040 comp rx=0 tx=0).stop 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39640b5d20 msgr2=0x7f3964153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39640b5d20 0x7f3964153960 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3958009fd0 tx=0x7f395800ec20 comp rx=0 tx=0).stop 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 shutdown_connections 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3950078b90 0x7f395007b0a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39640cdf10 0x7f39640c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f39640b5d20 0x7f3964153960 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 --2- 172.21.15.104:0/153155041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39640b4fc0 0x7f39641f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 >> 172.21.15.104:0/153155041 conn(0x7f39640b44a0 msgr2=0x7f39640d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 shutdown_connections 2024-09-17T03:00:07.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.727+0000 7f396ad57640 1 -- 172.21.15.104:0/153155041 wait complete. 2024-09-17T03:00:07.738 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.851+0000 7f3059aa2640 1 -- 172.21.15.104:0/1723025271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540b2630 msgr2=0x7f30540b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.851+0000 7f3059aa2640 1 --2- 172.21.15.104:0/1723025271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540b2630 0x7f30540b2a40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f304c005fd0 tx=0x7f304c02a970 comp rx=0 tx=0).stop 2024-09-17T03:00:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.851+0000 7f3059aa2640 1 -- 172.21.15.104:0/1723025271 shutdown_connections 2024-09-17T03:00:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.851+0000 7f3059aa2640 1 --2- 172.21.15.104:0/1723025271 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540b2630 0x7f30540b2a40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.851+0000 7f3059aa2640 1 --2- 172.21.15.104:0/1723025271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30540b7c80 0x7f30540b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.851+0000 7f3059aa2640 1 -- 172.21.15.104:0/1723025271 >> 172.21.15.104:0/1723025271 conn(0x7f30540d2970 msgr2=0x7f30540d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.851+0000 7f3059aa2640 1 -- 172.21.15.104:0/1723025271 shutdown_connections 2024-09-17T03:00:07.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.851+0000 7f3059aa2640 1 -- 172.21.15.104:0/1723025271 wait complete. 2024-09-17T03:00:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.853+0000 7f3059aa2640 1 Processor -- start 2024-09-17T03:00:07.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.853+0000 7f3059aa2640 1 -- start start 2024-09-17T03:00:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.854+0000 7f3059aa2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30540b2630 0x7f305415d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.854+0000 7f3059aa2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30540b7c80 0x7f30541f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.854+0000 7f3059aa2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540d3490 0x7f30541f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3059aa2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f30540b6bd0 con 0x7f30540d3490 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3059aa2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f30540b6a50 con 0x7f30540b7c80 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3059aa2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f30540b6d50 con 0x7f30540b2630 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540d3490 0x7f30541f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540d3490 0x7f30541f00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39362/0 (socket says 172.21.15.104:39362) 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 -- 172.21.15.104:0/3195640832 learned_addr learned my addr 172.21.15.104:0/3195640832 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3052ffd640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30540b7c80 0x7f30541f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f30537fe640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30540b2630 0x7f305415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 -- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30540b2630 msgr2=0x7f305415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30540b2630 0x7f305415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 -- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30540b7c80 msgr2=0x7f30541f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:07.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30540b7c80 0x7f30541f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 -- 172.21.15.104:0/3195640832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305415e110 con 0x7f30540d3490 2024-09-17T03:00:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3053fff640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540d3490 0x7f30541f00d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f304c006010 tx=0x7f304c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f303bfff640 1 -- 172.21.15.104:0/3195640832 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c034040 con 0x7f30540d3490 2024-09-17T03:00:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f303bfff640 1 -- 172.21.15.104:0/3195640832 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f304c004640 con 0x7f30540d3490 2024-09-17T03:00:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305406dd40 con 0x7f30540d3490 2024-09-17T03:00:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f303bfff640 1 -- 172.21.15.104:0/3195640832 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c045480 con 0x7f30540d3490 2024-09-17T03:00:07.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.855+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305406d260 con 0x7f30540d3490 2024-09-17T03:00:07.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.856+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30540b2a40 con 0x7f30540d3490 2024-09-17T03:00:07.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.857+0000 7f303bfff640 1 -- 172.21.15.104:0/3195640832 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f304c037020 con 0x7f30540d3490 2024-09-17T03:00:07.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.858+0000 7f303bfff640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3040078b90 0x7f304007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:07.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.858+0000 7f303bfff640 1 -- 172.21.15.104:0/3195640832 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f304c0bc580 con 0x7f30540d3490 2024-09-17T03:00:07.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.858+0000 7f30537fe640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3040078b90 0x7f304007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:07.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.859+0000 7f30537fe640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3040078b90 0x7f304007b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3044006fd0 tx=0x7f3044009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:07.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:07.862+0000 7f303bfff640 1 -- 172.21.15.104:0/3195640832 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f305415e110 con 0x7f30540d3490 2024-09-17T03:00:08.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.072+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f305415dea0 con 0x7f30540d3490 2024-09-17T03:00:08.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.072+0000 7f303bfff640 1 -- 172.21.15.104:0/3195640832 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5234 (secure 0 0 0) 0x7f304c084400 con 0x7f30540d3490 2024-09-17T03:00:08.072 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:08.072 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":42,"btime":"2024-09-17T02:59:33:797395+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T02:59:31.126864+0000","modified":"2024-09-17T02:59:33.150043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.104:6834/515764261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":515764261},{"type":"v1","addr":"172.21.15.104:6834","nonce":515764261}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6282,"qdb_cluster":[6282]},"id":6}]} 2024-09-17T03:00:08.072 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 42 2024-09-17T03:00:08.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.074+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3040078b90 msgr2=0x7f304007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.074+0000 7f3059aa2640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3040078b90 0x7f304007b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3044006fd0 tx=0x7f3044009060 comp rx=0 tx=0).stop 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.074+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540d3490 msgr2=0x7f30541f00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.074+0000 7f3059aa2640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540d3490 0x7f30541f00d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f304c006010 tx=0x7f304c003f10 comp rx=0 tx=0).stop 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.075+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 shutdown_connections 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.075+0000 7f3059aa2640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3040078b90 0x7f304007b0a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.075+0000 7f3059aa2640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30540b7c80 0x7f30541f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.075+0000 7f3059aa2640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f30540d3490 0x7f30541f00d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.075+0000 7f3059aa2640 1 --2- 172.21.15.104:0/3195640832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30540b2630 0x7f305415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.075+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 >> 172.21.15.104:0/3195640832 conn(0x7f30540d2970 msgr2=0x7f30540d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.075+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 shutdown_connections 2024-09-17T03:00:08.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.075+0000 7f3059aa2640 1 -- 172.21.15.104:0/3195640832 wait complete. 2024-09-17T03:00:08.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.198+0000 7f63e9b01640 1 -- 172.21.15.104:0/3615762394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e40d1d00 msgr2=0x7f63e40d2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.198+0000 7f63e9b01640 1 --2- 172.21.15.104:0/3615762394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e40d1d00 0x7f63e40d2110 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009830 tx=0x7f63d802a510 comp rx=0 tx=0).stop 2024-09-17T03:00:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.198+0000 7f63e9b01640 1 -- 172.21.15.104:0/3615762394 shutdown_connections 2024-09-17T03:00:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.198+0000 7f63e9b01640 1 --2- 172.21.15.104:0/3615762394 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e40d1d00 0x7f63e40d2110 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.198+0000 7f63e9b01640 1 -- 172.21.15.104:0/3615762394 >> 172.21.15.104:0/3615762394 conn(0x7f63e406d200 msgr2=0x7f63e406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.198+0000 7f63e9b01640 1 -- 172.21.15.104:0/3615762394 shutdown_connections 2024-09-17T03:00:08.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.198+0000 7f63e9b01640 1 -- 172.21.15.104:0/3615762394 wait complete. 2024-09-17T03:00:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.200+0000 7f63e9b01640 1 Processor -- start 2024-09-17T03:00:08.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.200+0000 7f63e9b01640 1 -- start start 2024-09-17T03:00:08.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e9b01640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e40d1d00 0x7f63e413f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e9b01640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e415dcf0 0x7f63e4142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e9b01640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e4160790 0x7f63e41535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e9b01640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4161430 con 0x7f63e4160790 2024-09-17T03:00:08.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e9b01640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f63e41612b0 con 0x7f63e40d1d00 2024-09-17T03:00:08.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e9b01640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f63e41574a0 con 0x7f63e415dcf0 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e4160790 0x7f63e41535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e4160790 0x7f63e41535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39378/0 (socket says 172.21.15.104:39378) 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.201+0000 7f63e3fff640 1 -- 172.21.15.104:0/928225563 learned_addr learned my addr 172.21.15.104:0/928225563 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e37fe640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e40d1d00 0x7f63e413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e2ffd640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e415dcf0 0x7f63e4142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e3fff640 1 -- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e415dcf0 msgr2=0x7f63e4142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e3fff640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e415dcf0 0x7f63e4142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e3fff640 1 -- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e40d1d00 msgr2=0x7f63e413f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e3fff640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e40d1d00 0x7f63e413f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e3fff640 1 -- 172.21.15.104:0/928225563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e4151bf0 con 0x7f63e4160790 2024-09-17T03:00:08.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e2ffd640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e415dcf0 0x7f63e4142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:08.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e37fe640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e40d1d00 0x7f63e413f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:08.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e3fff640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e4160790 0x7f63e41535a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00ba10 tx=0x7f63dc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:08.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63cbfff640 1 -- 172.21.15.104:0/928225563 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc019070 con 0x7f63e4160790 2024-09-17T03:00:08.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63cbfff640 1 -- 172.21.15.104:0/928225563 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63dc00cc90 con 0x7f63e4160790 2024-09-17T03:00:08.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e4142ee0 con 0x7f63e4160790 2024-09-17T03:00:08.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63cbfff640 1 -- 172.21.15.104:0/928225563 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc0146a0 con 0x7f63e4160790 2024-09-17T03:00:08.204 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.202+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e4140310 con 0x7f63e4160790 2024-09-17T03:00:08.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.203+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e40d2110 con 0x7f63e4160790 2024-09-17T03:00:08.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.204+0000 7f63cbfff640 1 -- 172.21.15.104:0/928225563 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f63dc01c070 con 0x7f63e4160790 2024-09-17T03:00:08.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.204+0000 7f63cbfff640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63d0078bc0 0x7f63d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.204+0000 7f63cbfff640 1 -- 172.21.15.104:0/928225563 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f63dc09a690 con 0x7f63e4160790 2024-09-17T03:00:08.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.205+0000 7f63e37fe640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63d0078bc0 0x7f63d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.205+0000 7f63e37fe640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63d0078bc0 0x7f63d007b0d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f63d40046b0 tx=0x7f63d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:08.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.209+0000 7f63cbfff640 1 -- 172.21.15.104:0/928225563 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f63e4151bf0 con 0x7f63e4160790 2024-09-17T03:00:08.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.386+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63e40747a0 con 0x7f63e4160790 2024-09-17T03:00:08.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.387+0000 7f63cbfff640 1 -- 172.21.15.104:0/928225563 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+16780 (secure 0 0 0) 0x7f63dc06b030 con 0x7f63e4160790 2024-09-17T03:00:08.386 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:08.386 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":111,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:00.942611+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T02:59:28.780702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T02:59:30.098469+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63d0078bc0 msgr2=0x7f63d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63d0078bc0 0x7f63d007b0d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f63d40046b0 tx=0x7f63d4009040 comp rx=0 tx=0).stop 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e4160790 msgr2=0x7f63e41535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e4160790 0x7f63e41535a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00ba10 tx=0x7f63dc00bed0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 shutdown_connections 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f63d0078bc0 0x7f63d007b0d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f63e4160790 0x7f63e41535a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63e415dcf0 0x7f63e4142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 --2- 172.21.15.104:0/928225563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63e40d1d00 0x7f63e413f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 >> 172.21.15.104:0/928225563 conn(0x7f63e406d200 msgr2=0x7f63e406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 shutdown_connections 2024-09-17T03:00:08.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.389+0000 7f63e9b01640 1 -- 172.21.15.104:0/928225563 wait complete. 2024-09-17T03:00:08.401 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:00:08.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.515+0000 7f84a87c3640 1 -- 172.21.15.104:0/2671192809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a00cfa40 msgr2=0x7f84a00b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.515+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2671192809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a00cfa40 0x7f84a00b61f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8498005fd0 tx=0x7f849802a820 comp rx=0 tx=0).stop 2024-09-17T03:00:08.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.515+0000 7f84a87c3640 1 -- 172.21.15.104:0/2671192809 shutdown_connections 2024-09-17T03:00:08.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.515+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2671192809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a00cfa40 0x7f84a00b61f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.515+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2671192809 >> v2:172.21.15.192:3300/0 conn(0x7f84a00cf630 0x7f84a00b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.515+0000 7f84a87c3640 1 -- 172.21.15.104:0/2671192809 >> 172.21.15.104:0/2671192809 conn(0x7f84a00d28e0 msgr2=0x7f84a00d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:08.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.515+0000 7f84a87c3640 1 -- 172.21.15.104:0/2671192809 shutdown_connections 2024-09-17T03:00:08.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.515+0000 7f84a87c3640 1 -- 172.21.15.104:0/2671192809 wait complete. 2024-09-17T03:00:08.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.517+0000 7f84a87c3640 1 Processor -- start 2024-09-17T03:00:08.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.517+0000 7f84a87c3640 1 -- start start 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.518+0000 7f84a87c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84a00cf630 0x7f84a00c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.518+0000 7f84a87c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a00cfa40 0x7f84a01f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.518+0000 7f84a87c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a00d3400 0x7f84a009fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.518+0000 7f84a87c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f84a00b68b0 con 0x7f84a00cf630 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.518+0000 7f84a87c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f84a00b6730 con 0x7f84a00d3400 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.518+0000 7f84a87c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f84a00b6a30 con 0x7f84a00cfa40 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.518+0000 7f84a655f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84a00cf630 0x7f84a00c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a655f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84a00cf630 0x7f84a00c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39386/0 (socket says 172.21.15.104:39386) 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a655f640 1 -- 172.21.15.104:0/2195237217 learned_addr learned my addr 172.21.15.104:0/2195237217 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:08.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a6d60640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a00d3400 0x7f84a009fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a5d5e640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a00cfa40 0x7f84a01f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a655f640 1 -- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a00cfa40 msgr2=0x7f84a01f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a655f640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a00cfa40 0x7f84a01f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a655f640 1 -- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a00d3400 msgr2=0x7f84a009fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a655f640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a00d3400 0x7f84a009fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a655f640 1 -- 172.21.15.104:0/2195237217 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a01f50c0 con 0x7f84a00cf630 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a655f640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84a00cf630 0x7f84a00c8a00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f849c00c390 tx=0x7f849c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f8496ffd640 1 -- 172.21.15.104:0/2195237217 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c017070 con 0x7f84a00cf630 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a00c7460 con 0x7f84a00cf630 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f8496ffd640 1 -- 172.21.15.104:0/2195237217 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f849c0053c0 con 0x7f84a00cf630 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f8496ffd640 1 -- 172.21.15.104:0/2195237217 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c003880 con 0x7f84a00cf630 2024-09-17T03:00:08.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.519+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a00c7c40 con 0x7f84a00cf630 2024-09-17T03:00:08.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.520+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a00b6f50 con 0x7f84a00cf630 2024-09-17T03:00:08.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.521+0000 7f8496ffd640 1 -- 172.21.15.104:0/2195237217 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f849c01a070 con 0x7f84a00cf630 2024-09-17T03:00:08.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.522+0000 7f8496ffd640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8484078b90 0x7f848407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.522+0000 7f8496ffd640 1 -- 172.21.15.104:0/2195237217 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f849c09a1a0 con 0x7f84a00cf630 2024-09-17T03:00:08.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.522+0000 7f84a5d5e640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8484078b90 0x7f848407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.522+0000 7f84a5d5e640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8484078b90 0x7f848407b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f84900096c0 tx=0x7f8490009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:08.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.526+0000 7f8496ffd640 1 -- 172.21.15.104:0/2195237217 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f84a01f50c0 con 0x7f84a00cf630 2024-09-17T03:00:08.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.735+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f84a00d2e60 con 0x7f84a00cf630 2024-09-17T03:00:08.735 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T03:00:08.736+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:00:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.737+0000 7f8496ffd640 1 -- 172.21.15.104:0/2195237217 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) ==== 161+0+0 (secure 0 0 0) 0x7f849c061f10 con 0x7f84a00cf630 2024-09-17T03:00:08.737 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:00:08.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8484078b90 msgr2=0x7f848407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8484078b90 0x7f848407b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f84900096c0 tx=0x7f8490009260 comp rx=0 tx=0).stop 2024-09-17T03:00:08.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84a00cf630 msgr2=0x7f84a00c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84a00cf630 0x7f84a00c8a00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f849c00c390 tx=0x7f849c00c850 comp rx=0 tx=0).stop 2024-09-17T03:00:08.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 shutdown_connections 2024-09-17T03:00:08.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8484078b90 0x7f848407b0a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84a00d3400 0x7f84a009fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f84a00cfa40 0x7f84a01f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.741+0000 7f84a87c3640 1 --2- 172.21.15.104:0/2195237217 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f84a00cf630 0x7f84a00c8a00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.742+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 >> 172.21.15.104:0/2195237217 conn(0x7f84a00d28e0 msgr2=0x7f84a0071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:08.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.742+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 shutdown_connections 2024-09-17T03:00:08.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.742+0000 7f84a87c3640 1 -- 172.21.15.104:0/2195237217 wait complete. 2024-09-17T03:00:08.753 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:00:08.801 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T03:00:08.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.870+0000 7f42fa9a8640 1 -- 172.21.15.104:0/3459920418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42dc004d90 msgr2=0x7f42dc005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.871+0000 7f42fa9a8640 1 --2- 172.21.15.104:0/3459920418 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42dc004d90 0x7f42dc005260 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f42ec005fd0 tx=0x7f42dc005830 comp rx=0 tx=0).stop 2024-09-17T03:00:08.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.871+0000 7f42f8f45640 1 -- 172.21.15.104:0/3459920418 reap_dead start 2024-09-17T03:00:08.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.871+0000 7f42fa9a8640 1 -- 172.21.15.104:0/3459920418 shutdown_connections 2024-09-17T03:00:08.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.871+0000 7f42fa9a8640 1 -- 172.21.15.104:0/3459920418 >> 172.21.15.104:0/3459920418 conn(0x7f42f4069120 msgr2=0x7f42f4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:08.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.871+0000 7f42fa9a8640 1 -- 172.21.15.104:0/3459920418 shutdown_connections 2024-09-17T03:00:08.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.871+0000 7f42fa9a8640 1 -- 172.21.15.104:0/3459920418 wait complete. 2024-09-17T03:00:08.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.872+0000 7f42fa9a8640 1 Processor -- start 2024-09-17T03:00:08.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.873+0000 7f42fa9a8640 1 -- start start 2024-09-17T03:00:08.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42fa9a8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42f41f3240 0x7f42f414db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42fa9a8640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42f41f5c50 0x7f42f41f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42fa9a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42f40ad3f0 0x7f42f40ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42fa9a8640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f42f415fb50 con 0x7f42f40ad3f0 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42fa9a8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f42f415f9d0 con 0x7f42f41f3240 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42fa9a8640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f42f415fcd0 con 0x7f42f41f5c50 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42f40ad3f0 0x7f42f40ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42f40ad3f0 0x7f42f40ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39410/0 (socket says 172.21.15.104:39410) 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 -- 172.21.15.104:0/2029904785 learned_addr learned my addr 172.21.15.104:0/2029904785 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f37fe640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42f41f5c50 0x7f42f41f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f3fff640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42f41f3240 0x7f42f414db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 -- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42f41f5c50 msgr2=0x7f42f41f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42f41f5c50 0x7f42f41f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 -- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42f41f3240 msgr2=0x7f42f414db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42f41f3240 0x7f42f414db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:08.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 -- 172.21.15.104:0/2029904785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f41f3650 con 0x7f42f40ad3f0 2024-09-17T03:00:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.874+0000 7f42f8f45640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42f40ad3f0 0x7f42f40ad800 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00d310 tx=0x7f42ec02be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.875+0000 7f42f0ff9640 1 -- 172.21.15.104:0/2029904785 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec031070 con 0x7f42f40ad3f0 2024-09-17T03:00:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.875+0000 7f42f0ff9640 1 -- 172.21.15.104:0/2029904785 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42ec004030 con 0x7f42f40ad3f0 2024-09-17T03:00:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.875+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f40ac630 con 0x7f42f40ad3f0 2024-09-17T03:00:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.875+0000 7f42f0ff9640 1 -- 172.21.15.104:0/2029904785 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec009b40 con 0x7f42f40ad3f0 2024-09-17T03:00:08.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.875+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f40acbf0 con 0x7f42f40ad3f0 2024-09-17T03:00:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.876+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f414d860 con 0x7f42f40ad3f0 2024-09-17T03:00:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.877+0000 7f42f0ff9640 1 -- 172.21.15.104:0/2029904785 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42ec004420 con 0x7f42f40ad3f0 2024-09-17T03:00:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.877+0000 7f42f0ff9640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42e0078b90 0x7f42e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.877+0000 7f42f0ff9640 1 -- 172.21.15.104:0/2029904785 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5795+0+0 (secure 0 0 0) 0x7f42ec0bab70 con 0x7f42f40ad3f0 2024-09-17T03:00:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.877+0000 7f42f3fff640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42e0078b90 0x7f42e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:08.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.878+0000 7f42f3fff640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42e0078b90 0x7f42e007b0a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f42f40ced70 tx=0x7f42e4006770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:08.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:08.881+0000 7f42f0ff9640 1 -- 172.21.15.104:0/2029904785 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42f414d860 con 0x7f42f40ad3f0 2024-09-17T03:00:09.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.092+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f42f4160210 con 0x7f42f40ad3f0 2024-09-17T03:00:09.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.739+0000 7f42f0ff9640 1 -- 172.21.15.104:0/2029904785 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) ==== 104+0+0 (secure 0 0 0) 0x7f42ec082990 con 0x7f42f40ad3f0 2024-09-17T03:00:09.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.741+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42e0078b90 msgr2=0x7f42e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:09.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42e0078b90 0x7f42e007b0a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f42f40ced70 tx=0x7f42e4006770 comp rx=0 tx=0).stop 2024-09-17T03:00:09.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42f40ad3f0 msgr2=0x7f42f40ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:09.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42f40ad3f0 0x7f42f40ad800 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00d310 tx=0x7f42ec02be80 comp rx=0 tx=0).stop 2024-09-17T03:00:09.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 shutdown_connections 2024-09-17T03:00:09.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f42e0078b90 0x7f42e007b0a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:09.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f42f40ad3f0 0x7f42f40ad800 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:09.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f42f41f5c50 0x7f42f41f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:09.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 --2- 172.21.15.104:0/2029904785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42f41f3240 0x7f42f414db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:09.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 >> 172.21.15.104:0/2029904785 conn(0x7f42f4069120 msgr2=0x7f42f40b96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:09.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 shutdown_connections 2024-09-17T03:00:09.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.742+0000 7f42fa9a8640 1 -- 172.21.15.104:0/2029904785 wait complete. 2024-09-17T03:00:09.754 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:00:09.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.873+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/3780010589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b81a0 msgr2=0x7f2c280b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:09.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.873+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/3780010589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b81a0 0x7f2c280b3960 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2c24005fd0 tx=0x7f2c2402aa10 comp rx=0 tx=0).stop 2024-09-17T03:00:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.873+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/3780010589 shutdown_connections 2024-09-17T03:00:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.873+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/3780010589 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c280b7200 0x7f2c280b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.873+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/3780010589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b81a0 0x7f2c280b3960 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.873+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/3780010589 >> 172.21.15.104:0/3780010589 conn(0x7f2c280d29c0 msgr2=0x7f2c280d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.873+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/3780010589 shutdown_connections 2024-09-17T03:00:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.873+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/3780010589 wait complete. 2024-09-17T03:00:09.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.875+0000 7f2c2f5c3640 1 Processor -- start 2024-09-17T03:00:09.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.875+0000 7f2c2f5c3640 1 -- start start 2024-09-17T03:00:09.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.876+0000 7f2c2f5c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c280b3ea0 0x7f2c28166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:09.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.876+0000 7f2c2f5c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b7200 0x7f2c2815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:09.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.876+0000 7f2c2f5c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c280b81a0 0x7f2c2806f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:09.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.876+0000 7f2c2f5c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2c280b32e0 con 0x7f2c280b7200 2024-09-17T03:00:09.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.876+0000 7f2c2f5c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c280b3160 con 0x7f2c280b81a0 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.876+0000 7f2c2f5c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c280b3460 con 0x7f2c280b3ea0 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.876+0000 7f2c2cb5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b7200 0x7f2c2815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2cb5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b7200 0x7f2c2815dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39424/0 (socket says 172.21.15.104:39424) 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2cb5e640 1 -- 172.21.15.104:0/1482459038 learned_addr learned my addr 172.21.15.104:0/1482459038 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2d35f640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c280b3ea0 0x7f2c28166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2db60640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c280b81a0 0x7f2c2806f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2cb5e640 1 -- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c280b3ea0 msgr2=0x7f2c28166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2cb5e640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c280b3ea0 0x7f2c28166eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2cb5e640 1 -- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c280b81a0 msgr2=0x7f2c2806f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2cb5e640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c280b81a0 0x7f2c2806f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2cb5e640 1 -- 172.21.15.104:0/1482459038 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c281f63b0 con 0x7f2c280b7200 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2cb5e640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b7200 0x7f2c2815dcc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c3a0 tx=0x7f2c1800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:09.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c1dffb640 1 -- 172.21.15.104:0/1482459038 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18017070 con 0x7f2c280b7200 2024-09-17T03:00:09.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c1dffb640 1 -- 172.21.15.104:0/1482459038 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c180053c0 con 0x7f2c280b7200 2024-09-17T03:00:09.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c281f6690 con 0x7f2c280b7200 2024-09-17T03:00:09.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c1dffb640 1 -- 172.21.15.104:0/1482459038 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18003850 con 0x7f2c280b7200 2024-09-17T03:00:09.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.877+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c281f6c50 con 0x7f2c280b7200 2024-09-17T03:00:09.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.878+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c280b16a0 con 0x7f2c280b7200 2024-09-17T03:00:09.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.879+0000 7f2c1dffb640 1 -- 172.21.15.104:0/1482459038 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c1801a070 con 0x7f2c280b7200 2024-09-17T03:00:09.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.880+0000 7f2c1dffb640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bf0 0x7f2c0c07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:09.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.880+0000 7f2c1dffb640 1 -- 172.21.15.104:0/1482459038 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5795+0+0 (secure 0 0 0) 0x7f2c1809a0c0 con 0x7f2c280b7200 2024-09-17T03:00:09.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.880+0000 7f2c2d35f640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bf0 0x7f2c0c07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:09.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.880+0000 7f2c2d35f640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bf0 0x7f2c0c07b100 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2c24035000 tx=0x7f2c2403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:09.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:09.884+0000 7f2c1dffb640 1 -- 172.21.15.104:0/1482459038 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c280b42b0 con 0x7f2c280b7200 2024-09-17T03:00:10.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:10.062+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2c280b13c0 con 0x7f2c280b7200 2024-09-17T03:00:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.025+0000 7f2c1dffb640 1 -- 172.21.15.104:0/1482459038 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) ==== 181+0+0 (secure 0 0 0) 0x7f2c18061dd0 con 0x7f2c280b7200 2024-09-17T03:00:11.025 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bf0 msgr2=0x7f2c0c07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bf0 0x7f2c0c07b100 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2c24035000 tx=0x7f2c2403b040 comp rx=0 tx=0).stop 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b7200 msgr2=0x7f2c2815dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b7200 0x7f2c2815dcc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2c1800c3a0 tx=0x7f2c1800c860 comp rx=0 tx=0).stop 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 shutdown_connections 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bf0 0x7f2c0c07b100 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c280b81a0 0x7f2c2806f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c280b7200 0x7f2c2815dcc0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 --2- 172.21.15.104:0/1482459038 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c280b3ea0 0x7f2c28166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 >> 172.21.15.104:0/1482459038 conn(0x7f2c280d29c0 msgr2=0x7f2c28161030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 shutdown_connections 2024-09-17T03:00:11.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.029+0000 7f2c2f5c3640 1 -- 172.21.15.104:0/1482459038 wait complete. 2024-09-17T03:00:11.041 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:00:11.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.163+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3187113115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40b3c90 msgr2=0x7fd6a40b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:11.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.163+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3187113115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40b3c90 0x7fd6a40b29a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40736e0 tx=0x7fd69402a560 comp rx=0 tx=0).stop 2024-09-17T03:00:11.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.163+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3187113115 shutdown_connections 2024-09-17T03:00:11.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.163+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3187113115 >> v2:172.21.15.192:3300/0 conn(0x7fd6a40d0840 0x7fd6a40d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:11.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.163+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3187113115 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40b3c90 0x7fd6a40b29a0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:11.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.163+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3187113115 >> 172.21.15.104:0/3187113115 conn(0x7fd6a409ba40 msgr2=0x7fd6a409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:11.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.163+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3187113115 shutdown_connections 2024-09-17T03:00:11.163 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.163+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3187113115 wait complete. 2024-09-17T03:00:11.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.165+0000 7fd6a89ad640 1 Processor -- start 2024-09-17T03:00:11.164 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.165+0000 7fd6a89ad640 1 -- start start 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a89ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6a40b3c90 0x7fd6a41f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a89ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a40d0840 0x7fd6a41f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a89ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40d2660 0x7fd6a406ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a89ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a40cdfe0 con 0x7fd6a40d2660 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a89ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a40cde60 con 0x7fd6a40d0840 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a89ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a40ce160 con 0x7fd6a40b3c90 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40d2660 0x7fd6a406ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40d2660 0x7fd6a406ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39432/0 (socket says 172.21.15.104:39432) 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a2d9d640 1 -- 172.21.15.104:0/3956424516 learned_addr learned my addr 172.21.15.104:0/3956424516 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a1d9b640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a40d0840 0x7fd6a41f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:11.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a2d9d640 1 -- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6a40b3c90 msgr2=0x7fd6a41f9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a2d9d640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6a40b3c90 0x7fd6a41f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a2d9d640 1 -- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a40d0840 msgr2=0x7fd6a41f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a2d9d640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a40d0840 0x7fd6a41f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a2d9d640 1 -- 172.21.15.104:0/3956424516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a40b9380 con 0x7fd6a40d2660 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.166+0000 7fd6a1d9b640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a40d0840 0x7fd6a41f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.167+0000 7fd6a2d9d640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40d2660 0x7fd6a406ee50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00b9e0 tx=0x7fd69c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.167+0000 7fd692ffd640 1 -- 172.21.15.104:0/3956424516 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c003b70 con 0x7fd6a40d2660 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.167+0000 7fd692ffd640 1 -- 172.21.15.104:0/3956424516 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd69c003e00 con 0x7fd6a40d2660 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.167+0000 7fd692ffd640 1 -- 172.21.15.104:0/3956424516 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00cb80 con 0x7fd6a40d2660 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.167+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a406e090 con 0x7fd6a40d2660 2024-09-17T03:00:11.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.167+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a406e650 con 0x7fd6a40d2660 2024-09-17T03:00:11.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.168+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a40ce620 con 0x7fd6a40d2660 2024-09-17T03:00:11.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.168+0000 7fd692ffd640 1 -- 172.21.15.104:0/3956424516 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd69c004000 con 0x7fd6a40d2660 2024-09-17T03:00:11.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.169+0000 7fd692ffd640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd684078b90 0x7fd68407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:11.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.169+0000 7fd692ffd640 1 -- 172.21.15.104:0/3956424516 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5357+0+0 (secure 0 0 0) 0x7fd69c09aa80 con 0x7fd6a40d2660 2024-09-17T03:00:11.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.169+0000 7fd6a259c640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd684078b90 0x7fd68407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:11.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.170+0000 7fd6a259c640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd684078b90 0x7fd68407b0a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd694033000 tx=0x7fd6940046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:11.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.173+0000 7fd692ffd640 1 -- 172.21.15.104:0/3956424516 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd69c063030 con 0x7fd6a40d2660 2024-09-17T03:00:11.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:11.347+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd6a40b90a0 con 0x7fd6a40d2660 2024-09-17T03:00:12.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.030+0000 7fd692ffd640 1 -- 172.21.15.104:0/3956424516 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) ==== 169+0+0 (secure 0 0 0) 0x7fd69c062930 con 0x7fd6a40d2660 2024-09-17T03:00:12.033 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T03:00:12.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd684078b90 msgr2=0x7fd68407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd684078b90 0x7fd68407b0a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd694033000 tx=0x7fd6940046c0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40d2660 msgr2=0x7fd6a406ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40d2660 0x7fd6a406ee50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00b9e0 tx=0x7fd69c00bea0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 shutdown_connections 2024-09-17T03:00:12.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd684078b90 0x7fd68407b0a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a40d0840 0x7fd6a41f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd6a40d2660 0x7fd6a406ee50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 --2- 172.21.15.104:0/3956424516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6a40b3c90 0x7fd6a41f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 >> 172.21.15.104:0/3956424516 conn(0x7fd6a409ba40 msgr2=0x7fd6a40716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:12.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 shutdown_connections 2024-09-17T03:00:12.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.034+0000 7fd6a89ad640 1 -- 172.21.15.104:0/3956424516 wait complete. 2024-09-17T03:00:12.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T03:00:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.166+0000 7f0a321df640 1 -- 172.21.15.104:0/576816774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 msgr2=0x7f0a14004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.166+0000 7f0a321df640 1 --2- 172.21.15.104:0/576816774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 0x7f0a14004c10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0a20001690 tx=0x7f0a14005830 comp rx=0 tx=0).stop 2024-09-17T03:00:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.166+0000 7f0a321df640 1 -- 172.21.15.104:0/576816774 shutdown_connections 2024-09-17T03:00:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.166+0000 7f0a321df640 1 --2- 172.21.15.104:0/576816774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 0x7f0a14004c10 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.166+0000 7f0a321df640 1 -- 172.21.15.104:0/576816774 >> 172.21.15.104:0/576816774 conn(0x7f0a2c0b44a0 msgr2=0x7f0a2c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.166+0000 7f0a321df640 1 -- 172.21.15.104:0/576816774 shutdown_connections 2024-09-17T03:00:12.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.166+0000 7f0a321df640 1 -- 172.21.15.104:0/576816774 wait complete. 2024-09-17T03:00:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.167+0000 7f0a321df640 1 Processor -- start 2024-09-17T03:00:12.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.168+0000 7f0a321df640 1 -- start start 2024-09-17T03:00:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a321df640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 0x7f0a2c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a321df640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a2c15cee0 0x7f0a2c1f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a321df640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2c1f5ea0 0x7f0a2c1f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a321df640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c0b57e0 con 0x7f0a14004800 2024-09-17T03:00:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a321df640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c0b3ce0 con 0x7f0a2c1f5ea0 2024-09-17T03:00:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a321df640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2c0b5960 con 0x7f0a2c15cee0 2024-09-17T03:00:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 0x7f0a2c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:12.170 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 0x7f0a2c14fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39462/0 (socket says 172.21.15.104:39462) 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2b7fe640 1 -- 172.21.15.104:0/3971356943 learned_addr learned my addr 172.21.15.104:0/3971356943 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2bfff640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2c1f5ea0 0x7f0a2c1f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2affd640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a2c15cee0 0x7f0a2c1f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2b7fe640 1 -- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a2c15cee0 msgr2=0x7f0a2c1f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2b7fe640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a2c15cee0 0x7f0a2c1f5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2b7fe640 1 -- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2c1f5ea0 msgr2=0x7f0a2c1f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2b7fe640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2c1f5ea0 0x7f0a2c1f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.169+0000 7f0a2b7fe640 1 -- 172.21.15.104:0/3971356943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c150340 con 0x7f0a14004800 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.170+0000 7f0a2b7fe640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 0x7f0a2c14fe00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c011ae0 tx=0x7f0a1c009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.170+0000 7f0a13fff640 1 -- 172.21.15.104:0/3971356943 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00fcb0 con 0x7f0a14004800 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.170+0000 7f0a13fff640 1 -- 172.21.15.104:0/3971356943 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a1c00fe50 con 0x7f0a14004800 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.170+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2c160730 con 0x7f0a14004800 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.170+0000 7f0a13fff640 1 -- 172.21.15.104:0/3971356943 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c004280 con 0x7f0a14004800 2024-09-17T03:00:12.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.170+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2c0c76e0 con 0x7f0a14004800 2024-09-17T03:00:12.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.171+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2c0b5ec0 con 0x7f0a14004800 2024-09-17T03:00:12.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.171+0000 7f0a13fff640 1 -- 172.21.15.104:0/3971356943 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a1c0035f0 con 0x7f0a14004800 2024-09-17T03:00:12.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.172+0000 7f0a13fff640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a18078b90 0x7f0a1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:12.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.172+0000 7f0a13fff640 1 -- 172.21.15.104:0/3971356943 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f0a1c09b530 con 0x7f0a14004800 2024-09-17T03:00:12.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.172+0000 7f0a2affd640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a18078b90 0x7f0a1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:12.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.173+0000 7f0a2affd640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a18078b90 0x7f0a1807b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0a20032000 tx=0x7f0a20001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:12.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.176+0000 7f0a13fff640 1 -- 172.21.15.104:0/3971356943 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a2c150340 con 0x7f0a14004800 2024-09-17T03:00:12.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.350+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f0a2c0cead0 con 0x7f0a14004800 2024-09-17T03:00:12.353 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.354+0000 7f0a13fff640 1 -- 172.21.15.104:0/3971356943 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f0a1c063d00 con 0x7f0a14004800 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a18078b90 msgr2=0x7f0a1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a18078b90 0x7f0a1807b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0a20032000 tx=0x7f0a20001190 comp rx=0 tx=0).stop 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 msgr2=0x7f0a2c14fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 0x7f0a2c14fe00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c011ae0 tx=0x7f0a1c009f10 comp rx=0 tx=0).stop 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 shutdown_connections 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a18078b90 0x7f0a1807b0a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a2c1f5ea0 0x7f0a2c1f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a2c15cee0 0x7f0a2c1f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 --2- 172.21.15.104:0/3971356943 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a14004800 0x7f0a2c14fe00 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 >> 172.21.15.104:0/3971356943 conn(0x7f0a2c0b44a0 msgr2=0x7f0a2c070740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:12.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 shutdown_connections 2024-09-17T03:00:12.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.356+0000 7f0a321df640 1 -- 172.21.15.104:0/3971356943 wait complete. 2024-09-17T03:00:12.367 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-17T03:00:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.480+0000 7f6113bb0640 1 -- 172.21.15.104:0/4177115291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b4fc0 msgr2=0x7f610c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.480+0000 7f6113bb0640 1 --2- 172.21.15.104:0/4177115291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b4fc0 0x7f610c0b39c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f6108005fd0 tx=0x7f610802a530 comp rx=0 tx=0).stop 2024-09-17T03:00:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.480+0000 7f6113bb0640 1 -- 172.21.15.104:0/4177115291 shutdown_connections 2024-09-17T03:00:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.480+0000 7f6113bb0640 1 --2- 172.21.15.104:0/4177115291 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f610c0cdf10 0x7f610c0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.480+0000 7f6113bb0640 1 --2- 172.21.15.104:0/4177115291 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b4fc0 0x7f610c0b39c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.480+0000 7f6113bb0640 1 -- 172.21.15.104:0/4177115291 >> 172.21.15.104:0/4177115291 conn(0x7f610c0b44a0 msgr2=0x7f610c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.480+0000 7f6113bb0640 1 -- 172.21.15.104:0/4177115291 shutdown_connections 2024-09-17T03:00:12.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.480+0000 7f6113bb0640 1 -- 172.21.15.104:0/4177115291 wait complete. 2024-09-17T03:00:12.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.482+0000 7f6113bb0640 1 Processor -- start 2024-09-17T03:00:12.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.482+0000 7f6113bb0640 1 -- start start 2024-09-17T03:00:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f6113bb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b3f00 0x7f610c152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f6113bb0640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f610c0b4fc0 0x7f610c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f6113bb0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f610c0cdf10 0x7f610c1600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f6113bb0640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f610c160f50 con 0x7f610c0b3f00 2024-09-17T03:00:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f6113bb0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0d0210 con 0x7f610c0cdf10 2024-09-17T03:00:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f6113bb0640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f610c1610d0 con 0x7f610c0b4fc0 2024-09-17T03:00:12.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f611194c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b3f00 0x7f610c152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f611194c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b3f00 0x7f610c152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39480/0 (socket says 172.21.15.104:39480) 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f611194c640 1 -- 172.21.15.104:0/600079279 learned_addr learned my addr 172.21.15.104:0/600079279 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f611214d640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f610c0cdf10 0x7f610c1600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.483+0000 7f611114b640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f610c0b4fc0 0x7f610c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f611194c640 1 -- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f610c0b4fc0 msgr2=0x7f610c15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f611194c640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f610c0b4fc0 0x7f610c15fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f611194c640 1 -- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f610c0cdf10 msgr2=0x7f610c1600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f611194c640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f610c0cdf10 0x7f610c1600f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f611194c640 1 -- 172.21.15.104:0/600079279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c0cc1b0 con 0x7f610c0b3f00 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f611194c640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b3f00 0x7f610c152950 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6108034040 tx=0x7f6108003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f61027fc640 1 -- 172.21.15.104:0/600079279 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610803e030 con 0x7f610c0b3f00 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f61027fc640 1 -- 172.21.15.104:0/600079279 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61080047a0 con 0x7f610c0b3f00 2024-09-17T03:00:12.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c152e90 con 0x7f610c0b3f00 2024-09-17T03:00:12.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f61027fc640 1 -- 172.21.15.104:0/600079279 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108035040 con 0x7f610c0b3f00 2024-09-17T03:00:12.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.484+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c0c9d80 con 0x7f610c0b3f00 2024-09-17T03:00:12.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.485+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c0b39c0 con 0x7f610c0b3f00 2024-09-17T03:00:12.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.486+0000 7f61027fc640 1 -- 172.21.15.104:0/600079279 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6108041030 con 0x7f610c0b3f00 2024-09-17T03:00:12.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.486+0000 7f61027fc640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f60f0078bc0 0x7f60f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:12.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.486+0000 7f61027fc640 1 -- 172.21.15.104:0/600079279 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f61080bb260 con 0x7f610c0b3f00 2024-09-17T03:00:12.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.486+0000 7f611114b640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f60f0078bc0 0x7f60f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:12.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.487+0000 7f611114b640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f60f0078bc0 0x7f60f007b0d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f60fc006fd0 tx=0x7f60fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:12.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.490+0000 7f61027fc640 1 -- 172.21.15.104:0/600079279 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6108083a30 con 0x7f610c0b3f00 2024-09-17T03:00:12.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:12.731+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7f610c0cead0 con 0x7f610c0b3f00 2024-09-17T03:00:13.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.032+0000 7f61027fc640 1 -- 172.21.15.104:0/600079279 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v281) ==== 137+0+0 (secure 0 0 0) 0x7f6108083330 con 0x7f610c0b3f00 2024-09-17T03:00:13.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f60f0078bc0 msgr2=0x7f60f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f60f0078bc0 0x7f60f007b0d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f60fc006fd0 tx=0x7f60fc008040 comp rx=0 tx=0).stop 2024-09-17T03:00:13.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b3f00 msgr2=0x7f610c152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b3f00 0x7f610c152950 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6108034040 tx=0x7f6108003970 comp rx=0 tx=0).stop 2024-09-17T03:00:13.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 shutdown_connections 2024-09-17T03:00:13.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f60f0078bc0 0x7f60f007b0d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f610c0cdf10 0x7f610c1600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f610c0b4fc0 0x7f610c15fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 --2- 172.21.15.104:0/600079279 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f610c0b3f00 0x7f610c152950 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 >> 172.21.15.104:0/600079279 conn(0x7f610c0b44a0 msgr2=0x7f610c0c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:13.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 shutdown_connections 2024-09-17T03:00:13.035 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.034+0000 7f6113bb0640 1 -- 172.21.15.104:0/600079279 wait complete. 2024-09-17T03:00:13.045 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-17T03:00:13.045 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-17T03:00:13.046 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2024-09-17T03:00:13.046 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:13.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.161+0000 7f875e72b640 1 -- 172.21.15.104:0/2730727596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 msgr2=0x7f87580b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.161+0000 7f875e72b640 1 --2- 172.21.15.104:0/2730727596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 0x7f87580b57e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f874c009830 tx=0x7f874c02a510 comp rx=0 tx=0).stop 2024-09-17T03:00:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.161+0000 7f875e72b640 1 -- 172.21.15.104:0/2730727596 shutdown_connections 2024-09-17T03:00:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.161+0000 7f875e72b640 1 --2- 172.21.15.104:0/2730727596 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 0x7f87580b57e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.161+0000 7f875e72b640 1 --2- 172.21.15.104:0/2730727596 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87580b4fc0 0x7f87580b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.161+0000 7f875e72b640 1 -- 172.21.15.104:0/2730727596 >> 172.21.15.104:0/2730727596 conn(0x7f87580b44a0 msgr2=0x7f87580b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.161+0000 7f875e72b640 1 -- 172.21.15.104:0/2730727596 shutdown_connections 2024-09-17T03:00:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.161+0000 7f875e72b640 1 -- 172.21.15.104:0/2730727596 wait complete. 2024-09-17T03:00:13.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.162+0000 7f875e72b640 1 Processor -- start 2024-09-17T03:00:13.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.163+0000 7f875e72b640 1 -- start start 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f875e72b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 0x7f8758156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f875e72b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87580b4fc0 0x7f875815d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f875e72b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87580b5d20 0x7f875815df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f875e72b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8758160f50 con 0x7f87580b3f00 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f875e72b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f87580ce160 con 0x7f87580b5d20 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f875e72b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f87581610d0 con 0x7f87580b4fc0 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f8757fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 0x7f8758156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f8757fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 0x7f8758156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39488/0 (socket says 172.21.15.104:39488) 2024-09-17T03:00:13.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f8757fff640 1 -- 172.21.15.104:0/910477277 learned_addr learned my addr 172.21.15.104:0/910477277 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f87577fe640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87580b4fc0 0x7f875815d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f875ccc8640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87580b5d20 0x7f875815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f8757fff640 1 -- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87580b4fc0 msgr2=0x7f875815d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f8757fff640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87580b4fc0 0x7f875815d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f8757fff640 1 -- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87580b5d20 msgr2=0x7f875815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f8757fff640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87580b5d20 0x7f875815df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.164+0000 7f8757fff640 1 -- 172.21.15.104:0/910477277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87581f4e60 con 0x7f87580b3f00 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.165+0000 7f8757fff640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 0x7f8758156b40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f874800c970 tx=0x7f874800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.165+0000 7f8754ff9640 1 -- 172.21.15.104:0/910477277 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748007bb0 con 0x7f87580b3f00 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.165+0000 7f8754ff9640 1 -- 172.21.15.104:0/910477277 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8748007e40 con 0x7f87580b3f00 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.165+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875815f400 con 0x7f87580b3f00 2024-09-17T03:00:13.166 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.165+0000 7f8754ff9640 1 -- 172.21.15.104:0/910477277 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748005280 con 0x7f87580b3f00 2024-09-17T03:00:13.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.165+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87581f4380 con 0x7f87580b3f00 2024-09-17T03:00:13.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.166+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87580b57e0 con 0x7f87580b3f00 2024-09-17T03:00:13.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.167+0000 7f8754ff9640 1 -- 172.21.15.104:0/910477277 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8748005420 con 0x7f87580b3f00 2024-09-17T03:00:13.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.167+0000 7f8754ff9640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8744078b90 0x7f874407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.167+0000 7f8754ff9640 1 -- 172.21.15.104:0/910477277 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f874809ae90 con 0x7f87580b3f00 2024-09-17T03:00:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.168+0000 7f87577fe640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8744078b90 0x7f874407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.168+0000 7f87577fe640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8744078b90 0x7f874407b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f874c034000 tx=0x7f874c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:13.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.172+0000 7f8754ff9640 1 -- 172.21.15.104:0/910477277 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8748014030 con 0x7f87580b3f00 2024-09-17T03:00:13.347 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.348+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87580a0a80 con 0x7f87580b3f00 2024-09-17T03:00:13.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.349+0000 7f8754ff9640 1 -- 172.21.15.104:0/910477277 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+13091 (secure 0 0 0) 0x7f8748063040 con 0x7f87580b3f00 2024-09-17T03:00:13.348 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:13.349 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":114,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:12.027164+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6834/515764261":"2024-09-18T03:00:08.737064+0000","172.21.15.104:6832/515764261":"2024-09-18T03:00:08.737064+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:13.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8744078b90 msgr2=0x7f874407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8744078b90 0x7f874407b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f874c034000 tx=0x7f874c004730 comp rx=0 tx=0).stop 2024-09-17T03:00:13.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 msgr2=0x7f8758156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 0x7f8758156b40 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f874800c970 tx=0x7f874800ce30 comp rx=0 tx=0).stop 2024-09-17T03:00:13.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 shutdown_connections 2024-09-17T03:00:13.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8744078b90 0x7f874407b0a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87580b5d20 0x7f875815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f87580b4fc0 0x7f875815d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 --2- 172.21.15.104:0/910477277 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f87580b3f00 0x7f8758156b40 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 >> 172.21.15.104:0/910477277 conn(0x7f87580b44a0 msgr2=0x7f87580b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:13.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 shutdown_connections 2024-09-17T03:00:13.352 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.351+0000 7f875e72b640 1 -- 172.21.15.104:0/910477277 wait complete. 2024-09-17T03:00:13.362 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:00:13.362 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:00:13.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.478+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/2589089037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 msgr2=0x7f8f1806f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.478+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/2589089037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 0x7f8f1806f540 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8f1815d1d0 tx=0x7f8f0802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.478+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/2589089037 shutdown_connections 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.478+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/2589089037 >> v2:172.21.15.192:3300/0 conn(0x7f8f18073c90 0x7f8f180b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.478+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/2589089037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 0x7f8f1806f540 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.478+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/2589089037 >> 172.21.15.104:0/2589089037 conn(0x7f8f180b3640 msgr2=0x7f8f180b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.478+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/2589089037 shutdown_connections 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.478+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/2589089037 wait complete. 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.480+0000 7f8f1e7c3640 1 Processor -- start 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.480+0000 7f8f1e7c3640 1 -- start start 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.481+0000 7f8f1e7c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1806fa80 0x7f8f1814b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.481+0000 7f8f1e7c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 0x7f8f18068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.481+0000 7f8f1e7c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f18155fc0 0x7f8f18069240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.481+0000 7f8f1e7c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8f180b5860 con 0x7f8f18152ce0 2024-09-17T03:00:13.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.481+0000 7f8f1e7c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8f180b56e0 con 0x7f8f1806fa80 2024-09-17T03:00:13.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.481+0000 7f8f1e7c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8f180b59e0 con 0x7f8f18155fc0 2024-09-17T03:00:13.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.481+0000 7f8f177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 0x7f8f18068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f177fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 0x7f8f18068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39504/0 (socket says 172.21.15.104:39504) 2024-09-17T03:00:13.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f177fe640 1 -- 172.21.15.104:0/987885766 learned_addr learned my addr 172.21.15.104:0/987885766 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:13.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f1cd60640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f18155fc0 0x7f8f18069240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f17fff640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1806fa80 0x7f8f1814b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f177fe640 1 -- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f18155fc0 msgr2=0x7f8f18069240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f177fe640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f18155fc0 0x7f8f18069240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f177fe640 1 -- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1806fa80 msgr2=0x7f8f1814b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f177fe640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1806fa80 0x7f8f1814b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f177fe640 1 -- 172.21.15.104:0/987885766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f180cc3c0 con 0x7f8f18152ce0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f17fff640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1806fa80 0x7f8f1814b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f177fe640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 0x7f8f18068d00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c3f0 tx=0x7f8f0c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f14ff9640 1 -- 172.21.15.104:0/987885766 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c017070 con 0x7f8f18152ce0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f14ff9640 1 -- 172.21.15.104:0/987885766 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f0c0035f0 con 0x7f8f18152ce0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f18159490 con 0x7f8f18152ce0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f14ff9640 1 -- 172.21.15.104:0/987885766 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c003a40 con 0x7f8f18152ce0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.482+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f180cc640 con 0x7f8f18152ce0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.483+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f180b5e90 con 0x7f8f18152ce0 2024-09-17T03:00:13.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.484+0000 7f8f14ff9640 1 -- 172.21.15.104:0/987885766 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f0c01a070 con 0x7f8f18152ce0 2024-09-17T03:00:13.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.485+0000 7f8f14ff9640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f04078bc0 0x7f8f0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.485+0000 7f8f14ff9640 1 -- 172.21.15.104:0/987885766 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f8f0c099b70 con 0x7f8f18152ce0 2024-09-17T03:00:13.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.485+0000 7f8f17fff640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f04078bc0 0x7f8f0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.485+0000 7f8f17fff640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f04078bc0 0x7f8f0407b0d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8f08034000 tx=0x7f8f08004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:13.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.489+0000 7f8f14ff9640 1 -- 172.21.15.104:0/987885766 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f180cc3c0 con 0x7f8f18152ce0 2024-09-17T03:00:13.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.660+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8f181f6140 con 0x7f8f18152ce0 2024-09-17T03:00:13.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.660+0000 7f8f14ff9640 1 -- 172.21.15.104:0/987885766 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) ==== 93+0+10 (secure 0 0 0) 0x7f8f0c061c60 con 0x7f8f18152ce0 2024-09-17T03:00:13.660 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T03:00:13.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f04078bc0 msgr2=0x7f8f0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f04078bc0 0x7f8f0407b0d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8f08034000 tx=0x7f8f08004730 comp rx=0 tx=0).stop 2024-09-17T03:00:13.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 msgr2=0x7f8f18068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 0x7f8f18068d00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c3f0 tx=0x7f8f0c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 shutdown_connections 2024-09-17T03:00:13.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f04078bc0 0x7f8f0407b0d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f18155fc0 0x7f8f18069240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f18152ce0 0x7f8f18068d00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 --2- 172.21.15.104:0/987885766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f1806fa80 0x7f8f1814b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 >> 172.21.15.104:0/987885766 conn(0x7f8f180b3640 msgr2=0x7f8f1815e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:13.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 shutdown_connections 2024-09-17T03:00:13.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.662+0000 7f8f1e7c3640 1 -- 172.21.15.104:0/987885766 wait complete. 2024-09-17T03:00:13.673 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-17T03:00:13.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.787+0000 7f6832a8b640 1 -- 172.21.15.104:0/2242966537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 msgr2=0x7f6814003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.787 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.787+0000 7f6832a8b640 1 --2- 172.21.15.104:0/2242966537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 0x7f6814003ec0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6828006fc0 tx=0x7f6814005830 comp rx=0 tx=0).stop 2024-09-17T03:00:13.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.787+0000 7f6832a8b640 1 -- 172.21.15.104:0/2242966537 shutdown_connections 2024-09-17T03:00:13.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.787+0000 7f6832a8b640 1 --2- 172.21.15.104:0/2242966537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 0x7f6814003ec0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.787+0000 7f6832a8b640 1 -- 172.21.15.104:0/2242966537 >> 172.21.15.104:0/2242966537 conn(0x7f682c0d28a0 msgr2=0x7f682c0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:13.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.787+0000 7f6832a8b640 1 -- 172.21.15.104:0/2242966537 shutdown_connections 2024-09-17T03:00:13.788 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.787+0000 7f6832a8b640 1 -- 172.21.15.104:0/2242966537 wait complete. 2024-09-17T03:00:13.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.789+0000 7f6832a8b640 1 Processor -- start 2024-09-17T03:00:13.789 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.789+0000 7f6832a8b640 1 -- start start 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6832a8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 0x7f682c1e8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6832a8b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f682c1db8d0 0x7f682c1f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6832a8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682c1dbce0 0x7f682c1f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6832a8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f682c0ce220 con 0x7f6814003a50 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6832a8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f682c0ce0a0 con 0x7f682c1dbce0 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6832a8b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f682c0ce3a0 con 0x7f682c1db8d0 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6830827640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 0x7f682c1e8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6830827640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 0x7f682c1e8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:39512/0 (socket says 172.21.15.104:39512) 2024-09-17T03:00:13.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.790+0000 7f6830827640 1 -- 172.21.15.104:0/1709524500 learned_addr learned my addr 172.21.15.104:0/1709524500 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6823fff640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f682c1db8d0 0x7f682c1f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6831028640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682c1dbce0 0x7f682c1f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6830827640 1 -- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f682c1db8d0 msgr2=0x7f682c1f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6830827640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f682c1db8d0 0x7f682c1f6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6830827640 1 -- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682c1dbce0 msgr2=0x7f682c1f74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6830827640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682c1dbce0 0x7f682c1f74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6830827640 1 -- 172.21.15.104:0/1709524500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c0ccc30 con 0x7f6814003a50 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6830827640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 0x7f682c1e8770 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f682800c350 tx=0x7f6828001220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:13.792 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f68217fa640 1 -- 172.21.15.104:0/1709524500 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68280037f0 con 0x7f6814003a50 2024-09-17T03:00:13.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f68217fa640 1 -- 172.21.15.104:0/1709524500 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f682803e070 con 0x7f6814003a50 2024-09-17T03:00:13.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682c1dfb40 con 0x7f6814003a50 2024-09-17T03:00:13.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f68217fa640 1 -- 172.21.15.104:0/1709524500 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828003d40 con 0x7f6814003a50 2024-09-17T03:00:13.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.791+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682c0cc670 con 0x7f6814003a50 2024-09-17T03:00:13.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.792+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682c074eb0 con 0x7f6814003a50 2024-09-17T03:00:13.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.793+0000 7f68217fa640 1 -- 172.21.15.104:0/1709524500 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f682802e480 con 0x7f6814003a50 2024-09-17T03:00:13.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.793+0000 7f68217fa640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6818078bc0 0x7f681807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:13.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.794+0000 7f68217fa640 1 -- 172.21.15.104:0/1709524500 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f68280bbd30 con 0x7f6814003a50 2024-09-17T03:00:13.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.794+0000 7f6823fff640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6818078bc0 0x7f681807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:13.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.794+0000 7f6823fff640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6818078bc0 0x7f681807b0d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f682c1e97f0 tx=0x7f681c006d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:13.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:13.798+0000 7f68217fa640 1 -- 172.21.15.104:0/1709524500 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f682c074eb0 con 0x7f6814003a50 2024-09-17T03:00:14.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:14.044+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7f682c0d0a40 con 0x7f6814003a50 2024-09-17T03:00:15.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.040+0000 7f68217fa640 1 -- 172.21.15.104:0/1709524500 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v283) ==== 131+0+0 (secure 0 0 0) 0x7f6828048060 con 0x7f6814003a50 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6818078bc0 msgr2=0x7f681807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6818078bc0 0x7f681807b0d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f682c1e97f0 tx=0x7f681c006d10 comp rx=0 tx=0).stop 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 msgr2=0x7f682c1e8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 0x7f682c1e8770 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f682800c350 tx=0x7f6828001220 comp rx=0 tx=0).stop 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 shutdown_connections 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6818078bc0 0x7f681807b0d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682c1dbce0 0x7f682c1f74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f682c1db8d0 0x7f682c1f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 --2- 172.21.15.104:0/1709524500 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6814003a50 0x7f682c1e8770 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 >> 172.21.15.104:0/1709524500 conn(0x7f682c0d28a0 msgr2=0x7f682c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:15.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 shutdown_connections 2024-09-17T03:00:15.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.043+0000 7f6832a8b640 1 -- 172.21.15.104:0/1709524500 wait complete. 2024-09-17T03:00:15.057 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:00:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.175+0000 7f9642d20640 1 -- 172.21.15.104:0/3874239642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c0cff70 msgr2=0x7f963c15b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.175+0000 7f9642d20640 1 --2- 172.21.15.104:0/3874239642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c0cff70 0x7f963c15b170 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f963c073ad0 tx=0x7f962c02a540 comp rx=0 tx=0).stop 2024-09-17T03:00:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.175+0000 7f9642d20640 1 -- 172.21.15.104:0/3874239642 shutdown_connections 2024-09-17T03:00:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.175+0000 7f9642d20640 1 --2- 172.21.15.104:0/3874239642 >> v2:172.21.15.192:3300/0 conn(0x7f963c073540 0x7f963c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.175+0000 7f9642d20640 1 --2- 172.21.15.104:0/3874239642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c0cff70 0x7f963c15b170 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.175+0000 7f9642d20640 1 -- 172.21.15.104:0/3874239642 >> 172.21.15.104:0/3874239642 conn(0x7f963c0b2450 msgr2=0x7f963c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.175+0000 7f9642d20640 1 -- 172.21.15.104:0/3874239642 shutdown_connections 2024-09-17T03:00:15.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.175+0000 7f9642d20640 1 -- 172.21.15.104:0/3874239642 wait complete. 2024-09-17T03:00:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.177+0000 7f9642d20640 1 Processor -- start 2024-09-17T03:00:15.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.177+0000 7f9642d20640 1 -- start start 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9642d20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c06f840 0x7f963c146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9642d20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c073540 0x7f963c146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9642d20640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f963c0cff70 0x7f963c147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9642d20640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f963c06fdd0 con 0x7f963c06f840 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9642d20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f963c06fc50 con 0x7f963c073540 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9642d20640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f963c0b3c90 con 0x7f963c0cff70 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9640abc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c06f840 0x7f963c146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9640abc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c06f840 0x7f963c146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37352/0 (socket says 172.21.15.104:37352) 2024-09-17T03:00:15.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.178+0000 7f9640abc640 1 -- 172.21.15.104:0/1856488952 learned_addr learned my addr 172.21.15.104:0/1856488952 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f96412bd640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f963c0cff70 0x7f963c147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f963bfff640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c073540 0x7f963c146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f9640abc640 1 -- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f963c0cff70 msgr2=0x7f963c147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f9640abc640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f963c0cff70 0x7f963c147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f9640abc640 1 -- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c073540 msgr2=0x7f963c146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f9640abc640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c073540 0x7f963c146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f9640abc640 1 -- 172.21.15.104:0/1856488952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c0af370 con 0x7f963c06f840 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f9640abc640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c06f840 0x7f963c146630 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f962c009920 tx=0x7f962c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f96397fa640 1 -- 172.21.15.104:0/1856488952 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c031d60 con 0x7f963c06f840 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f96397fa640 1 -- 172.21.15.104:0/1856488952 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f962c005020 con 0x7f963c06f840 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963c1e6cb0 con 0x7f963c06f840 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f96397fa640 1 -- 172.21.15.104:0/1856488952 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c005470 con 0x7f963c06f840 2024-09-17T03:00:15.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.179+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963c146b70 con 0x7f963c06f840 2024-09-17T03:00:15.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.180+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963c0b4140 con 0x7f963c06f840 2024-09-17T03:00:15.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.181+0000 7f96397fa640 1 -- 172.21.15.104:0/1856488952 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f962c0047a0 con 0x7f963c06f840 2024-09-17T03:00:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.182+0000 7f96397fa640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9628078bc0 0x7f962807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.182+0000 7f96397fa640 1 -- 172.21.15.104:0/1856488952 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f962c0bbcf0 con 0x7f963c06f840 2024-09-17T03:00:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.182+0000 7f963bfff640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9628078bc0 0x7f962807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:15.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.182+0000 7f963bfff640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9628078bc0 0x7f962807b0d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f963c1597d0 tx=0x7f9630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:15.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.186+0000 7f96397fa640 1 -- 172.21.15.104:0/1856488952 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f962c0c0070 con 0x7f963c06f840 2024-09-17T03:00:15.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.358+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f963c15b3a0 con 0x7f963c06f840 2024-09-17T03:00:15.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.359+0000 7f96397fa640 1 -- 172.21.15.104:0/1856488952 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+1472 (secure 0 0 0) 0x7f962c03f030 con 0x7f963c06f840 2024-09-17T03:00:15.358 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T03:00:15.359 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:00:15.360 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9628078bc0 msgr2=0x7f962807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9628078bc0 0x7f962807b0d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f963c1597d0 tx=0x7f9630009040 comp rx=0 tx=0).stop 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c06f840 msgr2=0x7f963c146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c06f840 0x7f963c146630 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f962c009920 tx=0x7f962c033d60 comp rx=0 tx=0).stop 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 shutdown_connections 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9628078bc0 0x7f962807b0d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f963c073540 0x7f963c146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f963c0cff70 0x7f963c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 --2- 172.21.15.104:0/1856488952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f963c06f840 0x7f963c146630 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 >> 172.21.15.104:0/1856488952 conn(0x7f963c0b2450 msgr2=0x7f963c15a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:15.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 shutdown_connections 2024-09-17T03:00:15.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.361+0000 7f9642d20640 1 -- 172.21.15.104:0/1856488952 wait complete. 2024-09-17T03:00:15.372 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:00:15.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.487+0000 7f2c62263640 1 -- 172.21.15.104:0/1171633209 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c073c00 msgr2=0x7f2c5c0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.487+0000 7f2c62263640 1 --2- 172.21.15.104:0/1171633209 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c073c00 0x7f2c5c0b6000 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0ce490 tx=0x7f2c5002a530 comp rx=0 tx=0).stop 2024-09-17T03:00:15.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.487+0000 7f2c62263640 1 -- 172.21.15.104:0/1171633209 shutdown_connections 2024-09-17T03:00:15.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.487+0000 7f2c62263640 1 --2- 172.21.15.104:0/1171633209 >> v2:172.21.15.192:3300/0 conn(0x7f2c5c06f550 0x7f2c5c0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.487+0000 7f2c62263640 1 --2- 172.21.15.104:0/1171633209 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c073c00 0x7f2c5c0b6000 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.487+0000 7f2c62263640 1 -- 172.21.15.104:0/1171633209 >> 172.21.15.104:0/1171633209 conn(0x7f2c5c06d200 msgr2=0x7f2c5c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:15.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.487+0000 7f2c62263640 1 -- 172.21.15.104:0/1171633209 shutdown_connections 2024-09-17T03:00:15.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.487+0000 7f2c62263640 1 -- 172.21.15.104:0/1171633209 wait complete. 2024-09-17T03:00:15.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.489+0000 7f2c62263640 1 Processor -- start 2024-09-17T03:00:15.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.489+0000 7f2c62263640 1 -- start start 2024-09-17T03:00:15.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.490+0000 7f2c62263640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c06f550 0x7f2c5c146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:15.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.490+0000 7f2c62263640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c5c15bd20 0x7f2c5c0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:15.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.490+0000 7f2c62263640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c5c1580b0 0x7f2c5c0b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.490+0000 7f2c62263640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0cf470 con 0x7f2c5c06f550 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.490+0000 7f2c62263640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0cf2f0 con 0x7f2c5c1580b0 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.490+0000 7f2c62263640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5c0cf5f0 con 0x7f2c5c15bd20 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c06f550 0x7f2c5c146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c06f550 0x7f2c5c146700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37376/0 (socket says 172.21.15.104:37376) 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 -- 172.21.15.104:0/3918712025 learned_addr learned my addr 172.21.15.104:0/3918712025 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5b7fe640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c5c15bd20 0x7f2c5c0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 -- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c5c15bd20 msgr2=0x7f2c5c0b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c5c15bd20 0x7f2c5c0b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c60800640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c5c1580b0 0x7f2c5c0b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 -- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c5c1580b0 msgr2=0x7f2c5c0b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c5c1580b0 0x7f2c5c0b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 -- 172.21.15.104:0/3918712025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c149060 con 0x7f2c5c06f550 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c5bfff640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c06f550 0x7f2c5c146700 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00c3c0 tx=0x7f2c4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c58ff9640 1 -- 172.21.15.104:0/3918712025 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c017070 con 0x7f2c5c06f550 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c58ff9640 1 -- 172.21.15.104:0/3918712025 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c4c0035f0 con 0x7f2c5c06f550 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c58ff9640 1 -- 172.21.15.104:0/3918712025 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c003a80 con 0x7f2c5c06f550 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c149560 con 0x7f2c5c06f550 2024-09-17T03:00:15.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.491+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c149b20 con 0x7f2c5c06f550 2024-09-17T03:00:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.493+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5c06afc0 con 0x7f2c5c06f550 2024-09-17T03:00:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.493+0000 7f2c58ff9640 1 -- 172.21.15.104:0/3918712025 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c4c01a070 con 0x7f2c5c06f550 2024-09-17T03:00:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.494+0000 7f2c58ff9640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c48078bc0 0x7f2c4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.494+0000 7f2c58ff9640 1 -- 172.21.15.104:0/3918712025 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f2c4c099ca0 con 0x7f2c5c06f550 2024-09-17T03:00:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.494+0000 7f2c5b7fe640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c48078bc0 0x7f2c4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.495+0000 7f2c5b7fe640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c48078bc0 0x7f2c4807b0d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2c50034000 tx=0x7f2c50004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:15.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.499+0000 7f2c58ff9640 1 -- 172.21.15.104:0/3918712025 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c5c06afc0 con 0x7f2c5c06f550 2024-09-17T03:00:15.668 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.669+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2c5c0b47f0 con 0x7f2c5c06f550 2024-09-17T03:00:15.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.673+0000 7f2c58ff9640 1 -- 172.21.15.104:0/3918712025 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f2c4c062470 con 0x7f2c5c06f550 2024-09-17T03:00:15.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c48078bc0 msgr2=0x7f2c4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c48078bc0 0x7f2c4807b0d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2c50034000 tx=0x7f2c50004730 comp rx=0 tx=0).stop 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c06f550 msgr2=0x7f2c5c146700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c06f550 0x7f2c5c146700 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00c3c0 tx=0x7f2c4c00c880 comp rx=0 tx=0).stop 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 shutdown_connections 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c48078bc0 0x7f2c4807b0d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c5c1580b0 0x7f2c5c0b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c5c15bd20 0x7f2c5c0b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 --2- 172.21.15.104:0/3918712025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c5c06f550 0x7f2c5c146700 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 >> 172.21.15.104:0/3918712025 conn(0x7f2c5c06d200 msgr2=0x7f2c5c0734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 shutdown_connections 2024-09-17T03:00:15.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:15.675+0000 7f2c62263640 1 -- 172.21.15.104:0/3918712025 wait complete. 2024-09-17T03:00:15.686 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:00:15.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:00:15.730 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:00:15.772 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:00:15.773 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:15.773 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:15.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:00:15.789 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:15.789 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:15.831 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:00:15.831 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:15.831 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:15.846 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:00:15.846 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:15.846 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:15.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:00:15.888 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:00:15.888 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:16.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.000+0000 7f67d732b640 1 -- 172.21.15.104:0/2461057934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc003c30 msgr2=0x7f67bc004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:16.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.000+0000 7f67d732b640 1 --2- 172.21.15.104:0/2461057934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc003c30 0x7f67bc004080 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f67cc006fa0 tx=0x7f67bc005830 comp rx=0 tx=0).stop 2024-09-17T03:00:16.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.000+0000 7f67d732b640 1 -- 172.21.15.104:0/2461057934 shutdown_connections 2024-09-17T03:00:16.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.000+0000 7f67d732b640 1 --2- 172.21.15.104:0/2461057934 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67bc003c30 0x7f67bc004080 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.000+0000 7f67d732b640 1 -- 172.21.15.104:0/2461057934 >> 172.21.15.104:0/2461057934 conn(0x7f67d00b44a0 msgr2=0x7f67d00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:16.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.000+0000 7f67d732b640 1 -- 172.21.15.104:0/2461057934 shutdown_connections 2024-09-17T03:00:16.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.000+0000 7f67d732b640 1 -- 172.21.15.104:0/2461057934 wait complete. 2024-09-17T03:00:16.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.002+0000 7f67d732b640 1 Processor -- start 2024-09-17T03:00:16.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.002+0000 7f67d732b640 1 -- start start 2024-09-17T03:00:16.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.003+0000 7f67d732b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67bc003c30 0x7f67d00caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:16.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.003+0000 7f67d732b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67d01d8260 0x7f67d01f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:16.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.003+0000 7f67d732b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d01d8670 0x7f67d01f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:16.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.003+0000 7f67d732b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f67d00cf810 con 0x7f67d01d8260 2024-09-17T03:00:16.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.003+0000 7f67d732b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f67d00cf690 con 0x7f67d01d8670 2024-09-17T03:00:16.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.003+0000 7f67d732b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f67d00d1960 con 0x7f67bc003c30 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67d01d8260 0x7f67d01f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67d01d8260 0x7f67d01f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37402/0 (socket says 172.21.15.104:37402) 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 -- 172.21.15.104:0/321562851 learned_addr learned my addr 172.21.15.104:0/321562851 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d50c7640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67bc003c30 0x7f67d00caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 -- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67bc003c30 msgr2=0x7f67d00caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d58c8640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d01d8670 0x7f67d01f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67bc003c30 0x7f67d00caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 -- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d01d8670 msgr2=0x7f67d01f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d01d8670 0x7f67d01f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 -- 172.21.15.104:0/321562851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d00cb530 con 0x7f67d01d8260 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d50c7640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67bc003c30 0x7f67d00caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:16.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d58c8640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d01d8670 0x7f67d01f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:16.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d48c6640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67d01d8260 0x7f67d01f9180 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f67c0011ae0 tx=0x7f67c0009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:16.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67c5ffb640 1 -- 172.21.15.104:0/321562851 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c000fcb0 con 0x7f67d01d8260 2024-09-17T03:00:16.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67c5ffb640 1 -- 172.21.15.104:0/321562851 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67c000fe50 con 0x7f67d01d8260 2024-09-17T03:00:16.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d00cb810 con 0x7f67d01d8260 2024-09-17T03:00:16.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67c5ffb640 1 -- 172.21.15.104:0/321562851 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c0004280 con 0x7f67d01d8260 2024-09-17T03:00:16.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.004+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d00cbdd0 con 0x7f67d01d8260 2024-09-17T03:00:16.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.006+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d00cb2a0 con 0x7f67d01d8260 2024-09-17T03:00:16.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.006+0000 7f67c5ffb640 1 -- 172.21.15.104:0/321562851 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67c00035f0 con 0x7f67d01d8260 2024-09-17T03:00:16.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.006+0000 7f67c5ffb640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b4078b90 0x7f67b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:16.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.007+0000 7f67c5ffb640 1 -- 172.21.15.104:0/321562851 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f67c009b590 con 0x7f67d01d8260 2024-09-17T03:00:16.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.007+0000 7f67d50c7640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b4078b90 0x7f67b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:16.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.007+0000 7f67d50c7640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b4078b90 0x7f67b407b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f67cc033000 tx=0x7f67cc02d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:16.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.011+0000 7f67c5ffb640 1 -- 172.21.15.104:0/321562851 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f67c0063cd0 con 0x7f67d01d8260 2024-09-17T03:00:16.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.219+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67d00d1ec0 con 0x7f67d01d8260 2024-09-17T03:00:16.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.220+0000 7f67c5ffb640 1 -- 172.21.15.104:0/321562851 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+3923 (secure 0 0 0) 0x7f67c00635d0 con 0x7f67d01d8260 2024-09-17T03:00:16.219 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:16.219 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":44,"btime":"2024-09-17T03:00:09:739084+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5950,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/4122183556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4122183556},{"type":"v1","addr":"172.21.15.104:6835","nonce":4122183556}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5956,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1891543935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1891543935},{"type":"v1","addr":"172.21.15.192:6835","nonce":1891543935}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":5965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1667118256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":1667118256},{"type":"v1","addr":"172.21.15.192:6837","nonce":1667118256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6591,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2105758299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2105758299},{"type":"v1","addr":"172.21.15.104:6834","nonce":2105758299}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[]} 2024-09-17T03:00:16.220 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 44 2024-09-17T03:00:16.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b4078b90 msgr2=0x7f67b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b4078b90 0x7f67b407b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f67cc033000 tx=0x7f67cc02d000 comp rx=0 tx=0).stop 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67d01d8260 msgr2=0x7f67d01f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67d01d8260 0x7f67d01f9180 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f67c0011ae0 tx=0x7f67c0009f10 comp rx=0 tx=0).stop 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 shutdown_connections 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f67b4078b90 0x7f67b407b0a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67d01d8670 0x7f67d01f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67d01d8260 0x7f67d01f9180 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 --2- 172.21.15.104:0/321562851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67bc003c30 0x7f67d00caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 >> 172.21.15.104:0/321562851 conn(0x7f67d00b44a0 msgr2=0x7f67d00ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 shutdown_connections 2024-09-17T03:00:16.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.222+0000 7f67d732b640 1 -- 172.21.15.104:0/321562851 wait complete. 2024-09-17T03:00:16.233 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:00:16.233 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:00:16.233 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:00:16.233 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:00:16.233 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:00:16.233 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:00:16.234 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:00:16.234 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:00:16.234 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:00:16.234 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:00:16.234 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:00:16.234 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:00:16.234 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:00:16.235 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:00:16.235 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:00:16.235 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:00:16.243 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:00:16.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:00:16.245 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:00:16.246 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:00:16.247 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:00:16.247 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:00:16.248 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:00:16.248 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:00:16.288 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:00:16.288 DEBUG:teuthology.parallel:result is None 2024-09-17T03:00:16.289 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:00:16.289 DEBUG:teuthology.parallel:result is None 2024-09-17T03:00:16.290 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:00:16.290 DEBUG:teuthology.parallel:result is None 2024-09-17T03:00:16.291 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:00:16.291 DEBUG:teuthology.parallel:result is None 2024-09-17T03:00:16.292 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:00:16.377 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T03:00:16.377 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T03:00:16.383 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T03:00:16.383 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T03:00:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.413+0000 7f904e863640 1 -- 172.21.15.104:0/3266790374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 msgr2=0x7f90480d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.413+0000 7f904e863640 1 --2- 172.21.15.104:0/3266790374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 0x7f90480d34f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9040005fd0 tx=0x7f904002aa80 comp rx=0 tx=0).stop 2024-09-17T03:00:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.413+0000 7f904e863640 1 -- 172.21.15.104:0/3266790374 shutdown_connections 2024-09-17T03:00:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.413+0000 7f904e863640 1 --2- 172.21.15.104:0/3266790374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 0x7f90480d34f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.413+0000 7f904e863640 1 --2- 172.21.15.104:0/3266790374 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90480d18e0 0x7f904815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.413+0000 7f904e863640 1 -- 172.21.15.104:0/3266790374 >> 172.21.15.104:0/3266790374 conn(0x7f9048073df0 msgr2=0x7f9048068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:16.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.414+0000 7f904e863640 1 -- 172.21.15.104:0/3266790374 shutdown_connections 2024-09-17T03:00:16.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.414+0000 7f904e863640 1 -- 172.21.15.104:0/3266790374 wait complete. 2024-09-17T03:00:16.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.415+0000 7f904e863640 1 Processor -- start 2024-09-17T03:00:16.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.415+0000 7f904e863640 1 -- start start 2024-09-17T03:00:16.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904e863640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 0x7f90480ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:16.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904e863640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90480b6f70 0x7f9048155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:16.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904e863640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90480d18e0 0x7f90480b9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:16.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904e863640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f90480d3e40 con 0x7f90480d18e0 2024-09-17T03:00:16.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904e863640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f90480d3cc0 con 0x7f90480b3b00 2024-09-17T03:00:16.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904e863640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f90480d3fc0 con 0x7f90480b6f70 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904ce00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90480d18e0 0x7f90480b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904ce00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90480d18e0 0x7f90480b9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37450/0 (socket says 172.21.15.104:37450) 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f904ce00640 1 -- 172.21.15.104:0/3866900457 learned_addr learned my addr 172.21.15.104:0/3866900457 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f9047fff640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 0x7f90480ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f903f7fe640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90480b6f70 0x7f9048155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f9047fff640 1 -- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90480b6f70 msgr2=0x7f9048155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f9047fff640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90480b6f70 0x7f9048155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f9047fff640 1 -- 172.21.15.104:0/3866900457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90480d18e0 msgr2=0x7f90480b9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f9047fff640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90480d18e0 0x7f90480b9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f9047fff640 1 -- 172.21.15.104:0/3866900457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9048161760 con 0x7f90480b3b00 2024-09-17T03:00:16.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.417+0000 7f9047fff640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 0x7f90480ce220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f903800c3f0 tx=0x7f903800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:16.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.418+0000 7f90457fa640 1 -- 172.21.15.104:0/3866900457 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038017070 con 0x7f90480b3b00 2024-09-17T03:00:16.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.418+0000 7f90457fa640 1 -- 172.21.15.104:0/3866900457 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90380035f0 con 0x7f90480b3b00 2024-09-17T03:00:16.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.418+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9048161a40 con 0x7f90480b3b00 2024-09-17T03:00:16.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.418+0000 7f90457fa640 1 -- 172.21.15.104:0/3866900457 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038003a40 con 0x7f90480b3b00 2024-09-17T03:00:16.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.418+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9048162000 con 0x7f90480b3b00 2024-09-17T03:00:16.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.419+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90480d44e0 con 0x7f90480b3b00 2024-09-17T03:00:16.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.420+0000 7f90457fa640 1 -- 172.21.15.104:0/3866900457 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f903801a070 con 0x7f90480b3b00 2024-09-17T03:00:16.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.420+0000 7f90457fa640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9028078b90 0x7f902807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:16.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.420+0000 7f90457fa640 1 -- 172.21.15.104:0/3866900457 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f9038099bd0 con 0x7f90480b3b00 2024-09-17T03:00:16.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.420+0000 7f903f7fe640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9028078b90 0x7f902807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:16.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.421+0000 7f903f7fe640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9028078b90 0x7f902807b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f904815f240 tx=0x7f9030005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:16.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.425+0000 7f90457fa640 1 -- 172.21.15.104:0/3866900457 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9038061d90 con 0x7f90480b3b00 2024-09-17T03:00:16.607 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:16.608+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f90480cf490 con 0x7f90480b3b00 2024-09-17T03:00:17.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.691+0000 7f90457fa640 1 -- 172.21.15.104:0/3866900457 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v119) ==== 97+0+0 (secure 0 0 0) 0x7f90380667c0 con 0x7f90480b3b00 2024-09-17T03:00:17.691 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T03:00:17.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9028078b90 msgr2=0x7f902807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:17.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9028078b90 0x7f902807b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f904815f240 tx=0x7f9030005f90 comp rx=0 tx=0).stop 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 msgr2=0x7f90480ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 0x7f90480ce220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f903800c3f0 tx=0x7f903800c7f0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 shutdown_connections 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9028078b90 0x7f902807b0a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90480d18e0 0x7f90480b9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90480b6f70 0x7f9048155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 --2- 172.21.15.104:0/3866900457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90480b3b00 0x7f90480ce220 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 >> 172.21.15.104:0/3866900457 conn(0x7f9048073df0 msgr2=0x7f9048068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 shutdown_connections 2024-09-17T03:00:17.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.694+0000 7f904e863640 1 -- 172.21.15.104:0/3866900457 wait complete. 2024-09-17T03:00:17.707 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:00:17.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 -- 172.21.15.104:0/2693655409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 msgr2=0x7f9b300b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:17.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/2693655409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 0x7f9b300b6090 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f9b30072ff0 tx=0x7f9b2802aa30 comp rx=0 tx=0).stop 2024-09-17T03:00:17.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 -- 172.21.15.104:0/2693655409 shutdown_connections 2024-09-17T03:00:17.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/2693655409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 0x7f9b300b6090 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/2693655409 >> v2:172.21.15.192:3300/0 conn(0x7f9b300b27c0 0x7f9b300b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/2693655409 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b300b7c00 0x7f9b300b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 -- 172.21.15.104:0/2693655409 >> 172.21.15.104:0/2693655409 conn(0x7f9b300b4400 msgr2=0x7f9b300b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:17.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 -- 172.21.15.104:0/2693655409 shutdown_connections 2024-09-17T03:00:17.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.827+0000 7f9b35e2e640 1 -- 172.21.15.104:0/2693655409 wait complete. 2024-09-17T03:00:17.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.829+0000 7f9b35e2e640 1 Processor -- start 2024-09-17T03:00:17.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.829+0000 7f9b35e2e640 1 -- start start 2024-09-17T03:00:17.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b35e2e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b300b27c0 0x7f9b3014cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:17.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b35e2e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 0x7f9b3014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:17.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b35e2e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b300b7c00 0x7f9b3014da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:17.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b35e2e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30161170 con 0x7f9b300b5c80 2024-09-17T03:00:17.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b35e2e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9b300b5340 con 0x7f9b300b7c00 2024-09-17T03:00:17.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b35e2e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9b301612f0 con 0x7f9b300b27c0 2024-09-17T03:00:17.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b2effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 0x7f9b3014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:17.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b2effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 0x7f9b3014d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37470/0 (socket says 172.21.15.104:37470) 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.830+0000 7f9b2effd640 1 -- 172.21.15.104:0/1430668794 learned_addr learned my addr 172.21.15.104:0/1430668794 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2f7fe640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b300b27c0 0x7f9b3014cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2ffff640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b300b7c00 0x7f9b3014da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2effd640 1 -- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b300b27c0 msgr2=0x7f9b3014cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2effd640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b300b27c0 0x7f9b3014cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2effd640 1 -- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b300b7c00 msgr2=0x7f9b3014da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2effd640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b300b7c00 0x7f9b3014da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2effd640 1 -- 172.21.15.104:0/1430668794 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3015edb0 con 0x7f9b300b5c80 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2ffff640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b300b7c00 0x7f9b3014da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b2effd640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 0x7f9b3014d550 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c740 tx=0x7f9b2400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b17fff640 1 -- 172.21.15.104:0/1430668794 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24004220 con 0x7f9b300b5c80 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b17fff640 1 -- 172.21.15.104:0/1430668794 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b2400ce50 con 0x7f9b300b5c80 2024-09-17T03:00:17.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3015f090 con 0x7f9b300b5c80 2024-09-17T03:00:17.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b17fff640 1 -- 172.21.15.104:0/1430668794 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24007c10 con 0x7f9b300b5c80 2024-09-17T03:00:17.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.831+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3015f650 con 0x7f9b300b5c80 2024-09-17T03:00:17.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.832+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b300b6090 con 0x7f9b300b5c80 2024-09-17T03:00:17.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.833+0000 7f9b17fff640 1 -- 172.21.15.104:0/1430668794 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b240035f0 con 0x7f9b300b5c80 2024-09-17T03:00:17.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.833+0000 7f9b17fff640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:17.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.834+0000 7f9b17fff640 1 -- 172.21.15.104:0/1430668794 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7f9b2409ae10 con 0x7f9b300b5c80 2024-09-17T03:00:17.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.834+0000 7f9b2f7fe640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:17.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.834+0000 7f9b2f7fe640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9b20005860 tx=0x7f9b2000c440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:17.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:17.838+0000 7f9b17fff640 1 -- 172.21.15.104:0/1430668794 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9b24014030 con 0x7f9b300b5c80 2024-09-17T03:00:18.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.080+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9b3015eb40 con 0x7f9b300b5c80 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.080+0000 7f9b17fff640 1 -- 172.21.15.104:0/1430668794 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) ==== 80+0+5304 (secure 0 0 0) 0x7f9b240635a0 con 0x7f9b300b5c80 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:18.080 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:18.081 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T03:00:18.082 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:18.083 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.085 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.086 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T03:00:18.087 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:18.088 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.089 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T03:00:18.090 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:00:18.091 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.092 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T03:00:18.093 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T03:00:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:00:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:00:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.094 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:18.094 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:00:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b1c078b90 msgr2=0x7f9b1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9b20005860 tx=0x7f9b2000c440 comp rx=0 tx=0).stop 2024-09-17T03:00:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 msgr2=0x7f9b3014d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 0x7f9b3014d550 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c740 tx=0x7f9b2400cc00 comp rx=0 tx=0).stop 2024-09-17T03:00:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 shutdown_connections 2024-09-17T03:00:18.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9b1c078b90 0x7f9b1c07b0a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b300b7c00 0x7f9b3014da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9b300b5c80 0x7f9b3014d550 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 --2- 172.21.15.104:0/1430668794 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b300b27c0 0x7f9b3014cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 >> 172.21.15.104:0/1430668794 conn(0x7f9b300b4400 msgr2=0x7f9b300b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:18.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 shutdown_connections 2024-09-17T03:00:18.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.082+0000 7f9b35e2e640 1 -- 172.21.15.104:0/1430668794 wait complete. 2024-09-17T03:00:18.097 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:00:18.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.210+0000 7f757f3c3640 1 -- 172.21.15.104:0/2521229456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7564003a50 msgr2=0x7f7564003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.210+0000 7f757f3c3640 1 --2- 172.21.15.104:0/2521229456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7564003a50 0x7f7564003ec0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7574009b20 tx=0x7f7564005830 comp rx=0 tx=0).stop 2024-09-17T03:00:18.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.210+0000 7f757d960640 1 -- 172.21.15.104:0/2521229456 reap_dead start 2024-09-17T03:00:18.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.210+0000 7f757f3c3640 1 -- 172.21.15.104:0/2521229456 shutdown_connections 2024-09-17T03:00:18.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.210+0000 7f757f3c3640 1 -- 172.21.15.104:0/2521229456 >> 172.21.15.104:0/2521229456 conn(0x7f757806eb90 msgr2=0x7f757806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:18.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.210+0000 7f757f3c3640 1 -- 172.21.15.104:0/2521229456 shutdown_connections 2024-09-17T03:00:18.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.210+0000 7f757f3c3640 1 -- 172.21.15.104:0/2521229456 wait complete. 2024-09-17T03:00:18.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.212+0000 7f757f3c3640 1 Processor -- start 2024-09-17T03:00:18.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.212+0000 7f757f3c3640 1 -- start start 2024-09-17T03:00:18.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.213+0000 7f757f3c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7564003a50 0x7f7578157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:18.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.213+0000 7f757f3c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f757814c5a0 0x7f75781f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:18.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.213+0000 7f757f3c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7578072cf0 0x7f7578073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:18.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.213+0000 7f757f3c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7578156200 con 0x7f7578072cf0 2024-09-17T03:00:18.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.213+0000 7f757f3c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f757815d0c0 con 0x7f7564003a50 2024-09-17T03:00:18.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.213+0000 7f757f3c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7578156380 con 0x7f757814c5a0 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7578072cf0 0x7f7578073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7578072cf0 0x7f7578073100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37488/0 (socket says 172.21.15.104:37488) 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 -- 172.21.15.104:0/3062173364 learned_addr learned my addr 172.21.15.104:0/3062173364 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d15f640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7564003a50 0x7f7578157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757c95e640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f757814c5a0 0x7f75781f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 -- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f757814c5a0 msgr2=0x7f75781f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f757814c5a0 0x7f75781f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 -- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7564003a50 msgr2=0x7f7578157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7564003a50 0x7f7578157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 -- 172.21.15.104:0/3062173364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75781f3aa0 con 0x7f7578072cf0 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757c95e640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f757814c5a0 0x7f75781f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:18.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757d960640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7578072cf0 0x7f7578073100 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f75780cede0 tx=0x7f7570006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:18.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f756dffb640 1 -- 172.21.15.104:0/3062173364 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570010890 con 0x7f7578072cf0 2024-09-17T03:00:18.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f756dffb640 1 -- 172.21.15.104:0/3062173364 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7570017070 con 0x7f7578072cf0 2024-09-17T03:00:18.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7578073640 con 0x7f7578072cf0 2024-09-17T03:00:18.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f756dffb640 1 -- 172.21.15.104:0/3062173364 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570010dc0 con 0x7f7578072cf0 2024-09-17T03:00:18.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.214+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75781496d0 con 0x7f7578072cf0 2024-09-17T03:00:18.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.215+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7578158560 con 0x7f7578072cf0 2024-09-17T03:00:18.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.216+0000 7f756dffb640 1 -- 172.21.15.104:0/3062173364 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f757001c460 con 0x7f7578072cf0 2024-09-17T03:00:18.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.217+0000 7f756dffb640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f755c078b90 0x7f755c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:18.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.217+0000 7f756dffb640 1 -- 172.21.15.104:0/3062173364 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7f757009b2f0 con 0x7f7578072cf0 2024-09-17T03:00:18.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.217+0000 7f757d15f640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f755c078b90 0x7f755c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:18.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.218+0000 7f757d15f640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f755c078b90 0x7f755c07b0a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7574035000 tx=0x7f757402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:18.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.221+0000 7f756dffb640 1 -- 172.21.15.104:0/3062173364 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7578073640 con 0x7f7578072cf0 2024-09-17T03:00:18.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.396+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f75780cd770 con 0x7f7578072cf0 2024-09-17T03:00:18.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.396+0000 7f756dffb640 1 -- 172.21.15.104:0/3062173364 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) ==== 84+0+65 (secure 0 0 0) 0x7f75781f3aa0 con 0x7f7578072cf0 2024-09-17T03:00:18.396 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:18.396 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T03:00:18.396 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:18.396 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T03:00:18.397 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T03:00:18.397 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:18.397 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T03:00:18.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f755c078b90 msgr2=0x7f755c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f755c078b90 0x7f755c07b0a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7574035000 tx=0x7f757402d040 comp rx=0 tx=0).stop 2024-09-17T03:00:18.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7578072cf0 msgr2=0x7f7578073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7578072cf0 0x7f7578073100 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f75780cede0 tx=0x7f7570006420 comp rx=0 tx=0).stop 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 shutdown_connections 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f755c078b90 0x7f755c07b0a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7578072cf0 0x7f7578073100 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f757814c5a0 0x7f75781f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 --2- 172.21.15.104:0/3062173364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7564003a50 0x7f7578157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 >> 172.21.15.104:0/3062173364 conn(0x7f757806eb90 msgr2=0x7f757806ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 shutdown_connections 2024-09-17T03:00:18.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.399+0000 7f757f3c3640 1 -- 172.21.15.104:0/3062173364 wait complete. 2024-09-17T03:00:18.409 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:00:18.410 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 -- 172.21.15.104:0/1563637496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 msgr2=0x7f393c0b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 --2- 172.21.15.104:0/1563637496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 0x7f393c0b3960 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f393c0c64c0 tx=0x7f392c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 -- 172.21.15.104:0/1563637496 shutdown_connections 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 --2- 172.21.15.104:0/1563637496 >> v2:172.21.15.192:3300/0 conn(0x7f393c0b2840 0x7f393c0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 --2- 172.21.15.104:0/1563637496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f393c0b3ea0 0x7f393c0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 --2- 172.21.15.104:0/1563637496 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 0x7f393c0b3960 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 -- 172.21.15.104:0/1563637496 >> 172.21.15.104:0/1563637496 conn(0x7f393c0d29c0 msgr2=0x7f393c0d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 -- 172.21.15.104:0/1563637496 shutdown_connections 2024-09-17T03:00:18.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.527+0000 7f39426de640 1 -- 172.21.15.104:0/1563637496 wait complete. 2024-09-17T03:00:18.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.529+0000 7f39426de640 1 Processor -- start 2024-09-17T03:00:18.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.529+0000 7f39426de640 1 -- start start 2024-09-17T03:00:18.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.530+0000 7f39426de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f393c0b2840 0x7f393c0cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:18.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.530+0000 7f39426de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f393c0b3ea0 0x7f393c1e1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:18.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.530+0000 7f39426de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 0x7f393c1d3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:18.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.530+0000 7f39426de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f393c0b3520 con 0x7f393c0b81a0 2024-09-17T03:00:18.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.530+0000 7f39426de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f393c0b33a0 con 0x7f393c0b2840 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.530+0000 7f39426de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f393c0b61f0 con 0x7f393c0b3ea0 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.530+0000 7f3940c7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 0x7f393c1d3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3940c7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 0x7f393c1d3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37504/0 (socket says 172.21.15.104:37504) 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3940c7b640 1 -- 172.21.15.104:0/822143655 learned_addr learned my addr 172.21.15.104:0/822143655 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f393bfff640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f393c0b2840 0x7f393c0cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f393b7fe640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f393c0b3ea0 0x7f393c1e1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3940c7b640 1 -- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f393c0b3ea0 msgr2=0x7f393c1e1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3940c7b640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f393c0b3ea0 0x7f393c1e1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3940c7b640 1 -- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f393c0b2840 msgr2=0x7f393c0cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3940c7b640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f393c0b2840 0x7f393c0cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:18.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3940c7b640 1 -- 172.21.15.104:0/822143655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393c1f8dd0 con 0x7f393c0b81a0 2024-09-17T03:00:18.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f393b7fe640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f393c0b3ea0 0x7f393c1e1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:18.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3940c7b640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 0x7f393c1d3720 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f393400cab0 tx=0x7f393400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:18.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3938ff9640 1 -- 172.21.15.104:0/822143655 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934007df0 con 0x7f393c0b81a0 2024-09-17T03:00:18.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3938ff9640 1 -- 172.21.15.104:0/822143655 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f393400f560 con 0x7f393c0b81a0 2024-09-17T03:00:18.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393c1f8530 con 0x7f393c0b81a0 2024-09-17T03:00:18.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f3938ff9640 1 -- 172.21.15.104:0/822143655 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393400f9b0 con 0x7f393c0b81a0 2024-09-17T03:00:18.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.531+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393c1f8af0 con 0x7f393c0b81a0 2024-09-17T03:00:18.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.532+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f393c1f82a0 con 0x7f393c0b81a0 2024-09-17T03:00:18.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.533+0000 7f3938ff9640 1 -- 172.21.15.104:0/822143655 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f393400fb50 con 0x7f393c0b81a0 2024-09-17T03:00:18.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.533+0000 7f3938ff9640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3928078bc0 0x7f392807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:18.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.533+0000 7f3938ff9640 1 -- 172.21.15.104:0/822143655 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7f393409b460 con 0x7f393c0b81a0 2024-09-17T03:00:18.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.534+0000 7f393bfff640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3928078bc0 0x7f392807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:18.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.534+0000 7f393bfff640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3928078bc0 0x7f392807b0d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f392c033000 tx=0x7f392c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:18.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.538+0000 7f3938ff9640 1 -- 172.21.15.104:0/822143655 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3934014070 con 0x7f393c0b81a0 2024-09-17T03:00:18.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:18.711+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f393c0cf5e0 con 0x7f393c0b81a0 2024-09-17T03:00:19.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.690+0000 7f3938ff9640 1 -- 172.21.15.104:0/822143655 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) ==== 138+0+0 (secure 0 0 0) 0x7f393c0cf5e0 con 0x7f393c0b81a0 2024-09-17T03:00:19.690 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T03:00:19.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3928078bc0 msgr2=0x7f392807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:19.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3928078bc0 0x7f392807b0d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f392c033000 tx=0x7f392c004730 comp rx=0 tx=0).stop 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 msgr2=0x7f393c1d3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 0x7f393c1d3720 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f393400cab0 tx=0x7f393400cf70 comp rx=0 tx=0).stop 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 shutdown_connections 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3928078bc0 0x7f392807b0d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f393c0b81a0 0x7f393c1d3720 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f393c0b3ea0 0x7f393c1e1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 --2- 172.21.15.104:0/822143655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f393c0b2840 0x7f393c0cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 >> 172.21.15.104:0/822143655 conn(0x7f393c0d29c0 msgr2=0x7f393c1e2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 shutdown_connections 2024-09-17T03:00:19.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.694+0000 7f39426de640 1 -- 172.21.15.104:0/822143655 wait complete. 2024-09-17T03:00:19.710 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:00:19.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.837+0000 7fac84669640 1 -- 172.21.15.104:0/2245671455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c161ac0 msgr2=0x7fac7c0b67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:19.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.837+0000 7fac84669640 1 --2- 172.21.15.104:0/2245671455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c161ac0 0x7fac7c0b67e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fac7c06fe80 tx=0x7fac7402aac0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.837+0000 7fac84669640 1 -- 172.21.15.104:0/2245671455 shutdown_connections 2024-09-17T03:00:19.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.837+0000 7fac84669640 1 --2- 172.21.15.104:0/2245671455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c161ac0 0x7fac7c0b67e0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.837+0000 7fac84669640 1 --2- 172.21.15.104:0/2245671455 >> v2:172.21.15.192:3300/0 conn(0x7fac7c161170 0x7fac7c161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.837+0000 7fac84669640 1 -- 172.21.15.104:0/2245671455 >> 172.21.15.104:0/2245671455 conn(0x7fac7c0b4400 msgr2=0x7fac7c0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:19.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.838+0000 7fac84669640 1 -- 172.21.15.104:0/2245671455 shutdown_connections 2024-09-17T03:00:19.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.838+0000 7fac84669640 1 -- 172.21.15.104:0/2245671455 wait complete. 2024-09-17T03:00:19.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.839+0000 7fac84669640 1 Processor -- start 2024-09-17T03:00:19.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.839+0000 7fac84669640 1 -- start start 2024-09-17T03:00:19.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac84669640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c0b7c00 0x7fac7c0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac84669640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac7c161170 0x7fac7c0a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac84669640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac7c161ac0 0x7fac7c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac84669640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c0b52b0 con 0x7fac7c0b7c00 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac84669640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c0b5130 con 0x7fac7c161170 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac84669640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fac7c0b6d20 con 0x7fac7c161ac0 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c0b7c00 0x7fac7c0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c0b7c00 0x7fac7c0cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37536/0 (socket says 172.21.15.104:37536) 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 -- 172.21.15.104:0/2169445555 learned_addr learned my addr 172.21.15.104:0/2169445555 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac81c04640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac7c161170 0x7fac7c0a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82c06640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac7c161ac0 0x7fac7c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:19.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 -- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac7c161ac0 msgr2=0x7fac7c15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac7c161ac0 0x7fac7c15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 -- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac7c161170 msgr2=0x7fac7c0a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac7c161170 0x7fac7c0a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 -- 172.21.15.104:0/2169445555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c06ce80 con 0x7fac7c0b7c00 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac81c04640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac7c161170 0x7fac7c0a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac82405640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c0b7c00 0x7fac7c0cac20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fac7800c3c0 tx=0x7fac7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.841+0000 7fac72ffd640 1 -- 172.21.15.104:0/2169445555 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78017070 con 0x7fac7c0b7c00 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.842+0000 7fac72ffd640 1 -- 172.21.15.104:0/2169445555 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac780053c0 con 0x7fac7c0b7c00 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.842+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7c06d160 con 0x7fac7c0b7c00 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.842+0000 7fac72ffd640 1 -- 172.21.15.104:0/2169445555 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac780038a0 con 0x7fac7c0b7c00 2024-09-17T03:00:19.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.842+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7c06d720 con 0x7fac7c0b7c00 2024-09-17T03:00:19.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.843+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7c071ca0 con 0x7fac7c0b7c00 2024-09-17T03:00:19.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.843+0000 7fac72ffd640 1 -- 172.21.15.104:0/2169445555 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac7801a070 con 0x7fac7c0b7c00 2024-09-17T03:00:19.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.844+0000 7fac72ffd640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fac60078b90 0x7fac6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:19.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.844+0000 7fac72ffd640 1 -- 172.21.15.104:0/2169445555 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5227+0+0 (secure 0 0 0) 0x7fac78099f60 con 0x7fac7c0b7c00 2024-09-17T03:00:19.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.844+0000 7fac81c04640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fac60078b90 0x7fac6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:19.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.845+0000 7fac81c04640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fac60078b90 0x7fac6007b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fac6c005fd0 tx=0x7fac6c005e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:19.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:19.849+0000 7fac72ffd640 1 -- 172.21.15.104:0/2169445555 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fac7c071ca0 con 0x7fac7c0b7c00 2024-09-17T03:00:20.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.022+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fac7c161580 con 0x7fac7c0b7c00 2024-09-17T03:00:20.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.695+0000 7fac72ffd640 1 -- 172.21.15.104:0/2169445555 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) ==== 170+0+0 (secure 0 0 0) 0x7fac78062580 con 0x7fac7c0b7c00 2024-09-17T03:00:20.695 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fac60078b90 msgr2=0x7fac6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fac60078b90 0x7fac6007b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fac6c005fd0 tx=0x7fac6c005e40 comp rx=0 tx=0).stop 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c0b7c00 msgr2=0x7fac7c0cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c0b7c00 0x7fac7c0cac20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fac7800c3c0 tx=0x7fac7800c880 comp rx=0 tx=0).stop 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 shutdown_connections 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fac60078b90 0x7fac6007b0a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac7c161170 0x7fac7c0a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac7c161ac0 0x7fac7c15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 --2- 172.21.15.104:0/2169445555 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fac7c0b7c00 0x7fac7c0cac20 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 >> 172.21.15.104:0/2169445555 conn(0x7fac7c0b4400 msgr2=0x7fac7c071330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:20.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 shutdown_connections 2024-09-17T03:00:20.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.698+0000 7fac84669640 1 -- 172.21.15.104:0/2169445555 wait complete. 2024-09-17T03:00:20.719 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:00:20.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 -- 172.21.15.104:0/1145001050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9941607e0 msgr2=0x7fb994160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:20.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 --2- 172.21.15.104:0/1145001050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9941607e0 0x7fb994160bf0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb9940b6c40 tx=0x7fb98c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:00:20.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 -- 172.21.15.104:0/1145001050 shutdown_connections 2024-09-17T03:00:20.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 --2- 172.21.15.104:0/1145001050 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9941607e0 0x7fb994160bf0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 --2- 172.21.15.104:0/1145001050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb994068d00 0x7fb994069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 --2- 172.21.15.104:0/1145001050 >> v2:172.21.15.192:3300/0 conn(0x7fb994145e30 0x7fb994073f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 -- 172.21.15.104:0/1145001050 >> 172.21.15.104:0/1145001050 conn(0x7fb9940b35d0 msgr2=0x7fb9940b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:20.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 -- 172.21.15.104:0/1145001050 shutdown_connections 2024-09-17T03:00:20.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.835+0000 7fb99a372640 1 -- 172.21.15.104:0/1145001050 wait complete. 2024-09-17T03:00:20.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.837+0000 7fb99a372640 1 Processor -- start 2024-09-17T03:00:20.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.837+0000 7fb99a372640 1 -- start start 2024-09-17T03:00:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99a372640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb994068d00 0x7fb994140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99a372640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb994145e30 0x7fb9941f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99a372640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9941607e0 0x7fb9941f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99a372640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb9941467a0 con 0x7fb994068d00 2024-09-17T03:00:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99a372640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb994146620 con 0x7fb9941607e0 2024-09-17T03:00:20.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99a372640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb994161130 con 0x7fb994145e30 2024-09-17T03:00:20.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb994068d00 0x7fb994140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:20.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb994068d00 0x7fb994140e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37558/0 (socket says 172.21.15.104:37558) 2024-09-17T03:00:20.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 -- 172.21.15.104:0/3314202997 learned_addr learned my addr 172.21.15.104:0/3314202997 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:20.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb9937fe640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb994145e30 0x7fb9941f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:20.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99890f640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9941607e0 0x7fb9941f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 -- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb994145e30 msgr2=0x7fb9941f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb994145e30 0x7fb9941f7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 -- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9941607e0 msgr2=0x7fb9941f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9941607e0 0x7fb9941f4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 -- 172.21.15.104:0/3314202997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9941f7d70 con 0x7fb994068d00 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb993fff640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb994068d00 0x7fb994140e00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb98400d750 tx=0x7fb98400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb990ff9640 1 -- 172.21.15.104:0/3314202997 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984017070 con 0x7fb994068d00 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb990ff9640 1 -- 172.21.15.104:0/3314202997 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb984004310 con 0x7fb994068d00 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9941f81f0 con 0x7fb994068d00 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb990ff9640 1 -- 172.21.15.104:0/3314202997 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98400de60 con 0x7fb994068d00 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.839+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941f43e0 con 0x7fb994068d00 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.841+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9940b11b0 con 0x7fb994068d00 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.841+0000 7fb990ff9640 1 -- 172.21.15.104:0/3314202997 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb984009c30 con 0x7fb994068d00 2024-09-17T03:00:20.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.842+0000 7fb990ff9640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb980078b90 0x7fb98007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:20.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.842+0000 7fb990ff9640 1 -- 172.21.15.104:0/3314202997 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5609+0+0 (secure 0 0 0) 0x7fb98409b040 con 0x7fb994068d00 2024-09-17T03:00:20.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.842+0000 7fb9937fe640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb980078b90 0x7fb98007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:20.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.843+0000 7fb9937fe640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb980078b90 0x7fb98007b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb9940b3fa0 tx=0x7fb988005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:20.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:20.846+0000 7fb990ff9640 1 -- 172.21.15.104:0/3314202997 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9940b11b0 con 0x7fb994068d00 2024-09-17T03:00:21.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.056+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb99406adb0 con 0x7fb994068d00 2024-09-17T03:00:21.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.697+0000 7fb990ff9640 1 -- 172.21.15.104:0/3314202997 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v46) ==== 174+0+0 (secure 0 0 0) 0x7fb99406adb0 con 0x7fb994068d00 2024-09-17T03:00:21.697 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 14 and data pool 15 2024-09-17T03:00:21.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb980078b90 msgr2=0x7fb98007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb980078b90 0x7fb98007b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb9940b3fa0 tx=0x7fb988005c90 comp rx=0 tx=0).stop 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb994068d00 msgr2=0x7fb994140e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb994068d00 0x7fb994140e00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb98400d750 tx=0x7fb98400dc10 comp rx=0 tx=0).stop 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 shutdown_connections 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb980078b90 0x7fb98007b0a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9941607e0 0x7fb9941f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb994145e30 0x7fb9941f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 --2- 172.21.15.104:0/3314202997 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb994068d00 0x7fb994140e00 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 >> 172.21.15.104:0/3314202997 conn(0x7fb9940b35d0 msgr2=0x7fb9941ea6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 shutdown_connections 2024-09-17T03:00:21.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.700+0000 7fb99a372640 1 -- 172.21.15.104:0/3314202997 wait complete. 2024-09-17T03:00:21.725 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:21.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.838+0000 7f5697df1640 1 -- 172.21.15.104:0/3171333229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f567c005250 msgr2=0x7f567c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:21.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.838+0000 7f5697df1640 1 --2- 172.21.15.104:0/3171333229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f567c005250 0x7f567c00b9c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5688009b50 tx=0x7f567c005830 comp rx=0 tx=0).stop 2024-09-17T03:00:21.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.839+0000 7f5697df1640 1 -- 172.21.15.104:0/3171333229 shutdown_connections 2024-09-17T03:00:21.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.839+0000 7f5697df1640 1 --2- 172.21.15.104:0/3171333229 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f567c005250 0x7f567c00b9c0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:21.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.839+0000 7f5697df1640 1 -- 172.21.15.104:0/3171333229 >> 172.21.15.104:0/3171333229 conn(0x7f569006d200 msgr2=0x7f569006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:21.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.839+0000 7f5697df1640 1 -- 172.21.15.104:0/3171333229 shutdown_connections 2024-09-17T03:00:21.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.839+0000 7f5697df1640 1 -- 172.21.15.104:0/3171333229 wait complete. 2024-09-17T03:00:21.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.840+0000 7f5697df1640 1 Processor -- start 2024-09-17T03:00:21.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.840+0000 7f5697df1640 1 -- start start 2024-09-17T03:00:21.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5697df1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f567c005250 0x7f56900b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:21.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5697df1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56901f4550 0x7f569015e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:21.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5697df1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f569015f1f0 0x7f569015f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:21.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5697df1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5690073900 con 0x7f569015f1f0 2024-09-17T03:00:21.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5697df1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f569006f9d0 con 0x7f567c005250 2024-09-17T03:00:21.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5697df1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5690073a80 con 0x7f56901f4550 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f569015f1f0 0x7f569015f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f569015f1f0 0x7f569015f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37564/0 (socket says 172.21.15.104:37564) 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 -- 172.21.15.104:0/3715805716 learned_addr learned my addr 172.21.15.104:0/3715805716 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 -- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56901f4550 msgr2=0x7f569015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56901f4550 0x7f569015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 -- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f567c005250 msgr2=0x7f56900b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5695b8d640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f567c005250 0x7f56900b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f567c005250 0x7f56900b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 -- 172.21.15.104:0/3715805716 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569015fb40 con 0x7f569015f1f0 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5695b8d640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f567c005250 0x7f56900b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f569638e640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f569015f1f0 0x7f569015f600 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f568802b4f0 tx=0x7f5688009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f56867fc640 1 -- 172.21.15.104:0/3715805716 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688041070 con 0x7f569015f1f0 2024-09-17T03:00:21.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f56867fc640 1 -- 172.21.15.104:0/3715805716 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56880035f0 con 0x7f569015f1f0 2024-09-17T03:00:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56900b1f90 con 0x7f569015f1f0 2024-09-17T03:00:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.842+0000 7f56867fc640 1 -- 172.21.15.104:0/3715805716 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688003a60 con 0x7f569015f1f0 2024-09-17T03:00:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.843+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56900b2550 con 0x7f569015f1f0 2024-09-17T03:00:21.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.843+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569015e0e0 con 0x7f569015f1f0 2024-09-17T03:00:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.844+0000 7f56867fc640 1 -- 172.21.15.104:0/3715805716 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5688044070 con 0x7f569015f1f0 2024-09-17T03:00:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.845+0000 7f56867fc640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5674078b90 0x7f567407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.845+0000 7f56867fc640 1 -- 172.21.15.104:0/3715805716 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7f56880bb070 con 0x7f569015f1f0 2024-09-17T03:00:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.845+0000 7f5695b8d640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5674078b90 0x7f567407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:21.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.846+0000 7f5695b8d640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5674078b90 0x7f567407b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f568c004fd0 tx=0x7f568c006e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:21.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:21.849+0000 7f56867fc640 1 -- 172.21.15.104:0/3715805716 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f569015fb40 con 0x7f569015f1f0 2024-09-17T03:00:22.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.022+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56900b0500 con 0x7f569015f1f0 2024-09-17T03:00:22.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.023+0000 7f56867fc640 1 -- 172.21.15.104:0/3715805716 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16741 (secure 0 0 0) 0x7f5688083430 con 0x7f569015f1f0 2024-09-17T03:00:22.022 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:22.023 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":122,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:21.058699+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:18.716486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:20.027435+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:22.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5674078b90 msgr2=0x7f567407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5674078b90 0x7f567407b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f568c004fd0 tx=0x7f568c006e30 comp rx=0 tx=0).stop 2024-09-17T03:00:22.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f569015f1f0 msgr2=0x7f569015f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f569015f1f0 0x7f569015f600 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f568802b4f0 tx=0x7f5688009720 comp rx=0 tx=0).stop 2024-09-17T03:00:22.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 shutdown_connections 2024-09-17T03:00:22.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5674078b90 0x7f567407b0a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f569015f1f0 0x7f569015f600 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56901f4550 0x7f569015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 --2- 172.21.15.104:0/3715805716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f567c005250 0x7f56900b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 >> 172.21.15.104:0/3715805716 conn(0x7f569006d200 msgr2=0x7f56900b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:22.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 shutdown_connections 2024-09-17T03:00:22.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.025+0000 7f5697df1640 1 -- 172.21.15.104:0/3715805716 wait complete. 2024-09-17T03:00:22.036 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:22.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.149+0000 7fde63b50640 1 -- 172.21.15.104:0/3032167766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 msgr2=0x7fde48005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.149+0000 7fde63b50640 1 --2- 172.21.15.104:0/3032167766 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 0x7fde48005220 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fde54001ed0 tx=0x7fde48005830 comp rx=0 tx=0).stop 2024-09-17T03:00:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.149+0000 7fde620ed640 1 -- 172.21.15.104:0/3032167766 reap_dead start 2024-09-17T03:00:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.150+0000 7fde63b50640 1 -- 172.21.15.104:0/3032167766 shutdown_connections 2024-09-17T03:00:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.150+0000 7fde63b50640 1 -- 172.21.15.104:0/3032167766 >> 172.21.15.104:0/3032167766 conn(0x7fde5c0b2450 msgr2=0x7fde5c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.150+0000 7fde63b50640 1 -- 172.21.15.104:0/3032167766 shutdown_connections 2024-09-17T03:00:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.150+0000 7fde63b50640 1 -- 172.21.15.104:0/3032167766 wait complete. 2024-09-17T03:00:22.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.151+0000 7fde63b50640 1 Processor -- start 2024-09-17T03:00:22.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.151+0000 7fde63b50640 1 -- start start 2024-09-17T03:00:22.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde63b50640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 0x7fde5c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde63b50640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c155c60 0x7fde5c15de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde63b50640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde5c15e350 0x7fde5c15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde63b50640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c072f10 con 0x7fde48004d90 2024-09-17T03:00:22.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde63b50640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c072d90 con 0x7fde5c155c60 2024-09-17T03:00:22.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde63b50640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fde5c073090 con 0x7fde5c15e350 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 0x7fde5c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 0x7fde5c154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37574/0 (socket says 172.21.15.104:37574) 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 -- 172.21.15.104:0/1097381652 learned_addr learned my addr 172.21.15.104:0/1097381652 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 -- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde5c15e350 msgr2=0x7fde5c15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde5c15e350 0x7fde5c15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 -- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c155c60 msgr2=0x7fde5c15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c155c60 0x7fde5c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 -- 172.21.15.104:0/1097381652 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c0af3f0 con 0x7fde48004d90 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde618ec640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 0x7fde5c154ef0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fde58006600 tx=0x7fde580039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde527fc640 1 -- 172.21.15.104:0/1097381652 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58015070 con 0x7fde48004d90 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde527fc640 1 -- 172.21.15.104:0/1097381652 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde58011840 con 0x7fde48004d90 2024-09-17T03:00:22.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde527fc640 1 -- 172.21.15.104:0/1097381652 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58011c90 con 0x7fde48004d90 2024-09-17T03:00:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5c15eca0 con 0x7fde48004d90 2024-09-17T03:00:22.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.153+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5c0af660 con 0x7fde48004d90 2024-09-17T03:00:22.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.154+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5c15b070 con 0x7fde48004d90 2024-09-17T03:00:22.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.155+0000 7fde527fc640 1 -- 172.21.15.104:0/1097381652 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde58018070 con 0x7fde48004d90 2024-09-17T03:00:22.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.156+0000 7fde527fc640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde40078b90 0x7fde4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.156+0000 7fde527fc640 1 -- 172.21.15.104:0/1097381652 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7fde5809ba10 con 0x7fde48004d90 2024-09-17T03:00:22.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.156+0000 7fde610eb640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde40078b90 0x7fde4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.156+0000 7fde610eb640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde40078b90 0x7fde4007b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fde5c1563e0 tx=0x7fde4c009660 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:22.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.160+0000 7fde527fc640 1 -- 172.21.15.104:0/1097381652 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde5c15b070 con 0x7fde48004d90 2024-09-17T03:00:22.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.334+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde5c0ce690 con 0x7fde48004d90 2024-09-17T03:00:22.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.336+0000 7fde527fc640 1 -- 172.21.15.104:0/1097381652 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16741 (secure 0 0 0) 0x7fde58063fa0 con 0x7fde48004d90 2024-09-17T03:00:22.335 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:22.336 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":122,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:21.058699+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:18.716486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:20.027435+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde40078b90 msgr2=0x7fde4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde40078b90 0x7fde4007b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fde5c1563e0 tx=0x7fde4c009660 comp rx=0 tx=0).stop 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 msgr2=0x7fde5c154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 0x7fde5c154ef0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fde58006600 tx=0x7fde580039c0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 shutdown_connections 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fde40078b90 0x7fde4007b0a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde5c155c60 0x7fde5c15de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde5c15e350 0x7fde5c15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 --2- 172.21.15.104:0/1097381652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fde48004d90 0x7fde5c154ef0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 >> 172.21.15.104:0/1097381652 conn(0x7fde5c0b2450 msgr2=0x7fde5c0b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 shutdown_connections 2024-09-17T03:00:22.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.338+0000 7fde63b50640 1 -- 172.21.15.104:0/1097381652 wait complete. 2024-09-17T03:00:22.349 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:00:22.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.466+0000 7f76dc8f9640 1 -- 172.21.15.104:0/3958941316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 msgr2=0x7f76c0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.466+0000 7f76dc8f9640 1 --2- 172.21.15.104:0/3958941316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 0x7f76c0004c10 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0016c0 tx=0x7f76c0005830 comp rx=0 tx=0).stop 2024-09-17T03:00:22.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.466+0000 7f76dc8f9640 1 -- 172.21.15.104:0/3958941316 shutdown_connections 2024-09-17T03:00:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.466+0000 7f76dc8f9640 1 --2- 172.21.15.104:0/3958941316 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 0x7f76c0004c10 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.466+0000 7f76dc8f9640 1 -- 172.21.15.104:0/3958941316 >> 172.21.15.104:0/3958941316 conn(0x7f76d806eb90 msgr2=0x7f76d806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.466+0000 7f76dc8f9640 1 -- 172.21.15.104:0/3958941316 shutdown_connections 2024-09-17T03:00:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.466+0000 7f76dc8f9640 1 -- 172.21.15.104:0/3958941316 wait complete. 2024-09-17T03:00:22.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.468+0000 7f76dc8f9640 1 Processor -- start 2024-09-17T03:00:22.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.468+0000 7f76dc8f9640 1 -- start start 2024-09-17T03:00:22.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76dc8f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 0x7f76d81f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76dc8f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76d8143720 0x7f76d81588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76dc8f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76d8143b30 0x7f76d8158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76dc8f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f76d8156300 con 0x7f76c0004800 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76dc8f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76d8156180 con 0x7f76d8143b30 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76dc8f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f76d8156480 con 0x7f76d8143720 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 0x7f76d81f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 0x7f76d81f57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37592/0 (socket says 172.21.15.104:37592) 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 -- 172.21.15.104:0/2300718702 learned_addr learned my addr 172.21.15.104:0/2300718702 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 -- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76d8143720 msgr2=0x7f76d81588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d6d9d640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76d8143b30 0x7f76d8158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d5d9b640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76d8143720 0x7f76d81588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76d8143720 0x7f76d81588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 -- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76d8143b30 msgr2=0x7f76d8158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76d8143b30 0x7f76d8158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 -- 172.21.15.104:0/2300718702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d81f6210 con 0x7f76c0004800 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d6d9d640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76d8143b30 0x7f76d8158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d5d9b640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76d8143720 0x7f76d81588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76d659c640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 0x7f76d81f57e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f76c8001ba0 tx=0x7f76c80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76c6ffd640 1 -- 172.21.15.104:0/2300718702 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8015070 con 0x7f76c0004800 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76c6ffd640 1 -- 172.21.15.104:0/2300718702 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76c8011900 con 0x7f76c0004800 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76c6ffd640 1 -- 172.21.15.104:0/2300718702 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011d50 con 0x7f76c0004800 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d81f64f0 con 0x7f76c0004800 2024-09-17T03:00:22.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.470+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d81f5d20 con 0x7f76c0004800 2024-09-17T03:00:22.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.472+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d81f6730 con 0x7f76c0004800 2024-09-17T03:00:22.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.472+0000 7f76c6ffd640 1 -- 172.21.15.104:0/2300718702 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f76c8018070 con 0x7f76c0004800 2024-09-17T03:00:22.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.473+0000 7f76c6ffd640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b8078b90 0x7f76b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.473+0000 7f76c6ffd640 1 -- 172.21.15.104:0/2300718702 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7f76c809ba60 con 0x7f76c0004800 2024-09-17T03:00:22.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.473+0000 7f76d5d9b640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b8078b90 0x7f76b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.473+0000 7f76d5d9b640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b8078b90 0x7f76b807b0a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f76cc032000 tx=0x7f76cc001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:22.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.477+0000 7f76c6ffd640 1 -- 172.21.15.104:0/2300718702 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f76d81f6730 con 0x7f76c0004800 2024-09-17T03:00:22.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.690+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f76d80cd8e0 con 0x7f76c0004800 2024-09-17T03:00:22.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.723+0000 7f76c6ffd640 1 -- 172.21.15.104:0/2300718702 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) ==== 118+0+0 (secure 0 0 0) 0x7f76c8063f40 con 0x7f76c0004800 2024-09-17T03:00:22.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.725+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b8078b90 msgr2=0x7f76b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.725+0000 7f76dc8f9640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b8078b90 0x7f76b807b0a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f76cc032000 tx=0x7f76cc001190 comp rx=0 tx=0).stop 2024-09-17T03:00:22.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 msgr2=0x7f76d81f57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 0x7f76d81f57e0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f76c8001ba0 tx=0x7f76c80039c0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 shutdown_connections 2024-09-17T03:00:22.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b8078b90 0x7f76b807b0a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76d8143b30 0x7f76d8158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76d8143720 0x7f76d81588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 --2- 172.21.15.104:0/2300718702 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c0004800 0x7f76d81f57e0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 >> 172.21.15.104:0/2300718702 conn(0x7f76d806eb90 msgr2=0x7f76d806fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:22.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 shutdown_connections 2024-09-17T03:00:22.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.726+0000 7f76dc8f9640 1 -- 172.21.15.104:0/2300718702 wait complete. 2024-09-17T03:00:22.736 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:00:22.737 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:00:22.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.852+0000 7f08f2b94640 1 -- 172.21.15.104:0/977054352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 msgr2=0x7f08ec0b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.852+0000 7f08f2b94640 1 --2- 172.21.15.104:0/977054352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 0x7f08ec0b7c80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005fd0 tx=0x7f08dc02a460 comp rx=0 tx=0).stop 2024-09-17T03:00:22.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.852+0000 7f08f2b94640 1 -- 172.21.15.104:0/977054352 shutdown_connections 2024-09-17T03:00:22.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.852+0000 7f08f2b94640 1 --2- 172.21.15.104:0/977054352 >> v2:172.21.15.192:3300/0 conn(0x7f08ec0d13e0 0x7f08ec1615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.852+0000 7f08f2b94640 1 --2- 172.21.15.104:0/977054352 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 0x7f08ec0b7c80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.852+0000 7f08f2b94640 1 -- 172.21.15.104:0/977054352 >> 172.21.15.104:0/977054352 conn(0x7f08ec0d2970 msgr2=0x7f08ec0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:22.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.852+0000 7f08f2b94640 1 -- 172.21.15.104:0/977054352 shutdown_connections 2024-09-17T03:00:22.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.852+0000 7f08f2b94640 1 -- 172.21.15.104:0/977054352 wait complete. 2024-09-17T03:00:22.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.854+0000 7f08f2b94640 1 Processor -- start 2024-09-17T03:00:22.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.854+0000 7f08f2b94640 1 -- start start 2024-09-17T03:00:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.855+0000 7f08f2b94640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08ec0d0fd0 0x7f08ec0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.855+0000 7f08f2b94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec0d13e0 0x7f08ec0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.855+0000 7f08f2b94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 0x7f08ec0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.855+0000 7f08f2b94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec0b6bd0 con 0x7f08ec0d3490 2024-09-17T03:00:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.855+0000 7f08f2b94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec0b6a50 con 0x7f08ec0d13e0 2024-09-17T03:00:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.855+0000 7f08f2b94640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f08ec0b6d50 con 0x7f08ec0d0fd0 2024-09-17T03:00:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.855+0000 7f08f1131640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 0x7f08ec0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f1131640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 0x7f08ec0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37612/0 (socket says 172.21.15.104:37612) 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f1131640 1 -- 172.21.15.104:0/1909040360 learned_addr learned my addr 172.21.15.104:0/1909040360 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08ebfff640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec0d13e0 0x7f08ec0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f0930640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08ec0d0fd0 0x7f08ec0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f1131640 1 -- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08ec0d0fd0 msgr2=0x7f08ec0c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f1131640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08ec0d0fd0 0x7f08ec0c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f1131640 1 -- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec0d13e0 msgr2=0x7f08ec0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f1131640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec0d13e0 0x7f08ec0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f1131640 1 -- 172.21.15.104:0/1909040360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ec0b1740 con 0x7f08ec0d3490 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08ebfff640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec0d13e0 0x7f08ec0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f1131640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 0x7f08ec0cc590 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b970 tx=0x7f08e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08e97fa640 1 -- 172.21.15.104:0/1909040360 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4019070 con 0x7f08ec0d3490 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08e97fa640 1 -- 172.21.15.104:0/1909040360 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08e400cc50 con 0x7f08ec0d3490 2024-09-17T03:00:22.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08e97fa640 1 -- 172.21.15.104:0/1909040360 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e40146a0 con 0x7f08ec0d3490 2024-09-17T03:00:22.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ec0b1a20 con 0x7f08ec0d3490 2024-09-17T03:00:22.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.856+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ec1f3e00 con 0x7f08ec0d3490 2024-09-17T03:00:22.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.857+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08ec0b7c80 con 0x7f08ec0d3490 2024-09-17T03:00:22.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.858+0000 7f08e97fa640 1 -- 172.21.15.104:0/1909040360 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f08e401c070 con 0x7f08ec0d3490 2024-09-17T03:00:22.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.858+0000 7f08e97fa640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08cc078b90 0x7f08cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:22.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.859+0000 7f08e97fa640 1 -- 172.21.15.104:0/1909040360 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f08e409ab00 con 0x7f08ec0d3490 2024-09-17T03:00:22.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.859+0000 7f08f0930640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08cc078b90 0x7f08cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:22.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.859+0000 7f08f0930640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08cc078b90 0x7f08cc07b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f08dc033000 tx=0x7f08dc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:22.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:22.863+0000 7f08e97fa640 1 -- 172.21.15.104:0/1909040360 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f08e4062f40 con 0x7f08ec0d3490 2024-09-17T03:00:23.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.071+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f08ec0d0900 con 0x7f08ec0d3490 2024-09-17T03:00:23.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.728+0000 7f08e97fa640 1 -- 172.21.15.104:0/1909040360 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f08e4062840 con 0x7f08ec0d3490 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08cc078b90 msgr2=0x7f08cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08cc078b90 0x7f08cc07b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f08dc033000 tx=0x7f08dc004730 comp rx=0 tx=0).stop 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 msgr2=0x7f08ec0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 0x7f08ec0cc590 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b970 tx=0x7f08e400be30 comp rx=0 tx=0).stop 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 shutdown_connections 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f08cc078b90 0x7f08cc07b0a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec0d13e0 0x7f08ec0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f08ec0d3490 0x7f08ec0cc590 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 --2- 172.21.15.104:0/1909040360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08ec0d0fd0 0x7f08ec0c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:23.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 >> 172.21.15.104:0/1909040360 conn(0x7f08ec0d2970 msgr2=0x7f08ec0cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:23.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 shutdown_connections 2024-09-17T03:00:23.732 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.731+0000 7f08f2b94640 1 -- 172.21.15.104:0/1909040360 wait complete. 2024-09-17T03:00:23.743 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:00:23.743 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:23.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.859+0000 7f3754d20640 1 -- 172.21.15.104:0/49462255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 msgr2=0x7f3738003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:23.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.859+0000 7f3754d20640 1 --2- 172.21.15.104:0/49462255 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 0x7f3738003ea0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f374000c470 tx=0x7f3738005830 comp rx=0 tx=0).stop 2024-09-17T03:00:23.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.859+0000 7f374ed9d640 1 -- 172.21.15.104:0/49462255 reap_dead start 2024-09-17T03:00:23.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.859+0000 7f3754d20640 1 -- 172.21.15.104:0/49462255 shutdown_connections 2024-09-17T03:00:23.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.859+0000 7f3754d20640 1 -- 172.21.15.104:0/49462255 >> 172.21.15.104:0/49462255 conn(0x7f375006d200 msgr2=0x7f375006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:23.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.859+0000 7f3754d20640 1 -- 172.21.15.104:0/49462255 shutdown_connections 2024-09-17T03:00:23.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.859+0000 7f3754d20640 1 -- 172.21.15.104:0/49462255 wait complete. 2024-09-17T03:00:23.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.861+0000 7f3754d20640 1 Processor -- start 2024-09-17T03:00:23.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.861+0000 7f3754d20640 1 -- start start 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f3754d20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 0x7f375015da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f3754d20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37501e5930 0x7f3750140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f3754d20640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3750143d90 0x7f37500cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f3754d20640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f37500b60b0 con 0x7f3738003a30 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f3754d20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37500b5f30 con 0x7f37501e5930 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f3754d20640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f37500b6230 con 0x7f3750143d90 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 0x7f375015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 0x7f375015da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37638/0 (socket says 172.21.15.104:37638) 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374e59c640 1 -- 172.21.15.104:0/650470025 learned_addr learned my addr 172.21.15.104:0/650470025 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374dd9b640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37501e5930 0x7f3750140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374ed9d640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3750143d90 0x7f37500cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:23.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374e59c640 1 -- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3750143d90 msgr2=0x7f37500cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374e59c640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3750143d90 0x7f37500cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374e59c640 1 -- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37501e5930 msgr2=0x7f3750140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374e59c640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37501e5930 0x7f3750140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374e59c640 1 -- 172.21.15.104:0/650470025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3750141500 con 0x7f3738003a30 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.862+0000 7f374dd9b640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37501e5930 0x7f3750140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.863+0000 7f374e59c640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 0x7f375015da30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f374002b2d0 tx=0x7f37400013c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.863+0000 7f373effd640 1 -- 172.21.15.104:0/650470025 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740042070 con 0x7f3738003a30 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.863+0000 7f373effd640 1 -- 172.21.15.104:0/650470025 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f374002b620 con 0x7f3738003a30 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.863+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37501417e0 con 0x7f3738003a30 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.863+0000 7f373effd640 1 -- 172.21.15.104:0/650470025 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740039070 con 0x7f3738003a30 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.863+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3750141da0 con 0x7f3738003a30 2024-09-17T03:00:23.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.864+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37500b0910 con 0x7f3738003a30 2024-09-17T03:00:23.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.864+0000 7f373effd640 1 -- 172.21.15.104:0/650470025 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3740045070 con 0x7f3738003a30 2024-09-17T03:00:23.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.865+0000 7f373effd640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3730078b90 0x7f373007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:23.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.865+0000 7f373effd640 1 -- 172.21.15.104:0/650470025 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f37400ba770 con 0x7f3738003a30 2024-09-17T03:00:23.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.865+0000 7f374dd9b640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3730078b90 0x7f373007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:23.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.866+0000 7f374dd9b640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3730078b90 0x7f373007b0a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f37500d08b0 tx=0x7f374400b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:23.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:23.870+0000 7f373effd640 1 -- 172.21.15.104:0/650470025 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3750073e40 con 0x7f3738003a30 2024-09-17T03:00:24.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.077+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3750070810 con 0x7f3738003a30 2024-09-17T03:00:24.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.077+0000 7f373effd640 1 -- 172.21.15.104:0/650470025 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f3740082c90 con 0x7f3738003a30 2024-09-17T03:00:24.077 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:24.077 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:21.058657+0000","modified":"2024-09-17T03:00:23.073068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3958916187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3958916187},{"type":"v1","addr":"172.21.15.192:6837","nonce":3958916187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":7}]} 2024-09-17T03:00:24.077 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 48 2024-09-17T03:00:24.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.079+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3730078b90 msgr2=0x7f373007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.079+0000 7f3754d20640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3730078b90 0x7f373007b0a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f37500d08b0 tx=0x7f374400b260 comp rx=0 tx=0).stop 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.079+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 msgr2=0x7f375015da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.079+0000 7f3754d20640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 0x7f375015da30 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f374002b2d0 tx=0x7f37400013c0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.080+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 shutdown_connections 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.080+0000 7f3754d20640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3730078b90 0x7f373007b0a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.080+0000 7f3754d20640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37501e5930 0x7f3750140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.080+0000 7f3754d20640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3750143d90 0x7f37500cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.080+0000 7f3754d20640 1 --2- 172.21.15.104:0/650470025 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3738003a30 0x7f375015da30 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.080+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 >> 172.21.15.104:0/650470025 conn(0x7f375006d200 msgr2=0x7f37501557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.080+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 shutdown_connections 2024-09-17T03:00:24.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.080+0000 7f3754d20640 1 -- 172.21.15.104:0/650470025 wait complete. 2024-09-17T03:00:24.091 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:24.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.205+0000 7fc5458dc640 1 -- 172.21.15.104:0/2547777395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5400b2800 msgr2=0x7fc5400b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.205+0000 7fc5458dc640 1 --2- 172.21.15.104:0/2547777395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5400b2800 0x7fc5400b2c10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc538005fd0 tx=0x7fc53802a7c0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.205+0000 7fc5458dc640 1 -- 172.21.15.104:0/2547777395 shutdown_connections 2024-09-17T03:00:24.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.205+0000 7fc5458dc640 1 --2- 172.21.15.104:0/2547777395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5400b2800 0x7fc5400b2c10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.205+0000 7fc5458dc640 1 -- 172.21.15.104:0/2547777395 >> 172.21.15.104:0/2547777395 conn(0x7fc5400d2970 msgr2=0x7fc5400d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:24.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.206+0000 7fc5458dc640 1 -- 172.21.15.104:0/2547777395 shutdown_connections 2024-09-17T03:00:24.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.206+0000 7fc5458dc640 1 -- 172.21.15.104:0/2547777395 wait complete. 2024-09-17T03:00:24.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.207+0000 7fc5458dc640 1 Processor -- start 2024-09-17T03:00:24.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.207+0000 7fc5458dc640 1 -- start start 2024-09-17T03:00:24.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc5458dc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5400b2800 0x7fc540157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc5458dc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5400b7c80 0x7fc5400cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc5458dc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5400d3490 0x7fc5400ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc5458dc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc540168300 con 0x7fc5400d3490 2024-09-17T03:00:24.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc5458dc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc540168180 con 0x7fc5400b2800 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc5458dc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc540168480 con 0x7fc5400b7c80 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5400d3490 0x7fc5400ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5400d3490 0x7fc5400ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53034/0 (socket says 172.21.15.104:53034) 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 -- 172.21.15.104:0/2498342698 learned_addr learned my addr 172.21.15.104:0/2498342698 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 -- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5400b7c80 msgr2=0x7fc5400cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5400b7c80 0x7fc5400cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 -- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5400b2800 msgr2=0x7fc540157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5400b2800 0x7fc540157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 -- 172.21.15.104:0/2498342698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5401f7a50 con 0x7fc5400d3490 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53f7fe640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5400d3490 0x7fc5400ce520 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc538005fd0 tx=0x7fc538032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53cff9640 1 -- 172.21.15.104:0/2498342698 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538041020 con 0x7fc5400d3490 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc53cff9640 1 -- 172.21.15.104:0/2498342698 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc538004330 con 0x7fc5400d3490 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.209+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5401f7d30 con 0x7fc5400d3490 2024-09-17T03:00:24.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.210+0000 7fc53cff9640 1 -- 172.21.15.104:0/2498342698 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538036040 con 0x7fc5400d3490 2024-09-17T03:00:24.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.210+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5401f82f0 con 0x7fc5400d3490 2024-09-17T03:00:24.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.211+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5400b1df0 con 0x7fc5400d3490 2024-09-17T03:00:24.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.211+0000 7fc53cff9640 1 -- 172.21.15.104:0/2498342698 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc538044020 con 0x7fc5400d3490 2024-09-17T03:00:24.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.212+0000 7fc53cff9640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc520078b90 0x7fc52007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.212+0000 7fc53cff9640 1 -- 172.21.15.104:0/2498342698 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fc5380bbe50 con 0x7fc5400d3490 2024-09-17T03:00:24.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.212+0000 7fc53effd640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc520078b90 0x7fc52007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.213+0000 7fc53effd640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc520078b90 0x7fc52007b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc530001550 tx=0x7fc530007970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:24.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.216+0000 7fc53cff9640 1 -- 172.21.15.104:0/2498342698 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc5400b1df0 con 0x7fc5400d3490 2024-09-17T03:00:24.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.389+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5400d1fc0 con 0x7fc5400d3490 2024-09-17T03:00:24.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.390+0000 7fc53cff9640 1 -- 172.21.15.104:0/2498342698 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+16728 (secure 0 0 0) 0x7fc53804b030 con 0x7fc5400d3490 2024-09-17T03:00:24.390 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:24.390 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":123,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:22.698947+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:18.716486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:20.027435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc520078b90 msgr2=0x7fc52007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc520078b90 0x7fc52007b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc530001550 tx=0x7fc530007970 comp rx=0 tx=0).stop 2024-09-17T03:00:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5400d3490 msgr2=0x7fc5400ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5400d3490 0x7fc5400ce520 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc538005fd0 tx=0x7fc538032c90 comp rx=0 tx=0).stop 2024-09-17T03:00:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 shutdown_connections 2024-09-17T03:00:24.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc520078b90 0x7fc52007b0a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc5400d3490 0x7fc5400ce520 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5400b7c80 0x7fc5400cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 --2- 172.21.15.104:0/2498342698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5400b2800 0x7fc540157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.392+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 >> 172.21.15.104:0/2498342698 conn(0x7fc5400d2970 msgr2=0x7fc5400b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:24.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.393+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 shutdown_connections 2024-09-17T03:00:24.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.393+0000 7fc5458dc640 1 -- 172.21.15.104:0/2498342698 wait complete. 2024-09-17T03:00:24.404 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:00:24.404 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:24.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.517+0000 7f2c73783640 1 -- 172.21.15.104:0/1527636019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c152cd0 msgr2=0x7f2c6c0b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.517+0000 7f2c73783640 1 --2- 172.21.15.104:0/1527636019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c152cd0 0x7f2c6c0b5200 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c005fd0 tx=0x7f2c5c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.517+0000 7f2c73783640 1 -- 172.21.15.104:0/1527636019 shutdown_connections 2024-09-17T03:00:24.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.517+0000 7f2c73783640 1 --2- 172.21.15.104:0/1527636019 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c152cd0 0x7f2c6c0b5200 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.517+0000 7f2c73783640 1 -- 172.21.15.104:0/1527636019 >> 172.21.15.104:0/1527636019 conn(0x7f2c6c0b35d0 msgr2=0x7f2c6c0b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:24.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.517+0000 7f2c73783640 1 -- 172.21.15.104:0/1527636019 shutdown_connections 2024-09-17T03:00:24.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.517+0000 7f2c73783640 1 -- 172.21.15.104:0/1527636019 wait complete. 2024-09-17T03:00:24.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.519+0000 7f2c73783640 1 Processor -- start 2024-09-17T03:00:24.518 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.519+0000 7f2c73783640 1 -- start start 2024-09-17T03:00:24.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.520+0000 7f2c73783640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c152cd0 0x7f2c6c155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.520+0000 7f2c73783640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c15c060 0x7f2c6c1442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.520+0000 7f2c73783640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1531d0 0x7f2c6c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.520+0000 7f2c73783640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c06fee0 con 0x7f2c6c15c060 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.520+0000 7f2c73783640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c06fd60 con 0x7f2c6c152cd0 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.520+0000 7f2c73783640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6c15c470 con 0x7f2c6c1531d0 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.520+0000 7f2c70d1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c15c060 0x7f2c6c1442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c70d1e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c15c060 0x7f2c6c1442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53050/0 (socket says 172.21.15.104:53050) 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c70d1e640 1 -- 172.21.15.104:0/4187846233 learned_addr learned my addr 172.21.15.104:0/4187846233 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c7151f640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c152cd0 0x7f2c6c155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c71d20640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1531d0 0x7f2c6c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c70d1e640 1 -- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1531d0 msgr2=0x7f2c6c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c70d1e640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1531d0 0x7f2c6c1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c70d1e640 1 -- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c152cd0 msgr2=0x7f2c6c155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c70d1e640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c152cd0 0x7f2c6c155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c70d1e640 1 -- 172.21.15.104:0/4187846233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c15b310 con 0x7f2c6c15c060 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c70d1e640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c15c060 0x7f2c6c1442f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000c340 tx=0x7f2c6000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c69ffb640 1 -- 172.21.15.104:0/4187846233 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60011790 con 0x7f2c6c15c060 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c69ffb640 1 -- 172.21.15.104:0/4187846233 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c60017070 con 0x7f2c6c15c060 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c15b5f0 con 0x7f2c6c15c060 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c69ffb640 1 -- 172.21.15.104:0/4187846233 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60011cc0 con 0x7f2c6c15c060 2024-09-17T03:00:24.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.521+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c156a50 con 0x7f2c6c15c060 2024-09-17T03:00:24.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.523+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c0b5200 con 0x7f2c6c15c060 2024-09-17T03:00:24.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.523+0000 7f2c69ffb640 1 -- 172.21.15.104:0/4187846233 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c6001c460 con 0x7f2c6c15c060 2024-09-17T03:00:24.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.523+0000 7f2c69ffb640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.524+0000 7f2c69ffb640 1 -- 172.21.15.104:0/4187846233 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f2c6009aaa0 con 0x7f2c6c15c060 2024-09-17T03:00:24.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.524+0000 7f2c7151f640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.524+0000 7f2c7151f640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c034000 tx=0x7f2c5c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:24.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.528+0000 7f2c69ffb640 1 -- 172.21.15.104:0/4187846233 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c60062ee0 con 0x7f2c6c15c060 2024-09-17T03:00:24.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.698+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c6c15b060 con 0x7f2c58078b90 2024-09-17T03:00:24.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.703+0000 7f2c69ffb640 1 -- 172.21.15.104:0/4187846233 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242658 (secure 0 0 0) 0x7f2c6c15b060 con 0x7f2c58078b90 2024-09-17T03:00:24.705 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:24.706 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:24.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 msgr2=0x7f2c5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c034000 tx=0x7f2c5c004ab0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c15c060 msgr2=0x7f2c6c1442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c15c060 0x7f2c6c1442f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000c340 tx=0x7f2c6000c800 comp rx=0 tx=0).stop 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 shutdown_connections 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c58078b90 0x7f2c5807b0a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6c1531d0 0x7f2c6c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c6c15c060 0x7f2c6c1442f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 --2- 172.21.15.104:0/4187846233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6c152cd0 0x7f2c6c155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 >> 172.21.15.104:0/4187846233 conn(0x7f2c6c0b35d0 msgr2=0x7f2c6c14e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 shutdown_connections 2024-09-17T03:00:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.706+0000 7f2c73783640 1 -- 172.21.15.104:0/4187846233 wait complete. 2024-09-17T03:00:24.717 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-17T03:00:23.705900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556187,"statfs":{"total":1600000000,"available":1593536419,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.012951"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707902+0000","last_change":"2024-09-17T03:00:20.707902+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707902+0000","last_undegraded":"2024-09-17T03:00:20.707902+0000","last_fullsized":"2024-09-17T03:00:20.707902+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704250+0000","last_change":"2024-09-17T03:00:20.704250+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704250+0000","last_undegraded":"2024-09-17T03:00:20.704250+0000","last_fullsized":"2024-09-17T03:00:20.704250+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708033+0000","last_change":"2024-09-17T03:00:20.708033+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708033+0000","last_undegraded":"2024-09-17T03:00:20.708033+0000","last_fullsized":"2024-09-17T03:00:20.708033+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705954+0000","last_change":"2024-09-17T03:00:20.705954+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705954+0000","last_undegraded":"2024-09-17T03:00:20.705954+0000","last_fullsized":"2024-09-17T03:00:20.705954+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708578+0000","last_change":"2024-09-17T03:00:20.708578+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708578+0000","last_undegraded":"2024-09-17T03:00:20.708578+0000","last_fullsized":"2024-09-17T03:00:20.708578+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708198+0000","last_change":"2024-09-17T03:00:20.708198+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708198+0000","last_undegraded":"2024-09-17T03:00:20.708198+0000","last_fullsized":"2024-09-17T03:00:20.708198+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704558+0000","last_change":"2024-09-17T03:00:20.704558+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704558+0000","last_undegraded":"2024-09-17T03:00:20.704558+0000","last_fullsized":"2024-09-17T03:00:20.704558+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704854+0000","last_change":"2024-09-17T03:00:20.704854+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704854+0000","last_undegraded":"2024-09-17T03:00:20.704854+0000","last_fullsized":"2024-09-17T03:00:20.704854+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703508+0000","last_change":"2024-09-17T03:00:20.703508+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703508+0000","last_undegraded":"2024-09-17T03:00:20.703508+0000","last_fullsized":"2024-09-17T03:00:20.703508+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707293+0000","last_change":"2024-09-17T03:00:20.707293+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707293+0000","last_undegraded":"2024-09-17T03:00:20.707293+0000","last_fullsized":"2024-09-17T03:00:20.707293+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706662+0000","last_change":"2024-09-17T03:00:20.706662+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706662+0000","last_undegraded":"2024-09-17T03:00:20.706662+0000","last_fullsized":"2024-09-17T03:00:20.706662+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703939+0000","last_change":"2024-09-17T03:00:20.703939+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703939+0000","last_undegraded":"2024-09-17T03:00:20.703939+0000","last_fullsized":"2024-09-17T03:00:20.703939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705526+0000","last_change":"2024-09-17T03:00:20.705526+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705526+0000","last_undegraded":"2024-09-17T03:00:20.705526+0000","last_fullsized":"2024-09-17T03:00:20.705526+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708723+0000","last_change":"2024-09-17T03:00:20.708723+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708723+0000","last_undegraded":"2024-09-17T03:00:20.708723+0000","last_fullsized":"2024-09-17T03:00:20.708723+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704101+0000","last_change":"2024-09-17T03:00:20.704101+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704101+0000","last_undegraded":"2024-09-17T03:00:20.704101+0000","last_fullsized":"2024-09-17T03:00:20.704101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704585+0000","last_change":"2024-09-17T03:00:20.704585+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704585+0000","last_undegraded":"2024-09-17T03:00:20.704585+0000","last_fullsized":"2024-09-17T03:00:20.704585+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703938+0000","last_change":"2024-09-17T03:00:20.703938+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703938+0000","last_undegraded":"2024-09-17T03:00:20.703938+0000","last_fullsized":"2024-09-17T03:00:20.703938+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703715+0000","last_change":"2024-09-17T03:00:20.703715+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703715+0000","last_undegraded":"2024-09-17T03:00:20.703715+0000","last_fullsized":"2024-09-17T03:00:20.703715+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708386+0000","last_change":"2024-09-17T03:00:20.708386+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708386+0000","last_undegraded":"2024-09-17T03:00:20.708386+0000","last_fullsized":"2024-09-17T03:00:20.708386+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702974+0000","last_change":"2024-09-17T03:00:20.702974+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702974+0000","last_undegraded":"2024-09-17T03:00:20.702974+0000","last_fullsized":"2024-09-17T03:00:20.702974+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705029+0000","last_change":"2024-09-17T03:00:20.705029+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705029+0000","last_undegraded":"2024-09-17T03:00:20.705029+0000","last_fullsized":"2024-09-17T03:00:20.705029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703645+0000","last_change":"2024-09-17T03:00:20.703645+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703645+0000","last_undegraded":"2024-09-17T03:00:20.703645+0000","last_fullsized":"2024-09-17T03:00:20.703645+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704205+0000","last_change":"2024-09-17T03:00:20.704205+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704205+0000","last_undegraded":"2024-09-17T03:00:20.704205+0000","last_fullsized":"2024-09-17T03:00:20.704205+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703787+0000","last_change":"2024-09-17T03:00:20.703787+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703787+0000","last_undegraded":"2024-09-17T03:00:20.703787+0000","last_fullsized":"2024-09-17T03:00:20.703787+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706900+0000","last_change":"2024-09-17T03:00:20.706900+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706900+0000","last_undegraded":"2024-09-17T03:00:20.706900+0000","last_fullsized":"2024-09-17T03:00:20.706900+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703793+0000","last_change":"2024-09-17T03:00:20.703793+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703793+0000","last_undegraded":"2024-09-17T03:00:20.703793+0000","last_fullsized":"2024-09-17T03:00:20.703793+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703939+0000","last_change":"2024-09-17T03:00:20.703939+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703939+0000","last_undegraded":"2024-09-17T03:00:20.703939+0000","last_fullsized":"2024-09-17T03:00:20.703939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702095+0000","last_change":"2024-09-17T03:00:20.702095+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702095+0000","last_undegraded":"2024-09-17T03:00:20.702095+0000","last_fullsized":"2024-09-17T03:00:20.702095+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703340+0000","last_change":"2024-09-17T03:00:20.703340+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703340+0000","last_undegraded":"2024-09-17T03:00:20.703340+0000","last_fullsized":"2024-09-17T03:00:20.703340+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.710426+0000","last_change":"2024-09-17T03:00:20.710426+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.710426+0000","last_undegraded":"2024-09-17T03:00:20.710426+0000","last_fullsized":"2024-09-17T03:00:20.710426+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705430+0000","last_change":"2024-09-17T03:00:20.705430+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705430+0000","last_undegraded":"2024-09-17T03:00:20.705430+0000","last_fullsized":"2024-09-17T03:00:20.705430+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.714003+0000","last_change":"2024-09-17T03:00:20.714003+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.714003+0000","last_undegraded":"2024-09-17T03:00:20.714003+0000","last_fullsized":"2024-09-17T03:00:20.714003+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708016+0000","last_change":"2024-09-17T03:00:20.708016+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708016+0000","last_undegraded":"2024-09-17T03:00:20.708016+0000","last_fullsized":"2024-09-17T03:00:20.708016+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.713185+0000","last_change":"2024-09-17T03:00:20.712953+0000","last_active":"2024-09-17T03:00:20.713185+0000","last_peered":"2024-09-17T03:00:20.713185+0000","last_clean":"2024-09-17T03:00:20.713185+0000","last_became_active":"2024-09-17T03:00:20.711675+0000","last_became_peered":"2024-09-17T03:00:20.711675+0000","last_unstale":"2024-09-17T03:00:20.713185+0000","last_undegraded":"2024-09-17T03:00:20.713185+0000","last_fullsized":"2024-09-17T03:00:20.713185+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:59.207345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703274+0000","last_change":"2024-09-17T03:00:20.703274+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703274+0000","last_undegraded":"2024-09-17T03:00:20.703274+0000","last_fullsized":"2024-09-17T03:00:20.703274+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.708711+0000","last_change":"2024-09-17T03:00:20.708495+0000","last_active":"2024-09-17T03:00:20.708711+0000","last_peered":"2024-09-17T03:00:20.708711+0000","last_clean":"2024-09-17T03:00:20.708711+0000","last_became_active":"2024-09-17T03:00:20.708193+0000","last_became_peered":"2024-09-17T03:00:20.708193+0000","last_unstale":"2024-09-17T03:00:20.708711+0000","last_undegraded":"2024-09-17T03:00:20.708711+0000","last_fullsized":"2024-09-17T03:00:20.708711+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:41.910157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706575+0000","last_change":"2024-09-17T03:00:20.706575+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706575+0000","last_undegraded":"2024-09-17T03:00:20.706575+0000","last_fullsized":"2024-09-17T03:00:20.706575+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712883+0000","last_change":"2024-09-17T03:00:20.712435+0000","last_active":"2024-09-17T03:00:20.712883+0000","last_peered":"2024-09-17T03:00:20.712883+0000","last_clean":"2024-09-17T03:00:20.712883+0000","last_became_active":"2024-09-17T03:00:20.712152+0000","last_became_peered":"2024-09-17T03:00:20.712152+0000","last_unstale":"2024-09-17T03:00:20.712883+0000","last_undegraded":"2024-09-17T03:00:20.712883+0000","last_fullsized":"2024-09-17T03:00:20.712883+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:09.544663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702555+0000","last_change":"2024-09-17T03:00:20.702555+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702555+0000","last_undegraded":"2024-09-17T03:00:20.702555+0000","last_fullsized":"2024-09-17T03:00:20.702555+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709825+0000","last_change":"2024-09-17T03:00:20.706619+0000","last_active":"2024-09-17T03:00:20.709825+0000","last_peered":"2024-09-17T03:00:20.709825+0000","last_clean":"2024-09-17T03:00:20.709825+0000","last_became_active":"2024-09-17T03:00:20.706294+0000","last_became_peered":"2024-09-17T03:00:20.706294+0000","last_unstale":"2024-09-17T03:00:20.709825+0000","last_undegraded":"2024-09-17T03:00:20.709825+0000","last_fullsized":"2024-09-17T03:00:20.709825+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:25.963999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707968+0000","last_change":"2024-09-17T03:00:20.707968+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707968+0000","last_undegraded":"2024-09-17T03:00:20.707968+0000","last_fullsized":"2024-09-17T03:00:20.707968+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.717170+0000","last_change":"2024-09-17T03:00:20.716966+0000","last_active":"2024-09-17T03:00:20.717170+0000","last_peered":"2024-09-17T03:00:20.717170+0000","last_clean":"2024-09-17T03:00:20.717170+0000","last_became_active":"2024-09-17T03:00:20.716681+0000","last_became_peered":"2024-09-17T03:00:20.716681+0000","last_unstale":"2024-09-17T03:00:20.717170+0000","last_undegraded":"2024-09-17T03:00:20.717170+0000","last_fullsized":"2024-09-17T03:00:20.717170+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:22.125483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703049+0000","last_change":"2024-09-17T03:00:20.703049+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703049+0000","last_undegraded":"2024-09-17T03:00:20.703049+0000","last_fullsized":"2024-09-17T03:00:20.703049+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710665+0000","last_change":"2024-09-17T03:00:20.709805+0000","last_active":"2024-09-17T03:00:20.710665+0000","last_peered":"2024-09-17T03:00:20.710665+0000","last_clean":"2024-09-17T03:00:20.710665+0000","last_became_active":"2024-09-17T03:00:20.709291+0000","last_became_peered":"2024-09-17T03:00:20.709291+0000","last_unstale":"2024-09-17T03:00:20.710665+0000","last_undegraded":"2024-09-17T03:00:20.710665+0000","last_fullsized":"2024-09-17T03:00:20.710665+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:51.369575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702850+0000","last_change":"2024-09-17T03:00:20.702850+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702850+0000","last_undegraded":"2024-09-17T03:00:20.702850+0000","last_fullsized":"2024-09-17T03:00:20.702850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716535+0000","last_change":"2024-09-17T03:00:20.716327+0000","last_active":"2024-09-17T03:00:20.716535+0000","last_peered":"2024-09-17T03:00:20.716535+0000","last_clean":"2024-09-17T03:00:20.716535+0000","last_became_active":"2024-09-17T03:00:20.716045+0000","last_became_peered":"2024-09-17T03:00:20.716045+0000","last_unstale":"2024-09-17T03:00:20.716535+0000","last_undegraded":"2024-09-17T03:00:20.716535+0000","last_fullsized":"2024-09-17T03:00:20.716535+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:04.957426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702547+0000","last_change":"2024-09-17T03:00:20.702547+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702547+0000","last_undegraded":"2024-09-17T03:00:20.702547+0000","last_fullsized":"2024-09-17T03:00:20.702547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.714735+0000","last_change":"2024-09-17T03:00:20.714525+0000","last_active":"2024-09-17T03:00:20.714735+0000","last_peered":"2024-09-17T03:00:20.714735+0000","last_clean":"2024-09-17T03:00:20.714735+0000","last_became_active":"2024-09-17T03:00:20.714180+0000","last_became_peered":"2024-09-17T03:00:20.714180+0000","last_unstale":"2024-09-17T03:00:20.714735+0000","last_undegraded":"2024-09-17T03:00:20.714735+0000","last_fullsized":"2024-09-17T03:00:20.714735+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:11.032307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703270+0000","last_change":"2024-09-17T03:00:20.703270+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703270+0000","last_undegraded":"2024-09-17T03:00:20.703270+0000","last_fullsized":"2024-09-17T03:00:20.703270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716275+0000","last_change":"2024-09-17T03:00:20.716045+0000","last_active":"2024-09-17T03:00:20.716275+0000","last_peered":"2024-09-17T03:00:20.716275+0000","last_clean":"2024-09-17T03:00:20.716275+0000","last_became_active":"2024-09-17T03:00:20.715454+0000","last_became_peered":"2024-09-17T03:00:20.715454+0000","last_unstale":"2024-09-17T03:00:20.716275+0000","last_undegraded":"2024-09-17T03:00:20.716275+0000","last_fullsized":"2024-09-17T03:00:20.716275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:22.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702481+0000","last_change":"2024-09-17T03:00:20.702481+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702481+0000","last_undegraded":"2024-09-17T03:00:20.702481+0000","last_fullsized":"2024-09-17T03:00:20.702481+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.708732+0000","last_change":"2024-09-17T03:00:20.707140+0000","last_active":"2024-09-17T03:00:20.708732+0000","last_peered":"2024-09-17T03:00:20.708732+0000","last_clean":"2024-09-17T03:00:20.708732+0000","last_became_active":"2024-09-17T03:00:20.706883+0000","last_became_peered":"2024-09-17T03:00:20.706883+0000","last_unstale":"2024-09-17T03:00:20.708732+0000","last_undegraded":"2024-09-17T03:00:20.708732+0000","last_fullsized":"2024-09-17T03:00:20.708732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:32.842810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703041+0000","last_change":"2024-09-17T03:00:20.703041+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703041+0000","last_undegraded":"2024-09-17T03:00:20.703041+0000","last_fullsized":"2024-09-17T03:00:20.703041+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.704945+0000","last_change":"2024-09-17T03:00:20.704627+0000","last_active":"2024-09-17T03:00:20.704945+0000","last_peered":"2024-09-17T03:00:20.704945+0000","last_clean":"2024-09-17T03:00:20.704945+0000","last_became_active":"2024-09-17T03:00:20.704288+0000","last_became_peered":"2024-09-17T03:00:20.704288+0000","last_unstale":"2024-09-17T03:00:20.704945+0000","last_undegraded":"2024-09-17T03:00:20.704945+0000","last_fullsized":"2024-09-17T03:00:20.704945+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:04.769154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703560+0000","last_change":"2024-09-17T03:00:20.703560+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703560+0000","last_undegraded":"2024-09-17T03:00:20.703560+0000","last_fullsized":"2024-09-17T03:00:20.703560+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.707000+0000","last_change":"2024-09-17T03:00:20.706770+0000","last_active":"2024-09-17T03:00:20.707000+0000","last_peered":"2024-09-17T03:00:20.707000+0000","last_clean":"2024-09-17T03:00:20.707000+0000","last_became_active":"2024-09-17T03:00:20.706322+0000","last_became_peered":"2024-09-17T03:00:20.706322+0000","last_unstale":"2024-09-17T03:00:20.707000+0000","last_undegraded":"2024-09-17T03:00:20.707000+0000","last_fullsized":"2024-09-17T03:00:20.707000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:48.537480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704712+0000","last_change":"2024-09-17T03:00:20.704712+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704712+0000","last_undegraded":"2024-09-17T03:00:20.704712+0000","last_fullsized":"2024-09-17T03:00:20.704712+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.714959+0000","last_change":"2024-09-17T03:00:20.714692+0000","last_active":"2024-09-17T03:00:20.714959+0000","last_peered":"2024-09-17T03:00:20.714959+0000","last_clean":"2024-09-17T03:00:20.714959+0000","last_became_active":"2024-09-17T03:00:20.713971+0000","last_became_peered":"2024-09-17T03:00:20.713971+0000","last_unstale":"2024-09-17T03:00:20.714959+0000","last_undegraded":"2024-09-17T03:00:20.714959+0000","last_fullsized":"2024-09-17T03:00:20.714959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:46.645734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706815+0000","last_change":"2024-09-17T03:00:20.706815+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706815+0000","last_undegraded":"2024-09-17T03:00:20.706815+0000","last_fullsized":"2024-09-17T03:00:20.706815+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710421+0000","last_change":"2024-09-17T03:00:20.710168+0000","last_active":"2024-09-17T03:00:20.710421+0000","last_peered":"2024-09-17T03:00:20.710421+0000","last_clean":"2024-09-17T03:00:20.710421+0000","last_became_active":"2024-09-17T03:00:20.709908+0000","last_became_peered":"2024-09-17T03:00:20.709908+0000","last_unstale":"2024-09-17T03:00:20.710421+0000","last_undegraded":"2024-09-17T03:00:20.710421+0000","last_fullsized":"2024-09-17T03:00:20.710421+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:09.474996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703461+0000","last_change":"2024-09-17T03:00:20.703461+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703461+0000","last_undegraded":"2024-09-17T03:00:20.703461+0000","last_fullsized":"2024-09-17T03:00:20.703461+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711241+0000","last_change":"2024-09-17T03:00:20.710421+0000","last_active":"2024-09-17T03:00:20.711241+0000","last_peered":"2024-09-17T03:00:20.711241+0000","last_clean":"2024-09-17T03:00:20.711241+0000","last_became_active":"2024-09-17T03:00:20.710135+0000","last_became_peered":"2024-09-17T03:00:20.710135+0000","last_unstale":"2024-09-17T03:00:20.711241+0000","last_undegraded":"2024-09-17T03:00:20.711241+0000","last_fullsized":"2024-09-17T03:00:20.711241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:55.620059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703041+0000","last_change":"2024-09-17T03:00:20.703041+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703041+0000","last_undegraded":"2024-09-17T03:00:20.703041+0000","last_fullsized":"2024-09-17T03:00:20.703041+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716975+0000","last_change":"2024-09-17T03:00:20.716746+0000","last_active":"2024-09-17T03:00:20.716975+0000","last_peered":"2024-09-17T03:00:20.716975+0000","last_clean":"2024-09-17T03:00:20.716975+0000","last_became_active":"2024-09-17T03:00:20.716463+0000","last_became_peered":"2024-09-17T03:00:20.716463+0000","last_unstale":"2024-09-17T03:00:20.716975+0000","last_undegraded":"2024-09-17T03:00:20.716975+0000","last_fullsized":"2024-09-17T03:00:20.716975+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:48.954013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702645+0000","last_change":"2024-09-17T03:00:20.702645+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702645+0000","last_undegraded":"2024-09-17T03:00:20.702645+0000","last_fullsized":"2024-09-17T03:00:20.702645+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712486+0000","last_change":"2024-09-17T03:00:20.712205+0000","last_active":"2024-09-17T03:00:20.712486+0000","last_peered":"2024-09-17T03:00:20.712486+0000","last_clean":"2024-09-17T03:00:20.712486+0000","last_became_active":"2024-09-17T03:00:20.711889+0000","last_became_peered":"2024-09-17T03:00:20.711889+0000","last_unstale":"2024-09-17T03:00:20.712486+0000","last_undegraded":"2024-09-17T03:00:20.712486+0000","last_fullsized":"2024-09-17T03:00:20.712486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:27.364433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708618+0000","last_change":"2024-09-17T03:00:20.708618+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708618+0000","last_undegraded":"2024-09-17T03:00:20.708618+0000","last_fullsized":"2024-09-17T03:00:20.708618+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712921+0000","last_change":"2024-09-17T03:00:20.712674+0000","last_active":"2024-09-17T03:00:20.712921+0000","last_peered":"2024-09-17T03:00:20.712921+0000","last_clean":"2024-09-17T03:00:20.712921+0000","last_became_active":"2024-09-17T03:00:20.712384+0000","last_became_peered":"2024-09-17T03:00:20.712384+0000","last_unstale":"2024-09-17T03:00:20.712921+0000","last_undegraded":"2024-09-17T03:00:20.712921+0000","last_fullsized":"2024-09-17T03:00:20.712921+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:34.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704049+0000","last_change":"2024-09-17T03:00:20.704049+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704049+0000","last_undegraded":"2024-09-17T03:00:20.704049+0000","last_fullsized":"2024-09-17T03:00:20.704049+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709856+0000","last_change":"2024-09-17T03:00:20.707138+0000","last_active":"2024-09-17T03:00:20.709856+0000","last_peered":"2024-09-17T03:00:20.709856+0000","last_clean":"2024-09-17T03:00:20.709856+0000","last_became_active":"2024-09-17T03:00:20.706724+0000","last_became_peered":"2024-09-17T03:00:20.706724+0000","last_unstale":"2024-09-17T03:00:20.709856+0000","last_undegraded":"2024-09-17T03:00:20.709856+0000","last_fullsized":"2024-09-17T03:00:20.709856+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:26.157803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707674+0000","last_change":"2024-09-17T03:00:20.707674+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707674+0000","last_undegraded":"2024-09-17T03:00:20.707674+0000","last_fullsized":"2024-09-17T03:00:20.707674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712834+0000","last_change":"2024-09-17T03:00:20.712055+0000","last_active":"2024-09-17T03:00:20.712834+0000","last_peered":"2024-09-17T03:00:20.712834+0000","last_clean":"2024-09-17T03:00:20.712834+0000","last_became_active":"2024-09-17T03:00:20.710950+0000","last_became_peered":"2024-09-17T03:00:20.710950+0000","last_unstale":"2024-09-17T03:00:20.712834+0000","last_undegraded":"2024-09-17T03:00:20.712834+0000","last_fullsized":"2024-09-17T03:00:20.712834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:00.876072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702809+0000","last_change":"2024-09-17T03:00:20.702809+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702809+0000","last_undegraded":"2024-09-17T03:00:20.702809+0000","last_fullsized":"2024-09-17T03:00:20.702809+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716106+0000","last_change":"2024-09-17T03:00:20.715877+0000","last_active":"2024-09-17T03:00:20.716106+0000","last_peered":"2024-09-17T03:00:20.716106+0000","last_clean":"2024-09-17T03:00:20.716106+0000","last_became_active":"2024-09-17T03:00:20.715603+0000","last_became_peered":"2024-09-17T03:00:20.715603+0000","last_unstale":"2024-09-17T03:00:20.716106+0000","last_undegraded":"2024-09-17T03:00:20.716106+0000","last_fullsized":"2024-09-17T03:00:20.716106+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:18.834772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704674+0000","last_change":"2024-09-17T03:00:20.704674+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704674+0000","last_undegraded":"2024-09-17T03:00:20.704674+0000","last_fullsized":"2024-09-17T03:00:20.704674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711397+0000","last_change":"2024-09-17T03:00:20.711135+0000","last_active":"2024-09-17T03:00:20.711397+0000","last_peered":"2024-09-17T03:00:20.711397+0000","last_clean":"2024-09-17T03:00:20.711397+0000","last_became_active":"2024-09-17T03:00:20.710383+0000","last_became_peered":"2024-09-17T03:00:20.710383+0000","last_unstale":"2024-09-17T03:00:20.711397+0000","last_undegraded":"2024-09-17T03:00:20.711397+0000","last_fullsized":"2024-09-17T03:00:20.711397+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:23.116065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704822+0000","last_change":"2024-09-17T03:00:20.704822+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704822+0000","last_undegraded":"2024-09-17T03:00:20.704822+0000","last_fullsized":"2024-09-17T03:00:20.704822+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710801+0000","last_change":"2024-09-17T03:00:20.710576+0000","last_active":"2024-09-17T03:00:20.710801+0000","last_peered":"2024-09-17T03:00:20.710801+0000","last_clean":"2024-09-17T03:00:20.710801+0000","last_became_active":"2024-09-17T03:00:20.710160+0000","last_became_peered":"2024-09-17T03:00:20.710160+0000","last_unstale":"2024-09-17T03:00:20.710801+0000","last_undegraded":"2024-09-17T03:00:20.710801+0000","last_fullsized":"2024-09-17T03:00:20.710801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:31.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703865+0000","last_change":"2024-09-17T03:00:20.703865+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703865+0000","last_undegraded":"2024-09-17T03:00:20.703865+0000","last_fullsized":"2024-09-17T03:00:20.703865+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711357+0000","last_change":"2024-09-17T03:00:20.710615+0000","last_active":"2024-09-17T03:00:20.711357+0000","last_peered":"2024-09-17T03:00:20.711357+0000","last_clean":"2024-09-17T03:00:20.711357+0000","last_became_active":"2024-09-17T03:00:20.710295+0000","last_became_peered":"2024-09-17T03:00:20.710295+0000","last_unstale":"2024-09-17T03:00:20.711357+0000","last_undegraded":"2024-09-17T03:00:20.711357+0000","last_fullsized":"2024-09-17T03:00:20.711357+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:12.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.713637+0000","last_change":"2024-09-17T03:00:20.713637+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.713637+0000","last_undegraded":"2024-09-17T03:00:20.713637+0000","last_fullsized":"2024-09-17T03:00:20.713637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712859+0000","last_change":"2024-09-17T03:00:20.712374+0000","last_active":"2024-09-17T03:00:20.712859+0000","last_peered":"2024-09-17T03:00:20.712859+0000","last_clean":"2024-09-17T03:00:20.712859+0000","last_became_active":"2024-09-17T03:00:20.711318+0000","last_became_peered":"2024-09-17T03:00:20.711318+0000","last_unstale":"2024-09-17T03:00:20.712859+0000","last_undegraded":"2024-09-17T03:00:20.712859+0000","last_fullsized":"2024-09-17T03:00:20.712859+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:27.300493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706423+0000","last_change":"2024-09-17T03:00:20.706423+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706423+0000","last_undegraded":"2024-09-17T03:00:20.706423+0000","last_fullsized":"2024-09-17T03:00:20.706423+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.715298+0000","last_change":"2024-09-17T03:00:20.714967+0000","last_active":"2024-09-17T03:00:20.715298+0000","last_peered":"2024-09-17T03:00:20.715298+0000","last_clean":"2024-09-17T03:00:20.715298+0000","last_became_active":"2024-09-17T03:00:20.710118+0000","last_became_peered":"2024-09-17T03:00:20.710118+0000","last_unstale":"2024-09-17T03:00:20.715298+0000","last_undegraded":"2024-09-17T03:00:20.715298+0000","last_fullsized":"2024-09-17T03:00:20.715298+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:53.483800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702243+0000","last_change":"2024-09-17T03:00:20.702243+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702243+0000","last_undegraded":"2024-09-17T03:00:20.702243+0000","last_fullsized":"2024-09-17T03:00:20.702243+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710919+0000","last_change":"2024-09-17T03:00:20.710692+0000","last_active":"2024-09-17T03:00:20.710919+0000","last_peered":"2024-09-17T03:00:20.710919+0000","last_clean":"2024-09-17T03:00:20.710919+0000","last_became_active":"2024-09-17T03:00:20.710092+0000","last_became_peered":"2024-09-17T03:00:20.710092+0000","last_unstale":"2024-09-17T03:00:20.710919+0000","last_undegraded":"2024-09-17T03:00:20.710919+0000","last_fullsized":"2024-09-17T03:00:20.710919+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:57.885988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702606+0000","last_change":"2024-09-17T03:00:20.702606+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702606+0000","last_undegraded":"2024-09-17T03:00:20.702606+0000","last_fullsized":"2024-09-17T03:00:20.702606+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.713846+0000","last_change":"2024-09-17T03:00:20.711935+0000","last_active":"2024-09-17T03:00:20.713846+0000","last_peered":"2024-09-17T03:00:20.713846+0000","last_clean":"2024-09-17T03:00:20.713846+0000","last_became_active":"2024-09-17T03:00:20.711593+0000","last_became_peered":"2024-09-17T03:00:20.711593+0000","last_unstale":"2024-09-17T03:00:20.713846+0000","last_undegraded":"2024-09-17T03:00:20.713846+0000","last_fullsized":"2024-09-17T03:00:20.713846+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:09.109660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702029+0000","last_change":"2024-09-17T03:00:20.702029+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702029+0000","last_undegraded":"2024-09-17T03:00:20.702029+0000","last_fullsized":"2024-09-17T03:00:20.702029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.717078+0000","last_change":"2024-09-17T03:00:20.716927+0000","last_active":"2024-09-17T03:00:20.717078+0000","last_peered":"2024-09-17T03:00:20.717078+0000","last_clean":"2024-09-17T03:00:20.717078+0000","last_became_active":"2024-09-17T03:00:20.716608+0000","last_became_peered":"2024-09-17T03:00:20.716608+0000","last_unstale":"2024-09-17T03:00:20.717078+0000","last_undegraded":"2024-09-17T03:00:20.717078+0000","last_fullsized":"2024-09-17T03:00:20.717078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:33.480653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707312+0000","last_change":"2024-09-17T03:00:20.707312+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707312+0000","last_undegraded":"2024-09-17T03:00:20.707312+0000","last_fullsized":"2024-09-17T03:00:20.707312+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709760+0000","last_change":"2024-09-17T03:00:20.709303+0000","last_active":"2024-09-17T03:00:20.709760+0000","last_peered":"2024-09-17T03:00:20.709760+0000","last_clean":"2024-09-17T03:00:20.709760+0000","last_became_active":"2024-09-17T03:00:20.709021+0000","last_became_peered":"2024-09-17T03:00:20.709021+0000","last_unstale":"2024-09-17T03:00:20.709760+0000","last_undegraded":"2024-09-17T03:00:20.709760+0000","last_fullsized":"2024-09-17T03:00:20.709760+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:54.955286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702546+0000","last_change":"2024-09-17T03:00:20.702546+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702546+0000","last_undegraded":"2024-09-17T03:00:20.702546+0000","last_fullsized":"2024-09-17T03:00:20.702546+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711392+0000","last_change":"2024-09-17T03:00:20.711202+0000","last_active":"2024-09-17T03:00:20.711392+0000","last_peered":"2024-09-17T03:00:20.711392+0000","last_clean":"2024-09-17T03:00:20.711392+0000","last_became_active":"2024-09-17T03:00:20.710535+0000","last_became_peered":"2024-09-17T03:00:20.710535+0000","last_unstale":"2024-09-17T03:00:20.711392+0000","last_undegraded":"2024-09-17T03:00:20.711392+0000","last_fullsized":"2024-09-17T03:00:20.711392+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.244482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.710074+0000","last_change":"2024-09-17T03:00:20.710074+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.710074+0000","last_undegraded":"2024-09-17T03:00:20.710074+0000","last_fullsized":"2024-09-17T03:00:20.710074+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.706938+0000","last_change":"2024-09-17T03:00:20.706322+0000","last_active":"2024-09-17T03:00:20.706938+0000","last_peered":"2024-09-17T03:00:20.706938+0000","last_clean":"2024-09-17T03:00:20.706938+0000","last_became_active":"2024-09-17T03:00:20.706045+0000","last_became_peered":"2024-09-17T03:00:20.706045+0000","last_unstale":"2024-09-17T03:00:20.706938+0000","last_undegraded":"2024-09-17T03:00:20.706938+0000","last_fullsized":"2024-09-17T03:00:20.706938+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:51.063485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":311,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.699015+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:20.699015+0000","last_peered":"2024-09-17T03:00:20.699015+0000","last_clean":"2024-09-17T03:00:20.699015+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:20.699015+0000","last_undegraded":"2024-09-17T03:00:20.699015+0000","last_fullsized":"2024-09-17T03:00:20.699015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194090,"statfs":{"total":200000000,"available":198748492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345135,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194090,"statfs":{"total":200000000,"available":198748492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:00:24.721 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:24.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.870+0000 7f959608b640 1 -- 172.21.15.104:0/387246409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9578003a00 msgr2=0x7f9578003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.870+0000 7f959608b640 1 --2- 172.21.15.104:0/387246409 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9578003a00 0x7f9578003e70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9580009b50 tx=0x7f9578005830 comp rx=0 tx=0).stop 2024-09-17T03:00:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.870+0000 7f958ffff640 1 -- 172.21.15.104:0/387246409 reap_dead start 2024-09-17T03:00:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.870+0000 7f959608b640 1 -- 172.21.15.104:0/387246409 shutdown_connections 2024-09-17T03:00:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.870+0000 7f959608b640 1 -- 172.21.15.104:0/387246409 >> 172.21.15.104:0/387246409 conn(0x7f95900b2450 msgr2=0x7f95900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.870+0000 7f959608b640 1 -- 172.21.15.104:0/387246409 shutdown_connections 2024-09-17T03:00:24.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.870+0000 7f959608b640 1 -- 172.21.15.104:0/387246409 wait complete. 2024-09-17T03:00:24.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.872+0000 7f959608b640 1 Processor -- start 2024-09-17T03:00:24.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.872+0000 7f959608b640 1 -- start start 2024-09-17T03:00:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f959608b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9578003a00 0x7f959015db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f959608b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95901f6840 0x7f95900ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f959608b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95900aedf0 0x7f9590157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f959608b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f959015bfc0 con 0x7f95900aedf0 2024-09-17T03:00:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f959608b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f959015be40 con 0x7f9578003a00 2024-09-17T03:00:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f959608b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f95900ce7c0 con 0x7f95901f6840 2024-09-17T03:00:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95900aedf0 0x7f9590157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95900aedf0 0x7f9590157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53066/0 (socket says 172.21.15.104:53066) 2024-09-17T03:00:24.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 -- 172.21.15.104:0/1417926272 learned_addr learned my addr 172.21.15.104:0/1417926272 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:24.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958f7fe640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9578003a00 0x7f959015db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958effd640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95901f6840 0x7f95900ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 -- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95901f6840 msgr2=0x7f95900ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95901f6840 0x7f95900ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 -- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9578003a00 msgr2=0x7f959015db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:24.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9578003a00 0x7f959015db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 -- 172.21.15.104:0/1417926272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95900af200 con 0x7f95900aedf0 2024-09-17T03:00:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f958ffff640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95900aedf0 0x7f9590157d40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f9588005fd0 tx=0x7f9588010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f9577fff640 1 -- 172.21.15.104:0/1417926272 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958800ee80 con 0x7f95900aedf0 2024-09-17T03:00:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f9577fff640 1 -- 172.21.15.104:0/1417926272 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9588015070 con 0x7f95900aedf0 2024-09-17T03:00:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959015e4b0 con 0x7f95900aedf0 2024-09-17T03:00:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.874+0000 7f9577fff640 1 -- 172.21.15.104:0/1417926272 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9588003ce0 con 0x7f95900aedf0 2024-09-17T03:00:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.875+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95901f6040 con 0x7f95900aedf0 2024-09-17T03:00:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.875+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959015e220 con 0x7f95900aedf0 2024-09-17T03:00:24.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.876+0000 7f9577fff640 1 -- 172.21.15.104:0/1417926272 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9588004030 con 0x7f95900aedf0 2024-09-17T03:00:24.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.877+0000 7f9577fff640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f957c078b90 0x7f957c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:24.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.877+0000 7f9577fff640 1 -- 172.21.15.104:0/1417926272 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f958809b6b0 con 0x7f95900aedf0 2024-09-17T03:00:24.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.877+0000 7f958f7fe640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f957c078b90 0x7f957c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:24.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.877+0000 7f958f7fe640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f957c078b90 0x7f957c07b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9580035000 tx=0x7f958002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:24.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:24.881+0000 7f9577fff640 1 -- 172.21.15.104:0/1417926272 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f95900af200 con 0x7f95900aedf0 2024-09-17T03:00:25.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.050+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f95900ce280 con 0x7f957c078b90 2024-09-17T03:00:25.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.055+0000 7f9577fff640 1 -- 172.21.15.104:0/1417926272 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242658 (secure 0 0 0) 0x7f95900ce280 con 0x7f957c078b90 2024-09-17T03:00:25.057 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:25.058 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:25.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f957c078b90 msgr2=0x7f957c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f957c078b90 0x7f957c07b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9580035000 tx=0x7f958002d040 comp rx=0 tx=0).stop 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95900aedf0 msgr2=0x7f9590157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95900aedf0 0x7f9590157d40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f9588005fd0 tx=0x7f9588010f40 comp rx=0 tx=0).stop 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 shutdown_connections 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f957c078b90 0x7f957c07b0a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95900aedf0 0x7f9590157d40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95901f6840 0x7f95900ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 --2- 172.21.15.104:0/1417926272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9578003a00 0x7f959015db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 >> 172.21.15.104:0/1417926272 conn(0x7f95900b2450 msgr2=0x7f95900b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 shutdown_connections 2024-09-17T03:00:25.060 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.058+0000 7f959608b640 1 -- 172.21.15.104:0/1417926272 wait complete. 2024-09-17T03:00:25.068 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-17T03:00:23.705900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556187,"statfs":{"total":1600000000,"available":1593536419,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.012951"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707902+0000","last_change":"2024-09-17T03:00:20.707902+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707902+0000","last_undegraded":"2024-09-17T03:00:20.707902+0000","last_fullsized":"2024-09-17T03:00:20.707902+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704250+0000","last_change":"2024-09-17T03:00:20.704250+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704250+0000","last_undegraded":"2024-09-17T03:00:20.704250+0000","last_fullsized":"2024-09-17T03:00:20.704250+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708033+0000","last_change":"2024-09-17T03:00:20.708033+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708033+0000","last_undegraded":"2024-09-17T03:00:20.708033+0000","last_fullsized":"2024-09-17T03:00:20.708033+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705954+0000","last_change":"2024-09-17T03:00:20.705954+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705954+0000","last_undegraded":"2024-09-17T03:00:20.705954+0000","last_fullsized":"2024-09-17T03:00:20.705954+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708578+0000","last_change":"2024-09-17T03:00:20.708578+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708578+0000","last_undegraded":"2024-09-17T03:00:20.708578+0000","last_fullsized":"2024-09-17T03:00:20.708578+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708198+0000","last_change":"2024-09-17T03:00:20.708198+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708198+0000","last_undegraded":"2024-09-17T03:00:20.708198+0000","last_fullsized":"2024-09-17T03:00:20.708198+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704558+0000","last_change":"2024-09-17T03:00:20.704558+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704558+0000","last_undegraded":"2024-09-17T03:00:20.704558+0000","last_fullsized":"2024-09-17T03:00:20.704558+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704854+0000","last_change":"2024-09-17T03:00:20.704854+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704854+0000","last_undegraded":"2024-09-17T03:00:20.704854+0000","last_fullsized":"2024-09-17T03:00:20.704854+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703508+0000","last_change":"2024-09-17T03:00:20.703508+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703508+0000","last_undegraded":"2024-09-17T03:00:20.703508+0000","last_fullsized":"2024-09-17T03:00:20.703508+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707293+0000","last_change":"2024-09-17T03:00:20.707293+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707293+0000","last_undegraded":"2024-09-17T03:00:20.707293+0000","last_fullsized":"2024-09-17T03:00:20.707293+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706662+0000","last_change":"2024-09-17T03:00:20.706662+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706662+0000","last_undegraded":"2024-09-17T03:00:20.706662+0000","last_fullsized":"2024-09-17T03:00:20.706662+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703939+0000","last_change":"2024-09-17T03:00:20.703939+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703939+0000","last_undegraded":"2024-09-17T03:00:20.703939+0000","last_fullsized":"2024-09-17T03:00:20.703939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705526+0000","last_change":"2024-09-17T03:00:20.705526+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705526+0000","last_undegraded":"2024-09-17T03:00:20.705526+0000","last_fullsized":"2024-09-17T03:00:20.705526+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708723+0000","last_change":"2024-09-17T03:00:20.708723+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708723+0000","last_undegraded":"2024-09-17T03:00:20.708723+0000","last_fullsized":"2024-09-17T03:00:20.708723+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704101+0000","last_change":"2024-09-17T03:00:20.704101+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704101+0000","last_undegraded":"2024-09-17T03:00:20.704101+0000","last_fullsized":"2024-09-17T03:00:20.704101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704585+0000","last_change":"2024-09-17T03:00:20.704585+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704585+0000","last_undegraded":"2024-09-17T03:00:20.704585+0000","last_fullsized":"2024-09-17T03:00:20.704585+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703938+0000","last_change":"2024-09-17T03:00:20.703938+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703938+0000","last_undegraded":"2024-09-17T03:00:20.703938+0000","last_fullsized":"2024-09-17T03:00:20.703938+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703715+0000","last_change":"2024-09-17T03:00:20.703715+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703715+0000","last_undegraded":"2024-09-17T03:00:20.703715+0000","last_fullsized":"2024-09-17T03:00:20.703715+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708386+0000","last_change":"2024-09-17T03:00:20.708386+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708386+0000","last_undegraded":"2024-09-17T03:00:20.708386+0000","last_fullsized":"2024-09-17T03:00:20.708386+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702974+0000","last_change":"2024-09-17T03:00:20.702974+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702974+0000","last_undegraded":"2024-09-17T03:00:20.702974+0000","last_fullsized":"2024-09-17T03:00:20.702974+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705029+0000","last_change":"2024-09-17T03:00:20.705029+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705029+0000","last_undegraded":"2024-09-17T03:00:20.705029+0000","last_fullsized":"2024-09-17T03:00:20.705029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703645+0000","last_change":"2024-09-17T03:00:20.703645+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703645+0000","last_undegraded":"2024-09-17T03:00:20.703645+0000","last_fullsized":"2024-09-17T03:00:20.703645+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704205+0000","last_change":"2024-09-17T03:00:20.704205+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704205+0000","last_undegraded":"2024-09-17T03:00:20.704205+0000","last_fullsized":"2024-09-17T03:00:20.704205+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703787+0000","last_change":"2024-09-17T03:00:20.703787+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703787+0000","last_undegraded":"2024-09-17T03:00:20.703787+0000","last_fullsized":"2024-09-17T03:00:20.703787+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706900+0000","last_change":"2024-09-17T03:00:20.706900+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706900+0000","last_undegraded":"2024-09-17T03:00:20.706900+0000","last_fullsized":"2024-09-17T03:00:20.706900+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703793+0000","last_change":"2024-09-17T03:00:20.703793+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703793+0000","last_undegraded":"2024-09-17T03:00:20.703793+0000","last_fullsized":"2024-09-17T03:00:20.703793+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703939+0000","last_change":"2024-09-17T03:00:20.703939+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703939+0000","last_undegraded":"2024-09-17T03:00:20.703939+0000","last_fullsized":"2024-09-17T03:00:20.703939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702095+0000","last_change":"2024-09-17T03:00:20.702095+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702095+0000","last_undegraded":"2024-09-17T03:00:20.702095+0000","last_fullsized":"2024-09-17T03:00:20.702095+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703340+0000","last_change":"2024-09-17T03:00:20.703340+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703340+0000","last_undegraded":"2024-09-17T03:00:20.703340+0000","last_fullsized":"2024-09-17T03:00:20.703340+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.710426+0000","last_change":"2024-09-17T03:00:20.710426+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.710426+0000","last_undegraded":"2024-09-17T03:00:20.710426+0000","last_fullsized":"2024-09-17T03:00:20.710426+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705430+0000","last_change":"2024-09-17T03:00:20.705430+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705430+0000","last_undegraded":"2024-09-17T03:00:20.705430+0000","last_fullsized":"2024-09-17T03:00:20.705430+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.714003+0000","last_change":"2024-09-17T03:00:20.714003+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.714003+0000","last_undegraded":"2024-09-17T03:00:20.714003+0000","last_fullsized":"2024-09-17T03:00:20.714003+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708016+0000","last_change":"2024-09-17T03:00:20.708016+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708016+0000","last_undegraded":"2024-09-17T03:00:20.708016+0000","last_fullsized":"2024-09-17T03:00:20.708016+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.713185+0000","last_change":"2024-09-17T03:00:20.712953+0000","last_active":"2024-09-17T03:00:20.713185+0000","last_peered":"2024-09-17T03:00:20.713185+0000","last_clean":"2024-09-17T03:00:20.713185+0000","last_became_active":"2024-09-17T03:00:20.711675+0000","last_became_peered":"2024-09-17T03:00:20.711675+0000","last_unstale":"2024-09-17T03:00:20.713185+0000","last_undegraded":"2024-09-17T03:00:20.713185+0000","last_fullsized":"2024-09-17T03:00:20.713185+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:59.207345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703274+0000","last_change":"2024-09-17T03:00:20.703274+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703274+0000","last_undegraded":"2024-09-17T03:00:20.703274+0000","last_fullsized":"2024-09-17T03:00:20.703274+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.708711+0000","last_change":"2024-09-17T03:00:20.708495+0000","last_active":"2024-09-17T03:00:20.708711+0000","last_peered":"2024-09-17T03:00:20.708711+0000","last_clean":"2024-09-17T03:00:20.708711+0000","last_became_active":"2024-09-17T03:00:20.708193+0000","last_became_peered":"2024-09-17T03:00:20.708193+0000","last_unstale":"2024-09-17T03:00:20.708711+0000","last_undegraded":"2024-09-17T03:00:20.708711+0000","last_fullsized":"2024-09-17T03:00:20.708711+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:41.910157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706575+0000","last_change":"2024-09-17T03:00:20.706575+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706575+0000","last_undegraded":"2024-09-17T03:00:20.706575+0000","last_fullsized":"2024-09-17T03:00:20.706575+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712883+0000","last_change":"2024-09-17T03:00:20.712435+0000","last_active":"2024-09-17T03:00:20.712883+0000","last_peered":"2024-09-17T03:00:20.712883+0000","last_clean":"2024-09-17T03:00:20.712883+0000","last_became_active":"2024-09-17T03:00:20.712152+0000","last_became_peered":"2024-09-17T03:00:20.712152+0000","last_unstale":"2024-09-17T03:00:20.712883+0000","last_undegraded":"2024-09-17T03:00:20.712883+0000","last_fullsized":"2024-09-17T03:00:20.712883+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:09.544663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702555+0000","last_change":"2024-09-17T03:00:20.702555+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702555+0000","last_undegraded":"2024-09-17T03:00:20.702555+0000","last_fullsized":"2024-09-17T03:00:20.702555+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709825+0000","last_change":"2024-09-17T03:00:20.706619+0000","last_active":"2024-09-17T03:00:20.709825+0000","last_peered":"2024-09-17T03:00:20.709825+0000","last_clean":"2024-09-17T03:00:20.709825+0000","last_became_active":"2024-09-17T03:00:20.706294+0000","last_became_peered":"2024-09-17T03:00:20.706294+0000","last_unstale":"2024-09-17T03:00:20.709825+0000","last_undegraded":"2024-09-17T03:00:20.709825+0000","last_fullsized":"2024-09-17T03:00:20.709825+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:25.963999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707968+0000","last_change":"2024-09-17T03:00:20.707968+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707968+0000","last_undegraded":"2024-09-17T03:00:20.707968+0000","last_fullsized":"2024-09-17T03:00:20.707968+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.717170+0000","last_change":"2024-09-17T03:00:20.716966+0000","last_active":"2024-09-17T03:00:20.717170+0000","last_peered":"2024-09-17T03:00:20.717170+0000","last_clean":"2024-09-17T03:00:20.717170+0000","last_became_active":"2024-09-17T03:00:20.716681+0000","last_became_peered":"2024-09-17T03:00:20.716681+0000","last_unstale":"2024-09-17T03:00:20.717170+0000","last_undegraded":"2024-09-17T03:00:20.717170+0000","last_fullsized":"2024-09-17T03:00:20.717170+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:22.125483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703049+0000","last_change":"2024-09-17T03:00:20.703049+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703049+0000","last_undegraded":"2024-09-17T03:00:20.703049+0000","last_fullsized":"2024-09-17T03:00:20.703049+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710665+0000","last_change":"2024-09-17T03:00:20.709805+0000","last_active":"2024-09-17T03:00:20.710665+0000","last_peered":"2024-09-17T03:00:20.710665+0000","last_clean":"2024-09-17T03:00:20.710665+0000","last_became_active":"2024-09-17T03:00:20.709291+0000","last_became_peered":"2024-09-17T03:00:20.709291+0000","last_unstale":"2024-09-17T03:00:20.710665+0000","last_undegraded":"2024-09-17T03:00:20.710665+0000","last_fullsized":"2024-09-17T03:00:20.710665+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:51.369575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702850+0000","last_change":"2024-09-17T03:00:20.702850+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702850+0000","last_undegraded":"2024-09-17T03:00:20.702850+0000","last_fullsized":"2024-09-17T03:00:20.702850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716535+0000","last_change":"2024-09-17T03:00:20.716327+0000","last_active":"2024-09-17T03:00:20.716535+0000","last_peered":"2024-09-17T03:00:20.716535+0000","last_clean":"2024-09-17T03:00:20.716535+0000","last_became_active":"2024-09-17T03:00:20.716045+0000","last_became_peered":"2024-09-17T03:00:20.716045+0000","last_unstale":"2024-09-17T03:00:20.716535+0000","last_undegraded":"2024-09-17T03:00:20.716535+0000","last_fullsized":"2024-09-17T03:00:20.716535+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:04.957426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702547+0000","last_change":"2024-09-17T03:00:20.702547+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702547+0000","last_undegraded":"2024-09-17T03:00:20.702547+0000","last_fullsized":"2024-09-17T03:00:20.702547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.714735+0000","last_change":"2024-09-17T03:00:20.714525+0000","last_active":"2024-09-17T03:00:20.714735+0000","last_peered":"2024-09-17T03:00:20.714735+0000","last_clean":"2024-09-17T03:00:20.714735+0000","last_became_active":"2024-09-17T03:00:20.714180+0000","last_became_peered":"2024-09-17T03:00:20.714180+0000","last_unstale":"2024-09-17T03:00:20.714735+0000","last_undegraded":"2024-09-17T03:00:20.714735+0000","last_fullsized":"2024-09-17T03:00:20.714735+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:11.032307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703270+0000","last_change":"2024-09-17T03:00:20.703270+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703270+0000","last_undegraded":"2024-09-17T03:00:20.703270+0000","last_fullsized":"2024-09-17T03:00:20.703270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716275+0000","last_change":"2024-09-17T03:00:20.716045+0000","last_active":"2024-09-17T03:00:20.716275+0000","last_peered":"2024-09-17T03:00:20.716275+0000","last_clean":"2024-09-17T03:00:20.716275+0000","last_became_active":"2024-09-17T03:00:20.715454+0000","last_became_peered":"2024-09-17T03:00:20.715454+0000","last_unstale":"2024-09-17T03:00:20.716275+0000","last_undegraded":"2024-09-17T03:00:20.716275+0000","last_fullsized":"2024-09-17T03:00:20.716275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:22.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702481+0000","last_change":"2024-09-17T03:00:20.702481+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702481+0000","last_undegraded":"2024-09-17T03:00:20.702481+0000","last_fullsized":"2024-09-17T03:00:20.702481+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.708732+0000","last_change":"2024-09-17T03:00:20.707140+0000","last_active":"2024-09-17T03:00:20.708732+0000","last_peered":"2024-09-17T03:00:20.708732+0000","last_clean":"2024-09-17T03:00:20.708732+0000","last_became_active":"2024-09-17T03:00:20.706883+0000","last_became_peered":"2024-09-17T03:00:20.706883+0000","last_unstale":"2024-09-17T03:00:20.708732+0000","last_undegraded":"2024-09-17T03:00:20.708732+0000","last_fullsized":"2024-09-17T03:00:20.708732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:32.842810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703041+0000","last_change":"2024-09-17T03:00:20.703041+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703041+0000","last_undegraded":"2024-09-17T03:00:20.703041+0000","last_fullsized":"2024-09-17T03:00:20.703041+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.704945+0000","last_change":"2024-09-17T03:00:20.704627+0000","last_active":"2024-09-17T03:00:20.704945+0000","last_peered":"2024-09-17T03:00:20.704945+0000","last_clean":"2024-09-17T03:00:20.704945+0000","last_became_active":"2024-09-17T03:00:20.704288+0000","last_became_peered":"2024-09-17T03:00:20.704288+0000","last_unstale":"2024-09-17T03:00:20.704945+0000","last_undegraded":"2024-09-17T03:00:20.704945+0000","last_fullsized":"2024-09-17T03:00:20.704945+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:04.769154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703560+0000","last_change":"2024-09-17T03:00:20.703560+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703560+0000","last_undegraded":"2024-09-17T03:00:20.703560+0000","last_fullsized":"2024-09-17T03:00:20.703560+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.707000+0000","last_change":"2024-09-17T03:00:20.706770+0000","last_active":"2024-09-17T03:00:20.707000+0000","last_peered":"2024-09-17T03:00:20.707000+0000","last_clean":"2024-09-17T03:00:20.707000+0000","last_became_active":"2024-09-17T03:00:20.706322+0000","last_became_peered":"2024-09-17T03:00:20.706322+0000","last_unstale":"2024-09-17T03:00:20.707000+0000","last_undegraded":"2024-09-17T03:00:20.707000+0000","last_fullsized":"2024-09-17T03:00:20.707000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:48.537480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704712+0000","last_change":"2024-09-17T03:00:20.704712+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704712+0000","last_undegraded":"2024-09-17T03:00:20.704712+0000","last_fullsized":"2024-09-17T03:00:20.704712+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.714959+0000","last_change":"2024-09-17T03:00:20.714692+0000","last_active":"2024-09-17T03:00:20.714959+0000","last_peered":"2024-09-17T03:00:20.714959+0000","last_clean":"2024-09-17T03:00:20.714959+0000","last_became_active":"2024-09-17T03:00:20.713971+0000","last_became_peered":"2024-09-17T03:00:20.713971+0000","last_unstale":"2024-09-17T03:00:20.714959+0000","last_undegraded":"2024-09-17T03:00:20.714959+0000","last_fullsized":"2024-09-17T03:00:20.714959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:46.645734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706815+0000","last_change":"2024-09-17T03:00:20.706815+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706815+0000","last_undegraded":"2024-09-17T03:00:20.706815+0000","last_fullsized":"2024-09-17T03:00:20.706815+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710421+0000","last_change":"2024-09-17T03:00:20.710168+0000","last_active":"2024-09-17T03:00:20.710421+0000","last_peered":"2024-09-17T03:00:20.710421+0000","last_clean":"2024-09-17T03:00:20.710421+0000","last_became_active":"2024-09-17T03:00:20.709908+0000","last_became_peered":"2024-09-17T03:00:20.709908+0000","last_unstale":"2024-09-17T03:00:20.710421+0000","last_undegraded":"2024-09-17T03:00:20.710421+0000","last_fullsized":"2024-09-17T03:00:20.710421+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:09.474996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703461+0000","last_change":"2024-09-17T03:00:20.703461+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703461+0000","last_undegraded":"2024-09-17T03:00:20.703461+0000","last_fullsized":"2024-09-17T03:00:20.703461+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711241+0000","last_change":"2024-09-17T03:00:20.710421+0000","last_active":"2024-09-17T03:00:20.711241+0000","last_peered":"2024-09-17T03:00:20.711241+0000","last_clean":"2024-09-17T03:00:20.711241+0000","last_became_active":"2024-09-17T03:00:20.710135+0000","last_became_peered":"2024-09-17T03:00:20.710135+0000","last_unstale":"2024-09-17T03:00:20.711241+0000","last_undegraded":"2024-09-17T03:00:20.711241+0000","last_fullsized":"2024-09-17T03:00:20.711241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:55.620059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703041+0000","last_change":"2024-09-17T03:00:20.703041+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703041+0000","last_undegraded":"2024-09-17T03:00:20.703041+0000","last_fullsized":"2024-09-17T03:00:20.703041+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716975+0000","last_change":"2024-09-17T03:00:20.716746+0000","last_active":"2024-09-17T03:00:20.716975+0000","last_peered":"2024-09-17T03:00:20.716975+0000","last_clean":"2024-09-17T03:00:20.716975+0000","last_became_active":"2024-09-17T03:00:20.716463+0000","last_became_peered":"2024-09-17T03:00:20.716463+0000","last_unstale":"2024-09-17T03:00:20.716975+0000","last_undegraded":"2024-09-17T03:00:20.716975+0000","last_fullsized":"2024-09-17T03:00:20.716975+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:48.954013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702645+0000","last_change":"2024-09-17T03:00:20.702645+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702645+0000","last_undegraded":"2024-09-17T03:00:20.702645+0000","last_fullsized":"2024-09-17T03:00:20.702645+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712486+0000","last_change":"2024-09-17T03:00:20.712205+0000","last_active":"2024-09-17T03:00:20.712486+0000","last_peered":"2024-09-17T03:00:20.712486+0000","last_clean":"2024-09-17T03:00:20.712486+0000","last_became_active":"2024-09-17T03:00:20.711889+0000","last_became_peered":"2024-09-17T03:00:20.711889+0000","last_unstale":"2024-09-17T03:00:20.712486+0000","last_undegraded":"2024-09-17T03:00:20.712486+0000","last_fullsized":"2024-09-17T03:00:20.712486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:27.364433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708618+0000","last_change":"2024-09-17T03:00:20.708618+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708618+0000","last_undegraded":"2024-09-17T03:00:20.708618+0000","last_fullsized":"2024-09-17T03:00:20.708618+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712921+0000","last_change":"2024-09-17T03:00:20.712674+0000","last_active":"2024-09-17T03:00:20.712921+0000","last_peered":"2024-09-17T03:00:20.712921+0000","last_clean":"2024-09-17T03:00:20.712921+0000","last_became_active":"2024-09-17T03:00:20.712384+0000","last_became_peered":"2024-09-17T03:00:20.712384+0000","last_unstale":"2024-09-17T03:00:20.712921+0000","last_undegraded":"2024-09-17T03:00:20.712921+0000","last_fullsized":"2024-09-17T03:00:20.712921+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:34.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704049+0000","last_change":"2024-09-17T03:00:20.704049+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704049+0000","last_undegraded":"2024-09-17T03:00:20.704049+0000","last_fullsized":"2024-09-17T03:00:20.704049+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709856+0000","last_change":"2024-09-17T03:00:20.707138+0000","last_active":"2024-09-17T03:00:20.709856+0000","last_peered":"2024-09-17T03:00:20.709856+0000","last_clean":"2024-09-17T03:00:20.709856+0000","last_became_active":"2024-09-17T03:00:20.706724+0000","last_became_peered":"2024-09-17T03:00:20.706724+0000","last_unstale":"2024-09-17T03:00:20.709856+0000","last_undegraded":"2024-09-17T03:00:20.709856+0000","last_fullsized":"2024-09-17T03:00:20.709856+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:26.157803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707674+0000","last_change":"2024-09-17T03:00:20.707674+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707674+0000","last_undegraded":"2024-09-17T03:00:20.707674+0000","last_fullsized":"2024-09-17T03:00:20.707674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712834+0000","last_change":"2024-09-17T03:00:20.712055+0000","last_active":"2024-09-17T03:00:20.712834+0000","last_peered":"2024-09-17T03:00:20.712834+0000","last_clean":"2024-09-17T03:00:20.712834+0000","last_became_active":"2024-09-17T03:00:20.710950+0000","last_became_peered":"2024-09-17T03:00:20.710950+0000","last_unstale":"2024-09-17T03:00:20.712834+0000","last_undegraded":"2024-09-17T03:00:20.712834+0000","last_fullsized":"2024-09-17T03:00:20.712834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:00.876072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702809+0000","last_change":"2024-09-17T03:00:20.702809+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702809+0000","last_undegraded":"2024-09-17T03:00:20.702809+0000","last_fullsized":"2024-09-17T03:00:20.702809+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716106+0000","last_change":"2024-09-17T03:00:20.715877+0000","last_active":"2024-09-17T03:00:20.716106+0000","last_peered":"2024-09-17T03:00:20.716106+0000","last_clean":"2024-09-17T03:00:20.716106+0000","last_became_active":"2024-09-17T03:00:20.715603+0000","last_became_peered":"2024-09-17T03:00:20.715603+0000","last_unstale":"2024-09-17T03:00:20.716106+0000","last_undegraded":"2024-09-17T03:00:20.716106+0000","last_fullsized":"2024-09-17T03:00:20.716106+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:18.834772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704674+0000","last_change":"2024-09-17T03:00:20.704674+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704674+0000","last_undegraded":"2024-09-17T03:00:20.704674+0000","last_fullsized":"2024-09-17T03:00:20.704674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711397+0000","last_change":"2024-09-17T03:00:20.711135+0000","last_active":"2024-09-17T03:00:20.711397+0000","last_peered":"2024-09-17T03:00:20.711397+0000","last_clean":"2024-09-17T03:00:20.711397+0000","last_became_active":"2024-09-17T03:00:20.710383+0000","last_became_peered":"2024-09-17T03:00:20.710383+0000","last_unstale":"2024-09-17T03:00:20.711397+0000","last_undegraded":"2024-09-17T03:00:20.711397+0000","last_fullsized":"2024-09-17T03:00:20.711397+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:23.116065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704822+0000","last_change":"2024-09-17T03:00:20.704822+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704822+0000","last_undegraded":"2024-09-17T03:00:20.704822+0000","last_fullsized":"2024-09-17T03:00:20.704822+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710801+0000","last_change":"2024-09-17T03:00:20.710576+0000","last_active":"2024-09-17T03:00:20.710801+0000","last_peered":"2024-09-17T03:00:20.710801+0000","last_clean":"2024-09-17T03:00:20.710801+0000","last_became_active":"2024-09-17T03:00:20.710160+0000","last_became_peered":"2024-09-17T03:00:20.710160+0000","last_unstale":"2024-09-17T03:00:20.710801+0000","last_undegraded":"2024-09-17T03:00:20.710801+0000","last_fullsized":"2024-09-17T03:00:20.710801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:31.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703865+0000","last_change":"2024-09-17T03:00:20.703865+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703865+0000","last_undegraded":"2024-09-17T03:00:20.703865+0000","last_fullsized":"2024-09-17T03:00:20.703865+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711357+0000","last_change":"2024-09-17T03:00:20.710615+0000","last_active":"2024-09-17T03:00:20.711357+0000","last_peered":"2024-09-17T03:00:20.711357+0000","last_clean":"2024-09-17T03:00:20.711357+0000","last_became_active":"2024-09-17T03:00:20.710295+0000","last_became_peered":"2024-09-17T03:00:20.710295+0000","last_unstale":"2024-09-17T03:00:20.711357+0000","last_undegraded":"2024-09-17T03:00:20.711357+0000","last_fullsized":"2024-09-17T03:00:20.711357+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:12.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.713637+0000","last_change":"2024-09-17T03:00:20.713637+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.713637+0000","last_undegraded":"2024-09-17T03:00:20.713637+0000","last_fullsized":"2024-09-17T03:00:20.713637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712859+0000","last_change":"2024-09-17T03:00:20.712374+0000","last_active":"2024-09-17T03:00:20.712859+0000","last_peered":"2024-09-17T03:00:20.712859+0000","last_clean":"2024-09-17T03:00:20.712859+0000","last_became_active":"2024-09-17T03:00:20.711318+0000","last_became_peered":"2024-09-17T03:00:20.711318+0000","last_unstale":"2024-09-17T03:00:20.712859+0000","last_undegraded":"2024-09-17T03:00:20.712859+0000","last_fullsized":"2024-09-17T03:00:20.712859+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:27.300493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706423+0000","last_change":"2024-09-17T03:00:20.706423+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706423+0000","last_undegraded":"2024-09-17T03:00:20.706423+0000","last_fullsized":"2024-09-17T03:00:20.706423+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.715298+0000","last_change":"2024-09-17T03:00:20.714967+0000","last_active":"2024-09-17T03:00:20.715298+0000","last_peered":"2024-09-17T03:00:20.715298+0000","last_clean":"2024-09-17T03:00:20.715298+0000","last_became_active":"2024-09-17T03:00:20.710118+0000","last_became_peered":"2024-09-17T03:00:20.710118+0000","last_unstale":"2024-09-17T03:00:20.715298+0000","last_undegraded":"2024-09-17T03:00:20.715298+0000","last_fullsized":"2024-09-17T03:00:20.715298+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:53.483800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702243+0000","last_change":"2024-09-17T03:00:20.702243+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702243+0000","last_undegraded":"2024-09-17T03:00:20.702243+0000","last_fullsized":"2024-09-17T03:00:20.702243+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710919+0000","last_change":"2024-09-17T03:00:20.710692+0000","last_active":"2024-09-17T03:00:20.710919+0000","last_peered":"2024-09-17T03:00:20.710919+0000","last_clean":"2024-09-17T03:00:20.710919+0000","last_became_active":"2024-09-17T03:00:20.710092+0000","last_became_peered":"2024-09-17T03:00:20.710092+0000","last_unstale":"2024-09-17T03:00:20.710919+0000","last_undegraded":"2024-09-17T03:00:20.710919+0000","last_fullsized":"2024-09-17T03:00:20.710919+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:57.885988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702606+0000","last_change":"2024-09-17T03:00:20.702606+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702606+0000","last_undegraded":"2024-09-17T03:00:20.702606+0000","last_fullsized":"2024-09-17T03:00:20.702606+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.713846+0000","last_change":"2024-09-17T03:00:20.711935+0000","last_active":"2024-09-17T03:00:20.713846+0000","last_peered":"2024-09-17T03:00:20.713846+0000","last_clean":"2024-09-17T03:00:20.713846+0000","last_became_active":"2024-09-17T03:00:20.711593+0000","last_became_peered":"2024-09-17T03:00:20.711593+0000","last_unstale":"2024-09-17T03:00:20.713846+0000","last_undegraded":"2024-09-17T03:00:20.713846+0000","last_fullsized":"2024-09-17T03:00:20.713846+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:09.109660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702029+0000","last_change":"2024-09-17T03:00:20.702029+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702029+0000","last_undegraded":"2024-09-17T03:00:20.702029+0000","last_fullsized":"2024-09-17T03:00:20.702029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.717078+0000","last_change":"2024-09-17T03:00:20.716927+0000","last_active":"2024-09-17T03:00:20.717078+0000","last_peered":"2024-09-17T03:00:20.717078+0000","last_clean":"2024-09-17T03:00:20.717078+0000","last_became_active":"2024-09-17T03:00:20.716608+0000","last_became_peered":"2024-09-17T03:00:20.716608+0000","last_unstale":"2024-09-17T03:00:20.717078+0000","last_undegraded":"2024-09-17T03:00:20.717078+0000","last_fullsized":"2024-09-17T03:00:20.717078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:33.480653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707312+0000","last_change":"2024-09-17T03:00:20.707312+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707312+0000","last_undegraded":"2024-09-17T03:00:20.707312+0000","last_fullsized":"2024-09-17T03:00:20.707312+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709760+0000","last_change":"2024-09-17T03:00:20.709303+0000","last_active":"2024-09-17T03:00:20.709760+0000","last_peered":"2024-09-17T03:00:20.709760+0000","last_clean":"2024-09-17T03:00:20.709760+0000","last_became_active":"2024-09-17T03:00:20.709021+0000","last_became_peered":"2024-09-17T03:00:20.709021+0000","last_unstale":"2024-09-17T03:00:20.709760+0000","last_undegraded":"2024-09-17T03:00:20.709760+0000","last_fullsized":"2024-09-17T03:00:20.709760+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:54.955286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702546+0000","last_change":"2024-09-17T03:00:20.702546+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702546+0000","last_undegraded":"2024-09-17T03:00:20.702546+0000","last_fullsized":"2024-09-17T03:00:20.702546+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711392+0000","last_change":"2024-09-17T03:00:20.711202+0000","last_active":"2024-09-17T03:00:20.711392+0000","last_peered":"2024-09-17T03:00:20.711392+0000","last_clean":"2024-09-17T03:00:20.711392+0000","last_became_active":"2024-09-17T03:00:20.710535+0000","last_became_peered":"2024-09-17T03:00:20.710535+0000","last_unstale":"2024-09-17T03:00:20.711392+0000","last_undegraded":"2024-09-17T03:00:20.711392+0000","last_fullsized":"2024-09-17T03:00:20.711392+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.244482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.710074+0000","last_change":"2024-09-17T03:00:20.710074+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.710074+0000","last_undegraded":"2024-09-17T03:00:20.710074+0000","last_fullsized":"2024-09-17T03:00:20.710074+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.706938+0000","last_change":"2024-09-17T03:00:20.706322+0000","last_active":"2024-09-17T03:00:20.706938+0000","last_peered":"2024-09-17T03:00:20.706938+0000","last_clean":"2024-09-17T03:00:20.706938+0000","last_became_active":"2024-09-17T03:00:20.706045+0000","last_became_peered":"2024-09-17T03:00:20.706045+0000","last_unstale":"2024-09-17T03:00:20.706938+0000","last_undegraded":"2024-09-17T03:00:20.706938+0000","last_fullsized":"2024-09-17T03:00:20.706938+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:51.063485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":311,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.699015+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:20.699015+0000","last_peered":"2024-09-17T03:00:20.699015+0000","last_clean":"2024-09-17T03:00:20.699015+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:20.699015+0000","last_undegraded":"2024-09-17T03:00:20.699015+0000","last_fullsized":"2024-09-17T03:00:20.699015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194090,"statfs":{"total":200000000,"available":198748492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345135,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194090,"statfs":{"total":200000000,"available":198748492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:00:25.072 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:25.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.222+0000 7f9e0a750640 1 -- 172.21.15.104:0/1108977235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b6f70 msgr2=0x7f9e0415ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.222+0000 7f9e0a750640 1 --2- 172.21.15.104:0/1108977235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b6f70 0x7f9e0415ef90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009830 tx=0x7f9df402a530 comp rx=0 tx=0).stop 2024-09-17T03:00:25.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.222+0000 7f9e0a750640 1 -- 172.21.15.104:0/1108977235 shutdown_connections 2024-09-17T03:00:25.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.222+0000 7f9e0a750640 1 --2- 172.21.15.104:0/1108977235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b6f70 0x7f9e0415ef90 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.222+0000 7f9e0a750640 1 -- 172.21.15.104:0/1108977235 >> 172.21.15.104:0/1108977235 conn(0x7f9e04073df0 msgr2=0x7f9e04068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:25.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.222+0000 7f9e0a750640 1 -- 172.21.15.104:0/1108977235 shutdown_connections 2024-09-17T03:00:25.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.222+0000 7f9e0a750640 1 -- 172.21.15.104:0/1108977235 wait complete. 2024-09-17T03:00:25.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.224+0000 7f9e0a750640 1 Processor -- start 2024-09-17T03:00:25.224 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.224+0000 7f9e0a750640 1 -- start start 2024-09-17T03:00:25.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e0a750640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b3b00 0x7f9e041f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e0a750640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e040b6f70 0x7f9e04151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e0a750640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e040d18e0 0x7f9e040c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e0a750640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9e040d3fc0 con 0x7f9e040b3b00 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e0a750640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e040d3e40 con 0x7f9e040b6f70 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e0a750640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9e040d4140 con 0x7f9e040d18e0 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b3b00 0x7f9e041f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b3b00 0x7f9e041f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53088/0 (socket says 172.21.15.104:53088) 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 -- 172.21.15.104:0/2964939556 learned_addr learned my addr 172.21.15.104:0/2964939556 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e037fe640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e040b6f70 0x7f9e04151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e08ced640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e040d18e0 0x7f9e040c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 -- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e040d18e0 msgr2=0x7f9e040c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e040d18e0 0x7f9e040c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 -- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e040b6f70 msgr2=0x7f9e04151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e040b6f70 0x7f9e04151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 -- 172.21.15.104:0/2964939556 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e040cafd0 con 0x7f9e040b3b00 2024-09-17T03:00:25.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e08ced640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e040d18e0 0x7f9e040c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:25.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e037fe640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e040b6f70 0x7f9e04151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:25.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e03fff640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b3b00 0x7f9e041f6510 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9df402ab20 tx=0x7f9df4033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:25.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e00ff9640 1 -- 172.21.15.104:0/2964939556 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4031b60 con 0x7f9e040b3b00 2024-09-17T03:00:25.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e00ff9640 1 -- 172.21.15.104:0/2964939556 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9df4031df0 con 0x7f9e040b3b00 2024-09-17T03:00:25.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e040cb7b0 con 0x7f9e040b3b00 2024-09-17T03:00:25.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e00ff9640 1 -- 172.21.15.104:0/2964939556 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4005280 con 0x7f9e040b3b00 2024-09-17T03:00:25.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.226+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e041f6d20 con 0x7f9e040b3b00 2024-09-17T03:00:25.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.227+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e040d4630 con 0x7f9e040b3b00 2024-09-17T03:00:25.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.228+0000 7f9e00ff9640 1 -- 172.21.15.104:0/2964939556 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9df4005420 con 0x7f9e040b3b00 2024-09-17T03:00:25.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.228+0000 7f9e00ff9640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df0078b90 0x7f9df007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.229+0000 7f9e00ff9640 1 -- 172.21.15.104:0/2964939556 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f9df40bbfb0 con 0x7f9e040b3b00 2024-09-17T03:00:25.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.229+0000 7f9e037fe640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df0078b90 0x7f9df007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.229+0000 7f9e037fe640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df0078b90 0x7f9df007b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9df8000f60 tx=0x7f9df8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:25.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.233+0000 7f9e00ff9640 1 -- 172.21.15.104:0/2964939556 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9df403f030 con 0x7f9e040b3b00 2024-09-17T03:00:25.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.404+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e040d1370 con 0x7f9df0078b90 2024-09-17T03:00:25.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.408+0000 7f9e00ff9640 1 -- 172.21.15.104:0/2964939556 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242658 (secure 0 0 0) 0x7f9e040d1370 con 0x7f9df0078b90 2024-09-17T03:00:25.410 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:25.411 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:25.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df0078b90 msgr2=0x7f9df007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df0078b90 0x7f9df007b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9df8000f60 tx=0x7f9df8009040 comp rx=0 tx=0).stop 2024-09-17T03:00:25.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b3b00 msgr2=0x7f9e041f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b3b00 0x7f9e041f6510 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9df402ab20 tx=0x7f9df4033c10 comp rx=0 tx=0).stop 2024-09-17T03:00:25.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 shutdown_connections 2024-09-17T03:00:25.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df0078b90 0x7f9df007b0a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e040b6f70 0x7f9e04151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e040d18e0 0x7f9e040c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 --2- 172.21.15.104:0/2964939556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e040b3b00 0x7f9e041f6510 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 >> 172.21.15.104:0/2964939556 conn(0x7f9e04073df0 msgr2=0x7f9e040d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:25.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 shutdown_connections 2024-09-17T03:00:25.414 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.411+0000 7f9e0a750640 1 -- 172.21.15.104:0/2964939556 wait complete. 2024-09-17T03:00:25.422 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-17T03:00:23.705900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556187,"statfs":{"total":1600000000,"available":1593536419,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.012951"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707902+0000","last_change":"2024-09-17T03:00:20.707902+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707902+0000","last_undegraded":"2024-09-17T03:00:20.707902+0000","last_fullsized":"2024-09-17T03:00:20.707902+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704250+0000","last_change":"2024-09-17T03:00:20.704250+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704250+0000","last_undegraded":"2024-09-17T03:00:20.704250+0000","last_fullsized":"2024-09-17T03:00:20.704250+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708033+0000","last_change":"2024-09-17T03:00:20.708033+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708033+0000","last_undegraded":"2024-09-17T03:00:20.708033+0000","last_fullsized":"2024-09-17T03:00:20.708033+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705954+0000","last_change":"2024-09-17T03:00:20.705954+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705954+0000","last_undegraded":"2024-09-17T03:00:20.705954+0000","last_fullsized":"2024-09-17T03:00:20.705954+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708578+0000","last_change":"2024-09-17T03:00:20.708578+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708578+0000","last_undegraded":"2024-09-17T03:00:20.708578+0000","last_fullsized":"2024-09-17T03:00:20.708578+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708198+0000","last_change":"2024-09-17T03:00:20.708198+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708198+0000","last_undegraded":"2024-09-17T03:00:20.708198+0000","last_fullsized":"2024-09-17T03:00:20.708198+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704558+0000","last_change":"2024-09-17T03:00:20.704558+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704558+0000","last_undegraded":"2024-09-17T03:00:20.704558+0000","last_fullsized":"2024-09-17T03:00:20.704558+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704854+0000","last_change":"2024-09-17T03:00:20.704854+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704854+0000","last_undegraded":"2024-09-17T03:00:20.704854+0000","last_fullsized":"2024-09-17T03:00:20.704854+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703508+0000","last_change":"2024-09-17T03:00:20.703508+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703508+0000","last_undegraded":"2024-09-17T03:00:20.703508+0000","last_fullsized":"2024-09-17T03:00:20.703508+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707293+0000","last_change":"2024-09-17T03:00:20.707293+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707293+0000","last_undegraded":"2024-09-17T03:00:20.707293+0000","last_fullsized":"2024-09-17T03:00:20.707293+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706662+0000","last_change":"2024-09-17T03:00:20.706662+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706662+0000","last_undegraded":"2024-09-17T03:00:20.706662+0000","last_fullsized":"2024-09-17T03:00:20.706662+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703939+0000","last_change":"2024-09-17T03:00:20.703939+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703939+0000","last_undegraded":"2024-09-17T03:00:20.703939+0000","last_fullsized":"2024-09-17T03:00:20.703939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705526+0000","last_change":"2024-09-17T03:00:20.705526+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705526+0000","last_undegraded":"2024-09-17T03:00:20.705526+0000","last_fullsized":"2024-09-17T03:00:20.705526+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708723+0000","last_change":"2024-09-17T03:00:20.708723+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708723+0000","last_undegraded":"2024-09-17T03:00:20.708723+0000","last_fullsized":"2024-09-17T03:00:20.708723+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704101+0000","last_change":"2024-09-17T03:00:20.704101+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704101+0000","last_undegraded":"2024-09-17T03:00:20.704101+0000","last_fullsized":"2024-09-17T03:00:20.704101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704585+0000","last_change":"2024-09-17T03:00:20.704585+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704585+0000","last_undegraded":"2024-09-17T03:00:20.704585+0000","last_fullsized":"2024-09-17T03:00:20.704585+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703938+0000","last_change":"2024-09-17T03:00:20.703938+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703938+0000","last_undegraded":"2024-09-17T03:00:20.703938+0000","last_fullsized":"2024-09-17T03:00:20.703938+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703715+0000","last_change":"2024-09-17T03:00:20.703715+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703715+0000","last_undegraded":"2024-09-17T03:00:20.703715+0000","last_fullsized":"2024-09-17T03:00:20.703715+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708386+0000","last_change":"2024-09-17T03:00:20.708386+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708386+0000","last_undegraded":"2024-09-17T03:00:20.708386+0000","last_fullsized":"2024-09-17T03:00:20.708386+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702974+0000","last_change":"2024-09-17T03:00:20.702974+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702974+0000","last_undegraded":"2024-09-17T03:00:20.702974+0000","last_fullsized":"2024-09-17T03:00:20.702974+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705029+0000","last_change":"2024-09-17T03:00:20.705029+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705029+0000","last_undegraded":"2024-09-17T03:00:20.705029+0000","last_fullsized":"2024-09-17T03:00:20.705029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703645+0000","last_change":"2024-09-17T03:00:20.703645+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703645+0000","last_undegraded":"2024-09-17T03:00:20.703645+0000","last_fullsized":"2024-09-17T03:00:20.703645+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704205+0000","last_change":"2024-09-17T03:00:20.704205+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704205+0000","last_undegraded":"2024-09-17T03:00:20.704205+0000","last_fullsized":"2024-09-17T03:00:20.704205+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703787+0000","last_change":"2024-09-17T03:00:20.703787+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703787+0000","last_undegraded":"2024-09-17T03:00:20.703787+0000","last_fullsized":"2024-09-17T03:00:20.703787+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706900+0000","last_change":"2024-09-17T03:00:20.706900+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706900+0000","last_undegraded":"2024-09-17T03:00:20.706900+0000","last_fullsized":"2024-09-17T03:00:20.706900+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703793+0000","last_change":"2024-09-17T03:00:20.703793+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703793+0000","last_undegraded":"2024-09-17T03:00:20.703793+0000","last_fullsized":"2024-09-17T03:00:20.703793+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703939+0000","last_change":"2024-09-17T03:00:20.703939+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703939+0000","last_undegraded":"2024-09-17T03:00:20.703939+0000","last_fullsized":"2024-09-17T03:00:20.703939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702095+0000","last_change":"2024-09-17T03:00:20.702095+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702095+0000","last_undegraded":"2024-09-17T03:00:20.702095+0000","last_fullsized":"2024-09-17T03:00:20.702095+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703340+0000","last_change":"2024-09-17T03:00:20.703340+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703340+0000","last_undegraded":"2024-09-17T03:00:20.703340+0000","last_fullsized":"2024-09-17T03:00:20.703340+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.710426+0000","last_change":"2024-09-17T03:00:20.710426+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.710426+0000","last_undegraded":"2024-09-17T03:00:20.710426+0000","last_fullsized":"2024-09-17T03:00:20.710426+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705430+0000","last_change":"2024-09-17T03:00:20.705430+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705430+0000","last_undegraded":"2024-09-17T03:00:20.705430+0000","last_fullsized":"2024-09-17T03:00:20.705430+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.714003+0000","last_change":"2024-09-17T03:00:20.714003+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.714003+0000","last_undegraded":"2024-09-17T03:00:20.714003+0000","last_fullsized":"2024-09-17T03:00:20.714003+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708016+0000","last_change":"2024-09-17T03:00:20.708016+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708016+0000","last_undegraded":"2024-09-17T03:00:20.708016+0000","last_fullsized":"2024-09-17T03:00:20.708016+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.713185+0000","last_change":"2024-09-17T03:00:20.712953+0000","last_active":"2024-09-17T03:00:20.713185+0000","last_peered":"2024-09-17T03:00:20.713185+0000","last_clean":"2024-09-17T03:00:20.713185+0000","last_became_active":"2024-09-17T03:00:20.711675+0000","last_became_peered":"2024-09-17T03:00:20.711675+0000","last_unstale":"2024-09-17T03:00:20.713185+0000","last_undegraded":"2024-09-17T03:00:20.713185+0000","last_fullsized":"2024-09-17T03:00:20.713185+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:59.207345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703274+0000","last_change":"2024-09-17T03:00:20.703274+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703274+0000","last_undegraded":"2024-09-17T03:00:20.703274+0000","last_fullsized":"2024-09-17T03:00:20.703274+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.708711+0000","last_change":"2024-09-17T03:00:20.708495+0000","last_active":"2024-09-17T03:00:20.708711+0000","last_peered":"2024-09-17T03:00:20.708711+0000","last_clean":"2024-09-17T03:00:20.708711+0000","last_became_active":"2024-09-17T03:00:20.708193+0000","last_became_peered":"2024-09-17T03:00:20.708193+0000","last_unstale":"2024-09-17T03:00:20.708711+0000","last_undegraded":"2024-09-17T03:00:20.708711+0000","last_fullsized":"2024-09-17T03:00:20.708711+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:41.910157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706575+0000","last_change":"2024-09-17T03:00:20.706575+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706575+0000","last_undegraded":"2024-09-17T03:00:20.706575+0000","last_fullsized":"2024-09-17T03:00:20.706575+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712883+0000","last_change":"2024-09-17T03:00:20.712435+0000","last_active":"2024-09-17T03:00:20.712883+0000","last_peered":"2024-09-17T03:00:20.712883+0000","last_clean":"2024-09-17T03:00:20.712883+0000","last_became_active":"2024-09-17T03:00:20.712152+0000","last_became_peered":"2024-09-17T03:00:20.712152+0000","last_unstale":"2024-09-17T03:00:20.712883+0000","last_undegraded":"2024-09-17T03:00:20.712883+0000","last_fullsized":"2024-09-17T03:00:20.712883+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:09.544663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702555+0000","last_change":"2024-09-17T03:00:20.702555+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702555+0000","last_undegraded":"2024-09-17T03:00:20.702555+0000","last_fullsized":"2024-09-17T03:00:20.702555+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709825+0000","last_change":"2024-09-17T03:00:20.706619+0000","last_active":"2024-09-17T03:00:20.709825+0000","last_peered":"2024-09-17T03:00:20.709825+0000","last_clean":"2024-09-17T03:00:20.709825+0000","last_became_active":"2024-09-17T03:00:20.706294+0000","last_became_peered":"2024-09-17T03:00:20.706294+0000","last_unstale":"2024-09-17T03:00:20.709825+0000","last_undegraded":"2024-09-17T03:00:20.709825+0000","last_fullsized":"2024-09-17T03:00:20.709825+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:25.963999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707968+0000","last_change":"2024-09-17T03:00:20.707968+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707968+0000","last_undegraded":"2024-09-17T03:00:20.707968+0000","last_fullsized":"2024-09-17T03:00:20.707968+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.717170+0000","last_change":"2024-09-17T03:00:20.716966+0000","last_active":"2024-09-17T03:00:20.717170+0000","last_peered":"2024-09-17T03:00:20.717170+0000","last_clean":"2024-09-17T03:00:20.717170+0000","last_became_active":"2024-09-17T03:00:20.716681+0000","last_became_peered":"2024-09-17T03:00:20.716681+0000","last_unstale":"2024-09-17T03:00:20.717170+0000","last_undegraded":"2024-09-17T03:00:20.717170+0000","last_fullsized":"2024-09-17T03:00:20.717170+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:22.125483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703049+0000","last_change":"2024-09-17T03:00:20.703049+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703049+0000","last_undegraded":"2024-09-17T03:00:20.703049+0000","last_fullsized":"2024-09-17T03:00:20.703049+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710665+0000","last_change":"2024-09-17T03:00:20.709805+0000","last_active":"2024-09-17T03:00:20.710665+0000","last_peered":"2024-09-17T03:00:20.710665+0000","last_clean":"2024-09-17T03:00:20.710665+0000","last_became_active":"2024-09-17T03:00:20.709291+0000","last_became_peered":"2024-09-17T03:00:20.709291+0000","last_unstale":"2024-09-17T03:00:20.710665+0000","last_undegraded":"2024-09-17T03:00:20.710665+0000","last_fullsized":"2024-09-17T03:00:20.710665+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:51.369575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702850+0000","last_change":"2024-09-17T03:00:20.702850+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702850+0000","last_undegraded":"2024-09-17T03:00:20.702850+0000","last_fullsized":"2024-09-17T03:00:20.702850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716535+0000","last_change":"2024-09-17T03:00:20.716327+0000","last_active":"2024-09-17T03:00:20.716535+0000","last_peered":"2024-09-17T03:00:20.716535+0000","last_clean":"2024-09-17T03:00:20.716535+0000","last_became_active":"2024-09-17T03:00:20.716045+0000","last_became_peered":"2024-09-17T03:00:20.716045+0000","last_unstale":"2024-09-17T03:00:20.716535+0000","last_undegraded":"2024-09-17T03:00:20.716535+0000","last_fullsized":"2024-09-17T03:00:20.716535+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:04.957426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702547+0000","last_change":"2024-09-17T03:00:20.702547+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702547+0000","last_undegraded":"2024-09-17T03:00:20.702547+0000","last_fullsized":"2024-09-17T03:00:20.702547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.714735+0000","last_change":"2024-09-17T03:00:20.714525+0000","last_active":"2024-09-17T03:00:20.714735+0000","last_peered":"2024-09-17T03:00:20.714735+0000","last_clean":"2024-09-17T03:00:20.714735+0000","last_became_active":"2024-09-17T03:00:20.714180+0000","last_became_peered":"2024-09-17T03:00:20.714180+0000","last_unstale":"2024-09-17T03:00:20.714735+0000","last_undegraded":"2024-09-17T03:00:20.714735+0000","last_fullsized":"2024-09-17T03:00:20.714735+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:11.032307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703270+0000","last_change":"2024-09-17T03:00:20.703270+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703270+0000","last_undegraded":"2024-09-17T03:00:20.703270+0000","last_fullsized":"2024-09-17T03:00:20.703270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716275+0000","last_change":"2024-09-17T03:00:20.716045+0000","last_active":"2024-09-17T03:00:20.716275+0000","last_peered":"2024-09-17T03:00:20.716275+0000","last_clean":"2024-09-17T03:00:20.716275+0000","last_became_active":"2024-09-17T03:00:20.715454+0000","last_became_peered":"2024-09-17T03:00:20.715454+0000","last_unstale":"2024-09-17T03:00:20.716275+0000","last_undegraded":"2024-09-17T03:00:20.716275+0000","last_fullsized":"2024-09-17T03:00:20.716275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:22.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702481+0000","last_change":"2024-09-17T03:00:20.702481+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702481+0000","last_undegraded":"2024-09-17T03:00:20.702481+0000","last_fullsized":"2024-09-17T03:00:20.702481+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.708732+0000","last_change":"2024-09-17T03:00:20.707140+0000","last_active":"2024-09-17T03:00:20.708732+0000","last_peered":"2024-09-17T03:00:20.708732+0000","last_clean":"2024-09-17T03:00:20.708732+0000","last_became_active":"2024-09-17T03:00:20.706883+0000","last_became_peered":"2024-09-17T03:00:20.706883+0000","last_unstale":"2024-09-17T03:00:20.708732+0000","last_undegraded":"2024-09-17T03:00:20.708732+0000","last_fullsized":"2024-09-17T03:00:20.708732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:32.842810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703041+0000","last_change":"2024-09-17T03:00:20.703041+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703041+0000","last_undegraded":"2024-09-17T03:00:20.703041+0000","last_fullsized":"2024-09-17T03:00:20.703041+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.704945+0000","last_change":"2024-09-17T03:00:20.704627+0000","last_active":"2024-09-17T03:00:20.704945+0000","last_peered":"2024-09-17T03:00:20.704945+0000","last_clean":"2024-09-17T03:00:20.704945+0000","last_became_active":"2024-09-17T03:00:20.704288+0000","last_became_peered":"2024-09-17T03:00:20.704288+0000","last_unstale":"2024-09-17T03:00:20.704945+0000","last_undegraded":"2024-09-17T03:00:20.704945+0000","last_fullsized":"2024-09-17T03:00:20.704945+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:04.769154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703560+0000","last_change":"2024-09-17T03:00:20.703560+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703560+0000","last_undegraded":"2024-09-17T03:00:20.703560+0000","last_fullsized":"2024-09-17T03:00:20.703560+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.707000+0000","last_change":"2024-09-17T03:00:20.706770+0000","last_active":"2024-09-17T03:00:20.707000+0000","last_peered":"2024-09-17T03:00:20.707000+0000","last_clean":"2024-09-17T03:00:20.707000+0000","last_became_active":"2024-09-17T03:00:20.706322+0000","last_became_peered":"2024-09-17T03:00:20.706322+0000","last_unstale":"2024-09-17T03:00:20.707000+0000","last_undegraded":"2024-09-17T03:00:20.707000+0000","last_fullsized":"2024-09-17T03:00:20.707000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:48.537480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704712+0000","last_change":"2024-09-17T03:00:20.704712+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704712+0000","last_undegraded":"2024-09-17T03:00:20.704712+0000","last_fullsized":"2024-09-17T03:00:20.704712+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.714959+0000","last_change":"2024-09-17T03:00:20.714692+0000","last_active":"2024-09-17T03:00:20.714959+0000","last_peered":"2024-09-17T03:00:20.714959+0000","last_clean":"2024-09-17T03:00:20.714959+0000","last_became_active":"2024-09-17T03:00:20.713971+0000","last_became_peered":"2024-09-17T03:00:20.713971+0000","last_unstale":"2024-09-17T03:00:20.714959+0000","last_undegraded":"2024-09-17T03:00:20.714959+0000","last_fullsized":"2024-09-17T03:00:20.714959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:46.645734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706815+0000","last_change":"2024-09-17T03:00:20.706815+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706815+0000","last_undegraded":"2024-09-17T03:00:20.706815+0000","last_fullsized":"2024-09-17T03:00:20.706815+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710421+0000","last_change":"2024-09-17T03:00:20.710168+0000","last_active":"2024-09-17T03:00:20.710421+0000","last_peered":"2024-09-17T03:00:20.710421+0000","last_clean":"2024-09-17T03:00:20.710421+0000","last_became_active":"2024-09-17T03:00:20.709908+0000","last_became_peered":"2024-09-17T03:00:20.709908+0000","last_unstale":"2024-09-17T03:00:20.710421+0000","last_undegraded":"2024-09-17T03:00:20.710421+0000","last_fullsized":"2024-09-17T03:00:20.710421+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:09.474996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703461+0000","last_change":"2024-09-17T03:00:20.703461+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703461+0000","last_undegraded":"2024-09-17T03:00:20.703461+0000","last_fullsized":"2024-09-17T03:00:20.703461+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711241+0000","last_change":"2024-09-17T03:00:20.710421+0000","last_active":"2024-09-17T03:00:20.711241+0000","last_peered":"2024-09-17T03:00:20.711241+0000","last_clean":"2024-09-17T03:00:20.711241+0000","last_became_active":"2024-09-17T03:00:20.710135+0000","last_became_peered":"2024-09-17T03:00:20.710135+0000","last_unstale":"2024-09-17T03:00:20.711241+0000","last_undegraded":"2024-09-17T03:00:20.711241+0000","last_fullsized":"2024-09-17T03:00:20.711241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:55.620059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703041+0000","last_change":"2024-09-17T03:00:20.703041+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703041+0000","last_undegraded":"2024-09-17T03:00:20.703041+0000","last_fullsized":"2024-09-17T03:00:20.703041+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716975+0000","last_change":"2024-09-17T03:00:20.716746+0000","last_active":"2024-09-17T03:00:20.716975+0000","last_peered":"2024-09-17T03:00:20.716975+0000","last_clean":"2024-09-17T03:00:20.716975+0000","last_became_active":"2024-09-17T03:00:20.716463+0000","last_became_peered":"2024-09-17T03:00:20.716463+0000","last_unstale":"2024-09-17T03:00:20.716975+0000","last_undegraded":"2024-09-17T03:00:20.716975+0000","last_fullsized":"2024-09-17T03:00:20.716975+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:48.954013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702645+0000","last_change":"2024-09-17T03:00:20.702645+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702645+0000","last_undegraded":"2024-09-17T03:00:20.702645+0000","last_fullsized":"2024-09-17T03:00:20.702645+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712486+0000","last_change":"2024-09-17T03:00:20.712205+0000","last_active":"2024-09-17T03:00:20.712486+0000","last_peered":"2024-09-17T03:00:20.712486+0000","last_clean":"2024-09-17T03:00:20.712486+0000","last_became_active":"2024-09-17T03:00:20.711889+0000","last_became_peered":"2024-09-17T03:00:20.711889+0000","last_unstale":"2024-09-17T03:00:20.712486+0000","last_undegraded":"2024-09-17T03:00:20.712486+0000","last_fullsized":"2024-09-17T03:00:20.712486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:27.364433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708618+0000","last_change":"2024-09-17T03:00:20.708618+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708618+0000","last_undegraded":"2024-09-17T03:00:20.708618+0000","last_fullsized":"2024-09-17T03:00:20.708618+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712921+0000","last_change":"2024-09-17T03:00:20.712674+0000","last_active":"2024-09-17T03:00:20.712921+0000","last_peered":"2024-09-17T03:00:20.712921+0000","last_clean":"2024-09-17T03:00:20.712921+0000","last_became_active":"2024-09-17T03:00:20.712384+0000","last_became_peered":"2024-09-17T03:00:20.712384+0000","last_unstale":"2024-09-17T03:00:20.712921+0000","last_undegraded":"2024-09-17T03:00:20.712921+0000","last_fullsized":"2024-09-17T03:00:20.712921+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:34.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704049+0000","last_change":"2024-09-17T03:00:20.704049+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704049+0000","last_undegraded":"2024-09-17T03:00:20.704049+0000","last_fullsized":"2024-09-17T03:00:20.704049+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709856+0000","last_change":"2024-09-17T03:00:20.707138+0000","last_active":"2024-09-17T03:00:20.709856+0000","last_peered":"2024-09-17T03:00:20.709856+0000","last_clean":"2024-09-17T03:00:20.709856+0000","last_became_active":"2024-09-17T03:00:20.706724+0000","last_became_peered":"2024-09-17T03:00:20.706724+0000","last_unstale":"2024-09-17T03:00:20.709856+0000","last_undegraded":"2024-09-17T03:00:20.709856+0000","last_fullsized":"2024-09-17T03:00:20.709856+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:26.157803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707674+0000","last_change":"2024-09-17T03:00:20.707674+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707674+0000","last_undegraded":"2024-09-17T03:00:20.707674+0000","last_fullsized":"2024-09-17T03:00:20.707674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712834+0000","last_change":"2024-09-17T03:00:20.712055+0000","last_active":"2024-09-17T03:00:20.712834+0000","last_peered":"2024-09-17T03:00:20.712834+0000","last_clean":"2024-09-17T03:00:20.712834+0000","last_became_active":"2024-09-17T03:00:20.710950+0000","last_became_peered":"2024-09-17T03:00:20.710950+0000","last_unstale":"2024-09-17T03:00:20.712834+0000","last_undegraded":"2024-09-17T03:00:20.712834+0000","last_fullsized":"2024-09-17T03:00:20.712834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:00.876072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702809+0000","last_change":"2024-09-17T03:00:20.702809+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702809+0000","last_undegraded":"2024-09-17T03:00:20.702809+0000","last_fullsized":"2024-09-17T03:00:20.702809+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716106+0000","last_change":"2024-09-17T03:00:20.715877+0000","last_active":"2024-09-17T03:00:20.716106+0000","last_peered":"2024-09-17T03:00:20.716106+0000","last_clean":"2024-09-17T03:00:20.716106+0000","last_became_active":"2024-09-17T03:00:20.715603+0000","last_became_peered":"2024-09-17T03:00:20.715603+0000","last_unstale":"2024-09-17T03:00:20.716106+0000","last_undegraded":"2024-09-17T03:00:20.716106+0000","last_fullsized":"2024-09-17T03:00:20.716106+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:18.834772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704674+0000","last_change":"2024-09-17T03:00:20.704674+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704674+0000","last_undegraded":"2024-09-17T03:00:20.704674+0000","last_fullsized":"2024-09-17T03:00:20.704674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711397+0000","last_change":"2024-09-17T03:00:20.711135+0000","last_active":"2024-09-17T03:00:20.711397+0000","last_peered":"2024-09-17T03:00:20.711397+0000","last_clean":"2024-09-17T03:00:20.711397+0000","last_became_active":"2024-09-17T03:00:20.710383+0000","last_became_peered":"2024-09-17T03:00:20.710383+0000","last_unstale":"2024-09-17T03:00:20.711397+0000","last_undegraded":"2024-09-17T03:00:20.711397+0000","last_fullsized":"2024-09-17T03:00:20.711397+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:23.116065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704822+0000","last_change":"2024-09-17T03:00:20.704822+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704822+0000","last_undegraded":"2024-09-17T03:00:20.704822+0000","last_fullsized":"2024-09-17T03:00:20.704822+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710801+0000","last_change":"2024-09-17T03:00:20.710576+0000","last_active":"2024-09-17T03:00:20.710801+0000","last_peered":"2024-09-17T03:00:20.710801+0000","last_clean":"2024-09-17T03:00:20.710801+0000","last_became_active":"2024-09-17T03:00:20.710160+0000","last_became_peered":"2024-09-17T03:00:20.710160+0000","last_unstale":"2024-09-17T03:00:20.710801+0000","last_undegraded":"2024-09-17T03:00:20.710801+0000","last_fullsized":"2024-09-17T03:00:20.710801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:31.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703865+0000","last_change":"2024-09-17T03:00:20.703865+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703865+0000","last_undegraded":"2024-09-17T03:00:20.703865+0000","last_fullsized":"2024-09-17T03:00:20.703865+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711357+0000","last_change":"2024-09-17T03:00:20.710615+0000","last_active":"2024-09-17T03:00:20.711357+0000","last_peered":"2024-09-17T03:00:20.711357+0000","last_clean":"2024-09-17T03:00:20.711357+0000","last_became_active":"2024-09-17T03:00:20.710295+0000","last_became_peered":"2024-09-17T03:00:20.710295+0000","last_unstale":"2024-09-17T03:00:20.711357+0000","last_undegraded":"2024-09-17T03:00:20.711357+0000","last_fullsized":"2024-09-17T03:00:20.711357+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:12.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.713637+0000","last_change":"2024-09-17T03:00:20.713637+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.713637+0000","last_undegraded":"2024-09-17T03:00:20.713637+0000","last_fullsized":"2024-09-17T03:00:20.713637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712859+0000","last_change":"2024-09-17T03:00:20.712374+0000","last_active":"2024-09-17T03:00:20.712859+0000","last_peered":"2024-09-17T03:00:20.712859+0000","last_clean":"2024-09-17T03:00:20.712859+0000","last_became_active":"2024-09-17T03:00:20.711318+0000","last_became_peered":"2024-09-17T03:00:20.711318+0000","last_unstale":"2024-09-17T03:00:20.712859+0000","last_undegraded":"2024-09-17T03:00:20.712859+0000","last_fullsized":"2024-09-17T03:00:20.712859+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:27.300493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706423+0000","last_change":"2024-09-17T03:00:20.706423+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706423+0000","last_undegraded":"2024-09-17T03:00:20.706423+0000","last_fullsized":"2024-09-17T03:00:20.706423+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.715298+0000","last_change":"2024-09-17T03:00:20.714967+0000","last_active":"2024-09-17T03:00:20.715298+0000","last_peered":"2024-09-17T03:00:20.715298+0000","last_clean":"2024-09-17T03:00:20.715298+0000","last_became_active":"2024-09-17T03:00:20.710118+0000","last_became_peered":"2024-09-17T03:00:20.710118+0000","last_unstale":"2024-09-17T03:00:20.715298+0000","last_undegraded":"2024-09-17T03:00:20.715298+0000","last_fullsized":"2024-09-17T03:00:20.715298+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:53.483800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702243+0000","last_change":"2024-09-17T03:00:20.702243+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702243+0000","last_undegraded":"2024-09-17T03:00:20.702243+0000","last_fullsized":"2024-09-17T03:00:20.702243+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710919+0000","last_change":"2024-09-17T03:00:20.710692+0000","last_active":"2024-09-17T03:00:20.710919+0000","last_peered":"2024-09-17T03:00:20.710919+0000","last_clean":"2024-09-17T03:00:20.710919+0000","last_became_active":"2024-09-17T03:00:20.710092+0000","last_became_peered":"2024-09-17T03:00:20.710092+0000","last_unstale":"2024-09-17T03:00:20.710919+0000","last_undegraded":"2024-09-17T03:00:20.710919+0000","last_fullsized":"2024-09-17T03:00:20.710919+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:57.885988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702606+0000","last_change":"2024-09-17T03:00:20.702606+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702606+0000","last_undegraded":"2024-09-17T03:00:20.702606+0000","last_fullsized":"2024-09-17T03:00:20.702606+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.713846+0000","last_change":"2024-09-17T03:00:20.711935+0000","last_active":"2024-09-17T03:00:20.713846+0000","last_peered":"2024-09-17T03:00:20.713846+0000","last_clean":"2024-09-17T03:00:20.713846+0000","last_became_active":"2024-09-17T03:00:20.711593+0000","last_became_peered":"2024-09-17T03:00:20.711593+0000","last_unstale":"2024-09-17T03:00:20.713846+0000","last_undegraded":"2024-09-17T03:00:20.713846+0000","last_fullsized":"2024-09-17T03:00:20.713846+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:09.109660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702029+0000","last_change":"2024-09-17T03:00:20.702029+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702029+0000","last_undegraded":"2024-09-17T03:00:20.702029+0000","last_fullsized":"2024-09-17T03:00:20.702029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.717078+0000","last_change":"2024-09-17T03:00:20.716927+0000","last_active":"2024-09-17T03:00:20.717078+0000","last_peered":"2024-09-17T03:00:20.717078+0000","last_clean":"2024-09-17T03:00:20.717078+0000","last_became_active":"2024-09-17T03:00:20.716608+0000","last_became_peered":"2024-09-17T03:00:20.716608+0000","last_unstale":"2024-09-17T03:00:20.717078+0000","last_undegraded":"2024-09-17T03:00:20.717078+0000","last_fullsized":"2024-09-17T03:00:20.717078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:33.480653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707312+0000","last_change":"2024-09-17T03:00:20.707312+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707312+0000","last_undegraded":"2024-09-17T03:00:20.707312+0000","last_fullsized":"2024-09-17T03:00:20.707312+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709760+0000","last_change":"2024-09-17T03:00:20.709303+0000","last_active":"2024-09-17T03:00:20.709760+0000","last_peered":"2024-09-17T03:00:20.709760+0000","last_clean":"2024-09-17T03:00:20.709760+0000","last_became_active":"2024-09-17T03:00:20.709021+0000","last_became_peered":"2024-09-17T03:00:20.709021+0000","last_unstale":"2024-09-17T03:00:20.709760+0000","last_undegraded":"2024-09-17T03:00:20.709760+0000","last_fullsized":"2024-09-17T03:00:20.709760+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:54.955286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702546+0000","last_change":"2024-09-17T03:00:20.702546+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702546+0000","last_undegraded":"2024-09-17T03:00:20.702546+0000","last_fullsized":"2024-09-17T03:00:20.702546+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711392+0000","last_change":"2024-09-17T03:00:20.711202+0000","last_active":"2024-09-17T03:00:20.711392+0000","last_peered":"2024-09-17T03:00:20.711392+0000","last_clean":"2024-09-17T03:00:20.711392+0000","last_became_active":"2024-09-17T03:00:20.710535+0000","last_became_peered":"2024-09-17T03:00:20.710535+0000","last_unstale":"2024-09-17T03:00:20.711392+0000","last_undegraded":"2024-09-17T03:00:20.711392+0000","last_fullsized":"2024-09-17T03:00:20.711392+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.244482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.710074+0000","last_change":"2024-09-17T03:00:20.710074+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.710074+0000","last_undegraded":"2024-09-17T03:00:20.710074+0000","last_fullsized":"2024-09-17T03:00:20.710074+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.706938+0000","last_change":"2024-09-17T03:00:20.706322+0000","last_active":"2024-09-17T03:00:20.706938+0000","last_peered":"2024-09-17T03:00:20.706938+0000","last_clean":"2024-09-17T03:00:20.706938+0000","last_became_active":"2024-09-17T03:00:20.706045+0000","last_became_peered":"2024-09-17T03:00:20.706045+0000","last_unstale":"2024-09-17T03:00:20.706938+0000","last_undegraded":"2024-09-17T03:00:20.706938+0000","last_fullsized":"2024-09-17T03:00:20.706938+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:51.063485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":311,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.699015+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:20.699015+0000","last_peered":"2024-09-17T03:00:20.699015+0000","last_clean":"2024-09-17T03:00:20.699015+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:20.699015+0000","last_undegraded":"2024-09-17T03:00:20.699015+0000","last_fullsized":"2024-09-17T03:00:20.699015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194090,"statfs":{"total":200000000,"available":198748492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345135,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194090,"statfs":{"total":200000000,"available":198748492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:00:25.426 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3f is not active+clean 2024-09-17T03:00:25.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.707902+0000', 'last_change': '2024-09-17T03:00:20.707902+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.707902+0000', 'last_undegraded': '2024-09-17T03:00:20.707902+0000', 'last_fullsized': '2024-09-17T03:00:20.707902+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:00:25.426 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3e is not active+clean 2024-09-17T03:00:25.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704250+0000', 'last_change': '2024-09-17T03:00:20.704250+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704250+0000', 'last_undegraded': '2024-09-17T03:00:20.704250+0000', 'last_fullsized': '2024-09-17T03:00:20.704250+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.426 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3d is not active+clean 2024-09-17T03:00:25.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.708033+0000', 'last_change': '2024-09-17T03:00:20.708033+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.708033+0000', 'last_undegraded': '2024-09-17T03:00:20.708033+0000', 'last_fullsized': '2024-09-17T03:00:20.708033+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:00:25.426 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3c is not active+clean 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.705954+0000', 'last_change': '2024-09-17T03:00:20.705954+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.705954+0000', 'last_undegraded': '2024-09-17T03:00:20.705954+0000', 'last_fullsized': '2024-09-17T03:00:20.705954+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3b is not active+clean 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.708578+0000', 'last_change': '2024-09-17T03:00:20.708578+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.708578+0000', 'last_undegraded': '2024-09-17T03:00:20.708578+0000', 'last_fullsized': '2024-09-17T03:00:20.708578+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3a is not active+clean 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.708198+0000', 'last_change': '2024-09-17T03:00:20.708198+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.708198+0000', 'last_undegraded': '2024-09-17T03:00:20.708198+0000', 'last_fullsized': '2024-09-17T03:00:20.708198+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:PG 15.39 is not active+clean 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704558+0000', 'last_change': '2024-09-17T03:00:20.704558+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704558+0000', 'last_undegraded': '2024-09-17T03:00:20.704558+0000', 'last_fullsized': '2024-09-17T03:00:20.704558+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:PG 15.38 is not active+clean 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704854+0000', 'last_change': '2024-09-17T03:00:20.704854+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704854+0000', 'last_undegraded': '2024-09-17T03:00:20.704854+0000', 'last_fullsized': '2024-09-17T03:00:20.704854+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:PG 15.37 is not active+clean 2024-09-17T03:00:25.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703508+0000', 'last_change': '2024-09-17T03:00:20.703508+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703508+0000', 'last_undegraded': '2024-09-17T03:00:20.703508+0000', 'last_fullsized': '2024-09-17T03:00:20.703508+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:PG 15.36 is not active+clean 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.707293+0000', 'last_change': '2024-09-17T03:00:20.707293+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.707293+0000', 'last_undegraded': '2024-09-17T03:00:20.707293+0000', 'last_fullsized': '2024-09-17T03:00:20.707293+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:PG 15.35 is not active+clean 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.706662+0000', 'last_change': '2024-09-17T03:00:20.706662+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.706662+0000', 'last_undegraded': '2024-09-17T03:00:20.706662+0000', 'last_fullsized': '2024-09-17T03:00:20.706662+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:PG 15.34 is not active+clean 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703939+0000', 'last_change': '2024-09-17T03:00:20.703939+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703939+0000', 'last_undegraded': '2024-09-17T03:00:20.703939+0000', 'last_fullsized': '2024-09-17T03:00:20.703939+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:PG 15.33 is not active+clean 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.705526+0000', 'last_change': '2024-09-17T03:00:20.705526+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.705526+0000', 'last_undegraded': '2024-09-17T03:00:20.705526+0000', 'last_fullsized': '2024-09-17T03:00:20.705526+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:PG 15.32 is not active+clean 2024-09-17T03:00:25.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.708723+0000', 'last_change': '2024-09-17T03:00:20.708723+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.708723+0000', 'last_undegraded': '2024-09-17T03:00:20.708723+0000', 'last_fullsized': '2024-09-17T03:00:20.708723+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:PG 15.31 is not active+clean 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704101+0000', 'last_change': '2024-09-17T03:00:20.704101+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704101+0000', 'last_undegraded': '2024-09-17T03:00:20.704101+0000', 'last_fullsized': '2024-09-17T03:00:20.704101+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:PG 15.30 is not active+clean 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704585+0000', 'last_change': '2024-09-17T03:00:20.704585+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704585+0000', 'last_undegraded': '2024-09-17T03:00:20.704585+0000', 'last_fullsized': '2024-09-17T03:00:20.704585+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2f is not active+clean 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703938+0000', 'last_change': '2024-09-17T03:00:20.703938+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703938+0000', 'last_undegraded': '2024-09-17T03:00:20.703938+0000', 'last_fullsized': '2024-09-17T03:00:20.703938+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2e is not active+clean 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703715+0000', 'last_change': '2024-09-17T03:00:20.703715+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703715+0000', 'last_undegraded': '2024-09-17T03:00:20.703715+0000', 'last_fullsized': '2024-09-17T03:00:20.703715+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2d is not active+clean 2024-09-17T03:00:25.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.708386+0000', 'last_change': '2024-09-17T03:00:20.708386+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.708386+0000', 'last_undegraded': '2024-09-17T03:00:20.708386+0000', 'last_fullsized': '2024-09-17T03:00:20.708386+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2c is not active+clean 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702974+0000', 'last_change': '2024-09-17T03:00:20.702974+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702974+0000', 'last_undegraded': '2024-09-17T03:00:20.702974+0000', 'last_fullsized': '2024-09-17T03:00:20.702974+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2b is not active+clean 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.705029+0000', 'last_change': '2024-09-17T03:00:20.705029+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.705029+0000', 'last_undegraded': '2024-09-17T03:00:20.705029+0000', 'last_fullsized': '2024-09-17T03:00:20.705029+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2a is not active+clean 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703645+0000', 'last_change': '2024-09-17T03:00:20.703645+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703645+0000', 'last_undegraded': '2024-09-17T03:00:20.703645+0000', 'last_fullsized': '2024-09-17T03:00:20.703645+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:PG 15.29 is not active+clean 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704205+0000', 'last_change': '2024-09-17T03:00:20.704205+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704205+0000', 'last_undegraded': '2024-09-17T03:00:20.704205+0000', 'last_fullsized': '2024-09-17T03:00:20.704205+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:PG 15.28 is not active+clean 2024-09-17T03:00:25.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703787+0000', 'last_change': '2024-09-17T03:00:20.703787+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703787+0000', 'last_undegraded': '2024-09-17T03:00:20.703787+0000', 'last_fullsized': '2024-09-17T03:00:20.703787+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:PG 15.27 is not active+clean 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.706900+0000', 'last_change': '2024-09-17T03:00:20.706900+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.706900+0000', 'last_undegraded': '2024-09-17T03:00:20.706900+0000', 'last_fullsized': '2024-09-17T03:00:20.706900+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:PG 15.26 is not active+clean 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703793+0000', 'last_change': '2024-09-17T03:00:20.703793+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703793+0000', 'last_undegraded': '2024-09-17T03:00:20.703793+0000', 'last_fullsized': '2024-09-17T03:00:20.703793+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:PG 15.25 is not active+clean 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703939+0000', 'last_change': '2024-09-17T03:00:20.703939+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703939+0000', 'last_undegraded': '2024-09-17T03:00:20.703939+0000', 'last_fullsized': '2024-09-17T03:00:20.703939+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:PG 15.24 is not active+clean 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702095+0000', 'last_change': '2024-09-17T03:00:20.702095+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702095+0000', 'last_undegraded': '2024-09-17T03:00:20.702095+0000', 'last_fullsized': '2024-09-17T03:00:20.702095+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:PG 15.23 is not active+clean 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703340+0000', 'last_change': '2024-09-17T03:00:20.703340+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703340+0000', 'last_undegraded': '2024-09-17T03:00:20.703340+0000', 'last_fullsized': '2024-09-17T03:00:20.703340+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.431 INFO:tasks.ceph.ceph_manager.ceph:PG 15.22 is not active+clean 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.710426+0000', 'last_change': '2024-09-17T03:00:20.710426+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.710426+0000', 'last_undegraded': '2024-09-17T03:00:20.710426+0000', 'last_fullsized': '2024-09-17T03:00:20.710426+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:PG 15.21 is not active+clean 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.705430+0000', 'last_change': '2024-09-17T03:00:20.705430+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.705430+0000', 'last_undegraded': '2024-09-17T03:00:20.705430+0000', 'last_fullsized': '2024-09-17T03:00:20.705430+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:PG 15.20 is not active+clean 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.714003+0000', 'last_change': '2024-09-17T03:00:20.714003+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.714003+0000', 'last_undegraded': '2024-09-17T03:00:20.714003+0000', 'last_fullsized': '2024-09-17T03:00:20.714003+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1e is not active+clean 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.708016+0000', 'last_change': '2024-09-17T03:00:20.708016+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.708016+0000', 'last_undegraded': '2024-09-17T03:00:20.708016+0000', 'last_fullsized': '2024-09-17T03:00:20.708016+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1f is not active+clean 2024-09-17T03:00:25.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703274+0000', 'last_change': '2024-09-17T03:00:20.703274+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703274+0000', 'last_undegraded': '2024-09-17T03:00:20.703274+0000', 'last_fullsized': '2024-09-17T03:00:20.703274+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:00:25.433 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1c is not active+clean 2024-09-17T03:00:25.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.706575+0000', 'last_change': '2024-09-17T03:00:20.706575+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.706575+0000', 'last_undegraded': '2024-09-17T03:00:20.706575+0000', 'last_fullsized': '2024-09-17T03:00:20.706575+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:00:25.433 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1d is not active+clean 2024-09-17T03:00:25.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702555+0000', 'last_change': '2024-09-17T03:00:20.702555+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702555+0000', 'last_undegraded': '2024-09-17T03:00:20.702555+0000', 'last_fullsized': '2024-09-17T03:00:20.702555+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:00:25.433 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1a is not active+clean 2024-09-17T03:00:25.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.707968+0000', 'last_change': '2024-09-17T03:00:20.707968+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.707968+0000', 'last_undegraded': '2024-09-17T03:00:20.707968+0000', 'last_fullsized': '2024-09-17T03:00:20.707968+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1b is not active+clean 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703049+0000', 'last_change': '2024-09-17T03:00:20.703049+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703049+0000', 'last_undegraded': '2024-09-17T03:00:20.703049+0000', 'last_fullsized': '2024-09-17T03:00:20.703049+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:PG 15.18 is not active+clean 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702850+0000', 'last_change': '2024-09-17T03:00:20.702850+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702850+0000', 'last_undegraded': '2024-09-17T03:00:20.702850+0000', 'last_fullsized': '2024-09-17T03:00:20.702850+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:PG 15.19 is not active+clean 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702547+0000', 'last_change': '2024-09-17T03:00:20.702547+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702547+0000', 'last_undegraded': '2024-09-17T03:00:20.702547+0000', 'last_fullsized': '2024-09-17T03:00:20.702547+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:PG 15.16 is not active+clean 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703270+0000', 'last_change': '2024-09-17T03:00:20.703270+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703270+0000', 'last_undegraded': '2024-09-17T03:00:20.703270+0000', 'last_fullsized': '2024-09-17T03:00:20.703270+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.434 INFO:tasks.ceph.ceph_manager.ceph:PG 15.17 is not active+clean 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702481+0000', 'last_change': '2024-09-17T03:00:20.702481+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702481+0000', 'last_undegraded': '2024-09-17T03:00:20.702481+0000', 'last_fullsized': '2024-09-17T03:00:20.702481+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:PG 15.14 is not active+clean 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703041+0000', 'last_change': '2024-09-17T03:00:20.703041+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703041+0000', 'last_undegraded': '2024-09-17T03:00:20.703041+0000', 'last_fullsized': '2024-09-17T03:00:20.703041+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:PG 15.15 is not active+clean 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703560+0000', 'last_change': '2024-09-17T03:00:20.703560+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703560+0000', 'last_undegraded': '2024-09-17T03:00:20.703560+0000', 'last_fullsized': '2024-09-17T03:00:20.703560+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:PG 15.12 is not active+clean 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704712+0000', 'last_change': '2024-09-17T03:00:20.704712+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704712+0000', 'last_undegraded': '2024-09-17T03:00:20.704712+0000', 'last_fullsized': '2024-09-17T03:00:20.704712+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:PG 15.13 is not active+clean 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.706815+0000', 'last_change': '2024-09-17T03:00:20.706815+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.706815+0000', 'last_undegraded': '2024-09-17T03:00:20.706815+0000', 'last_fullsized': '2024-09-17T03:00:20.706815+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:PG 15.10 is not active+clean 2024-09-17T03:00:25.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703461+0000', 'last_change': '2024-09-17T03:00:20.703461+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703461+0000', 'last_undegraded': '2024-09-17T03:00:20.703461+0000', 'last_fullsized': '2024-09-17T03:00:20.703461+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:00:25.436 INFO:tasks.ceph.ceph_manager.ceph:PG 15.11 is not active+clean 2024-09-17T03:00:25.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703041+0000', 'last_change': '2024-09-17T03:00:20.703041+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703041+0000', 'last_undegraded': '2024-09-17T03:00:20.703041+0000', 'last_fullsized': '2024-09-17T03:00:20.703041+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.436 INFO:tasks.ceph.ceph_manager.ceph:PG 15.f is not active+clean 2024-09-17T03:00:25.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702645+0000', 'last_change': '2024-09-17T03:00:20.702645+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702645+0000', 'last_undegraded': '2024-09-17T03:00:20.702645+0000', 'last_fullsized': '2024-09-17T03:00:20.702645+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.436 INFO:tasks.ceph.ceph_manager.ceph:PG 15.c is not active+clean 2024-09-17T03:00:25.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.708618+0000', 'last_change': '2024-09-17T03:00:20.708618+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.708618+0000', 'last_undegraded': '2024-09-17T03:00:20.708618+0000', 'last_fullsized': '2024-09-17T03:00:20.708618+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:00:25.436 INFO:tasks.ceph.ceph_manager.ceph:PG 15.d is not active+clean 2024-09-17T03:00:25.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704049+0000', 'last_change': '2024-09-17T03:00:20.704049+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704049+0000', 'last_undegraded': '2024-09-17T03:00:20.704049+0000', 'last_fullsized': '2024-09-17T03:00:20.704049+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:PG 15.a is not active+clean 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.707674+0000', 'last_change': '2024-09-17T03:00:20.707674+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.707674+0000', 'last_undegraded': '2024-09-17T03:00:20.707674+0000', 'last_fullsized': '2024-09-17T03:00:20.707674+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:PG 15.b is not active+clean 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702809+0000', 'last_change': '2024-09-17T03:00:20.702809+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702809+0000', 'last_undegraded': '2024-09-17T03:00:20.702809+0000', 'last_fullsized': '2024-09-17T03:00:20.702809+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:PG 15.8 is not active+clean 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704674+0000', 'last_change': '2024-09-17T03:00:20.704674+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704674+0000', 'last_undegraded': '2024-09-17T03:00:20.704674+0000', 'last_fullsized': '2024-09-17T03:00:20.704674+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:PG 15.9 is not active+clean 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.704822+0000', 'last_change': '2024-09-17T03:00:20.704822+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.704822+0000', 'last_undegraded': '2024-09-17T03:00:20.704822+0000', 'last_fullsized': '2024-09-17T03:00:20.704822+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:PG 15.6 is not active+clean 2024-09-17T03:00:25.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.703865+0000', 'last_change': '2024-09-17T03:00:20.703865+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.703865+0000', 'last_undegraded': '2024-09-17T03:00:20.703865+0000', 'last_fullsized': '2024-09-17T03:00:20.703865+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:PG 15.7 is not active+clean 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.713637+0000', 'last_change': '2024-09-17T03:00:20.713637+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.713637+0000', 'last_undegraded': '2024-09-17T03:00:20.713637+0000', 'last_fullsized': '2024-09-17T03:00:20.713637+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:PG 15.4 is not active+clean 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.706423+0000', 'last_change': '2024-09-17T03:00:20.706423+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.706423+0000', 'last_undegraded': '2024-09-17T03:00:20.706423+0000', 'last_fullsized': '2024-09-17T03:00:20.706423+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:PG 15.5 is not active+clean 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702243+0000', 'last_change': '2024-09-17T03:00:20.702243+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702243+0000', 'last_undegraded': '2024-09-17T03:00:20.702243+0000', 'last_fullsized': '2024-09-17T03:00:20.702243+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2 is not active+clean 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702606+0000', 'last_change': '2024-09-17T03:00:20.702606+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702606+0000', 'last_undegraded': '2024-09-17T03:00:20.702606+0000', 'last_fullsized': '2024-09-17T03:00:20.702606+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3 is not active+clean 2024-09-17T03:00:25.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702029+0000', 'last_change': '2024-09-17T03:00:20.702029+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702029+0000', 'last_undegraded': '2024-09-17T03:00:20.702029+0000', 'last_fullsized': '2024-09-17T03:00:20.702029+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:00:25.439 INFO:tasks.ceph.ceph_manager.ceph:PG 15.0 is not active+clean 2024-09-17T03:00:25.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.707312+0000', 'last_change': '2024-09-17T03:00:20.707312+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.707312+0000', 'last_undegraded': '2024-09-17T03:00:20.707312+0000', 'last_fullsized': '2024-09-17T03:00:20.707312+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.439 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1 is not active+clean 2024-09-17T03:00:25.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.702546+0000', 'last_change': '2024-09-17T03:00:20.702546+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.702546+0000', 'last_undegraded': '2024-09-17T03:00:20.702546+0000', 'last_fullsized': '2024-09-17T03:00:20.702546+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:00:25.439 INFO:tasks.ceph.ceph_manager.ceph:PG 15.e is not active+clean 2024-09-17T03:00:25.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:00:20.710074+0000', 'last_change': '2024-09-17T03:00:20.710074+0000', 'last_active': '2024-09-17T03:00:20.692074+0000', 'last_peered': '2024-09-17T03:00:20.692074+0000', 'last_clean': '2024-09-17T03:00:20.692074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:20.710074+0000', 'last_undegraded': '2024-09-17T03:00:20.710074+0000', 'last_fullsized': '2024-09-17T03:00:20.710074+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:20.692074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:00:25.440 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:00:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.574+0000 7f371c990640 1 -- 172.21.15.104:0/4192272283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815bc00 msgr2=0x7f3718072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.574+0000 7f371c990640 1 --2- 172.21.15.104:0/4192272283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815bc00 0x7f3718072b80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3718074880 tx=0x7f370c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.574+0000 7f371c990640 1 -- 172.21.15.104:0/4192272283 shutdown_connections 2024-09-17T03:00:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.574+0000 7f371c990640 1 --2- 172.21.15.104:0/4192272283 >> v2:172.21.15.192:3300/0 conn(0x7f37180ce280 0x7f37180ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.574+0000 7f371c990640 1 --2- 172.21.15.104:0/4192272283 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815bc00 0x7f3718072b80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.574+0000 7f371c990640 1 -- 172.21.15.104:0/4192272283 >> 172.21.15.104:0/4192272283 conn(0x7f37180b2450 msgr2=0x7f37180b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.574+0000 7f371c990640 1 -- 172.21.15.104:0/4192272283 shutdown_connections 2024-09-17T03:00:25.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.574+0000 7f371c990640 1 -- 172.21.15.104:0/4192272283 wait complete. 2024-09-17T03:00:25.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.576+0000 7f371c990640 1 Processor -- start 2024-09-17T03:00:25.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.576+0000 7f371c990640 1 -- start start 2024-09-17T03:00:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f371c990640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37180ce280 0x7f371815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f371c990640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815b7f0 0x7f3718140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f371c990640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371815bc00 0x7f37181412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f371c990640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f37180cebd0 con 0x7f371815b7f0 2024-09-17T03:00:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f371c990640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37180700c0 con 0x7f371815bc00 2024-09-17T03:00:25.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f371c990640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f37180ced50 con 0x7f37180ce280 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f3715d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815b7f0 0x7f3718140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f3715d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815b7f0 0x7f3718140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53102/0 (socket says 172.21.15.104:53102) 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f3715d9b640 1 -- 172.21.15.104:0/76960154 learned_addr learned my addr 172.21.15.104:0/76960154 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f3716d9d640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371815bc00 0x7f37181412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.577+0000 7f371659c640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37180ce280 0x7f371815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3715d9b640 1 -- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37180ce280 msgr2=0x7f371815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3715d9b640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37180ce280 0x7f371815a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3715d9b640 1 -- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371815bc00 msgr2=0x7f37181412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3715d9b640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371815bc00 0x7f37181412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3715d9b640 1 -- 172.21.15.104:0/76960154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371815e920 con 0x7f371815b7f0 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f371659c640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37180ce280 0x7f371815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3715d9b640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815b7f0 0x7f3718140d60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f370c009780 tx=0x7f370c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:25.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3706ffd640 1 -- 172.21.15.104:0/76960154 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c031d60 con 0x7f371815b7f0 2024-09-17T03:00:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3706ffd640 1 -- 172.21.15.104:0/76960154 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f370c040030 con 0x7f371815b7f0 2024-09-17T03:00:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371815ec00 con 0x7f371815b7f0 2024-09-17T03:00:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f3706ffd640 1 -- 172.21.15.104:0/76960154 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c005280 con 0x7f371815b7f0 2024-09-17T03:00:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.578+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371815f1c0 con 0x7f371815b7f0 2024-09-17T03:00:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.579+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37180b1150 con 0x7f371815b7f0 2024-09-17T03:00:25.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.580+0000 7f3706ffd640 1 -- 172.21.15.104:0/76960154 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f370c005420 con 0x7f371815b7f0 2024-09-17T03:00:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.580+0000 7f3706ffd640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36f8078bc0 0x7f36f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.580+0000 7f3706ffd640 1 -- 172.21.15.104:0/76960154 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f370c0bdde0 con 0x7f371815b7f0 2024-09-17T03:00:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.580+0000 7f371659c640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36f8078bc0 0x7f36f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.581+0000 7f371659c640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36f8078bc0 0x7f36f807b0d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f37080012e0 tx=0x7f3708009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:25.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.585+0000 7f3706ffd640 1 -- 172.21.15.104:0/76960154 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f37180b1150 con 0x7f371815b7f0 2024-09-17T03:00:25.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.828+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f37180ce690 con 0x7f371815b7f0 2024-09-17T03:00:25.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.829+0000 7f3706ffd640 1 -- 172.21.15.104:0/76960154 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1490 (secure 0 0 0) 0x7f370c086220 con 0x7f371815b7f0 2024-09-17T03:00:25.829 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:25.829 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":362,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":123,"num_osds":8,"num_up_osds":8,"osd_up_since":1726541670,"num_in_osds":8,"osd_in_since":1726541667,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":6463581,"bytes_avail":1593536419,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":6696}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-17T03:00:09.702590+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36f8078bc0 msgr2=0x7f36f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36f8078bc0 0x7f36f807b0d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f37080012e0 tx=0x7f3708009040 comp rx=0 tx=0).stop 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815b7f0 msgr2=0x7f3718140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815b7f0 0x7f3718140d60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f370c009780 tx=0x7f370c033d60 comp rx=0 tx=0).stop 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 shutdown_connections 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f36f8078bc0 0x7f36f807b0d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371815bc00 0x7f37181412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f371815b7f0 0x7f3718140d60 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 --2- 172.21.15.104:0/76960154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37180ce280 0x7f371815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 >> 172.21.15.104:0/76960154 conn(0x7f37180b2450 msgr2=0x7f3718156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:25.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 shutdown_connections 2024-09-17T03:00:25.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.831+0000 7f371c990640 1 -- 172.21.15.104:0/76960154 wait complete. 2024-09-17T03:00:25.842 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:00:25.842 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:25.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.954+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/357055652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a6415cc30 msgr2=0x7f0a640cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.954+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/357055652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a6415cc30 0x7f0a640cfa80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c005fd0 tx=0x7f0a5c02a820 comp rx=0 tx=0).stop 2024-09-17T03:00:25.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.954+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/357055652 shutdown_connections 2024-09-17T03:00:25.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.954+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/357055652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a6415cc30 0x7f0a640cfa80 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.954+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/357055652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a640cde80 0x7f0a64156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.954+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/357055652 >> 172.21.15.104:0/357055652 conn(0x7f0a6406eb90 msgr2=0x7f0a6406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:25.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.955+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/357055652 shutdown_connections 2024-09-17T03:00:25.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.955+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/357055652 wait complete. 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.956+0000 7f0a6bfc3640 1 Processor -- start 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.956+0000 7f0a6bfc3640 1 -- start start 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6bfc3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a64073e00 0x7f0a641f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6bfc3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a6415cc30 0x7f0a641f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6bfc3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a64159520 0x7f0a64154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6bfc3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0a640d0350 con 0x7f0a64073e00 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6bfc3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a640d01d0 con 0x7f0a6415cc30 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6bfc3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0a640d04d0 con 0x7f0a64159520 2024-09-17T03:00:25.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a64073e00 0x7f0a641f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a64073e00 0x7f0a641f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53124/0 (socket says 172.21.15.104:53124) 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 -- 172.21.15.104:0/3038613008 learned_addr learned my addr 172.21.15.104:0/3038613008 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6a560640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a64159520 0x7f0a64154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 -- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a64159520 msgr2=0x7f0a64154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a64159520 0x7f0a64154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 -- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a6415cc30 msgr2=0x7f0a641f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a6415cc30 0x7f0a641f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 -- 172.21.15.104:0/3038613008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a641e24b0 con 0x7f0a64073e00 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a69d5f640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a64073e00 0x7f0a641f63f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000c3c0 tx=0x7f0a6000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a5a7fc640 1 -- 172.21.15.104:0/3038613008 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60017070 con 0x7f0a64073e00 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a5a7fc640 1 -- 172.21.15.104:0/3038613008 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a600035f0 con 0x7f0a64073e00 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a641f2300 con 0x7f0a64073e00 2024-09-17T03:00:25.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a5a7fc640 1 -- 172.21.15.104:0/3038613008 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60003a20 con 0x7f0a64073e00 2024-09-17T03:00:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.958+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a641572c0 con 0x7f0a64073e00 2024-09-17T03:00:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.959+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a640d0a10 con 0x7f0a64073e00 2024-09-17T03:00:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.960+0000 7f0a5a7fc640 1 -- 172.21.15.104:0/3038613008 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a6001a070 con 0x7f0a64073e00 2024-09-17T03:00:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.961+0000 7f0a5a7fc640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a48078b90 0x7f0a4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.961+0000 7f0a5a7fc640 1 -- 172.21.15.104:0/3038613008 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f0a6009a070 con 0x7f0a64073e00 2024-09-17T03:00:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.961+0000 7f0a6955e640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a48078b90 0x7f0a4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:25.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.962+0000 7f0a6955e640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a48078b90 0x7f0a4807b0a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0a540058c0 tx=0x7f0a54005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:25.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:25.965+0000 7f0a5a7fc640 1 -- 172.21.15.104:0/3038613008 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a600624b0 con 0x7f0a64073e00 2024-09-17T03:00:26.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.135+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a64070de0 con 0x7f0a48078b90 2024-09-17T03:00:26.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.140+0000 7f0a5a7fc640 1 -- 172.21.15.104:0/3038613008 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242658 (secure 0 0 0) 0x7f0a64070de0 con 0x7f0a48078b90 2024-09-17T03:00:26.146 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:26.147 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:26.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a48078b90 msgr2=0x7f0a4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:26.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a48078b90 0x7f0a4807b0a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0a540058c0 tx=0x7f0a54005850 comp rx=0 tx=0).stop 2024-09-17T03:00:26.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a64073e00 msgr2=0x7f0a641f63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:26.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a64073e00 0x7f0a641f63f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000c3c0 tx=0x7f0a6000c880 comp rx=0 tx=0).stop 2024-09-17T03:00:26.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 shutdown_connections 2024-09-17T03:00:26.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0a48078b90 0x7f0a4807b0a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:26.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a6415cc30 0x7f0a641f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:26.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a64159520 0x7f0a64154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:26.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 --2- 172.21.15.104:0/3038613008 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0a64073e00 0x7f0a641f63f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:26.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 >> 172.21.15.104:0/3038613008 conn(0x7f0a6406eb90 msgr2=0x7f0a6414f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:26.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 shutdown_connections 2024-09-17T03:00:26.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:26.143+0000 7f0a6bfc3640 1 -- 172.21.15.104:0/3038613008 wait complete. 2024-09-17T03:00:26.154 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-17T03:00:25.706332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6312,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556187,"statfs":{"total":1600000000,"available":1593536419,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001303"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707902+0000","last_change":"2024-09-17T03:00:20.707902+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707902+0000","last_undegraded":"2024-09-17T03:00:20.707902+0000","last_fullsized":"2024-09-17T03:00:20.707902+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704250+0000","last_change":"2024-09-17T03:00:20.704250+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704250+0000","last_undegraded":"2024-09-17T03:00:20.704250+0000","last_fullsized":"2024-09-17T03:00:20.704250+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708033+0000","last_change":"2024-09-17T03:00:20.708033+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708033+0000","last_undegraded":"2024-09-17T03:00:20.708033+0000","last_fullsized":"2024-09-17T03:00:20.708033+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705954+0000","last_change":"2024-09-17T03:00:20.705954+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705954+0000","last_undegraded":"2024-09-17T03:00:20.705954+0000","last_fullsized":"2024-09-17T03:00:20.705954+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708578+0000","last_change":"2024-09-17T03:00:20.708578+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708578+0000","last_undegraded":"2024-09-17T03:00:20.708578+0000","last_fullsized":"2024-09-17T03:00:20.708578+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708198+0000","last_change":"2024-09-17T03:00:20.708198+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708198+0000","last_undegraded":"2024-09-17T03:00:20.708198+0000","last_fullsized":"2024-09-17T03:00:20.708198+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704558+0000","last_change":"2024-09-17T03:00:20.704558+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704558+0000","last_undegraded":"2024-09-17T03:00:20.704558+0000","last_fullsized":"2024-09-17T03:00:20.704558+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704854+0000","last_change":"2024-09-17T03:00:20.704854+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704854+0000","last_undegraded":"2024-09-17T03:00:20.704854+0000","last_fullsized":"2024-09-17T03:00:20.704854+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703508+0000","last_change":"2024-09-17T03:00:20.703508+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703508+0000","last_undegraded":"2024-09-17T03:00:20.703508+0000","last_fullsized":"2024-09-17T03:00:20.703508+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707293+0000","last_change":"2024-09-17T03:00:20.707293+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707293+0000","last_undegraded":"2024-09-17T03:00:20.707293+0000","last_fullsized":"2024-09-17T03:00:20.707293+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706662+0000","last_change":"2024-09-17T03:00:20.706662+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706662+0000","last_undegraded":"2024-09-17T03:00:20.706662+0000","last_fullsized":"2024-09-17T03:00:20.706662+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703939+0000","last_change":"2024-09-17T03:00:20.703939+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703939+0000","last_undegraded":"2024-09-17T03:00:20.703939+0000","last_fullsized":"2024-09-17T03:00:20.703939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705526+0000","last_change":"2024-09-17T03:00:20.705526+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705526+0000","last_undegraded":"2024-09-17T03:00:20.705526+0000","last_fullsized":"2024-09-17T03:00:20.705526+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708723+0000","last_change":"2024-09-17T03:00:20.708723+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708723+0000","last_undegraded":"2024-09-17T03:00:20.708723+0000","last_fullsized":"2024-09-17T03:00:20.708723+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704101+0000","last_change":"2024-09-17T03:00:20.704101+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704101+0000","last_undegraded":"2024-09-17T03:00:20.704101+0000","last_fullsized":"2024-09-17T03:00:20.704101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704585+0000","last_change":"2024-09-17T03:00:20.704585+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704585+0000","last_undegraded":"2024-09-17T03:00:20.704585+0000","last_fullsized":"2024-09-17T03:00:20.704585+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703938+0000","last_change":"2024-09-17T03:00:20.703938+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703938+0000","last_undegraded":"2024-09-17T03:00:20.703938+0000","last_fullsized":"2024-09-17T03:00:20.703938+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703715+0000","last_change":"2024-09-17T03:00:20.703715+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703715+0000","last_undegraded":"2024-09-17T03:00:20.703715+0000","last_fullsized":"2024-09-17T03:00:20.703715+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708386+0000","last_change":"2024-09-17T03:00:20.708386+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708386+0000","last_undegraded":"2024-09-17T03:00:20.708386+0000","last_fullsized":"2024-09-17T03:00:20.708386+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702974+0000","last_change":"2024-09-17T03:00:20.702974+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702974+0000","last_undegraded":"2024-09-17T03:00:20.702974+0000","last_fullsized":"2024-09-17T03:00:20.702974+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705029+0000","last_change":"2024-09-17T03:00:20.705029+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705029+0000","last_undegraded":"2024-09-17T03:00:20.705029+0000","last_fullsized":"2024-09-17T03:00:20.705029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703645+0000","last_change":"2024-09-17T03:00:20.703645+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703645+0000","last_undegraded":"2024-09-17T03:00:20.703645+0000","last_fullsized":"2024-09-17T03:00:20.703645+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704205+0000","last_change":"2024-09-17T03:00:20.704205+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704205+0000","last_undegraded":"2024-09-17T03:00:20.704205+0000","last_fullsized":"2024-09-17T03:00:20.704205+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703787+0000","last_change":"2024-09-17T03:00:20.703787+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703787+0000","last_undegraded":"2024-09-17T03:00:20.703787+0000","last_fullsized":"2024-09-17T03:00:20.703787+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706900+0000","last_change":"2024-09-17T03:00:20.706900+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706900+0000","last_undegraded":"2024-09-17T03:00:20.706900+0000","last_fullsized":"2024-09-17T03:00:20.706900+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703793+0000","last_change":"2024-09-17T03:00:20.703793+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703793+0000","last_undegraded":"2024-09-17T03:00:20.703793+0000","last_fullsized":"2024-09-17T03:00:20.703793+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703939+0000","last_change":"2024-09-17T03:00:20.703939+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703939+0000","last_undegraded":"2024-09-17T03:00:20.703939+0000","last_fullsized":"2024-09-17T03:00:20.703939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702095+0000","last_change":"2024-09-17T03:00:20.702095+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702095+0000","last_undegraded":"2024-09-17T03:00:20.702095+0000","last_fullsized":"2024-09-17T03:00:20.702095+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703340+0000","last_change":"2024-09-17T03:00:20.703340+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703340+0000","last_undegraded":"2024-09-17T03:00:20.703340+0000","last_fullsized":"2024-09-17T03:00:20.703340+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.710426+0000","last_change":"2024-09-17T03:00:20.710426+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.710426+0000","last_undegraded":"2024-09-17T03:00:20.710426+0000","last_fullsized":"2024-09-17T03:00:20.710426+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.705430+0000","last_change":"2024-09-17T03:00:20.705430+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.705430+0000","last_undegraded":"2024-09-17T03:00:20.705430+0000","last_fullsized":"2024-09-17T03:00:20.705430+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.714003+0000","last_change":"2024-09-17T03:00:20.714003+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.714003+0000","last_undegraded":"2024-09-17T03:00:20.714003+0000","last_fullsized":"2024-09-17T03:00:20.714003+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708016+0000","last_change":"2024-09-17T03:00:20.708016+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708016+0000","last_undegraded":"2024-09-17T03:00:20.708016+0000","last_fullsized":"2024-09-17T03:00:20.708016+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.713185+0000","last_change":"2024-09-17T03:00:20.712953+0000","last_active":"2024-09-17T03:00:20.713185+0000","last_peered":"2024-09-17T03:00:20.713185+0000","last_clean":"2024-09-17T03:00:20.713185+0000","last_became_active":"2024-09-17T03:00:20.711675+0000","last_became_peered":"2024-09-17T03:00:20.711675+0000","last_unstale":"2024-09-17T03:00:20.713185+0000","last_undegraded":"2024-09-17T03:00:20.713185+0000","last_fullsized":"2024-09-17T03:00:20.713185+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:59.207345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703274+0000","last_change":"2024-09-17T03:00:20.703274+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703274+0000","last_undegraded":"2024-09-17T03:00:20.703274+0000","last_fullsized":"2024-09-17T03:00:20.703274+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.708711+0000","last_change":"2024-09-17T03:00:20.708495+0000","last_active":"2024-09-17T03:00:20.708711+0000","last_peered":"2024-09-17T03:00:20.708711+0000","last_clean":"2024-09-17T03:00:20.708711+0000","last_became_active":"2024-09-17T03:00:20.708193+0000","last_became_peered":"2024-09-17T03:00:20.708193+0000","last_unstale":"2024-09-17T03:00:20.708711+0000","last_undegraded":"2024-09-17T03:00:20.708711+0000","last_fullsized":"2024-09-17T03:00:20.708711+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:41.910157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706575+0000","last_change":"2024-09-17T03:00:20.706575+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706575+0000","last_undegraded":"2024-09-17T03:00:20.706575+0000","last_fullsized":"2024-09-17T03:00:20.706575+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712883+0000","last_change":"2024-09-17T03:00:20.712435+0000","last_active":"2024-09-17T03:00:20.712883+0000","last_peered":"2024-09-17T03:00:20.712883+0000","last_clean":"2024-09-17T03:00:20.712883+0000","last_became_active":"2024-09-17T03:00:20.712152+0000","last_became_peered":"2024-09-17T03:00:20.712152+0000","last_unstale":"2024-09-17T03:00:20.712883+0000","last_undegraded":"2024-09-17T03:00:20.712883+0000","last_fullsized":"2024-09-17T03:00:20.712883+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:09.544663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702555+0000","last_change":"2024-09-17T03:00:20.702555+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702555+0000","last_undegraded":"2024-09-17T03:00:20.702555+0000","last_fullsized":"2024-09-17T03:00:20.702555+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709825+0000","last_change":"2024-09-17T03:00:20.706619+0000","last_active":"2024-09-17T03:00:20.709825+0000","last_peered":"2024-09-17T03:00:20.709825+0000","last_clean":"2024-09-17T03:00:20.709825+0000","last_became_active":"2024-09-17T03:00:20.706294+0000","last_became_peered":"2024-09-17T03:00:20.706294+0000","last_unstale":"2024-09-17T03:00:20.709825+0000","last_undegraded":"2024-09-17T03:00:20.709825+0000","last_fullsized":"2024-09-17T03:00:20.709825+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:25.963999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707968+0000","last_change":"2024-09-17T03:00:20.707968+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707968+0000","last_undegraded":"2024-09-17T03:00:20.707968+0000","last_fullsized":"2024-09-17T03:00:20.707968+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.717170+0000","last_change":"2024-09-17T03:00:20.716966+0000","last_active":"2024-09-17T03:00:20.717170+0000","last_peered":"2024-09-17T03:00:20.717170+0000","last_clean":"2024-09-17T03:00:20.717170+0000","last_became_active":"2024-09-17T03:00:20.716681+0000","last_became_peered":"2024-09-17T03:00:20.716681+0000","last_unstale":"2024-09-17T03:00:20.717170+0000","last_undegraded":"2024-09-17T03:00:20.717170+0000","last_fullsized":"2024-09-17T03:00:20.717170+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:22.125483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703049+0000","last_change":"2024-09-17T03:00:20.703049+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703049+0000","last_undegraded":"2024-09-17T03:00:20.703049+0000","last_fullsized":"2024-09-17T03:00:20.703049+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710665+0000","last_change":"2024-09-17T03:00:20.709805+0000","last_active":"2024-09-17T03:00:20.710665+0000","last_peered":"2024-09-17T03:00:20.710665+0000","last_clean":"2024-09-17T03:00:20.710665+0000","last_became_active":"2024-09-17T03:00:20.709291+0000","last_became_peered":"2024-09-17T03:00:20.709291+0000","last_unstale":"2024-09-17T03:00:20.710665+0000","last_undegraded":"2024-09-17T03:00:20.710665+0000","last_fullsized":"2024-09-17T03:00:20.710665+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:51.369575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702850+0000","last_change":"2024-09-17T03:00:20.702850+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702850+0000","last_undegraded":"2024-09-17T03:00:20.702850+0000","last_fullsized":"2024-09-17T03:00:20.702850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716535+0000","last_change":"2024-09-17T03:00:20.716327+0000","last_active":"2024-09-17T03:00:20.716535+0000","last_peered":"2024-09-17T03:00:20.716535+0000","last_clean":"2024-09-17T03:00:20.716535+0000","last_became_active":"2024-09-17T03:00:20.716045+0000","last_became_peered":"2024-09-17T03:00:20.716045+0000","last_unstale":"2024-09-17T03:00:20.716535+0000","last_undegraded":"2024-09-17T03:00:20.716535+0000","last_fullsized":"2024-09-17T03:00:20.716535+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:04.957426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702547+0000","last_change":"2024-09-17T03:00:20.702547+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702547+0000","last_undegraded":"2024-09-17T03:00:20.702547+0000","last_fullsized":"2024-09-17T03:00:20.702547+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.714735+0000","last_change":"2024-09-17T03:00:20.714525+0000","last_active":"2024-09-17T03:00:20.714735+0000","last_peered":"2024-09-17T03:00:20.714735+0000","last_clean":"2024-09-17T03:00:20.714735+0000","last_became_active":"2024-09-17T03:00:20.714180+0000","last_became_peered":"2024-09-17T03:00:20.714180+0000","last_unstale":"2024-09-17T03:00:20.714735+0000","last_undegraded":"2024-09-17T03:00:20.714735+0000","last_fullsized":"2024-09-17T03:00:20.714735+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:10:11.032307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703270+0000","last_change":"2024-09-17T03:00:20.703270+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703270+0000","last_undegraded":"2024-09-17T03:00:20.703270+0000","last_fullsized":"2024-09-17T03:00:20.703270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716275+0000","last_change":"2024-09-17T03:00:20.716045+0000","last_active":"2024-09-17T03:00:20.716275+0000","last_peered":"2024-09-17T03:00:20.716275+0000","last_clean":"2024-09-17T03:00:20.716275+0000","last_became_active":"2024-09-17T03:00:20.715454+0000","last_became_peered":"2024-09-17T03:00:20.715454+0000","last_unstale":"2024-09-17T03:00:20.716275+0000","last_undegraded":"2024-09-17T03:00:20.716275+0000","last_fullsized":"2024-09-17T03:00:20.716275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:22.511329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702481+0000","last_change":"2024-09-17T03:00:20.702481+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702481+0000","last_undegraded":"2024-09-17T03:00:20.702481+0000","last_fullsized":"2024-09-17T03:00:20.702481+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.708732+0000","last_change":"2024-09-17T03:00:20.707140+0000","last_active":"2024-09-17T03:00:20.708732+0000","last_peered":"2024-09-17T03:00:20.708732+0000","last_clean":"2024-09-17T03:00:20.708732+0000","last_became_active":"2024-09-17T03:00:20.706883+0000","last_became_peered":"2024-09-17T03:00:20.706883+0000","last_unstale":"2024-09-17T03:00:20.708732+0000","last_undegraded":"2024-09-17T03:00:20.708732+0000","last_fullsized":"2024-09-17T03:00:20.708732+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:32.842810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703041+0000","last_change":"2024-09-17T03:00:20.703041+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703041+0000","last_undegraded":"2024-09-17T03:00:20.703041+0000","last_fullsized":"2024-09-17T03:00:20.703041+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.704945+0000","last_change":"2024-09-17T03:00:20.704627+0000","last_active":"2024-09-17T03:00:20.704945+0000","last_peered":"2024-09-17T03:00:20.704945+0000","last_clean":"2024-09-17T03:00:20.704945+0000","last_became_active":"2024-09-17T03:00:20.704288+0000","last_became_peered":"2024-09-17T03:00:20.704288+0000","last_unstale":"2024-09-17T03:00:20.704945+0000","last_undegraded":"2024-09-17T03:00:20.704945+0000","last_fullsized":"2024-09-17T03:00:20.704945+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:04.769154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703560+0000","last_change":"2024-09-17T03:00:20.703560+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703560+0000","last_undegraded":"2024-09-17T03:00:20.703560+0000","last_fullsized":"2024-09-17T03:00:20.703560+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.707000+0000","last_change":"2024-09-17T03:00:20.706770+0000","last_active":"2024-09-17T03:00:20.707000+0000","last_peered":"2024-09-17T03:00:20.707000+0000","last_clean":"2024-09-17T03:00:20.707000+0000","last_became_active":"2024-09-17T03:00:20.706322+0000","last_became_peered":"2024-09-17T03:00:20.706322+0000","last_unstale":"2024-09-17T03:00:20.707000+0000","last_undegraded":"2024-09-17T03:00:20.707000+0000","last_fullsized":"2024-09-17T03:00:20.707000+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:48.537480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704712+0000","last_change":"2024-09-17T03:00:20.704712+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704712+0000","last_undegraded":"2024-09-17T03:00:20.704712+0000","last_fullsized":"2024-09-17T03:00:20.704712+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.714959+0000","last_change":"2024-09-17T03:00:20.714692+0000","last_active":"2024-09-17T03:00:20.714959+0000","last_peered":"2024-09-17T03:00:20.714959+0000","last_clean":"2024-09-17T03:00:20.714959+0000","last_became_active":"2024-09-17T03:00:20.713971+0000","last_became_peered":"2024-09-17T03:00:20.713971+0000","last_unstale":"2024-09-17T03:00:20.714959+0000","last_undegraded":"2024-09-17T03:00:20.714959+0000","last_fullsized":"2024-09-17T03:00:20.714959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:46.645734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706815+0000","last_change":"2024-09-17T03:00:20.706815+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706815+0000","last_undegraded":"2024-09-17T03:00:20.706815+0000","last_fullsized":"2024-09-17T03:00:20.706815+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710421+0000","last_change":"2024-09-17T03:00:20.710168+0000","last_active":"2024-09-17T03:00:20.710421+0000","last_peered":"2024-09-17T03:00:20.710421+0000","last_clean":"2024-09-17T03:00:20.710421+0000","last_became_active":"2024-09-17T03:00:20.709908+0000","last_became_peered":"2024-09-17T03:00:20.709908+0000","last_unstale":"2024-09-17T03:00:20.710421+0000","last_undegraded":"2024-09-17T03:00:20.710421+0000","last_fullsized":"2024-09-17T03:00:20.710421+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:09.474996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703461+0000","last_change":"2024-09-17T03:00:20.703461+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703461+0000","last_undegraded":"2024-09-17T03:00:20.703461+0000","last_fullsized":"2024-09-17T03:00:20.703461+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711241+0000","last_change":"2024-09-17T03:00:20.710421+0000","last_active":"2024-09-17T03:00:20.711241+0000","last_peered":"2024-09-17T03:00:20.711241+0000","last_clean":"2024-09-17T03:00:20.711241+0000","last_became_active":"2024-09-17T03:00:20.710135+0000","last_became_peered":"2024-09-17T03:00:20.710135+0000","last_unstale":"2024-09-17T03:00:20.711241+0000","last_undegraded":"2024-09-17T03:00:20.711241+0000","last_fullsized":"2024-09-17T03:00:20.711241+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:55.620059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703041+0000","last_change":"2024-09-17T03:00:20.703041+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703041+0000","last_undegraded":"2024-09-17T03:00:20.703041+0000","last_fullsized":"2024-09-17T03:00:20.703041+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716975+0000","last_change":"2024-09-17T03:00:20.716746+0000","last_active":"2024-09-17T03:00:20.716975+0000","last_peered":"2024-09-17T03:00:20.716975+0000","last_clean":"2024-09-17T03:00:20.716975+0000","last_became_active":"2024-09-17T03:00:20.716463+0000","last_became_peered":"2024-09-17T03:00:20.716463+0000","last_unstale":"2024-09-17T03:00:20.716975+0000","last_undegraded":"2024-09-17T03:00:20.716975+0000","last_fullsized":"2024-09-17T03:00:20.716975+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:48.954013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702645+0000","last_change":"2024-09-17T03:00:20.702645+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702645+0000","last_undegraded":"2024-09-17T03:00:20.702645+0000","last_fullsized":"2024-09-17T03:00:20.702645+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712486+0000","last_change":"2024-09-17T03:00:20.712205+0000","last_active":"2024-09-17T03:00:20.712486+0000","last_peered":"2024-09-17T03:00:20.712486+0000","last_clean":"2024-09-17T03:00:20.712486+0000","last_became_active":"2024-09-17T03:00:20.711889+0000","last_became_peered":"2024-09-17T03:00:20.711889+0000","last_unstale":"2024-09-17T03:00:20.712486+0000","last_undegraded":"2024-09-17T03:00:20.712486+0000","last_fullsized":"2024-09-17T03:00:20.712486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:27.364433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.708618+0000","last_change":"2024-09-17T03:00:20.708618+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.708618+0000","last_undegraded":"2024-09-17T03:00:20.708618+0000","last_fullsized":"2024-09-17T03:00:20.708618+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712921+0000","last_change":"2024-09-17T03:00:20.712674+0000","last_active":"2024-09-17T03:00:20.712921+0000","last_peered":"2024-09-17T03:00:20.712921+0000","last_clean":"2024-09-17T03:00:20.712921+0000","last_became_active":"2024-09-17T03:00:20.712384+0000","last_became_peered":"2024-09-17T03:00:20.712384+0000","last_unstale":"2024-09-17T03:00:20.712921+0000","last_undegraded":"2024-09-17T03:00:20.712921+0000","last_fullsized":"2024-09-17T03:00:20.712921+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:34.755387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704049+0000","last_change":"2024-09-17T03:00:20.704049+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704049+0000","last_undegraded":"2024-09-17T03:00:20.704049+0000","last_fullsized":"2024-09-17T03:00:20.704049+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709856+0000","last_change":"2024-09-17T03:00:20.707138+0000","last_active":"2024-09-17T03:00:20.709856+0000","last_peered":"2024-09-17T03:00:20.709856+0000","last_clean":"2024-09-17T03:00:20.709856+0000","last_became_active":"2024-09-17T03:00:20.706724+0000","last_became_peered":"2024-09-17T03:00:20.706724+0000","last_unstale":"2024-09-17T03:00:20.709856+0000","last_undegraded":"2024-09-17T03:00:20.709856+0000","last_fullsized":"2024-09-17T03:00:20.709856+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:26.157803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707674+0000","last_change":"2024-09-17T03:00:20.707674+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707674+0000","last_undegraded":"2024-09-17T03:00:20.707674+0000","last_fullsized":"2024-09-17T03:00:20.707674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712834+0000","last_change":"2024-09-17T03:00:20.712055+0000","last_active":"2024-09-17T03:00:20.712834+0000","last_peered":"2024-09-17T03:00:20.712834+0000","last_clean":"2024-09-17T03:00:20.712834+0000","last_became_active":"2024-09-17T03:00:20.710950+0000","last_became_peered":"2024-09-17T03:00:20.710950+0000","last_unstale":"2024-09-17T03:00:20.712834+0000","last_undegraded":"2024-09-17T03:00:20.712834+0000","last_fullsized":"2024-09-17T03:00:20.712834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:03:00.876072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702809+0000","last_change":"2024-09-17T03:00:20.702809+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702809+0000","last_undegraded":"2024-09-17T03:00:20.702809+0000","last_fullsized":"2024-09-17T03:00:20.702809+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.716106+0000","last_change":"2024-09-17T03:00:20.715877+0000","last_active":"2024-09-17T03:00:20.716106+0000","last_peered":"2024-09-17T03:00:20.716106+0000","last_clean":"2024-09-17T03:00:20.716106+0000","last_became_active":"2024-09-17T03:00:20.715603+0000","last_became_peered":"2024-09-17T03:00:20.715603+0000","last_unstale":"2024-09-17T03:00:20.716106+0000","last_undegraded":"2024-09-17T03:00:20.716106+0000","last_fullsized":"2024-09-17T03:00:20.716106+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:18.834772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704674+0000","last_change":"2024-09-17T03:00:20.704674+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704674+0000","last_undegraded":"2024-09-17T03:00:20.704674+0000","last_fullsized":"2024-09-17T03:00:20.704674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711397+0000","last_change":"2024-09-17T03:00:20.711135+0000","last_active":"2024-09-17T03:00:20.711397+0000","last_peered":"2024-09-17T03:00:20.711397+0000","last_clean":"2024-09-17T03:00:20.711397+0000","last_became_active":"2024-09-17T03:00:20.710383+0000","last_became_peered":"2024-09-17T03:00:20.710383+0000","last_unstale":"2024-09-17T03:00:20.711397+0000","last_undegraded":"2024-09-17T03:00:20.711397+0000","last_fullsized":"2024-09-17T03:00:20.711397+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:23.116065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.704822+0000","last_change":"2024-09-17T03:00:20.704822+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.704822+0000","last_undegraded":"2024-09-17T03:00:20.704822+0000","last_fullsized":"2024-09-17T03:00:20.704822+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710801+0000","last_change":"2024-09-17T03:00:20.710576+0000","last_active":"2024-09-17T03:00:20.710801+0000","last_peered":"2024-09-17T03:00:20.710801+0000","last_clean":"2024-09-17T03:00:20.710801+0000","last_became_active":"2024-09-17T03:00:20.710160+0000","last_became_peered":"2024-09-17T03:00:20.710160+0000","last_unstale":"2024-09-17T03:00:20.710801+0000","last_undegraded":"2024-09-17T03:00:20.710801+0000","last_fullsized":"2024-09-17T03:00:20.710801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:31.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.703865+0000","last_change":"2024-09-17T03:00:20.703865+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.703865+0000","last_undegraded":"2024-09-17T03:00:20.703865+0000","last_fullsized":"2024-09-17T03:00:20.703865+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711357+0000","last_change":"2024-09-17T03:00:20.710615+0000","last_active":"2024-09-17T03:00:20.711357+0000","last_peered":"2024-09-17T03:00:20.711357+0000","last_clean":"2024-09-17T03:00:20.711357+0000","last_became_active":"2024-09-17T03:00:20.710295+0000","last_became_peered":"2024-09-17T03:00:20.710295+0000","last_unstale":"2024-09-17T03:00:20.711357+0000","last_undegraded":"2024-09-17T03:00:20.711357+0000","last_fullsized":"2024-09-17T03:00:20.711357+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:12.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.713637+0000","last_change":"2024-09-17T03:00:20.713637+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.713637+0000","last_undegraded":"2024-09-17T03:00:20.713637+0000","last_fullsized":"2024-09-17T03:00:20.713637+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.712859+0000","last_change":"2024-09-17T03:00:20.712374+0000","last_active":"2024-09-17T03:00:20.712859+0000","last_peered":"2024-09-17T03:00:20.712859+0000","last_clean":"2024-09-17T03:00:20.712859+0000","last_became_active":"2024-09-17T03:00:20.711318+0000","last_became_peered":"2024-09-17T03:00:20.711318+0000","last_unstale":"2024-09-17T03:00:20.712859+0000","last_undegraded":"2024-09-17T03:00:20.712859+0000","last_fullsized":"2024-09-17T03:00:20.712859+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:27.300493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.706423+0000","last_change":"2024-09-17T03:00:20.706423+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.706423+0000","last_undegraded":"2024-09-17T03:00:20.706423+0000","last_fullsized":"2024-09-17T03:00:20.706423+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.715298+0000","last_change":"2024-09-17T03:00:20.714967+0000","last_active":"2024-09-17T03:00:20.715298+0000","last_peered":"2024-09-17T03:00:20.715298+0000","last_clean":"2024-09-17T03:00:20.715298+0000","last_became_active":"2024-09-17T03:00:20.710118+0000","last_became_peered":"2024-09-17T03:00:20.710118+0000","last_unstale":"2024-09-17T03:00:20.715298+0000","last_undegraded":"2024-09-17T03:00:20.715298+0000","last_fullsized":"2024-09-17T03:00:20.715298+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:53.483800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702243+0000","last_change":"2024-09-17T03:00:20.702243+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702243+0000","last_undegraded":"2024-09-17T03:00:20.702243+0000","last_fullsized":"2024-09-17T03:00:20.702243+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.710919+0000","last_change":"2024-09-17T03:00:20.710692+0000","last_active":"2024-09-17T03:00:20.710919+0000","last_peered":"2024-09-17T03:00:20.710919+0000","last_clean":"2024-09-17T03:00:20.710919+0000","last_became_active":"2024-09-17T03:00:20.710092+0000","last_became_peered":"2024-09-17T03:00:20.710092+0000","last_unstale":"2024-09-17T03:00:20.710919+0000","last_undegraded":"2024-09-17T03:00:20.710919+0000","last_fullsized":"2024-09-17T03:00:20.710919+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:57.885988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702606+0000","last_change":"2024-09-17T03:00:20.702606+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702606+0000","last_undegraded":"2024-09-17T03:00:20.702606+0000","last_fullsized":"2024-09-17T03:00:20.702606+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.713846+0000","last_change":"2024-09-17T03:00:20.711935+0000","last_active":"2024-09-17T03:00:20.713846+0000","last_peered":"2024-09-17T03:00:20.713846+0000","last_clean":"2024-09-17T03:00:20.713846+0000","last_became_active":"2024-09-17T03:00:20.711593+0000","last_became_peered":"2024-09-17T03:00:20.711593+0000","last_unstale":"2024-09-17T03:00:20.713846+0000","last_undegraded":"2024-09-17T03:00:20.713846+0000","last_fullsized":"2024-09-17T03:00:20.713846+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:09.109660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702029+0000","last_change":"2024-09-17T03:00:20.702029+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702029+0000","last_undegraded":"2024-09-17T03:00:20.702029+0000","last_fullsized":"2024-09-17T03:00:20.702029+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.717078+0000","last_change":"2024-09-17T03:00:20.716927+0000","last_active":"2024-09-17T03:00:20.717078+0000","last_peered":"2024-09-17T03:00:20.717078+0000","last_clean":"2024-09-17T03:00:20.717078+0000","last_became_active":"2024-09-17T03:00:20.716608+0000","last_became_peered":"2024-09-17T03:00:20.716608+0000","last_unstale":"2024-09-17T03:00:20.717078+0000","last_undegraded":"2024-09-17T03:00:20.717078+0000","last_fullsized":"2024-09-17T03:00:20.717078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:33.480653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.707312+0000","last_change":"2024-09-17T03:00:20.707312+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.707312+0000","last_undegraded":"2024-09-17T03:00:20.707312+0000","last_fullsized":"2024-09-17T03:00:20.707312+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.709760+0000","last_change":"2024-09-17T03:00:20.709303+0000","last_active":"2024-09-17T03:00:20.709760+0000","last_peered":"2024-09-17T03:00:20.709760+0000","last_clean":"2024-09-17T03:00:20.709760+0000","last_became_active":"2024-09-17T03:00:20.709021+0000","last_became_peered":"2024-09-17T03:00:20.709021+0000","last_unstale":"2024-09-17T03:00:20.709760+0000","last_undegraded":"2024-09-17T03:00:20.709760+0000","last_fullsized":"2024-09-17T03:00:20.709760+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:46:54.955286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.702546+0000","last_change":"2024-09-17T03:00:20.702546+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.702546+0000","last_undegraded":"2024-09-17T03:00:20.702546+0000","last_fullsized":"2024-09-17T03:00:20.702546+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.711392+0000","last_change":"2024-09-17T03:00:20.711202+0000","last_active":"2024-09-17T03:00:20.711392+0000","last_peered":"2024-09-17T03:00:20.711392+0000","last_clean":"2024-09-17T03:00:20.711392+0000","last_became_active":"2024-09-17T03:00:20.710535+0000","last_became_peered":"2024-09-17T03:00:20.710535+0000","last_unstale":"2024-09-17T03:00:20.711392+0000","last_undegraded":"2024-09-17T03:00:20.711392+0000","last_fullsized":"2024-09-17T03:00:20.711392+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:12.244482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-09-17T03:00:20.710074+0000","last_change":"2024-09-17T03:00:20.710074+0000","last_active":"2024-09-17T03:00:20.692074+0000","last_peered":"2024-09-17T03:00:20.692074+0000","last_clean":"2024-09-17T03:00:20.692074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:20.710074+0000","last_undegraded":"2024-09-17T03:00:20.710074+0000","last_fullsized":"2024-09-17T03:00:20.710074+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.706938+0000","last_change":"2024-09-17T03:00:20.706322+0000","last_active":"2024-09-17T03:00:20.706938+0000","last_peered":"2024-09-17T03:00:20.706938+0000","last_clean":"2024-09-17T03:00:20.706938+0000","last_became_active":"2024-09-17T03:00:20.706045+0000","last_became_peered":"2024-09-17T03:00:20.706045+0000","last_unstale":"2024-09-17T03:00:20.706938+0000","last_undegraded":"2024-09-17T03:00:20.706938+0000","last_fullsized":"2024-09-17T03:00:20.706938+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:51.063485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":311,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-09-17T03:00:20.699015+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:20.699015+0000","last_peered":"2024-09-17T03:00:20.699015+0000","last_clean":"2024-09-17T03:00:20.699015+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:20.699015+0000","last_undegraded":"2024-09-17T03:00:20.699015+0000","last_fullsized":"2024-09-17T03:00:20.699015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194090,"statfs":{"total":200000000,"available":198748492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194672,"statfs":{"total":200000000,"available":199345135,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":645,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194090,"statfs":{"total":200000000,"available":198748492,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:00:27.053 INFO:tasks.ceph.mds.b.smithi192.stderr:2024-09-17T03:00:27.054+0000 7ffbaa7c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:00:29.162 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.289+0000 7fa3bbd39640 1 -- 172.21.15.104:0/3557486647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3a0004800 msgr2=0x7fa3a0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.289+0000 7fa3bbd39640 1 --2- 172.21.15.104:0/3557486647 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3a0004800 0x7fa3a0004c10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40016c0 tx=0x7fa3a0005830 comp rx=0 tx=0).stop 2024-09-17T03:00:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.289+0000 7fa3ba2d6640 1 -- 172.21.15.104:0/3557486647 reap_dead start 2024-09-17T03:00:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.289+0000 7fa3bbd39640 1 -- 172.21.15.104:0/3557486647 shutdown_connections 2024-09-17T03:00:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.289+0000 7fa3bbd39640 1 -- 172.21.15.104:0/3557486647 >> 172.21.15.104:0/3557486647 conn(0x7fa3b40b2450 msgr2=0x7fa3b40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.289+0000 7fa3bbd39640 1 -- 172.21.15.104:0/3557486647 shutdown_connections 2024-09-17T03:00:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.289+0000 7fa3bbd39640 1 -- 172.21.15.104:0/3557486647 wait complete. 2024-09-17T03:00:29.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.291+0000 7fa3bbd39640 1 Processor -- start 2024-09-17T03:00:29.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.291+0000 7fa3bbd39640 1 -- start start 2024-09-17T03:00:29.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3bbd39640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3a0004800 0x7fa3b415bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:29.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3bbd39640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b40b1690 0x7fa3b40b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3bbd39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b41f7050 0x7fa3b41f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3bbd39640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b406fc50 con 0x7fa3b41f7050 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3bbd39640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b406fad0 con 0x7fa3b40b1690 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3bbd39640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b406fdd0 con 0x7fa3a0004800 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b41f7050 0x7fa3b41f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b41f7050 0x7fa3b41f7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53138/0 (socket says 172.21.15.104:53138) 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 -- 172.21.15.104:0/2289477119 learned_addr learned my addr 172.21.15.104:0/2289477119 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3b9ad5640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3a0004800 0x7fa3b415bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3b92d4640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b40b1690 0x7fa3b40b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 -- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3a0004800 msgr2=0x7fa3b415bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3a0004800 0x7fa3b415bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 -- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b40b1690 msgr2=0x7fa3b40b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b40b1690 0x7fa3b40b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 -- 172.21.15.104:0/2289477119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b41f3830 con 0x7fa3b41f7050 2024-09-17T03:00:29.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.292+0000 7fa3ba2d6640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b41f7050 0x7fa3b41f7460 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4072400 tx=0x7fa3ac006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:29.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.293+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/2289477119 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00fa80 con 0x7fa3b41f7050 2024-09-17T03:00:29.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.293+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/2289477119 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3ac00fc20 con 0x7fa3b41f7050 2024-09-17T03:00:29.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.293+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b41f3ad0 con 0x7fa3b41f7050 2024-09-17T03:00:29.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.293+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/2289477119 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac011430 con 0x7fa3b41f7050 2024-09-17T03:00:29.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.293+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b41f4090 con 0x7fa3b41f7050 2024-09-17T03:00:29.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.294+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b40742a0 con 0x7fa3b41f7050 2024-09-17T03:00:29.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.294+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/2289477119 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3ac0115d0 con 0x7fa3b41f7050 2024-09-17T03:00:29.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.295+0000 7fa3aa7fc640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa398078bc0 0x7fa39807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:29.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.295+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/2289477119 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fa3ac09b5b0 con 0x7fa3b41f7050 2024-09-17T03:00:29.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.295+0000 7fa3b9ad5640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa398078bc0 0x7fa39807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:29.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.296+0000 7fa3b9ad5640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa398078bc0 0x7fa39807b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ce510 tx=0x7fa3b0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:29.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.299+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/2289477119 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3b40742a0 con 0x7fa3b41f7050 2024-09-17T03:00:29.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.471+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3b40b30b0 con 0x7fa398078bc0 2024-09-17T03:00:29.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.476+0000 7fa3aa7fc640 1 -- 172.21.15.104:0/2289477119 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7fa3b40b30b0 con 0x7fa398078bc0 2024-09-17T03:00:29.477 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:29.479 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:29.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa398078bc0 msgr2=0x7fa39807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa398078bc0 0x7fa39807b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ce510 tx=0x7fa3b0005f90 comp rx=0 tx=0).stop 2024-09-17T03:00:29.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b41f7050 msgr2=0x7fa3b41f7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b41f7050 0x7fa3b41f7460 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4072400 tx=0x7fa3ac006660 comp rx=0 tx=0).stop 2024-09-17T03:00:29.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 shutdown_connections 2024-09-17T03:00:29.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa398078bc0 0x7fa39807b0d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3b40b1690 0x7fa3b40b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.480 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa3b41f7050 0x7fa3b41f7460 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 --2- 172.21.15.104:0/2289477119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3a0004800 0x7fa3b415bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 >> 172.21.15.104:0/2289477119 conn(0x7fa3b40b2450 msgr2=0x7fa3b4153460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:29.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 shutdown_connections 2024-09-17T03:00:29.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.479+0000 7fa3bbd39640 1 -- 172.21.15.104:0/2289477119 wait complete. 2024-09-17T03:00:29.490 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-17T03:00:27.706845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6425,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556074,"statfs":{"total":1600000000,"available":1593420724,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.006383"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709040+0000","last_change":"2024-09-17T03:00:21.719845+0000","last_active":"2024-09-17T03:00:22.709040+0000","last_peered":"2024-09-17T03:00:22.709040+0000","last_clean":"2024-09-17T03:00:22.709040+0000","last_became_active":"2024-09-17T03:00:21.719595+0000","last_became_peered":"2024-09-17T03:00:21.719595+0000","last_unstale":"2024-09-17T03:00:22.709040+0000","last_undegraded":"2024-09-17T03:00:22.709040+0000","last_fullsized":"2024-09-17T03:00:22.709040+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:08.508599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196569+0000","last_change":"2024-09-17T03:00:21.721093+0000","last_active":"2024-09-17T03:00:23.196569+0000","last_peered":"2024-09-17T03:00:23.196569+0000","last_clean":"2024-09-17T03:00:23.196569+0000","last_became_active":"2024-09-17T03:00:21.720831+0000","last_became_peered":"2024-09-17T03:00:21.720831+0000","last_unstale":"2024-09-17T03:00:23.196569+0000","last_undegraded":"2024-09-17T03:00:23.196569+0000","last_fullsized":"2024-09-17T03:00:23.196569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:11.341152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.708906+0000","last_change":"2024-09-17T03:00:21.722192+0000","last_active":"2024-09-17T03:00:22.708906+0000","last_peered":"2024-09-17T03:00:22.708906+0000","last_clean":"2024-09-17T03:00:22.708906+0000","last_became_active":"2024-09-17T03:00:21.721950+0000","last_became_peered":"2024-09-17T03:00:21.721950+0000","last_unstale":"2024-09-17T03:00:22.708906+0000","last_undegraded":"2024-09-17T03:00:22.708906+0000","last_fullsized":"2024-09-17T03:00:22.708906+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:05.687413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.995975+0000","last_change":"2024-09-17T03:00:21.711898+0000","last_active":"2024-09-17T03:00:22.995975+0000","last_peered":"2024-09-17T03:00:22.995975+0000","last_clean":"2024-09-17T03:00:22.995975+0000","last_became_active":"2024-09-17T03:00:21.711169+0000","last_became_peered":"2024-09-17T03:00:21.711169+0000","last_unstale":"2024-09-17T03:00:22.995975+0000","last_undegraded":"2024-09-17T03:00:22.995975+0000","last_fullsized":"2024-09-17T03:00:22.995975+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:53.203399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709415+0000","last_change":"2024-09-17T03:00:21.710737+0000","last_active":"2024-09-17T03:00:22.709415+0000","last_peered":"2024-09-17T03:00:22.709415+0000","last_clean":"2024-09-17T03:00:22.709415+0000","last_became_active":"2024-09-17T03:00:21.710458+0000","last_became_peered":"2024-09-17T03:00:21.710458+0000","last_unstale":"2024-09-17T03:00:22.709415+0000","last_undegraded":"2024-09-17T03:00:22.709415+0000","last_fullsized":"2024-09-17T03:00:22.709415+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:12.102262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701612+0000","last_change":"2024-09-17T03:00:21.717953+0000","last_active":"2024-09-17T03:00:22.701612+0000","last_peered":"2024-09-17T03:00:22.701612+0000","last_clean":"2024-09-17T03:00:22.701612+0000","last_became_active":"2024-09-17T03:00:21.717667+0000","last_became_peered":"2024-09-17T03:00:21.717667+0000","last_unstale":"2024-09-17T03:00:22.701612+0000","last_undegraded":"2024-09-17T03:00:22.701612+0000","last_fullsized":"2024-09-17T03:00:22.701612+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:23.892704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701457+0000","last_change":"2024-09-17T03:00:21.718007+0000","last_active":"2024-09-17T03:00:22.701457+0000","last_peered":"2024-09-17T03:00:22.701457+0000","last_clean":"2024-09-17T03:00:22.701457+0000","last_became_active":"2024-09-17T03:00:21.717720+0000","last_became_peered":"2024-09-17T03:00:21.717720+0000","last_unstale":"2024-09-17T03:00:22.701457+0000","last_undegraded":"2024-09-17T03:00:22.701457+0000","last_fullsized":"2024-09-17T03:00:22.701457+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:49.301531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196516+0000","last_change":"2024-09-17T03:00:21.712022+0000","last_active":"2024-09-17T03:00:23.196516+0000","last_peered":"2024-09-17T03:00:23.196516+0000","last_clean":"2024-09-17T03:00:23.196516+0000","last_became_active":"2024-09-17T03:00:21.711701+0000","last_became_peered":"2024-09-17T03:00:21.711701+0000","last_unstale":"2024-09-17T03:00:23.196516+0000","last_undegraded":"2024-09-17T03:00:23.196516+0000","last_fullsized":"2024-09-17T03:00:23.196516+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:50.434332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996542+0000","last_change":"2024-09-17T03:00:21.718109+0000","last_active":"2024-09-17T03:00:22.996542+0000","last_peered":"2024-09-17T03:00:22.996542+0000","last_clean":"2024-09-17T03:00:22.996542+0000","last_became_active":"2024-09-17T03:00:21.717831+0000","last_became_peered":"2024-09-17T03:00:21.717831+0000","last_unstale":"2024-09-17T03:00:22.996542+0000","last_undegraded":"2024-09-17T03:00:22.996542+0000","last_fullsized":"2024-09-17T03:00:22.996542+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:43.281479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709697+0000","last_change":"2024-09-17T03:00:21.723486+0000","last_active":"2024-09-17T03:00:22.709697+0000","last_peered":"2024-09-17T03:00:22.709697+0000","last_clean":"2024-09-17T03:00:22.709697+0000","last_became_active":"2024-09-17T03:00:21.722531+0000","last_became_peered":"2024-09-17T03:00:21.722531+0000","last_unstale":"2024-09-17T03:00:22.709697+0000","last_undegraded":"2024-09-17T03:00:22.709697+0000","last_fullsized":"2024-09-17T03:00:22.709697+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:47.437367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701918+0000","last_change":"2024-09-17T03:00:21.716458+0000","last_active":"2024-09-17T03:00:22.701918+0000","last_peered":"2024-09-17T03:00:22.701918+0000","last_clean":"2024-09-17T03:00:22.701918+0000","last_became_active":"2024-09-17T03:00:21.715813+0000","last_became_peered":"2024-09-17T03:00:21.715813+0000","last_unstale":"2024-09-17T03:00:22.701918+0000","last_undegraded":"2024-09-17T03:00:22.701918+0000","last_fullsized":"2024-09-17T03:00:22.701918+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:50.334220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996869+0000","last_change":"2024-09-17T03:00:21.721633+0000","last_active":"2024-09-17T03:00:22.996869+0000","last_peered":"2024-09-17T03:00:22.996869+0000","last_clean":"2024-09-17T03:00:22.996869+0000","last_became_active":"2024-09-17T03:00:21.720908+0000","last_became_peered":"2024-09-17T03:00:21.720908+0000","last_unstale":"2024-09-17T03:00:22.996869+0000","last_undegraded":"2024-09-17T03:00:22.996869+0000","last_fullsized":"2024-09-17T03:00:22.996869+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:17.061390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996018+0000","last_change":"2024-09-17T03:00:21.722281+0000","last_active":"2024-09-17T03:00:22.996018+0000","last_peered":"2024-09-17T03:00:22.996018+0000","last_clean":"2024-09-17T03:00:22.996018+0000","last_became_active":"2024-09-17T03:00:21.721996+0000","last_became_peered":"2024-09-17T03:00:21.721996+0000","last_unstale":"2024-09-17T03:00:22.996018+0000","last_undegraded":"2024-09-17T03:00:22.996018+0000","last_fullsized":"2024-09-17T03:00:22.996018+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:37.738868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196612+0000","last_change":"2024-09-17T03:00:21.714876+0000","last_active":"2024-09-17T03:00:23.196612+0000","last_peered":"2024-09-17T03:00:23.196612+0000","last_clean":"2024-09-17T03:00:23.196612+0000","last_became_active":"2024-09-17T03:00:21.714617+0000","last_became_peered":"2024-09-17T03:00:21.714617+0000","last_unstale":"2024-09-17T03:00:23.196612+0000","last_undegraded":"2024-09-17T03:00:23.196612+0000","last_fullsized":"2024-09-17T03:00:23.196612+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:24.797426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996330+0000","last_change":"2024-09-17T03:00:21.724929+0000","last_active":"2024-09-17T03:00:22.996330+0000","last_peered":"2024-09-17T03:00:22.996330+0000","last_clean":"2024-09-17T03:00:22.996330+0000","last_became_active":"2024-09-17T03:00:21.724701+0000","last_became_peered":"2024-09-17T03:00:21.724701+0000","last_unstale":"2024-09-17T03:00:22.996330+0000","last_undegraded":"2024-09-17T03:00:22.996330+0000","last_fullsized":"2024-09-17T03:00:22.996330+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:18.079352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.702179+0000","last_change":"2024-09-17T03:00:21.713503+0000","last_active":"2024-09-17T03:00:22.702179+0000","last_peered":"2024-09-17T03:00:22.702179+0000","last_clean":"2024-09-17T03:00:22.702179+0000","last_became_active":"2024-09-17T03:00:21.713247+0000","last_became_peered":"2024-09-17T03:00:21.713247+0000","last_unstale":"2024-09-17T03:00:22.702179+0000","last_undegraded":"2024-09-17T03:00:22.702179+0000","last_fullsized":"2024-09-17T03:00:22.702179+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:48.483306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196811+0000","last_change":"2024-09-17T03:00:21.708932+0000","last_active":"2024-09-17T03:00:23.196811+0000","last_peered":"2024-09-17T03:00:23.196811+0000","last_clean":"2024-09-17T03:00:23.196811+0000","last_became_active":"2024-09-17T03:00:21.708652+0000","last_became_peered":"2024-09-17T03:00:21.708652+0000","last_unstale":"2024-09-17T03:00:23.196811+0000","last_undegraded":"2024-09-17T03:00:23.196811+0000","last_fullsized":"2024-09-17T03:00:23.196811+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:52.404368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996254+0000","last_change":"2024-09-17T03:00:21.708159+0000","last_active":"2024-09-17T03:00:22.996254+0000","last_peered":"2024-09-17T03:00:22.996254+0000","last_clean":"2024-09-17T03:00:22.996254+0000","last_became_active":"2024-09-17T03:00:21.707897+0000","last_became_peered":"2024-09-17T03:00:21.707897+0000","last_unstale":"2024-09-17T03:00:22.996254+0000","last_undegraded":"2024-09-17T03:00:22.996254+0000","last_fullsized":"2024-09-17T03:00:22.996254+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:42.731505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196846+0000","last_change":"2024-09-17T03:00:21.719320+0000","last_active":"2024-09-17T03:00:23.196846+0000","last_peered":"2024-09-17T03:00:23.196846+0000","last_clean":"2024-09-17T03:00:23.196846+0000","last_became_active":"2024-09-17T03:00:21.717846+0000","last_became_peered":"2024-09-17T03:00:21.717846+0000","last_unstale":"2024-09-17T03:00:23.196846+0000","last_undegraded":"2024-09-17T03:00:23.196846+0000","last_fullsized":"2024-09-17T03:00:23.196846+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:56.319785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996588+0000","last_change":"2024-09-17T03:00:21.712423+0000","last_active":"2024-09-17T03:00:22.996588+0000","last_peered":"2024-09-17T03:00:22.996588+0000","last_clean":"2024-09-17T03:00:22.996588+0000","last_became_active":"2024-09-17T03:00:21.712085+0000","last_became_peered":"2024-09-17T03:00:21.712085+0000","last_unstale":"2024-09-17T03:00:22.996588+0000","last_undegraded":"2024-09-17T03:00:22.996588+0000","last_fullsized":"2024-09-17T03:00:22.996588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:28.579897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196805+0000","last_change":"2024-09-17T03:00:21.718764+0000","last_active":"2024-09-17T03:00:23.196805+0000","last_peered":"2024-09-17T03:00:23.196805+0000","last_clean":"2024-09-17T03:00:23.196805+0000","last_became_active":"2024-09-17T03:00:21.718492+0000","last_became_peered":"2024-09-17T03:00:21.718492+0000","last_unstale":"2024-09-17T03:00:23.196805+0000","last_undegraded":"2024-09-17T03:00:23.196805+0000","last_fullsized":"2024-09-17T03:00:23.196805+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:42.215123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197269+0000","last_change":"2024-09-17T03:00:21.720432+0000","last_active":"2024-09-17T03:00:23.197269+0000","last_peered":"2024-09-17T03:00:23.197269+0000","last_clean":"2024-09-17T03:00:23.197269+0000","last_became_active":"2024-09-17T03:00:21.718596+0000","last_became_peered":"2024-09-17T03:00:21.718596+0000","last_unstale":"2024-09-17T03:00:23.197269+0000","last_undegraded":"2024-09-17T03:00:23.197269+0000","last_fullsized":"2024-09-17T03:00:23.197269+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:30.601429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196747+0000","last_change":"2024-09-17T03:00:21.721087+0000","last_active":"2024-09-17T03:00:23.196747+0000","last_peered":"2024-09-17T03:00:23.196747+0000","last_clean":"2024-09-17T03:00:23.196747+0000","last_became_active":"2024-09-17T03:00:21.720554+0000","last_became_peered":"2024-09-17T03:00:21.720554+0000","last_unstale":"2024-09-17T03:00:23.196747+0000","last_undegraded":"2024-09-17T03:00:23.196747+0000","last_fullsized":"2024-09-17T03:00:23.196747+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:01.817233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701502+0000","last_change":"2024-09-17T03:00:21.718164+0000","last_active":"2024-09-17T03:00:22.701502+0000","last_peered":"2024-09-17T03:00:22.701502+0000","last_clean":"2024-09-17T03:00:22.701502+0000","last_became_active":"2024-09-17T03:00:21.717342+0000","last_became_peered":"2024-09-17T03:00:21.717342+0000","last_unstale":"2024-09-17T03:00:22.701502+0000","last_undegraded":"2024-09-17T03:00:22.701502+0000","last_fullsized":"2024-09-17T03:00:22.701502+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:10:40.772376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709898+0000","last_change":"2024-09-17T03:00:21.709739+0000","last_active":"2024-09-17T03:00:22.709898+0000","last_peered":"2024-09-17T03:00:22.709898+0000","last_clean":"2024-09-17T03:00:22.709898+0000","last_became_active":"2024-09-17T03:00:21.709469+0000","last_became_peered":"2024-09-17T03:00:21.709469+0000","last_unstale":"2024-09-17T03:00:22.709898+0000","last_undegraded":"2024-09-17T03:00:22.709898+0000","last_fullsized":"2024-09-17T03:00:22.709898+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:19.986965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197481+0000","last_change":"2024-09-17T03:00:21.720908+0000","last_active":"2024-09-17T03:00:23.197481+0000","last_peered":"2024-09-17T03:00:23.197481+0000","last_clean":"2024-09-17T03:00:23.197481+0000","last_became_active":"2024-09-17T03:00:21.720494+0000","last_became_peered":"2024-09-17T03:00:21.720494+0000","last_unstale":"2024-09-17T03:00:23.197481+0000","last_undegraded":"2024-09-17T03:00:23.197481+0000","last_fullsized":"2024-09-17T03:00:23.197481+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:46.800337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701760+0000","last_change":"2024-09-17T03:00:21.708241+0000","last_active":"2024-09-17T03:00:22.701760+0000","last_peered":"2024-09-17T03:00:22.701760+0000","last_clean":"2024-09-17T03:00:22.701760+0000","last_became_active":"2024-09-17T03:00:21.707966+0000","last_became_peered":"2024-09-17T03:00:21.707966+0000","last_unstale":"2024-09-17T03:00:22.701760+0000","last_undegraded":"2024-09-17T03:00:22.701760+0000","last_fullsized":"2024-09-17T03:00:22.701760+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:51.541902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709619+0000","last_change":"2024-09-17T03:00:21.716270+0000","last_active":"2024-09-17T03:00:22.709619+0000","last_peered":"2024-09-17T03:00:22.709619+0000","last_clean":"2024-09-17T03:00:22.709619+0000","last_became_active":"2024-09-17T03:00:21.714920+0000","last_became_peered":"2024-09-17T03:00:21.714920+0000","last_unstale":"2024-09-17T03:00:22.709619+0000","last_undegraded":"2024-09-17T03:00:22.709619+0000","last_fullsized":"2024-09-17T03:00:22.709619+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:47.921546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196466+0000","last_change":"2024-09-17T03:00:21.715833+0000","last_active":"2024-09-17T03:00:23.196466+0000","last_peered":"2024-09-17T03:00:23.196466+0000","last_clean":"2024-09-17T03:00:23.196466+0000","last_became_active":"2024-09-17T03:00:21.715372+0000","last_became_peered":"2024-09-17T03:00:21.715372+0000","last_unstale":"2024-09-17T03:00:23.196466+0000","last_undegraded":"2024-09-17T03:00:23.196466+0000","last_fullsized":"2024-09-17T03:00:23.196466+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:16:26.628505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197225+0000","last_change":"2024-09-17T03:00:21.724023+0000","last_active":"2024-09-17T03:00:23.197225+0000","last_peered":"2024-09-17T03:00:23.197225+0000","last_clean":"2024-09-17T03:00:23.197225+0000","last_became_active":"2024-09-17T03:00:21.723562+0000","last_became_peered":"2024-09-17T03:00:21.723562+0000","last_unstale":"2024-09-17T03:00:23.197225+0000","last_undegraded":"2024-09-17T03:00:23.197225+0000","last_fullsized":"2024-09-17T03:00:23.197225+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:19.108082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.995955+0000","last_change":"2024-09-17T03:00:21.715488+0000","last_active":"2024-09-17T03:00:22.995955+0000","last_peered":"2024-09-17T03:00:22.995955+0000","last_clean":"2024-09-17T03:00:22.995955+0000","last_became_active":"2024-09-17T03:00:21.715233+0000","last_became_peered":"2024-09-17T03:00:21.715233+0000","last_unstale":"2024-09-17T03:00:22.995955+0000","last_undegraded":"2024-09-17T03:00:22.995955+0000","last_fullsized":"2024-09-17T03:00:22.995955+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:10.430358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709039+0000","last_change":"2024-09-17T03:00:21.720455+0000","last_active":"2024-09-17T03:00:22.709039+0000","last_peered":"2024-09-17T03:00:22.709039+0000","last_clean":"2024-09-17T03:00:22.709039+0000","last_became_active":"2024-09-17T03:00:21.719038+0000","last_became_peered":"2024-09-17T03:00:21.719038+0000","last_unstale":"2024-09-17T03:00:22.709039+0000","last_undegraded":"2024-09-17T03:00:22.709039+0000","last_fullsized":"2024-09-17T03:00:22.709039+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:59.000408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197074+0000","last_change":"2024-09-17T03:00:21.708427+0000","last_active":"2024-09-17T03:00:23.197074+0000","last_peered":"2024-09-17T03:00:23.197074+0000","last_clean":"2024-09-17T03:00:23.197074+0000","last_became_active":"2024-09-17T03:00:21.708105+0000","last_became_peered":"2024-09-17T03:00:21.708105+0000","last_unstale":"2024-09-17T03:00:23.197074+0000","last_undegraded":"2024-09-17T03:00:23.197074+0000","last_fullsized":"2024-09-17T03:00:23.197074+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:49.111129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":19,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197201+0000","last_change":"2024-09-17T03:00:20.712953+0000","last_active":"2024-09-17T03:00:23.197201+0000","last_peered":"2024-09-17T03:00:23.197201+0000","last_clean":"2024-09-17T03:00:23.197201+0000","last_became_active":"2024-09-17T03:00:20.711675+0000","last_became_peered":"2024-09-17T03:00:20.711675+0000","last_unstale":"2024-09-17T03:00:23.197201+0000","last_undegraded":"2024-09-17T03:00:23.197201+0000","last_fullsized":"2024-09-17T03:00:23.197201+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:26.010388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996472+0000","last_change":"2024-09-17T03:00:21.721426+0000","last_active":"2024-09-17T03:00:22.996472+0000","last_peered":"2024-09-17T03:00:22.996472+0000","last_clean":"2024-09-17T03:00:22.996472+0000","last_became_active":"2024-09-17T03:00:21.720975+0000","last_became_peered":"2024-09-17T03:00:21.720975+0000","last_unstale":"2024-09-17T03:00:22.996472+0000","last_undegraded":"2024-09-17T03:00:22.996472+0000","last_fullsized":"2024-09-17T03:00:22.996472+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:27.793966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701731+0000","last_change":"2024-09-17T03:00:20.708495+0000","last_active":"2024-09-17T03:00:22.701731+0000","last_peered":"2024-09-17T03:00:22.701731+0000","last_clean":"2024-09-17T03:00:22.701731+0000","last_became_active":"2024-09-17T03:00:20.708193+0000","last_became_peered":"2024-09-17T03:00:20.708193+0000","last_unstale":"2024-09-17T03:00:22.701731+0000","last_undegraded":"2024-09-17T03:00:22.701731+0000","last_fullsized":"2024-09-17T03:00:22.701731+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:37.557464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709280+0000","last_change":"2024-09-17T03:00:21.717669+0000","last_active":"2024-09-17T03:00:22.709280+0000","last_peered":"2024-09-17T03:00:22.709280+0000","last_clean":"2024-09-17T03:00:22.709280+0000","last_became_active":"2024-09-17T03:00:21.717202+0000","last_became_peered":"2024-09-17T03:00:21.717202+0000","last_unstale":"2024-09-17T03:00:22.709280+0000","last_undegraded":"2024-09-17T03:00:22.709280+0000","last_fullsized":"2024-09-17T03:00:22.709280+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:33.888864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196602+0000","last_change":"2024-09-17T03:00:20.712435+0000","last_active":"2024-09-17T03:00:23.196602+0000","last_peered":"2024-09-17T03:00:23.196602+0000","last_clean":"2024-09-17T03:00:23.196602+0000","last_became_active":"2024-09-17T03:00:20.712152+0000","last_became_peered":"2024-09-17T03:00:20.712152+0000","last_unstale":"2024-09-17T03:00:23.196602+0000","last_undegraded":"2024-09-17T03:00:23.196602+0000","last_fullsized":"2024-09-17T03:00:23.196602+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:01.556494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996868+0000","last_change":"2024-09-17T03:00:21.722258+0000","last_active":"2024-09-17T03:00:22.996868+0000","last_peered":"2024-09-17T03:00:22.996868+0000","last_clean":"2024-09-17T03:00:22.996868+0000","last_became_active":"2024-09-17T03:00:21.721481+0000","last_became_peered":"2024-09-17T03:00:21.721481+0000","last_unstale":"2024-09-17T03:00:22.996868+0000","last_undegraded":"2024-09-17T03:00:22.996868+0000","last_fullsized":"2024-09-17T03:00:22.996868+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:02:00.607987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197655+0000","last_change":"2024-09-17T03:00:20.706619+0000","last_active":"2024-09-17T03:00:23.197655+0000","last_peered":"2024-09-17T03:00:23.197655+0000","last_clean":"2024-09-17T03:00:23.197655+0000","last_became_active":"2024-09-17T03:00:20.706294+0000","last_became_peered":"2024-09-17T03:00:20.706294+0000","last_unstale":"2024-09-17T03:00:23.197655+0000","last_undegraded":"2024-09-17T03:00:23.197655+0000","last_fullsized":"2024-09-17T03:00:23.197655+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:41.385996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197072+0000","last_change":"2024-09-17T03:00:21.724595+0000","last_active":"2024-09-17T03:00:23.197072+0000","last_peered":"2024-09-17T03:00:23.197072+0000","last_clean":"2024-09-17T03:00:23.197072+0000","last_became_active":"2024-09-17T03:00:21.724260+0000","last_became_peered":"2024-09-17T03:00:21.724260+0000","last_unstale":"2024-09-17T03:00:23.197072+0000","last_undegraded":"2024-09-17T03:00:23.197072+0000","last_fullsized":"2024-09-17T03:00:23.197072+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:30.241692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709459+0000","last_change":"2024-09-17T03:00:20.716966+0000","last_active":"2024-09-17T03:00:22.709459+0000","last_peered":"2024-09-17T03:00:22.709459+0000","last_clean":"2024-09-17T03:00:22.709459+0000","last_became_active":"2024-09-17T03:00:20.716681+0000","last_became_peered":"2024-09-17T03:00:20.716681+0000","last_unstale":"2024-09-17T03:00:22.709459+0000","last_undegraded":"2024-09-17T03:00:22.709459+0000","last_fullsized":"2024-09-17T03:00:22.709459+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:41.707867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.702039+0000","last_change":"2024-09-17T03:00:21.713653+0000","last_active":"2024-09-17T03:00:22.702039+0000","last_peered":"2024-09-17T03:00:22.702039+0000","last_clean":"2024-09-17T03:00:22.702039+0000","last_became_active":"2024-09-17T03:00:21.713398+0000","last_became_peered":"2024-09-17T03:00:21.713398+0000","last_unstale":"2024-09-17T03:00:22.702039+0000","last_undegraded":"2024-09-17T03:00:22.702039+0000","last_fullsized":"2024-09-17T03:00:22.702039+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:39.068752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197331+0000","last_change":"2024-09-17T03:00:20.709805+0000","last_active":"2024-09-17T03:00:23.197331+0000","last_peered":"2024-09-17T03:00:23.197331+0000","last_clean":"2024-09-17T03:00:23.197331+0000","last_became_active":"2024-09-17T03:00:20.709291+0000","last_became_peered":"2024-09-17T03:00:20.709291+0000","last_unstale":"2024-09-17T03:00:23.197331+0000","last_undegraded":"2024-09-17T03:00:23.197331+0000","last_fullsized":"2024-09-17T03:00:23.197331+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:04.050676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996569+0000","last_change":"2024-09-17T03:00:21.724228+0000","last_active":"2024-09-17T03:00:22.996569+0000","last_peered":"2024-09-17T03:00:22.996569+0000","last_clean":"2024-09-17T03:00:22.996569+0000","last_became_active":"2024-09-17T03:00:21.724007+0000","last_became_peered":"2024-09-17T03:00:21.724007+0000","last_unstale":"2024-09-17T03:00:22.996569+0000","last_undegraded":"2024-09-17T03:00:22.996569+0000","last_fullsized":"2024-09-17T03:00:22.996569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:26.249668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709779+0000","last_change":"2024-09-17T03:00:20.716327+0000","last_active":"2024-09-17T03:00:22.709779+0000","last_peered":"2024-09-17T03:00:22.709779+0000","last_clean":"2024-09-17T03:00:22.709779+0000","last_became_active":"2024-09-17T03:00:20.716045+0000","last_became_peered":"2024-09-17T03:00:20.716045+0000","last_unstale":"2024-09-17T03:00:22.709779+0000","last_undegraded":"2024-09-17T03:00:22.709779+0000","last_fullsized":"2024-09-17T03:00:22.709779+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:33.669794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996867+0000","last_change":"2024-09-17T03:00:21.724811+0000","last_active":"2024-09-17T03:00:22.996867+0000","last_peered":"2024-09-17T03:00:22.996867+0000","last_clean":"2024-09-17T03:00:22.996867+0000","last_became_active":"2024-09-17T03:00:21.722303+0000","last_became_peered":"2024-09-17T03:00:21.722303+0000","last_unstale":"2024-09-17T03:00:22.996867+0000","last_undegraded":"2024-09-17T03:00:22.996867+0000","last_fullsized":"2024-09-17T03:00:22.996867+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:46.630640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709516+0000","last_change":"2024-09-17T03:00:20.714525+0000","last_active":"2024-09-17T03:00:22.709516+0000","last_peered":"2024-09-17T03:00:22.709516+0000","last_clean":"2024-09-17T03:00:22.709516+0000","last_became_active":"2024-09-17T03:00:20.714180+0000","last_became_peered":"2024-09-17T03:00:20.714180+0000","last_unstale":"2024-09-17T03:00:22.709516+0000","last_undegraded":"2024-09-17T03:00:22.709516+0000","last_fullsized":"2024-09-17T03:00:22.709516+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:05.204129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197043+0000","last_change":"2024-09-17T03:00:21.718844+0000","last_active":"2024-09-17T03:00:23.197043+0000","last_peered":"2024-09-17T03:00:23.197043+0000","last_clean":"2024-09-17T03:00:23.197043+0000","last_became_active":"2024-09-17T03:00:21.718252+0000","last_became_peered":"2024-09-17T03:00:21.718252+0000","last_unstale":"2024-09-17T03:00:23.197043+0000","last_undegraded":"2024-09-17T03:00:23.197043+0000","last_fullsized":"2024-09-17T03:00:23.197043+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:34.628438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709520+0000","last_change":"2024-09-17T03:00:20.716045+0000","last_active":"2024-09-17T03:00:22.709520+0000","last_peered":"2024-09-17T03:00:22.709520+0000","last_clean":"2024-09-17T03:00:22.709520+0000","last_became_active":"2024-09-17T03:00:20.715454+0000","last_became_peered":"2024-09-17T03:00:20.715454+0000","last_unstale":"2024-09-17T03:00:22.709520+0000","last_undegraded":"2024-09-17T03:00:22.709520+0000","last_fullsized":"2024-09-17T03:00:22.709520+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:03.498538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996713+0000","last_change":"2024-09-17T03:00:21.725204+0000","last_active":"2024-09-17T03:00:22.996713+0000","last_peered":"2024-09-17T03:00:22.996713+0000","last_clean":"2024-09-17T03:00:22.996713+0000","last_became_active":"2024-09-17T03:00:21.724732+0000","last_became_peered":"2024-09-17T03:00:21.724732+0000","last_unstale":"2024-09-17T03:00:22.996713+0000","last_undegraded":"2024-09-17T03:00:22.996713+0000","last_fullsized":"2024-09-17T03:00:22.996713+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:15.512856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.995891+0000","last_change":"2024-09-17T03:00:20.707140+0000","last_active":"2024-09-17T03:00:22.995891+0000","last_peered":"2024-09-17T03:00:22.995891+0000","last_clean":"2024-09-17T03:00:22.995891+0000","last_became_active":"2024-09-17T03:00:20.706883+0000","last_became_peered":"2024-09-17T03:00:20.706883+0000","last_unstale":"2024-09-17T03:00:22.995891+0000","last_undegraded":"2024-09-17T03:00:22.995891+0000","last_fullsized":"2024-09-17T03:00:22.995891+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:21.714703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709182+0000","last_change":"2024-09-17T03:00:21.714315+0000","last_active":"2024-09-17T03:00:22.709182+0000","last_peered":"2024-09-17T03:00:22.709182+0000","last_clean":"2024-09-17T03:00:22.709182+0000","last_became_active":"2024-09-17T03:00:21.713979+0000","last_became_peered":"2024-09-17T03:00:21.713979+0000","last_unstale":"2024-09-17T03:00:22.709182+0000","last_undegraded":"2024-09-17T03:00:22.709182+0000","last_fullsized":"2024-09-17T03:00:22.709182+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:20.627697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701739+0000","last_change":"2024-09-17T03:00:20.704627+0000","last_active":"2024-09-17T03:00:22.701739+0000","last_peered":"2024-09-17T03:00:22.701739+0000","last_clean":"2024-09-17T03:00:22.701739+0000","last_became_active":"2024-09-17T03:00:20.704288+0000","last_became_peered":"2024-09-17T03:00:20.704288+0000","last_unstale":"2024-09-17T03:00:22.701739+0000","last_undegraded":"2024-09-17T03:00:22.701739+0000","last_fullsized":"2024-09-17T03:00:22.701739+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:01:52.675134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701589+0000","last_change":"2024-09-17T03:00:21.712459+0000","last_active":"2024-09-17T03:00:22.701589+0000","last_peered":"2024-09-17T03:00:22.701589+0000","last_clean":"2024-09-17T03:00:22.701589+0000","last_became_active":"2024-09-17T03:00:21.712098+0000","last_became_peered":"2024-09-17T03:00:21.712098+0000","last_unstale":"2024-09-17T03:00:22.701589+0000","last_undegraded":"2024-09-17T03:00:22.701589+0000","last_fullsized":"2024-09-17T03:00:22.701589+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:53.020470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":21,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.997199+0000","last_change":"2024-09-17T03:00:20.706770+0000","last_active":"2024-09-17T03:00:22.997199+0000","last_peered":"2024-09-17T03:00:22.997199+0000","last_clean":"2024-09-17T03:00:22.997199+0000","last_became_active":"2024-09-17T03:00:20.706322+0000","last_became_peered":"2024-09-17T03:00:20.706322+0000","last_unstale":"2024-09-17T03:00:22.997199+0000","last_undegraded":"2024-09-17T03:00:22.997199+0000","last_fullsized":"2024-09-17T03:00:22.997199+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:03.236760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996160+0000","last_change":"2024-09-17T03:00:21.709067+0000","last_active":"2024-09-17T03:00:22.996160+0000","last_peered":"2024-09-17T03:00:22.996160+0000","last_clean":"2024-09-17T03:00:22.996160+0000","last_became_active":"2024-09-17T03:00:21.708819+0000","last_became_peered":"2024-09-17T03:00:21.708819+0000","last_unstale":"2024-09-17T03:00:22.996160+0000","last_undegraded":"2024-09-17T03:00:22.996160+0000","last_fullsized":"2024-09-17T03:00:22.996160+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:42.870384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197767+0000","last_change":"2024-09-17T03:00:20.714692+0000","last_active":"2024-09-17T03:00:23.197767+0000","last_peered":"2024-09-17T03:00:23.197767+0000","last_clean":"2024-09-17T03:00:23.197767+0000","last_became_active":"2024-09-17T03:00:20.713971+0000","last_became_peered":"2024-09-17T03:00:20.713971+0000","last_unstale":"2024-09-17T03:00:23.197767+0000","last_undegraded":"2024-09-17T03:00:23.197767+0000","last_fullsized":"2024-09-17T03:00:23.197767+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:01.749462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709281+0000","last_change":"2024-09-17T03:00:21.723282+0000","last_active":"2024-09-17T03:00:22.709281+0000","last_peered":"2024-09-17T03:00:22.709281+0000","last_clean":"2024-09-17T03:00:22.709281+0000","last_became_active":"2024-09-17T03:00:21.723025+0000","last_became_peered":"2024-09-17T03:00:21.723025+0000","last_unstale":"2024-09-17T03:00:22.709281+0000","last_undegraded":"2024-09-17T03:00:22.709281+0000","last_fullsized":"2024-09-17T03:00:22.709281+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:23.449272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197409+0000","last_change":"2024-09-17T03:00:20.710168+0000","last_active":"2024-09-17T03:00:23.197409+0000","last_peered":"2024-09-17T03:00:23.197409+0000","last_clean":"2024-09-17T03:00:23.197409+0000","last_became_active":"2024-09-17T03:00:20.709908+0000","last_became_peered":"2024-09-17T03:00:20.709908+0000","last_unstale":"2024-09-17T03:00:23.197409+0000","last_undegraded":"2024-09-17T03:00:23.197409+0000","last_fullsized":"2024-09-17T03:00:23.197409+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:33.577364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996500+0000","last_change":"2024-09-17T03:00:21.723280+0000","last_active":"2024-09-17T03:00:22.996500+0000","last_peered":"2024-09-17T03:00:22.996500+0000","last_clean":"2024-09-17T03:00:22.996500+0000","last_became_active":"2024-09-17T03:00:21.722950+0000","last_became_peered":"2024-09-17T03:00:21.722950+0000","last_unstale":"2024-09-17T03:00:22.996500+0000","last_undegraded":"2024-09-17T03:00:22.996500+0000","last_fullsized":"2024-09-17T03:00:22.996500+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:07.892368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.997101+0000","last_change":"2024-09-17T03:00:20.710421+0000","last_active":"2024-09-17T03:00:22.997101+0000","last_peered":"2024-09-17T03:00:22.997101+0000","last_clean":"2024-09-17T03:00:22.997101+0000","last_became_active":"2024-09-17T03:00:20.710135+0000","last_became_peered":"2024-09-17T03:00:20.710135+0000","last_unstale":"2024-09-17T03:00:22.997101+0000","last_undegraded":"2024-09-17T03:00:22.997101+0000","last_fullsized":"2024-09-17T03:00:22.997101+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:28.733715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196823+0000","last_change":"2024-09-17T03:00:21.716164+0000","last_active":"2024-09-17T03:00:23.196823+0000","last_peered":"2024-09-17T03:00:23.196823+0000","last_clean":"2024-09-17T03:00:23.196823+0000","last_became_active":"2024-09-17T03:00:21.715550+0000","last_became_peered":"2024-09-17T03:00:21.715550+0000","last_unstale":"2024-09-17T03:00:23.196823+0000","last_undegraded":"2024-09-17T03:00:23.196823+0000","last_fullsized":"2024-09-17T03:00:23.196823+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:57.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":23,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709149+0000","last_change":"2024-09-17T03:00:20.716746+0000","last_active":"2024-09-17T03:00:22.709149+0000","last_peered":"2024-09-17T03:00:22.709149+0000","last_clean":"2024-09-17T03:00:22.709149+0000","last_became_active":"2024-09-17T03:00:20.716463+0000","last_became_peered":"2024-09-17T03:00:20.716463+0000","last_unstale":"2024-09-17T03:00:22.709149+0000","last_undegraded":"2024-09-17T03:00:22.709149+0000","last_fullsized":"2024-09-17T03:00:22.709149+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:11.556006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709500+0000","last_change":"2024-09-17T03:00:21.720681+0000","last_active":"2024-09-17T03:00:22.709500+0000","last_peered":"2024-09-17T03:00:22.709500+0000","last_clean":"2024-09-17T03:00:22.709500+0000","last_became_active":"2024-09-17T03:00:21.720355+0000","last_became_peered":"2024-09-17T03:00:21.720355+0000","last_unstale":"2024-09-17T03:00:22.709500+0000","last_undegraded":"2024-09-17T03:00:22.709500+0000","last_fullsized":"2024-09-17T03:00:22.709500+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:25.786015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.997101+0000","last_change":"2024-09-17T03:00:20.712205+0000","last_active":"2024-09-17T03:00:22.997101+0000","last_peered":"2024-09-17T03:00:22.997101+0000","last_clean":"2024-09-17T03:00:22.997101+0000","last_became_active":"2024-09-17T03:00:20.711889+0000","last_became_peered":"2024-09-17T03:00:20.711889+0000","last_unstale":"2024-09-17T03:00:22.997101+0000","last_undegraded":"2024-09-17T03:00:22.997101+0000","last_fullsized":"2024-09-17T03:00:22.997101+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:55.820701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197007+0000","last_change":"2024-09-17T03:00:21.717669+0000","last_active":"2024-09-17T03:00:23.197007+0000","last_peered":"2024-09-17T03:00:23.197007+0000","last_clean":"2024-09-17T03:00:23.197007+0000","last_became_active":"2024-09-17T03:00:21.717365+0000","last_became_peered":"2024-09-17T03:00:21.717365+0000","last_unstale":"2024-09-17T03:00:23.197007+0000","last_undegraded":"2024-09-17T03:00:23.197007+0000","last_fullsized":"2024-09-17T03:00:23.197007+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:43.055359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709364+0000","last_change":"2024-09-17T03:00:20.712674+0000","last_active":"2024-09-17T03:00:22.709364+0000","last_peered":"2024-09-17T03:00:22.709364+0000","last_clean":"2024-09-17T03:00:22.709364+0000","last_became_active":"2024-09-17T03:00:20.712384+0000","last_became_peered":"2024-09-17T03:00:20.712384+0000","last_unstale":"2024-09-17T03:00:22.709364+0000","last_undegraded":"2024-09-17T03:00:22.709364+0000","last_fullsized":"2024-09-17T03:00:22.709364+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:01.969862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.702357+0000","last_change":"2024-09-17T03:00:21.716109+0000","last_active":"2024-09-17T03:00:22.702357+0000","last_peered":"2024-09-17T03:00:22.702357+0000","last_clean":"2024-09-17T03:00:22.702357+0000","last_became_active":"2024-09-17T03:00:21.715457+0000","last_became_peered":"2024-09-17T03:00:21.715457+0000","last_unstale":"2024-09-17T03:00:22.702357+0000","last_undegraded":"2024-09-17T03:00:22.702357+0000","last_fullsized":"2024-09-17T03:00:22.702357+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:30.334739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197514+0000","last_change":"2024-09-17T03:00:20.707138+0000","last_active":"2024-09-17T03:00:23.197514+0000","last_peered":"2024-09-17T03:00:23.197514+0000","last_clean":"2024-09-17T03:00:23.197514+0000","last_became_active":"2024-09-17T03:00:20.706724+0000","last_became_peered":"2024-09-17T03:00:20.706724+0000","last_unstale":"2024-09-17T03:00:23.197514+0000","last_undegraded":"2024-09-17T03:00:23.197514+0000","last_fullsized":"2024-09-17T03:00:23.197514+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:31.882209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197303+0000","last_change":"2024-09-17T03:00:21.710199+0000","last_active":"2024-09-17T03:00:23.197303+0000","last_peered":"2024-09-17T03:00:23.197303+0000","last_clean":"2024-09-17T03:00:23.197303+0000","last_became_active":"2024-09-17T03:00:21.709878+0000","last_became_peered":"2024-09-17T03:00:21.709878+0000","last_unstale":"2024-09-17T03:00:23.197303+0000","last_undegraded":"2024-09-17T03:00:23.197303+0000","last_fullsized":"2024-09-17T03:00:23.197303+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:38.069268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197450+0000","last_change":"2024-09-17T03:00:20.712055+0000","last_active":"2024-09-17T03:00:23.197450+0000","last_peered":"2024-09-17T03:00:23.197450+0000","last_clean":"2024-09-17T03:00:23.197450+0000","last_became_active":"2024-09-17T03:00:20.710950+0000","last_became_peered":"2024-09-17T03:00:20.710950+0000","last_unstale":"2024-09-17T03:00:23.197450+0000","last_undegraded":"2024-09-17T03:00:23.197450+0000","last_fullsized":"2024-09-17T03:00:23.197450+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:34.835464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197402+0000","last_change":"2024-09-17T03:00:21.713318+0000","last_active":"2024-09-17T03:00:23.197402+0000","last_peered":"2024-09-17T03:00:23.197402+0000","last_clean":"2024-09-17T03:00:23.197402+0000","last_became_active":"2024-09-17T03:00:21.713062+0000","last_became_peered":"2024-09-17T03:00:21.713062+0000","last_unstale":"2024-09-17T03:00:23.197402+0000","last_undegraded":"2024-09-17T03:00:23.197402+0000","last_fullsized":"2024-09-17T03:00:23.197402+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:26.686961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196754+0000","last_change":"2024-09-17T03:00:20.715877+0000","last_active":"2024-09-17T03:00:23.196754+0000","last_peered":"2024-09-17T03:00:23.196754+0000","last_clean":"2024-09-17T03:00:23.196754+0000","last_became_active":"2024-09-17T03:00:20.715603+0000","last_became_peered":"2024-09-17T03:00:20.715603+0000","last_unstale":"2024-09-17T03:00:23.196754+0000","last_undegraded":"2024-09-17T03:00:23.196754+0000","last_fullsized":"2024-09-17T03:00:23.196754+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:28.319444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197234+0000","last_change":"2024-09-17T03:00:21.712336+0000","last_active":"2024-09-17T03:00:23.197234+0000","last_peered":"2024-09-17T03:00:23.197234+0000","last_clean":"2024-09-17T03:00:23.197234+0000","last_became_active":"2024-09-17T03:00:21.711186+0000","last_became_peered":"2024-09-17T03:00:21.711186+0000","last_unstale":"2024-09-17T03:00:23.197234+0000","last_undegraded":"2024-09-17T03:00:23.197234+0000","last_fullsized":"2024-09-17T03:00:23.197234+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:07.221543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196951+0000","last_change":"2024-09-17T03:00:20.711135+0000","last_active":"2024-09-17T03:00:23.196951+0000","last_peered":"2024-09-17T03:00:23.196951+0000","last_clean":"2024-09-17T03:00:23.196951+0000","last_became_active":"2024-09-17T03:00:20.710383+0000","last_became_peered":"2024-09-17T03:00:20.710383+0000","last_unstale":"2024-09-17T03:00:23.196951+0000","last_undegraded":"2024-09-17T03:00:23.196951+0000","last_fullsized":"2024-09-17T03:00:23.196951+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:10.154000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.710037+0000","last_change":"2024-09-17T03:00:21.722984+0000","last_active":"2024-09-17T03:00:22.710037+0000","last_peered":"2024-09-17T03:00:22.710037+0000","last_clean":"2024-09-17T03:00:22.710037+0000","last_became_active":"2024-09-17T03:00:21.721964+0000","last_became_peered":"2024-09-17T03:00:21.721964+0000","last_unstale":"2024-09-17T03:00:22.710037+0000","last_undegraded":"2024-09-17T03:00:22.710037+0000","last_fullsized":"2024-09-17T03:00:22.710037+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:46.303301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197781+0000","last_change":"2024-09-17T03:00:20.710576+0000","last_active":"2024-09-17T03:00:23.197781+0000","last_peered":"2024-09-17T03:00:23.197781+0000","last_clean":"2024-09-17T03:00:23.197781+0000","last_became_active":"2024-09-17T03:00:20.710160+0000","last_became_peered":"2024-09-17T03:00:20.710160+0000","last_unstale":"2024-09-17T03:00:23.197781+0000","last_undegraded":"2024-09-17T03:00:23.197781+0000","last_fullsized":"2024-09-17T03:00:23.197781+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:48.195719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196958+0000","last_change":"2024-09-17T03:00:21.720802+0000","last_active":"2024-09-17T03:00:23.196958+0000","last_peered":"2024-09-17T03:00:23.196958+0000","last_clean":"2024-09-17T03:00:23.196958+0000","last_became_active":"2024-09-17T03:00:21.720184+0000","last_became_peered":"2024-09-17T03:00:21.720184+0000","last_unstale":"2024-09-17T03:00:23.196958+0000","last_undegraded":"2024-09-17T03:00:23.196958+0000","last_fullsized":"2024-09-17T03:00:23.196958+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:14.921499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197290+0000","last_change":"2024-09-17T03:00:20.710615+0000","last_active":"2024-09-17T03:00:23.197290+0000","last_peered":"2024-09-17T03:00:23.197290+0000","last_clean":"2024-09-17T03:00:23.197290+0000","last_became_active":"2024-09-17T03:00:20.710295+0000","last_became_peered":"2024-09-17T03:00:20.710295+0000","last_unstale":"2024-09-17T03:00:23.197290+0000","last_undegraded":"2024-09-17T03:00:23.197290+0000","last_fullsized":"2024-09-17T03:00:23.197290+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:43:59.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709279+0000","last_change":"2024-09-17T03:00:21.719300+0000","last_active":"2024-09-17T03:00:22.709279+0000","last_peered":"2024-09-17T03:00:22.709279+0000","last_clean":"2024-09-17T03:00:22.709279+0000","last_became_active":"2024-09-17T03:00:21.717352+0000","last_became_peered":"2024-09-17T03:00:21.717352+0000","last_unstale":"2024-09-17T03:00:22.709279+0000","last_undegraded":"2024-09-17T03:00:22.709279+0000","last_fullsized":"2024-09-17T03:00:22.709279+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:07.257668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"123'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197642+0000","last_change":"2024-09-17T03:00:20.712374+0000","last_active":"2024-09-17T03:00:23.197642+0000","last_peered":"2024-09-17T03:00:23.197642+0000","last_clean":"2024-09-17T03:00:23.197642+0000","last_became_active":"2024-09-17T03:00:20.711318+0000","last_became_peered":"2024-09-17T03:00:20.711318+0000","last_unstale":"2024-09-17T03:00:23.197642+0000","last_undegraded":"2024-09-17T03:00:23.197642+0000","last_fullsized":"2024-09-17T03:00:23.197642+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:15.710330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709426+0000","last_change":"2024-09-17T03:00:21.721657+0000","last_active":"2024-09-17T03:00:22.709426+0000","last_peered":"2024-09-17T03:00:22.709426+0000","last_clean":"2024-09-17T03:00:22.709426+0000","last_became_active":"2024-09-17T03:00:21.721394+0000","last_became_peered":"2024-09-17T03:00:21.721394+0000","last_unstale":"2024-09-17T03:00:22.709426+0000","last_undegraded":"2024-09-17T03:00:22.709426+0000","last_fullsized":"2024-09-17T03:00:22.709426+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:47.895594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.196648+0000","last_change":"2024-09-17T03:00:20.714967+0000","last_active":"2024-09-17T03:00:23.196648+0000","last_peered":"2024-09-17T03:00:23.196648+0000","last_clean":"2024-09-17T03:00:23.196648+0000","last_became_active":"2024-09-17T03:00:20.710118+0000","last_became_peered":"2024-09-17T03:00:20.710118+0000","last_unstale":"2024-09-17T03:00:23.196648+0000","last_undegraded":"2024-09-17T03:00:23.196648+0000","last_fullsized":"2024-09-17T03:00:23.196648+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:03.033995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709664+0000","last_change":"2024-09-17T03:00:21.711359+0000","last_active":"2024-09-17T03:00:22.709664+0000","last_peered":"2024-09-17T03:00:22.709664+0000","last_clean":"2024-09-17T03:00:22.709664+0000","last_became_active":"2024-09-17T03:00:21.710133+0000","last_became_peered":"2024-09-17T03:00:21.710133+0000","last_unstale":"2024-09-17T03:00:22.709664+0000","last_undegraded":"2024-09-17T03:00:22.709664+0000","last_fullsized":"2024-09-17T03:00:22.709664+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:00.505450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.710138+0000","last_change":"2024-09-17T03:00:20.710692+0000","last_active":"2024-09-17T03:00:22.710138+0000","last_peered":"2024-09-17T03:00:22.710138+0000","last_clean":"2024-09-17T03:00:22.710138+0000","last_became_active":"2024-09-17T03:00:20.710092+0000","last_became_peered":"2024-09-17T03:00:20.710092+0000","last_unstale":"2024-09-17T03:00:22.710138+0000","last_undegraded":"2024-09-17T03:00:22.710138+0000","last_fullsized":"2024-09-17T03:00:22.710138+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:03.397202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197040+0000","last_change":"2024-09-17T03:00:21.717332+0000","last_active":"2024-09-17T03:00:23.197040+0000","last_peered":"2024-09-17T03:00:23.197040+0000","last_clean":"2024-09-17T03:00:23.197040+0000","last_became_active":"2024-09-17T03:00:21.715906+0000","last_became_peered":"2024-09-17T03:00:21.715906+0000","last_unstale":"2024-09-17T03:00:23.197040+0000","last_undegraded":"2024-09-17T03:00:23.197040+0000","last_fullsized":"2024-09-17T03:00:23.197040+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:48.605298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197897+0000","last_change":"2024-09-17T03:00:20.711935+0000","last_active":"2024-09-17T03:00:23.197897+0000","last_peered":"2024-09-17T03:00:23.197897+0000","last_clean":"2024-09-17T03:00:23.197897+0000","last_became_active":"2024-09-17T03:00:20.711593+0000","last_became_peered":"2024-09-17T03:00:20.711593+0000","last_unstale":"2024-09-17T03:00:23.197897+0000","last_undegraded":"2024-09-17T03:00:23.197897+0000","last_fullsized":"2024-09-17T03:00:23.197897+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:01.824417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996897+0000","last_change":"2024-09-17T03:00:21.718105+0000","last_active":"2024-09-17T03:00:22.996897+0000","last_peered":"2024-09-17T03:00:22.996897+0000","last_clean":"2024-09-17T03:00:22.996897+0000","last_became_active":"2024-09-17T03:00:21.717072+0000","last_became_peered":"2024-09-17T03:00:21.717072+0000","last_unstale":"2024-09-17T03:00:22.996897+0000","last_undegraded":"2024-09-17T03:00:22.996897+0000","last_fullsized":"2024-09-17T03:00:22.996897+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:24.556408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709464+0000","last_change":"2024-09-17T03:00:20.716927+0000","last_active":"2024-09-17T03:00:22.709464+0000","last_peered":"2024-09-17T03:00:22.709464+0000","last_clean":"2024-09-17T03:00:22.709464+0000","last_became_active":"2024-09-17T03:00:20.716608+0000","last_became_peered":"2024-09-17T03:00:20.716608+0000","last_unstale":"2024-09-17T03:00:22.709464+0000","last_undegraded":"2024-09-17T03:00:22.709464+0000","last_fullsized":"2024-09-17T03:00:22.709464+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:22.833445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197536+0000","last_change":"2024-09-17T03:00:21.719678+0000","last_active":"2024-09-17T03:00:23.197536+0000","last_peered":"2024-09-17T03:00:23.197536+0000","last_clean":"2024-09-17T03:00:23.197536+0000","last_became_active":"2024-09-17T03:00:21.718221+0000","last_became_peered":"2024-09-17T03:00:21.718221+0000","last_unstale":"2024-09-17T03:00:23.197536+0000","last_undegraded":"2024-09-17T03:00:23.197536+0000","last_fullsized":"2024-09-17T03:00:23.197536+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:06.409825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.996622+0000","last_change":"2024-09-17T03:00:20.709303+0000","last_active":"2024-09-17T03:00:22.996622+0000","last_peered":"2024-09-17T03:00:22.996622+0000","last_clean":"2024-09-17T03:00:22.996622+0000","last_became_active":"2024-09-17T03:00:20.709021+0000","last_became_peered":"2024-09-17T03:00:20.709021+0000","last_unstale":"2024-09-17T03:00:22.996622+0000","last_undegraded":"2024-09-17T03:00:22.996622+0000","last_fullsized":"2024-09-17T03:00:22.996622+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:34.872295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.709248+0000","last_change":"2024-09-17T03:00:21.715265+0000","last_active":"2024-09-17T03:00:22.709248+0000","last_peered":"2024-09-17T03:00:22.709248+0000","last_clean":"2024-09-17T03:00:22.709248+0000","last_became_active":"2024-09-17T03:00:21.714478+0000","last_became_peered":"2024-09-17T03:00:21.714478+0000","last_unstale":"2024-09-17T03:00:22.709248+0000","last_undegraded":"2024-09-17T03:00:22.709248+0000","last_fullsized":"2024-09-17T03:00:22.709248+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:35.682825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197676+0000","last_change":"2024-09-17T03:00:20.711202+0000","last_active":"2024-09-17T03:00:23.197676+0000","last_peered":"2024-09-17T03:00:23.197676+0000","last_clean":"2024-09-17T03:00:23.197676+0000","last_became_active":"2024-09-17T03:00:20.710535+0000","last_became_peered":"2024-09-17T03:00:20.710535+0000","last_unstale":"2024-09-17T03:00:23.197676+0000","last_undegraded":"2024-09-17T03:00:23.197676+0000","last_fullsized":"2024-09-17T03:00:23.197676+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:07.646796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:23.197591+0000","last_change":"2024-09-17T03:00:21.710188+0000","last_active":"2024-09-17T03:00:23.197591+0000","last_peered":"2024-09-17T03:00:23.197591+0000","last_clean":"2024-09-17T03:00:23.197591+0000","last_became_active":"2024-09-17T03:00:21.709595+0000","last_became_peered":"2024-09-17T03:00:21.709595+0000","last_unstale":"2024-09-17T03:00:23.197591+0000","last_undegraded":"2024-09-17T03:00:23.197591+0000","last_fullsized":"2024-09-17T03:00:23.197591+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:20.692074+0000","last_clean_scrub_stamp":"2024-09-17T03:00:20.692074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:43.955146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701840+0000","last_change":"2024-09-17T03:00:20.706322+0000","last_active":"2024-09-17T03:00:22.701840+0000","last_peered":"2024-09-17T03:00:22.701840+0000","last_clean":"2024-09-17T03:00:22.701840+0000","last_became_active":"2024-09-17T03:00:20.706045+0000","last_became_peered":"2024-09-17T03:00:20.706045+0000","last_unstale":"2024-09-17T03:00:22.701840+0000","last_undegraded":"2024-09-17T03:00:22.701840+0000","last_fullsized":"2024-09-17T03:00:22.701840+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:19.690143+0000","last_clean_scrub_stamp":"2024-09-17T03:00:19.690143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:47.146655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":315,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-17T03:00:22.701943+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:22.701943+0000","last_peered":"2024-09-17T03:00:22.701943+0000","last_clean":"2024-09-17T03:00:22.701943+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:22.701943+0000","last_undegraded":"2024-09-17T03:00:22.701943+0000","last_fullsized":"2024-09-17T03:00:22.701943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194077,"statfs":{"total":200000000,"available":198735305,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":659,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194653,"statfs":{"total":200000000,"available":199325133,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325715,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324049,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":660,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194652,"statfs":{"total":200000000,"available":199324151,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325751,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":658,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194654,"statfs":{"total":200000000,"available":199325785,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194076,"statfs":{"total":200000000,"available":198734835,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:00:29.494 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:00:29.494 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:00:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 -- 172.21.15.104:0/1782757300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 msgr2=0x7f5b4c0b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1782757300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 0x7f5b4c0b47f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c072420 tx=0x7f5b3c02a560 comp rx=0 tx=0).stop 2024-09-17T03:00:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 -- 172.21.15.104:0/1782757300 shutdown_connections 2024-09-17T03:00:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1782757300 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c0734f0 0x7f5b4c073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1782757300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 0x7f5b4c0b47f0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1782757300 >> v2:172.21.15.192:3300/0 conn(0x7f5b4c15bd20 0x7f5b4c0b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 -- 172.21.15.104:0/1782757300 >> 172.21.15.104:0/1782757300 conn(0x7f5b4c06d200 msgr2=0x7f5b4c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:29.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 -- 172.21.15.104:0/1782757300 shutdown_connections 2024-09-17T03:00:29.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.650+0000 7f5b546a9640 1 -- 172.21.15.104:0/1782757300 wait complete. 2024-09-17T03:00:29.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.652+0000 7f5b546a9640 1 Processor -- start 2024-09-17T03:00:29.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.652+0000 7f5b546a9640 1 -- start start 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b546a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 0x7f5b4c14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b546a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0734f0 0x7f5b4c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b546a9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c15bd20 0x7f5b4c157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b546a9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c15fcf0 con 0x7f5b4c06f550 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b546a9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c15fb70 con 0x7f5b4c0734f0 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b546a9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5b4c15fe70 con 0x7f5b4c15bd20 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b52445640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 0x7f5b4c14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b52445640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 0x7f5b4c14ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53158/0 (socket says 172.21.15.104:53158) 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b52445640 1 -- 172.21.15.104:0/1659597385 learned_addr learned my addr 172.21.15.104:0/1659597385 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:29.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b52c46640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c15bd20 0x7f5b4c157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.653+0000 7f5b51c44640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0734f0 0x7f5b4c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b52445640 1 -- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c15bd20 msgr2=0x7f5b4c157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b52445640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c15bd20 0x7f5b4c157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b52445640 1 -- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0734f0 msgr2=0x7f5b4c157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b52445640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0734f0 0x7f5b4c157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b52445640 1 -- 172.21.15.104:0/1659597385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4c0b4260 con 0x7f5b4c06f550 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b52445640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 0x7f5b4c14ec50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800c970 tx=0x7f5b4800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b42ffd640 1 -- 172.21.15.104:0/1659597385 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48007bb0 con 0x7f5b4c06f550 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b42ffd640 1 -- 172.21.15.104:0/1659597385 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b48007e40 con 0x7f5b4c06f550 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4c1587b0 con 0x7f5b4c06f550 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b42ffd640 1 -- 172.21.15.104:0/1659597385 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800f690 con 0x7f5b4c06f550 2024-09-17T03:00:29.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.654+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4c14f350 con 0x7f5b4c06f550 2024-09-17T03:00:29.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.655+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b4c14f5e0 con 0x7f5b4c06f550 2024-09-17T03:00:29.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.656+0000 7f5b42ffd640 1 -- 172.21.15.104:0/1659597385 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b4800f830 con 0x7f5b4c06f550 2024-09-17T03:00:29.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.656+0000 7f5b42ffd640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b30078b90 0x7f5b3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:29.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.656+0000 7f5b42ffd640 1 -- 172.21.15.104:0/1659597385 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f5b4809b4b0 con 0x7f5b4c06f550 2024-09-17T03:00:29.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.656+0000 7f5b51c44640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b30078b90 0x7f5b3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:29.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.657+0000 7f5b51c44640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b30078b90 0x7f5b3007b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c033000 tx=0x7f5b3c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:29.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.661+0000 7f5b42ffd640 1 -- 172.21.15.104:0/1659597385 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b4c14f5e0 con 0x7f5b4c06f550 2024-09-17T03:00:29.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.906+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5b4c160390 con 0x7f5b4c06f550 2024-09-17T03:00:29.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.911+0000 7f5b42ffd640 1 -- 172.21.15.104:0/1659597385 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v30) ==== 190+0+147 (secure 0 0 0) 0x7f5b48014030 con 0x7f5b4c06f550 2024-09-17T03:00:29.911 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T03:00:29.911 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T03:00:29.911 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T03:00:29.911 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T03:00:29.911 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:00:29.911 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T03:00:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b30078b90 msgr2=0x7f5b3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b30078b90 0x7f5b3007b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c033000 tx=0x7f5b3c004730 comp rx=0 tx=0).stop 2024-09-17T03:00:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 msgr2=0x7f5b4c14ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 0x7f5b4c14ec50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800c970 tx=0x7f5b4800ce30 comp rx=0 tx=0).stop 2024-09-17T03:00:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 shutdown_connections 2024-09-17T03:00:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b30078b90 0x7f5b3007b0a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b4c0734f0 0x7f5b4c157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b4c15bd20 0x7f5b4c157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 --2- 172.21.15.104:0/1659597385 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b4c06f550 0x7f5b4c14ec50 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:29.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 >> 172.21.15.104:0/1659597385 conn(0x7f5b4c06d200 msgr2=0x7f5b4c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:29.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 shutdown_connections 2024-09-17T03:00:29.914 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:29.913+0000 7f5b546a9640 1 -- 172.21.15.104:0/1659597385 wait complete. 2024-09-17T03:00:29.924 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:30.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.036+0000 7ff83f4de640 1 -- 172.21.15.104:0/2861049940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 msgr2=0x7ff83806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.036+0000 7ff83f4de640 1 --2- 172.21.15.104:0/2861049940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 0x7ff83806f550 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7ff834005fd0 tx=0x7ff83402a530 comp rx=0 tx=0).stop 2024-09-17T03:00:30.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.036+0000 7ff83f4de640 1 -- 172.21.15.104:0/2861049940 shutdown_connections 2024-09-17T03:00:30.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.036+0000 7ff83f4de640 1 --2- 172.21.15.104:0/2861049940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8380734f0 0x7ff838073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.036+0000 7ff83f4de640 1 --2- 172.21.15.104:0/2861049940 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 0x7ff83806f550 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.036+0000 7ff83f4de640 1 -- 172.21.15.104:0/2861049940 >> 172.21.15.104:0/2861049940 conn(0x7ff83806d200 msgr2=0x7ff83806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.036+0000 7ff83f4de640 1 -- 172.21.15.104:0/2861049940 shutdown_connections 2024-09-17T03:00:30.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.036+0000 7ff83f4de640 1 -- 172.21.15.104:0/2861049940 wait complete. 2024-09-17T03:00:30.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.038+0000 7ff83f4de640 1 Processor -- start 2024-09-17T03:00:30.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.038+0000 7ff83f4de640 1 -- start start 2024-09-17T03:00:30.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.039+0000 7ff83f4de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8380734f0 0x7ff838150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.039+0000 7ff83f4de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8380b0500 0x7ff8381588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.039+0000 7ff83f4de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 0x7ff838158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.039+0000 7ff83f4de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff8380b4f20 con 0x7ff83815c220 2024-09-17T03:00:30.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.039+0000 7ff83f4de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8380b1230 con 0x7ff8380734f0 2024-09-17T03:00:30.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.039+0000 7ff83f4de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff8380b50a0 con 0x7ff8380b0500 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 0x7ff838158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 0x7ff838158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53178/0 (socket says 172.21.15.104:53178) 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 -- 172.21.15.104:0/3141692378 learned_addr learned my addr 172.21.15.104:0/3141692378 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83d27a640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8380734f0 0x7ff838150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83ca79640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8380b0500 0x7ff8381588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 -- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8380b0500 msgr2=0x7ff8381588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8380b0500 0x7ff8381588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 -- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8380734f0 msgr2=0x7ff838150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8380734f0 0x7ff838150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 -- 172.21.15.104:0/3141692378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83815d360 con 0x7ff83815c220 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83d27a640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8380734f0 0x7ff838150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83da7b640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 0x7ff838158e20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff83000ba10 tx=0x7ff83000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff82dffb640 1 -- 172.21.15.104:0/3141692378 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830019070 con 0x7ff83815c220 2024-09-17T03:00:30.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff82dffb640 1 -- 172.21.15.104:0/3141692378 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff83000cc90 con 0x7ff83815c220 2024-09-17T03:00:30.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83815d640 con 0x7ff83815c220 2024-09-17T03:00:30.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff82dffb640 1 -- 172.21.15.104:0/3141692378 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8300146a0 con 0x7ff83815c220 2024-09-17T03:00:30.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.040+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83815dc00 con 0x7ff83815c220 2024-09-17T03:00:30.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.041+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8381601f0 con 0x7ff83815c220 2024-09-17T03:00:30.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.042+0000 7ff82dffb640 1 -- 172.21.15.104:0/3141692378 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff83001d3f0 con 0x7ff83815c220 2024-09-17T03:00:30.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.043+0000 7ff82dffb640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff81c078bc0 0x7ff81c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.043+0000 7ff82dffb640 1 -- 172.21.15.104:0/3141692378 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7ff83009a8a0 con 0x7ff83815c220 2024-09-17T03:00:30.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.043+0000 7ff83d27a640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff81c078bc0 0x7ff81c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.043+0000 7ff83d27a640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff81c078bc0 0x7ff81c07b0d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff834033000 tx=0x7ff834004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.047+0000 7ff82dffb640 1 -- 172.21.15.104:0/3141692378 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff830062d70 con 0x7ff83815c220 2024-09-17T03:00:30.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.255+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff838073900 con 0x7ff83815c220 2024-09-17T03:00:30.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.256+0000 7ff82dffb640 1 -- 172.21.15.104:0/3141692378 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7ff830062670 con 0x7ff83815c220 2024-09-17T03:00:30.258 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:30.258 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:21.058657+0000","modified":"2024-09-17T03:00:23.073068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3958916187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3958916187},{"type":"v1","addr":"172.21.15.192:6837","nonce":3958916187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":7}]} 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 48 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff81c078bc0 msgr2=0x7ff81c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff81c078bc0 0x7ff81c07b0d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff834033000 tx=0x7ff834004730 comp rx=0 tx=0).stop 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 msgr2=0x7ff838158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 0x7ff838158e20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff83000ba10 tx=0x7ff83000bed0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 shutdown_connections 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff81c078bc0 0x7ff81c07b0d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83815c220 0x7ff838158e20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8380b0500 0x7ff8381588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 --2- 172.21.15.104:0/3141692378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8380734f0 0x7ff838150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 >> 172.21.15.104:0/3141692378 conn(0x7ff83806d200 msgr2=0x7ff8380d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 shutdown_connections 2024-09-17T03:00:30.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.258+0000 7ff83f4de640 1 -- 172.21.15.104:0/3141692378 wait complete. 2024-09-17T03:00:30.672 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:00:21.058657+0000', 'modified': '2024-09-17T03:00:23.073068+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6696}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6696': {'gid': 6696, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/3958916187', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 3958916187}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 3958916187}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6696, 'qdb_cluster': [6696]} 2024-09-17T03:00:30.672 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:00:30.672 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:00:30.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.790+0000 7f578c60a640 1 -- 172.21.15.104:0/356449876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5770003a30 msgr2=0x7f5770003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.790+0000 7f578c60a640 1 --2- 172.21.15.104:0/356449876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5770003a30 0x7f5770003ea0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f578000c2e0 tx=0x7f5770005830 comp rx=0 tx=0).stop 2024-09-17T03:00:30.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.790+0000 7f578aba7640 1 -- 172.21.15.104:0/356449876 reap_dead start 2024-09-17T03:00:30.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.790+0000 7f578c60a640 1 -- 172.21.15.104:0/356449876 shutdown_connections 2024-09-17T03:00:30.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.790+0000 7f578c60a640 1 -- 172.21.15.104:0/356449876 >> 172.21.15.104:0/356449876 conn(0x7f5784069120 msgr2=0x7f5784069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.790+0000 7f578c60a640 1 -- 172.21.15.104:0/356449876 shutdown_connections 2024-09-17T03:00:30.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.790+0000 7f578c60a640 1 -- 172.21.15.104:0/356449876 wait complete. 2024-09-17T03:00:30.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.792+0000 7f578c60a640 1 Processor -- start 2024-09-17T03:00:30.791 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.792+0000 7f578c60a640 1 -- start start 2024-09-17T03:00:30.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f578c60a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5770003a30 0x7f57840cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f578c60a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57841fa240 0x7f57841f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f578c60a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57840ca2c0 0x7f57840b9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f578c60a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5784161a90 con 0x7f57841fa240 2024-09-17T03:00:30.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f578c60a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f578415f950 con 0x7f5770003a30 2024-09-17T03:00:30.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f578c60a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5784161c10 con 0x7f57840ca2c0 2024-09-17T03:00:30.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f5789ba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57841fa240 0x7f57841f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f5789ba5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57841fa240 0x7f57841f35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53204/0 (socket says 172.21.15.104:53204) 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.793+0000 7f5789ba5640 1 -- 172.21.15.104:0/3536681811 learned_addr learned my addr 172.21.15.104:0/3536681811 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f578aba7640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57840ca2c0 0x7f57840b9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f578a3a6640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5770003a30 0x7f57840cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f5789ba5640 1 -- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57840ca2c0 msgr2=0x7f57840b9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f5789ba5640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57840ca2c0 0x7f57840b9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f5789ba5640 1 -- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5770003a30 msgr2=0x7f57840cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f5789ba5640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5770003a30 0x7f57840cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f5789ba5640 1 -- 172.21.15.104:0/3536681811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57840caad0 con 0x7f57841fa240 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f5789ba5640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57841fa240 0x7f57841f35c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f577400f6c0 tx=0x7f577400fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f577affd640 1 -- 172.21.15.104:0/3536681811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577400baa0 con 0x7f57841fa240 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f577affd640 1 -- 172.21.15.104:0/3536681811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f577400bd30 con 0x7f57841fa240 2024-09-17T03:00:30.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f578c60a640 1 -- 172.21.15.104:0/3536681811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57841f9760 con 0x7f57841fa240 2024-09-17T03:00:30.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f577affd640 1 -- 172.21.15.104:0/3536681811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57740116a0 con 0x7f57841fa240 2024-09-17T03:00:30.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.794+0000 7f578c60a640 1 -- 172.21.15.104:0/3536681811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57840ca6d0 con 0x7f57841fa240 2024-09-17T03:00:30.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.796+0000 7f577affd640 1 -- 172.21.15.104:0/3536681811 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5774019020 con 0x7f57841fa240 2024-09-17T03:00:30.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.797+0000 7f577affd640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5768078bc0 0x7f576807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.797+0000 7f577affd640 1 -- 172.21.15.104:0/3536681811 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f577409b390 con 0x7f57841fa240 2024-09-17T03:00:30.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.797+0000 7f578a3a6640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5768078bc0 0x7f576807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.798+0000 7f578a3a6640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5768078bc0 0x7f576807b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5780033000 tx=0x7f5780038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.798+0000 7f5793652740 1 Processor -- start 2024-09-17T03:00:30.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.798+0000 7f5793652740 1 -- start start 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.799+0000 7f5793652740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b6cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.799+0000 7f5793652740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b6d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.799+0000 7f5793652740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5677a590 0x559a56b8a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.799+0000 7f5793652740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559a56ab5820 con 0x559a5677a590 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.799+0000 7f5793652740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559a56aa4c50 con 0x559a5679b270 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.799+0000 7f5793652740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x559a56aa8a60 con 0x559a567723b0 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5677a590 0x559a56b8a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578a3a6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b6cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5677a590 0x559a56b8a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53216/0 (socket says 172.21.15.104:53216) 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 -- 172.21.15.104:0/3295172096 learned_addr learned my addr 172.21.15.104:0/3295172096 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578a3a6640 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b6cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.104:57558/0 (socket says 172.21.15.104:57558) 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f5789ba5640 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b6d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 -- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 msgr2=0x559a56b6d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b6d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 -- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 msgr2=0x559a56b6cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b6cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 -- 172.21.15.104:0/3295172096 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a56806850 con 0x559a5677a590 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578a3a6640 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b6cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f578aba7640 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5677a590 0x559a56b8a3e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f57840b7bb0 tx=0x7f577c006620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bccdfbbbfb6f30c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f5767fff640 1 -- 172.21.15.104:0/3295172096 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c011b20 con 0x559a5677a590 2024-09-17T03:00:30.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f5767fff640 1 -- 172.21.15.104:0/3295172096 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f577c016070 con 0x559a5677a590 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.800+0000 7f5767fff640 1 -- 172.21.15.104:0/3295172096 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c012440 con 0x559a5677a590 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 -- 172.21.15.104:0/3295172096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5677a590 msgr2=0x559a56b8a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5677a590 0x559a56b8a3e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f57840b7bb0 tx=0x7f577c006620 comp rx=0 tx=0).stop 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 -- 172.21.15.104:0/3295172096 shutdown_connections 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5677a590 0x559a56b8a3e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b6d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 --2- 172.21.15.104:0/3295172096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b6cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 -- 172.21.15.104:0/3295172096 >> 172.21.15.104:0/3295172096 conn(0x559a5678f3c0 msgr2=0x559a56b43260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 -- 172.21.15.104:0/3295172096 shutdown_connections 2024-09-17T03:00:30.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.801+0000 7f5793652740 1 -- 172.21.15.104:0/3295172096 wait complete. 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.802+0000 7f5793652740 1 -- start start 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.802+0000 7f5793652740 1 Processor -- start 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5793652740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b8c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5793652740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b5a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5793652740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5679b270 0x559a56b56770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5793652740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559a56815620 con 0x559a5679b270 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5793652740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559a56a4a5f0 con 0x559a5677a590 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5793652740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x559a56b6da20 con 0x559a567723b0 2024-09-17T03:00:30.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5793652740 10 client.0 _ll_register_callbacks cb 0x559a56a4e0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5679b270 0x559a56b56770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5679b270 0x559a56b56770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53218/0 (socket says 172.21.15.104:53218) 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 -- 172.21.15.104:0/2092732308 learned_addr learned my addr 172.21.15.104:0/2092732308 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578a3a6640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b8c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5789ba5640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b5a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 -- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 msgr2=0x559a56b8c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b8c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 -- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 msgr2=0x559a56b5a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b5a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 -- 172.21.15.104:0/2092732308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5687d6b0 con 0x559a5679b270 2024-09-17T03:00:30.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578a3a6640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b8c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5789ba5640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b5a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f578aba7640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5679b270 0x559a56b56770 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f57700057e0 tx=0x7f577c0012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a00b25f9f86757 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f57657fa640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f57657fa640 1 -- 172.21.15.104:0/2092732308 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c02a060 con 0x559a5679b270 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f57657fa640 1 -- 172.21.15.104:0/2092732308 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f577c011920 con 0x559a5679b270 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.804+0000 7f5793652740 1 -- 172.21.15.104:0/2092732308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f577c016070 con 0x559a5679b270 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f57657fa640 1 -- 172.21.15.104:0/2092732308 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f577c011b20 con 0x559a5679b270 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f5793652740 10 client.6837 fetch_fsmap learned FSMap version 48 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f5793652740 1 -- 172.21.15.104:0/2092732308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x559a56b56d70 con 0x559a5679b270 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f57657fa640 1 -- 172.21.15.104:0/2092732308 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f577c016070 con 0x559a5679b270 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f57657fa640 1 -- 172.21.15.104:0/2092732308 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7f577c033080 con 0x559a5679b270 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f5793652740 10 client.6837 fetch_fsmap finished waiting for FSMap version 48 2024-09-17T03:00:30.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f5793652740 10 client.6837 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f5793652740 20 client.6837 populate_metadata read hostname 'smithi104' 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f5793652740 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] conn(0x559a56759e40 0x559a56b57460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f5793652740 4 client.6837 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f5793652740 1 -- 172.21.15.104:0/2092732308 --> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a56ab7770 con 0x559a56759e40 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.805+0000 7f578a3a6640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] conn(0x559a56759e40 0x559a56b57460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.806+0000 7f57657fa640 10 client.6837 ms_handle_connect on v2:172.21.15.192:6835/3958916187 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.806+0000 7f578a3a6640 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] conn(0x559a56759e40 0x559a56b57460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6f30d89223388a server_cookie=a12f60955620dc98 in_seq=0 out_seq=0 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f57657fa640 1 -- 172.21.15.104:0/2092732308 <== mds.0 v2:172.21.15.192:6835/3958916187 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a56ab7770 con 0x559a56759e40 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f57657fa640 10 client.6837 handle_command_reply: tid=0 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 client.6837 shutdown 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 -- 172.21.15.104:0/2092732308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5679b270 msgr2=0x559a56b56770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5679b270 0x559a56b56770 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f57700057e0 tx=0x7f577c0012f0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 -- 172.21.15.104:0/2092732308 shutdown_connections 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] conn(0x559a56759e40 0x559a56b57460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b5a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a5679b270 0x559a56b56770 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 --2- 172.21.15.104:0/2092732308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a567723b0 0x559a56b8c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f57657fa640 0 client.6837 ms_handle_reset on v2:172.21.15.192:6835/3958916187 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 -- 172.21.15.104:0/2092732308 >> 172.21.15.104:0/2092732308 conn(0x559a5678f3c0 msgr2=0x559a56b43110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 -- 172.21.15.104:0/2092732308 shutdown_connections 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 1 -- 172.21.15.104:0/2092732308 wait complete. 2024-09-17T03:00:30.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.807+0000 7f5793652740 20 client.6837 trim_cache size 0 max 16384 2024-09-17T03:00:30.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.825+0000 7f5793652740 1 Processor -- start 2024-09-17T03:00:30.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.825+0000 7f5793652740 1 -- start start 2024-09-17T03:00:30.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f5793652740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56b437a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f5793652740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5677a590 0x559a56b886e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f5793652740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b88c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f5793652740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5784201fc0 con 0x559a567723b0 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f5793652740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f57840c8f50 con 0x559a5679b270 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f5793652740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f57842019c0 con 0x559a5677a590 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f578a3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56b437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f578a3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56b437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53224/0 (socket says 172.21.15.104:53224) 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.826+0000 7f578a3a6640 1 -- 172.21.15.104:0/3312787672 learned_addr learned my addr 172.21.15.104:0/3312787672 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f578a3a6640 1 -- 172.21.15.104:0/3312787672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5677a590 msgr2=0x559a56b886e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f578a3a6640 1 --2- 172.21.15.104:0/3312787672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5677a590 0x559a56b886e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f578aba7640 1 --2- 172.21.15.104:0/3312787672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b88c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f578a3a6640 1 -- 172.21.15.104:0/3312787672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 msgr2=0x559a56b88c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:00:30.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f578a3a6640 1 --2- 172.21.15.104:0/3312787672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b88c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f578a3a6640 1 -- 172.21.15.104:0/3312787672 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a56b894d0 con 0x559a567723b0 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f578a3a6640 1 --2- 172.21.15.104:0/3312787672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56b437a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f578000c3d0 tx=0x7f5770005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab60c16e0d0a74b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f57677fe640 1 -- 172.21.15.104:0/3312787672 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780031040 con 0x559a567723b0 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f57677fe640 1 -- 172.21.15.104:0/3312787672 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5780003ab0 con 0x559a567723b0 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.827+0000 7f57677fe640 1 -- 172.21.15.104:0/3312787672 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780003e60 con 0x559a567723b0 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 -- 172.21.15.104:0/3312787672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 msgr2=0x559a56b437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 --2- 172.21.15.104:0/3312787672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56b437a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f578000c3d0 tx=0x7f5770005830 comp rx=0 tx=0).stop 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 -- 172.21.15.104:0/3312787672 shutdown_connections 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 --2- 172.21.15.104:0/3312787672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5679b270 0x559a56b88c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 --2- 172.21.15.104:0/3312787672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5677a590 0x559a56b886e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 --2- 172.21.15.104:0/3312787672 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56b437a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 -- 172.21.15.104:0/3312787672 >> 172.21.15.104:0/3312787672 conn(0x559a5678f3c0 msgr2=0x559a56b38920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 -- 172.21.15.104:0/3312787672 shutdown_connections 2024-09-17T03:00:30.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.828+0000 7f5793652740 1 -- 172.21.15.104:0/3312787672 wait complete. 2024-09-17T03:00:30.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.829+0000 7f5793652740 1 -- start start 2024-09-17T03:00:30.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.829+0000 7f5793652740 1 Processor -- start 2024-09-17T03:00:30.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f5793652740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56c0aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f5793652740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b8d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f5793652740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5679b270 0x559a56c09ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f5793652740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x559a56b8be80 con 0x559a567723b0 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f5793652740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559a56b8c980 con 0x559a5677a590 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f5793652740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x559a56b7c4d0 con 0x559a5679b270 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f5793652740 10 client.0 _ll_register_callbacks cb 0x7f577000c170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f578a3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56c0aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f578a3a6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56c0aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53226/0 (socket says 172.21.15.104:53226) 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.830+0000 7f578a3a6640 1 -- 172.21.15.104:0/4195400318 learned_addr learned my addr 172.21.15.104:0/4195400318 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f5789ba5640 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b8d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f578aba7640 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5679b270 0x559a56c09ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f578a3a6640 1 -- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5679b270 msgr2=0x559a56c09ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f578a3a6640 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5679b270 0x559a56c09ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f578a3a6640 1 -- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 msgr2=0x559a56b8d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f578a3a6640 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b8d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f578a3a6640 1 -- 172.21.15.104:0/4195400318 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a56c0a450 con 0x559a567723b0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f578aba7640 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5679b270 0x559a56c09ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f578a3a6640 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56c0aef0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f57800039c0 tx=0x7f5780001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf96bbe423d6901 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f57657fa640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f57657fa640 1 -- 172.21.15.104:0/4195400318 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780031070 con 0x559a567723b0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f57657fa640 1 -- 172.21.15.104:0/4195400318 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f578002e670 con 0x559a567723b0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f5793652740 1 -- 172.21.15.104:0/4195400318 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5780003ab0 con 0x559a567723b0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f57657fa640 1 -- 172.21.15.104:0/4195400318 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f5780065050 con 0x559a567723b0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f5793652740 10 client.6843 fetch_fsmap learned FSMap version 48 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f5793652740 1 -- 172.21.15.104:0/4195400318 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x559a56b55970 con 0x559a567723b0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f57657fa640 1 -- 172.21.15.104:0/4195400318 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5780003ab0 con 0x559a567723b0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f57657fa640 1 -- 172.21.15.104:0/4195400318 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7f5780068020 con 0x559a567723b0 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.831+0000 7f5793652740 10 client.6843 fetch_fsmap finished waiting for FSMap version 48 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5793652740 10 client.6843 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:00:30.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5793652740 20 client.6843 populate_metadata read hostname 'smithi104' 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5793652740 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] conn(0x559a56b5ca60 0x559a56b5ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5793652740 4 client.6843 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5793652740 1 -- 172.21.15.104:0/4195400318 --> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] -- command(tid 0: {"prefix": "status"}) -- 0x559a56ab3220 con 0x559a56b5ca60 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5789ba5640 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] conn(0x559a56b5ca60 0x559a56b5ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f57657fa640 10 client.6843 ms_handle_connect on v2:172.21.15.192:6835/3958916187 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5789ba5640 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] conn(0x559a56b5ca60 0x559a56b5ce70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12915659bd3358b7 server_cookie=9d398184dfe8ec43 in_seq=0 out_seq=0 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f57657fa640 1 -- 172.21.15.104:0/4195400318 <== mds.0 v2:172.21.15.192:6835/3958916187 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x559a56ab3220 con 0x559a56b5ca60 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f57657fa640 10 client.6843 handle_command_reply: tid=0 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5793652740 1 client.6843 shutdown 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5793652740 1 -- 172.21.15.104:0/4195400318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 msgr2=0x559a56c0aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.832+0000 7f5793652740 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56c0aef0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f57800039c0 tx=0x7f5780001770 comp rx=0 tx=0).stop 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 1 -- 172.21.15.104:0/4195400318 shutdown_connections 2024-09-17T03:00:30.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:6835/3958916187,v1:172.21.15.192:6837/3958916187] conn(0x559a56b5ca60 0x559a56b5ce70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a5677a590 0x559a56b8d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x559a5679b270 0x559a56c09ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 1 --2- 172.21.15.104:0/4195400318 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x559a567723b0 0x559a56c0aef0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f57657fa640 0 client.6843 ms_handle_reset on v2:172.21.15.192:6835/3958916187 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 1 -- 172.21.15.104:0/4195400318 >> 172.21.15.104:0/4195400318 conn(0x559a5678f3c0 msgr2=0x559a56b80c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 1 -- 172.21.15.104:0/4195400318 shutdown_connections 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 1 -- 172.21.15.104:0/4195400318 wait complete. 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f5793652740 20 client.6843 trim_cache size 0 max 16384 2024-09-17T03:00:30.838 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 6696, 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.1343997849999994, 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 48, 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 123, 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 123, 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 14.447431916999999 2024-09-17T03:00:30.839 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:00:30.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 -- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5768078bc0 msgr2=0x7f576807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5768078bc0 0x7f576807b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5780033000 tx=0x7f5780038040 comp rx=0 tx=0).stop 2024-09-17T03:00:30.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 -- 172.21.15.104:0/3536681811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57841fa240 msgr2=0x7f57841f35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57841fa240 0x7f57841f35c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f577400f6c0 tx=0x7f577400fb80 comp rx=0 tx=0).stop 2024-09-17T03:00:30.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 -- 172.21.15.104:0/3536681811 shutdown_connections 2024-09-17T03:00:30.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5768078bc0 0x7f576807b0d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57840ca2c0 0x7f57840b9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57841fa240 0x7f57841f35c0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 --2- 172.21.15.104:0/3536681811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5770003a30 0x7f57840cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 -- 172.21.15.104:0/3536681811 >> 172.21.15.104:0/3536681811 conn(0x7f5784069120 msgr2=0x7f5784069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 -- 172.21.15.104:0/3536681811 shutdown_connections 2024-09-17T03:00:30.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.833+0000 7f578c60a640 1 -- 172.21.15.104:0/3536681811 wait complete. 2024-09-17T03:00:30.844 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:00:30.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.956+0000 7fea7a670640 1 -- 172.21.15.104:0/3722113871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b65e0 msgr2=0x7fea740b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.956+0000 7fea7a670640 1 --2- 172.21.15.104:0/3722113871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b65e0 0x7fea740b69f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fea64009830 tx=0x7fea6402a480 comp rx=0 tx=0).stop 2024-09-17T03:00:30.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.956+0000 7fea7a670640 1 -- 172.21.15.104:0/3722113871 shutdown_connections 2024-09-17T03:00:30.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.956+0000 7fea7a670640 1 --2- 172.21.15.104:0/3722113871 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea7415fd10 0x7fea74161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.956+0000 7fea7a670640 1 --2- 172.21.15.104:0/3722113871 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b65e0 0x7fea740b69f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.956+0000 7fea7a670640 1 -- 172.21.15.104:0/3722113871 >> 172.21.15.104:0/3722113871 conn(0x7fea74069120 msgr2=0x7fea74069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:30.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.956+0000 7fea7a670640 1 -- 172.21.15.104:0/3722113871 shutdown_connections 2024-09-17T03:00:30.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.956+0000 7fea7a670640 1 -- 172.21.15.104:0/3722113871 wait complete. 2024-09-17T03:00:30.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.958+0000 7fea7a670640 1 Processor -- start 2024-09-17T03:00:30.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.958+0000 7fea7a670640 1 -- start start 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea7a670640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea740b65e0 0x7fea74149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea7a670640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7415f1f0 0x7fea741f9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea7a670640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7415fd10 0x7fea741f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea7a670640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fea74161e40 con 0x7fea7415f1f0 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea7a670640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fea74161cc0 con 0x7fea7415fd10 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea7a670640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fea74161fc0 con 0x7fea740b65e0 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea6bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7415f1f0 0x7fea741f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea6bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7415f1f0 0x7fea741f9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53246/0 (socket says 172.21.15.104:53246) 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea6bfff640 1 -- 172.21.15.104:0/3557982138 learned_addr learned my addr 172.21.15.104:0/3557982138 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea73fff640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea740b65e0 0x7fea74149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea78c0d640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7415fd10 0x7fea741f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea6bfff640 1 -- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea740b65e0 msgr2=0x7fea74149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea6bfff640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea740b65e0 0x7fea74149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea6bfff640 1 -- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7415fd10 msgr2=0x7fea741f9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea6bfff640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7415fd10 0x7fea741f9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.959+0000 7fea6bfff640 1 -- 172.21.15.104:0/3557982138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea74154200 con 0x7fea7415f1f0 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.960+0000 7fea6bfff640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7415f1f0 0x7fea741f9790 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c760 tx=0x7fea5c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.960+0000 7fea717fa640 1 -- 172.21.15.104:0/3557982138 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c006a90 con 0x7fea7415f1f0 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.960+0000 7fea717fa640 1 -- 172.21.15.104:0/3557982138 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea5c006c30 con 0x7fea7415f1f0 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.960+0000 7fea717fa640 1 -- 172.21.15.104:0/3557982138 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c007290 con 0x7fea7415f1f0 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.960+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7414a500 con 0x7fea7415f1f0 2024-09-17T03:00:30.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.960+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea74154750 con 0x7fea7415f1f0 2024-09-17T03:00:30.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.961+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea741f6d70 con 0x7fea7415f1f0 2024-09-17T03:00:30.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.962+0000 7fea717fa640 1 -- 172.21.15.104:0/3557982138 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea5c007430 con 0x7fea7415f1f0 2024-09-17T03:00:30.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.962+0000 7fea717fa640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea54078bc0 0x7fea5407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:30.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.962+0000 7fea717fa640 1 -- 172.21.15.104:0/3557982138 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fea5c09a7a0 con 0x7fea7415f1f0 2024-09-17T03:00:30.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.962+0000 7fea73fff640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea54078bc0 0x7fea5407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:30.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.963+0000 7fea73fff640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea54078bc0 0x7fea5407b0d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea64034000 tx=0x7fea64004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:30.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:30.967+0000 7fea717fa640 1 -- 172.21.15.104:0/3557982138 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea7414a500 con 0x7fea7415f1f0 2024-09-17T03:00:31.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.174+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fea740d0760 con 0x7fea7415f1f0 2024-09-17T03:00:31.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.174+0000 7fea717fa640 1 -- 172.21.15.104:0/3557982138 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7fea740d0760 con 0x7fea7415f1f0 2024-09-17T03:00:31.174 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:00:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea54078bc0 msgr2=0x7fea5407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea54078bc0 0x7fea5407b0d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea64034000 tx=0x7fea64004730 comp rx=0 tx=0).stop 2024-09-17T03:00:31.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7415f1f0 msgr2=0x7fea741f9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7415f1f0 0x7fea741f9790 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c760 tx=0x7fea5c00cc20 comp rx=0 tx=0).stop 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 shutdown_connections 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea54078bc0 0x7fea5407b0d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea7415fd10 0x7fea741f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea7415f1f0 0x7fea741f9790 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 --2- 172.21.15.104:0/3557982138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea740b65e0 0x7fea74149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.176+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 >> 172.21.15.104:0/3557982138 conn(0x7fea74069120 msgr2=0x7fea740d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.177+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 shutdown_connections 2024-09-17T03:00:31.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31.177+0000 7fea7a670640 1 -- 172.21.15.104:0/3557982138 wait complete. 2024-09-17T03:00:31.187 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:00:31.187 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:00:31.188 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T03:00:31.188 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:00:31.188 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:00:31.188 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:00:31.188 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:00:31.188 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:00:31.188 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:00:31.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:31.188 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:00:31.205 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:00:31.206 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T03:00:31.207 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:31.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:31.208 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:00:31.268 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T03:00:31.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:31.270 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T03:00:31.327 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T03:00:31.327 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:00:31.327 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:00:31.327 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:00:31.327 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:00:31.328 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:00:31.328 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T03:00:31.328 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:00:31.328 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:00:31.328 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:00:31.328 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T03:00:31.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:00:31.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:31.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:31.453 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T03:00:31.468 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:00:31.468 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:00:31.468 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:00:31.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:31.469 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T03:00:31.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:00:31.533 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:00:31.588 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:00:31.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:00:31.589 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:00:31.644 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:00:31.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:31.644 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:00:31.741 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:00:31.742 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:00:31.742 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:00:31.753 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:00:31.753 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:00:31.753 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:00:31.753 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:00:31.753 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:00:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:00:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:00:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:00:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:00:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:00:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:00:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:00:31.772 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:00:31.773 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:00:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:00:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:00:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:00:31.773 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:00:31.774 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:00:31.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:31.775 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:00:31.799 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:00:31.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:00:31.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:31.903 INFO:teuthology.orchestra.run.smithi104.stdout:client5789 2024-09-17T03:00:31.904 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:31.904 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:31.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:00:32.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.073+0000 7f7917e4a640 1 -- 172.21.15.104:0/4041693552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78fc003a00 msgr2=0x7f78fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.073+0000 7f7917e4a640 1 --2- 172.21.15.104:0/4041693552 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78fc003a00 0x7f78fc003e70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7910073e30 tx=0x7f78fc005830 comp rx=0 tx=0).stop 2024-09-17T03:00:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.073+0000 7f79163e7640 1 -- 172.21.15.104:0/4041693552 reap_dead start 2024-09-17T03:00:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.073+0000 7f7917e4a640 1 -- 172.21.15.104:0/4041693552 shutdown_connections 2024-09-17T03:00:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.073+0000 7f7917e4a640 1 -- 172.21.15.104:0/4041693552 >> 172.21.15.104:0/4041693552 conn(0x7f79100d28a0 msgr2=0x7f79100d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.073+0000 7f7917e4a640 1 -- 172.21.15.104:0/4041693552 shutdown_connections 2024-09-17T03:00:32.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.073+0000 7f7917e4a640 1 -- 172.21.15.104:0/4041693552 wait complete. 2024-09-17T03:00:32.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.075+0000 7f7917e4a640 1 Processor -- start 2024-09-17T03:00:32.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.075+0000 7f7917e4a640 1 -- start start 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f7917e4a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78fc003a00 0x7f79101dfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f7917e4a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79101e4920 0x7f79100710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f7917e4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79101e4d30 0x7f79100715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f7917e4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f79100cde90 con 0x7f79101e4d30 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f7917e4a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f79100cfce0 con 0x7f79101e4920 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f7917e4a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f79100ce010 con 0x7f78fc003a00 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79163e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79101e4d30 0x7f79100715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79163e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79101e4d30 0x7f79100715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53258/0 (socket says 172.21.15.104:53258) 2024-09-17T03:00:32.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79163e7640 1 -- 172.21.15.104:0/2804038799 learned_addr learned my addr 172.21.15.104:0/2804038799 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79153e5640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79101e4920 0x7f79100710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f7915be6640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78fc003a00 0x7f79101dfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79163e7640 1 -- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78fc003a00 msgr2=0x7f79101dfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79163e7640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78fc003a00 0x7f79101dfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79163e7640 1 -- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79101e4920 msgr2=0x7f79100710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79163e7640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79101e4920 0x7f79100710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79163e7640 1 -- 172.21.15.104:0/2804038799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79100b0db0 con 0x7f79101e4d30 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f79153e5640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79101e4920 0x7f79100710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.076+0000 7f7915be6640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78fc003a00 0x7f79101dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.077+0000 7f79163e7640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79101e4d30 0x7f79100715e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f79100b3e70 tx=0x7f79080039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.077+0000 7f79067fc640 1 -- 172.21.15.104:0/2804038799 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908011840 con 0x7f79101e4d30 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.077+0000 7f79067fc640 1 -- 172.21.15.104:0/2804038799 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7908018070 con 0x7f79101e4d30 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.077+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79100b1090 con 0x7f79101e4d30 2024-09-17T03:00:32.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.077+0000 7f79067fc640 1 -- 172.21.15.104:0/2804038799 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908011c80 con 0x7f79101e4d30 2024-09-17T03:00:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.077+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79100b1b70 con 0x7f79101e4d30 2024-09-17T03:00:32.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.078+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f791006a700 con 0x7f79101e4d30 2024-09-17T03:00:32.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.079+0000 7f79067fc640 1 -- 172.21.15.104:0/2804038799 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f790801d460 con 0x7f79101e4d30 2024-09-17T03:00:32.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.079+0000 7f79067fc640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f78f4078b90 0x7f78f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:32.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.079+0000 7f79067fc640 1 -- 172.21.15.104:0/2804038799 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f790809b350 con 0x7f79101e4d30 2024-09-17T03:00:32.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.079+0000 7f7915be6640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f78f4078b90 0x7f78f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:32.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.080+0000 7f7915be6640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f78f4078b90 0x7f78f407b0a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f790c036000 tx=0x7f790c004a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:32.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.084+0000 7f79067fc640 1 -- 172.21.15.104:0/2804038799 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7908011e20 con 0x7f79101e4d30 2024-09-17T03:00:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.295+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f79100ce5a0 con 0x7f79101e4d30 2024-09-17T03:00:32.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.295+0000 7f79067fc640 1 -- 172.21.15.104:0/2804038799 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7f7908063820 con 0x7f79101e4d30 2024-09-17T03:00:32.295 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:00:32.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f78f4078b90 msgr2=0x7f78f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:32.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f78f4078b90 0x7f78f407b0a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f790c036000 tx=0x7f790c004a40 comp rx=0 tx=0).stop 2024-09-17T03:00:32.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79101e4d30 msgr2=0x7f79100715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79101e4d30 0x7f79100715e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f79100b3e70 tx=0x7f79080039c0 comp rx=0 tx=0).stop 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 shutdown_connections 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f78f4078b90 0x7f78f407b0a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79101e4920 0x7f79100710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f79101e4d30 0x7f79100715e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 --2- 172.21.15.104:0/2804038799 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78fc003a00 0x7f79101dfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 >> 172.21.15.104:0/2804038799 conn(0x7f79100d28a0 msgr2=0x7f79101e2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.297+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 shutdown_connections 2024-09-17T03:00:32.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:32.298+0000 7f7917e4a640 1 -- 172.21.15.104:0/2804038799 wait complete. 2024-09-17T03:00:32.309 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:00:32.309 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:00:32.309 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T03:00:32.310 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:00:32.310 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:00:32.310 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:00:32.310 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:00:32.310 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:00:32.310 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:00:32.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:32.311 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T03:00:32.332 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:00:32.332 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:00:32.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:00:32.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:32.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T03:00:32.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:32.333 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:00:32.333 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:32.334 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T03:00:32.334 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:00:32.334 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:32.334 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T03:00:32.334 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:00:32.335 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:32.335 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:00:32.335 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:32.335 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:00:32.335 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42462sec preferred_lft 42462sec 2024-09-17T03:00:32.335 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T03:00:32.336 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:32.336 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:00:32.336 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:00:32.336 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:00:32.336 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:32.337 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T03:00:32.337 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:32.337 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:00:32.337 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:00:32.337 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T03:00:32.337 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:32.338 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:00:32.338 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:00:32.338 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T03:00:32.338 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:00:32.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:32.339 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:00:32.400 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T03:00:32.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:32.402 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T03:00:32.460 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T03:00:32.460 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:00:32.460 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:00:32.460 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:00:32.460 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:00:32.461 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:00:32.461 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T03:00:32.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:00:32.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:00:32.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:00:32.461 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T03:00:32.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:00:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:00:32.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:00:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:32.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:32.592 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T03:00:32.607 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:00:32.607 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:00:32.608 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:00:32.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:32.608 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T03:00:32.673 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:00:32.673 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:00:32.731 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:00:32.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:00:32.732 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:00:32.787 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:00:32.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:32.787 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:00:32.881 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:00:32.881 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:00:32.881 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:00:32.892 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:00:32.892 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:00:32.892 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:00:32.892 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:00:32.892 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:00:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:00:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:00:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:00:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:00:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:00:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:00:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:00:32.897 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:00:32.898 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:00:32.898 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:00:32.898 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:00:32.898 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:00:32.898 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:00:32.899 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:00:32.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:32.900 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:00:32.924 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:00:33.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:00:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:00:33.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:00:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:33.020 INFO:teuthology.orchestra.run.smithi192.stdout:client6361 2024-09-17T03:00:33.020 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:33.020 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:33.036 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:33.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.156+0000 7f953abc6640 1 -- 172.21.15.104:0/4002903153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95340b65e0 msgr2=0x7f95340b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:33.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.156+0000 7f953abc6640 1 --2- 172.21.15.104:0/4002903153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95340b65e0 0x7f95340b69f0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9524005fd0 tx=0x7f952402a820 comp rx=0 tx=0).stop 2024-09-17T03:00:33.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.156+0000 7f953abc6640 1 -- 172.21.15.104:0/4002903153 shutdown_connections 2024-09-17T03:00:33.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.156+0000 7f953abc6640 1 --2- 172.21.15.104:0/4002903153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f953415fd10 0x7f9534161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.156+0000 7f953abc6640 1 --2- 172.21.15.104:0/4002903153 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95340b65e0 0x7f95340b69f0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.156+0000 7f953abc6640 1 -- 172.21.15.104:0/4002903153 >> 172.21.15.104:0/4002903153 conn(0x7f9534069120 msgr2=0x7f9534069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:33.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.156+0000 7f953abc6640 1 -- 172.21.15.104:0/4002903153 shutdown_connections 2024-09-17T03:00:33.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.156+0000 7f953abc6640 1 -- 172.21.15.104:0/4002903153 wait complete. 2024-09-17T03:00:33.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.158+0000 7f953abc6640 1 Processor -- start 2024-09-17T03:00:33.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.158+0000 7f953abc6640 1 -- start start 2024-09-17T03:00:33.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f953abc6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95340b65e0 0x7f95340c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:33.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f953abc6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953415f1f0 0x7f953414cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:33.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f953abc6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f953415fd10 0x7f95340cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:33.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f953abc6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9534161da0 con 0x7f953415fd10 2024-09-17T03:00:33.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f953abc6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9534161c20 con 0x7f953415f1f0 2024-09-17T03:00:33.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f953abc6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9534161f20 con 0x7f95340b65e0 2024-09-17T03:00:33.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9539163640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f953415fd10 0x7f95340cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9539163640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f953415fd10 0x7f95340cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53286/0 (socket says 172.21.15.104:53286) 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9539163640 1 -- 172.21.15.104:0/700983430 learned_addr learned my addr 172.21.15.104:0/700983430 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9533fff640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953415f1f0 0x7f953414cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9538962640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95340b65e0 0x7f95340c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9539163640 1 -- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95340b65e0 msgr2=0x7f95340c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9539163640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95340b65e0 0x7f95340c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9539163640 1 -- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953415f1f0 msgr2=0x7f953414cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9539163640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953415f1f0 0x7f953414cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9539163640 1 -- 172.21.15.104:0/700983430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95340ceac0 con 0x7f953415fd10 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.159+0000 7f9538962640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95340b65e0 0x7f95340c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:33.160 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.160+0000 7f9539163640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f953415fd10 0x7f95340cbba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f952c00c970 tx=0x7f952c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:33.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.160+0000 7f95317fa640 1 -- 172.21.15.104:0/700983430 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c004460 con 0x7f953415fd10 2024-09-17T03:00:33.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.160+0000 7f95317fa640 1 -- 172.21.15.104:0/700983430 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f952c0077a0 con 0x7f953415fd10 2024-09-17T03:00:33.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.160+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95340c86f0 con 0x7f953415fd10 2024-09-17T03:00:33.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.160+0000 7f95317fa640 1 -- 172.21.15.104:0/700983430 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952c007bd0 con 0x7f953415fd10 2024-09-17T03:00:33.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.160+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95340c8990 con 0x7f953415fd10 2024-09-17T03:00:33.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.161+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9534162460 con 0x7f953415fd10 2024-09-17T03:00:33.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.162+0000 7f95317fa640 1 -- 172.21.15.104:0/700983430 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f952c0035f0 con 0x7f953415fd10 2024-09-17T03:00:33.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.162+0000 7f95317fa640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9520078b90 0x7f952007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:33.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.162+0000 7f95317fa640 1 -- 172.21.15.104:0/700983430 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f952c09b4b0 con 0x7f953415fd10 2024-09-17T03:00:33.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.162+0000 7f9538962640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9520078b90 0x7f952007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:33.162 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.163+0000 7f9538962640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9520078b90 0x7f952007b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9524034000 tx=0x7f9524004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:33.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.167+0000 7f95317fa640 1 -- 172.21.15.104:0/700983430 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f952c013030 con 0x7f953415fd10 2024-09-17T03:00:33.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.374+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f953415e690 con 0x7f953415fd10 2024-09-17T03:00:33.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.374+0000 7f95317fa640 1 -- 172.21.15.104:0/700983430 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f952c00de20 con 0x7f953415fd10 2024-09-17T03:00:33.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:33.373 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:21.058657+0000","modified":"2024-09-17T03:00:23.073068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3958916187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3958916187},{"type":"v1","addr":"172.21.15.192:6837","nonce":3958916187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":7}]} 2024-09-17T03:00:33.374 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 48 2024-09-17T03:00:33.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9520078b90 msgr2=0x7f952007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:33.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9520078b90 0x7f952007b0a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9524034000 tx=0x7f9524004ab0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f953415fd10 msgr2=0x7f95340cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f953415fd10 0x7f95340cbba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f952c00c970 tx=0x7f952c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 shutdown_connections 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9520078b90 0x7f952007b0a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953415f1f0 0x7f953414cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f953415fd10 0x7f95340cbba0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 --2- 172.21.15.104:0/700983430 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95340b65e0 0x7f95340c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 >> 172.21.15.104:0/700983430 conn(0x7f9534069120 msgr2=0x7f953415f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 shutdown_connections 2024-09-17T03:00:33.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.377+0000 7f953abc6640 1 -- 172.21.15.104:0/700983430 wait complete. 2024-09-17T03:00:33.388 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-17T03:00:33.513 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":6696,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.806776157,"mdsmap_epoch":48,"osdmap_epoch":123,"osdmap_epoch_barrier":123,"uptime":17.119810952000002} 2024-09-17T03:00:33.513 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 6696, "mdsmap_epoch": 48, "osdmap_epoch": 123, "osdmap_epoch_barrier": 123, "rank_uptime": 11.806776157, "state": "up:active", "uptime": 17.119810952, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:00:33.514 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-17T03:00:33.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.634+0000 7f5a18c20640 1 -- 172.21.15.104:0/3690047522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 msgr2=0x7f5a00003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:33.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.634+0000 7f5a18c20640 1 --2- 172.21.15.104:0/3690047522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 0x7f5a00003ec0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009b40 tx=0x7f5a00005830 comp rx=0 tx=0).stop 2024-09-17T03:00:33.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.634+0000 7f5a18c20640 1 -- 172.21.15.104:0/3690047522 shutdown_connections 2024-09-17T03:00:33.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.634+0000 7f5a18c20640 1 --2- 172.21.15.104:0/3690047522 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 0x7f5a00003ec0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.634+0000 7f5a18c20640 1 -- 172.21.15.104:0/3690047522 >> 172.21.15.104:0/3690047522 conn(0x7f5a14068ee0 msgr2=0x7f5a140692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:33.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.634+0000 7f5a18c20640 1 -- 172.21.15.104:0/3690047522 shutdown_connections 2024-09-17T03:00:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.634+0000 7f5a18c20640 1 -- 172.21.15.104:0/3690047522 wait complete. 2024-09-17T03:00:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.636+0000 7f5a18c20640 1 Processor -- start 2024-09-17T03:00:33.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.636+0000 7f5a18c20640 1 -- start start 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a18c20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 0x7f5a141f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a18c20640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a141eff50 0x7f5a140b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a18c20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a14156b60 0x7f5a14153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a18c20640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5a140d2470 con 0x7f5a00003a50 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a18c20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5a140d22f0 con 0x7f5a14156b60 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a18c20640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5a140d25f0 con 0x7f5a141eff50 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a1259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 0x7f5a141f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a1259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 0x7f5a141f31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53312/0 (socket says 172.21.15.104:53312) 2024-09-17T03:00:33.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a1259c640 1 -- 172.21.15.104:0/471889656 learned_addr learned my addr 172.21.15.104:0/471889656 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a12d9d640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a14156b60 0x7f5a14153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.637+0000 7f5a0bfff640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a141eff50 0x7f5a140b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a1259c640 1 -- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a141eff50 msgr2=0x7f5a140b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a1259c640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a141eff50 0x7f5a140b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a1259c640 1 -- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a14156b60 msgr2=0x7f5a14153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a1259c640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a14156b60 0x7f5a14153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a1259c640 1 -- 172.21.15.104:0/471889656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a141f3700 con 0x7f5a00003a50 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a1259c640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 0x7f5a141f31c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009c60 tx=0x7f5a04033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a0affd640 1 -- 172.21.15.104:0/471889656 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04042020 con 0x7f5a00003a50 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a0affd640 1 -- 172.21.15.104:0/471889656 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a0402dd70 con 0x7f5a00003a50 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a0affd640 1 -- 172.21.15.104:0/471889656 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04038040 con 0x7f5a00003a50 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a140b33c0 con 0x7f5a00003a50 2024-09-17T03:00:33.638 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.638+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a141592e0 con 0x7f5a00003a50 2024-09-17T03:00:33.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.639+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a1415ffe0 con 0x7f5a00003a50 2024-09-17T03:00:33.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.640+0000 7f5a0affd640 1 -- 172.21.15.104:0/471889656 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a04045020 con 0x7f5a00003a50 2024-09-17T03:00:33.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.640+0000 7f5a0affd640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f59f4078bc0 0x7f59f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:33.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.641+0000 7f5a0affd640 1 -- 172.21.15.104:0/471889656 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f5a040bdf00 con 0x7f5a00003a50 2024-09-17T03:00:33.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.641+0000 7f5a0bfff640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f59f4078bc0 0x7f59f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:33.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.641+0000 7f5a0bfff640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f59f4078bc0 0x7f59f407b0d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5a141583e0 tx=0x7f59fc0067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:33.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.645+0000 7f5a0affd640 1 -- 172.21.15.104:0/471889656 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a0404c030 con 0x7f5a00003a50 2024-09-17T03:00:33.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:33.820+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f5a140b0ae0 con 0x7f5a00003a50 2024-09-17T03:00:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.766+0000 7f5a0affd640 1 -- 172.21.15.104:0/471889656 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v124) ==== 181+0+0 (secure 0 0 0) 0x7f5a141f3700 con 0x7f5a00003a50 2024-09-17T03:00:34.765 INFO:teuthology.orchestra.run.smithi104.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-17T03:00:34.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f59f4078bc0 msgr2=0x7f59f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:34.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f59f4078bc0 0x7f59f407b0d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5a141583e0 tx=0x7f59fc0067a0 comp rx=0 tx=0).stop 2024-09-17T03:00:34.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 msgr2=0x7f5a141f31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:34.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 0x7f5a141f31c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009c60 tx=0x7f5a04033c90 comp rx=0 tx=0).stop 2024-09-17T03:00:34.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 shutdown_connections 2024-09-17T03:00:34.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f59f4078bc0 0x7f59f407b0d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:34.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a14156b60 0x7f5a14153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:34.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a141eff50 0x7f5a140b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:34.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 --2- 172.21.15.104:0/471889656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5a00003a50 0x7f5a141f31c0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:34.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 >> 172.21.15.104:0/471889656 conn(0x7f5a14068ee0 msgr2=0x7f5a1415d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:34.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 shutdown_connections 2024-09-17T03:00:34.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34.769+0000 7f5a18c20640 1 -- 172.21.15.104:0/471889656 wait complete. 2024-09-17T03:00:34.782 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T03:00:34.782 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T03:00:34.782 DEBUG:teuthology.orchestra.run.smithi104:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-17T03:00:34.782 DEBUG:teuthology.orchestra.run.smithi104:> os.fchmod(fd, 0O666) 2024-09-17T03:00:34.782 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(fd) 2024-09-17T03:00:34.782 DEBUG:teuthology.orchestra.run.smithi104:> os.close(fd) 2024-09-17T03:00:34.782 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T03:00:34.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:34.868 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:00:34.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:00:34.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:34.969 INFO:teuthology.orchestra.run.smithi104.stdout:client5789 2024-09-17T03:00:34.969 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client5789/osdmap') 2024-09-17T03:00:35.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:00:35.027 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 123 barrier 123 flags 0x588000 2024-09-17T03:00:35.027 INFO:teuthology.orchestra.run.smithi104.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:35.027 INFO:teuthology.orchestra.run.smithi104.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:osd0 (1)172.21.15.104:6801 100% (exists, up) 100% -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:osd1 (1)172.21.15.104:6809 100% (exists, up) 100% -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:osd2 (1)172.21.15.104:6825 100% (exists, up) 100% -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:osd3 (1)172.21.15.104:6817 100% (exists, up) 100% -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:osd4 (1)172.21.15.192:6819 100% (exists, up) 100% -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:osd5 (1)172.21.15.192:6803 100% (exists, up) 100% -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:osd6 (1)172.21.15.192:6811 100% (exists, up) 100% -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stdout:osd7 (1)172.21.15.192:6827 100% (exists, up) 100% -1 2024-09-17T03:00:35.028 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records in 2024-09-17T03:00:35.029 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records out 2024-09-17T03:00:35.029 INFO:teuthology.orchestra.run.smithi104.stderr:803 bytes copied, 3.4356e-05 s, 23.4 MB/s 2024-09-17T03:00:35.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:35.035 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-17T03:00:35.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 -- 172.21.15.104:0/1077889639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad40cd6b0 msgr2=0x7f8ad4156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:35.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 --2- 172.21.15.104:0/1077889639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad40cd6b0 0x7f8ad4156a00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4069fb0 tx=0x7f8acc02a980 comp rx=0 tx=0).stop 2024-09-17T03:00:35.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 -- 172.21.15.104:0/1077889639 shutdown_connections 2024-09-17T03:00:35.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 --2- 172.21.15.104:0/1077889639 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad40cd6b0 0x7f8ad4156a00 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 --2- 172.21.15.104:0/1077889639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ad415dd20 0x7f8ad40cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 --2- 172.21.15.104:0/1077889639 >> v2:172.21.15.192:3300/0 conn(0x7f8ad40744d0 0x7f8ad406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 -- 172.21.15.104:0/1077889639 >> 172.21.15.104:0/1077889639 conn(0x7f8ad40b2450 msgr2=0x7f8ad40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:35.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 -- 172.21.15.104:0/1077889639 shutdown_connections 2024-09-17T03:00:35.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.150+0000 7f8ada769640 1 -- 172.21.15.104:0/1077889639 wait complete. 2024-09-17T03:00:35.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.152+0000 7f8ada769640 1 Processor -- start 2024-09-17T03:00:35.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.152+0000 7f8ada769640 1 -- start start 2024-09-17T03:00:35.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.153+0000 7f8ada769640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ad40744d0 0x7f8ad415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:35.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.153+0000 7f8ada769640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ad40cd6b0 0x7f8ad41f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:35.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.153+0000 7f8ada769640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad415dd20 0x7f8ad41458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:35.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.153+0000 7f8ada769640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad41572d0 con 0x7f8ad415dd20 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.153+0000 7f8ada769640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad4157150 con 0x7f8ad40cd6b0 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.153+0000 7f8ada769640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad4157450 con 0x7f8ad40744d0 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad415dd20 0x7f8ad41458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad415dd20 0x7f8ad41458f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54430/0 (socket says 172.21.15.104:54430) 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 -- 172.21.15.104:0/358275773 learned_addr learned my addr 172.21.15.104:0/358275773 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad3fff640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ad40744d0 0x7f8ad415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad37fe640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ad40cd6b0 0x7f8ad41f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 -- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ad40744d0 msgr2=0x7f8ad415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ad40744d0 0x7f8ad415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 -- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ad40cd6b0 msgr2=0x7f8ad41f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ad40cd6b0 0x7f8ad41f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 -- 172.21.15.104:0/358275773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad415b4a0 con 0x7f8ad415dd20 2024-09-17T03:00:35.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad37fe640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ad40cd6b0 0x7f8ad41f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:35.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad8d06640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad415dd20 0x7f8ad41458f0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009d60 tx=0x7f8acc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:35.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad0ff9640 1 -- 172.21.15.104:0/358275773 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc034040 con 0x7f8ad415dd20 2024-09-17T03:00:35.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad0ff9640 1 -- 172.21.15.104:0/358275773 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8acc004540 con 0x7f8ad415dd20 2024-09-17T03:00:35.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad40af550 con 0x7f8ad415dd20 2024-09-17T03:00:35.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ad0ff9640 1 -- 172.21.15.104:0/358275773 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc045480 con 0x7f8ad415dd20 2024-09-17T03:00:35.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.154+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad40af270 con 0x7f8ad415dd20 2024-09-17T03:00:35.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.155+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad4156a00 con 0x7f8ad415dd20 2024-09-17T03:00:35.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.156+0000 7f8ad0ff9640 1 -- 172.21.15.104:0/358275773 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8acc037020 con 0x7f8ad415dd20 2024-09-17T03:00:35.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.157+0000 7f8ad0ff9640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ac0078bc0 0x7f8ac007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:35.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.157+0000 7f8ad0ff9640 1 -- 172.21.15.104:0/358275773 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5709+0+0 (secure 0 0 0) 0x7f8acc0bc500 con 0x7f8ad415dd20 2024-09-17T03:00:35.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.157+0000 7f8ad3fff640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ac0078bc0 0x7f8ac007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:35.156 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.157+0000 7f8ad3fff640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ac0078bc0 0x7f8ac007b0d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40ce510 tx=0x7f8ac400b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:35.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.161+0000 7f8ad0ff9640 1 -- 172.21.15.104:0/358275773 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8acc0849e0 con 0x7f8ad415dd20 2024-09-17T03:00:35.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.343+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7f8ad40b30b0 con 0x7f8ad415dd20 2024-09-17T03:00:35.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.771+0000 7f8ad0ff9640 1 -- 172.21.15.104:0/358275773 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v125) ==== 93+0+0 (secure 0 0 0) 0x7f8acc0842e0 con 0x7f8ad415dd20 2024-09-17T03:00:35.770 INFO:teuthology.orchestra.run.smithi104.stderr:pauserd,pausewr is set 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ac0078bc0 msgr2=0x7f8ac007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ac0078bc0 0x7f8ac007b0d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8ad40ce510 tx=0x7f8ac400b260 comp rx=0 tx=0).stop 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad415dd20 msgr2=0x7f8ad41458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad415dd20 0x7f8ad41458f0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009d60 tx=0x7f8acc003f90 comp rx=0 tx=0).stop 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 shutdown_connections 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ac0078bc0 0x7f8ac007b0d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ad40cd6b0 0x7f8ad41f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ad415dd20 0x7f8ad41458f0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.773 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 --2- 172.21.15.104:0/358275773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ad40744d0 0x7f8ad415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 >> 172.21.15.104:0/358275773 conn(0x7f8ad40b2450 msgr2=0x7f8ad415f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:35.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 shutdown_connections 2024-09-17T03:00:35.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.774+0000 7f8ada769640 1 -- 172.21.15.104:0/358275773 wait complete. 2024-09-17T03:00:35.785 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-17T03:00:35.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.901+0000 7f9c65627640 1 -- 172.21.15.104:0/180513480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 msgr2=0x7f9c4c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.901+0000 7f9c65627640 1 --2- 172.21.15.104:0/180513480 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 0x7f9c4c004800 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f9c6008df00 tx=0x7f9c4c005830 comp rx=0 tx=0).stop 2024-09-17T03:00:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.901+0000 7f9c5f7fe640 1 -- 172.21.15.104:0/180513480 reap_dead start 2024-09-17T03:00:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.901+0000 7f9c65627640 1 -- 172.21.15.104:0/180513480 shutdown_connections 2024-09-17T03:00:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.901+0000 7f9c65627640 1 -- 172.21.15.104:0/180513480 >> 172.21.15.104:0/180513480 conn(0x7f9c60069120 msgr2=0x7f9c60069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.901+0000 7f9c65627640 1 -- 172.21.15.104:0/180513480 shutdown_connections 2024-09-17T03:00:35.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.901+0000 7f9c65627640 1 -- 172.21.15.104:0/180513480 wait complete. 2024-09-17T03:00:35.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.903+0000 7f9c65627640 1 Processor -- start 2024-09-17T03:00:35.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.903+0000 7f9c65627640 1 -- start start 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c65627640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 0x7f9c601f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c65627640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c600c9fa0 0x7f9c600ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c65627640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c60154940 0x7f9c60154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c65627640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9c60168280 con 0x7f9c4c004000 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c65627640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9c60168100 con 0x7f9c600c9fa0 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c65627640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9c60168400 con 0x7f9c60154940 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 0x7f9c601f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5effd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 0x7f9c601f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54434/0 (socket says 172.21.15.104:54434) 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5effd640 1 -- 172.21.15.104:0/3136059203 learned_addr learned my addr 172.21.15.104:0/3136059203 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:35.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c567fc640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c600c9fa0 0x7f9c600ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5f7fe640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c60154940 0x7f9c60154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5effd640 1 -- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c60154940 msgr2=0x7f9c60154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5effd640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c60154940 0x7f9c60154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5effd640 1 -- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c600c9fa0 msgr2=0x7f9c600ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5effd640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c600c9fa0 0x7f9c600ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.904+0000 7f9c5effd640 1 -- 172.21.15.104:0/3136059203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c600cea80 con 0x7f9c4c004000 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.905+0000 7f9c5effd640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 0x7f9c601f6d50 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006680 tx=0x7f9c500066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.905+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50015070 con 0x7f9c4c004000 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.905+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c50011900 con 0x7f9c4c004000 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.905+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50011d50 con 0x7f9c4c004000 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.905+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c60155290 con 0x7f9c4c004000 2024-09-17T03:00:35.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.905+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c600cbcd0 con 0x7f9c4c004000 2024-09-17T03:00:35.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.906+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6015f600 con 0x7f9c4c004000 2024-09-17T03:00:35.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.907+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c50010420 con 0x7f9c4c004000 2024-09-17T03:00:35.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.907+0000 7f9c57fff640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c40078bc0 0x7f9c4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:35.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.907+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5709+0+0 (secure 0 0 0) 0x7f9c5009b930 con 0x7f9c4c004000 2024-09-17T03:00:35.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.907+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=126+}) -- 0x7f9c400807a0 con 0x7f9c4c004000 2024-09-17T03:00:35.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.907+0000 7f9c567fc640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c40078bc0 0x7f9c4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:35.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.908+0000 7f9c567fc640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c40078bc0 0x7f9c4007b0d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9c48032000 tx=0x7f9c48001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:35.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:35.912+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9c500637c0 con 0x7f9c4c004000 2024-09-17T03:00:36.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:00:36.022 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:00:36.097 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.099+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7f9c600c8380 con 0x7f9c4c004000 2024-09-17T03:00:36.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.773+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v126) ==== 97+0+0 (secure 0 0 0) 0x7f9c500681f0 con 0x7f9c4c004000 2024-09-17T03:00:36.772 INFO:teuthology.orchestra.run.smithi104.stderr:pauserd,pausewr is unset 2024-09-17T03:00:36.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.774+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(126..126 src has 1..126) ==== 288+0+0 (secure 0 0 0) 0x7f9c50099f70 con 0x7f9c4c004000 2024-09-17T03:00:36.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.774+0000 7f9c57fff640 1 -- 172.21.15.104:0/3136059203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=127}) -- 0x7f9c40081170 con 0x7f9c4c004000 2024-09-17T03:00:36.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c40078bc0 msgr2=0x7f9c4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:36.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c40078bc0 0x7f9c4007b0d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9c48032000 tx=0x7f9c48001190 comp rx=0 tx=0).stop 2024-09-17T03:00:36.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 msgr2=0x7f9c601f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:36.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 0x7f9c601f6d50 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006680 tx=0x7f9c500066b0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 shutdown_connections 2024-09-17T03:00:36.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c40078bc0 0x7f9c4007b0d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c600c9fa0 0x7f9c600ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c60154940 0x7f9c60154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 --2- 172.21.15.104:0/3136059203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9c4c004000 0x7f9c601f6d50 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 >> 172.21.15.104:0/3136059203 conn(0x7f9c60069120 msgr2=0x7f9c600b5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:36.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 shutdown_connections 2024-09-17T03:00:36.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.777+0000 7f9c65627640 1 -- 172.21.15.104:0/3136059203 wait complete. 2024-09-17T03:00:36.788 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:36.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.943+0000 7f6f4fed3640 1 -- 172.21.15.104:0/841589905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f480cd880 msgr2=0x7f6f48156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:36.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.943+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/841589905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f480cd880 0x7f6f48156a00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6f40005fd0 tx=0x7f6f4002a970 comp rx=0 tx=0).stop 2024-09-17T03:00:36.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.943+0000 7f6f4fed3640 1 -- 172.21.15.104:0/841589905 shutdown_connections 2024-09-17T03:00:36.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.943+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/841589905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f480cd880 0x7f6f48156a00 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.943+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/841589905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f480744d0 0x7f6f4806fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.943+0000 7f6f4fed3640 1 -- 172.21.15.104:0/841589905 >> 172.21.15.104:0/841589905 conn(0x7f6f480b2450 msgr2=0x7f6f480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:36.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.943+0000 7f6f4fed3640 1 -- 172.21.15.104:0/841589905 shutdown_connections 2024-09-17T03:00:36.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.943+0000 7f6f4fed3640 1 -- 172.21.15.104:0/841589905 wait complete. 2024-09-17T03:00:36.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.945+0000 7f6f4fed3640 1 Processor -- start 2024-09-17T03:00:36.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.945+0000 7f6f4fed3640 1 -- start start 2024-09-17T03:00:36.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4fed3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f480744d0 0x7f6f4814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:36.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4fed3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f4815dd20 0x7f6f4815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4fed3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f4814bf40 0x7f6f4815c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4fed3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6f481572d0 con 0x7f6f4815dd20 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4fed3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6f48157150 con 0x7f6f4814bf40 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4fed3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6f48157450 con 0x7f6f480744d0 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4d46e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f4815dd20 0x7f6f4815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4d46e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f4815dd20 0x7f6f4815bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54450/0 (socket says 172.21.15.104:54450) 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4d46e640 1 -- 172.21.15.104:0/2710293205 learned_addr learned my addr 172.21.15.104:0/2710293205 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4dc6f640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f480744d0 0x7f6f4814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4e470640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f4814bf40 0x7f6f4815c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4d46e640 1 -- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f480744d0 msgr2=0x7f6f4814b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4d46e640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f480744d0 0x7f6f4814b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4d46e640 1 -- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f4814bf40 msgr2=0x7f6f4815c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:36.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4d46e640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f4814bf40 0x7f6f4815c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:36.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.946+0000 7f6f4d46e640 1 -- 172.21.15.104:0/2710293205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4814bd30 con 0x7f6f4815dd20 2024-09-17T03:00:36.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.947+0000 7f6f4d46e640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f4815dd20 0x7f6f4815bd70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800b3f0 tx=0x7f6f3800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:36.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.947+0000 7f6f3e7fc640 1 -- 172.21.15.104:0/2710293205 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38015020 con 0x7f6f4815dd20 2024-09-17T03:00:36.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.947+0000 7f6f3e7fc640 1 -- 172.21.15.104:0/2710293205 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f38011920 con 0x7f6f4815dd20 2024-09-17T03:00:36.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.947+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f481f99f0 con 0x7f6f4815dd20 2024-09-17T03:00:36.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.947+0000 7f6f3e7fc640 1 -- 172.21.15.104:0/2710293205 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38011d70 con 0x7f6f4815dd20 2024-09-17T03:00:36.947 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.947+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f480b4370 con 0x7f6f4815dd20 2024-09-17T03:00:36.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.948+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f48160270 con 0x7f6f4815dd20 2024-09-17T03:00:36.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.948+0000 7f6f3e7fc640 1 -- 172.21.15.104:0/2710293205 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f38018020 con 0x7f6f4815dd20 2024-09-17T03:00:36.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.949+0000 7f6f3e7fc640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f2c078b90 0x7f6f2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:36.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.949+0000 7f6f3e7fc640 1 -- 172.21.15.104:0/2710293205 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7f6f3809aa80 con 0x7f6f4815dd20 2024-09-17T03:00:36.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.949+0000 7f6f4dc6f640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f2c078b90 0x7f6f2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:36.948 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.950+0000 7f6f4dc6f640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f2c078b90 0x7f6f2c07b0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400a490 tx=0x7f6f4400a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:36.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:36.954+0000 7f6f3e7fc640 1 -- 172.21.15.104:0/2710293205 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6f48160270 con 0x7f6f4815dd20 2024-09-17T03:00:37.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.129+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f48150170 con 0x7f6f4815dd20 2024-09-17T03:00:37.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.130+0000 7f6f3e7fc640 1 -- 172.21.15.104:0/2710293205 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+16735 (secure 0 0 0) 0x7f6f3801f020 con 0x7f6f4815dd20 2024-09-17T03:00:37.129 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:37.129 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":126,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:36.772203+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:18.716486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:20.027435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f2c078b90 msgr2=0x7f6f2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f2c078b90 0x7f6f2c07b0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400a490 tx=0x7f6f4400a420 comp rx=0 tx=0).stop 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f4815dd20 msgr2=0x7f6f4815bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f4815dd20 0x7f6f4815bd70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800b3f0 tx=0x7f6f3800b8b0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 shutdown_connections 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f2c078b90 0x7f6f2c07b0a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f4814bf40 0x7f6f4815c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f4815dd20 0x7f6f4815bd70 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 --2- 172.21.15.104:0/2710293205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f480744d0 0x7f6f4814b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 >> 172.21.15.104:0/2710293205 conn(0x7f6f480b2450 msgr2=0x7f6f480cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:37.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 shutdown_connections 2024-09-17T03:00:37.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.132+0000 7f6f4fed3640 1 -- 172.21.15.104:0/2710293205 wait complete. 2024-09-17T03:00:37.142 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T03:00:37.142 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T03:00:37.143 DEBUG:teuthology.orchestra.run.smithi104:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-17T03:00:37.143 DEBUG:teuthology.orchestra.run.smithi104:> os.fchmod(fd, 0O666) 2024-09-17T03:00:37.143 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(fd) 2024-09-17T03:00:37.143 DEBUG:teuthology.orchestra.run.smithi104:> os.close(fd) 2024-09-17T03:00:37.143 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T03:00:37.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:37.218 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:00:37.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:00:37.309 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:37.314 INFO:teuthology.orchestra.run.smithi104.stdout:client5789 2024-09-17T03:00:37.315 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client5789/osdmap') 2024-09-17T03:00:37.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:00:37.373 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 123 barrier 123 flags 0x588000 2024-09-17T03:00:37.373 INFO:teuthology.orchestra.run.smithi104.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:37.373 INFO:teuthology.orchestra.run.smithi104.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:37.373 INFO:teuthology.orchestra.run.smithi104.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:37.373 INFO:teuthology.orchestra.run.smithi104.stdout:osd0 (1)172.21.15.104:6801 100% (exists, up) 100% -1 2024-09-17T03:00:37.373 INFO:teuthology.orchestra.run.smithi104.stdout:osd1 (1)172.21.15.104:6809 100% (exists, up) 100% -1 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stdout:osd2 (1)172.21.15.104:6825 100% (exists, up) 100% -1 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stdout:osd3 (1)172.21.15.104:6817 100% (exists, up) 100% -1 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stdout:osd4 (1)172.21.15.192:6819 100% (exists, up) 100% -1 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stdout:osd5 (1)172.21.15.192:6803 100% (exists, up) 100% -1 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stdout:osd6 (1)172.21.15.192:6811 100% (exists, up) 100% -1 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stdout:osd7 (1)172.21.15.192:6827 100% (exists, up) 100% -1 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records in 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records out 2024-09-17T03:00:37.374 INFO:teuthology.orchestra.run.smithi104.stderr:803 bytes copied, 3.4574e-05 s, 23.2 MB/s 2024-09-17T03:00:37.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:37.380 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:37.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.494+0000 7f82aafc3640 1 -- 172.21.15.104:0/3665446894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a415c220 msgr2=0x7f82a406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:37.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.494+0000 7f82aafc3640 1 --2- 172.21.15.104:0/3665446894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a415c220 0x7f82a406f550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009860 tx=0x7f82a002a530 comp rx=0 tx=0).stop 2024-09-17T03:00:37.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.494+0000 7f82aafc3640 1 -- 172.21.15.104:0/3665446894 shutdown_connections 2024-09-17T03:00:37.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.494+0000 7f82aafc3640 1 --2- 172.21.15.104:0/3665446894 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a415c220 0x7f82a406f550 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.494+0000 7f82aafc3640 1 -- 172.21.15.104:0/3665446894 >> 172.21.15.104:0/3665446894 conn(0x7f82a406d200 msgr2=0x7f82a406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:37.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.494+0000 7f82aafc3640 1 -- 172.21.15.104:0/3665446894 shutdown_connections 2024-09-17T03:00:37.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.494+0000 7f82aafc3640 1 -- 172.21.15.104:0/3665446894 wait complete. 2024-09-17T03:00:37.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.495+0000 7f82aafc3640 1 Processor -- start 2024-09-17T03:00:37.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.495+0000 7f82aafc3640 1 -- start start 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f82aafc3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40734f0 0x7f82a40af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f82aafc3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82a40b0500 0x7f82a4146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f82aafc3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a415c220 0x7f82a414dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f82aafc3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f82a40b60b0 con 0x7f82a40b0500 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f82aafc3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f82a40b5f30 con 0x7f82a40734f0 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f82aafc3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f82a40b6230 con 0x7f82a415c220 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82a40b0500 0x7f82a4146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82a40b0500 0x7f82a4146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54460/0 (socket says 172.21.15.104:54460) 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 -- 172.21.15.104:0/86793880 learned_addr learned my addr 172.21.15.104:0/86793880 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f82a9560640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a415c220 0x7f82a414dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:37.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f82a8d5f640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40734f0 0x7f82a40af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 -- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a415c220 msgr2=0x7f82a414dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a415c220 0x7f82a414dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 -- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40734f0 msgr2=0x7f82a40af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40734f0 0x7f82a40af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 -- 172.21.15.104:0/86793880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a41f9980 con 0x7f82a40b0500 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.497+0000 7f829bfff640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82a40b0500 0x7f82a4146be0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f829400c4b0 tx=0x7f829400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.498+0000 7f82997fa640 1 -- 172.21.15.104:0/86793880 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294016020 con 0x7f82a40b0500 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.498+0000 7f82997fa640 1 -- 172.21.15.104:0/86793880 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8294012920 con 0x7f82a40b0500 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.498+0000 7f82997fa640 1 -- 172.21.15.104:0/86793880 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294012cf0 con 0x7f82a40b0500 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.498+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a40afdb0 con 0x7f82a40b0500 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.498+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a41f9c20 con 0x7f82a40b0500 2024-09-17T03:00:37.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.499+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82a4152ac0 con 0x7f82a40b0500 2024-09-17T03:00:37.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.499+0000 7f82997fa640 1 -- 172.21.15.104:0/86793880 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8294019020 con 0x7f82a40b0500 2024-09-17T03:00:37.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.500+0000 7f82997fa640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8290078bc0 0x7f829007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:37.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.500+0000 7f82997fa640 1 -- 172.21.15.104:0/86793880 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7f829409ab30 con 0x7f82a40b0500 2024-09-17T03:00:37.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.500+0000 7f82a8d5f640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8290078bc0 0x7f829007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:37.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.501+0000 7f82a8d5f640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8290078bc0 0x7f829007b0d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f82a0034000 tx=0x7f82a0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:37.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.504+0000 7f82997fa640 1 -- 172.21.15.104:0/86793880 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f82a4152ac0 con 0x7f82a40b0500 2024-09-17T03:00:37.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.714+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82a4070810 con 0x7f82a40b0500 2024-09-17T03:00:37.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.714+0000 7f82997fa640 1 -- 172.21.15.104:0/86793880 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f8294020030 con 0x7f82a40b0500 2024-09-17T03:00:37.713 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:37.713 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:21.058657+0000","modified":"2024-09-17T03:00:23.073068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3958916187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3958916187},{"type":"v1","addr":"172.21.15.192:6837","nonce":3958916187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":7}]} 2024-09-17T03:00:37.713 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 48 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8290078bc0 msgr2=0x7f829007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8290078bc0 0x7f829007b0d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f82a0034000 tx=0x7f82a0004730 comp rx=0 tx=0).stop 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82a40b0500 msgr2=0x7f82a4146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82a40b0500 0x7f82a4146be0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f829400c4b0 tx=0x7f829400c970 comp rx=0 tx=0).stop 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 shutdown_connections 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8290078bc0 0x7f829007b0d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a415c220 0x7f82a414dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f82a40b0500 0x7f82a4146be0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 --2- 172.21.15.104:0/86793880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40734f0 0x7f82a40af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 >> 172.21.15.104:0/86793880 conn(0x7f82a406d200 msgr2=0x7f82a40696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:37.715 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 shutdown_connections 2024-09-17T03:00:37.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37.716+0000 7f82aafc3640 1 -- 172.21.15.104:0/86793880 wait complete. 2024-09-17T03:00:37.727 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json osdmap barrier 126 2024-09-17T03:00:37.864 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-17T03:00:37.864 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T03:00:37.864 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T03:00:37.864 DEBUG:teuthology.orchestra.run.smithi104:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-17T03:00:37.864 DEBUG:teuthology.orchestra.run.smithi104:> os.fchmod(fd, 0O666) 2024-09-17T03:00:37.865 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(fd) 2024-09-17T03:00:37.865 DEBUG:teuthology.orchestra.run.smithi104:> os.close(fd) 2024-09-17T03:00:37.865 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T03:00:37.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:37.942 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:00:38.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:00:38.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:38.039 INFO:teuthology.orchestra.run.smithi104.stdout:client5789 2024-09-17T03:00:38.039 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client5789/osdmap') 2024-09-17T03:00:38.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:00:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 126 barrier 126 flags 0x588000 2024-09-17T03:00:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:38.096 INFO:teuthology.orchestra.run.smithi104.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:osd0 (1)172.21.15.104:6801 100% (exists, up) 100% -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:osd1 (1)172.21.15.104:6809 100% (exists, up) 100% -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:osd2 (1)172.21.15.104:6825 100% (exists, up) 100% -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:osd3 (1)172.21.15.104:6817 100% (exists, up) 100% -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:osd4 (1)172.21.15.192:6819 100% (exists, up) 100% -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:osd5 (1)172.21.15.192:6803 100% (exists, up) 100% -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:osd6 (1)172.21.15.192:6811 100% (exists, up) 100% -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stdout:osd7 (1)172.21.15.192:6827 100% (exists, up) 100% -1 2024-09-17T03:00:38.097 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records in 2024-09-17T03:00:38.098 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records out 2024-09-17T03:00:38.098 INFO:teuthology.orchestra.run.smithi104.stderr:803 bytes copied, 3.3449e-05 s, 24.0 MB/s 2024-09-17T03:00:38.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:38.103 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:00:38.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:00:38.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:38.159 INFO:teuthology.orchestra.run.smithi104.stdout:client5789 2024-09-17T03:00:38.160 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5ed2cc55-4a25-471e-9183-b1048a1a073c.client5789/osdmap') 2024-09-17T03:00:38.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:epoch 126 barrier 126 flags 0x588000 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:osd0 (1)172.21.15.104:6801 100% (exists, up) 100% -1 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:osd1 (1)172.21.15.104:6809 100% (exists, up) 100% -1 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:osd2 (1)172.21.15.104:6825 100% (exists, up) 100% -1 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:osd3 (1)172.21.15.104:6817 100% (exists, up) 100% -1 2024-09-17T03:00:38.217 INFO:teuthology.orchestra.run.smithi104.stdout:osd4 (1)172.21.15.192:6819 100% (exists, up) 100% -1 2024-09-17T03:00:38.218 INFO:teuthology.orchestra.run.smithi104.stdout:osd5 (1)172.21.15.192:6803 100% (exists, up) 100% -1 2024-09-17T03:00:38.218 INFO:teuthology.orchestra.run.smithi104.stdout:osd6 (1)172.21.15.192:6811 100% (exists, up) 100% -1 2024-09-17T03:00:38.218 INFO:teuthology.orchestra.run.smithi104.stdout:osd7 (1)172.21.15.192:6827 100% (exists, up) 100% -1 2024-09-17T03:00:38.218 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records in 2024-09-17T03:00:38.218 INFO:teuthology.orchestra.run.smithi104.stderr:1+1 records out 2024-09-17T03:00:38.218 INFO:teuthology.orchestra.run.smithi104.stderr:803 bytes copied, 4.0225e-05 s, 20.0 MB/s 2024-09-17T03:00:38.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:00:38.224 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:00:38.224 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:00:38.224 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:00:38.273 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:00:38.313 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:00:38.313 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:00:38.314 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:38.314 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:38.330 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:38.330 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:38.386 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:00:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.541+0000 7f5c472bd640 1 -- 172.21.15.104:0/1244802497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400d18e0 msgr2=0x7f5c400d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.541+0000 7f5c472bd640 1 --2- 172.21.15.104:0/1244802497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400d18e0 0x7f5c400d34f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f5c4008daa0 tx=0x7f5c3802a4f0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.541+0000 7f5c472bd640 1 -- 172.21.15.104:0/1244802497 shutdown_connections 2024-09-17T03:00:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.541+0000 7f5c472bd640 1 --2- 172.21.15.104:0/1244802497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400d18e0 0x7f5c400d34f0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.541+0000 7f5c472bd640 1 --2- 172.21.15.104:0/1244802497 >> v2:172.21.15.192:3300/0 conn(0x7f5c400b6f70 0x7f5c4015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.541+0000 7f5c472bd640 1 -- 172.21.15.104:0/1244802497 >> 172.21.15.104:0/1244802497 conn(0x7f5c40073df0 msgr2=0x7f5c40068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:38.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.541+0000 7f5c472bd640 1 -- 172.21.15.104:0/1244802497 shutdown_connections 2024-09-17T03:00:38.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.541+0000 7f5c472bd640 1 -- 172.21.15.104:0/1244802497 wait complete. 2024-09-17T03:00:38.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.543+0000 7f5c472bd640 1 Processor -- start 2024-09-17T03:00:38.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.543+0000 7f5c472bd640 1 -- start start 2024-09-17T03:00:38.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.544+0000 7f5c472bd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c400b3b00 0x7f5c401f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:38.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.544+0000 7f5c472bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400b6f70 0x7f5c400c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:38.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.544+0000 7f5c472bd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400d18e0 0x7f5c401fa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:38.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.544+0000 7f5c472bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400d3dc0 con 0x7f5c400b6f70 2024-09-17T03:00:38.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.544+0000 7f5c472bd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c400d3c40 con 0x7f5c400d18e0 2024-09-17T03:00:38.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.544+0000 7f5c472bd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5c400d3f40 con 0x7f5c400b3b00 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.544+0000 7f5c44858640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400b6f70 0x7f5c400c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.544+0000 7f5c44858640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400b6f70 0x7f5c400c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54478/0 (socket says 172.21.15.104:54478) 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c44858640 1 -- 172.21.15.104:0/4277183427 learned_addr learned my addr 172.21.15.104:0/4277183427 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c45059640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c400b3b00 0x7f5c401f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c4585a640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400d18e0 0x7f5c401fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c44858640 1 -- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c400b3b00 msgr2=0x7f5c401f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c44858640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c400b3b00 0x7f5c401f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c44858640 1 -- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400d18e0 msgr2=0x7f5c401fa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c44858640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400d18e0 0x7f5c401fa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c44858640 1 -- 172.21.15.104:0/4277183427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c401f6d70 con 0x7f5c400b6f70 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c44858640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400b6f70 0x7f5c400c8500 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400b3e0 tx=0x7f5c3400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:38.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c3dffb640 1 -- 172.21.15.104:0/4277183427 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34015020 con 0x7f5c400b6f70 2024-09-17T03:00:38.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c3dffb640 1 -- 172.21.15.104:0/4277183427 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c34011940 con 0x7f5c400b6f70 2024-09-17T03:00:38.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c3dffb640 1 -- 172.21.15.104:0/4277183427 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34011d90 con 0x7f5c400b6f70 2024-09-17T03:00:38.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c401f7050 con 0x7f5c400b6f70 2024-09-17T03:00:38.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.545+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c401617c0 con 0x7f5c400b6f70 2024-09-17T03:00:38.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.546+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c401615b0 con 0x7f5c400b6f70 2024-09-17T03:00:38.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.547+0000 7f5c3dffb640 1 -- 172.21.15.104:0/4277183427 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c34018020 con 0x7f5c400b6f70 2024-09-17T03:00:38.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.548+0000 7f5c3dffb640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c2c078b90 0x7f5c2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:38.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.548+0000 7f5c3dffb640 1 -- 172.21.15.104:0/4277183427 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7f5c3409aca0 con 0x7f5c400b6f70 2024-09-17T03:00:38.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.548+0000 7f5c45059640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c2c078b90 0x7f5c2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:38.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.549+0000 7f5c45059640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c2c078b90 0x7f5c2c07b0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009f20 tx=0x7f5c300094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:38.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.552+0000 7f5c3dffb640 1 -- 172.21.15.104:0/4277183427 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c3401f020 con 0x7f5c400b6f70 2024-09-17T03:00:38.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.737+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5c401f6b00 con 0x7f5c400b6f70 2024-09-17T03:00:38.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.738+0000 7f5c3dffb640 1 -- 172.21.15.104:0/4277183427 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v126) ==== 80+0+0 (secure 0 0 0) 0x7f5c34063170 con 0x7f5c400b6f70 2024-09-17T03:00:38.736 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:00:38.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c2c078b90 msgr2=0x7f5c2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c2c078b90 0x7f5c2c07b0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009f20 tx=0x7f5c300094f0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400b6f70 msgr2=0x7f5c400c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400b6f70 0x7f5c400c8500 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400b3e0 tx=0x7f5c3400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 shutdown_connections 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c2c078b90 0x7f5c2c07b0a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c400d18e0 0x7f5c401fa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c400b6f70 0x7f5c400c8500 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 --2- 172.21.15.104:0/4277183427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c400b3b00 0x7f5c401f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 >> 172.21.15.104:0/4277183427 conn(0x7f5c40073df0 msgr2=0x7f5c40068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 shutdown_connections 2024-09-17T03:00:38.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:38.740+0000 7f5c472bd640 1 -- 172.21.15.104:0/4277183427 wait complete. 2024-09-17T03:00:38.749 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:00:38.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:38.750 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:00:38.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:00:38.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:38.795 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:00:38.820 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:00:38.820 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:38.821 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:38.838 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:38.838 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:38.895 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:00:39.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.011+0000 7f25e256e640 1 -- 172.21.15.104:0/2197208089 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b4fc0 msgr2=0x7f25dc0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.011+0000 7f25e256e640 1 --2- 172.21.15.104:0/2197208089 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b4fc0 0x7f25dc0b39c0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0c98b0 tx=0x7f25cc02a560 comp rx=0 tx=0).stop 2024-09-17T03:00:39.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.012+0000 7f25e256e640 1 -- 172.21.15.104:0/2197208089 shutdown_connections 2024-09-17T03:00:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.012+0000 7f25e256e640 1 --2- 172.21.15.104:0/2197208089 >> v2:172.21.15.192:3300/0 conn(0x7f25dc0cdf10 0x7f25dc0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.012+0000 7f25e256e640 1 --2- 172.21.15.104:0/2197208089 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b4fc0 0x7f25dc0b39c0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.012+0000 7f25e256e640 1 -- 172.21.15.104:0/2197208089 >> 172.21.15.104:0/2197208089 conn(0x7f25dc0b44a0 msgr2=0x7f25dc0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.012+0000 7f25e256e640 1 -- 172.21.15.104:0/2197208089 shutdown_connections 2024-09-17T03:00:39.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.012+0000 7f25e256e640 1 -- 172.21.15.104:0/2197208089 wait complete. 2024-09-17T03:00:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.013+0000 7f25e256e640 1 Processor -- start 2024-09-17T03:00:39.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.014+0000 7f25e256e640 1 -- start start 2024-09-17T03:00:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25e256e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b3f00 0x7f25dc0b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25e256e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25dc0b4fc0 0x7f25dc0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25e256e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25dc0cdf10 0x7f25dc15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25e256e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc0d18c0 con 0x7f25dc0b3f00 2024-09-17T03:00:39.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25e256e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc0d01d0 con 0x7f25dc0b4fc0 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25e256e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f25dc160f50 con 0x7f25dc0cdf10 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b3f00 0x7f25dc0b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b3f00 0x7f25dc0b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54498/0 (socket says 172.21.15.104:54498) 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 -- 172.21.15.104:0/1040984774 learned_addr learned my addr 172.21.15.104:0/1040984774 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25db7fe640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25dc0b4fc0 0x7f25dc0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 -- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25dc0cdf10 msgr2=0x7f25dc15bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25e0b0b640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25dc0cdf10 0x7f25dc15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25dc0cdf10 0x7f25dc15bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 -- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25dc0b4fc0 msgr2=0x7f25dc0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25dc0b4fc0 0x7f25dc0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.016 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 -- 172.21.15.104:0/1040984774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25dc0a06d0 con 0x7f25dc0b3f00 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25db7fe640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25dc0b4fc0 0x7f25dc0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25e0b0b640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25dc0cdf10 0x7f25dc15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.015+0000 7f25dbfff640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b3f00 0x7f25dc0b08b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f25cc034040 tx=0x7f25cc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.016+0000 7f25d8ff9640 1 -- 172.21.15.104:0/1040984774 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc03e030 con 0x7f25dc0b3f00 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.016+0000 7f25d8ff9640 1 -- 172.21.15.104:0/1040984774 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25cc0047a0 con 0x7f25dc0b3f00 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.016+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25dc0ca380 con 0x7f25dc0b3f00 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.016+0000 7f25d8ff9640 1 -- 172.21.15.104:0/1040984774 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc035040 con 0x7f25dc0b3f00 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.016+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25dc0c9a20 con 0x7f25dc0b3f00 2024-09-17T03:00:39.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.017+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25dc0b0e40 con 0x7f25dc0b3f00 2024-09-17T03:00:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.017+0000 7f25d8ff9640 1 -- 172.21.15.104:0/1040984774 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f25cc041030 con 0x7f25dc0b3f00 2024-09-17T03:00:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.018+0000 7f25d8ff9640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f25c8078b90 0x7f25c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.018+0000 7f25d8ff9640 1 -- 172.21.15.104:0/1040984774 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7f25cc0bb660 con 0x7f25dc0b3f00 2024-09-17T03:00:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.018+0000 7f25db7fe640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f25c8078b90 0x7f25c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.019+0000 7f25db7fe640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f25c8078b90 0x7f25c807b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0b2a10 tx=0x7f25d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:39.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.022+0000 7f25d8ff9640 1 -- 172.21.15.104:0/1040984774 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f25cc083aa0 con 0x7f25dc0b3f00 2024-09-17T03:00:39.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.211+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f25dc0af710 con 0x7f25dc0b3f00 2024-09-17T03:00:39.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.211+0000 7f25d8ff9640 1 -- 172.21.15.104:0/1040984774 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v126) ==== 80+0+0 (secure 0 0 0) 0x7f25cc0833a0 con 0x7f25dc0b3f00 2024-09-17T03:00:39.210 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:00:39.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f25c8078b90 msgr2=0x7f25c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f25c8078b90 0x7f25c807b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0b2a10 tx=0x7f25d0008040 comp rx=0 tx=0).stop 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b3f00 msgr2=0x7f25dc0b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b3f00 0x7f25dc0b08b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f25cc034040 tx=0x7f25cc0039e0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 shutdown_connections 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f25c8078b90 0x7f25c807b0a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25dc0b4fc0 0x7f25dc0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25dc0cdf10 0x7f25dc15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 --2- 172.21.15.104:0/1040984774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f25dc0b3f00 0x7f25dc0b08b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 >> 172.21.15.104:0/1040984774 conn(0x7f25dc0b44a0 msgr2=0x7f25dc0b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 shutdown_connections 2024-09-17T03:00:39.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.213+0000 7f25e256e640 1 -- 172.21.15.104:0/1040984774 wait complete. 2024-09-17T03:00:39.223 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:00:39.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:39.223 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:00:39.255 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:00:39.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:00:39.256 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:00:39.313 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:00:39.313 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:39.313 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:39.329 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:00:39.330 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:00:39.330 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:39.330 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:39.371 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:00:39.371 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:39.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.485+0000 7f05ee68b640 1 -- 172.21.15.104:0/3827737819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 msgr2=0x7f05d4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.485+0000 7f05ee68b640 1 --2- 172.21.15.104:0/3827737819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 0x7f05d4004c10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f05d00016c0 tx=0x7f05d4005830 comp rx=0 tx=0).stop 2024-09-17T03:00:39.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.485+0000 7f05ee68b640 1 -- 172.21.15.104:0/3827737819 shutdown_connections 2024-09-17T03:00:39.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.485+0000 7f05ee68b640 1 --2- 172.21.15.104:0/3827737819 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 0x7f05d4004c10 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.485+0000 7f05ee68b640 1 -- 172.21.15.104:0/3827737819 >> 172.21.15.104:0/3827737819 conn(0x7f05e80d28a0 msgr2=0x7f05e80d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:39.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.485+0000 7f05ee68b640 1 -- 172.21.15.104:0/3827737819 shutdown_connections 2024-09-17T03:00:39.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.485+0000 7f05ee68b640 1 -- 172.21.15.104:0/3827737819 wait complete. 2024-09-17T03:00:39.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.487+0000 7f05ee68b640 1 Processor -- start 2024-09-17T03:00:39.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.487+0000 7f05ee68b640 1 -- start start 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05ee68b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 0x7f05e81f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05ee68b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81f9a10 0x7f05e81e9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05ee68b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05e81e9570 0x7f05e806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05ee68b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f05e80d0c60 con 0x7f05d4004800 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05ee68b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f05e80d0ae0 con 0x7f05e81f9a10 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05ee68b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f05e80d0de0 con 0x7f05e81e9570 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05e7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 0x7f05e81f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05e7fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 0x7f05e81f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54522/0 (socket says 172.21.15.104:54522) 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05e7fff640 1 -- 172.21.15.104:0/1534101172 learned_addr learned my addr 172.21.15.104:0/1534101172 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05e77fe640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81f9a10 0x7f05e81e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05e7fff640 1 -- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05e81e9570 msgr2=0x7f05e806e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.488+0000 7f05ecc28640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05e81e9570 0x7f05e806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e7fff640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05e81e9570 0x7f05e806e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e7fff640 1 -- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81f9a10 msgr2=0x7f05e81e9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e7fff640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81f9a10 0x7f05e81e9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e7fff640 1 -- 172.21.15.104:0/1534101172 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e81e9980 con 0x7f05d4004800 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e77fe640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81f9a10 0x7f05e81e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e7fff640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 0x7f05e81f65c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f05d8011ae0 tx=0x7f05d8009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e4ff9640 1 -- 172.21.15.104:0/1534101172 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d801e070 con 0x7f05d4004800 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e4ff9640 1 -- 172.21.15.104:0/1534101172 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05d800fcd0 con 0x7f05d4004800 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e81f5b20 con 0x7f05d4004800 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05e4ff9640 1 -- 172.21.15.104:0/1534101172 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8019670 con 0x7f05d4004800 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.489+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e81f60a0 con 0x7f05d4004800 2024-09-17T03:00:39.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.490+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e80ce1c0 con 0x7f05d4004800 2024-09-17T03:00:39.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.491+0000 7f05e4ff9640 1 -- 172.21.15.104:0/1534101172 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f05d8021070 con 0x7f05d4004800 2024-09-17T03:00:39.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.491+0000 7f05e4ff9640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f05c8078b90 0x7f05c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.492+0000 7f05e4ff9640 1 -- 172.21.15.104:0/1534101172 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7f05d809b5a0 con 0x7f05d4004800 2024-09-17T03:00:39.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.492+0000 7f05e77fe640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f05c8078b90 0x7f05c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.492+0000 7f05e77fe640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f05c8078b90 0x7f05c807b0a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f05d0032000 tx=0x7f05d0001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:39.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.496+0000 7f05e4ff9640 1 -- 172.21.15.104:0/1534101172 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f05d8063420 con 0x7f05d4004800 2024-09-17T03:00:39.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.705+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05e8070d20 con 0x7f05d4004800 2024-09-17T03:00:39.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.705+0000 7f05e4ff9640 1 -- 172.21.15.104:0/1534101172 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f05d8067e50 con 0x7f05d4004800 2024-09-17T03:00:39.704 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:39.704 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:21.058657+0000","modified":"2024-09-17T03:00:23.073068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3958916187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3958916187},{"type":"v1","addr":"172.21.15.192:6837","nonce":3958916187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":7}]} 2024-09-17T03:00:39.704 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 48 2024-09-17T03:00:39.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f05c8078b90 msgr2=0x7f05c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f05c8078b90 0x7f05c807b0a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f05d0032000 tx=0x7f05d0001190 comp rx=0 tx=0).stop 2024-09-17T03:00:39.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 msgr2=0x7f05e81f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 0x7f05e81f65c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f05d8011ae0 tx=0x7f05d8009f20 comp rx=0 tx=0).stop 2024-09-17T03:00:39.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 shutdown_connections 2024-09-17T03:00:39.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f05c8078b90 0x7f05c807b0a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81f9a10 0x7f05e81e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05e81e9570 0x7f05e806e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 --2- 172.21.15.104:0/1534101172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f05d4004800 0x7f05e81f65c0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 >> 172.21.15.104:0/1534101172 conn(0x7f05e80d28a0 msgr2=0x7f05e80b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:39.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.707+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 shutdown_connections 2024-09-17T03:00:39.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.708+0000 7f05ee68b640 1 -- 172.21.15.104:0/1534101172 wait complete. 2024-09-17T03:00:39.717 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:39.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.833+0000 7f68a2094640 1 -- 172.21.15.104:0/2837832372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 msgr2=0x7f688400ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.833+0000 7f68a2094640 1 --2- 172.21.15.104:0/2837832372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 0x7f688400ba50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f68940016c0 tx=0x7f6884005830 comp rx=0 tx=0).stop 2024-09-17T03:00:39.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.833+0000 7f68a2094640 1 -- 172.21.15.104:0/2837832372 shutdown_connections 2024-09-17T03:00:39.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.833+0000 7f68a2094640 1 --2- 172.21.15.104:0/2837832372 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 0x7f688400ba50 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.833+0000 7f68a2094640 1 -- 172.21.15.104:0/2837832372 >> 172.21.15.104:0/2837832372 conn(0x7f689c06d200 msgr2=0x7f689c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:39.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.833+0000 7f68a2094640 1 -- 172.21.15.104:0/2837832372 shutdown_connections 2024-09-17T03:00:39.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.833+0000 7f68a2094640 1 -- 172.21.15.104:0/2837832372 wait complete. 2024-09-17T03:00:39.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.835+0000 7f68a2094640 1 Processor -- start 2024-09-17T03:00:39.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.835+0000 7f68a2094640 1 -- start start 2024-09-17T03:00:39.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.836+0000 7f68a2094640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 0x7f689c13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.836+0000 7f68a2094640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c1545d0 0x7f689c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.836+0000 7f68a2094640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f689c154f20 0x7f689c142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.836+0000 7f68a2094640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f689c1616c0 con 0x7f68840053a0 2024-09-17T03:00:39.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.836+0000 7f68a2094640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f689c074770 con 0x7f689c1545d0 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.836+0000 7f68a2094640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f689c06f550 con 0x7f689c154f20 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.836+0000 7f689b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 0x7f689c13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 0x7f689c13fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54538/0 (socket says 172.21.15.104:54538) 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689b7fe640 1 -- 172.21.15.104:0/1579931235 learned_addr learned my addr 172.21.15.104:0/1579931235 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689affd640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c1545d0 0x7f689c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689bfff640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f689c154f20 0x7f689c142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689b7fe640 1 -- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f689c154f20 msgr2=0x7f689c142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689b7fe640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f689c154f20 0x7f689c142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689b7fe640 1 -- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c1545d0 msgr2=0x7f689c1549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689b7fe640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c1545d0 0x7f689c1549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689b7fe640 1 -- 172.21.15.104:0/1579931235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c158a30 con 0x7f68840053a0 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689bfff640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f689c154f20 0x7f689c142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:39.837 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f689b7fe640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 0x7f689c13fb20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f688c006310 tx=0x7f688c0067d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:39.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f6883fff640 1 -- 172.21.15.104:0/1579931235 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c015070 con 0x7f68840053a0 2024-09-17T03:00:39.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f6883fff640 1 -- 172.21.15.104:0/1579931235 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f688c00fd40 con 0x7f68840053a0 2024-09-17T03:00:39.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c155a50 con 0x7f68840053a0 2024-09-17T03:00:39.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f6883fff640 1 -- 172.21.15.104:0/1579931235 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c011690 con 0x7f68840053a0 2024-09-17T03:00:39.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.837+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c140490 con 0x7f68840053a0 2024-09-17T03:00:39.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.838+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689c0d1c40 con 0x7f68840053a0 2024-09-17T03:00:39.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.839+0000 7f6883fff640 1 -- 172.21.15.104:0/1579931235 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f688c011830 con 0x7f68840053a0 2024-09-17T03:00:39.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.839+0000 7f6883fff640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6888078b90 0x7f688807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:39.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.839+0000 7f6883fff640 1 -- 172.21.15.104:0/1579931235 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7f688c09bc50 con 0x7f68840053a0 2024-09-17T03:00:39.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.840+0000 7f689affd640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6888078b90 0x7f688807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:39.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.840+0000 7f689affd640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6888078b90 0x7f688807b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f689c15cad0 tx=0x7f689000d2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:39.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:39.844+0000 7f6883fff640 1 -- 172.21.15.104:0/1579931235 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f688c0a1020 con 0x7f68840053a0 2024-09-17T03:00:40.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.056+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f689c1e8420 con 0x7f68840053a0 2024-09-17T03:00:40.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.057+0000 7f6883fff640 1 -- 172.21.15.104:0/1579931235 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f688c063a40 con 0x7f68840053a0 2024-09-17T03:00:40.056 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:40.056 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:21.058657+0000","modified":"2024-09-17T03:00:23.073068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3958916187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3958916187},{"type":"v1","addr":"172.21.15.192:6837","nonce":3958916187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":7}]} 2024-09-17T03:00:40.056 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 48 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6888078b90 msgr2=0x7f688807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6888078b90 0x7f688807b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f689c15cad0 tx=0x7f689000d2e0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 msgr2=0x7f689c13fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 0x7f689c13fb20 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f688c006310 tx=0x7f688c0067d0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 shutdown_connections 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6888078b90 0x7f688807b0a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f689c1545d0 0x7f689c1549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f689c154f20 0x7f689c142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 --2- 172.21.15.104:0/1579931235 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68840053a0 0x7f689c13fb20 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 >> 172.21.15.104:0/1579931235 conn(0x7f689c06d200 msgr2=0x7f689c070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:40.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 shutdown_connections 2024-09-17T03:00:40.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.059+0000 7f68a2094640 1 -- 172.21.15.104:0/1579931235 wait complete. 2024-09-17T03:00:40.069 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:40.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.183+0000 7ff64ada1640 1 -- 172.21.15.104:0/3964651379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64406f840 msgr2=0x7ff644072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.183+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3964651379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64406f840 0x7ff644072e30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff638005fd0 tx=0x7ff63802a820 comp rx=0 tx=0).stop 2024-09-17T03:00:40.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.183+0000 7ff64ada1640 1 -- 172.21.15.104:0/3964651379 shutdown_connections 2024-09-17T03:00:40.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.183+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3964651379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64406f840 0x7ff644072e30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.183+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3964651379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6440cff70 0x7ff64415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.183+0000 7ff64ada1640 1 -- 172.21.15.104:0/3964651379 >> 172.21.15.104:0/3964651379 conn(0x7ff6440b2450 msgr2=0x7ff6440b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:40.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.183+0000 7ff64ada1640 1 -- 172.21.15.104:0/3964651379 shutdown_connections 2024-09-17T03:00:40.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.183+0000 7ff64ada1640 1 -- 172.21.15.104:0/3964651379 wait complete. 2024-09-17T03:00:40.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.185+0000 7ff64ada1640 1 Processor -- start 2024-09-17T03:00:40.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.185+0000 7ff64ada1640 1 -- start start 2024-09-17T03:00:40.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.186+0000 7ff64ada1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff64406f840 0x7ff644148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.186+0000 7ff64ada1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff644073370 0x7ff644158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.186+0000 7ff64ada1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6440cff70 0x7ff6441591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff64ada1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff64406fdd0 con 0x7ff644073370 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff64ada1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff64406fc50 con 0x7ff6440cff70 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff64ada1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff6440b3e60 con 0x7ff64406f840 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff644073370 0x7ff644158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff644073370 0x7ff644158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54544/0 (socket says 172.21.15.104:54544) 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 -- 172.21.15.104:0/3335072014 learned_addr learned my addr 172.21.15.104:0/3335072014 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff648b3d640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff64406f840 0x7ff644148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff64933e640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6440cff70 0x7ff6441591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 -- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff64406f840 msgr2=0x7ff644148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff64406f840 0x7ff644148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 -- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6440cff70 msgr2=0x7ff6441591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6440cff70 0x7ff6441591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 -- 172.21.15.104:0/3335072014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6440afc20 con 0x7ff644073370 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff64933e640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6440cff70 0x7ff6441591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff648b3d640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff64406f840 0x7ff644148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff643fff640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff644073370 0x7ff644158cb0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff638035040 tx=0x7ff638032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff6417fa640 1 -- 172.21.15.104:0/3335072014 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638037040 con 0x7ff644073370 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff6417fa640 1 -- 172.21.15.104:0/3335072014 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff638042070 con 0x7ff644073370 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6440afec0 con 0x7ff644073370 2024-09-17T03:00:40.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff6417fa640 1 -- 172.21.15.104:0/3335072014 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6380042a0 con 0x7ff644073370 2024-09-17T03:00:40.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.187+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6440b0480 con 0x7ff644073370 2024-09-17T03:00:40.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.188+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff644072e30 con 0x7ff644073370 2024-09-17T03:00:40.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.189+0000 7ff6417fa640 1 -- 172.21.15.104:0/3335072014 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff638004440 con 0x7ff644073370 2024-09-17T03:00:40.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.190+0000 7ff6417fa640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff630078bf0 0x7ff63007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.190+0000 7ff6417fa640 1 -- 172.21.15.104:0/3335072014 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7ff6380bc6e0 con 0x7ff644073370 2024-09-17T03:00:40.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.190+0000 7ff648b3d640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff630078bf0 0x7ff63007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.191+0000 7ff648b3d640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff630078bf0 0x7ff63007b100 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff634009b80 tx=0x7ff634005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:40.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.193+0000 7ff6417fa640 1 -- 172.21.15.104:0/3335072014 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff638084b20 con 0x7ff644073370 2024-09-17T03:00:40.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.367+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6440b2fe0 con 0x7ff644073370 2024-09-17T03:00:40.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.368+0000 7ff6417fa640 1 -- 172.21.15.104:0/3335072014 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+16735 (secure 0 0 0) 0x7ff638088f00 con 0x7ff644073370 2024-09-17T03:00:40.367 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:40.367 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":126,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:36.772203+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:18.716486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:20.027435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:40.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff630078bf0 msgr2=0x7ff63007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff630078bf0 0x7ff63007b100 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff634009b80 tx=0x7ff634005f90 comp rx=0 tx=0).stop 2024-09-17T03:00:40.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff644073370 msgr2=0x7ff644158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff644073370 0x7ff644158cb0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7ff638035040 tx=0x7ff638032c90 comp rx=0 tx=0).stop 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 shutdown_connections 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff630078bf0 0x7ff63007b100 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6440cff70 0x7ff6441591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff644073370 0x7ff644158cb0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 --2- 172.21.15.104:0/3335072014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff64406f840 0x7ff644148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 >> 172.21.15.104:0/3335072014 conn(0x7ff6440b2450 msgr2=0x7ff64415e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 shutdown_connections 2024-09-17T03:00:40.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.370+0000 7ff64ada1640 1 -- 172.21.15.104:0/3335072014 wait complete. 2024-09-17T03:00:40.381 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:00:40.381 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:40.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.494+0000 7f576bc94640 1 -- 172.21.15.104:0/3778998392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57640cdf10 msgr2=0x7f57640cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.494+0000 7f576bc94640 1 --2- 172.21.15.104:0/3778998392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57640cdf10 0x7f57640cfa80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5760009830 tx=0x7f576002a510 comp rx=0 tx=0).stop 2024-09-17T03:00:40.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.494+0000 7f576bc94640 1 -- 172.21.15.104:0/3778998392 shutdown_connections 2024-09-17T03:00:40.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.494+0000 7f576bc94640 1 --2- 172.21.15.104:0/3778998392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57640cdf10 0x7f57640cfa80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.494+0000 7f576bc94640 1 --2- 172.21.15.104:0/3778998392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57640b4fc0 0x7f57640b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.494+0000 7f576bc94640 1 -- 172.21.15.104:0/3778998392 >> 172.21.15.104:0/3778998392 conn(0x7f57640b44a0 msgr2=0x7f57640b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:40.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.494+0000 7f576bc94640 1 -- 172.21.15.104:0/3778998392 shutdown_connections 2024-09-17T03:00:40.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.494+0000 7f576bc94640 1 -- 172.21.15.104:0/3778998392 wait complete. 2024-09-17T03:00:40.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.496+0000 7f576bc94640 1 Processor -- start 2024-09-17T03:00:40.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.496+0000 7f576bc94640 1 -- start start 2024-09-17T03:00:40.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576bc94640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57640b3f00 0x7f5764150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576bc94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57640b4fc0 0x7f57640cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576bc94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57640cdf10 0x7f57640cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576bc94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f57640d0210 con 0x7f57640cdf10 2024-09-17T03:00:40.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576bc94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5764160f50 con 0x7f57640b4fc0 2024-09-17T03:00:40.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576bc94640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f57640cca30 con 0x7f57640b3f00 2024-09-17T03:00:40.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576a231640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57640cdf10 0x7f57640cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576a231640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57640cdf10 0x7f57640cc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54548/0 (socket says 172.21.15.104:54548) 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576a231640 1 -- 172.21.15.104:0/536900840 learned_addr learned my addr 172.21.15.104:0/536900840 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f5769a30640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57640b3f00 0x7f5764150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.497+0000 7f576922f640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57640b4fc0 0x7f57640cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f576a231640 1 -- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57640b3f00 msgr2=0x7f5764150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f576a231640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57640b3f00 0x7f5764150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f576a231640 1 -- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57640b4fc0 msgr2=0x7f57640cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f576a231640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57640b4fc0 0x7f57640cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f576a231640 1 -- 172.21.15.104:0/536900840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57640af7b0 con 0x7f57640cdf10 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f576a231640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57640cdf10 0x7f57640cc280 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f576002ab00 tx=0x7f5760033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f575a7fc640 1 -- 172.21.15.104:0/536900840 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760005c90 con 0x7f57640cdf10 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f575a7fc640 1 -- 172.21.15.104:0/536900840 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5760031e50 con 0x7f57640cdf10 2024-09-17T03:00:40.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57640ca910 con 0x7f57640cdf10 2024-09-17T03:00:40.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f575a7fc640 1 -- 172.21.15.104:0/536900840 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760033330 con 0x7f57640cdf10 2024-09-17T03:00:40.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.498+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57640caed0 con 0x7f57640cdf10 2024-09-17T03:00:40.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.499+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57640b39c0 con 0x7f57640cdf10 2024-09-17T03:00:40.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.500+0000 7f575a7fc640 1 -- 172.21.15.104:0/536900840 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f57600334d0 con 0x7f57640cdf10 2024-09-17T03:00:40.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.500+0000 7f575a7fc640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5748078b90 0x7f574807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.501+0000 7f575a7fc640 1 -- 172.21.15.104:0/536900840 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7f57600bc030 con 0x7f57640cdf10 2024-09-17T03:00:40.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.501+0000 7f5769a30640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5748078b90 0x7f574807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.501+0000 7f5769a30640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5748078b90 0x7f574807b0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f575c005fd0 tx=0x7f575c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:40.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.505+0000 7f575a7fc640 1 -- 172.21.15.104:0/536900840 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f576003f030 con 0x7f57640cdf10 2024-09-17T03:00:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.715+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57640b84c0 con 0x7f57640cdf10 2024-09-17T03:00:40.714 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.715+0000 7f575a7fc640 1 -- 172.21.15.104:0/536900840 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f5760083e30 con 0x7f57640cdf10 2024-09-17T03:00:40.714 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:40.714 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:21.058657+0000","modified":"2024-09-17T03:00:23.073068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3958916187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3958916187},{"type":"v1","addr":"172.21.15.192:6837","nonce":3958916187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":7}]} 2024-09-17T03:00:40.715 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 48 2024-09-17T03:00:40.716 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5748078b90 msgr2=0x7f574807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5748078b90 0x7f574807b0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f575c005fd0 tx=0x7f575c009500 comp rx=0 tx=0).stop 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57640cdf10 msgr2=0x7f57640cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57640cdf10 0x7f57640cc280 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f576002ab00 tx=0x7f5760033c20 comp rx=0 tx=0).stop 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 shutdown_connections 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5748078b90 0x7f574807b0a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57640b4fc0 0x7f57640cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f57640cdf10 0x7f57640cc280 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 --2- 172.21.15.104:0/536900840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57640b3f00 0x7f5764150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 >> 172.21.15.104:0/536900840 conn(0x7f57640b44a0 msgr2=0x7f57640b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 shutdown_connections 2024-09-17T03:00:40.717 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.718+0000 7f576bc94640 1 -- 172.21.15.104:0/536900840 wait complete. 2024-09-17T03:00:40.728 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:40.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.842+0000 7fe80a1a1640 1 -- 172.21.15.104:0/2507762556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040cf630 msgr2=0x7fe8040b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.842+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/2507762556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040cf630 0x7fe8040b5cb0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fe8040c9940 tx=0x7fe7f802a560 comp rx=0 tx=0).stop 2024-09-17T03:00:40.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.842+0000 7fe80a1a1640 1 -- 172.21.15.104:0/2507762556 shutdown_connections 2024-09-17T03:00:40.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.842+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/2507762556 >> v2:172.21.15.192:3300/0 conn(0x7fe8040cfa40 0x7fe8040b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.842+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/2507762556 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040cf630 0x7fe8040b5cb0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.842+0000 7fe80a1a1640 1 -- 172.21.15.104:0/2507762556 >> 172.21.15.104:0/2507762556 conn(0x7fe8040d28e0 msgr2=0x7fe8040d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:40.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.842+0000 7fe80a1a1640 1 -- 172.21.15.104:0/2507762556 shutdown_connections 2024-09-17T03:00:40.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.842+0000 7fe80a1a1640 1 -- 172.21.15.104:0/2507762556 wait complete. 2024-09-17T03:00:40.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.844+0000 7fe80a1a1640 1 Processor -- start 2024-09-17T03:00:40.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.844+0000 7fe80a1a1640 1 -- start start 2024-09-17T03:00:40.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe80a1a1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8040cf630 0x7fe80409ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe80a1a1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8040cfa40 0x7fe804153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe80a1a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040d3400 0x7fe80415df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.849 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe80a1a1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe8040b68b0 con 0x7fe8040d3400 2024-09-17T03:00:40.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe80a1a1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8040b6730 con 0x7fe8040cfa40 2024-09-17T03:00:40.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe80a1a1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe8040b6a30 con 0x7fe8040cf630 2024-09-17T03:00:40.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe803fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040d3400 0x7fe80415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe803fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040d3400 0x7fe80415df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54568/0 (socket says 172.21.15.104:54568) 2024-09-17T03:00:40.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe803fff640 1 -- 172.21.15.104:0/1296670848 learned_addr learned my addr 172.21.15.104:0/1296670848 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:40.850 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe802ffd640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8040cfa40 0x7fe804153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.845+0000 7fe8037fe640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8040cf630 0x7fe80409ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe803fff640 1 -- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8040cf630 msgr2=0x7fe80409ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe803fff640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8040cf630 0x7fe80409ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe803fff640 1 -- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8040cfa40 msgr2=0x7fe804153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:40.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe803fff640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8040cfa40 0x7fe804153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:40.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe803fff640 1 -- 172.21.15.104:0/1296670848 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8040c7870 con 0x7fe8040d3400 2024-09-17T03:00:40.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe803fff640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040d3400 0x7fe80415df90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9c0 tx=0x7fe7fc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:40.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe7ebfff640 1 -- 172.21.15.104:0/1296670848 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc004d20 con 0x7fe8040d3400 2024-09-17T03:00:40.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe7ebfff640 1 -- 172.21.15.104:0/1296670848 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7fc00cb20 con 0x7fe8040d3400 2024-09-17T03:00:40.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8041f78f0 con 0x7fe8040d3400 2024-09-17T03:00:40.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe7ebfff640 1 -- 172.21.15.104:0/1296670848 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc005020 con 0x7fe8040d3400 2024-09-17T03:00:40.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.846+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8041f7eb0 con 0x7fe8040d3400 2024-09-17T03:00:40.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.847+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8041f7660 con 0x7fe8040d3400 2024-09-17T03:00:40.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.848+0000 7fe7ebfff640 1 -- 172.21.15.104:0/1296670848 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7fc0051c0 con 0x7fe8040d3400 2024-09-17T03:00:40.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.848+0000 7fe7ebfff640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078bc0 0x7fe7f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:40.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.848+0000 7fe7ebfff640 1 -- 172.21.15.104:0/1296670848 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7fe7fc09b500 con 0x7fe8040d3400 2024-09-17T03:00:40.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.849+0000 7fe8037fe640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078bc0 0x7fe7f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:40.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.849+0000 7fe8037fe640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078bc0 0x7fe7f007b0d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4007fd0 tx=0x7fe7f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:40.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:40.853+0000 7fe7ebfff640 1 -- 172.21.15.104:0/1296670848 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe7fc016030 con 0x7fe8040d3400 2024-09-17T03:00:41.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.063+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8041f3fd0 con 0x7fe8040d3400 2024-09-17T03:00:41.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.064+0000 7fe7ebfff640 1 -- 172.21.15.104:0/1296670848 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7fe7fc063410 con 0x7fe8040d3400 2024-09-17T03:00:41.062 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:41.062 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":48,"btime":"2024-09-17T03:00:23:725229+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:21.058657+0000","modified":"2024-09-17T03:00:23.073068+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3958916187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3958916187},{"type":"v1","addr":"172.21.15.192:6837","nonce":3958916187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6696,"qdb_cluster":[6696]},"id":7}]} 2024-09-17T03:00:41.062 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 48 2024-09-17T03:00:41.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078bc0 msgr2=0x7fe7f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078bc0 0x7fe7f007b0d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4007fd0 tx=0x7fe7f4009040 comp rx=0 tx=0).stop 2024-09-17T03:00:41.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040d3400 msgr2=0x7fe80415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040d3400 0x7fe80415df90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9c0 tx=0x7fe7fc00ee80 comp rx=0 tx=0).stop 2024-09-17T03:00:41.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 shutdown_connections 2024-09-17T03:00:41.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe7f0078bc0 0x7fe7f007b0d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8040cfa40 0x7fe804153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8040d3400 0x7fe80415df90 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 --2- 172.21.15.104:0/1296670848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8040cf630 0x7fe80409ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 >> 172.21.15.104:0/1296670848 conn(0x7fe8040d28e0 msgr2=0x7fe8040d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:41.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 shutdown_connections 2024-09-17T03:00:41.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.066+0000 7fe80a1a1640 1 -- 172.21.15.104:0/1296670848 wait complete. 2024-09-17T03:00:41.076 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:41.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.189+0000 7f7cbb35f640 1 -- 172.21.15.104:0/1995412650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 msgr2=0x7f7cb4161380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.189+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/1995412650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 0x7f7cb4161380 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f7cac005fd0 tx=0x7f7cac02a970 comp rx=0 tx=0).stop 2024-09-17T03:00:41.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.189+0000 7f7cbb35f640 1 -- 172.21.15.104:0/1995412650 shutdown_connections 2024-09-17T03:00:41.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.189+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/1995412650 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 0x7f7cb4161380 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.189+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/1995412650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb40b65e0 0x7f7cb40b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.189+0000 7f7cbb35f640 1 -- 172.21.15.104:0/1995412650 >> 172.21.15.104:0/1995412650 conn(0x7f7cb4069120 msgr2=0x7f7cb4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:41.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.189+0000 7f7cbb35f640 1 -- 172.21.15.104:0/1995412650 shutdown_connections 2024-09-17T03:00:41.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.189+0000 7f7cbb35f640 1 -- 172.21.15.104:0/1995412650 wait complete. 2024-09-17T03:00:41.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.191+0000 7f7cbb35f640 1 Processor -- start 2024-09-17T03:00:41.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.191+0000 7f7cbb35f640 1 -- start start 2024-09-17T03:00:41.191 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cbb35f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb40b65e0 0x7f7cb41f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cbb35f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb415f1f0 0x7f7cb41f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cbb35f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 0x7f7cb4156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cbb35f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb4161d90 con 0x7f7cb415fd10 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cbb35f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb4161c10 con 0x7f7cb40b65e0 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cbb35f640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb4161f10 con 0x7f7cb415f1f0 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cb98fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 0x7f7cb4156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cb98fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 0x7f7cb4156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54588/0 (socket says 172.21.15.104:54588) 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cb98fc640 1 -- 172.21.15.104:0/2087915154 learned_addr learned my addr 172.21.15.104:0/2087915154 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cb88fa640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb415f1f0 0x7f7cb41f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.192+0000 7f7cb90fb640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb40b65e0 0x7f7cb41f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7cb98fc640 1 -- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb415f1f0 msgr2=0x7f7cb41f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7cb98fc640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb415f1f0 0x7f7cb41f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7cb98fc640 1 -- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb40b65e0 msgr2=0x7f7cb41f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7cb98fc640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb40b65e0 0x7f7cb41f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7cb98fc640 1 -- 172.21.15.104:0/2087915154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb4159220 con 0x7f7cb415fd10 2024-09-17T03:00:41.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7cb98fc640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 0x7f7cb4156d10 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7cac006010 tx=0x7f7cac004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:41.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7ca9ffb640 1 -- 172.21.15.104:0/2087915154 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac034070 con 0x7f7cb415fd10 2024-09-17T03:00:41.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7ca9ffb640 1 -- 172.21.15.104:0/2087915154 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cac004640 con 0x7f7cb415fd10 2024-09-17T03:00:41.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7ca9ffb640 1 -- 172.21.15.104:0/2087915154 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0436a0 con 0x7f7cb415fd10 2024-09-17T03:00:41.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb4159500 con 0x7f7cb415fd10 2024-09-17T03:00:41.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.193+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb4159ac0 con 0x7f7cb415fd10 2024-09-17T03:00:41.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.194+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb4158f90 con 0x7f7cb415fd10 2024-09-17T03:00:41.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.195+0000 7f7ca9ffb640 1 -- 172.21.15.104:0/2087915154 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7cac037020 con 0x7f7cb415fd10 2024-09-17T03:00:41.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.195+0000 7f7ca9ffb640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c98078b90 0x7f7c9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.195+0000 7f7ca9ffb640 1 -- 172.21.15.104:0/2087915154 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7f7cac0bc110 con 0x7f7cb415fd10 2024-09-17T03:00:41.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.196+0000 7f7cb90fb640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c98078b90 0x7f7c9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.196+0000 7f7cb90fb640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c98078b90 0x7f7c9807b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000a490 tx=0x7f7cb000a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:41.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.200+0000 7f7ca9ffb640 1 -- 172.21.15.104:0/2087915154 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7cb40b6f30 con 0x7f7cb415fd10 2024-09-17T03:00:41.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.373+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cb40d1f80 con 0x7f7cb415fd10 2024-09-17T03:00:41.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.374+0000 7f7ca9ffb640 1 -- 172.21.15.104:0/2087915154 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+16735 (secure 0 0 0) 0x7f7cac083f00 con 0x7f7cb415fd10 2024-09-17T03:00:41.373 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:41.373 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":126,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:36.772203+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:18.716486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:20.027435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:41.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c98078b90 msgr2=0x7f7c9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c98078b90 0x7f7c9807b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000a490 tx=0x7f7cb000a420 comp rx=0 tx=0).stop 2024-09-17T03:00:41.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 msgr2=0x7f7cb4156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 0x7f7cb4156d10 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7cac006010 tx=0x7f7cac004040 comp rx=0 tx=0).stop 2024-09-17T03:00:41.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 shutdown_connections 2024-09-17T03:00:41.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7c98078b90 0x7f7c9807b0a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7cb415fd10 0x7f7cb4156d10 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cb415f1f0 0x7f7cb41f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 --2- 172.21.15.104:0/2087915154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cb40b65e0 0x7f7cb41f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 >> 172.21.15.104:0/2087915154 conn(0x7f7cb4069120 msgr2=0x7f7cb40d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:41.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.376+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 shutdown_connections 2024-09-17T03:00:41.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.377+0000 7f7cbb35f640 1 -- 172.21.15.104:0/2087915154 wait complete. 2024-09-17T03:00:41.387 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:00:41.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.502+0000 7fc043bc3640 1 -- 172.21.15.104:0/2560331270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc03c0b2630 msgr2=0x7fc03c0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.502+0000 7fc043bc3640 1 --2- 172.21.15.104:0/2560331270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc03c0b2630 0x7fc03c0b2a40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc034005fd0 tx=0x7fc03402a820 comp rx=0 tx=0).stop 2024-09-17T03:00:41.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.502+0000 7fc043bc3640 1 -- 172.21.15.104:0/2560331270 shutdown_connections 2024-09-17T03:00:41.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.502+0000 7fc043bc3640 1 --2- 172.21.15.104:0/2560331270 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc03c0b2630 0x7fc03c0b2a40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.502+0000 7fc043bc3640 1 --2- 172.21.15.104:0/2560331270 >> v2:172.21.15.192:3300/0 conn(0x7fc03c0b7c80 0x7fc03c0b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.502+0000 7fc043bc3640 1 -- 172.21.15.104:0/2560331270 >> 172.21.15.104:0/2560331270 conn(0x7fc03c0d2970 msgr2=0x7fc03c0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:41.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.502+0000 7fc043bc3640 1 -- 172.21.15.104:0/2560331270 shutdown_connections 2024-09-17T03:00:41.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.502+0000 7fc043bc3640 1 -- 172.21.15.104:0/2560331270 wait complete. 2024-09-17T03:00:41.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.504+0000 7fc043bc3640 1 Processor -- start 2024-09-17T03:00:41.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.504+0000 7fc043bc3640 1 -- start start 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc043bc3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc03c0b2630 0x7fc03c1f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc043bc3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc03c0b7c80 0x7fc03c15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc043bc3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc03c0d3490 0x7fc03c15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc043bc3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c0b6bd0 con 0x7fc03c0d3490 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc043bc3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c0b6a50 con 0x7fc03c0b7c80 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc043bc3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc03c0b6d50 con 0x7fc03c0b2630 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc042160640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc03c0d3490 0x7fc03c15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc042160640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc03c0d3490 0x7fc03c15dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54604/0 (socket says 172.21.15.104:54604) 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc042160640 1 -- 172.21.15.104:0/1100276698 learned_addr learned my addr 172.21.15.104:0/1100276698 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:41.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc04115e640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc03c0b7c80 0x7fc03c15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc04195f640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc03c0b2630 0x7fc03c1f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc042160640 1 -- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc03c0b2630 msgr2=0x7fc03c1f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc042160640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc03c0b2630 0x7fc03c1f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc042160640 1 -- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc03c0b7c80 msgr2=0x7fc03c15bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc042160640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc03c0b7c80 0x7fc03c15bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.505+0000 7fc042160640 1 -- 172.21.15.104:0/1100276698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c15c0b0 con 0x7fc03c0d3490 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.506+0000 7fc042160640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc03c0d3490 0x7fc03c15dd60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fc034009cd0 tx=0x7fc034032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.506+0000 7fc0327fc640 1 -- 172.21.15.104:0/1100276698 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034037040 con 0x7fc03c0d3490 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.506+0000 7fc0327fc640 1 -- 172.21.15.104:0/1100276698 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc034042070 con 0x7fc03c0d3490 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.506+0000 7fc0327fc640 1 -- 172.21.15.104:0/1100276698 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc034003e60 con 0x7fc03c0d3490 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.506+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03c160c20 con 0x7fc03c0d3490 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.506+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03c160940 con 0x7fc03c0d3490 2024-09-17T03:00:41.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.507+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03c0b20f0 con 0x7fc03c0d3490 2024-09-17T03:00:41.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.507+0000 7fc0327fc640 1 -- 172.21.15.104:0/1100276698 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc034004280 con 0x7fc03c0d3490 2024-09-17T03:00:41.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.508+0000 7fc0327fc640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc020078bc0 0x7fc02007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.508+0000 7fc0327fc640 1 -- 172.21.15.104:0/1100276698 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5709+0+0 (secure 0 0 0) 0x7fc0340bba60 con 0x7fc03c0d3490 2024-09-17T03:00:41.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.508+0000 7fc04195f640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc020078bc0 0x7fc02007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.509+0000 7fc04195f640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc020078bc0 0x7fc02007b0d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc038000f60 tx=0x7fc038009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:41.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.512+0000 7fc0327fc640 1 -- 172.21.15.104:0/1100276698 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc034083850 con 0x7fc03c0d3490 2024-09-17T03:00:41.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.722+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc03c1603e0 con 0x7fc03c0d3490 2024-09-17T03:00:41.720 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T03:00:41.722+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:00:41.722 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.724+0000 7fc0327fc640 1 -- 172.21.15.104:0/1100276698 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) ==== 161+0+0 (secure 0 0 0) 0x7fc03c1603e0 con 0x7fc03c0d3490 2024-09-17T03:00:41.722 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:00:41.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc020078bc0 msgr2=0x7fc02007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc020078bc0 0x7fc02007b0d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc038000f60 tx=0x7fc038009040 comp rx=0 tx=0).stop 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc03c0d3490 msgr2=0x7fc03c15dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc03c0d3490 0x7fc03c15dd60 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fc034009cd0 tx=0x7fc034032d10 comp rx=0 tx=0).stop 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 shutdown_connections 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc020078bc0 0x7fc02007b0d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc03c0b7c80 0x7fc03c15bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc03c0d3490 0x7fc03c15dd60 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 --2- 172.21.15.104:0/1100276698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc03c0b2630 0x7fc03c1f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 >> 172.21.15.104:0/1100276698 conn(0x7fc03c0d2970 msgr2=0x7fc03c15cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 shutdown_connections 2024-09-17T03:00:41.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.728+0000 7fc043bc3640 1 -- 172.21.15.104:0/1100276698 wait complete. 2024-09-17T03:00:41.732 INFO:tasks.ceph.mds.b.smithi192.stderr: -5610> 2024-09-17T03:00:27.054+0000 7ffbaa7c9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:00:41.738 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:00:41.785 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T03:00:41.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.856+0000 7f24c17c6640 1 -- 172.21.15.104:0/2197393965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 msgr2=0x7f24a80051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.856+0000 7f24c17c6640 1 --2- 172.21.15.104:0/2197393965 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 0x7f24a80051f0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009b20 tx=0x7f24a8005830 comp rx=0 tx=0).stop 2024-09-17T03:00:41.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.856+0000 7f24bb7fe640 1 -- 172.21.15.104:0/2197393965 reap_dead start 2024-09-17T03:00:41.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.856+0000 7f24c17c6640 1 -- 172.21.15.104:0/2197393965 shutdown_connections 2024-09-17T03:00:41.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.856+0000 7f24c17c6640 1 -- 172.21.15.104:0/2197393965 >> 172.21.15.104:0/2197393965 conn(0x7f24bc06d1d0 msgr2=0x7f24bc06d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:41.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.856+0000 7f24c17c6640 1 -- 172.21.15.104:0/2197393965 shutdown_connections 2024-09-17T03:00:41.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.856+0000 7f24c17c6640 1 -- 172.21.15.104:0/2197393965 wait complete. 2024-09-17T03:00:41.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.858+0000 7f24c17c6640 1 Processor -- start 2024-09-17T03:00:41.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.858+0000 7f24c17c6640 1 -- start start 2024-09-17T03:00:41.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24c17c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 0x7f24bc15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24c17c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24bc1f4570 0x7f24bc0af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24c17c6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24bc156400 0x7f24bc156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24c17c6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc06fa30 con 0x7f24a8004d40 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24c17c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc06f8b0 con 0x7f24bc1f4570 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24c17c6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f24bc0d0be0 con 0x7f24bc156400 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 0x7f24bc15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 0x7f24bc15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54618/0 (socket says 172.21.15.104:54618) 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 -- 172.21.15.104:0/3487533445 learned_addr learned my addr 172.21.15.104:0/3487533445 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24bb7fe640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24bc156400 0x7f24bc156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24ba7fc640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24bc1f4570 0x7f24bc0af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 -- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24bc156400 msgr2=0x7f24bc156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24bc156400 0x7f24bc156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 -- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24bc1f4570 msgr2=0x7f24bc0af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:41.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24bc1f4570 0x7f24bc0af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:41.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 -- 172.21.15.104:0/3487533445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc156d50 con 0x7f24a8004d40 2024-09-17T03:00:41.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.859+0000 7f24baffd640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 0x7f24bc15a320 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f24ac006090 tx=0x7f24ac006490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:41.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.860+0000 7f24b37fe640 1 -- 172.21.15.104:0/3487533445 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac015070 con 0x7f24a8004d40 2024-09-17T03:00:41.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.860+0000 7f24b37fe640 1 -- 172.21.15.104:0/3487533445 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24ac00f980 con 0x7f24a8004d40 2024-09-17T03:00:41.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.860+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc159280 con 0x7f24a8004d40 2024-09-17T03:00:41.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.860+0000 7f24b37fe640 1 -- 172.21.15.104:0/3487533445 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00fdd0 con 0x7f24a8004d40 2024-09-17T03:00:41.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.860+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc159840 con 0x7f24a8004d40 2024-09-17T03:00:41.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.861+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc0d1140 con 0x7f24a8004d40 2024-09-17T03:00:41.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.861+0000 7f24b37fe640 1 -- 172.21.15.104:0/3487533445 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f24ac011430 con 0x7f24a8004d40 2024-09-17T03:00:41.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.862+0000 7f24b37fe640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f249c078bc0 0x7f249c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:41.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.862+0000 7f24b37fe640 1 -- 172.21.15.104:0/3487533445 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5795+0+0 (secure 0 0 0) 0x7f24ac09bb60 con 0x7f24a8004d40 2024-09-17T03:00:41.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.862+0000 7f24ba7fc640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f249c078bc0 0x7f249c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:41.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.863+0000 7f24ba7fc640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f249c078bc0 0x7f249c07b0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0b05d0 tx=0x7f24a40067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:41.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:41.866+0000 7f24b37fe640 1 -- 172.21.15.104:0/3487533445 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f24ac0638f0 con 0x7f24a8004d40 2024-09-17T03:00:42.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.079+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f24bc0d14b0 con 0x7f24a8004d40 2024-09-17T03:00:42.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.725+0000 7f24b37fe640 1 -- 172.21.15.104:0/3487533445 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) ==== 104+0+0 (secure 0 0 0) 0x7f24ac068320 con 0x7f24a8004d40 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f249c078bc0 msgr2=0x7f249c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f249c078bc0 0x7f249c07b0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f24bc0b05d0 tx=0x7f24a40067a0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 msgr2=0x7f24bc15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 0x7f24bc15a320 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f24ac006090 tx=0x7f24ac006490 comp rx=0 tx=0).stop 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 shutdown_connections 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f249c078bc0 0x7f249c07b0d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24bc1f4570 0x7f24bc0af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24bc156400 0x7f24bc156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 --2- 172.21.15.104:0/3487533445 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24a8004d40 0x7f24bc15a320 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 >> 172.21.15.104:0/3487533445 conn(0x7f24bc06d1d0 msgr2=0x7f24bc0b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 shutdown_connections 2024-09-17T03:00:42.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.728+0000 7f24c17c6640 1 -- 172.21.15.104:0/3487533445 wait complete. 2024-09-17T03:00:42.739 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:00:42.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.861+0000 7f41a6d2b640 1 -- 172.21.15.104:0/991803502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a015f3f0 msgr2=0x7f41a00d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:42.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.861+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/991803502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a015f3f0 0x7f41a00d2a00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f419c005fd0 tx=0x7f419c02a540 comp rx=0 tx=0).stop 2024-09-17T03:00:42.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.861+0000 7f41a6d2b640 1 -- 172.21.15.104:0/991803502 shutdown_connections 2024-09-17T03:00:42.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.861+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/991803502 >> v2:172.21.15.192:3300/0 conn(0x7f41a00d2f40 0x7f41a00cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.861+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/991803502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a015f3f0 0x7f41a00d2a00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.861+0000 7f41a6d2b640 1 -- 172.21.15.104:0/991803502 >> 172.21.15.104:0/991803502 conn(0x7f41a00d4c20 msgr2=0x7f41a00d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:42.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.861+0000 7f41a6d2b640 1 -- 172.21.15.104:0/991803502 shutdown_connections 2024-09-17T03:00:42.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.861+0000 7f41a6d2b640 1 -- 172.21.15.104:0/991803502 wait complete. 2024-09-17T03:00:42.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.862+0000 7f41a6d2b640 1 Processor -- start 2024-09-17T03:00:42.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.862+0000 7f41a6d2b640 1 -- start start 2024-09-17T03:00:42.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a6d2b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a00cfd90 0x7f41a00cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a6d2b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a00d2f40 0x7f41a00c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a6d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a015f3f0 0x7f41a015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a6d2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00d0e00 con 0x7f41a015f3f0 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a6d2b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00d0c80 con 0x7f41a00d2f40 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a6d2b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f41a00b3810 con 0x7f41a00cfd90 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a52c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a015f3f0 0x7f41a015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a52c8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a015f3f0 0x7f41a015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54624/0 (socket says 172.21.15.104:54624) 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a52c8640 1 -- 172.21.15.104:0/1846842581 learned_addr learned my addr 172.21.15.104:0/1846842581 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a4ac7640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a00cfd90 0x7f41a00cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f4197fff640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a00d2f40 0x7f41a00c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a52c8640 1 -- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a00cfd90 msgr2=0x7f41a00cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:42.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a52c8640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a00cfd90 0x7f41a00cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a52c8640 1 -- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a00d2f40 msgr2=0x7f41a00c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a52c8640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a00d2f40 0x7f41a00c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a52c8640 1 -- 172.21.15.104:0/1846842581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a015ba90 con 0x7f41a015f3f0 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f41a4ac7640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a00cfd90 0x7f41a00cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.864+0000 7f4197fff640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a00d2f40 0x7f41a00c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.865+0000 7f41a52c8640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a015f3f0 0x7f41a015b550 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f419800c730 tx=0x7f419800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.865+0000 7f41957fa640 1 -- 172.21.15.104:0/1846842581 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198003b90 con 0x7f41a015f3f0 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.865+0000 7f41957fa640 1 -- 172.21.15.104:0/1846842581 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4198003d50 con 0x7f41a015f3f0 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.865+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a00cd250 con 0x7f41a015f3f0 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.865+0000 7f41957fa640 1 -- 172.21.15.104:0/1846842581 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198005330 con 0x7f41a015f3f0 2024-09-17T03:00:42.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.865+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a00cd810 con 0x7f41a015f3f0 2024-09-17T03:00:42.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.866+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a00b3ca0 con 0x7f41a015f3f0 2024-09-17T03:00:42.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.867+0000 7f41957fa640 1 -- 172.21.15.104:0/1846842581 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41980054d0 con 0x7f41a015f3f0 2024-09-17T03:00:42.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.867+0000 7f41957fa640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f418c078b90 0x7f418c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:42.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.867+0000 7f41957fa640 1 -- 172.21.15.104:0/1846842581 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5795+0+0 (secure 0 0 0) 0x7f419809a960 con 0x7f41a015f3f0 2024-09-17T03:00:42.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.867+0000 7f41a4ac7640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f418c078b90 0x7f418c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:42.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.868+0000 7f41a4ac7640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f418c078b90 0x7f418c07b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f419c033000 tx=0x7f419c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:42.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:42.872+0000 7f41957fa640 1 -- 172.21.15.104:0/1846842581 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f41980626f0 con 0x7f41a015f3f0 2024-09-17T03:00:43.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.044+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f41a0162a20 con 0x7f41a015f3f0 2024-09-17T03:00:43.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.816+0000 7f41957fa640 1 -- 172.21.15.104:0/1846842581 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) ==== 181+0+0 (secure 0 0 0) 0x7f4198067120 con 0x7f41a015f3f0 2024-09-17T03:00:43.815 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:00:43.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f418c078b90 msgr2=0x7f418c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:43.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f418c078b90 0x7f418c07b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f419c033000 tx=0x7f419c004730 comp rx=0 tx=0).stop 2024-09-17T03:00:43.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a015f3f0 msgr2=0x7f41a015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:43.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a015f3f0 0x7f41a015b550 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f419800c730 tx=0x7f419800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 shutdown_connections 2024-09-17T03:00:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f418c078b90 0x7f418c07b0a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41a00d2f40 0x7f41a00c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f41a015f3f0 0x7f41a015b550 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 --2- 172.21.15.104:0/1846842581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41a00cfd90 0x7f41a00cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.820+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 >> 172.21.15.104:0/1846842581 conn(0x7f41a00d4c20 msgr2=0x7f41a006d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.821+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 shutdown_connections 2024-09-17T03:00:43.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.821+0000 7f41a6d2b640 1 -- 172.21.15.104:0/1846842581 wait complete. 2024-09-17T03:00:43.833 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:00:43.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.957+0000 7f61f9362640 1 -- 172.21.15.104:0/1569714413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f40d3110 msgr2=0x7f61f40d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.957+0000 7f61f9362640 1 --2- 172.21.15.104:0/1569714413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f40d3110 0x7f61f40d0860 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f61f408de90 tx=0x7f61dc02aa30 comp rx=0 tx=0).stop 2024-09-17T03:00:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.957+0000 7f61f9362640 1 -- 172.21.15.104:0/1569714413 shutdown_connections 2024-09-17T03:00:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.957+0000 7f61f9362640 1 --2- 172.21.15.104:0/1569714413 >> v2:172.21.15.192:3300/0 conn(0x7f61f40b2800 0x7f61f40b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.957+0000 7f61f9362640 1 --2- 172.21.15.104:0/1569714413 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f40d3110 0x7f61f40d0860 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.957+0000 7f61f9362640 1 -- 172.21.15.104:0/1569714413 >> 172.21.15.104:0/1569714413 conn(0x7f61f40d4c20 msgr2=0x7f61f40d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.957+0000 7f61f9362640 1 -- 172.21.15.104:0/1569714413 shutdown_connections 2024-09-17T03:00:43.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.957+0000 7f61f9362640 1 -- 172.21.15.104:0/1569714413 wait complete. 2024-09-17T03:00:43.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.959+0000 7f61f9362640 1 Processor -- start 2024-09-17T03:00:43.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.959+0000 7f61f9362640 1 -- start start 2024-09-17T03:00:43.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f9362640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f40b2800 0x7f61f414e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f9362640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f40d3110 0x7f61f4161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f9362640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f415f3f0 0x7f61f414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f9362640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f61f40b35d0 con 0x7f61f415f3f0 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f9362640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61f40b3450 con 0x7f61f40d3110 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f9362640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61f40b3750 con 0x7f61f40b2800 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f415f3f0 0x7f61f414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f415f3f0 0x7f61f414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:54650/0 (socket says 172.21.15.104:54650) 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f37fe640 1 -- 172.21.15.104:0/1776312163 learned_addr learned my addr 172.21.15.104:0/1776312163 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f27fc640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f40d3110 0x7f61f4161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.960+0000 7f61f2ffd640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f40b2800 0x7f61f414e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61f37fe640 1 -- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f40b2800 msgr2=0x7f61f414e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:43.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61f37fe640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f40b2800 0x7f61f414e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61f37fe640 1 -- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f40d3110 msgr2=0x7f61f4161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61f37fe640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f40d3110 0x7f61f4161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61f37fe640 1 -- 172.21.15.104:0/1776312163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f41600d0 con 0x7f61f415f3f0 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61f37fe640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f415f3f0 0x7f61f414dab0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f61e400d660 tx=0x7f61e400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61eb7fe640 1 -- 172.21.15.104:0/1776312163 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4017070 con 0x7f61f415f3f0 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61eb7fe640 1 -- 172.21.15.104:0/1776312163 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61e4005310 con 0x7f61f415f3f0 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f41603b0 con 0x7f61f415f3f0 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61eb7fe640 1 -- 172.21.15.104:0/1776312163 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4009820 con 0x7f61f415f3f0 2024-09-17T03:00:43.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.961+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f4160970 con 0x7f61f415f3f0 2024-09-17T03:00:43.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.962+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f40b3c70 con 0x7f61f415f3f0 2024-09-17T03:00:43.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.963+0000 7f61eb7fe640 1 -- 172.21.15.104:0/1776312163 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61e40099c0 con 0x7f61f415f3f0 2024-09-17T03:00:43.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.963+0000 7f61eb7fe640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078b90 0x7f61d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:43.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.963+0000 7f61eb7fe640 1 -- 172.21.15.104:0/1776312163 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5357+0+0 (secure 0 0 0) 0x7f61e409ab40 con 0x7f61f415f3f0 2024-09-17T03:00:43.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.963+0000 7f61f2ffd640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078b90 0x7f61d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:43.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.964+0000 7f61f2ffd640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078b90 0x7f61d407b0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f61ec000f60 tx=0x7f61ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:43.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:43.968+0000 7f61eb7fe640 1 -- 172.21.15.104:0/1776312163 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61e4062b30 con 0x7f61f415f3f0 2024-09-17T03:00:44.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.140+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f61f415e6e0 con 0x7f61f415f3f0 2024-09-17T03:00:44.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.822+0000 7f61eb7fe640 1 -- 172.21.15.104:0/1776312163 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) ==== 169+0+0 (secure 0 0 0) 0x7f61e4067560 con 0x7f61f415f3f0 2024-09-17T03:00:44.821 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T03:00:44.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078b90 msgr2=0x7f61d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:44.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078b90 0x7f61d407b0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f61ec000f60 tx=0x7f61ec009040 comp rx=0 tx=0).stop 2024-09-17T03:00:44.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f415f3f0 msgr2=0x7f61f414dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:44.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f415f3f0 0x7f61f414dab0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f61e400d660 tx=0x7f61e400db20 comp rx=0 tx=0).stop 2024-09-17T03:00:44.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 shutdown_connections 2024-09-17T03:00:44.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078b90 0x7f61d407b0a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:44.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61f40d3110 0x7f61f4161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:44.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61f415f3f0 0x7f61f414dab0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:44.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 --2- 172.21.15.104:0/1776312163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61f40b2800 0x7f61f414e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:44.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.825+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 >> 172.21.15.104:0/1776312163 conn(0x7f61f40d4c20 msgr2=0x7f61f415c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:44.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.826+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 shutdown_connections 2024-09-17T03:00:44.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.826+0000 7f61f9362640 1 -- 172.21.15.104:0/1776312163 wait complete. 2024-09-17T03:00:44.838 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T03:00:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.957+0000 7fe198463640 1 -- 172.21.15.104:0/815066780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe178004800 msgr2=0x7fe178004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.957+0000 7fe198463640 1 --2- 172.21.15.104:0/815066780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe178004800 0x7fe178004c10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe18400c290 tx=0x7fe178005830 comp rx=0 tx=0).stop 2024-09-17T03:00:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.957+0000 7fe196a00640 1 -- 172.21.15.104:0/815066780 reap_dead start 2024-09-17T03:00:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.957+0000 7fe198463640 1 -- 172.21.15.104:0/815066780 shutdown_connections 2024-09-17T03:00:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.957+0000 7fe198463640 1 -- 172.21.15.104:0/815066780 >> 172.21.15.104:0/815066780 conn(0x7fe190073df0 msgr2=0x7fe190068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.957+0000 7fe198463640 1 -- 172.21.15.104:0/815066780 shutdown_connections 2024-09-17T03:00:44.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.957+0000 7fe198463640 1 -- 172.21.15.104:0/815066780 wait complete. 2024-09-17T03:00:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.959+0000 7fe198463640 1 Processor -- start 2024-09-17T03:00:44.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.959+0000 7fe198463640 1 -- start start 2024-09-17T03:00:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe198463640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe178004800 0x7fe1901f9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe198463640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1901f9b60 0x7fe190158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe198463640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1901590b0 0x7fe1901604b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe198463640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe19015f320 con 0x7fe1901590b0 2024-09-17T03:00:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe198463640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe19015f1a0 con 0x7fe1901f9b60 2024-09-17T03:00:44.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe198463640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900d3a30 con 0x7fe178004800 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe196a00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1901590b0 0x7fe1901604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe196a00640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1901590b0 0x7fe1901604b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44786/0 (socket says 172.21.15.104:44786) 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe196a00640 1 -- 172.21.15.104:0/717031379 learned_addr learned my addr 172.21.15.104:0/717031379 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe1961ff640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe178004800 0x7fe1901f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.960+0000 7fe1959fe640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1901f9b60 0x7fe190158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe196a00640 1 -- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe178004800 msgr2=0x7fe1901f9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe196a00640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe178004800 0x7fe1901f9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe196a00640 1 -- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1901f9b60 msgr2=0x7fe190158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe196a00640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1901f9b60 0x7fe190158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe196a00640 1 -- 172.21.15.104:0/717031379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901fa2a0 con 0x7fe1901590b0 2024-09-17T03:00:44.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe1959fe640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1901f9b60 0x7fe190158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe196a00640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1901590b0 0x7fe1901604b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe178004780 tx=0x7fe188011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe18effd640 1 -- 172.21.15.104:0/717031379 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188004240 con 0x7fe1901590b0 2024-09-17T03:00:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe18effd640 1 -- 172.21.15.104:0/717031379 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe188016070 con 0x7fe1901590b0 2024-09-17T03:00:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19015f6f0 con 0x7fe1901590b0 2024-09-17T03:00:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe18effd640 1 -- 172.21.15.104:0/717031379 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18800faf0 con 0x7fe1901590b0 2024-09-17T03:00:44.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.961+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19015fcb0 con 0x7fe1901590b0 2024-09-17T03:00:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.962+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1900d2fd0 con 0x7fe1901590b0 2024-09-17T03:00:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.963+0000 7fe18effd640 1 -- 172.21.15.104:0/717031379 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe18800fc90 con 0x7fe1901590b0 2024-09-17T03:00:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.963+0000 7fe18effd640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe17c078bc0 0x7fe17c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.963+0000 7fe18effd640 1 -- 172.21.15.104:0/717031379 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7fe18809b040 con 0x7fe1901590b0 2024-09-17T03:00:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.964+0000 7fe1961ff640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe17c078bc0 0x7fe17c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:44.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.964+0000 7fe1961ff640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe17c078bc0 0x7fe17c07b0d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe180005fd0 tx=0x7fe180009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:44.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:44.968+0000 7fe18effd640 1 -- 172.21.15.104:0/717031379 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe1900d2fd0 con 0x7fe1901590b0 2024-09-17T03:00:45.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.139+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7fe1900ba860 con 0x7fe1901590b0 2024-09-17T03:00:45.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.143+0000 7fe18effd640 1 -- 172.21.15.104:0/717031379 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7fe1901fa2a0 con 0x7fe1901590b0 2024-09-17T03:00:45.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe17c078bc0 msgr2=0x7fe17c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe17c078bc0 0x7fe17c07b0d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe180005fd0 tx=0x7fe180009500 comp rx=0 tx=0).stop 2024-09-17T03:00:45.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1901590b0 msgr2=0x7fe1901604b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1901590b0 0x7fe1901604b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe178004780 tx=0x7fe188011b30 comp rx=0 tx=0).stop 2024-09-17T03:00:45.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 shutdown_connections 2024-09-17T03:00:45.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe17c078bc0 0x7fe17c07b0d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1901f9b60 0x7fe190158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1901590b0 0x7fe1901604b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 --2- 172.21.15.104:0/717031379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe178004800 0x7fe1901f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 >> 172.21.15.104:0/717031379 conn(0x7fe190073df0 msgr2=0x7fe190068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 shutdown_connections 2024-09-17T03:00:45.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.145+0000 7fe198463640 1 -- 172.21.15.104:0/717031379 wait complete. 2024-09-17T03:00:45.155 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 -- 172.21.15.104:0/212037853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1840d2180 msgr2=0x7fd18406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/212037853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1840d2180 0x7fd18406f550 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd184072420 tx=0x7fd17402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 -- 172.21.15.104:0/212037853 shutdown_connections 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/212037853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd18406fa90 0x7fd18415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/212037853 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd1840d2180 0x7fd18406f550 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/212037853 >> v2:172.21.15.192:3300/0 conn(0x7fd1841610a0 0x7fd1840d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 -- 172.21.15.104:0/212037853 >> 172.21.15.104:0/212037853 conn(0x7fd18406d200 msgr2=0x7fd18406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 -- 172.21.15.104:0/212037853 shutdown_connections 2024-09-17T03:00:45.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.269+0000 7fd18c6cc640 1 -- 172.21.15.104:0/212037853 wait complete. 2024-09-17T03:00:45.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.271+0000 7fd18c6cc640 1 Processor -- start 2024-09-17T03:00:45.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.271+0000 7fd18c6cc640 1 -- start start 2024-09-17T03:00:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18c6cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18406fa90 0x7fd18414b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18c6cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1840d2180 0x7fd1841f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18c6cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1841610a0 0x7fd1840af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18c6cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd1840746e0 con 0x7fd18406fa90 2024-09-17T03:00:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18c6cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd184074560 con 0x7fd1840d2180 2024-09-17T03:00:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18c6cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd18415d2d0 con 0x7fd1841610a0 2024-09-17T03:00:45.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18a468640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18406fa90 0x7fd18414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18a468640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18406fa90 0x7fd18414b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44798/0 (socket says 172.21.15.104:44798) 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18a468640 1 -- 172.21.15.104:0/978353785 learned_addr learned my addr 172.21.15.104:0/978353785 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd18ac69640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1841610a0 0x7fd1840af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.272+0000 7fd189c67640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1840d2180 0x7fd1841f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd18a468640 1 -- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1841610a0 msgr2=0x7fd1840af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd18a468640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1841610a0 0x7fd1840af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd18a468640 1 -- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1840d2180 msgr2=0x7fd1841f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd18a468640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1840d2180 0x7fd1841f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd18a468640 1 -- 172.21.15.104:0/978353785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1840b53c0 con 0x7fd18406fa90 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd18a468640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18406fa90 0x7fd18414b420 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fd18000c970 tx=0x7fd18000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd17affd640 1 -- 172.21.15.104:0/978353785 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180007bb0 con 0x7fd18406fa90 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd17affd640 1 -- 172.21.15.104:0/978353785 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd180007e40 con 0x7fd18406fa90 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd17affd640 1 -- 172.21.15.104:0/978353785 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180005280 con 0x7fd18406fa90 2024-09-17T03:00:45.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18414b960 con 0x7fd18406fa90 2024-09-17T03:00:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.273+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1840b5bd0 con 0x7fd18406fa90 2024-09-17T03:00:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.274+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18415c680 con 0x7fd18406fa90 2024-09-17T03:00:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.275+0000 7fd17affd640 1 -- 172.21.15.104:0/978353785 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd180005420 con 0x7fd18406fa90 2024-09-17T03:00:45.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.275+0000 7fd17affd640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd168078b90 0x7fd16807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.276+0000 7fd17affd640 1 -- 172.21.15.104:0/978353785 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7fd18009aed0 con 0x7fd18406fa90 2024-09-17T03:00:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.276+0000 7fd189c67640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd168078b90 0x7fd16807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:45.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.276+0000 7fd189c67640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd168078b90 0x7fd16807b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd174033000 tx=0x7fd174004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:45.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.280+0000 7fd17affd640 1 -- 172.21.15.104:0/978353785 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd18415c680 con 0x7fd18406fa90 2024-09-17T03:00:45.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.537+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7fd18415d7f0 con 0x7fd18406fa90 2024-09-17T03:00:45.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.824+0000 7fd17affd640 1 -- 172.21.15.104:0/978353785 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v311) ==== 128+0+0 (secure 0 0 0) 0x7fd180014030 con 0x7fd18406fa90 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd168078b90 msgr2=0x7fd16807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd168078b90 0x7fd16807b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd174033000 tx=0x7fd174004730 comp rx=0 tx=0).stop 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18406fa90 msgr2=0x7fd18414b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18406fa90 0x7fd18414b420 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fd18000c970 tx=0x7fd18000ce30 comp rx=0 tx=0).stop 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 shutdown_connections 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd168078b90 0x7fd16807b0a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1840d2180 0x7fd1841f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1841610a0 0x7fd1840af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 --2- 172.21.15.104:0/978353785 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd18406fa90 0x7fd18414b420 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 >> 172.21.15.104:0/978353785 conn(0x7fd18406d200 msgr2=0x7fd184070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:45.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 shutdown_connections 2024-09-17T03:00:45.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.826+0000 7fd18c6cc640 1 -- 172.21.15.104:0/978353785 wait complete. 2024-09-17T03:00:45.837 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-17T03:00:45.837 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-17T03:00:45.837 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:45.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.952+0000 7fe7975e4640 1 -- 172.21.15.104:0/1343981138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe77c0053f0 msgr2=0x7fe77c00ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.952+0000 7fe7975e4640 1 --2- 172.21.15.104:0/1343981138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe77c0053f0 0x7fe77c00ba80 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c610 tx=0x7fe77c005830 comp rx=0 tx=0).stop 2024-09-17T03:00:45.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.952+0000 7fe7975e4640 1 -- 172.21.15.104:0/1343981138 shutdown_connections 2024-09-17T03:00:45.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.952+0000 7fe7975e4640 1 --2- 172.21.15.104:0/1343981138 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe77c0053f0 0x7fe77c00ba80 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.952+0000 7fe7975e4640 1 -- 172.21.15.104:0/1343981138 >> 172.21.15.104:0/1343981138 conn(0x7fe7900b2450 msgr2=0x7fe7900b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:45.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.953+0000 7fe7975e4640 1 -- 172.21.15.104:0/1343981138 shutdown_connections 2024-09-17T03:00:45.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.953+0000 7fe7975e4640 1 -- 172.21.15.104:0/1343981138 wait complete. 2024-09-17T03:00:45.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.954+0000 7fe7975e4640 1 Processor -- start 2024-09-17T03:00:45.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.954+0000 7fe7975e4640 1 -- start start 2024-09-17T03:00:45.955 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe7975e4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe790153fd0 0x7fe7900cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe7975e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790149870 0x7fe790147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe7975e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe790156df0 0x7fe790157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe7975e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe790072e30 con 0x7fe790149870 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe7975e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe79006fe60 con 0x7fe790156df0 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe7975e4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe790072fb0 con 0x7fe790153fd0 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790149870 0x7fe790147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790149870 0x7fe790147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44812/0 (socket says 172.21.15.104:44812) 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 -- 172.21.15.104:0/625619481 learned_addr learned my addr 172.21.15.104:0/625619481 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe795380640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe790153fd0 0x7fe7900cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:45.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe795b81640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe790156df0 0x7fe790157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 -- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe790153fd0 msgr2=0x7fe7900cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe790153fd0 0x7fe7900cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 -- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe790156df0 msgr2=0x7fe790157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe790156df0 0x7fe790157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 -- 172.21.15.104:0/625619481 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe790157740 con 0x7fe790149870 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe795380640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe790153fd0 0x7fe7900cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe795b81640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe790156df0 0x7fe790157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe794b7f640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790149870 0x7fe790147ed0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe780003ee0 tx=0x7fe78000b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe785ffb640 1 -- 172.21.15.104:0/625619481 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780005220 con 0x7fe790149870 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe785ffb640 1 -- 172.21.15.104:0/625619481 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7800053c0 con 0x7fe790149870 2024-09-17T03:00:45.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe790149c80 con 0x7fe790149870 2024-09-17T03:00:45.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.956+0000 7fe785ffb640 1 -- 172.21.15.104:0/625619481 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7800047a0 con 0x7fe790149870 2024-09-17T03:00:45.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.957+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe790148ab0 con 0x7fe790149870 2024-09-17T03:00:45.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.958+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79015b2e0 con 0x7fe790149870 2024-09-17T03:00:45.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.958+0000 7fe785ffb640 1 -- 172.21.15.104:0/625619481 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe780004940 con 0x7fe790149870 2024-09-17T03:00:45.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.959+0000 7fe785ffb640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe774078b90 0x7fe77407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:45.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.959+0000 7fe785ffb640 1 -- 172.21.15.104:0/625619481 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7fe78009b4d0 con 0x7fe790149870 2024-09-17T03:00:45.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.959+0000 7fe795380640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe774078b90 0x7fe77407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:45.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.960+0000 7fe795380640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe774078b90 0x7fe77407b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe7900cf630 tx=0x7fe78c006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:45.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:45.963+0000 7fe785ffb640 1 -- 172.21.15.104:0/625619481 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe790157740 con 0x7fe790149870 2024-09-17T03:00:46.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.139+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7900b2fe0 con 0x7fe790149870 2024-09-17T03:00:46.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.140+0000 7fe785ffb640 1 -- 172.21.15.104:0/625619481 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+13093 (secure 0 0 0) 0x7fe780063d30 con 0x7fe790149870 2024-09-17T03:00:46.139 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:46.139 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":129,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:44.817272+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/3958916187":"2024-09-18T03:00:41.722713+0000","172.21.15.192:6835/3958916187":"2024-09-18T03:00:41.722713+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:46.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe774078b90 msgr2=0x7fe77407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe774078b90 0x7fe77407b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe7900cf630 tx=0x7fe78c006bc0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790149870 msgr2=0x7fe790147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790149870 0x7fe790147ed0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe780003ee0 tx=0x7fe78000b980 comp rx=0 tx=0).stop 2024-09-17T03:00:46.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 shutdown_connections 2024-09-17T03:00:46.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe774078b90 0x7fe77407b0a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe790156df0 0x7fe790157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe790149870 0x7fe790147ed0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 --2- 172.21.15.104:0/625619481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe790153fd0 0x7fe7900cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 >> 172.21.15.104:0/625619481 conn(0x7fe7900b2450 msgr2=0x7fe7900af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:46.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 shutdown_connections 2024-09-17T03:00:46.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.142+0000 7fe7975e4640 1 -- 172.21.15.104:0/625619481 wait complete. 2024-09-17T03:00:46.152 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:00:46.153 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:00:46.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.269+0000 7fea7b49b640 1 -- 172.21.15.104:0/4189319227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea74073580 msgr2=0x7fea74073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.269+0000 7fea7b49b640 1 --2- 172.21.15.104:0/4189319227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea74073580 0x7fea74073990 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fea74070b10 tx=0x7fea6802a560 comp rx=0 tx=0).stop 2024-09-17T03:00:46.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.269+0000 7fea7b49b640 1 -- 172.21.15.104:0/4189319227 shutdown_connections 2024-09-17T03:00:46.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.269+0000 7fea7b49b640 1 --2- 172.21.15.104:0/4189319227 >> v2:172.21.15.192:3300/0 conn(0x7fea740b4ce0 0x7fea740b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.269+0000 7fea7b49b640 1 --2- 172.21.15.104:0/4189319227 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea74073580 0x7fea74073990 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.269+0000 7fea7b49b640 1 -- 172.21.15.104:0/4189319227 >> 172.21.15.104:0/4189319227 conn(0x7fea740b3640 msgr2=0x7fea740b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:46.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.269+0000 7fea7b49b640 1 -- 172.21.15.104:0/4189319227 shutdown_connections 2024-09-17T03:00:46.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.269+0000 7fea7b49b640 1 -- 172.21.15.104:0/4189319227 wait complete. 2024-09-17T03:00:46.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.271+0000 7fea7b49b640 1 Processor -- start 2024-09-17T03:00:46.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.271+0000 7fea7b49b640 1 -- start start 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea7b49b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea74073580 0x7fea74141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea7b49b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b4ce0 0x7fea74150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea7b49b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea74152ce0 0x7fea7415e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea7b49b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fea740b59c0 con 0x7fea740b4ce0 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea7b49b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fea740b5840 con 0x7fea74073580 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea7b49b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fea740b5b40 con 0x7fea74152ce0 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea78a36640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b4ce0 0x7fea74150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea78a36640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b4ce0 0x7fea74150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44828/0 (socket says 172.21.15.104:44828) 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.272+0000 7fea78a36640 1 -- 172.21.15.104:0/1539118780 learned_addr learned my addr 172.21.15.104:0/1539118780 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea78a36640 1 -- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea74152ce0 msgr2=0x7fea7415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea79a38640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea74152ce0 0x7fea7415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:46.272 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea78a36640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea74152ce0 0x7fea7415e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea79237640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea74073580 0x7fea74141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea78a36640 1 -- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea74073580 msgr2=0x7fea74141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea78a36640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea74073580 0x7fea74141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea78a36640 1 -- 172.21.15.104:0/1539118780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea741f7090 con 0x7fea740b4ce0 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea78a36640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b4ce0 0x7fea74150b50 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fea680099c0 tx=0x7fea680039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea71ffb640 1 -- 172.21.15.104:0/1539118780 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6803e030 con 0x7fea740b4ce0 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea71ffb640 1 -- 172.21.15.104:0/1539118780 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea680047a0 con 0x7fea740b4ce0 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea741f7370 con 0x7fea740b4ce0 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea71ffb640 1 -- 172.21.15.104:0/1539118780 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68035040 con 0x7fea740b4ce0 2024-09-17T03:00:46.273 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.273+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea741f7930 con 0x7fea740b4ce0 2024-09-17T03:00:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.274+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea74073990 con 0x7fea740b4ce0 2024-09-17T03:00:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.275+0000 7fea71ffb640 1 -- 172.21.15.104:0/1539118780 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea68041030 con 0x7fea740b4ce0 2024-09-17T03:00:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.275+0000 7fea71ffb640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea60078b90 0x7fea6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.275+0000 7fea71ffb640 1 -- 172.21.15.104:0/1539118780 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7fea680bb110 con 0x7fea740b4ce0 2024-09-17T03:00:46.274 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.276+0000 7fea79237640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea60078b90 0x7fea6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:46.275 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.276+0000 7fea79237640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea60078b90 0x7fea6007b0a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fea64007fd0 tx=0x7fea64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:46.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.280+0000 7fea71ffb640 1 -- 172.21.15.104:0/1539118780 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea68083970 con 0x7fea740b4ce0 2024-09-17T03:00:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.454+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fea741f6db0 con 0x7fea740b4ce0 2024-09-17T03:00:46.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.454+0000 7fea71ffb640 1 -- 172.21.15.104:0/1539118780 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) ==== 93+0+10 (secure 0 0 0) 0x7fea68083270 con 0x7fea740b4ce0 2024-09-17T03:00:46.453 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T03:00:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea60078b90 msgr2=0x7fea6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea60078b90 0x7fea6007b0a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fea64007fd0 tx=0x7fea64009040 comp rx=0 tx=0).stop 2024-09-17T03:00:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b4ce0 msgr2=0x7fea74150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b4ce0 0x7fea74150b50 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fea680099c0 tx=0x7fea680039e0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 shutdown_connections 2024-09-17T03:00:46.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fea60078b90 0x7fea6007b0a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fea74152ce0 0x7fea7415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fea740b4ce0 0x7fea74150b50 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 --2- 172.21.15.104:0/1539118780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea74073580 0x7fea74141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 >> 172.21.15.104:0/1539118780 conn(0x7fea740b3640 msgr2=0x7fea740d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:46.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 shutdown_connections 2024-09-17T03:00:46.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.456+0000 7fea7b49b640 1 -- 172.21.15.104:0/1539118780 wait complete. 2024-09-17T03:00:46.466 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-17T03:00:46.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.579+0000 7f3ce8762640 1 -- 172.21.15.104:0/1166609379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 msgr2=0x7f3ce00cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.579+0000 7f3ce8762640 1 --2- 172.21.15.104:0/1166609379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 0x7f3ce00cde90 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0069ef0 tx=0x7f3cd002a910 comp rx=0 tx=0).stop 2024-09-17T03:00:46.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.579+0000 7f3ce8762640 1 -- 172.21.15.104:0/1166609379 shutdown_connections 2024-09-17T03:00:46.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.579+0000 7f3ce8762640 1 --2- 172.21.15.104:0/1166609379 >> v2:172.21.15.192:3300/0 conn(0x7f3ce00cefb0 0x7f3ce00cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.579+0000 7f3ce8762640 1 --2- 172.21.15.104:0/1166609379 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 0x7f3ce00cde90 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.579+0000 7f3ce8762640 1 -- 172.21.15.104:0/1166609379 >> 172.21.15.104:0/1166609379 conn(0x7f3ce00d28a0 msgr2=0x7f3ce00d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:46.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.579+0000 7f3ce8762640 1 -- 172.21.15.104:0/1166609379 shutdown_connections 2024-09-17T03:00:46.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.579+0000 7f3ce8762640 1 -- 172.21.15.104:0/1166609379 wait complete. 2024-09-17T03:00:46.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.581+0000 7f3ce8762640 1 Processor -- start 2024-09-17T03:00:46.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.581+0000 7f3ce8762640 1 -- start start 2024-09-17T03:00:46.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce8762640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 0x7f3ce01e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:46.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce8762640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce00cefb0 0x7f3ce01e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:46.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce8762640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce00d0470 0x7f3ce01e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:46.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce8762640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00cf900 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce8762640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00ce620 con 0x7f3ce00cefb0 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce8762640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce00cfa80 con 0x7f3ce00d0470 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce64fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 0x7f3ce01e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce64fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 0x7f3ce01e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44856/0 (socket says 172.21.15.104:44856) 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce64fe640 1 -- 172.21.15.104:0/2142002725 learned_addr learned my addr 172.21.15.104:0/2142002725 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce5cfd640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce00cefb0 0x7f3ce01e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.582+0000 7f3ce6cff640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce00d0470 0x7f3ce01e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3ce64fe640 1 -- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce00d0470 msgr2=0x7f3ce01e84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3ce64fe640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce00d0470 0x7f3ce01e84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3ce64fe640 1 -- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce00cefb0 msgr2=0x7f3ce01e7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3ce64fe640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce00cefb0 0x7f3ce01e7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3ce64fe640 1 -- 172.21.15.104:0/2142002725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01f3d00 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3ce64fe640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 0x7f3ce01e4b00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000f80 tx=0x7f3cd0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3cdeffd640 1 -- 172.21.15.104:0/2142002725 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0034040 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3cdeffd640 1 -- 172.21.15.104:0/2142002725 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd0004600 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3cdeffd640 1 -- 172.21.15.104:0/2142002725 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0045480 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce00b18c0 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.583+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01f3f70 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.584+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce00b1a90 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.585+0000 7f3cdeffd640 1 -- 172.21.15.104:0/2142002725 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3cd0037020 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.585+0000 7f3cdeffd640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:46.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.586+0000 7f3cdeffd640 1 -- 172.21.15.104:0/2142002725 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7f3cd00bbf40 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.586+0000 7f3ce5cfd640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:46.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.586+0000 7f3ce5cfd640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3ce01f7140 tx=0x7f3cd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:46.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.590+0000 7f3cdeffd640 1 -- 172.21.15.104:0/2142002725 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3cd0084150 con 0x7f3ce00b7bb0 2024-09-17T03:00:46.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:46.831+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7f3ce00cde90 con 0x7f3ce00b7bb0 2024-09-17T03:00:47.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.830+0000 7f3cdeffd640 1 -- 172.21.15.104:0/2142002725 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v313) ==== 143+0+0 (secure 0 0 0) 0x7f3cd0088b80 con 0x7f3ce00b7bb0 2024-09-17T03:00:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3ccc078b90 msgr2=0x7f3ccc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3ce01f7140 tx=0x7f3cd4009040 comp rx=0 tx=0).stop 2024-09-17T03:00:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 msgr2=0x7f3ce01e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 0x7f3ce01e4b00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0000f80 tx=0x7f3cd0003f90 comp rx=0 tx=0).stop 2024-09-17T03:00:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 shutdown_connections 2024-09-17T03:00:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3ccc078b90 0x7f3ccc07b0a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce00cefb0 0x7f3ce01e7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:47.832 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce00d0470 0x7f3ce01e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:47.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 --2- 172.21.15.104:0/2142002725 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce00b7bb0 0x7f3ce01e4b00 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:47.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.833+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 >> 172.21.15.104:0/2142002725 conn(0x7f3ce00d28a0 msgr2=0x7f3ce00d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:47.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.834+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 shutdown_connections 2024-09-17T03:00:47.833 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.834+0000 7f3ce8762640 1 -- 172.21.15.104:0/2142002725 wait complete. 2024-09-17T03:00:47.846 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:00:47.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.966+0000 7f1248038640 1 -- 172.21.15.104:0/1898392895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 msgr2=0x7f12400cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:47.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.966+0000 7f1248038640 1 --2- 172.21.15.104:0/1898392895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 0x7f12400cde90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f123c009820 tx=0x7f123c02a3f0 comp rx=0 tx=0).stop 2024-09-17T03:00:47.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.966+0000 7f1248038640 1 -- 172.21.15.104:0/1898392895 shutdown_connections 2024-09-17T03:00:47.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.966+0000 7f1248038640 1 --2- 172.21.15.104:0/1898392895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 0x7f12400cde90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:47.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.966+0000 7f1248038640 1 -- 172.21.15.104:0/1898392895 >> 172.21.15.104:0/1898392895 conn(0x7f12400d28a0 msgr2=0x7f12400d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:47.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.966+0000 7f1248038640 1 -- 172.21.15.104:0/1898392895 shutdown_connections 2024-09-17T03:00:47.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.966+0000 7f1248038640 1 -- 172.21.15.104:0/1898392895 wait complete. 2024-09-17T03:00:47.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.968+0000 7f1248038640 1 Processor -- start 2024-09-17T03:00:47.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.968+0000 7f1248038640 1 -- start start 2024-09-17T03:00:47.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1248038640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 0x7f1240165fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:47.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1248038640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12400cefb0 0x7f12401f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:47.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1248038640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12400d0470 0x7f124014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:47.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1248038640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f12400cfc50 con 0x7f12400b7bb0 2024-09-17T03:00:47.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1248038640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f12400cfad0 con 0x7f12400cefb0 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1248038640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f12400cfdd0 con 0x7f12400d0470 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 0x7f1240165fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 0x7f1240165fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44866/0 (socket says 172.21.15.104:44866) 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 -- 172.21.15.104:0/1171677718 learned_addr learned my addr 172.21.15.104:0/1171677718 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f12465d5640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12400d0470 0x7f124014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 -- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12400d0470 msgr2=0x7f124014ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12400d0470 0x7f124014ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 -- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12400cefb0 msgr2=0x7f12401f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12400cefb0 0x7f12401f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 -- 172.21.15.104:0/1171677718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124014d200 con 0x7f12400b7bb0 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.969+0000 7f1245dd4640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 0x7f1240165fd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f123c02a9e0 tx=0x7f123c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:47.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.970+0000 7f12367fc640 1 -- 172.21.15.104:0/1171677718 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c03f070 con 0x7f12400b7bb0 2024-09-17T03:00:47.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.970+0000 7f12367fc640 1 -- 172.21.15.104:0/1171677718 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f123c004e50 con 0x7f12400b7bb0 2024-09-17T03:00:47.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.970+0000 7f12367fc640 1 -- 172.21.15.104:0/1171677718 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c031950 con 0x7f12400b7bb0 2024-09-17T03:00:47.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.970+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12401f7c70 con 0x7f12400b7bb0 2024-09-17T03:00:47.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.970+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12400b1a70 con 0x7f12400b7bb0 2024-09-17T03:00:47.971 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.971+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12400cde90 con 0x7f12400b7bb0 2024-09-17T03:00:47.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.971+0000 7f12367fc640 1 -- 172.21.15.104:0/1171677718 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f123c042070 con 0x7f12400b7bb0 2024-09-17T03:00:47.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.972+0000 7f12367fc640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1224078bc0 0x7f122407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:47.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.972+0000 7f12367fc640 1 -- 172.21.15.104:0/1171677718 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7f123c0bba00 con 0x7f12400b7bb0 2024-09-17T03:00:47.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.972+0000 7f12455d3640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1224078bc0 0x7f122407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:47.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.973+0000 7f12455d3640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1224078bc0 0x7f122407b0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f12400b7830 tx=0x7f1230006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:47.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:47.977+0000 7f12367fc640 1 -- 172.21.15.104:0/1171677718 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f123c031770 con 0x7f12400b7bb0 2024-09-17T03:00:48.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.151+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f12401f8190 con 0x7f12400b7bb0 2024-09-17T03:00:48.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.152+0000 7f12367fc640 1 -- 172.21.15.104:0/1171677718 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+1472 (secure 0 0 0) 0x7f123c0841d0 con 0x7f12400b7bb0 2024-09-17T03:00:48.150 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:00:48.150 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:00:48.150 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T03:00:48.151 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T03:00:48.152 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:00:48.153 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1224078bc0 msgr2=0x7f122407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1224078bc0 0x7f122407b0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f12400b7830 tx=0x7f1230006ba0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 msgr2=0x7f1240165fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 0x7f1240165fd0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f123c02a9e0 tx=0x7f123c004a50 comp rx=0 tx=0).stop 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 shutdown_connections 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1224078bc0 0x7f122407b0d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12400cefb0 0x7f12401f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12400d0470 0x7f124014ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 --2- 172.21.15.104:0/1171677718 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12400b7bb0 0x7f1240165fd0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 >> 172.21.15.104:0/1171677718 conn(0x7f12400d28a0 msgr2=0x7f12400b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:48.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 shutdown_connections 2024-09-17T03:00:48.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.154+0000 7f1248038640 1 -- 172.21.15.104:0/1171677718 wait complete. 2024-09-17T03:00:48.164 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:00:48.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.279+0000 7ff909e83640 1 -- 172.21.15.104:0/3339084132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 msgr2=0x7ff90415f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.279+0000 7ff909e83640 1 --2- 172.21.15.104:0/3339084132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 0x7ff90415f460 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff90408daa0 tx=0x7ff8fc02a980 comp rx=0 tx=0).stop 2024-09-17T03:00:48.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.279+0000 7ff909e83640 1 -- 172.21.15.104:0/3339084132 shutdown_connections 2024-09-17T03:00:48.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.279+0000 7ff909e83640 1 --2- 172.21.15.104:0/3339084132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 0x7ff90415f460 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.279+0000 7ff909e83640 1 --2- 172.21.15.104:0/3339084132 >> v2:172.21.15.192:3300/0 conn(0x7ff9040d0330 0x7ff904163140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.279+0000 7ff909e83640 1 -- 172.21.15.104:0/3339084132 >> 172.21.15.104:0/3339084132 conn(0x7ff904068d00 msgr2=0x7ff904069110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:48.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.279+0000 7ff909e83640 1 -- 172.21.15.104:0/3339084132 shutdown_connections 2024-09-17T03:00:48.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.279+0000 7ff909e83640 1 -- 172.21.15.104:0/3339084132 wait complete. 2024-09-17T03:00:48.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.281+0000 7ff909e83640 1 Processor -- start 2024-09-17T03:00:48.279 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.281+0000 7ff909e83640 1 -- start start 2024-09-17T03:00:48.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff909e83640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9040d0330 0x7ff904153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:48.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff909e83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 0x7ff9040ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:48.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff909e83640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff904163680 0x7ff9040cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff909e83640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff904155900 con 0x7ff9040d1b10 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff909e83640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff904155780 con 0x7ff9040d0330 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff909e83640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff904155a80 con 0x7ff904163680 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 0x7ff9040ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 0x7ff9040ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44892/0 (socket says 172.21.15.104:44892) 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 -- 172.21.15.104:0/277813294 learned_addr learned my addr 172.21.15.104:0/277813294 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff909682640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff904163680 0x7ff9040cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff908e81640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9040d0330 0x7ff904153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 -- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff904163680 msgr2=0x7ff9040cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff904163680 0x7ff9040cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 -- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9040d0330 msgr2=0x7ff904153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9040d0330 0x7ff904153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 -- 172.21.15.104:0/277813294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff904154240 con 0x7ff9040d1b10 2024-09-17T03:00:48.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff908e81640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9040d0330 0x7ff904153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:48.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8fbfff640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 0x7ff9040ca4b0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400b3e0 tx=0x7ff8f400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:48.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8f97fa640 1 -- 172.21.15.104:0/277813294 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4015020 con 0x7ff9040d1b10 2024-09-17T03:00:48.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8f97fa640 1 -- 172.21.15.104:0/277813294 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f4011920 con 0x7ff9040d1b10 2024-09-17T03:00:48.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff904158e20 con 0x7ff9040d1b10 2024-09-17T03:00:48.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.283+0000 7ff8f97fa640 1 -- 172.21.15.104:0/277813294 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4011d70 con 0x7ff9040d1b10 2024-09-17T03:00:48.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.284+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9041f6a20 con 0x7ff9040d1b10 2024-09-17T03:00:48.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.284+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff904163140 con 0x7ff9040d1b10 2024-09-17T03:00:48.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.285+0000 7ff8f97fa640 1 -- 172.21.15.104:0/277813294 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8f4018020 con 0x7ff9040d1b10 2024-09-17T03:00:48.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.286+0000 7ff8f97fa640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff8f0078b90 0x7ff8f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:48.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.286+0000 7ff8f97fa640 1 -- 172.21.15.104:0/277813294 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7ff8f409a760 con 0x7ff9040d1b10 2024-09-17T03:00:48.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.286+0000 7ff908e81640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff8f0078b90 0x7ff8f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:48.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.286+0000 7ff908e81640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff8f0078b90 0x7ff8f007b0a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff900005fd0 tx=0x7ff900005e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:48.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.290+0000 7ff8f97fa640 1 -- 172.21.15.104:0/277813294 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8f4062ea0 con 0x7ff9040d1b10 2024-09-17T03:00:48.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.463+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff904162c50 con 0x7ff9040d1b10 2024-09-17T03:00:48.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.469+0000 7ff8f97fa640 1 -- 172.21.15.104:0/277813294 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7ff8f40627a0 con 0x7ff9040d1b10 2024-09-17T03:00:48.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff8f0078b90 msgr2=0x7ff8f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff8f0078b90 0x7ff8f007b0a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff900005fd0 tx=0x7ff900005e20 comp rx=0 tx=0).stop 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 msgr2=0x7ff9040ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 0x7ff9040ca4b0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400b3e0 tx=0x7ff8f400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 shutdown_connections 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff8f0078b90 0x7ff8f007b0a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff904163680 0x7ff9040cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff9040d1b10 0x7ff9040ca4b0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 --2- 172.21.15.104:0/277813294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9040d0330 0x7ff904153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 >> 172.21.15.104:0/277813294 conn(0x7ff904068d00 msgr2=0x7ff904161cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 shutdown_connections 2024-09-17T03:00:48.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.472+0000 7ff909e83640 1 -- 172.21.15.104:0/277813294 wait complete. 2024-09-17T03:00:48.481 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:00:48.482 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:00:48.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:00:48.570 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:00:48.570 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:48.570 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:48.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:00:48.585 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:48.585 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:48.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:00:48.604 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:00:48.604 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:48.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:00:48.641 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:00:48.641 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:00:48.661 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:00:48.661 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:00:48.661 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:48.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.796+0000 7f3d7de4d640 1 -- 172.21.15.104:0/833992978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d64005270 msgr2=0x7f3d6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.796+0000 7f3d7de4d640 1 --2- 172.21.15.104:0/833992978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d64005270 0x7f3d6400b9c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3d70001ec0 tx=0x7f3d64005830 comp rx=0 tx=0).stop 2024-09-17T03:00:48.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.796+0000 7f3d7de4d640 1 -- 172.21.15.104:0/833992978 shutdown_connections 2024-09-17T03:00:48.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.796+0000 7f3d7de4d640 1 --2- 172.21.15.104:0/833992978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d64005270 0x7f3d6400b9c0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.796+0000 7f3d7de4d640 1 -- 172.21.15.104:0/833992978 >> 172.21.15.104:0/833992978 conn(0x7f3d78073df0 msgr2=0x7f3d78068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:48.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.796+0000 7f3d7de4d640 1 -- 172.21.15.104:0/833992978 shutdown_connections 2024-09-17T03:00:48.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.796+0000 7f3d7de4d640 1 -- 172.21.15.104:0/833992978 wait complete. 2024-09-17T03:00:48.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.798+0000 7f3d7de4d640 1 Processor -- start 2024-09-17T03:00:48.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.798+0000 7f3d7de4d640 1 -- start start 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d7de4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d64005270 0x7f3d78159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d7de4d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d7814d000 0x7f3d781f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d7de4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7814d410 0x7f3d781f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d7de4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7815f4e0 con 0x7f3d7814d410 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d7de4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7815f360 con 0x7f3d64005270 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d7de4d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3d780d11d0 con 0x7f3d7814d000 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d77fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7814d410 0x7f3d781f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d77fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7814d410 0x7f3d781f91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44904/0 (socket says 172.21.15.104:44904) 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d77fff640 1 -- 172.21.15.104:0/154744772 learned_addr learned my addr 172.21.15.104:0/154744772 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:48.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d6ffff640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d7814d000 0x7f3d781f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.799+0000 7f3d777fe640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d64005270 0x7f3d78159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d77fff640 1 -- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d7814d000 msgr2=0x7f3d781f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d77fff640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d7814d000 0x7f3d781f8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d77fff640 1 -- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d64005270 msgr2=0x7f3d78159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d77fff640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d64005270 0x7f3d78159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d77fff640 1 -- 172.21.15.104:0/154744772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d78159d40 con 0x7f3d7814d410 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d77fff640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7814d410 0x7f3d781f91b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3d70001fb0 tx=0x7f3d70003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d74ff9640 1 -- 172.21.15.104:0/154744772 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70041070 con 0x7f3d7814d410 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d74ff9640 1 -- 172.21.15.104:0/154744772 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d70006070 con 0x7f3d7814d410 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7815a250 con 0x7f3d7814d410 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d74ff9640 1 -- 172.21.15.104:0/154744772 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700064a0 con 0x7f3d7814d410 2024-09-17T03:00:48.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.800+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7815a810 con 0x7f3d7814d410 2024-09-17T03:00:48.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.801+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d78159fc0 con 0x7f3d7814d410 2024-09-17T03:00:48.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.802+0000 7f3d74ff9640 1 -- 172.21.15.104:0/154744772 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d70044070 con 0x7f3d7814d410 2024-09-17T03:00:48.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.802+0000 7f3d74ff9640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3d58078b90 0x7f3d5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:48.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.803+0000 7f3d74ff9640 1 -- 172.21.15.104:0/154744772 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7f3d700ba030 con 0x7f3d7814d410 2024-09-17T03:00:48.801 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.803+0000 7f3d777fe640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3d58078b90 0x7f3d5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:48.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.803+0000 7f3d777fe640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3d58078b90 0x7f3d5807b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009bd0 tx=0x7f3d68005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:48.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:48.807+0000 7f3d74ff9640 1 -- 172.21.15.104:0/154744772 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3d70082120 con 0x7f3d7814d410 2024-09-17T03:00:49.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.013+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d780cf920 con 0x7f3d7814d410 2024-09-17T03:00:49.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.014+0000 7f3d74ff9640 1 -- 172.21.15.104:0/154744772 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+3914 (secure 0 0 0) 0x7f3d70086b50 con 0x7f3d7814d410 2024-09-17T03:00:49.012 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:49.012 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":50,"btime":"2024-09-17T03:00:42:724446+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5852,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/393363867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":393363867},{"type":"v1","addr":"172.21.15.192:6837","nonce":393363867}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/373304709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":373304709},{"type":"v1","addr":"172.21.15.192:6836","nonce":373304709}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6681,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/571837311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":571837311},{"type":"v1","addr":"172.21.15.104:6834","nonce":571837311}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6684,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1750024822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1750024822},{"type":"v1","addr":"172.21.15.104:6835","nonce":1750024822}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[]} 2024-09-17T03:00:49.013 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 50 2024-09-17T03:00:49.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3d58078b90 msgr2=0x7f3d5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3d58078b90 0x7f3d5807b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009bd0 tx=0x7f3d68005f90 comp rx=0 tx=0).stop 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7814d410 msgr2=0x7f3d781f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7814d410 0x7f3d781f91b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3d70001fb0 tx=0x7f3d70003970 comp rx=0 tx=0).stop 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 shutdown_connections 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3d58078b90 0x7f3d5807b0a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3d7814d410 0x7f3d781f91b0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d7814d000 0x7f3d781f8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 --2- 172.21.15.104:0/154744772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d64005270 0x7f3d78159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 >> 172.21.15.104:0/154744772 conn(0x7f3d78073df0 msgr2=0x7f3d780b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 shutdown_connections 2024-09-17T03:00:49.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.016+0000 7f3d7de4d640 1 -- 172.21.15.104:0/154744772 wait complete. 2024-09-17T03:00:49.026 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:00:49.026 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:00:49.026 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:00:49.026 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:00:49.027 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:00:49.027 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:00:49.027 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:00:49.027 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:00:49.027 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:00:49.027 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:00:49.028 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:00:49.028 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:00:49.028 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:00:49.028 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:00:49.028 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:00:49.028 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:00:49.035 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:00:49.036 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:00:49.036 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:00:49.036 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:00:49.041 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:00:49.041 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:00:49.043 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:00:49.043 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:00:49.079 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:00:49.079 DEBUG:teuthology.parallel:result is None 2024-09-17T03:00:49.079 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:00:49.080 DEBUG:teuthology.parallel:result is None 2024-09-17T03:00:49.085 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:00:49.085 DEBUG:teuthology.parallel:result is None 2024-09-17T03:00:49.086 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:00:49.087 DEBUG:teuthology.parallel:result is None 2024-09-17T03:00:49.087 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:00:49.166 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T03:00:49.166 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T03:00:49.182 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T03:00:49.183 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T03:00:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.208+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2084026544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd806fa80 msgr2=0x7f0fd8073580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.208+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2084026544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd806fa80 0x7f0fd8073580 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4005fd0 tx=0x7f0fc402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.208+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2084026544 shutdown_connections 2024-09-17T03:00:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.208+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2084026544 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd806fa80 0x7f0fd8073580 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.208+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2084026544 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fd8152ce0 0x7f0fd806f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.208+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2084026544 >> 172.21.15.104:0/2084026544 conn(0x7f0fd80b3640 msgr2=0x7f0fd80b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.208+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2084026544 shutdown_connections 2024-09-17T03:00:49.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.208+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2084026544 wait complete. 2024-09-17T03:00:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.210+0000 7f0fdf24d640 1 Processor -- start 2024-09-17T03:00:49.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.210+0000 7f0fdf24d640 1 -- start start 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdf24d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fd806fa80 0x7f0fd813e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdf24d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fd8073ac0 0x7f0fd814fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdf24d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd8152ce0 0x7f0fd81f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdf24d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd815fda0 con 0x7f0fd8152ce0 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdf24d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd80b5fe0 con 0x7f0fd806fa80 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdf24d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd815ff20 con 0x7f0fd8073ac0 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd8152ce0 0x7f0fd81f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd8152ce0 0x7f0fd81f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44932/0 (socket says 172.21.15.104:44932) 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 -- 172.21.15.104:0/2604550105 learned_addr learned my addr 172.21.15.104:0/2604550105 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:49.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdcfe9640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fd806fa80 0x7f0fd813e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fd7fff640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fd8073ac0 0x7f0fd814fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 -- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fd8073ac0 msgr2=0x7f0fd814fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fd8073ac0 0x7f0fd814fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 -- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fd806fa80 msgr2=0x7f0fd813e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fd806fa80 0x7f0fd813e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 -- 172.21.15.104:0/2604550105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd81f9680 con 0x7f0fd8152ce0 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdcfe9640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fd806fa80 0x7f0fd813e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdd7ea640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd8152ce0 0x7f0fd81f65b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000c700 tx=0x7f0fd000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fd57fa640 1 -- 172.21.15.104:0/2604550105 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0003b70 con 0x7f0fd8152ce0 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fd57fa640 1 -- 172.21.15.104:0/2604550105 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fd0003d10 con 0x7f0fd8152ce0 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fd57fa640 1 -- 172.21.15.104:0/2604550105 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0005330 con 0x7f0fd8152ce0 2024-09-17T03:00:49.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.212+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd81f9960 con 0x7f0fd8152ce0 2024-09-17T03:00:49.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.213+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd81f9f20 con 0x7f0fd8152ce0 2024-09-17T03:00:49.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.213+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd81603f0 con 0x7f0fd8152ce0 2024-09-17T03:00:49.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.214+0000 7f0fd57fa640 1 -- 172.21.15.104:0/2604550105 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0fd00054d0 con 0x7f0fd8152ce0 2024-09-17T03:00:49.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.215+0000 7f0fd57fa640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:49.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.215+0000 7f0fd57fa640 1 -- 172.21.15.104:0/2604550105 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7f0fd009a580 con 0x7f0fd8152ce0 2024-09-17T03:00:49.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.215+0000 7f0fdcfe9640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:49.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.216+0000 7f0fdcfe9640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8073380 tx=0x7f0fcc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:49.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.219+0000 7f0fd57fa640 1 -- 172.21.15.104:0/2604550105 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0fd8073ed0 con 0x7f0fd8152ce0 2024-09-17T03:00:49.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.405+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0fd815bd80 con 0x7f0fd8152ce0 2024-09-17T03:00:49.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.852+0000 7f0fd57fa640 1 -- 172.21.15.104:0/2604550105 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v131) ==== 97+0+0 (secure 0 0 0) 0x7f0fd0062790 con 0x7f0fd8152ce0 2024-09-17T03:00:49.851 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T03:00:49.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0fbc078b90 msgr2=0x7f0fbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8073380 tx=0x7f0fcc005f90 comp rx=0 tx=0).stop 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd8152ce0 msgr2=0x7f0fd81f65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd8152ce0 0x7f0fd81f65b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000c700 tx=0x7f0fd000cbc0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 shutdown_connections 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0fbc078b90 0x7f0fbc07b0a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0fd8152ce0 0x7f0fd81f65b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0fd8073ac0 0x7f0fd814fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 --2- 172.21.15.104:0/2604550105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0fd806fa80 0x7f0fd813e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 >> 172.21.15.104:0/2604550105 conn(0x7f0fd80b3640 msgr2=0x7f0fd80cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 shutdown_connections 2024-09-17T03:00:49.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.855+0000 7f0fdf24d640 1 -- 172.21.15.104:0/2604550105 wait complete. 2024-09-17T03:00:49.865 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:00:49.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.980+0000 7f970db39640 1 -- 172.21.15.104:0/1730423179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f0003a30 msgr2=0x7f96f0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.980+0000 7f970db39640 1 --2- 172.21.15.104:0/1730423179 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f96f0003a30 0x7f96f0003ec0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f96f800c630 tx=0x7f96f0005830 comp rx=0 tx=0).stop 2024-09-17T03:00:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.981+0000 7f9707fff640 1 -- 172.21.15.104:0/1730423179 reap_dead start 2024-09-17T03:00:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.981+0000 7f970db39640 1 -- 172.21.15.104:0/1730423179 shutdown_connections 2024-09-17T03:00:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.981+0000 7f970db39640 1 -- 172.21.15.104:0/1730423179 >> 172.21.15.104:0/1730423179 conn(0x7f970806eb90 msgr2=0x7f970806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.981+0000 7f970db39640 1 -- 172.21.15.104:0/1730423179 shutdown_connections 2024-09-17T03:00:49.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.981+0000 7f970db39640 1 -- 172.21.15.104:0/1730423179 wait complete. 2024-09-17T03:00:49.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.982+0000 7f970db39640 1 Processor -- start 2024-09-17T03:00:49.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.983+0000 7f970db39640 1 -- start start 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f970db39640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f0003a30 0x7f970814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f970db39640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97080b57d0 0x7f97081e9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f970db39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97080b5be0 0x7f97081e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f970db39640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f97080735f0 con 0x7f97080b5be0 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f970db39640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9708073470 con 0x7f97080b57d0 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f970db39640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9708073770 con 0x7f96f0003a30 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97080b5be0 0x7f97081e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97080b5be0 0x7f97081e9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44958/0 (socket says 172.21.15.104:44958) 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 -- 172.21.15.104:0/2412857116 learned_addr learned my addr 172.21.15.104:0/2412857116 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:49.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f97077fe640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f0003a30 0x7f970814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9706ffd640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97080b57d0 0x7f97081e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 -- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f0003a30 msgr2=0x7f970814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f0003a30 0x7f970814fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 -- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97080b57d0 msgr2=0x7f97081e9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97080b57d0 0x7f97081e9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 -- 172.21.15.104:0/2412857116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97081f9a10 con 0x7f97080b5be0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.984+0000 7f9707fff640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97080b5be0 0x7f97081e9bc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f970806fac0 tx=0x7f9700001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.985+0000 7f96effff640 1 -- 172.21.15.104:0/2412857116 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97000107d0 con 0x7f97080b5be0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.985+0000 7f96effff640 1 -- 172.21.15.104:0/2412857116 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9700016070 con 0x7f97080b5be0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.985+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97081f9cf0 con 0x7f97080b5be0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.985+0000 7f96effff640 1 -- 172.21.15.104:0/2412857116 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700010d00 con 0x7f97080b5be0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.985+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97081fa2b0 con 0x7f97080b5be0 2024-09-17T03:00:49.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.986+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97081fa4b0 con 0x7f97080b5be0 2024-09-17T03:00:49.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.986+0000 7f96effff640 1 -- 172.21.15.104:0/2412857116 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f970001b460 con 0x7f97080b5be0 2024-09-17T03:00:49.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.987+0000 7f96effff640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96f4078b90 0x7f96f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:49.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.987+0000 7f96effff640 1 -- 172.21.15.104:0/2412857116 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4857+0+0 (secure 0 0 0) 0x7f970009b1e0 con 0x7f97080b5be0 2024-09-17T03:00:49.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.987+0000 7f97077fe640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96f4078b90 0x7f96f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:49.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.988+0000 7f97077fe640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96f4078b90 0x7f96f407b0a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96f8033000 tx=0x7f96f8001d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:49.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:49.992+0000 7f96effff640 1 -- 172.21.15.104:0/2412857116 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f97081fa4b0 con 0x7f97080b5be0 2024-09-17T03:00:50.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.230+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f97080b41a0 con 0x7f97080b5be0 2024-09-17T03:00:50.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.230+0000 7f96effff640 1 -- 172.21.15.104:0/2412857116 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) ==== 80+0+5304 (secure 0 0 0) 0x7f9700063970 con 0x7f97080b5be0 2024-09-17T03:00:50.229 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:50.229 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:00:50.229 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T03:00:50.230 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:50.231 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.232 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T03:00:50.233 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:50.234 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.235 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.236 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.237 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T03:00:50.238 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.239 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:00:50.240 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.241 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.242 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:00:50.243 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:00:50.244 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.244 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.244 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:00:50.244 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:00:50.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.232+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96f4078b90 msgr2=0x7f96f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.232+0000 7f970db39640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96f4078b90 0x7f96f407b0a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f96f8033000 tx=0x7f96f8001d90 comp rx=0 tx=0).stop 2024-09-17T03:00:50.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.232+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97080b5be0 msgr2=0x7f97081e9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.232+0000 7f970db39640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97080b5be0 0x7f97081e9bc0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f970806fac0 tx=0x7f9700001630 comp rx=0 tx=0).stop 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.233+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 shutdown_connections 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.233+0000 7f970db39640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f96f4078b90 0x7f96f407b0a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.233+0000 7f970db39640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97080b57d0 0x7f97081e9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.233+0000 7f970db39640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97080b5be0 0x7f97081e9bc0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.233+0000 7f970db39640 1 --2- 172.21.15.104:0/2412857116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96f0003a30 0x7f970814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.233+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 >> 172.21.15.104:0/2412857116 conn(0x7f970806eb90 msgr2=0x7f97081573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.233+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 shutdown_connections 2024-09-17T03:00:50.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.233+0000 7f970db39640 1 -- 172.21.15.104:0/2412857116 wait complete. 2024-09-17T03:00:50.247 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:00:50.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.361+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3606790895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f80d2350 msgr2=0x7ff7f806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.361+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3606790895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f80d2350 0x7ff7f806f550 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8005fd0 tx=0x7ff7e802a540 comp rx=0 tx=0).stop 2024-09-17T03:00:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.361+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3606790895 shutdown_connections 2024-09-17T03:00:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.361+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3606790895 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7f806fa90 0x7ff7f815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.361+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3606790895 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f80d2350 0x7ff7f806f550 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.361+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3606790895 >> 172.21.15.104:0/3606790895 conn(0x7ff7f806d200 msgr2=0x7ff7f806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.361+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3606790895 shutdown_connections 2024-09-17T03:00:50.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.361+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3606790895 wait complete. 2024-09-17T03:00:50.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.363+0000 7ff7ff6cc640 1 Processor -- start 2024-09-17T03:00:50.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.363+0000 7ff7ff6cc640 1 -- start start 2024-09-17T03:00:50.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7ff6cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f806fa90 0x7ff7f81548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:50.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7ff6cc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7f81610a0 0x7ff7f80aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:50.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7ff6cc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f8155030 0x7ff7f80ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7ff6cc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f815d2d0 con 0x7ff7f8155030 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7ff6cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f8074770 con 0x7ff7f806fa90 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7ff6cc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f815d450 con 0x7ff7f81610a0 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fdc69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f8155030 0x7ff7f80ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fdc69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f8155030 0x7ff7f80ab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44970/0 (socket says 172.21.15.104:44970) 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fdc69640 1 -- 172.21.15.104:0/3844806220 learned_addr learned my addr 172.21.15.104:0/3844806220 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fcc67640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7f81610a0 0x7ff7f80aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fd468640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f806fa90 0x7ff7f81548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fdc69640 1 -- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7f81610a0 msgr2=0x7ff7f80aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fdc69640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7f81610a0 0x7ff7f80aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fdc69640 1 -- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f806fa90 msgr2=0x7ff7f81548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.364+0000 7ff7fdc69640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f806fa90 0x7ff7f81548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.365+0000 7ff7fdc69640 1 -- 172.21.15.104:0/3844806220 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f81f7200 con 0x7ff7f8155030 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.365+0000 7ff7fdc69640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f8155030 0x7ff7f80ab500 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000ea40 tx=0x7ff7f000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.365+0000 7ff7edffb640 1 -- 172.21.15.104:0/3844806220 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f000ce40 con 0x7ff7f8155030 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.365+0000 7ff7edffb640 1 -- 172.21.15.104:0/3844806220 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7f0004c10 con 0x7ff7f8155030 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.365+0000 7ff7edffb640 1 -- 172.21.15.104:0/3844806220 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0005020 con 0x7ff7f8155030 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.365+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f8154de0 con 0x7ff7f8155030 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.365+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f81f77c0 con 0x7ff7f8155030 2024-09-17T03:00:50.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.366+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f815cd90 con 0x7ff7f8155030 2024-09-17T03:00:50.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.367+0000 7ff7edffb640 1 -- 172.21.15.104:0/3844806220 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7f00051c0 con 0x7ff7f8155030 2024-09-17T03:00:50.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.367+0000 7ff7edffb640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7dc078b90 0x7ff7dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:50.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.367+0000 7ff7edffb640 1 -- 172.21.15.104:0/3844806220 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4857+0+0 (secure 0 0 0) 0x7ff7f009b7a0 con 0x7ff7f8155030 2024-09-17T03:00:50.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.367+0000 7ff7fd468640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7dc078b90 0x7ff7dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:50.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.368+0000 7ff7fd468640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7dc078b90 0x7ff7dc07b0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80740d0 tx=0x7ff7f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:50.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.372+0000 7ff7edffb640 1 -- 172.21.15.104:0/3844806220 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7f00638e0 con 0x7ff7f8155030 2024-09-17T03:00:50.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.546+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff7f80b1190 con 0x7ff7f8155030 2024-09-17T03:00:50.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.546+0000 7ff7edffb640 1 -- 172.21.15.104:0/3844806220 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v133) ==== 84+0+65 (secure 0 0 0) 0x7ff7f0068310 con 0x7ff7f8155030 2024-09-17T03:00:50.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:50.545 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T03:00:50.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:00:50.545 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T03:00:50.545 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T03:00:50.546 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:00:50.546 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T03:00:50.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.548+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7dc078b90 msgr2=0x7ff7dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.548+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7dc078b90 0x7ff7dc07b0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80740d0 tx=0x7ff7f4009040 comp rx=0 tx=0).stop 2024-09-17T03:00:50.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.548+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f8155030 msgr2=0x7ff7f80ab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.548+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f8155030 0x7ff7f80ab500 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000ea40 tx=0x7ff7f000ef00 comp rx=0 tx=0).stop 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.549+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 shutdown_connections 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.549+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7dc078b90 0x7ff7dc07b0a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.549+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7f8155030 0x7ff7f80ab500 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.549+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7f81610a0 0x7ff7f80aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.549+0000 7ff7ff6cc640 1 --2- 172.21.15.104:0/3844806220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f806fa90 0x7ff7f81548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.549+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 >> 172.21.15.104:0/3844806220 conn(0x7ff7f806d200 msgr2=0x7ff7f80d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.549+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 shutdown_connections 2024-09-17T03:00:50.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.549+0000 7ff7ff6cc640 1 -- 172.21.15.104:0/3844806220 wait complete. 2024-09-17T03:00:50.558 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:00:50.558 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:00:50.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 -- 172.21.15.104:0/2270077286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 msgr2=0x7ff0700cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 --2- 172.21.15.104:0/2270077286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 0x7ff0700cf850 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ff0700cbc10 tx=0x7ff06402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 -- 172.21.15.104:0/2270077286 shutdown_connections 2024-09-17T03:00:50.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 --2- 172.21.15.104:0/2270077286 >> v2:172.21.15.192:3300/0 conn(0x7ff0700cfd90 0x7ff0700d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 --2- 172.21.15.104:0/2270077286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 0x7ff0700cf850 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 --2- 172.21.15.104:0/2270077286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff07015f3f0 0x7ff0700d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 -- 172.21.15.104:0/2270077286 >> 172.21.15.104:0/2270077286 conn(0x7ff0700d4c20 msgr2=0x7ff0700d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:50.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 -- 172.21.15.104:0/2270077286 shutdown_connections 2024-09-17T03:00:50.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.676+0000 7ff075789640 1 -- 172.21.15.104:0/2270077286 wait complete. 2024-09-17T03:00:50.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.678+0000 7ff075789640 1 Processor -- start 2024-09-17T03:00:50.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.678+0000 7ff075789640 1 -- start start 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff075789640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0700cfd90 0x7ff07014ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff075789640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 0x7ff0700ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff075789640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff07015f3f0 0x7ff07014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff075789640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700d0be0 con 0x7ff0700d2f40 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff075789640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700d0a60 con 0x7ff0700cfd90 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff075789640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff0700d0d60 con 0x7ff07015f3f0 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 0x7ff0700ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff06e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 0x7ff0700ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:44990/0 (socket says 172.21.15.104:44990) 2024-09-17T03:00:50.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff06e7fc640 1 -- 172.21.15.104:0/2160307218 learned_addr learned my addr 172.21.15.104:0/2160307218 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff06effd640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0700cfd90 0x7ff07014ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.679+0000 7ff06f7fe640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff07015f3f0 0x7ff07014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff06e7fc640 1 -- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff07015f3f0 msgr2=0x7ff07014be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff06e7fc640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff07015f3f0 0x7ff07014be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff06e7fc640 1 -- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0700cfd90 msgr2=0x7ff07014ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff06e7fc640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0700cfd90 0x7ff07014ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff06e7fc640 1 -- 172.21.15.104:0/2160307218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff070162b40 con 0x7ff0700d2f40 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff06e7fc640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 0x7ff0700ce8e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff064034040 tx=0x7ff064003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff0577fe640 1 -- 172.21.15.104:0/2160307218 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06403e030 con 0x7ff0700d2f40 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff0577fe640 1 -- 172.21.15.104:0/2160307218 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff064003e00 con 0x7ff0700d2f40 2024-09-17T03:00:50.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff0577fe640 1 -- 172.21.15.104:0/2160307218 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064035040 con 0x7ff0700d2f40 2024-09-17T03:00:50.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff070162580 con 0x7ff0700d2f40 2024-09-17T03:00:50.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.680+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0700b6000 con 0x7ff0700d2f40 2024-09-17T03:00:50.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.681+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0700cf850 con 0x7ff0700d2f40 2024-09-17T03:00:50.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.682+0000 7ff0577fe640 1 -- 172.21.15.104:0/2160307218 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff064041030 con 0x7ff0700d2f40 2024-09-17T03:00:50.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.682+0000 7ff0577fe640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff05c078bc0 0x7ff05c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:50.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.682+0000 7ff0577fe640 1 -- 172.21.15.104:0/2160307218 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4857+0+0 (secure 0 0 0) 0x7ff0640bb080 con 0x7ff0700d2f40 2024-09-17T03:00:50.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.682+0000 7ff06effd640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff05c078bc0 0x7ff05c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:50.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.683+0000 7ff06effd640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff05c078bc0 0x7ff05c07b0d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff060004630 tx=0x7ff06000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:50.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.687+0000 7ff0577fe640 1 -- 172.21.15.104:0/2160307218 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff064083250 con 0x7ff0700d2f40 2024-09-17T03:00:50.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:50.861+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff07006d510 con 0x7ff0700d2f40 2024-09-17T03:00:51.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.857+0000 7ff0577fe640 1 -- 172.21.15.104:0/2160307218 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v134) ==== 138+0+0 (secure 0 0 0) 0x7ff064087c80 con 0x7ff0700d2f40 2024-09-17T03:00:51.856 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T03:00:51.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff05c078bc0 msgr2=0x7ff05c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:51.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff05c078bc0 0x7ff05c07b0d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff060004630 tx=0x7ff06000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:00:51.859 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 msgr2=0x7ff0700ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:51.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 0x7ff0700ce8e0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff064034040 tx=0x7ff064003910 comp rx=0 tx=0).stop 2024-09-17T03:00:51.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 shutdown_connections 2024-09-17T03:00:51.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff05c078bc0 0x7ff05c07b0d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:51.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff07015f3f0 0x7ff07014be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:51.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff0700d2f40 0x7ff0700ce8e0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:51.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 --2- 172.21.15.104:0/2160307218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0700cfd90 0x7ff07014ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:51.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 >> 172.21.15.104:0/2160307218 conn(0x7ff0700d4c20 msgr2=0x7ff0700d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:51.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 shutdown_connections 2024-09-17T03:00:51.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.860+0000 7ff075789640 1 -- 172.21.15.104:0/2160307218 wait complete. 2024-09-17T03:00:51.874 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:00:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.998+0000 7fb9f29e4640 1 -- 172.21.15.104:0/110799845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 msgr2=0x7fb9d8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.998+0000 7fb9f29e4640 1 --2- 172.21.15.104:0/110799845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 0x7fb9d8003e50 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00baf0 tx=0x7fb9d8005830 comp rx=0 tx=0).stop 2024-09-17T03:00:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.998+0000 7fb9f29e4640 1 -- 172.21.15.104:0/110799845 shutdown_connections 2024-09-17T03:00:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.998+0000 7fb9f29e4640 1 --2- 172.21.15.104:0/110799845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 0x7fb9d8003e50 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.998+0000 7fb9f29e4640 1 -- 172.21.15.104:0/110799845 >> 172.21.15.104:0/110799845 conn(0x7fb9ec0b3640 msgr2=0x7fb9ec0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:51.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.998+0000 7fb9f29e4640 1 -- 172.21.15.104:0/110799845 shutdown_connections 2024-09-17T03:00:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:51.998+0000 7fb9f29e4640 1 -- 172.21.15.104:0/110799845 wait complete. 2024-09-17T03:00:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.000+0000 7fb9f29e4640 1 Processor -- start 2024-09-17T03:00:51.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.000+0000 7fb9f29e4640 1 -- start start 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9f29e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 0x7fb9ec15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9f29e4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9ec15b820 0x7fb9ec1f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9f29e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9ec1504e0 0x7fb9ec157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9f29e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec073700 con 0x7fb9d8003a00 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9f29e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec073580 con 0x7fb9ec1504e0 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9f29e4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ec073880 con 0x7fb9ec15b820 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9ebfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 0x7fb9ec15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9ebfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 0x7fb9ec15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45012/0 (socket says 172.21.15.104:45012) 2024-09-17T03:00:52.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9ebfff640 1 -- 172.21.15.104:0/100400896 learned_addr learned my addr 172.21.15.104:0/100400896 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9f0f81640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9ec1504e0 0x7fb9ec157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.001+0000 7fb9e3fff640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9ec15b820 0x7fb9ec1f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9ebfff640 1 -- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9ec15b820 msgr2=0x7fb9ec1f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9ebfff640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9ec15b820 0x7fb9ec1f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9ebfff640 1 -- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9ec1504e0 msgr2=0x7fb9ec157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9ebfff640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9ec1504e0 0x7fb9ec157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9ebfff640 1 -- 172.21.15.104:0/100400896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec159d90 con 0x7fb9d8003a00 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9f0f81640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9ec1504e0 0x7fb9ec157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9ebfff640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 0x7fb9ec15ab50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00bc10 tx=0x7fb9dc031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9e97fa640 1 -- 172.21.15.104:0/100400896 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc035040 con 0x7fb9d8003a00 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9e97fa640 1 -- 172.21.15.104:0/100400896 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9dc005310 con 0x7fb9d8003a00 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec15a070 con 0x7fb9d8003a00 2024-09-17T03:00:52.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9e97fa640 1 -- 172.21.15.104:0/100400896 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc03b7d0 con 0x7fb9d8003a00 2024-09-17T03:00:52.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.002+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec15a630 con 0x7fb9d8003a00 2024-09-17T03:00:52.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.003+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ec073de0 con 0x7fb9d8003a00 2024-09-17T03:00:52.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.004+0000 7fb9e97fa640 1 -- 172.21.15.104:0/100400896 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb9dc038020 con 0x7fb9d8003a00 2024-09-17T03:00:52.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.004+0000 7fb9e97fa640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb9cc078b90 0x7fb9cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:52.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.005+0000 7fb9e97fa640 1 -- 172.21.15.104:0/100400896 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5227+0+0 (secure 0 0 0) 0x7fb9dc0bd850 con 0x7fb9d8003a00 2024-09-17T03:00:52.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.005+0000 7fb9e3fff640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb9cc078b90 0x7fb9cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:52.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.005+0000 7fb9e3fff640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb9cc078b90 0x7fb9cc07b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4001860 tx=0x7fb9d4001bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:52.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.009+0000 7fb9e97fa640 1 -- 172.21.15.104:0/100400896 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9dc02c040 con 0x7fb9d8003a00 2024-09-17T03:00:52.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.183+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb9ec0b3dd0 con 0x7fb9d8003a00 2024-09-17T03:00:52.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.865+0000 7fb9e97fa640 1 -- 172.21.15.104:0/100400896 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v135) ==== 170+0+0 (secure 0 0 0) 0x7fb9dc085f00 con 0x7fb9d8003a00 2024-09-17T03:00:52.863 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T03:00:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb9cc078b90 msgr2=0x7fb9cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb9cc078b90 0x7fb9cc07b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4001860 tx=0x7fb9d4001bd0 comp rx=0 tx=0).stop 2024-09-17T03:00:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 msgr2=0x7fb9ec15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 0x7fb9ec15ab50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00bc10 tx=0x7fb9dc031f90 comp rx=0 tx=0).stop 2024-09-17T03:00:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 shutdown_connections 2024-09-17T03:00:52.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb9cc078b90 0x7fb9cc07b0a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9ec1504e0 0x7fb9ec157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9ec15b820 0x7fb9ec1f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 --2- 172.21.15.104:0/100400896 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb9d8003a00 0x7fb9ec15ab50 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 >> 172.21.15.104:0/100400896 conn(0x7fb9ec0b3640 msgr2=0x7fb9ec155f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.867+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 shutdown_connections 2024-09-17T03:00:52.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:52.868+0000 7fb9f29e4640 1 -- 172.21.15.104:0/100400896 wait complete. 2024-09-17T03:00:52.889 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:00:53.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.008+0000 7fb38273a640 1 -- 172.21.15.104:0/2483437904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb364003a00 msgr2=0x7fb364003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:53.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.008+0000 7fb38273a640 1 --2- 172.21.15.104:0/2483437904 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb364003a00 0x7fb364003e70 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00c260 tx=0x7fb364005830 comp rx=0 tx=0).stop 2024-09-17T03:00:53.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.008+0000 7fb380cd7640 1 -- 172.21.15.104:0/2483437904 reap_dead start 2024-09-17T03:00:53.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.008+0000 7fb38273a640 1 -- 172.21.15.104:0/2483437904 shutdown_connections 2024-09-17T03:00:53.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.008+0000 7fb38273a640 1 -- 172.21.15.104:0/2483437904 >> 172.21.15.104:0/2483437904 conn(0x7fb37c0b44a0 msgr2=0x7fb37c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:53.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.008+0000 7fb38273a640 1 -- 172.21.15.104:0/2483437904 shutdown_connections 2024-09-17T03:00:53.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.008+0000 7fb38273a640 1 -- 172.21.15.104:0/2483437904 wait complete. 2024-09-17T03:00:53.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.010+0000 7fb38273a640 1 Processor -- start 2024-09-17T03:00:53.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.010+0000 7fb38273a640 1 -- start start 2024-09-17T03:00:53.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb38273a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb364003a00 0x7fb37c1f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:53.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb38273a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb37c15fad0 0x7fb37c15fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:53.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb38273a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37c0cb690 0x7fb37c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:53.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb38273a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c1618f0 con 0x7fb37c0cb690 2024-09-17T03:00:53.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb38273a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c161770 con 0x7fb37c15fad0 2024-09-17T03:00:53.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb38273a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c161a70 con 0x7fb364003a00 2024-09-17T03:00:53.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb380cd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37c0cb690 0x7fb37c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:53.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb380cd7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37c0cb690 0x7fb37c0cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45040/0 (socket says 172.21.15.104:45040) 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb380cd7640 1 -- 172.21.15.104:0/434101998 learned_addr learned my addr 172.21.15.104:0/434101998 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb37bfff640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb364003a00 0x7fb37c1f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.011+0000 7fb37b7fe640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb37c15fad0 0x7fb37c15fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb380cd7640 1 -- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb364003a00 msgr2=0x7fb37c1f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb380cd7640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb364003a00 0x7fb37c1f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb380cd7640 1 -- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb37c15fad0 msgr2=0x7fb37c15fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb380cd7640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb37c15fad0 0x7fb37c15fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb380cd7640 1 -- 172.21.15.104:0/434101998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c1f89c0 con 0x7fb37c0cb690 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb380cd7640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37c0cb690 0x7fb37c0cbaa0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fb374005fd0 tx=0x7fb374004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb378ff9640 1 -- 172.21.15.104:0/434101998 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374004b20 con 0x7fb37c0cb690 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb378ff9640 1 -- 172.21.15.104:0/434101998 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb374004cc0 con 0x7fb37c0cb690 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37c0cbfe0 con 0x7fb37c0cb690 2024-09-17T03:00:53.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb378ff9640 1 -- 172.21.15.104:0/434101998 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374010d40 con 0x7fb37c0cb690 2024-09-17T03:00:53.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.012+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37c150cb0 con 0x7fb37c0cb690 2024-09-17T03:00:53.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.013+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37c0b6d30 con 0x7fb37c0cb690 2024-09-17T03:00:53.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.014+0000 7fb378ff9640 1 -- 172.21.15.104:0/434101998 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb37401c020 con 0x7fb37c0cb690 2024-09-17T03:00:53.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.014+0000 7fb378ff9640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb368078b90 0x7fb36807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:53.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.014+0000 7fb378ff9640 1 -- 172.21.15.104:0/434101998 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5609+0+0 (secure 0 0 0) 0x7fb37409b360 con 0x7fb37c0cb690 2024-09-17T03:00:53.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.015+0000 7fb37bfff640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb368078b90 0x7fb36807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:53.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.015+0000 7fb37bfff640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb368078b90 0x7fb36807b0a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb36c033000 tx=0x7fb36c038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:53.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.019+0000 7fb378ff9640 1 -- 172.21.15.104:0/434101998 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb37c0cbfe0 con 0x7fb37c0cb690 2024-09-17T03:00:53.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.228+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb37c0ce830 con 0x7fb37c0cb690 2024-09-17T03:00:53.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.883+0000 7fb378ff9640 1 -- 172.21.15.104:0/434101998 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v53) ==== 174+0+0 (secure 0 0 0) 0x7fb37c1f89c0 con 0x7fb37c0cb690 2024-09-17T03:00:53.882 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 16 and data pool 17 2024-09-17T03:00:53.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.888+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb368078b90 msgr2=0x7fb36807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.888+0000 7fb38273a640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb368078b90 0x7fb36807b0a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb36c033000 tx=0x7fb36c038040 comp rx=0 tx=0).stop 2024-09-17T03:00:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.888+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37c0cb690 msgr2=0x7fb37c0cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.888+0000 7fb38273a640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37c0cb690 0x7fb37c0cbaa0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fb374005fd0 tx=0x7fb374004700 comp rx=0 tx=0).stop 2024-09-17T03:00:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.889+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 shutdown_connections 2024-09-17T03:00:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.889+0000 7fb38273a640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb368078b90 0x7fb36807b0a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:53.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.889+0000 7fb38273a640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb37c15fad0 0x7fb37c15fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.889+0000 7fb38273a640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb37c0cb690 0x7fb37c0cbaa0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.889+0000 7fb38273a640 1 --2- 172.21.15.104:0/434101998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb364003a00 0x7fb37c1f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.889+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 >> 172.21.15.104:0/434101998 conn(0x7fb37c0b44a0 msgr2=0x7fb37c075ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.889+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 shutdown_connections 2024-09-17T03:00:53.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:53.889+0000 7fb38273a640 1 -- 172.21.15.104:0/434101998 wait complete. 2024-09-17T03:00:53.904 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:54.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.018+0000 7f18d3b57640 1 -- 172.21.15.104:0/2203274307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 msgr2=0x7f18cc156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.018+0000 7f18d3b57640 1 --2- 172.21.15.104:0/2203274307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 0x7f18cc156200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009830 tx=0x7f18c802a470 comp rx=0 tx=0).stop 2024-09-17T03:00:54.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.018+0000 7f18d3b57640 1 -- 172.21.15.104:0/2203274307 shutdown_connections 2024-09-17T03:00:54.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.018+0000 7f18d3b57640 1 --2- 172.21.15.104:0/2203274307 >> v2:172.21.15.192:3300/0 conn(0x7f18cc15cc30 0x7f18cc0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.018+0000 7f18d3b57640 1 --2- 172.21.15.104:0/2203274307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 0x7f18cc156200 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.018+0000 7f18d3b57640 1 -- 172.21.15.104:0/2203274307 >> 172.21.15.104:0/2203274307 conn(0x7f18cc06eb90 msgr2=0x7f18cc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:54.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.018+0000 7f18d3b57640 1 -- 172.21.15.104:0/2203274307 shutdown_connections 2024-09-17T03:00:54.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.018+0000 7f18d3b57640 1 -- 172.21.15.104:0/2203274307 wait complete. 2024-09-17T03:00:54.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.020+0000 7f18d3b57640 1 Processor -- start 2024-09-17T03:00:54.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.020+0000 7f18d3b57640 1 -- start start 2024-09-17T03:00:54.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d3b57640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 0x7f18cc1fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d3b57640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc0cdcb0 0x7f18cc146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d3b57640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18cc15cc30 0x7f18cc159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d3b57640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc160030 con 0x7f18cc15cc30 2024-09-17T03:00:54.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d3b57640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc15feb0 con 0x7f18cc0cdcb0 2024-09-17T03:00:54.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d3b57640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc1601b0 con 0x7f18cc073e00 2024-09-17T03:00:54.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d20f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18cc15cc30 0x7f18cc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d20f4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18cc15cc30 0x7f18cc159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45056/0 (socket says 172.21.15.104:45056) 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.021+0000 7f18d20f4640 1 -- 172.21.15.104:0/1197242949 learned_addr learned my addr 172.21.15.104:0/1197242949 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d18f3640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 0x7f18cc1fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d10f2640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc0cdcb0 0x7f18cc146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d20f4640 1 -- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 msgr2=0x7f18cc1fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d20f4640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 0x7f18cc1fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d20f4640 1 -- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc0cdcb0 msgr2=0x7f18cc146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d20f4640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc0cdcb0 0x7f18cc146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d20f4640 1 -- 172.21.15.104:0/1197242949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc1473c0 con 0x7f18cc15cc30 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d18f3640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 0x7f18cc1fa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d10f2640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc0cdcb0 0x7f18cc146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d20f4640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18cc15cc30 0x7f18cc159630 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f18c400cae0 tx=0x7f18c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:54.022 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18c27fc640 1 -- 172.21.15.104:0/1197242949 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4016020 con 0x7f18cc15cc30 2024-09-17T03:00:54.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18c27fc640 1 -- 172.21.15.104:0/1197242949 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18c400ad30 con 0x7f18cc15cc30 2024-09-17T03:00:54.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc156b60 con 0x7f18cc15cc30 2024-09-17T03:00:54.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18c27fc640 1 -- 172.21.15.104:0/1197242949 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4012680 con 0x7f18cc15cc30 2024-09-17T03:00:54.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.022+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc1f9ad0 con 0x7f18cc15cc30 2024-09-17T03:00:54.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.023+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc0cef30 con 0x7f18cc15cc30 2024-09-17T03:00:54.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.024+0000 7f18c27fc640 1 -- 172.21.15.104:0/1197242949 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18c4019020 con 0x7f18cc15cc30 2024-09-17T03:00:54.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.024+0000 7f18c27fc640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f18b0078b90 0x7f18b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.025+0000 7f18c27fc640 1 -- 172.21.15.104:0/1197242949 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f18c409b100 con 0x7f18cc15cc30 2024-09-17T03:00:54.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.025+0000 7f18d18f3640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f18b0078b90 0x7f18b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.026+0000 7f18d18f3640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f18b0078b90 0x7f18b007b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f18c8034000 tx=0x7f18c8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:54.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.029+0000 7f18c27fc640 1 -- 172.21.15.104:0/1197242949 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18cc0cef30 con 0x7f18cc15cc30 2024-09-17T03:00:54.203 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.205+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18cc156200 con 0x7f18cc15cc30 2024-09-17T03:00:54.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.206+0000 7f18c27fc640 1 -- 172.21.15.104:0/1197242949 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16749 (secure 0 0 0) 0x7f18c4020030 con 0x7f18cc15cc30 2024-09-17T03:00:54.205 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:54.205 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":136,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:53.229518+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:50.865818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:52.188131+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f18b0078b90 msgr2=0x7f18b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f18b0078b90 0x7f18b007b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f18c8034000 tx=0x7f18c8004730 comp rx=0 tx=0).stop 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18cc15cc30 msgr2=0x7f18cc159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18cc15cc30 0x7f18cc159630 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f18c400cae0 tx=0x7f18c400a060 comp rx=0 tx=0).stop 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 shutdown_connections 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f18b0078b90 0x7f18b007b0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc0cdcb0 0x7f18cc146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f18cc15cc30 0x7f18cc159630 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 --2- 172.21.15.104:0/1197242949 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18cc073e00 0x7f18cc1fa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.208+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 >> 172.21.15.104:0/1197242949 conn(0x7f18cc06eb90 msgr2=0x7f18cc070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:54.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.209+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 shutdown_connections 2024-09-17T03:00:54.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.209+0000 7f18d3b57640 1 -- 172.21.15.104:0/1197242949 wait complete. 2024-09-17T03:00:54.219 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.332+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/1338374490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b3520 msgr2=0x7f5b680b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.332+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/1338374490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b3520 0x7f5b680b3930 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5b60005fd0 tx=0x7f5b6002a870 comp rx=0 tx=0).stop 2024-09-17T03:00:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.332+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/1338374490 shutdown_connections 2024-09-17T03:00:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.332+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/1338374490 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b3520 0x7f5b680b3930 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.332+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/1338374490 >> v2:172.21.15.192:3300/0 conn(0x7f5b6815fee0 0x7f5b6815ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.332+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/1338374490 >> 172.21.15.104:0/1338374490 conn(0x7f5b68069120 msgr2=0x7f5b68069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:54.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.332+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/1338374490 shutdown_connections 2024-09-17T03:00:54.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.332+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/1338374490 wait complete. 2024-09-17T03:00:54.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.334+0000 7f5b6e3e6640 1 Processor -- start 2024-09-17T03:00:54.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.334+0000 7f5b6e3e6640 1 -- start start 2024-09-17T03:00:54.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.335+0000 7f5b6e3e6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b680b3520 0x7f5b6814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.335+0000 7f5b6e3e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b6570 0x7f5b6814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.335+0000 7f5b6e3e6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6815fee0 0x7f5b680ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.335+0000 7f5b6e3e6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5b680b3e70 con 0x7f5b680b6570 2024-09-17T03:00:54.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.335+0000 7f5b6e3e6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6815f310 con 0x7f5b680b3520 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.335+0000 7f5b6e3e6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5b680b3ff0 con 0x7f5b6815fee0 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.335+0000 7f5b677fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b6570 0x7f5b6814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.335+0000 7f5b677fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b6570 0x7f5b6814a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35346/0 (socket says 172.21.15.104:35346) 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b677fe640 1 -- 172.21.15.104:0/430423045 learned_addr learned my addr 172.21.15.104:0/430423045 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b67fff640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b680b3520 0x7f5b6814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b6c983640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6815fee0 0x7f5b680ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b677fe640 1 -- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6815fee0 msgr2=0x7f5b680ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b677fe640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6815fee0 0x7f5b680ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b677fe640 1 -- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b680b3520 msgr2=0x7f5b6814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b677fe640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b680b3520 0x7f5b6814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b677fe640 1 -- 172.21.15.104:0/430423045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b681595b0 con 0x7f5b680b6570 2024-09-17T03:00:54.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b677fe640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b6570 0x7f5b6814a410 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00c400 tx=0x7f5b5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:54.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b64ff9640 1 -- 172.21.15.104:0/430423045 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c011790 con 0x7f5b680b6570 2024-09-17T03:00:54.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b64ff9640 1 -- 172.21.15.104:0/430423045 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b5c017070 con 0x7f5b680b6570 2024-09-17T03:00:54.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b64ff9640 1 -- 172.21.15.104:0/430423045 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c011ce0 con 0x7f5b680b6570 2024-09-17T03:00:54.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6814dc50 con 0x7f5b680b6570 2024-09-17T03:00:54.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.336+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b680cd180 con 0x7f5b680b6570 2024-09-17T03:00:54.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.337+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b680ccef0 con 0x7f5b680b6570 2024-09-17T03:00:54.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.338+0000 7f5b64ff9640 1 -- 172.21.15.104:0/430423045 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b5c01c460 con 0x7f5b680b6570 2024-09-17T03:00:54.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.338+0000 7f5b64ff9640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b54078b90 0x7f5b5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.339+0000 7f5b64ff9640 1 -- 172.21.15.104:0/430423045 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f5b5c09ab50 con 0x7f5b680b6570 2024-09-17T03:00:54.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.339+0000 7f5b67fff640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b54078b90 0x7f5b5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.339+0000 7f5b67fff640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b54078b90 0x7f5b5407b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800bb50 tx=0x7f5b5800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:54.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.343+0000 7f5b64ff9640 1 -- 172.21.15.104:0/430423045 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5b681595b0 con 0x7f5b680b6570 2024-09-17T03:00:54.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.517+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b680ba090 con 0x7f5b680b6570 2024-09-17T03:00:54.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.518+0000 7f5b64ff9640 1 -- 172.21.15.104:0/430423045 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16749 (secure 0 0 0) 0x7f5b5c011e80 con 0x7f5b680b6570 2024-09-17T03:00:54.517 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:54.517 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":136,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:53.229518+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:50.865818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:52.188131+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:54.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b54078b90 msgr2=0x7f5b5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b54078b90 0x7f5b5407b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800bb50 tx=0x7f5b5800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b6570 msgr2=0x7f5b6814a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b6570 0x7f5b6814a410 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00c400 tx=0x7f5b5c00c8c0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 shutdown_connections 2024-09-17T03:00:54.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5b54078b90 0x7f5b5407b0a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.519 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b6815fee0 0x7f5b680ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5b680b6570 0x7f5b6814a410 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 --2- 172.21.15.104:0/430423045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b680b3520 0x7f5b6814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 >> 172.21.15.104:0/430423045 conn(0x7f5b68069120 msgr2=0x7f5b680b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:54.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 shutdown_connections 2024-09-17T03:00:54.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.520+0000 7f5b6e3e6640 1 -- 172.21.15.104:0/430423045 wait complete. 2024-09-17T03:00:54.530 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:00:54.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.648+0000 7f8dc33ba640 1 -- 172.21.15.104:0/3398694426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 msgr2=0x7f8da8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.648+0000 7f8dc33ba640 1 --2- 172.21.15.104:0/3398694426 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 0x7f8da8003ec0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f8db800bbb0 tx=0x7f8da8005830 comp rx=0 tx=0).stop 2024-09-17T03:00:54.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.648+0000 7f8dc1957640 1 -- 172.21.15.104:0/3398694426 reap_dead start 2024-09-17T03:00:54.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.648+0000 7f8dc33ba640 1 -- 172.21.15.104:0/3398694426 shutdown_connections 2024-09-17T03:00:54.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.648+0000 7f8dc33ba640 1 -- 172.21.15.104:0/3398694426 >> 172.21.15.104:0/3398694426 conn(0x7f8dbc073df0 msgr2=0x7f8dbc068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:54.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.648+0000 7f8dc33ba640 1 -- 172.21.15.104:0/3398694426 shutdown_connections 2024-09-17T03:00:54.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.648+0000 7f8dc33ba640 1 -- 172.21.15.104:0/3398694426 wait complete. 2024-09-17T03:00:54.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.650+0000 7f8dc33ba640 1 Processor -- start 2024-09-17T03:00:54.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.650+0000 7f8dc33ba640 1 -- start start 2024-09-17T03:00:54.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc33ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 0x7f8dbc162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc33ba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc0c83d0 0x7f8dbc14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc33ba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8dbc0c9be0 0x7f8dbc1f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc33ba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc15f320 con 0x7f8da8003a50 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc33ba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc15f1a0 con 0x7f8dbc0c83d0 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc33ba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc0d3a30 con 0x7f8dbc0c9be0 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 0x7f8dbc162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 0x7f8dbc162100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35364/0 (socket says 172.21.15.104:35364) 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 -- 172.21.15.104:0/1000971523 learned_addr learned my addr 172.21.15.104:0/1000971523 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc0955640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc0c83d0 0x7f8dbc14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1957640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8dbc0c9be0 0x7f8dbc1f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 -- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8dbc0c9be0 msgr2=0x7f8dbc1f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8dbc0c9be0 0x7f8dbc1f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 -- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc0c83d0 msgr2=0x7f8dbc14fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc0c83d0 0x7f8dbc14fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 -- 172.21.15.104:0/1000971523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc0c8b40 con 0x7f8da8003a50 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc0955640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc0c83d0 0x7f8dbc14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.651+0000 7f8dc1156640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 0x7f8dbc162100 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8db800bbb0 tx=0x7f8db80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.652+0000 7f8db1ffb640 1 -- 172.21.15.104:0/1000971523 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8005020 con 0x7f8da8003a50 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.652+0000 7f8db1ffb640 1 -- 172.21.15.104:0/1000971523 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8db80052b0 con 0x7f8da8003a50 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.652+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc0c8e20 con 0x7f8da8003a50 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.652+0000 7f8db1ffb640 1 -- 172.21.15.104:0/1000971523 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db80047a0 con 0x7f8da8003a50 2024-09-17T03:00:54.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.652+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc0c93e0 con 0x7f8da8003a50 2024-09-17T03:00:54.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.653+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dbc0d34f0 con 0x7f8da8003a50 2024-09-17T03:00:54.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.654+0000 7f8db1ffb640 1 -- 172.21.15.104:0/1000971523 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8db8038070 con 0x7f8da8003a50 2024-09-17T03:00:54.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.654+0000 7f8db1ffb640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8da0078b90 0x7f8da007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:54.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.654+0000 7f8db1ffb640 1 -- 172.21.15.104:0/1000971523 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5709+0+0 (secure 0 0 0) 0x7f8db80bbc90 con 0x7f8da8003a50 2024-09-17T03:00:54.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.654+0000 7f8dc0955640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8da0078b90 0x7f8da007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:54.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.655+0000 7f8dc0955640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8da0078b90 0x7f8da007b0a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8dac001860 tx=0x7f8dac001df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:54.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.658+0000 7f8db1ffb640 1 -- 172.21.15.104:0/1000971523 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8db803e030 con 0x7f8da8003a50 2024-09-17T03:00:54.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.868+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8dbc0ba480 con 0x7f8da8003a50 2024-09-17T03:00:54.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.885+0000 7f8db1ffb640 1 -- 172.21.15.104:0/1000971523 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) ==== 118+0+0 (secure 0 0 0) 0x7f8db8084240 con 0x7f8da8003a50 2024-09-17T03:00:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8da0078b90 msgr2=0x7f8da007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8da0078b90 0x7f8da007b0a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8dac001860 tx=0x7f8dac001df0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 msgr2=0x7f8dbc162100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 0x7f8dbc162100 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f8db800bbb0 tx=0x7f8db80038a0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 shutdown_connections 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8da0078b90 0x7f8da007b0a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc0c83d0 0x7f8dbc14fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8dbc0c9be0 0x7f8dbc1f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 --2- 172.21.15.104:0/1000971523 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da8003a50 0x7f8dbc162100 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 >> 172.21.15.104:0/1000971523 conn(0x7f8dbc073df0 msgr2=0x7f8dbc0b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 shutdown_connections 2024-09-17T03:00:54.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:54.888+0000 7f8dc33ba640 1 -- 172.21.15.104:0/1000971523 wait complete. 2024-09-17T03:00:54.898 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:00:54.898 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:00:55.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.014+0000 7f04ab8f9640 1 -- 172.21.15.104:0/3015708440 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 msgr2=0x7f04a415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:55.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.014+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/3015708440 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 0x7f04a415d210 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f04a4072c80 tx=0x7f049c02a410 comp rx=0 tx=0).stop 2024-09-17T03:00:55.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.014+0000 7f04ab8f9640 1 -- 172.21.15.104:0/3015708440 shutdown_connections 2024-09-17T03:00:55.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.014+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/3015708440 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 0x7f04a415d210 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:55.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.014+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/3015708440 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a4072cf0 0x7f04a4073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:55.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.014+0000 7f04ab8f9640 1 -- 172.21.15.104:0/3015708440 >> 172.21.15.104:0/3015708440 conn(0x7f04a406eb90 msgr2=0x7f04a406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:55.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.014+0000 7f04ab8f9640 1 -- 172.21.15.104:0/3015708440 shutdown_connections 2024-09-17T03:00:55.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.014+0000 7f04ab8f9640 1 -- 172.21.15.104:0/3015708440 wait complete. 2024-09-17T03:00:55.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.016+0000 7f04ab8f9640 1 Processor -- start 2024-09-17T03:00:55.014 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.016+0000 7f04ab8f9640 1 -- start start 2024-09-17T03:00:55.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04ab8f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f6b0 0x7f04a4155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:55.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04ab8f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a4072cf0 0x7f04a4155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:55.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04ab8f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 0x7f04a40b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:55.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04ab8f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f04a415dae0 con 0x7f04a415ce00 2024-09-17T03:00:55.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04ab8f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f04a415d960 con 0x7f04a4072cf0 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04ab8f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f04a415dc60 con 0x7f04a406f6b0 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9e96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 0x7f04a40b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9e96640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 0x7f04a40b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35390/0 (socket says 172.21.15.104:35390) 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9e96640 1 -- 172.21.15.104:0/2449897634 learned_addr learned my addr 172.21.15.104:0/2449897634 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a8e94640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a4072cf0 0x7f04a4155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9695640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f6b0 0x7f04a4155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9e96640 1 -- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f6b0 msgr2=0x7f04a4155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9e96640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f6b0 0x7f04a4155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9e96640 1 -- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a4072cf0 msgr2=0x7f04a4155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9e96640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a4072cf0 0x7f04a4155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9e96640 1 -- 172.21.15.104:0/2449897634 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a41568b0 con 0x7f04a415ce00 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a8e94640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a4072cf0 0x7f04a4155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:55.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.017+0000 7f04a9695640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f6b0 0x7f04a4155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:55.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.018+0000 7f04a9e96640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 0x7f04a40b17c0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f049c034040 tx=0x7f049c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:55.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.018+0000 7f04a1ffb640 1 -- 172.21.15.104:0/2449897634 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c03e030 con 0x7f04a415ce00 2024-09-17T03:00:55.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.018+0000 7f04a1ffb640 1 -- 172.21.15.104:0/2449897634 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f049c003e50 con 0x7f04a415ce00 2024-09-17T03:00:55.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.018+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a40b57d0 con 0x7f04a415ce00 2024-09-17T03:00:55.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.018+0000 7f04a1ffb640 1 -- 172.21.15.104:0/2449897634 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c035040 con 0x7f04a415ce00 2024-09-17T03:00:55.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.018+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a41548d0 con 0x7f04a415ce00 2024-09-17T03:00:55.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.019+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a4154b30 con 0x7f04a415ce00 2024-09-17T03:00:55.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.020+0000 7f04a1ffb640 1 -- 172.21.15.104:0/2449897634 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f049c041030 con 0x7f04a415ce00 2024-09-17T03:00:55.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.020+0000 7f04a1ffb640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0490078bf0 0x7f049007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:55.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.020+0000 7f04a1ffb640 1 -- 172.21.15.104:0/2449897634 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f049c0bb480 con 0x7f04a415ce00 2024-09-17T03:00:55.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.021+0000 7f04a9695640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0490078bf0 0x7f049007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:55.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.021+0000 7f04a9695640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0490078bf0 0x7f049007b100 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f049400c420 tx=0x7f0494009570 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:55.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.025+0000 7f04a1ffb640 1 -- 172.21.15.104:0/2449897634 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f049c083960 con 0x7f04a415ce00 2024-09-17T03:00:55.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.234+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f04a4073100 con 0x7f04a415ce00 2024-09-17T03:00:55.856 INFO:tasks.ceph.mds.d.smithi192.stderr:2024-09-17T03:00:55.857+0000 7fdf71c1e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:00:55.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.897+0000 7f04a1ffb640 1 -- 172.21.15.104:0/2449897634 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) ==== 122+0+0 (secure 0 0 0) 0x7f049c083260 con 0x7f04a415ce00 2024-09-17T03:00:55.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0490078bf0 msgr2=0x7f049007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:55.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0490078bf0 0x7f049007b100 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f049400c420 tx=0x7f0494009570 comp rx=0 tx=0).stop 2024-09-17T03:00:55.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 msgr2=0x7f04a40b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:55.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 0x7f04a40b17c0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f049c034040 tx=0x7f049c003960 comp rx=0 tx=0).stop 2024-09-17T03:00:55.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 shutdown_connections 2024-09-17T03:00:55.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0490078bf0 0x7f049007b100 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:55.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a4072cf0 0x7f04a4155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:55.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f04a415ce00 0x7f04a40b17c0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:55.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 --2- 172.21.15.104:0/2449897634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04a406f6b0 0x7f04a4155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:55.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 >> 172.21.15.104:0/2449897634 conn(0x7f04a406eb90 msgr2=0x7f04a415e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:55.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 shutdown_connections 2024-09-17T03:00:55.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:55.899+0000 7f04ab8f9640 1 -- 172.21.15.104:0/2449897634 wait complete. 2024-09-17T03:00:55.911 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:00:55.911 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:00:56.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.028+0000 7f98b4e69640 1 -- 172.21.15.104:0/1846703967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 msgr2=0x7f98b00b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.028+0000 7f98b4e69640 1 --2- 172.21.15.104:0/1846703967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 0x7f98b00b3750 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f98b0069fb0 tx=0x7f98a802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.028+0000 7f98b4e69640 1 -- 172.21.15.104:0/1846703967 shutdown_connections 2024-09-17T03:00:56.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.028+0000 7f98b4e69640 1 --2- 172.21.15.104:0/1846703967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 0x7f98b00b3750 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.028+0000 7f98b4e69640 1 --2- 172.21.15.104:0/1846703967 >> v2:172.21.15.192:3300/0 conn(0x7f98b00cff70 0x7f98b015b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.028+0000 7f98b4e69640 1 -- 172.21.15.104:0/1846703967 >> 172.21.15.104:0/1846703967 conn(0x7f98b00b2450 msgr2=0x7f98b00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:56.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.028+0000 7f98b4e69640 1 -- 172.21.15.104:0/1846703967 shutdown_connections 2024-09-17T03:00:56.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.028+0000 7f98b4e69640 1 -- 172.21.15.104:0/1846703967 wait complete. 2024-09-17T03:00:56.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.030+0000 7f98b4e69640 1 Processor -- start 2024-09-17T03:00:56.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.030+0000 7f98b4e69640 1 -- start start 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98b4e69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98b006f840 0x7f98b01f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98b4e69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 0x7f98b00b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98b4e69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98b00cff70 0x7f98b00b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98b4e69640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f98b006fdd0 con 0x7f98b0073540 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98b4e69640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f98b006fc50 con 0x7f98b00cff70 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98b4e69640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f98b00b3c90 con 0x7f98b006f840 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98add9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 0x7f98b00b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98add9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 0x7f98b00b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35402/0 (socket says 172.21.15.104:35402) 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98add9b640 1 -- 172.21.15.104:0/2053518579 learned_addr learned my addr 172.21.15.104:0/2053518579 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98aed9d640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98b00cff70 0x7f98b00b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98ae59c640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98b006f840 0x7f98b01f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98add9b640 1 -- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98b006f840 msgr2=0x7f98b01f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98add9b640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98b006f840 0x7f98b01f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98add9b640 1 -- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98b00cff70 msgr2=0x7f98b00b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.031+0000 7f98add9b640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98b00cff70 0x7f98b00b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.032+0000 7f98add9b640 1 -- 172.21.15.104:0/2053518579 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b01f3e50 con 0x7f98b0073540 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.032+0000 7f98aed9d640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98b00cff70 0x7f98b00b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.032+0000 7f98add9b640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 0x7f98b00b4350 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c3c0 tx=0x7f98a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.032+0000 7f989effd640 1 -- 172.21.15.104:0/2053518579 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4017070 con 0x7f98b0073540 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.032+0000 7f989effd640 1 -- 172.21.15.104:0/2053518579 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98a40035f0 con 0x7f98b0073540 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.032+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b01f4130 con 0x7f98b0073540 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.032+0000 7f989effd640 1 -- 172.21.15.104:0/2053518579 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a4003a20 con 0x7f98b0073540 2024-09-17T03:00:56.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.032+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b01f46f0 con 0x7f98b0073540 2024-09-17T03:00:56.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.033+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b00b4140 con 0x7f98b0073540 2024-09-17T03:00:56.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.034+0000 7f989effd640 1 -- 172.21.15.104:0/2053518579 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98a401a070 con 0x7f98b0073540 2024-09-17T03:00:56.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.034+0000 7f989effd640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9890078b90 0x7f989007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.034+0000 7f989effd640 1 -- 172.21.15.104:0/2053518579 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f98a4099f20 con 0x7f98b0073540 2024-09-17T03:00:56.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.034+0000 7f98ae59c640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9890078b90 0x7f989007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.035+0000 7f98ae59c640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9890078b90 0x7f989007b0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f98a000a490 tx=0x7f98a000a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:56.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.039+0000 7f989effd640 1 -- 172.21.15.104:0/2053518579 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f98a4061d10 con 0x7f98b0073540 2024-09-17T03:00:56.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.247+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98b00b2fe0 con 0x7f98b0073540 2024-09-17T03:00:56.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.247+0000 7f989effd640 1 -- 172.21.15.104:0/2053518579 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f98a4066740 con 0x7f98b0073540 2024-09-17T03:00:56.246 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:56.246 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:00:56.246 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:00:56.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9890078b90 msgr2=0x7f989007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9890078b90 0x7f989007b0a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f98a000a490 tx=0x7f98a000a420 comp rx=0 tx=0).stop 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 msgr2=0x7f98b00b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 0x7f98b00b4350 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c3c0 tx=0x7f98a400c880 comp rx=0 tx=0).stop 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 shutdown_connections 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9890078b90 0x7f989007b0a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98b00cff70 0x7f98b00b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98b0073540 0x7f98b00b4350 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 --2- 172.21.15.104:0/2053518579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98b006f840 0x7f98b01f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 >> 172.21.15.104:0/2053518579 conn(0x7f98b00b2450 msgr2=0x7f98b0159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 shutdown_connections 2024-09-17T03:00:56.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.250+0000 7f98b4e69640 1 -- 172.21.15.104:0/2053518579 wait complete. 2024-09-17T03:00:56.260 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:00:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.374+0000 7f9f574d3640 1 -- 172.21.15.104:0/4245145811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 msgr2=0x7f9f500cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.374+0000 7f9f574d3640 1 --2- 172.21.15.104:0/4245145811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 0x7f9f500cde90 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f9f50069ef0 tx=0x7f9f4002a860 comp rx=0 tx=0).stop 2024-09-17T03:00:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.374+0000 7f9f574d3640 1 -- 172.21.15.104:0/4245145811 shutdown_connections 2024-09-17T03:00:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.374+0000 7f9f574d3640 1 --2- 172.21.15.104:0/4245145811 >> v2:172.21.15.192:3300/0 conn(0x7f9f500cefb0 0x7f9f500cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.374+0000 7f9f574d3640 1 --2- 172.21.15.104:0/4245145811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 0x7f9f500cde90 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.374+0000 7f9f574d3640 1 -- 172.21.15.104:0/4245145811 >> 172.21.15.104:0/4245145811 conn(0x7f9f500d28a0 msgr2=0x7f9f500d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.374+0000 7f9f574d3640 1 -- 172.21.15.104:0/4245145811 shutdown_connections 2024-09-17T03:00:56.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.374+0000 7f9f574d3640 1 -- 172.21.15.104:0/4245145811 wait complete. 2024-09-17T03:00:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.376+0000 7f9f574d3640 1 Processor -- start 2024-09-17T03:00:56.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.376+0000 7f9f574d3640 1 -- start start 2024-09-17T03:00:56.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f574d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 0x7f9f500c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f574d3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f500cefb0 0x7f9f501f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f574d3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f500d0470 0x7f9f501f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f574d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9f500cf900 con 0x7f9f500b7bb0 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f574d3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9f500ce620 con 0x7f9f500cefb0 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f574d3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9f500cfa80 con 0x7f9f500d0470 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 0x7f9f500c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 0x7f9f500c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35422/0 (socket says 172.21.15.104:35422) 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 -- 172.21.15.104:0/2043267978 learned_addr learned my addr 172.21.15.104:0/2043267978 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f55a70640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f500d0470 0x7f9f501f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f54a6e640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f500cefb0 0x7f9f501f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 -- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f500d0470 msgr2=0x7f9f501f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f500d0470 0x7f9f501f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 -- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f500cefb0 msgr2=0x7f9f501f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.377 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f500cefb0 0x7f9f501f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 -- 172.21.15.104:0/2043267978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f500b0be0 con 0x7f9f500b7bb0 2024-09-17T03:00:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f54a6e640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f500cefb0 0x7f9f501f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f5526f640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 0x7f9f500c8520 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9f40000f80 tx=0x7f9f40003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.377+0000 7f9f4dffb640 1 -- 172.21.15.104:0/2043267978 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40004b40 con 0x7f9f500b7bb0 2024-09-17T03:00:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.378+0000 7f9f4dffb640 1 -- 172.21.15.104:0/2043267978 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f40004dd0 con 0x7f9f500b7bb0 2024-09-17T03:00:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.378+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f500b0ec0 con 0x7f9f500b7bb0 2024-09-17T03:00:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.378+0000 7f9f4dffb640 1 -- 172.21.15.104:0/2043267978 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f400042a0 con 0x7f9f500b7bb0 2024-09-17T03:00:56.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.378+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f500b1480 con 0x7f9f500b7bb0 2024-09-17T03:00:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.379+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f500cde90 con 0x7f9f500b7bb0 2024-09-17T03:00:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.380+0000 7f9f4dffb640 1 -- 172.21.15.104:0/2043267978 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f4000c040 con 0x7f9f500b7bb0 2024-09-17T03:00:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.380+0000 7f9f4dffb640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f3c078b90 0x7f9f3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.380+0000 7f9f4dffb640 1 -- 172.21.15.104:0/2043267978 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f9f400bc1d0 con 0x7f9f500b7bb0 2024-09-17T03:00:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.380+0000 7f9f54a6e640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f3c078b90 0x7f9f3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.381+0000 7f9f54a6e640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f3c078b90 0x7f9f3c07b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9f501e3010 tx=0x7f9f44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:56.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.384+0000 7f9f4dffb640 1 -- 172.21.15.104:0/2043267978 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9f40084730 con 0x7f9f500b7bb0 2024-09-17T03:00:56.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.562+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f500712b0 con 0x7f9f500b7bb0 2024-09-17T03:00:56.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.563+0000 7f9f4dffb640 1 -- 172.21.15.104:0/2043267978 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16736 (secure 0 0 0) 0x7f9f40084030 con 0x7f9f500b7bb0 2024-09-17T03:00:56.561 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:56.562 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":137,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:00:54.868411+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:50.865818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:52.188131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f3c078b90 msgr2=0x7f9f3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f3c078b90 0x7f9f3c07b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9f501e3010 tx=0x7f9f44008040 comp rx=0 tx=0).stop 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 msgr2=0x7f9f500c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 0x7f9f500c8520 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f9f40000f80 tx=0x7f9f40003ba0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 shutdown_connections 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f3c078b90 0x7f9f3c07b0a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f500cefb0 0x7f9f501f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f500d0470 0x7f9f501f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 --2- 172.21.15.104:0/2043267978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f500b7bb0 0x7f9f500c8520 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 >> 172.21.15.104:0/2043267978 conn(0x7f9f500d28a0 msgr2=0x7f9f50070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 shutdown_connections 2024-09-17T03:00:56.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.565+0000 7f9f574d3640 1 -- 172.21.15.104:0/2043267978 wait complete. 2024-09-17T03:00:56.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:00:56.575 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.689+0000 7fb0cc39b640 1 -- 172.21.15.104:0/2806382589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40cefb0 msgr2=0x7fb0c40cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.689+0000 7fb0cc39b640 1 --2- 172.21.15.104:0/2806382589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40cefb0 0x7fb0c40cf3c0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc005fd0 tx=0x7fb0bc02a820 comp rx=0 tx=0).stop 2024-09-17T03:00:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.689+0000 7fb0cc39b640 1 -- 172.21.15.104:0/2806382589 shutdown_connections 2024-09-17T03:00:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.689+0000 7fb0cc39b640 1 --2- 172.21.15.104:0/2806382589 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40cefb0 0x7fb0c40cf3c0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.689+0000 7fb0cc39b640 1 -- 172.21.15.104:0/2806382589 >> 172.21.15.104:0/2806382589 conn(0x7fb0c40d28a0 msgr2=0x7fb0c40d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.689+0000 7fb0cc39b640 1 -- 172.21.15.104:0/2806382589 shutdown_connections 2024-09-17T03:00:56.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.689+0000 7fb0cc39b640 1 -- 172.21.15.104:0/2806382589 wait complete. 2024-09-17T03:00:56.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.691+0000 7fb0cc39b640 1 Processor -- start 2024-09-17T03:00:56.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.691+0000 7fb0cc39b640 1 -- start start 2024-09-17T03:00:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0cc39b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40b7bb0 0x7fb0c415d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0cc39b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40cefb0 0x7fb0c40caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0cc39b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40d0470 0x7fb0c40cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0cc39b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c40cfcd0 con 0x7fb0c40d0470 2024-09-17T03:00:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0cc39b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c40cfb50 con 0x7fb0c40b7bb0 2024-09-17T03:00:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0cc39b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c40b3560 con 0x7fb0c40cefb0 2024-09-17T03:00:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0ca938640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40d0470 0x7fb0c40cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0ca938640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40d0470 0x7fb0c40cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35436/0 (socket says 172.21.15.104:35436) 2024-09-17T03:00:56.695 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.692+0000 7fb0ca938640 1 -- 172.21.15.104:0/3978569655 learned_addr learned my addr 172.21.15.104:0/3978569655 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0ca137640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40b7bb0 0x7fb0c415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0c9936640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40cefb0 0x7fb0c40caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0ca938640 1 -- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40cefb0 msgr2=0x7fb0c40caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0ca938640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40cefb0 0x7fb0c40caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0ca938640 1 -- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40b7bb0 msgr2=0x7fb0c415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.696 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0ca938640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40b7bb0 0x7fb0c415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0ca938640 1 -- 172.21.15.104:0/3978569655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c41606b0 con 0x7fb0c40d0470 2024-09-17T03:00:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0ca137640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40b7bb0 0x7fb0c415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0ca938640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40d0470 0x7fb0c40cb4a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc035040 tx=0x7fb0bc032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0baffd640 1 -- 172.21.15.104:0/3978569655 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc037040 con 0x7fb0c40d0470 2024-09-17T03:00:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0baffd640 1 -- 172.21.15.104:0/3978569655 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0bc042070 con 0x7fb0c40d0470 2024-09-17T03:00:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c4160990 con 0x7fb0c40d0470 2024-09-17T03:00:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0baffd640 1 -- 172.21.15.104:0/3978569655 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc003e60 con 0x7fb0c40d0470 2024-09-17T03:00:56.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.693+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c40cc120 con 0x7fb0c40d0470 2024-09-17T03:00:56.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.694+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c40d24c0 con 0x7fb0c40d0470 2024-09-17T03:00:56.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.695+0000 7fb0baffd640 1 -- 172.21.15.104:0/3978569655 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb0bc004280 con 0x7fb0c40d0470 2024-09-17T03:00:56.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.695+0000 7fb0baffd640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0a8078bc0 0x7fb0a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:56.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.695+0000 7fb0baffd640 1 -- 172.21.15.104:0/3978569655 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7fb0bc0bbb30 con 0x7fb0c40d0470 2024-09-17T03:00:56.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.696+0000 7fb0ca137640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0a8078bc0 0x7fb0a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:56.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.696+0000 7fb0ca137640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0a8078bc0 0x7fb0a807b0d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0001660 tx=0x7fb0c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:56.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.700+0000 7fb0baffd640 1 -- 172.21.15.104:0/3978569655 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0c40d24c0 con 0x7fb0c40d0470 2024-09-17T03:00:56.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.870+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0c4167e20 con 0x7fb0a8078bc0 2024-09-17T03:00:56.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.874+0000 7fb0baffd640 1 -- 172.21.15.104:0/3978569655 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236374 (secure 0 0 0) 0x7fb0c4167e20 con 0x7fb0a8078bc0 2024-09-17T03:00:56.875 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:56.876 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:56.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0a8078bc0 msgr2=0x7fb0a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0a8078bc0 0x7fb0a807b0d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0001660 tx=0x7fb0c0009040 comp rx=0 tx=0).stop 2024-09-17T03:00:56.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40d0470 msgr2=0x7fb0c40cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:56.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40d0470 0x7fb0c40cb4a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc035040 tx=0x7fb0bc032d10 comp rx=0 tx=0).stop 2024-09-17T03:00:56.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 shutdown_connections 2024-09-17T03:00:56.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0a8078bc0 0x7fb0a807b0d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0c40d0470 0x7fb0c40cb4a0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0c40cefb0 0x7fb0c40caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 --2- 172.21.15.104:0/3978569655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0c40b7bb0 0x7fb0c415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:56.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 >> 172.21.15.104:0/3978569655 conn(0x7fb0c40d28a0 msgr2=0x7fb0c40d0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:56.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 shutdown_connections 2024-09-17T03:00:56.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:56.877+0000 7fb0cc39b640 1 -- 172.21.15.104:0/3978569655 wait complete. 2024-09-17T03:00:56.887 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-17T03:00:55.714179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555655,"statfs":{"total":1600000000,"available":1592991507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000940"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":333,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T03:00:50.999889+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:50.999889+0000","last_peered":"2024-09-17T03:00:50.999889+0000","last_clean":"2024-09-17T03:00:50.999889+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:50.999889+0000","last_undegraded":"2024-09-17T03:00:50.999889+0000","last_fullsized":"2024-09-17T03:00:50.999889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194022,"statfs":{"total":200000000,"available":198679266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194609,"statfs":{"total":200000000,"available":199279748,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1284,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194027,"statfs":{"total":200000000,"available":198684323,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:00:56.891 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:57.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.041+0000 7f3af7069640 1 -- 172.21.15.104:0/3398124343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ad8003a00 msgr2=0x7f3ad8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.041+0000 7f3af7069640 1 --2- 172.21.15.104:0/3398124343 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ad8003a00 0x7f3ad8003e70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009b50 tx=0x7f3ad8005830 comp rx=0 tx=0).stop 2024-09-17T03:00:57.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.041+0000 7f3af5606640 1 -- 172.21.15.104:0/3398124343 reap_dead start 2024-09-17T03:00:57.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.041+0000 7f3af7069640 1 -- 172.21.15.104:0/3398124343 shutdown_connections 2024-09-17T03:00:57.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.041+0000 7f3af7069640 1 -- 172.21.15.104:0/3398124343 >> 172.21.15.104:0/3398124343 conn(0x7f3af00b2450 msgr2=0x7f3af00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:57.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.041+0000 7f3af7069640 1 -- 172.21.15.104:0/3398124343 shutdown_connections 2024-09-17T03:00:57.040 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.041+0000 7f3af7069640 1 -- 172.21.15.104:0/3398124343 wait complete. 2024-09-17T03:00:57.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.043+0000 7f3af7069640 1 Processor -- start 2024-09-17T03:00:57.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.043+0000 7f3af7069640 1 -- start start 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3af7069640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ad8003a00 0x7f3af01451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3af7069640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3af0150d90 0x7f3af01f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3af7069640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3af01f7550 0x7f3af014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3af7069640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3af015bfc0 con 0x7f3af0150d90 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3af7069640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3af015be40 con 0x7f3ad8003a00 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3af7069640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3af00ce7c0 con 0x7f3af01f7550 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3af0150d90 0x7f3af01f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3af0150d90 0x7f3af01f7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35454/0 (socket says 172.21.15.104:35454) 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3aeffff640 1 -- 172.21.15.104:0/3162869955 learned_addr learned my addr 172.21.15.104:0/3162869955 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:57.044 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3af5606640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3af01f7550 0x7f3af014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3af4e05640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ad8003a00 0x7f3af01451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3aeffff640 1 -- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3af01f7550 msgr2=0x7f3af014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3aeffff640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3af01f7550 0x7f3af014e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3aeffff640 1 -- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ad8003a00 msgr2=0x7f3af01451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3aeffff640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ad8003a00 0x7f3af01451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.044+0000 7f3aeffff640 1 -- 172.21.15.104:0/3162869955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af014d030 con 0x7f3af0150d90 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.045+0000 7f3aeffff640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3af0150d90 0x7f3af01f7010 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400e890 tx=0x7f3ae400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.045+0000 7f3aed7fa640 1 -- 172.21.15.104:0/3162869955 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4015070 con 0x7f3af0150d90 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.045+0000 7f3aed7fa640 1 -- 172.21.15.104:0/3162869955 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ae400cd40 con 0x7f3af0150d90 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.045+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af01529e0 con 0x7f3af0150d90 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.045+0000 7f3aed7fa640 1 -- 172.21.15.104:0/3162869955 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40116c0 con 0x7f3af0150d90 2024-09-17T03:00:57.045 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.045+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af014f640 con 0x7f3af0150d90 2024-09-17T03:00:57.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.046+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af014d200 con 0x7f3af0150d90 2024-09-17T03:00:57.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.047+0000 7f3aed7fa640 1 -- 172.21.15.104:0/3162869955 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ae4018070 con 0x7f3af0150d90 2024-09-17T03:00:57.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.047+0000 7f3aed7fa640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3adc078b90 0x7f3adc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.047+0000 7f3aed7fa640 1 -- 172.21.15.104:0/3162869955 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f3ae409b340 con 0x7f3af0150d90 2024-09-17T03:00:57.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.048+0000 7f3af4e05640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3adc078b90 0x7f3adc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.048+0000 7f3af4e05640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3adc078b90 0x7f3adc07b0a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0035000 tx=0x7f3ae002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:57.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.052+0000 7f3aed7fa640 1 -- 172.21.15.104:0/3162869955 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3af014d200 con 0x7f3af0150d90 2024-09-17T03:00:57.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.222+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3af00ce280 con 0x7f3adc078b90 2024-09-17T03:00:57.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.227+0000 7f3aed7fa640 1 -- 172.21.15.104:0/3162869955 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236374 (secure 0 0 0) 0x7f3af00ce280 con 0x7f3adc078b90 2024-09-17T03:00:57.227 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:57.228 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.229+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3adc078b90 msgr2=0x7f3adc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.229+0000 7f3af7069640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3adc078b90 0x7f3adc07b0a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0035000 tx=0x7f3ae002d040 comp rx=0 tx=0).stop 2024-09-17T03:00:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.229+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3af0150d90 msgr2=0x7f3af01f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.229+0000 7f3af7069640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3af0150d90 0x7f3af01f7010 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400e890 tx=0x7f3ae400ec90 comp rx=0 tx=0).stop 2024-09-17T03:00:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.230+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 shutdown_connections 2024-09-17T03:00:57.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.230+0000 7f3af7069640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3adc078b90 0x7f3adc07b0a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.230+0000 7f3af7069640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3af01f7550 0x7f3af014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.230+0000 7f3af7069640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3af0150d90 0x7f3af01f7010 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.230+0000 7f3af7069640 1 --2- 172.21.15.104:0/3162869955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ad8003a00 0x7f3af01451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.230+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 >> 172.21.15.104:0/3162869955 conn(0x7f3af00b2450 msgr2=0x7f3af0073480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.230+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 shutdown_connections 2024-09-17T03:00:57.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.230+0000 7f3af7069640 1 -- 172.21.15.104:0/3162869955 wait complete. 2024-09-17T03:00:57.240 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-17T03:00:55.714179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555655,"statfs":{"total":1600000000,"available":1592991507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000940"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":333,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T03:00:50.999889+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:50.999889+0000","last_peered":"2024-09-17T03:00:50.999889+0000","last_clean":"2024-09-17T03:00:50.999889+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:50.999889+0000","last_undegraded":"2024-09-17T03:00:50.999889+0000","last_fullsized":"2024-09-17T03:00:50.999889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194022,"statfs":{"total":200000000,"available":198679266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194609,"statfs":{"total":200000000,"available":199279748,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1284,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194027,"statfs":{"total":200000000,"available":198684323,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:00:57.243 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:57.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.394+0000 7f3827a27640 1 -- 172.21.15.104:0/759508434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38200d2180 msgr2=0x7f382006f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.394+0000 7f3827a27640 1 --2- 172.21.15.104:0/759508434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38200d2180 0x7f382006f550 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f3820072420 tx=0x7f381002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.394+0000 7f3827a27640 1 -- 172.21.15.104:0/759508434 shutdown_connections 2024-09-17T03:00:57.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.394+0000 7f3827a27640 1 --2- 172.21.15.104:0/759508434 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f38200d2180 0x7f382006f550 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.394+0000 7f3827a27640 1 --2- 172.21.15.104:0/759508434 >> v2:172.21.15.192:3300/0 conn(0x7f38201610a0 0x7f38200d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.394+0000 7f3827a27640 1 -- 172.21.15.104:0/759508434 >> 172.21.15.104:0/759508434 conn(0x7f382006d200 msgr2=0x7f382006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:57.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.394+0000 7f3827a27640 1 -- 172.21.15.104:0/759508434 shutdown_connections 2024-09-17T03:00:57.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.394+0000 7f3827a27640 1 -- 172.21.15.104:0/759508434 wait complete. 2024-09-17T03:00:57.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.396+0000 7f3827a27640 1 Processor -- start 2024-09-17T03:00:57.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.396+0000 7f3827a27640 1 -- start start 2024-09-17T03:00:57.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f3827a27640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382006fa90 0x7f3820141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f3827a27640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38200d2180 0x7f38201444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f3827a27640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38201610a0 0x7f38201449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f3827a27640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f38200746e0 con 0x7f382006fa90 2024-09-17T03:00:57.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f3827a27640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3820074560 con 0x7f38200d2180 2024-09-17T03:00:57.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f3827a27640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f382015d4a0 con 0x7f38201610a0 2024-09-17T03:00:57.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f38257c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382006fa90 0x7f3820141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f38257c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382006fa90 0x7f3820141b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35466/0 (socket says 172.21.15.104:35466) 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f38257c3640 1 -- 172.21.15.104:0/867455882 learned_addr learned my addr 172.21.15.104:0/867455882 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f3824fc2640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38200d2180 0x7f38201444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f3825fc4640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38201610a0 0x7f38201449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.397+0000 7f38257c3640 1 -- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38201610a0 msgr2=0x7f38201449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f38257c3640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38201610a0 0x7f38201449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f38257c3640 1 -- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38200d2180 msgr2=0x7f38201444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f38257c3640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38200d2180 0x7f38201444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f38257c3640 1 -- 172.21.15.104:0/867455882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38201e67a0 con 0x7f382006fa90 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f3825fc4640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38201610a0 0x7f38201449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f38257c3640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382006fa90 0x7f3820141b90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f381c00ba50 tx=0x7f381c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f3815ffb640 1 -- 172.21.15.104:0/867455882 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c019070 con 0x7f382006fa90 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f3815ffb640 1 -- 172.21.15.104:0/867455882 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f381c00ccf0 con 0x7f382006fa90 2024-09-17T03:00:57.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3820142550 con 0x7f382006fa90 2024-09-17T03:00:57.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f3815ffb640 1 -- 172.21.15.104:0/867455882 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c0146a0 con 0x7f382006fa90 2024-09-17T03:00:57.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.398+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3820142b10 con 0x7f382006fa90 2024-09-17T03:00:57.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.399+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38201e6970 con 0x7f382006fa90 2024-09-17T03:00:57.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.400+0000 7f3815ffb640 1 -- 172.21.15.104:0/867455882 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f381c01c070 con 0x7f382006fa90 2024-09-17T03:00:57.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.400+0000 7f3815ffb640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3804078bc0 0x7f380407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.400+0000 7f3815ffb640 1 -- 172.21.15.104:0/867455882 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f381c09aa00 con 0x7f382006fa90 2024-09-17T03:00:57.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.401+0000 7f3824fc2640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3804078bc0 0x7f380407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.401+0000 7f3824fc2640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3804078bc0 0x7f380407b0d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3810033000 tx=0x7f3810004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:57.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.405+0000 7f3815ffb640 1 -- 172.21.15.104:0/867455882 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f381c062880 con 0x7f382006fa90 2024-09-17T03:00:57.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.574+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3820158a60 con 0x7f3804078bc0 2024-09-17T03:00:57.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.578+0000 7f3815ffb640 1 -- 172.21.15.104:0/867455882 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236374 (secure 0 0 0) 0x7f3820158a60 con 0x7f3804078bc0 2024-09-17T03:00:57.579 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:57.581 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:57.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3804078bc0 msgr2=0x7f380407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3804078bc0 0x7f380407b0d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3810033000 tx=0x7f3810004730 comp rx=0 tx=0).stop 2024-09-17T03:00:57.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382006fa90 msgr2=0x7f3820141b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382006fa90 0x7f3820141b90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f381c00ba50 tx=0x7f381c00bf10 comp rx=0 tx=0).stop 2024-09-17T03:00:57.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 shutdown_connections 2024-09-17T03:00:57.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3804078bc0 0x7f380407b0d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38200d2180 0x7f38201444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38201610a0 0x7f38201449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 --2- 172.21.15.104:0/867455882 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f382006fa90 0x7f3820141b90 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 >> 172.21.15.104:0/867455882 conn(0x7f382006d200 msgr2=0x7f382015f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:57.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 shutdown_connections 2024-09-17T03:00:57.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.581+0000 7f3827a27640 1 -- 172.21.15.104:0/867455882 wait complete. 2024-09-17T03:00:57.591 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-17T03:00:55.714179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6844,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555655,"statfs":{"total":1600000000,"available":1592991507,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000940"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:52.857599+0000","last_change":"2024-09-17T03:00:52.857599+0000","last_active":"2024-09-17T03:00:52.857599+0000","last_peered":"2024-09-17T03:00:52.857599+0000","last_clean":"2024-09-17T03:00:52.857599+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:52.857599+0000","last_undegraded":"2024-09-17T03:00:52.857599+0000","last_fullsized":"2024-09-17T03:00:52.857599+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:00:51.851456+0000","last_change":"2024-09-17T03:00:51.851456+0000","last_active":"2024-09-17T03:00:51.851456+0000","last_peered":"2024-09-17T03:00:51.851456+0000","last_clean":"2024-09-17T03:00:51.851456+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:00:51.851456+0000","last_undegraded":"2024-09-17T03:00:51.851456+0000","last_fullsized":"2024-09-17T03:00:51.851456+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":333,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-17T03:00:50.999889+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:50.999889+0000","last_peered":"2024-09-17T03:00:50.999889+0000","last_clean":"2024-09-17T03:00:50.999889+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:50.999889+0000","last_undegraded":"2024-09-17T03:00:50.999889+0000","last_fullsized":"2024-09-17T03:00:50.999889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1289,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194022,"statfs":{"total":200000000,"available":198679266,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194609,"statfs":{"total":200000000,"available":199279748,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":713,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199269634,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1284,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194027,"statfs":{"total":200000000,"available":198684323,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3f is not active+clean 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3e is not active+clean 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3d is not active+clean 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3c is not active+clean 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.595 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3b is not active+clean 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3a is not active+clean 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:PG 17.39 is not active+clean 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:PG 17.38 is not active+clean 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:PG 17.37 is not active+clean 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:PG 17.36 is not active+clean 2024-09-17T03:00:57.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:PG 17.35 is not active+clean 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:PG 17.34 is not active+clean 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:PG 17.33 is not active+clean 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:PG 17.32 is not active+clean 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:PG 17.31 is not active+clean 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.597 INFO:tasks.ceph.ceph_manager.ceph:PG 17.30 is not active+clean 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2f is not active+clean 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2e is not active+clean 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2d is not active+clean 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2c is not active+clean 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2b is not active+clean 2024-09-17T03:00:57.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2a is not active+clean 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:PG 17.29 is not active+clean 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:PG 17.28 is not active+clean 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:PG 17.27 is not active+clean 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:PG 17.26 is not active+clean 2024-09-17T03:00:57.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:PG 17.25 is not active+clean 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:PG 17.24 is not active+clean 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:PG 17.23 is not active+clean 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:PG 17.22 is not active+clean 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:PG 17.21 is not active+clean 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:PG 17.20 is not active+clean 2024-09-17T03:00:57.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1e is not active+clean 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1f is not active+clean 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1f is not active+clean 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1e is not active+clean 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1c is not active+clean 2024-09-17T03:00:57.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.602 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1d is not active+clean 2024-09-17T03:00:57.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.602 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1d is not active+clean 2024-09-17T03:00:57.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.602 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1c is not active+clean 2024-09-17T03:00:57.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.602 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1a is not active+clean 2024-09-17T03:00:57.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1b is not active+clean 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1b is not active+clean 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1a is not active+clean 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:PG 17.18 is not active+clean 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:PG 16.19 is not active+clean 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.603 INFO:tasks.ceph.ceph_manager.ceph:PG 17.19 is not active+clean 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:PG 16.18 is not active+clean 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:PG 17.16 is not active+clean 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:PG 16.17 is not active+clean 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:PG 17.17 is not active+clean 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:PG 16.16 is not active+clean 2024-09-17T03:00:57.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:PG 17.14 is not active+clean 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:PG 16.15 is not active+clean 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:PG 17.15 is not active+clean 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:PG 16.14 is not active+clean 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:PG 17.12 is not active+clean 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.605 INFO:tasks.ceph.ceph_manager.ceph:PG 16.13 is not active+clean 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:PG 17.13 is not active+clean 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:PG 16.12 is not active+clean 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:PG 17.11 is not active+clean 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:PG 16.10 is not active+clean 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:PG 17.e is not active+clean 2024-09-17T03:00:57.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:PG 16.f is not active+clean 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:PG 17.f is not active+clean 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:PG 16.e is not active+clean 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:PG 17.c is not active+clean 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:PG 16.d is not active+clean 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.607 INFO:tasks.ceph.ceph_manager.ceph:PG 17.d is not active+clean 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:PG 16.c is not active+clean 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:PG 17.a is not active+clean 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:PG 16.b is not active+clean 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:PG 17.b is not active+clean 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:PG 16.a is not active+clean 2024-09-17T03:00:57.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:PG 17.8 is not active+clean 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:PG 16.9 is not active+clean 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:PG 17.9 is not active+clean 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:PG 16.8 is not active+clean 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:PG 17.6 is not active+clean 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.609 INFO:tasks.ceph.ceph_manager.ceph:PG 16.7 is not active+clean 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:PG 17.7 is not active+clean 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:PG 16.6 is not active+clean 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:PG 17.4 is not active+clean 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:PG 16.5 is not active+clean 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:PG 17.5 is not active+clean 2024-09-17T03:00:57.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:PG 16.4 is not active+clean 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2 is not active+clean 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3 is not active+clean 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3 is not active+clean 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2 is not active+clean 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:PG 17.0 is not active+clean 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.611 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1 is not active+clean 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1 is not active+clean 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:PG 16.0 is not active+clean 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:PG 17.10 is not active+clean 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:52.857599+0000', 'last_change': '2024-09-17T03:00:52.857599+0000', 'last_active': '2024-09-17T03:00:52.857599+0000', 'last_peered': '2024-09-17T03:00:52.857599+0000', 'last_clean': '2024-09-17T03:00:52.857599+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:52.857599+0000', 'last_undegraded': '2024-09-17T03:00:52.857599+0000', 'last_fullsized': '2024-09-17T03:00:52.857599+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:52.857599+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:PG 16.11 is not active+clean 2024-09-17T03:00:57.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:00:51.851456+0000', 'last_change': '2024-09-17T03:00:51.851456+0000', 'last_active': '2024-09-17T03:00:51.851456+0000', 'last_peered': '2024-09-17T03:00:51.851456+0000', 'last_clean': '2024-09-17T03:00:51.851456+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:00:51.851456+0000', 'last_undegraded': '2024-09-17T03:00:51.851456+0000', 'last_fullsized': '2024-09-17T03:00:51.851456+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'last_clean_scrub_stamp': '2024-09-17T03:00:51.851456+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:00:57.613 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:00:57.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.745+0000 7eff0d19d640 1 -- 172.21.15.104:0/806293532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efef4003a50 msgr2=0x7efef4003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.745+0000 7eff0d19d640 1 --2- 172.21.15.104:0/806293532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efef4003a50 0x7efef4003ee0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7efef800c420 tx=0x7efef4005830 comp rx=0 tx=0).stop 2024-09-17T03:00:57.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.745+0000 7eff0d19d640 1 -- 172.21.15.104:0/806293532 shutdown_connections 2024-09-17T03:00:57.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.745+0000 7eff0d19d640 1 --2- 172.21.15.104:0/806293532 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efef4003a50 0x7efef4003ee0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.745+0000 7eff0d19d640 1 -- 172.21.15.104:0/806293532 >> 172.21.15.104:0/806293532 conn(0x7eff08074520 msgr2=0x7eff08074930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:57.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.745+0000 7eff0d19d640 1 -- 172.21.15.104:0/806293532 shutdown_connections 2024-09-17T03:00:57.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.745+0000 7eff0d19d640 1 -- 172.21.15.104:0/806293532 wait complete. 2024-09-17T03:00:57.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.747+0000 7eff0d19d640 1 Processor -- start 2024-09-17T03:00:57.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.747+0000 7eff0d19d640 1 -- start start 2024-09-17T03:00:57.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0d19d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efef4003a50 0x7eff081401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0d19d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff08154120 0x7eff08154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0d19d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff08151410 0x7eff08151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0d19d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7eff08069a50 con 0x7eff08151410 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0d19d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7eff080698d0 con 0x7efef4003a50 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0d19d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7eff08069bd0 con 0x7eff08154120 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0c99c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff08151410 0x7eff08151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0c99c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff08151410 0x7eff08151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35492/0 (socket says 172.21.15.104:35492) 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff0c99c640 1 -- 172.21.15.104:0/542464520 learned_addr learned my addr 172.21.15.104:0/542464520 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff077fe640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff08154120 0x7eff08154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.748+0000 7eff07fff640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efef4003a50 0x7eff081401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff0c99c640 1 -- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff08154120 msgr2=0x7eff08154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff0c99c640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff08154120 0x7eff08154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff0c99c640 1 -- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efef4003a50 msgr2=0x7eff081401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:57.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff0c99c640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efef4003a50 0x7eff081401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:57.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff0c99c640 1 -- 172.21.15.104:0/542464520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff08151d60 con 0x7eff08151410 2024-09-17T03:00:57.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff0c99c640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff08151410 0x7eff08151820 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7eff0806fee0 tx=0x7eff000019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:57.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff04ff9640 1 -- 172.21.15.104:0/542464520 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00017070 con 0x7eff08151410 2024-09-17T03:00:57.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff04ff9640 1 -- 172.21.15.104:0/542464520 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff000108c0 con 0x7eff08151410 2024-09-17T03:00:57.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff08154ce0 con 0x7eff08151410 2024-09-17T03:00:57.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff04ff9640 1 -- 172.21.15.104:0/542464520 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00010d10 con 0x7eff08151410 2024-09-17T03:00:57.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.749+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff080d1190 con 0x7eff08151410 2024-09-17T03:00:57.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.750+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff08160970 con 0x7eff08151410 2024-09-17T03:00:57.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.751+0000 7eff04ff9640 1 -- 172.21.15.104:0/542464520 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff0001a070 con 0x7eff08151410 2024-09-17T03:00:57.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.751+0000 7eff04ff9640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efee8078b90 0x7efee807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:57.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.751+0000 7eff04ff9640 1 -- 172.21.15.104:0/542464520 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7eff0009aa50 con 0x7eff08151410 2024-09-17T03:00:57.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.752+0000 7eff07fff640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efee8078b90 0x7efee807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:57.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.752+0000 7eff07fff640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efee8078b90 0x7efee807b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efef8033000 tx=0x7efef802d070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:57.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.756+0000 7eff04ff9640 1 -- 172.21.15.104:0/542464520 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff08151d60 con 0x7eff08151410 2024-09-17T03:00:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.998+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7eff08154a70 con 0x7eff08151410 2024-09-17T03:00:57.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:57.999+0000 7eff04ff9640 1 -- 172.21.15.104:0/542464520 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1469 (secure 0 0 0) 0x7eff00062840 con 0x7eff08151410 2024-09-17T03:00:57.998 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:57.998 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":394,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":137,"num_osds":8,"num_up_osds":8,"osd_up_since":1726541670,"num_in_osds":8,"osd_in_since":1726541667,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":7229820,"bytes_avail":1592770180,"bytes_total":1600000000,"write_bytes_sec":2448,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":7044}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-17T03:00:09.702590+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efee8078b90 msgr2=0x7efee807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efee8078b90 0x7efee807b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efef8033000 tx=0x7efef802d070 comp rx=0 tx=0).stop 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff08151410 msgr2=0x7eff08151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff08151410 0x7eff08151820 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7eff0806fee0 tx=0x7eff000019b0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 shutdown_connections 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efee8078b90 0x7efee807b0a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7eff08151410 0x7eff08151820 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff08154120 0x7eff08154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 --2- 172.21.15.104:0/542464520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efef4003a50 0x7eff081401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 >> 172.21.15.104:0/542464520 conn(0x7eff08074520 msgr2=0x7eff080d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:58.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 shutdown_connections 2024-09-17T03:00:58.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.001+0000 7eff0d19d640 1 -- 172.21.15.104:0/542464520 wait complete. 2024-09-17T03:00:58.011 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:00:58.011 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:00:58.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 -- 172.21.15.104:0/725078923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d3490 msgr2=0x7fec200b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:58.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 --2- 172.21.15.104:0/725078923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d3490 0x7fec200b7c80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fec200d2500 tx=0x7fec1002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 -- 172.21.15.104:0/725078923 shutdown_connections 2024-09-17T03:00:58.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 --2- 172.21.15.104:0/725078923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec200d13e0 0x7fec20161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 --2- 172.21.15.104:0/725078923 >> v2:172.21.15.192:3300/0 conn(0x7fec200d0fd0 0x7fec20160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 --2- 172.21.15.104:0/725078923 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d3490 0x7fec200b7c80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 -- 172.21.15.104:0/725078923 >> 172.21.15.104:0/725078923 conn(0x7fec200d2970 msgr2=0x7fec200d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:58.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 -- 172.21.15.104:0/725078923 shutdown_connections 2024-09-17T03:00:58.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.124+0000 7fec25ede640 1 -- 172.21.15.104:0/725078923 wait complete. 2024-09-17T03:00:58.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.126+0000 7fec25ede640 1 Processor -- start 2024-09-17T03:00:58.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.126+0000 7fec25ede640 1 -- start start 2024-09-17T03:00:58.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.127+0000 7fec25ede640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d0fd0 0x7fec20071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:58.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec25ede640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec200d13e0 0x7fec20071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:58.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec25ede640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec200d3490 0x7fec201f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec25ede640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fec200b2270 con 0x7fec200d0fd0 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec25ede640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec200b20f0 con 0x7fec200d13e0 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec25ede640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fec200b23f0 con 0x7fec200d3490 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d0fd0 0x7fec20071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d0fd0 0x7fec20071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35514/0 (socket says 172.21.15.104:35514) 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 -- 172.21.15.104:0/1447810860 learned_addr learned my addr 172.21.15.104:0/1447810860 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1ffff640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec200d3490 0x7fec201f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1effd640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec200d13e0 0x7fec20071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 -- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec200d3490 msgr2=0x7fec201f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec200d3490 0x7fec201f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 -- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec200d13e0 msgr2=0x7fec20071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:58.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec200d13e0 0x7fec20071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 -- 172.21.15.104:0/1447810860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2014ee90 con 0x7fec200d0fd0 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1ffff640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec200d3490 0x7fec201f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1effd640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec200d13e0 0x7fec20071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec1f7fe640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d0fd0 0x7fec20071750 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fec10034040 tx=0x7fec10003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec07fff640 1 -- 172.21.15.104:0/1447810860 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1003e030 con 0x7fec200d0fd0 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec07fff640 1 -- 172.21.15.104:0/1447810860 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec10003e00 con 0x7fec200d0fd0 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2014f170 con 0x7fec200d0fd0 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec07fff640 1 -- 172.21.15.104:0/1447810860 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10035040 con 0x7fec200d0fd0 2024-09-17T03:00:58.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.128+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2014f730 con 0x7fec200d0fd0 2024-09-17T03:00:58.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.129+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec200b7c80 con 0x7fec200d0fd0 2024-09-17T03:00:58.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.130+0000 7fec07fff640 1 -- 172.21.15.104:0/1447810860 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec10041030 con 0x7fec200d0fd0 2024-09-17T03:00:58.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.130+0000 7fec07fff640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec0c078b90 0x7fec0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:00:58.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.131+0000 7fec07fff640 1 -- 172.21.15.104:0/1447810860 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7fec100bb560 con 0x7fec200d0fd0 2024-09-17T03:00:58.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.131+0000 7fec1effd640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec0c078b90 0x7fec0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:00:58.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.131+0000 7fec1effd640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec0c078b90 0x7fec0c07b0a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fec14009a20 tx=0x7fec14005d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:00:58.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.135+0000 7fec07fff640 1 -- 172.21.15.104:0/1447810860 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec10083a30 con 0x7fec200d0fd0 2024-09-17T03:00:58.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.303+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec200d0900 con 0x7fec0c078b90 2024-09-17T03:00:58.306 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.308+0000 7fec07fff640 1 -- 172.21.15.104:0/1447810860 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247980 (secure 0 0 0) 0x7fec200d0900 con 0x7fec0c078b90 2024-09-17T03:00:58.309 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:00:58.310 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec0c078b90 msgr2=0x7fec0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec0c078b90 0x7fec0c07b0a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fec14009a20 tx=0x7fec14005d30 comp rx=0 tx=0).stop 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d0fd0 msgr2=0x7fec20071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d0fd0 0x7fec20071750 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fec10034040 tx=0x7fec10003910 comp rx=0 tx=0).stop 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 shutdown_connections 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fec0c078b90 0x7fec0c07b0a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec200d13e0 0x7fec20071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec200d3490 0x7fec201f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 --2- 172.21.15.104:0/1447810860 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fec200d0fd0 0x7fec20071750 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:00:58.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 >> 172.21.15.104:0/1447810860 conn(0x7fec200d2970 msgr2=0x7fec200cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:00:58.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 shutdown_connections 2024-09-17T03:00:58.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:00:58.311+0000 7fec25ede640 1 -- 172.21.15.104:0/1447810860 wait complete. 2024-09-17T03:00:58.321 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-17T03:00:57.714610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555439,"statfs":{"total":1600000000,"available":1592770180,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.855937"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902067+0000","last_change":"2024-09-17T03:00:53.888863+0000","last_active":"2024-09-17T03:00:54.902067+0000","last_peered":"2024-09-17T03:00:54.902067+0000","last_clean":"2024-09-17T03:00:54.902067+0000","last_became_active":"2024-09-17T03:00:53.888491+0000","last_became_peered":"2024-09-17T03:00:53.888491+0000","last_unstale":"2024-09-17T03:00:54.902067+0000","last_undegraded":"2024-09-17T03:00:54.902067+0000","last_fullsized":"2024-09-17T03:00:54.902067+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:11.017578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872009+0000","last_change":"2024-09-17T03:00:53.884012+0000","last_active":"2024-09-17T03:00:54.872009+0000","last_peered":"2024-09-17T03:00:54.872009+0000","last_clean":"2024-09-17T03:00:54.872009+0000","last_became_active":"2024-09-17T03:00:53.883647+0000","last_became_peered":"2024-09-17T03:00:53.883647+0000","last_unstale":"2024-09-17T03:00:54.872009+0000","last_undegraded":"2024-09-17T03:00:54.872009+0000","last_fullsized":"2024-09-17T03:00:54.872009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:01.358039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901553+0000","last_change":"2024-09-17T03:00:53.887551+0000","last_active":"2024-09-17T03:00:54.901553+0000","last_peered":"2024-09-17T03:00:54.901553+0000","last_clean":"2024-09-17T03:00:54.901553+0000","last_became_active":"2024-09-17T03:00:53.887200+0000","last_became_peered":"2024-09-17T03:00:53.887200+0000","last_unstale":"2024-09-17T03:00:54.901553+0000","last_undegraded":"2024-09-17T03:00:54.901553+0000","last_fullsized":"2024-09-17T03:00:54.901553+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:22.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901617+0000","last_change":"2024-09-17T03:00:53.879671+0000","last_active":"2024-09-17T03:00:54.901617+0000","last_peered":"2024-09-17T03:00:54.901617+0000","last_clean":"2024-09-17T03:00:54.901617+0000","last_became_active":"2024-09-17T03:00:53.879402+0000","last_became_peered":"2024-09-17T03:00:53.879402+0000","last_unstale":"2024-09-17T03:00:54.901617+0000","last_undegraded":"2024-09-17T03:00:54.901617+0000","last_fullsized":"2024-09-17T03:00:54.901617+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:05.353656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902034+0000","last_change":"2024-09-17T03:00:53.879822+0000","last_active":"2024-09-17T03:00:54.902034+0000","last_peered":"2024-09-17T03:00:54.902034+0000","last_clean":"2024-09-17T03:00:54.902034+0000","last_became_active":"2024-09-17T03:00:53.879502+0000","last_became_peered":"2024-09-17T03:00:53.879502+0000","last_unstale":"2024-09-17T03:00:54.902034+0000","last_undegraded":"2024-09-17T03:00:54.902034+0000","last_fullsized":"2024-09-17T03:00:54.902034+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:19.943127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902096+0000","last_change":"2024-09-17T03:00:53.885297+0000","last_active":"2024-09-17T03:00:54.902096+0000","last_peered":"2024-09-17T03:00:54.902096+0000","last_clean":"2024-09-17T03:00:54.902096+0000","last_became_active":"2024-09-17T03:00:53.884139+0000","last_became_peered":"2024-09-17T03:00:53.884139+0000","last_unstale":"2024-09-17T03:00:54.902096+0000","last_undegraded":"2024-09-17T03:00:54.902096+0000","last_fullsized":"2024-09-17T03:00:54.902096+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:27.771567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891933+0000","last_change":"2024-09-17T03:00:53.874350+0000","last_active":"2024-09-17T03:00:54.891933+0000","last_peered":"2024-09-17T03:00:54.891933+0000","last_clean":"2024-09-17T03:00:54.891933+0000","last_became_active":"2024-09-17T03:00:53.873831+0000","last_became_peered":"2024-09-17T03:00:53.873831+0000","last_unstale":"2024-09-17T03:00:54.891933+0000","last_undegraded":"2024-09-17T03:00:54.891933+0000","last_fullsized":"2024-09-17T03:00:54.891933+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:47.988165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901782+0000","last_change":"2024-09-17T03:00:53.885255+0000","last_active":"2024-09-17T03:00:54.901782+0000","last_peered":"2024-09-17T03:00:54.901782+0000","last_clean":"2024-09-17T03:00:54.901782+0000","last_became_active":"2024-09-17T03:00:53.884009+0000","last_became_peered":"2024-09-17T03:00:53.884009+0000","last_unstale":"2024-09-17T03:00:54.901782+0000","last_undegraded":"2024-09-17T03:00:54.901782+0000","last_fullsized":"2024-09-17T03:00:54.901782+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:19.012424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902789+0000","last_change":"2024-09-17T03:00:53.880249+0000","last_active":"2024-09-17T03:00:54.902789+0000","last_peered":"2024-09-17T03:00:54.902789+0000","last_clean":"2024-09-17T03:00:54.902789+0000","last_became_active":"2024-09-17T03:00:53.879996+0000","last_became_peered":"2024-09-17T03:00:53.879996+0000","last_unstale":"2024-09-17T03:00:54.902789+0000","last_undegraded":"2024-09-17T03:00:54.902789+0000","last_fullsized":"2024-09-17T03:00:54.902789+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:31.776461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901684+0000","last_change":"2024-09-17T03:00:53.886351+0000","last_active":"2024-09-17T03:00:54.901684+0000","last_peered":"2024-09-17T03:00:54.901684+0000","last_clean":"2024-09-17T03:00:54.901684+0000","last_became_active":"2024-09-17T03:00:53.885986+0000","last_became_peered":"2024-09-17T03:00:53.885986+0000","last_unstale":"2024-09-17T03:00:54.901684+0000","last_undegraded":"2024-09-17T03:00:54.901684+0000","last_fullsized":"2024-09-17T03:00:54.901684+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:55.149194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872965+0000","last_change":"2024-09-17T03:00:53.890035+0000","last_active":"2024-09-17T03:00:54.872965+0000","last_peered":"2024-09-17T03:00:54.872965+0000","last_clean":"2024-09-17T03:00:54.872965+0000","last_became_active":"2024-09-17T03:00:53.889750+0000","last_became_peered":"2024-09-17T03:00:53.889750+0000","last_unstale":"2024-09-17T03:00:54.872965+0000","last_undegraded":"2024-09-17T03:00:54.872965+0000","last_fullsized":"2024-09-17T03:00:54.872965+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:53.386287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902722+0000","last_change":"2024-09-17T03:00:53.886840+0000","last_active":"2024-09-17T03:00:54.902722+0000","last_peered":"2024-09-17T03:00:54.902722+0000","last_clean":"2024-09-17T03:00:54.902722+0000","last_became_active":"2024-09-17T03:00:53.884247+0000","last_became_peered":"2024-09-17T03:00:53.884247+0000","last_unstale":"2024-09-17T03:00:54.902722+0000","last_undegraded":"2024-09-17T03:00:54.902722+0000","last_fullsized":"2024-09-17T03:00:54.902722+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:01.976720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901952+0000","last_change":"2024-09-17T03:00:53.885581+0000","last_active":"2024-09-17T03:00:54.901952+0000","last_peered":"2024-09-17T03:00:54.901952+0000","last_clean":"2024-09-17T03:00:54.901952+0000","last_became_active":"2024-09-17T03:00:53.884784+0000","last_became_peered":"2024-09-17T03:00:53.884784+0000","last_unstale":"2024-09-17T03:00:54.901952+0000","last_undegraded":"2024-09-17T03:00:54.901952+0000","last_fullsized":"2024-09-17T03:00:54.901952+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:10.994396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901459+0000","last_change":"2024-09-17T03:00:53.884108+0000","last_active":"2024-09-17T03:00:54.901459+0000","last_peered":"2024-09-17T03:00:54.901459+0000","last_clean":"2024-09-17T03:00:54.901459+0000","last_became_active":"2024-09-17T03:00:53.882917+0000","last_became_peered":"2024-09-17T03:00:53.882917+0000","last_unstale":"2024-09-17T03:00:54.901459+0000","last_undegraded":"2024-09-17T03:00:54.901459+0000","last_fullsized":"2024-09-17T03:00:54.901459+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:25.240996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902233+0000","last_change":"2024-09-17T03:00:53.883334+0000","last_active":"2024-09-17T03:00:54.902233+0000","last_peered":"2024-09-17T03:00:54.902233+0000","last_clean":"2024-09-17T03:00:54.902233+0000","last_became_active":"2024-09-17T03:00:53.883084+0000","last_became_peered":"2024-09-17T03:00:53.883084+0000","last_unstale":"2024-09-17T03:00:54.902233+0000","last_undegraded":"2024-09-17T03:00:54.902233+0000","last_fullsized":"2024-09-17T03:00:54.902233+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:12.042801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902291+0000","last_change":"2024-09-17T03:00:53.886857+0000","last_active":"2024-09-17T03:00:54.902291+0000","last_peered":"2024-09-17T03:00:54.902291+0000","last_clean":"2024-09-17T03:00:54.902291+0000","last_became_active":"2024-09-17T03:00:53.886604+0000","last_became_peered":"2024-09-17T03:00:53.886604+0000","last_unstale":"2024-09-17T03:00:54.902291+0000","last_undegraded":"2024-09-17T03:00:54.902291+0000","last_fullsized":"2024-09-17T03:00:54.902291+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:27.969831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872266+0000","last_change":"2024-09-17T03:00:53.887705+0000","last_active":"2024-09-17T03:00:54.872266+0000","last_peered":"2024-09-17T03:00:54.872266+0000","last_clean":"2024-09-17T03:00:54.872266+0000","last_became_active":"2024-09-17T03:00:53.887427+0000","last_became_peered":"2024-09-17T03:00:53.887427+0000","last_unstale":"2024-09-17T03:00:54.872266+0000","last_undegraded":"2024-09-17T03:00:54.872266+0000","last_fullsized":"2024-09-17T03:00:54.872266+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:25.788837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.871690+0000","last_change":"2024-09-17T03:00:53.881359+0000","last_active":"2024-09-17T03:00:54.871690+0000","last_peered":"2024-09-17T03:00:54.871690+0000","last_clean":"2024-09-17T03:00:54.871690+0000","last_became_active":"2024-09-17T03:00:53.879738+0000","last_became_peered":"2024-09-17T03:00:53.879738+0000","last_unstale":"2024-09-17T03:00:54.871690+0000","last_undegraded":"2024-09-17T03:00:54.871690+0000","last_fullsized":"2024-09-17T03:00:54.871690+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:02.727956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901729+0000","last_change":"2024-09-17T03:00:53.878913+0000","last_active":"2024-09-17T03:00:54.901729+0000","last_peered":"2024-09-17T03:00:54.901729+0000","last_clean":"2024-09-17T03:00:54.901729+0000","last_became_active":"2024-09-17T03:00:53.877926+0000","last_became_peered":"2024-09-17T03:00:53.877926+0000","last_unstale":"2024-09-17T03:00:54.901729+0000","last_undegraded":"2024-09-17T03:00:54.901729+0000","last_fullsized":"2024-09-17T03:00:54.901729+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:11.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873164+0000","last_change":"2024-09-17T03:00:53.881960+0000","last_active":"2024-09-17T03:00:54.873164+0000","last_peered":"2024-09-17T03:00:54.873164+0000","last_clean":"2024-09-17T03:00:54.873164+0000","last_became_active":"2024-09-17T03:00:53.881629+0000","last_became_peered":"2024-09-17T03:00:53.881629+0000","last_unstale":"2024-09-17T03:00:54.873164+0000","last_undegraded":"2024-09-17T03:00:54.873164+0000","last_fullsized":"2024-09-17T03:00:54.873164+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:54.625991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873196+0000","last_change":"2024-09-17T03:00:53.879711+0000","last_active":"2024-09-17T03:00:54.873196+0000","last_peered":"2024-09-17T03:00:54.873196+0000","last_clean":"2024-09-17T03:00:54.873196+0000","last_became_active":"2024-09-17T03:00:53.879272+0000","last_became_peered":"2024-09-17T03:00:53.879272+0000","last_unstale":"2024-09-17T03:00:54.873196+0000","last_undegraded":"2024-09-17T03:00:54.873196+0000","last_fullsized":"2024-09-17T03:00:54.873196+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:39.464424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873229+0000","last_change":"2024-09-17T03:00:53.882035+0000","last_active":"2024-09-17T03:00:54.873229+0000","last_peered":"2024-09-17T03:00:54.873229+0000","last_clean":"2024-09-17T03:00:54.873229+0000","last_became_active":"2024-09-17T03:00:53.881768+0000","last_became_peered":"2024-09-17T03:00:53.881768+0000","last_unstale":"2024-09-17T03:00:54.873229+0000","last_undegraded":"2024-09-17T03:00:54.873229+0000","last_fullsized":"2024-09-17T03:00:54.873229+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:50.049352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872971+0000","last_change":"2024-09-17T03:00:53.891262+0000","last_active":"2024-09-17T03:00:54.872971+0000","last_peered":"2024-09-17T03:00:54.872971+0000","last_clean":"2024-09-17T03:00:54.872971+0000","last_became_active":"2024-09-17T03:00:53.890786+0000","last_became_peered":"2024-09-17T03:00:53.890786+0000","last_unstale":"2024-09-17T03:00:54.872971+0000","last_undegraded":"2024-09-17T03:00:54.872971+0000","last_fullsized":"2024-09-17T03:00:54.872971+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:04.694227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873232+0000","last_change":"2024-09-17T03:00:53.884196+0000","last_active":"2024-09-17T03:00:54.873232+0000","last_peered":"2024-09-17T03:00:54.873232+0000","last_clean":"2024-09-17T03:00:54.873232+0000","last_became_active":"2024-09-17T03:00:53.881939+0000","last_became_peered":"2024-09-17T03:00:53.881939+0000","last_unstale":"2024-09-17T03:00:54.873232+0000","last_undegraded":"2024-09-17T03:00:54.873232+0000","last_fullsized":"2024-09-17T03:00:54.873232+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:11.880929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873433+0000","last_change":"2024-09-17T03:00:53.889020+0000","last_active":"2024-09-17T03:00:54.873433+0000","last_peered":"2024-09-17T03:00:54.873433+0000","last_clean":"2024-09-17T03:00:54.873433+0000","last_became_active":"2024-09-17T03:00:53.888677+0000","last_became_peered":"2024-09-17T03:00:53.888677+0000","last_unstale":"2024-09-17T03:00:54.873433+0000","last_undegraded":"2024-09-17T03:00:54.873433+0000","last_fullsized":"2024-09-17T03:00:54.873433+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:52.922786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902604+0000","last_change":"2024-09-17T03:00:53.885807+0000","last_active":"2024-09-17T03:00:54.902604+0000","last_peered":"2024-09-17T03:00:54.902604+0000","last_clean":"2024-09-17T03:00:54.902604+0000","last_became_active":"2024-09-17T03:00:53.885208+0000","last_became_peered":"2024-09-17T03:00:53.885208+0000","last_unstale":"2024-09-17T03:00:54.902604+0000","last_undegraded":"2024-09-17T03:00:54.902604+0000","last_fullsized":"2024-09-17T03:00:54.902604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:25.188203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901716+0000","last_change":"2024-09-17T03:00:53.889596+0000","last_active":"2024-09-17T03:00:54.901716+0000","last_peered":"2024-09-17T03:00:54.901716+0000","last_clean":"2024-09-17T03:00:54.901716+0000","last_became_active":"2024-09-17T03:00:53.889287+0000","last_became_peered":"2024-09-17T03:00:53.889287+0000","last_unstale":"2024-09-17T03:00:54.901716+0000","last_undegraded":"2024-09-17T03:00:54.901716+0000","last_fullsized":"2024-09-17T03:00:54.901716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:50.109812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873239+0000","last_change":"2024-09-17T03:00:53.882356+0000","last_active":"2024-09-17T03:00:54.873239+0000","last_peered":"2024-09-17T03:00:54.873239+0000","last_clean":"2024-09-17T03:00:54.873239+0000","last_became_active":"2024-09-17T03:00:53.882102+0000","last_became_peered":"2024-09-17T03:00:53.882102+0000","last_unstale":"2024-09-17T03:00:54.873239+0000","last_undegraded":"2024-09-17T03:00:54.873239+0000","last_fullsized":"2024-09-17T03:00:54.873239+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:43.120613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.871880+0000","last_change":"2024-09-17T03:00:53.882946+0000","last_active":"2024-09-17T03:00:54.871880+0000","last_peered":"2024-09-17T03:00:54.871880+0000","last_clean":"2024-09-17T03:00:54.871880+0000","last_became_active":"2024-09-17T03:00:53.882577+0000","last_became_peered":"2024-09-17T03:00:53.882577+0000","last_unstale":"2024-09-17T03:00:54.871880+0000","last_undegraded":"2024-09-17T03:00:54.871880+0000","last_fullsized":"2024-09-17T03:00:54.871880+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:46.728487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891531+0000","last_change":"2024-09-17T03:00:53.878517+0000","last_active":"2024-09-17T03:00:54.891531+0000","last_peered":"2024-09-17T03:00:54.891531+0000","last_clean":"2024-09-17T03:00:54.891531+0000","last_became_active":"2024-09-17T03:00:53.878177+0000","last_became_peered":"2024-09-17T03:00:53.878177+0000","last_unstale":"2024-09-17T03:00:54.891531+0000","last_undegraded":"2024-09-17T03:00:54.891531+0000","last_fullsized":"2024-09-17T03:00:54.891531+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:28.624034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902755+0000","last_change":"2024-09-17T03:00:53.886239+0000","last_active":"2024-09-17T03:00:54.902755+0000","last_peered":"2024-09-17T03:00:54.902755+0000","last_clean":"2024-09-17T03:00:54.902755+0000","last_became_active":"2024-09-17T03:00:53.885552+0000","last_became_peered":"2024-09-17T03:00:53.885552+0000","last_unstale":"2024-09-17T03:00:54.902755+0000","last_undegraded":"2024-09-17T03:00:54.902755+0000","last_fullsized":"2024-09-17T03:00:54.902755+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:59.368295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902019+0000","last_change":"2024-09-17T03:00:53.882483+0000","last_active":"2024-09-17T03:00:54.902019+0000","last_peered":"2024-09-17T03:00:54.902019+0000","last_clean":"2024-09-17T03:00:54.902019+0000","last_became_active":"2024-09-17T03:00:53.882211+0000","last_became_peered":"2024-09-17T03:00:53.882211+0000","last_unstale":"2024-09-17T03:00:54.902019+0000","last_undegraded":"2024-09-17T03:00:54.902019+0000","last_fullsized":"2024-09-17T03:00:54.902019+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:25.815247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901412+0000","last_change":"2024-09-17T03:00:53.884625+0000","last_active":"2024-09-17T03:00:54.901412+0000","last_peered":"2024-09-17T03:00:54.901412+0000","last_clean":"2024-09-17T03:00:54.901412+0000","last_became_active":"2024-09-17T03:00:53.884388+0000","last_became_peered":"2024-09-17T03:00:53.884388+0000","last_unstale":"2024-09-17T03:00:54.901412+0000","last_undegraded":"2024-09-17T03:00:54.901412+0000","last_fullsized":"2024-09-17T03:00:54.901412+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:14.740350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"136'4","reported_seq":19,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891566+0000","last_change":"2024-09-17T03:00:52.878170+0000","last_active":"2024-09-17T03:00:54.891566+0000","last_peered":"2024-09-17T03:00:54.891566+0000","last_clean":"2024-09-17T03:00:54.891566+0000","last_became_active":"2024-09-17T03:00:52.877899+0000","last_became_peered":"2024-09-17T03:00:52.877899+0000","last_unstale":"2024-09-17T03:00:54.891566+0000","last_undegraded":"2024-09-17T03:00:54.891566+0000","last_fullsized":"2024-09-17T03:00:54.891566+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:29.489522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872015+0000","last_change":"2024-09-17T03:00:53.882062+0000","last_active":"2024-09-17T03:00:54.872015+0000","last_peered":"2024-09-17T03:00:54.872015+0000","last_clean":"2024-09-17T03:00:54.872015+0000","last_became_active":"2024-09-17T03:00:53.881780+0000","last_became_peered":"2024-09-17T03:00:53.881780+0000","last_unstale":"2024-09-17T03:00:54.872015+0000","last_undegraded":"2024-09-17T03:00:54.872015+0000","last_fullsized":"2024-09-17T03:00:54.872015+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:25:02.871279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902136+0000","last_change":"2024-09-17T03:00:52.877565+0000","last_active":"2024-09-17T03:00:54.902136+0000","last_peered":"2024-09-17T03:00:54.902136+0000","last_clean":"2024-09-17T03:00:54.902136+0000","last_became_active":"2024-09-17T03:00:52.876815+0000","last_became_peered":"2024-09-17T03:00:52.876815+0000","last_unstale":"2024-09-17T03:00:54.902136+0000","last_undegraded":"2024-09-17T03:00:54.902136+0000","last_fullsized":"2024-09-17T03:00:54.902136+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:48.045380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902298+0000","last_change":"2024-09-17T03:00:53.884955+0000","last_active":"2024-09-17T03:00:54.902298+0000","last_peered":"2024-09-17T03:00:54.902298+0000","last_clean":"2024-09-17T03:00:54.902298+0000","last_became_active":"2024-09-17T03:00:53.883807+0000","last_became_peered":"2024-09-17T03:00:53.883807+0000","last_unstale":"2024-09-17T03:00:54.902298+0000","last_undegraded":"2024-09-17T03:00:54.902298+0000","last_fullsized":"2024-09-17T03:00:54.902298+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:57.073309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902462+0000","last_change":"2024-09-17T03:00:52.880815+0000","last_active":"2024-09-17T03:00:54.902462+0000","last_peered":"2024-09-17T03:00:54.902462+0000","last_clean":"2024-09-17T03:00:54.902462+0000","last_became_active":"2024-09-17T03:00:52.880573+0000","last_became_peered":"2024-09-17T03:00:52.880573+0000","last_unstale":"2024-09-17T03:00:54.902462+0000","last_undegraded":"2024-09-17T03:00:54.902462+0000","last_fullsized":"2024-09-17T03:00:54.902462+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:34.773468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901740+0000","last_change":"2024-09-17T03:00:53.878726+0000","last_active":"2024-09-17T03:00:54.901740+0000","last_peered":"2024-09-17T03:00:54.901740+0000","last_clean":"2024-09-17T03:00:54.901740+0000","last_became_active":"2024-09-17T03:00:53.877886+0000","last_became_peered":"2024-09-17T03:00:53.877886+0000","last_unstale":"2024-09-17T03:00:54.901740+0000","last_undegraded":"2024-09-17T03:00:54.901740+0000","last_fullsized":"2024-09-17T03:00:54.901740+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:18.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901736+0000","last_change":"2024-09-17T03:00:52.880035+0000","last_active":"2024-09-17T03:00:54.901736+0000","last_peered":"2024-09-17T03:00:54.901736+0000","last_clean":"2024-09-17T03:00:54.901736+0000","last_became_active":"2024-09-17T03:00:52.879118+0000","last_became_peered":"2024-09-17T03:00:52.879118+0000","last_unstale":"2024-09-17T03:00:54.901736+0000","last_undegraded":"2024-09-17T03:00:54.901736+0000","last_fullsized":"2024-09-17T03:00:54.901736+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:27.131759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902533+0000","last_change":"2024-09-17T03:00:53.881447+0000","last_active":"2024-09-17T03:00:54.902533+0000","last_peered":"2024-09-17T03:00:54.902533+0000","last_clean":"2024-09-17T03:00:54.902533+0000","last_became_active":"2024-09-17T03:00:53.881163+0000","last_became_peered":"2024-09-17T03:00:53.881163+0000","last_unstale":"2024-09-17T03:00:54.902533+0000","last_undegraded":"2024-09-17T03:00:54.902533+0000","last_fullsized":"2024-09-17T03:00:54.902533+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:20.352921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891680+0000","last_change":"2024-09-17T03:00:52.880915+0000","last_active":"2024-09-17T03:00:54.891680+0000","last_peered":"2024-09-17T03:00:54.891680+0000","last_clean":"2024-09-17T03:00:54.891680+0000","last_became_active":"2024-09-17T03:00:52.880612+0000","last_became_peered":"2024-09-17T03:00:52.880612+0000","last_unstale":"2024-09-17T03:00:54.891680+0000","last_undegraded":"2024-09-17T03:00:54.891680+0000","last_fullsized":"2024-09-17T03:00:54.891680+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:02.645302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872514+0000","last_change":"2024-09-17T03:00:53.882547+0000","last_active":"2024-09-17T03:00:54.872514+0000","last_peered":"2024-09-17T03:00:54.872514+0000","last_clean":"2024-09-17T03:00:54.872514+0000","last_became_active":"2024-09-17T03:00:53.881299+0000","last_became_peered":"2024-09-17T03:00:53.881299+0000","last_unstale":"2024-09-17T03:00:54.872514+0000","last_undegraded":"2024-09-17T03:00:54.872514+0000","last_fullsized":"2024-09-17T03:00:54.872514+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:55.582818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873623+0000","last_change":"2024-09-17T03:00:52.879515+0000","last_active":"2024-09-17T03:00:54.873623+0000","last_peered":"2024-09-17T03:00:54.873623+0000","last_clean":"2024-09-17T03:00:54.873623+0000","last_became_active":"2024-09-17T03:00:52.879055+0000","last_became_peered":"2024-09-17T03:00:52.879055+0000","last_unstale":"2024-09-17T03:00:54.873623+0000","last_undegraded":"2024-09-17T03:00:54.873623+0000","last_fullsized":"2024-09-17T03:00:54.873623+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:44.763569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901913+0000","last_change":"2024-09-17T03:00:53.889036+0000","last_active":"2024-09-17T03:00:54.901913+0000","last_peered":"2024-09-17T03:00:54.901913+0000","last_clean":"2024-09-17T03:00:54.901913+0000","last_became_active":"2024-09-17T03:00:53.888750+0000","last_became_peered":"2024-09-17T03:00:53.888750+0000","last_unstale":"2024-09-17T03:00:54.901913+0000","last_undegraded":"2024-09-17T03:00:54.901913+0000","last_fullsized":"2024-09-17T03:00:54.901913+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:01.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872024+0000","last_change":"2024-09-17T03:00:52.884070+0000","last_active":"2024-09-17T03:00:54.872024+0000","last_peered":"2024-09-17T03:00:54.872024+0000","last_clean":"2024-09-17T03:00:54.872024+0000","last_became_active":"2024-09-17T03:00:52.883899+0000","last_became_peered":"2024-09-17T03:00:52.883899+0000","last_unstale":"2024-09-17T03:00:54.872024+0000","last_undegraded":"2024-09-17T03:00:54.872024+0000","last_fullsized":"2024-09-17T03:00:54.872024+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:36.368513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891372+0000","last_change":"2024-09-17T03:00:53.874335+0000","last_active":"2024-09-17T03:00:54.891372+0000","last_peered":"2024-09-17T03:00:54.891372+0000","last_clean":"2024-09-17T03:00:54.891372+0000","last_became_active":"2024-09-17T03:00:53.874058+0000","last_became_peered":"2024-09-17T03:00:53.874058+0000","last_unstale":"2024-09-17T03:00:54.891372+0000","last_undegraded":"2024-09-17T03:00:54.891372+0000","last_fullsized":"2024-09-17T03:00:54.891372+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:48.857232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902330+0000","last_change":"2024-09-17T03:00:52.881468+0000","last_active":"2024-09-17T03:00:54.902330+0000","last_peered":"2024-09-17T03:00:54.902330+0000","last_clean":"2024-09-17T03:00:54.902330+0000","last_became_active":"2024-09-17T03:00:52.880508+0000","last_became_peered":"2024-09-17T03:00:52.880508+0000","last_unstale":"2024-09-17T03:00:54.902330+0000","last_undegraded":"2024-09-17T03:00:54.902330+0000","last_fullsized":"2024-09-17T03:00:54.902330+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:13.909992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891526+0000","last_change":"2024-09-17T03:00:53.873265+0000","last_active":"2024-09-17T03:00:54.891526+0000","last_peered":"2024-09-17T03:00:54.891526+0000","last_clean":"2024-09-17T03:00:54.891526+0000","last_became_active":"2024-09-17T03:00:53.872966+0000","last_became_peered":"2024-09-17T03:00:53.872966+0000","last_unstale":"2024-09-17T03:00:54.891526+0000","last_undegraded":"2024-09-17T03:00:54.891526+0000","last_fullsized":"2024-09-17T03:00:54.891526+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:10.568493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901844+0000","last_change":"2024-09-17T03:00:52.880765+0000","last_active":"2024-09-17T03:00:54.901844+0000","last_peered":"2024-09-17T03:00:54.901844+0000","last_clean":"2024-09-17T03:00:54.901844+0000","last_became_active":"2024-09-17T03:00:52.879777+0000","last_became_peered":"2024-09-17T03:00:52.879777+0000","last_unstale":"2024-09-17T03:00:54.901844+0000","last_undegraded":"2024-09-17T03:00:54.901844+0000","last_fullsized":"2024-09-17T03:00:54.901844+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:47.506315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872217+0000","last_change":"2024-09-17T03:00:53.889264+0000","last_active":"2024-09-17T03:00:54.872217+0000","last_peered":"2024-09-17T03:00:54.872217+0000","last_clean":"2024-09-17T03:00:54.872217+0000","last_became_active":"2024-09-17T03:00:53.888922+0000","last_became_peered":"2024-09-17T03:00:53.888922+0000","last_unstale":"2024-09-17T03:00:54.872217+0000","last_undegraded":"2024-09-17T03:00:54.872217+0000","last_fullsized":"2024-09-17T03:00:54.872217+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:16.474422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873593+0000","last_change":"2024-09-17T03:00:52.875996+0000","last_active":"2024-09-17T03:00:54.873593+0000","last_peered":"2024-09-17T03:00:54.873593+0000","last_clean":"2024-09-17T03:00:54.873593+0000","last_became_active":"2024-09-17T03:00:52.875718+0000","last_became_peered":"2024-09-17T03:00:52.875718+0000","last_unstale":"2024-09-17T03:00:54.873593+0000","last_undegraded":"2024-09-17T03:00:54.873593+0000","last_fullsized":"2024-09-17T03:00:54.873593+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:36.736041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873477+0000","last_change":"2024-09-17T03:00:53.887970+0000","last_active":"2024-09-17T03:00:54.873477+0000","last_peered":"2024-09-17T03:00:54.873477+0000","last_clean":"2024-09-17T03:00:54.873477+0000","last_became_active":"2024-09-17T03:00:53.887658+0000","last_became_peered":"2024-09-17T03:00:53.887658+0000","last_unstale":"2024-09-17T03:00:54.873477+0000","last_undegraded":"2024-09-17T03:00:54.873477+0000","last_fullsized":"2024-09-17T03:00:54.873477+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:46.637328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"136'3","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903262+0000","last_change":"2024-09-17T03:00:52.886525+0000","last_active":"2024-09-17T03:00:54.903262+0000","last_peered":"2024-09-17T03:00:54.903262+0000","last_clean":"2024-09-17T03:00:54.903262+0000","last_became_active":"2024-09-17T03:00:52.885317+0000","last_became_peered":"2024-09-17T03:00:52.885317+0000","last_unstale":"2024-09-17T03:00:54.903262+0000","last_undegraded":"2024-09-17T03:00:54.903262+0000","last_fullsized":"2024-09-17T03:00:54.903262+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:33.701860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891374+0000","last_change":"2024-09-17T03:00:53.882046+0000","last_active":"2024-09-17T03:00:54.891374+0000","last_peered":"2024-09-17T03:00:54.891374+0000","last_clean":"2024-09-17T03:00:54.891374+0000","last_became_active":"2024-09-17T03:00:53.881759+0000","last_became_peered":"2024-09-17T03:00:53.881759+0000","last_unstale":"2024-09-17T03:00:54.891374+0000","last_undegraded":"2024-09-17T03:00:54.891374+0000","last_fullsized":"2024-09-17T03:00:54.891374+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:21.913882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"136'6","reported_seq":21,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903059+0000","last_change":"2024-09-17T03:00:52.885857+0000","last_active":"2024-09-17T03:00:54.903059+0000","last_peered":"2024-09-17T03:00:54.903059+0000","last_clean":"2024-09-17T03:00:54.903059+0000","last_became_active":"2024-09-17T03:00:52.884895+0000","last_became_peered":"2024-09-17T03:00:52.884895+0000","last_unstale":"2024-09-17T03:00:54.903059+0000","last_undegraded":"2024-09-17T03:00:54.903059+0000","last_fullsized":"2024-09-17T03:00:54.903059+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:01.004488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873520+0000","last_change":"2024-09-17T03:00:53.878919+0000","last_active":"2024-09-17T03:00:54.873520+0000","last_peered":"2024-09-17T03:00:54.873520+0000","last_clean":"2024-09-17T03:00:54.873520+0000","last_became_active":"2024-09-17T03:00:53.878662+0000","last_became_peered":"2024-09-17T03:00:53.878662+0000","last_unstale":"2024-09-17T03:00:54.873520+0000","last_undegraded":"2024-09-17T03:00:54.873520+0000","last_fullsized":"2024-09-17T03:00:54.873520+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:28.559523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902486+0000","last_change":"2024-09-17T03:00:52.880779+0000","last_active":"2024-09-17T03:00:54.902486+0000","last_peered":"2024-09-17T03:00:54.902486+0000","last_clean":"2024-09-17T03:00:54.902486+0000","last_became_active":"2024-09-17T03:00:52.880491+0000","last_became_peered":"2024-09-17T03:00:52.880491+0000","last_unstale":"2024-09-17T03:00:54.902486+0000","last_undegraded":"2024-09-17T03:00:54.902486+0000","last_fullsized":"2024-09-17T03:00:54.902486+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:54.359896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873524+0000","last_change":"2024-09-17T03:00:53.881248+0000","last_active":"2024-09-17T03:00:54.873524+0000","last_peered":"2024-09-17T03:00:54.873524+0000","last_clean":"2024-09-17T03:00:54.873524+0000","last_became_active":"2024-09-17T03:00:53.880303+0000","last_became_peered":"2024-09-17T03:00:53.880303+0000","last_unstale":"2024-09-17T03:00:54.873524+0000","last_undegraded":"2024-09-17T03:00:54.873524+0000","last_fullsized":"2024-09-17T03:00:54.873524+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:37.750607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872351+0000","last_change":"2024-09-17T03:00:52.882158+0000","last_active":"2024-09-17T03:00:54.872351+0000","last_peered":"2024-09-17T03:00:54.872351+0000","last_clean":"2024-09-17T03:00:54.872351+0000","last_became_active":"2024-09-17T03:00:52.881597+0000","last_became_peered":"2024-09-17T03:00:52.881597+0000","last_unstale":"2024-09-17T03:00:54.872351+0000","last_undegraded":"2024-09-17T03:00:54.872351+0000","last_fullsized":"2024-09-17T03:00:54.872351+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:37.098133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873483+0000","last_change":"2024-09-17T03:00:53.887594+0000","last_active":"2024-09-17T03:00:54.873483+0000","last_peered":"2024-09-17T03:00:54.873483+0000","last_clean":"2024-09-17T03:00:54.873483+0000","last_became_active":"2024-09-17T03:00:53.887302+0000","last_became_peered":"2024-09-17T03:00:53.887302+0000","last_unstale":"2024-09-17T03:00:54.873483+0000","last_undegraded":"2024-09-17T03:00:54.873483+0000","last_fullsized":"2024-09-17T03:00:54.873483+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.116260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":23,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901725+0000","last_change":"2024-09-17T03:00:52.877431+0000","last_active":"2024-09-17T03:00:54.901725+0000","last_peered":"2024-09-17T03:00:54.901725+0000","last_clean":"2024-09-17T03:00:54.901725+0000","last_became_active":"2024-09-17T03:00:52.876828+0000","last_became_peered":"2024-09-17T03:00:52.876828+0000","last_unstale":"2024-09-17T03:00:54.901725+0000","last_undegraded":"2024-09-17T03:00:54.901725+0000","last_fullsized":"2024-09-17T03:00:54.901725+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:37.176604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902256+0000","last_change":"2024-09-17T03:00:53.884402+0000","last_active":"2024-09-17T03:00:54.902256+0000","last_peered":"2024-09-17T03:00:54.902256+0000","last_clean":"2024-09-17T03:00:54.902256+0000","last_became_active":"2024-09-17T03:00:53.884134+0000","last_became_peered":"2024-09-17T03:00:53.884134+0000","last_unstale":"2024-09-17T03:00:54.902256+0000","last_undegraded":"2024-09-17T03:00:54.902256+0000","last_fullsized":"2024-09-17T03:00:54.902256+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:40.868357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903161+0000","last_change":"2024-09-17T03:00:52.879989+0000","last_active":"2024-09-17T03:00:54.903161+0000","last_peered":"2024-09-17T03:00:54.903161+0000","last_clean":"2024-09-17T03:00:54.903161+0000","last_became_active":"2024-09-17T03:00:52.878876+0000","last_became_peered":"2024-09-17T03:00:52.878876+0000","last_unstale":"2024-09-17T03:00:54.903161+0000","last_undegraded":"2024-09-17T03:00:54.903161+0000","last_fullsized":"2024-09-17T03:00:54.903161+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:06.587131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901646+0000","last_change":"2024-09-17T03:00:53.889370+0000","last_active":"2024-09-17T03:00:54.901646+0000","last_peered":"2024-09-17T03:00:54.901646+0000","last_clean":"2024-09-17T03:00:54.901646+0000","last_became_active":"2024-09-17T03:00:53.889096+0000","last_became_peered":"2024-09-17T03:00:53.889096+0000","last_unstale":"2024-09-17T03:00:54.901646+0000","last_undegraded":"2024-09-17T03:00:54.901646+0000","last_fullsized":"2024-09-17T03:00:54.901646+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:52.603670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902575+0000","last_change":"2024-09-17T03:00:52.875812+0000","last_active":"2024-09-17T03:00:54.902575+0000","last_peered":"2024-09-17T03:00:54.902575+0000","last_clean":"2024-09-17T03:00:54.902575+0000","last_became_active":"2024-09-17T03:00:52.875470+0000","last_became_peered":"2024-09-17T03:00:52.875470+0000","last_unstale":"2024-09-17T03:00:54.902575+0000","last_undegraded":"2024-09-17T03:00:54.902575+0000","last_fullsized":"2024-09-17T03:00:54.902575+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:25.606689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901403+0000","last_change":"2024-09-17T03:00:53.886903+0000","last_active":"2024-09-17T03:00:54.901403+0000","last_peered":"2024-09-17T03:00:54.901403+0000","last_clean":"2024-09-17T03:00:54.901403+0000","last_became_active":"2024-09-17T03:00:53.886603+0000","last_became_peered":"2024-09-17T03:00:53.886603+0000","last_unstale":"2024-09-17T03:00:54.901403+0000","last_undegraded":"2024-09-17T03:00:54.901403+0000","last_fullsized":"2024-09-17T03:00:54.901403+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:57.290259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872485+0000","last_change":"2024-09-17T03:00:52.877913+0000","last_active":"2024-09-17T03:00:54.872485+0000","last_peered":"2024-09-17T03:00:54.872485+0000","last_clean":"2024-09-17T03:00:54.872485+0000","last_became_active":"2024-09-17T03:00:52.877633+0000","last_became_peered":"2024-09-17T03:00:52.877633+0000","last_unstale":"2024-09-17T03:00:54.872485+0000","last_undegraded":"2024-09-17T03:00:54.872485+0000","last_fullsized":"2024-09-17T03:00:54.872485+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:52.930031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901476+0000","last_change":"2024-09-17T03:00:53.885263+0000","last_active":"2024-09-17T03:00:54.901476+0000","last_peered":"2024-09-17T03:00:54.901476+0000","last_clean":"2024-09-17T03:00:54.901476+0000","last_became_active":"2024-09-17T03:00:53.884709+0000","last_became_peered":"2024-09-17T03:00:53.884709+0000","last_unstale":"2024-09-17T03:00:54.901476+0000","last_undegraded":"2024-09-17T03:00:54.901476+0000","last_fullsized":"2024-09-17T03:00:54.901476+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:04.315461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.892207+0000","last_change":"2024-09-17T03:00:52.884785+0000","last_active":"2024-09-17T03:00:54.892207+0000","last_peered":"2024-09-17T03:00:54.892207+0000","last_clean":"2024-09-17T03:00:54.892207+0000","last_became_active":"2024-09-17T03:00:52.884333+0000","last_became_peered":"2024-09-17T03:00:52.884333+0000","last_unstale":"2024-09-17T03:00:54.892207+0000","last_undegraded":"2024-09-17T03:00:54.892207+0000","last_fullsized":"2024-09-17T03:00:54.892207+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.266482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902061+0000","last_change":"2024-09-17T03:00:53.888558+0000","last_active":"2024-09-17T03:00:54.902061+0000","last_peered":"2024-09-17T03:00:54.902061+0000","last_clean":"2024-09-17T03:00:54.902061+0000","last_became_active":"2024-09-17T03:00:53.888036+0000","last_became_peered":"2024-09-17T03:00:53.888036+0000","last_unstale":"2024-09-17T03:00:54.902061+0000","last_undegraded":"2024-09-17T03:00:54.902061+0000","last_fullsized":"2024-09-17T03:00:54.902061+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:29.247064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902391+0000","last_change":"2024-09-17T03:00:52.882567+0000","last_active":"2024-09-17T03:00:54.902391+0000","last_peered":"2024-09-17T03:00:54.902391+0000","last_clean":"2024-09-17T03:00:54.902391+0000","last_became_active":"2024-09-17T03:00:52.881639+0000","last_became_peered":"2024-09-17T03:00:52.881639+0000","last_unstale":"2024-09-17T03:00:54.902391+0000","last_undegraded":"2024-09-17T03:00:54.902391+0000","last_fullsized":"2024-09-17T03:00:54.902391+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:35.128554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903066+0000","last_change":"2024-09-17T03:00:53.887047+0000","last_active":"2024-09-17T03:00:54.903066+0000","last_peered":"2024-09-17T03:00:54.903066+0000","last_clean":"2024-09-17T03:00:54.903066+0000","last_became_active":"2024-09-17T03:00:53.886438+0000","last_became_peered":"2024-09-17T03:00:53.886438+0000","last_unstale":"2024-09-17T03:00:54.903066+0000","last_undegraded":"2024-09-17T03:00:54.903066+0000","last_fullsized":"2024-09-17T03:00:54.903066+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:30.964407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901447+0000","last_change":"2024-09-17T03:00:52.877467+0000","last_active":"2024-09-17T03:00:54.901447+0000","last_peered":"2024-09-17T03:00:54.901447+0000","last_clean":"2024-09-17T03:00:54.901447+0000","last_became_active":"2024-09-17T03:00:52.877064+0000","last_became_peered":"2024-09-17T03:00:52.877064+0000","last_unstale":"2024-09-17T03:00:54.901447+0000","last_undegraded":"2024-09-17T03:00:54.901447+0000","last_fullsized":"2024-09-17T03:00:54.901447+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:07.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901726+0000","last_change":"2024-09-17T03:00:53.884137+0000","last_active":"2024-09-17T03:00:54.901726+0000","last_peered":"2024-09-17T03:00:54.901726+0000","last_clean":"2024-09-17T03:00:54.901726+0000","last_became_active":"2024-09-17T03:00:53.879707+0000","last_became_peered":"2024-09-17T03:00:53.879707+0000","last_unstale":"2024-09-17T03:00:54.901726+0000","last_undegraded":"2024-09-17T03:00:54.901726+0000","last_fullsized":"2024-09-17T03:00:54.901726+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:03.742753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902590+0000","last_change":"2024-09-17T03:00:52.881563+0000","last_active":"2024-09-17T03:00:54.902590+0000","last_peered":"2024-09-17T03:00:54.902590+0000","last_clean":"2024-09-17T03:00:54.902590+0000","last_became_active":"2024-09-17T03:00:52.881211+0000","last_became_peered":"2024-09-17T03:00:52.881211+0000","last_unstale":"2024-09-17T03:00:54.902590+0000","last_undegraded":"2024-09-17T03:00:54.902590+0000","last_fullsized":"2024-09-17T03:00:54.902590+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:25.945976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873742+0000","last_change":"2024-09-17T03:00:53.882092+0000","last_active":"2024-09-17T03:00:54.873742+0000","last_peered":"2024-09-17T03:00:54.873742+0000","last_clean":"2024-09-17T03:00:54.873742+0000","last_became_active":"2024-09-17T03:00:53.881824+0000","last_became_peered":"2024-09-17T03:00:53.881824+0000","last_unstale":"2024-09-17T03:00:54.873742+0000","last_undegraded":"2024-09-17T03:00:54.873742+0000","last_fullsized":"2024-09-17T03:00:54.873742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:25.919498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902902+0000","last_change":"2024-09-17T03:00:52.886093+0000","last_active":"2024-09-17T03:00:54.902902+0000","last_peered":"2024-09-17T03:00:54.902902+0000","last_clean":"2024-09-17T03:00:54.902902+0000","last_became_active":"2024-09-17T03:00:52.885604+0000","last_became_peered":"2024-09-17T03:00:52.885604+0000","last_unstale":"2024-09-17T03:00:54.902902+0000","last_undegraded":"2024-09-17T03:00:54.902902+0000","last_fullsized":"2024-09-17T03:00:54.902902+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:41.971212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872365+0000","last_change":"2024-09-17T03:00:53.889256+0000","last_active":"2024-09-17T03:00:54.872365+0000","last_peered":"2024-09-17T03:00:54.872365+0000","last_clean":"2024-09-17T03:00:54.872365+0000","last_became_active":"2024-09-17T03:00:53.888985+0000","last_became_peered":"2024-09-17T03:00:53.888985+0000","last_unstale":"2024-09-17T03:00:54.872365+0000","last_undegraded":"2024-09-17T03:00:54.872365+0000","last_fullsized":"2024-09-17T03:00:54.872365+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:45.620241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873726+0000","last_change":"2024-09-17T03:00:52.877017+0000","last_active":"2024-09-17T03:00:54.873726+0000","last_peered":"2024-09-17T03:00:54.873726+0000","last_clean":"2024-09-17T03:00:54.873726+0000","last_became_active":"2024-09-17T03:00:52.876760+0000","last_became_peered":"2024-09-17T03:00:52.876760+0000","last_unstale":"2024-09-17T03:00:54.873726+0000","last_undegraded":"2024-09-17T03:00:54.873726+0000","last_fullsized":"2024-09-17T03:00:54.873726+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:35.600688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902951+0000","last_change":"2024-09-17T03:00:53.888004+0000","last_active":"2024-09-17T03:00:54.902951+0000","last_peered":"2024-09-17T03:00:54.902951+0000","last_clean":"2024-09-17T03:00:54.902951+0000","last_became_active":"2024-09-17T03:00:53.887496+0000","last_became_peered":"2024-09-17T03:00:53.887496+0000","last_unstale":"2024-09-17T03:00:54.902951+0000","last_undegraded":"2024-09-17T03:00:54.902951+0000","last_fullsized":"2024-09-17T03:00:54.902951+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:32.471441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"137'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891170+0000","last_change":"2024-09-17T03:00:52.878222+0000","last_active":"2024-09-17T03:00:54.891170+0000","last_peered":"2024-09-17T03:00:54.891170+0000","last_clean":"2024-09-17T03:00:54.891170+0000","last_became_active":"2024-09-17T03:00:52.877962+0000","last_became_peered":"2024-09-17T03:00:52.877962+0000","last_unstale":"2024-09-17T03:00:54.891170+0000","last_undegraded":"2024-09-17T03:00:54.891170+0000","last_fullsized":"2024-09-17T03:00:54.891170+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:31.101800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902210+0000","last_change":"2024-09-17T03:00:53.887846+0000","last_active":"2024-09-17T03:00:54.902210+0000","last_peered":"2024-09-17T03:00:54.902210+0000","last_clean":"2024-09-17T03:00:54.902210+0000","last_became_active":"2024-09-17T03:00:53.887590+0000","last_became_peered":"2024-09-17T03:00:53.887590+0000","last_unstale":"2024-09-17T03:00:54.902210+0000","last_undegraded":"2024-09-17T03:00:54.902210+0000","last_fullsized":"2024-09-17T03:00:54.902210+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:52.657055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903221+0000","last_change":"2024-09-17T03:00:52.886139+0000","last_active":"2024-09-17T03:00:54.903221+0000","last_peered":"2024-09-17T03:00:54.903221+0000","last_clean":"2024-09-17T03:00:54.903221+0000","last_became_active":"2024-09-17T03:00:52.885237+0000","last_became_peered":"2024-09-17T03:00:52.885237+0000","last_unstale":"2024-09-17T03:00:54.903221+0000","last_undegraded":"2024-09-17T03:00:54.903221+0000","last_fullsized":"2024-09-17T03:00:54.903221+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:48.424841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872199+0000","last_change":"2024-09-17T03:00:53.880710+0000","last_active":"2024-09-17T03:00:54.872199+0000","last_peered":"2024-09-17T03:00:54.872199+0000","last_clean":"2024-09-17T03:00:54.872199+0000","last_became_active":"2024-09-17T03:00:53.880392+0000","last_became_peered":"2024-09-17T03:00:53.880392+0000","last_unstale":"2024-09-17T03:00:54.872199+0000","last_undegraded":"2024-09-17T03:00:54.872199+0000","last_fullsized":"2024-09-17T03:00:54.872199+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:02.100846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873801+0000","last_change":"2024-09-17T03:00:52.882188+0000","last_active":"2024-09-17T03:00:54.873801+0000","last_peered":"2024-09-17T03:00:54.873801+0000","last_clean":"2024-09-17T03:00:54.873801+0000","last_became_active":"2024-09-17T03:00:52.881793+0000","last_became_peered":"2024-09-17T03:00:52.881793+0000","last_unstale":"2024-09-17T03:00:54.873801+0000","last_undegraded":"2024-09-17T03:00:54.873801+0000","last_fullsized":"2024-09-17T03:00:54.873801+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:10.652451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872774+0000","last_change":"2024-09-17T03:00:53.881635+0000","last_active":"2024-09-17T03:00:54.872774+0000","last_peered":"2024-09-17T03:00:54.872774+0000","last_clean":"2024-09-17T03:00:54.872774+0000","last_became_active":"2024-09-17T03:00:53.880355+0000","last_became_peered":"2024-09-17T03:00:53.880355+0000","last_unstale":"2024-09-17T03:00:54.872774+0000","last_undegraded":"2024-09-17T03:00:54.872774+0000","last_fullsized":"2024-09-17T03:00:54.872774+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:41.314871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891599+0000","last_change":"2024-09-17T03:00:52.879137+0000","last_active":"2024-09-17T03:00:54.891599+0000","last_peered":"2024-09-17T03:00:54.891599+0000","last_clean":"2024-09-17T03:00:54.891599+0000","last_became_active":"2024-09-17T03:00:52.878490+0000","last_became_peered":"2024-09-17T03:00:52.878490+0000","last_unstale":"2024-09-17T03:00:54.891599+0000","last_undegraded":"2024-09-17T03:00:54.891599+0000","last_fullsized":"2024-09-17T03:00:54.891599+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:08.953575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873365+0000","last_change":"2024-09-17T03:00:53.883054+0000","last_active":"2024-09-17T03:00:54.873365+0000","last_peered":"2024-09-17T03:00:54.873365+0000","last_clean":"2024-09-17T03:00:54.873365+0000","last_became_active":"2024-09-17T03:00:53.880141+0000","last_became_peered":"2024-09-17T03:00:53.880141+0000","last_unstale":"2024-09-17T03:00:54.873365+0000","last_undegraded":"2024-09-17T03:00:54.873365+0000","last_fullsized":"2024-09-17T03:00:54.873365+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:21.898845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872913+0000","last_change":"2024-09-17T03:00:52.879952+0000","last_active":"2024-09-17T03:00:54.872913+0000","last_peered":"2024-09-17T03:00:54.872913+0000","last_clean":"2024-09-17T03:00:54.872913+0000","last_became_active":"2024-09-17T03:00:52.879675+0000","last_became_peered":"2024-09-17T03:00:52.879675+0000","last_unstale":"2024-09-17T03:00:54.872913+0000","last_undegraded":"2024-09-17T03:00:54.872913+0000","last_fullsized":"2024-09-17T03:00:54.872913+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:16.806679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901914+0000","last_change":"2024-09-17T03:00:53.884467+0000","last_active":"2024-09-17T03:00:54.901914+0000","last_peered":"2024-09-17T03:00:54.901914+0000","last_clean":"2024-09-17T03:00:54.901914+0000","last_became_active":"2024-09-17T03:00:53.883534+0000","last_became_peered":"2024-09-17T03:00:53.883534+0000","last_unstale":"2024-09-17T03:00:54.901914+0000","last_undegraded":"2024-09-17T03:00:54.901914+0000","last_fullsized":"2024-09-17T03:00:54.901914+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:10.553370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901828+0000","last_change":"2024-09-17T03:00:52.877112+0000","last_active":"2024-09-17T03:00:54.901828+0000","last_peered":"2024-09-17T03:00:54.901828+0000","last_clean":"2024-09-17T03:00:54.901828+0000","last_became_active":"2024-09-17T03:00:52.876367+0000","last_became_peered":"2024-09-17T03:00:52.876367+0000","last_unstale":"2024-09-17T03:00:54.901828+0000","last_undegraded":"2024-09-17T03:00:54.901828+0000","last_fullsized":"2024-09-17T03:00:54.901828+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:34.403558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902767+0000","last_change":"2024-09-17T03:00:53.886699+0000","last_active":"2024-09-17T03:00:54.902767+0000","last_peered":"2024-09-17T03:00:54.902767+0000","last_clean":"2024-09-17T03:00:54.902767+0000","last_became_active":"2024-09-17T03:00:53.886062+0000","last_became_peered":"2024-09-17T03:00:53.886062+0000","last_unstale":"2024-09-17T03:00:54.902767+0000","last_undegraded":"2024-09-17T03:00:54.902767+0000","last_fullsized":"2024-09-17T03:00:54.902767+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:12.300075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903272+0000","last_change":"2024-09-17T03:00:52.886428+0000","last_active":"2024-09-17T03:00:54.903272+0000","last_peered":"2024-09-17T03:00:54.903272+0000","last_clean":"2024-09-17T03:00:54.903272+0000","last_became_active":"2024-09-17T03:00:52.885582+0000","last_became_peered":"2024-09-17T03:00:52.885582+0000","last_unstale":"2024-09-17T03:00:54.903272+0000","last_undegraded":"2024-09-17T03:00:54.903272+0000","last_fullsized":"2024-09-17T03:00:54.903272+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:33.968252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873500+0000","last_change":"2024-09-17T03:00:53.883298+0000","last_active":"2024-09-17T03:00:54.873500+0000","last_peered":"2024-09-17T03:00:54.873500+0000","last_clean":"2024-09-17T03:00:54.873500+0000","last_became_active":"2024-09-17T03:00:53.882880+0000","last_became_peered":"2024-09-17T03:00:53.882880+0000","last_unstale":"2024-09-17T03:00:54.873500+0000","last_undegraded":"2024-09-17T03:00:54.873500+0000","last_fullsized":"2024-09-17T03:00:54.873500+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:21.906322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.892072+0000","last_change":"2024-09-17T03:00:52.885018+0000","last_active":"2024-09-17T03:00:54.892072+0000","last_peered":"2024-09-17T03:00:54.892072+0000","last_clean":"2024-09-17T03:00:54.892072+0000","last_became_active":"2024-09-17T03:00:52.884598+0000","last_became_peered":"2024-09-17T03:00:52.884598+0000","last_unstale":"2024-09-17T03:00:54.892072+0000","last_undegraded":"2024-09-17T03:00:54.892072+0000","last_fullsized":"2024-09-17T03:00:54.892072+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:50.980522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":341,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902173+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:54.902173+0000","last_peered":"2024-09-17T03:00:54.902173+0000","last_clean":"2024-09-17T03:00:54.902173+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:54.902173+0000","last_undegraded":"2024-09-17T03:00:54.902173+0000","last_fullsized":"2024-09-17T03:00:54.902173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1314,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193997,"statfs":{"total":200000000,"available":198653483,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":738,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199243863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244467,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194573,"statfs":{"total":200000000,"available":199242785,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244467,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244343,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193996,"statfs":{"total":200000000,"available":198652375,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:01:01.326 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:01:01.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.453+0000 7fdae0c0e640 1 -- 172.21.15.104:0/1183512720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d3490 msgr2=0x7fdadc0b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:01.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.453+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/1183512720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d3490 0x7fdadc0b7c80 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fdacc005fd0 tx=0x7fdacc02a7e0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.453+0000 7fdae0c0e640 1 -- 172.21.15.104:0/1183512720 shutdown_connections 2024-09-17T03:01:01.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.453+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/1183512720 >> v2:172.21.15.192:3300/0 conn(0x7fdadc0d13e0 0x7fdadc1615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.453+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/1183512720 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d3490 0x7fdadc0b7c80 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.453+0000 7fdae0c0e640 1 -- 172.21.15.104:0/1183512720 >> 172.21.15.104:0/1183512720 conn(0x7fdadc0d2970 msgr2=0x7fdadc0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:01.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.453+0000 7fdae0c0e640 1 -- 172.21.15.104:0/1183512720 shutdown_connections 2024-09-17T03:01:01.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.453+0000 7fdae0c0e640 1 -- 172.21.15.104:0/1183512720 wait complete. 2024-09-17T03:01:01.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.455+0000 7fdae0c0e640 1 Processor -- start 2024-09-17T03:01:01.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.455+0000 7fdae0c0e640 1 -- start start 2024-09-17T03:01:01.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdae0c0e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdadc0d0fd0 0x7fdadc0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:01.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdae0c0e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d13e0 0x7fdadc159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:01.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdae0c0e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdadc0d3490 0x7fdadc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdae0c0e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc0b6bd0 con 0x7fdadc0d13e0 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdae0c0e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc0b6a50 con 0x7fdadc0d0fd0 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdae0c0e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdadc0b6d50 con 0x7fdadc0d3490 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d13e0 0x7fdadc159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d13e0 0x7fdadc159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35526/0 (socket says 172.21.15.104:35526) 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 -- 172.21.15.104:0/680907476 learned_addr learned my addr 172.21.15.104:0/680907476 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdada59c640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdadc0d0fd0 0x7fdadc0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdadad9d640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdadc0d3490 0x7fdadc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 -- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdadc0d3490 msgr2=0x7fdadc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdadc0d3490 0x7fdadc0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 -- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdadc0d0fd0 msgr2=0x7fdadc0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdadc0d0fd0 0x7fdadc0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 -- 172.21.15.104:0/680907476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc06d6b0 con 0x7fdadc0d13e0 2024-09-17T03:01:01.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdada59c640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdadc0d0fd0 0x7fdadc0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:01.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad9d9b640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d13e0 0x7fdadc159070 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c3c0 tx=0x7fdac400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:01.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.457+0000 7fdad2ffd640 1 -- 172.21.15.104:0/680907476 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4017070 con 0x7fdadc0d13e0 2024-09-17T03:01:01.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.458+0000 7fdad2ffd640 1 -- 172.21.15.104:0/680907476 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac40035f0 con 0x7fdadc0d13e0 2024-09-17T03:01:01.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.458+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc0cc7f0 con 0x7fdadc0d13e0 2024-09-17T03:01:01.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.458+0000 7fdad2ffd640 1 -- 172.21.15.104:0/680907476 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4003a40 con 0x7fdadc0d13e0 2024-09-17T03:01:01.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.458+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc0ccdb0 con 0x7fdadc0d13e0 2024-09-17T03:01:01.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.458+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc0b7c80 con 0x7fdadc0d13e0 2024-09-17T03:01:01.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.459+0000 7fdad2ffd640 1 -- 172.21.15.104:0/680907476 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdac401a070 con 0x7fdadc0d13e0 2024-09-17T03:01:01.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.460+0000 7fdad2ffd640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:01.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.460+0000 7fdad2ffd640 1 -- 172.21.15.104:0/680907476 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7fdac4099f10 con 0x7fdadc0d13e0 2024-09-17T03:01:01.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.460+0000 7fdada59c640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:01.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.461+0000 7fdada59c640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdabc078bc0 0x7fdabc07b0d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdacc033000 tx=0x7fdacc004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:01.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.464+0000 7fdad2ffd640 1 -- 172.21.15.104:0/680907476 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdac4062470 con 0x7fdadc0d13e0 2024-09-17T03:01:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.633+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdadc0d0900 con 0x7fdabc078bc0 2024-09-17T03:01:01.640 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:01.641 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:01:01.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.638+0000 7fdad2ffd640 1 -- 172.21.15.104:0/680907476 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247980 (secure 0 0 0) 0x7fdadc0d0900 con 0x7fdabc078bc0 2024-09-17T03:01:01.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdabc078bc0 msgr2=0x7fdabc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:01.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdabc078bc0 0x7fdabc07b0d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdacc033000 tx=0x7fdacc004ab0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d13e0 msgr2=0x7fdadc159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:01.664 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d13e0 0x7fdadc159070 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c3c0 tx=0x7fdac400c880 comp rx=0 tx=0).stop 2024-09-17T03:01:01.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 shutdown_connections 2024-09-17T03:01:01.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdabc078bc0 0x7fdabc07b0d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdadc0d3490 0x7fdadc0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdadc0d13e0 0x7fdadc159070 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 --2- 172.21.15.104:0/680907476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdadc0d0fd0 0x7fdadc0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 >> 172.21.15.104:0/680907476 conn(0x7fdadc0d2970 msgr2=0x7fdadc0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:01.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 shutdown_connections 2024-09-17T03:01:01.665 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.641+0000 7fdae0c0e640 1 -- 172.21.15.104:0/680907476 wait complete. 2024-09-17T03:01:01.675 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-17T03:00:59.715183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555439,"statfs":{"total":1600000000,"available":1592770180,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.846670"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902067+0000","last_change":"2024-09-17T03:00:53.888863+0000","last_active":"2024-09-17T03:00:54.902067+0000","last_peered":"2024-09-17T03:00:54.902067+0000","last_clean":"2024-09-17T03:00:54.902067+0000","last_became_active":"2024-09-17T03:00:53.888491+0000","last_became_peered":"2024-09-17T03:00:53.888491+0000","last_unstale":"2024-09-17T03:00:54.902067+0000","last_undegraded":"2024-09-17T03:00:54.902067+0000","last_fullsized":"2024-09-17T03:00:54.902067+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:11.017578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872009+0000","last_change":"2024-09-17T03:00:53.884012+0000","last_active":"2024-09-17T03:00:54.872009+0000","last_peered":"2024-09-17T03:00:54.872009+0000","last_clean":"2024-09-17T03:00:54.872009+0000","last_became_active":"2024-09-17T03:00:53.883647+0000","last_became_peered":"2024-09-17T03:00:53.883647+0000","last_unstale":"2024-09-17T03:00:54.872009+0000","last_undegraded":"2024-09-17T03:00:54.872009+0000","last_fullsized":"2024-09-17T03:00:54.872009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:01.358039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901553+0000","last_change":"2024-09-17T03:00:53.887551+0000","last_active":"2024-09-17T03:00:54.901553+0000","last_peered":"2024-09-17T03:00:54.901553+0000","last_clean":"2024-09-17T03:00:54.901553+0000","last_became_active":"2024-09-17T03:00:53.887200+0000","last_became_peered":"2024-09-17T03:00:53.887200+0000","last_unstale":"2024-09-17T03:00:54.901553+0000","last_undegraded":"2024-09-17T03:00:54.901553+0000","last_fullsized":"2024-09-17T03:00:54.901553+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:22.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901617+0000","last_change":"2024-09-17T03:00:53.879671+0000","last_active":"2024-09-17T03:00:54.901617+0000","last_peered":"2024-09-17T03:00:54.901617+0000","last_clean":"2024-09-17T03:00:54.901617+0000","last_became_active":"2024-09-17T03:00:53.879402+0000","last_became_peered":"2024-09-17T03:00:53.879402+0000","last_unstale":"2024-09-17T03:00:54.901617+0000","last_undegraded":"2024-09-17T03:00:54.901617+0000","last_fullsized":"2024-09-17T03:00:54.901617+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:05.353656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902034+0000","last_change":"2024-09-17T03:00:53.879822+0000","last_active":"2024-09-17T03:00:54.902034+0000","last_peered":"2024-09-17T03:00:54.902034+0000","last_clean":"2024-09-17T03:00:54.902034+0000","last_became_active":"2024-09-17T03:00:53.879502+0000","last_became_peered":"2024-09-17T03:00:53.879502+0000","last_unstale":"2024-09-17T03:00:54.902034+0000","last_undegraded":"2024-09-17T03:00:54.902034+0000","last_fullsized":"2024-09-17T03:00:54.902034+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:19.943127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902096+0000","last_change":"2024-09-17T03:00:53.885297+0000","last_active":"2024-09-17T03:00:54.902096+0000","last_peered":"2024-09-17T03:00:54.902096+0000","last_clean":"2024-09-17T03:00:54.902096+0000","last_became_active":"2024-09-17T03:00:53.884139+0000","last_became_peered":"2024-09-17T03:00:53.884139+0000","last_unstale":"2024-09-17T03:00:54.902096+0000","last_undegraded":"2024-09-17T03:00:54.902096+0000","last_fullsized":"2024-09-17T03:00:54.902096+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:27.771567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891933+0000","last_change":"2024-09-17T03:00:53.874350+0000","last_active":"2024-09-17T03:00:54.891933+0000","last_peered":"2024-09-17T03:00:54.891933+0000","last_clean":"2024-09-17T03:00:54.891933+0000","last_became_active":"2024-09-17T03:00:53.873831+0000","last_became_peered":"2024-09-17T03:00:53.873831+0000","last_unstale":"2024-09-17T03:00:54.891933+0000","last_undegraded":"2024-09-17T03:00:54.891933+0000","last_fullsized":"2024-09-17T03:00:54.891933+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:47.988165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901782+0000","last_change":"2024-09-17T03:00:53.885255+0000","last_active":"2024-09-17T03:00:54.901782+0000","last_peered":"2024-09-17T03:00:54.901782+0000","last_clean":"2024-09-17T03:00:54.901782+0000","last_became_active":"2024-09-17T03:00:53.884009+0000","last_became_peered":"2024-09-17T03:00:53.884009+0000","last_unstale":"2024-09-17T03:00:54.901782+0000","last_undegraded":"2024-09-17T03:00:54.901782+0000","last_fullsized":"2024-09-17T03:00:54.901782+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:19.012424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902789+0000","last_change":"2024-09-17T03:00:53.880249+0000","last_active":"2024-09-17T03:00:54.902789+0000","last_peered":"2024-09-17T03:00:54.902789+0000","last_clean":"2024-09-17T03:00:54.902789+0000","last_became_active":"2024-09-17T03:00:53.879996+0000","last_became_peered":"2024-09-17T03:00:53.879996+0000","last_unstale":"2024-09-17T03:00:54.902789+0000","last_undegraded":"2024-09-17T03:00:54.902789+0000","last_fullsized":"2024-09-17T03:00:54.902789+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:31.776461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901684+0000","last_change":"2024-09-17T03:00:53.886351+0000","last_active":"2024-09-17T03:00:54.901684+0000","last_peered":"2024-09-17T03:00:54.901684+0000","last_clean":"2024-09-17T03:00:54.901684+0000","last_became_active":"2024-09-17T03:00:53.885986+0000","last_became_peered":"2024-09-17T03:00:53.885986+0000","last_unstale":"2024-09-17T03:00:54.901684+0000","last_undegraded":"2024-09-17T03:00:54.901684+0000","last_fullsized":"2024-09-17T03:00:54.901684+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:26:55.149194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872965+0000","last_change":"2024-09-17T03:00:53.890035+0000","last_active":"2024-09-17T03:00:54.872965+0000","last_peered":"2024-09-17T03:00:54.872965+0000","last_clean":"2024-09-17T03:00:54.872965+0000","last_became_active":"2024-09-17T03:00:53.889750+0000","last_became_peered":"2024-09-17T03:00:53.889750+0000","last_unstale":"2024-09-17T03:00:54.872965+0000","last_undegraded":"2024-09-17T03:00:54.872965+0000","last_fullsized":"2024-09-17T03:00:54.872965+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:53.386287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902722+0000","last_change":"2024-09-17T03:00:53.886840+0000","last_active":"2024-09-17T03:00:54.902722+0000","last_peered":"2024-09-17T03:00:54.902722+0000","last_clean":"2024-09-17T03:00:54.902722+0000","last_became_active":"2024-09-17T03:00:53.884247+0000","last_became_peered":"2024-09-17T03:00:53.884247+0000","last_unstale":"2024-09-17T03:00:54.902722+0000","last_undegraded":"2024-09-17T03:00:54.902722+0000","last_fullsized":"2024-09-17T03:00:54.902722+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:01.976720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901952+0000","last_change":"2024-09-17T03:00:53.885581+0000","last_active":"2024-09-17T03:00:54.901952+0000","last_peered":"2024-09-17T03:00:54.901952+0000","last_clean":"2024-09-17T03:00:54.901952+0000","last_became_active":"2024-09-17T03:00:53.884784+0000","last_became_peered":"2024-09-17T03:00:53.884784+0000","last_unstale":"2024-09-17T03:00:54.901952+0000","last_undegraded":"2024-09-17T03:00:54.901952+0000","last_fullsized":"2024-09-17T03:00:54.901952+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:10.994396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901459+0000","last_change":"2024-09-17T03:00:53.884108+0000","last_active":"2024-09-17T03:00:54.901459+0000","last_peered":"2024-09-17T03:00:54.901459+0000","last_clean":"2024-09-17T03:00:54.901459+0000","last_became_active":"2024-09-17T03:00:53.882917+0000","last_became_peered":"2024-09-17T03:00:53.882917+0000","last_unstale":"2024-09-17T03:00:54.901459+0000","last_undegraded":"2024-09-17T03:00:54.901459+0000","last_fullsized":"2024-09-17T03:00:54.901459+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:25.240996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902233+0000","last_change":"2024-09-17T03:00:53.883334+0000","last_active":"2024-09-17T03:00:54.902233+0000","last_peered":"2024-09-17T03:00:54.902233+0000","last_clean":"2024-09-17T03:00:54.902233+0000","last_became_active":"2024-09-17T03:00:53.883084+0000","last_became_peered":"2024-09-17T03:00:53.883084+0000","last_unstale":"2024-09-17T03:00:54.902233+0000","last_undegraded":"2024-09-17T03:00:54.902233+0000","last_fullsized":"2024-09-17T03:00:54.902233+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:12.042801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902291+0000","last_change":"2024-09-17T03:00:53.886857+0000","last_active":"2024-09-17T03:00:54.902291+0000","last_peered":"2024-09-17T03:00:54.902291+0000","last_clean":"2024-09-17T03:00:54.902291+0000","last_became_active":"2024-09-17T03:00:53.886604+0000","last_became_peered":"2024-09-17T03:00:53.886604+0000","last_unstale":"2024-09-17T03:00:54.902291+0000","last_undegraded":"2024-09-17T03:00:54.902291+0000","last_fullsized":"2024-09-17T03:00:54.902291+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:27.969831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872266+0000","last_change":"2024-09-17T03:00:53.887705+0000","last_active":"2024-09-17T03:00:54.872266+0000","last_peered":"2024-09-17T03:00:54.872266+0000","last_clean":"2024-09-17T03:00:54.872266+0000","last_became_active":"2024-09-17T03:00:53.887427+0000","last_became_peered":"2024-09-17T03:00:53.887427+0000","last_unstale":"2024-09-17T03:00:54.872266+0000","last_undegraded":"2024-09-17T03:00:54.872266+0000","last_fullsized":"2024-09-17T03:00:54.872266+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:25.788837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.871690+0000","last_change":"2024-09-17T03:00:53.881359+0000","last_active":"2024-09-17T03:00:54.871690+0000","last_peered":"2024-09-17T03:00:54.871690+0000","last_clean":"2024-09-17T03:00:54.871690+0000","last_became_active":"2024-09-17T03:00:53.879738+0000","last_became_peered":"2024-09-17T03:00:53.879738+0000","last_unstale":"2024-09-17T03:00:54.871690+0000","last_undegraded":"2024-09-17T03:00:54.871690+0000","last_fullsized":"2024-09-17T03:00:54.871690+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:22:02.727956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901729+0000","last_change":"2024-09-17T03:00:53.878913+0000","last_active":"2024-09-17T03:00:54.901729+0000","last_peered":"2024-09-17T03:00:54.901729+0000","last_clean":"2024-09-17T03:00:54.901729+0000","last_became_active":"2024-09-17T03:00:53.877926+0000","last_became_peered":"2024-09-17T03:00:53.877926+0000","last_unstale":"2024-09-17T03:00:54.901729+0000","last_undegraded":"2024-09-17T03:00:54.901729+0000","last_fullsized":"2024-09-17T03:00:54.901729+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:11.371371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873164+0000","last_change":"2024-09-17T03:00:53.881960+0000","last_active":"2024-09-17T03:00:54.873164+0000","last_peered":"2024-09-17T03:00:54.873164+0000","last_clean":"2024-09-17T03:00:54.873164+0000","last_became_active":"2024-09-17T03:00:53.881629+0000","last_became_peered":"2024-09-17T03:00:53.881629+0000","last_unstale":"2024-09-17T03:00:54.873164+0000","last_undegraded":"2024-09-17T03:00:54.873164+0000","last_fullsized":"2024-09-17T03:00:54.873164+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:54.625991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873196+0000","last_change":"2024-09-17T03:00:53.879711+0000","last_active":"2024-09-17T03:00:54.873196+0000","last_peered":"2024-09-17T03:00:54.873196+0000","last_clean":"2024-09-17T03:00:54.873196+0000","last_became_active":"2024-09-17T03:00:53.879272+0000","last_became_peered":"2024-09-17T03:00:53.879272+0000","last_unstale":"2024-09-17T03:00:54.873196+0000","last_undegraded":"2024-09-17T03:00:54.873196+0000","last_fullsized":"2024-09-17T03:00:54.873196+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:39.464424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873229+0000","last_change":"2024-09-17T03:00:53.882035+0000","last_active":"2024-09-17T03:00:54.873229+0000","last_peered":"2024-09-17T03:00:54.873229+0000","last_clean":"2024-09-17T03:00:54.873229+0000","last_became_active":"2024-09-17T03:00:53.881768+0000","last_became_peered":"2024-09-17T03:00:53.881768+0000","last_unstale":"2024-09-17T03:00:54.873229+0000","last_undegraded":"2024-09-17T03:00:54.873229+0000","last_fullsized":"2024-09-17T03:00:54.873229+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:50.049352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872971+0000","last_change":"2024-09-17T03:00:53.891262+0000","last_active":"2024-09-17T03:00:54.872971+0000","last_peered":"2024-09-17T03:00:54.872971+0000","last_clean":"2024-09-17T03:00:54.872971+0000","last_became_active":"2024-09-17T03:00:53.890786+0000","last_became_peered":"2024-09-17T03:00:53.890786+0000","last_unstale":"2024-09-17T03:00:54.872971+0000","last_undegraded":"2024-09-17T03:00:54.872971+0000","last_fullsized":"2024-09-17T03:00:54.872971+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:04.694227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873232+0000","last_change":"2024-09-17T03:00:53.884196+0000","last_active":"2024-09-17T03:00:54.873232+0000","last_peered":"2024-09-17T03:00:54.873232+0000","last_clean":"2024-09-17T03:00:54.873232+0000","last_became_active":"2024-09-17T03:00:53.881939+0000","last_became_peered":"2024-09-17T03:00:53.881939+0000","last_unstale":"2024-09-17T03:00:54.873232+0000","last_undegraded":"2024-09-17T03:00:54.873232+0000","last_fullsized":"2024-09-17T03:00:54.873232+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:11.880929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873433+0000","last_change":"2024-09-17T03:00:53.889020+0000","last_active":"2024-09-17T03:00:54.873433+0000","last_peered":"2024-09-17T03:00:54.873433+0000","last_clean":"2024-09-17T03:00:54.873433+0000","last_became_active":"2024-09-17T03:00:53.888677+0000","last_became_peered":"2024-09-17T03:00:53.888677+0000","last_unstale":"2024-09-17T03:00:54.873433+0000","last_undegraded":"2024-09-17T03:00:54.873433+0000","last_fullsized":"2024-09-17T03:00:54.873433+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:52.922786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902604+0000","last_change":"2024-09-17T03:00:53.885807+0000","last_active":"2024-09-17T03:00:54.902604+0000","last_peered":"2024-09-17T03:00:54.902604+0000","last_clean":"2024-09-17T03:00:54.902604+0000","last_became_active":"2024-09-17T03:00:53.885208+0000","last_became_peered":"2024-09-17T03:00:53.885208+0000","last_unstale":"2024-09-17T03:00:54.902604+0000","last_undegraded":"2024-09-17T03:00:54.902604+0000","last_fullsized":"2024-09-17T03:00:54.902604+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:25.188203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901716+0000","last_change":"2024-09-17T03:00:53.889596+0000","last_active":"2024-09-17T03:00:54.901716+0000","last_peered":"2024-09-17T03:00:54.901716+0000","last_clean":"2024-09-17T03:00:54.901716+0000","last_became_active":"2024-09-17T03:00:53.889287+0000","last_became_peered":"2024-09-17T03:00:53.889287+0000","last_unstale":"2024-09-17T03:00:54.901716+0000","last_undegraded":"2024-09-17T03:00:54.901716+0000","last_fullsized":"2024-09-17T03:00:54.901716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:50.109812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873239+0000","last_change":"2024-09-17T03:00:53.882356+0000","last_active":"2024-09-17T03:00:54.873239+0000","last_peered":"2024-09-17T03:00:54.873239+0000","last_clean":"2024-09-17T03:00:54.873239+0000","last_became_active":"2024-09-17T03:00:53.882102+0000","last_became_peered":"2024-09-17T03:00:53.882102+0000","last_unstale":"2024-09-17T03:00:54.873239+0000","last_undegraded":"2024-09-17T03:00:54.873239+0000","last_fullsized":"2024-09-17T03:00:54.873239+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:43.120613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.871880+0000","last_change":"2024-09-17T03:00:53.882946+0000","last_active":"2024-09-17T03:00:54.871880+0000","last_peered":"2024-09-17T03:00:54.871880+0000","last_clean":"2024-09-17T03:00:54.871880+0000","last_became_active":"2024-09-17T03:00:53.882577+0000","last_became_peered":"2024-09-17T03:00:53.882577+0000","last_unstale":"2024-09-17T03:00:54.871880+0000","last_undegraded":"2024-09-17T03:00:54.871880+0000","last_fullsized":"2024-09-17T03:00:54.871880+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:46.728487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891531+0000","last_change":"2024-09-17T03:00:53.878517+0000","last_active":"2024-09-17T03:00:54.891531+0000","last_peered":"2024-09-17T03:00:54.891531+0000","last_clean":"2024-09-17T03:00:54.891531+0000","last_became_active":"2024-09-17T03:00:53.878177+0000","last_became_peered":"2024-09-17T03:00:53.878177+0000","last_unstale":"2024-09-17T03:00:54.891531+0000","last_undegraded":"2024-09-17T03:00:54.891531+0000","last_fullsized":"2024-09-17T03:00:54.891531+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:28.624034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902755+0000","last_change":"2024-09-17T03:00:53.886239+0000","last_active":"2024-09-17T03:00:54.902755+0000","last_peered":"2024-09-17T03:00:54.902755+0000","last_clean":"2024-09-17T03:00:54.902755+0000","last_became_active":"2024-09-17T03:00:53.885552+0000","last_became_peered":"2024-09-17T03:00:53.885552+0000","last_unstale":"2024-09-17T03:00:54.902755+0000","last_undegraded":"2024-09-17T03:00:54.902755+0000","last_fullsized":"2024-09-17T03:00:54.902755+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:59.368295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902019+0000","last_change":"2024-09-17T03:00:53.882483+0000","last_active":"2024-09-17T03:00:54.902019+0000","last_peered":"2024-09-17T03:00:54.902019+0000","last_clean":"2024-09-17T03:00:54.902019+0000","last_became_active":"2024-09-17T03:00:53.882211+0000","last_became_peered":"2024-09-17T03:00:53.882211+0000","last_unstale":"2024-09-17T03:00:54.902019+0000","last_undegraded":"2024-09-17T03:00:54.902019+0000","last_fullsized":"2024-09-17T03:00:54.902019+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:25.815247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901412+0000","last_change":"2024-09-17T03:00:53.884625+0000","last_active":"2024-09-17T03:00:54.901412+0000","last_peered":"2024-09-17T03:00:54.901412+0000","last_clean":"2024-09-17T03:00:54.901412+0000","last_became_active":"2024-09-17T03:00:53.884388+0000","last_became_peered":"2024-09-17T03:00:53.884388+0000","last_unstale":"2024-09-17T03:00:54.901412+0000","last_undegraded":"2024-09-17T03:00:54.901412+0000","last_fullsized":"2024-09-17T03:00:54.901412+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:14.740350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"136'4","reported_seq":19,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891566+0000","last_change":"2024-09-17T03:00:52.878170+0000","last_active":"2024-09-17T03:00:54.891566+0000","last_peered":"2024-09-17T03:00:54.891566+0000","last_clean":"2024-09-17T03:00:54.891566+0000","last_became_active":"2024-09-17T03:00:52.877899+0000","last_became_peered":"2024-09-17T03:00:52.877899+0000","last_unstale":"2024-09-17T03:00:54.891566+0000","last_undegraded":"2024-09-17T03:00:54.891566+0000","last_fullsized":"2024-09-17T03:00:54.891566+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:29.489522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872015+0000","last_change":"2024-09-17T03:00:53.882062+0000","last_active":"2024-09-17T03:00:54.872015+0000","last_peered":"2024-09-17T03:00:54.872015+0000","last_clean":"2024-09-17T03:00:54.872015+0000","last_became_active":"2024-09-17T03:00:53.881780+0000","last_became_peered":"2024-09-17T03:00:53.881780+0000","last_unstale":"2024-09-17T03:00:54.872015+0000","last_undegraded":"2024-09-17T03:00:54.872015+0000","last_fullsized":"2024-09-17T03:00:54.872015+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:25:02.871279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902136+0000","last_change":"2024-09-17T03:00:52.877565+0000","last_active":"2024-09-17T03:00:54.902136+0000","last_peered":"2024-09-17T03:00:54.902136+0000","last_clean":"2024-09-17T03:00:54.902136+0000","last_became_active":"2024-09-17T03:00:52.876815+0000","last_became_peered":"2024-09-17T03:00:52.876815+0000","last_unstale":"2024-09-17T03:00:54.902136+0000","last_undegraded":"2024-09-17T03:00:54.902136+0000","last_fullsized":"2024-09-17T03:00:54.902136+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:48.045380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902298+0000","last_change":"2024-09-17T03:00:53.884955+0000","last_active":"2024-09-17T03:00:54.902298+0000","last_peered":"2024-09-17T03:00:54.902298+0000","last_clean":"2024-09-17T03:00:54.902298+0000","last_became_active":"2024-09-17T03:00:53.883807+0000","last_became_peered":"2024-09-17T03:00:53.883807+0000","last_unstale":"2024-09-17T03:00:54.902298+0000","last_undegraded":"2024-09-17T03:00:54.902298+0000","last_fullsized":"2024-09-17T03:00:54.902298+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:57.073309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902462+0000","last_change":"2024-09-17T03:00:52.880815+0000","last_active":"2024-09-17T03:00:54.902462+0000","last_peered":"2024-09-17T03:00:54.902462+0000","last_clean":"2024-09-17T03:00:54.902462+0000","last_became_active":"2024-09-17T03:00:52.880573+0000","last_became_peered":"2024-09-17T03:00:52.880573+0000","last_unstale":"2024-09-17T03:00:54.902462+0000","last_undegraded":"2024-09-17T03:00:54.902462+0000","last_fullsized":"2024-09-17T03:00:54.902462+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:34.773468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901740+0000","last_change":"2024-09-17T03:00:53.878726+0000","last_active":"2024-09-17T03:00:54.901740+0000","last_peered":"2024-09-17T03:00:54.901740+0000","last_clean":"2024-09-17T03:00:54.901740+0000","last_became_active":"2024-09-17T03:00:53.877886+0000","last_became_peered":"2024-09-17T03:00:53.877886+0000","last_unstale":"2024-09-17T03:00:54.901740+0000","last_undegraded":"2024-09-17T03:00:54.901740+0000","last_fullsized":"2024-09-17T03:00:54.901740+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:18.665613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901736+0000","last_change":"2024-09-17T03:00:52.880035+0000","last_active":"2024-09-17T03:00:54.901736+0000","last_peered":"2024-09-17T03:00:54.901736+0000","last_clean":"2024-09-17T03:00:54.901736+0000","last_became_active":"2024-09-17T03:00:52.879118+0000","last_became_peered":"2024-09-17T03:00:52.879118+0000","last_unstale":"2024-09-17T03:00:54.901736+0000","last_undegraded":"2024-09-17T03:00:54.901736+0000","last_fullsized":"2024-09-17T03:00:54.901736+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:27.131759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902533+0000","last_change":"2024-09-17T03:00:53.881447+0000","last_active":"2024-09-17T03:00:54.902533+0000","last_peered":"2024-09-17T03:00:54.902533+0000","last_clean":"2024-09-17T03:00:54.902533+0000","last_became_active":"2024-09-17T03:00:53.881163+0000","last_became_peered":"2024-09-17T03:00:53.881163+0000","last_unstale":"2024-09-17T03:00:54.902533+0000","last_undegraded":"2024-09-17T03:00:54.902533+0000","last_fullsized":"2024-09-17T03:00:54.902533+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:20.352921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891680+0000","last_change":"2024-09-17T03:00:52.880915+0000","last_active":"2024-09-17T03:00:54.891680+0000","last_peered":"2024-09-17T03:00:54.891680+0000","last_clean":"2024-09-17T03:00:54.891680+0000","last_became_active":"2024-09-17T03:00:52.880612+0000","last_became_peered":"2024-09-17T03:00:52.880612+0000","last_unstale":"2024-09-17T03:00:54.891680+0000","last_undegraded":"2024-09-17T03:00:54.891680+0000","last_fullsized":"2024-09-17T03:00:54.891680+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:02.645302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872514+0000","last_change":"2024-09-17T03:00:53.882547+0000","last_active":"2024-09-17T03:00:54.872514+0000","last_peered":"2024-09-17T03:00:54.872514+0000","last_clean":"2024-09-17T03:00:54.872514+0000","last_became_active":"2024-09-17T03:00:53.881299+0000","last_became_peered":"2024-09-17T03:00:53.881299+0000","last_unstale":"2024-09-17T03:00:54.872514+0000","last_undegraded":"2024-09-17T03:00:54.872514+0000","last_fullsized":"2024-09-17T03:00:54.872514+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:55.582818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873623+0000","last_change":"2024-09-17T03:00:52.879515+0000","last_active":"2024-09-17T03:00:54.873623+0000","last_peered":"2024-09-17T03:00:54.873623+0000","last_clean":"2024-09-17T03:00:54.873623+0000","last_became_active":"2024-09-17T03:00:52.879055+0000","last_became_peered":"2024-09-17T03:00:52.879055+0000","last_unstale":"2024-09-17T03:00:54.873623+0000","last_undegraded":"2024-09-17T03:00:54.873623+0000","last_fullsized":"2024-09-17T03:00:54.873623+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:44.763569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901913+0000","last_change":"2024-09-17T03:00:53.889036+0000","last_active":"2024-09-17T03:00:54.901913+0000","last_peered":"2024-09-17T03:00:54.901913+0000","last_clean":"2024-09-17T03:00:54.901913+0000","last_became_active":"2024-09-17T03:00:53.888750+0000","last_became_peered":"2024-09-17T03:00:53.888750+0000","last_unstale":"2024-09-17T03:00:54.901913+0000","last_undegraded":"2024-09-17T03:00:54.901913+0000","last_fullsized":"2024-09-17T03:00:54.901913+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:01.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872024+0000","last_change":"2024-09-17T03:00:52.884070+0000","last_active":"2024-09-17T03:00:54.872024+0000","last_peered":"2024-09-17T03:00:54.872024+0000","last_clean":"2024-09-17T03:00:54.872024+0000","last_became_active":"2024-09-17T03:00:52.883899+0000","last_became_peered":"2024-09-17T03:00:52.883899+0000","last_unstale":"2024-09-17T03:00:54.872024+0000","last_undegraded":"2024-09-17T03:00:54.872024+0000","last_fullsized":"2024-09-17T03:00:54.872024+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:36.368513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891372+0000","last_change":"2024-09-17T03:00:53.874335+0000","last_active":"2024-09-17T03:00:54.891372+0000","last_peered":"2024-09-17T03:00:54.891372+0000","last_clean":"2024-09-17T03:00:54.891372+0000","last_became_active":"2024-09-17T03:00:53.874058+0000","last_became_peered":"2024-09-17T03:00:53.874058+0000","last_unstale":"2024-09-17T03:00:54.891372+0000","last_undegraded":"2024-09-17T03:00:54.891372+0000","last_fullsized":"2024-09-17T03:00:54.891372+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:48.857232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902330+0000","last_change":"2024-09-17T03:00:52.881468+0000","last_active":"2024-09-17T03:00:54.902330+0000","last_peered":"2024-09-17T03:00:54.902330+0000","last_clean":"2024-09-17T03:00:54.902330+0000","last_became_active":"2024-09-17T03:00:52.880508+0000","last_became_peered":"2024-09-17T03:00:52.880508+0000","last_unstale":"2024-09-17T03:00:54.902330+0000","last_undegraded":"2024-09-17T03:00:54.902330+0000","last_fullsized":"2024-09-17T03:00:54.902330+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:13.909992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891526+0000","last_change":"2024-09-17T03:00:53.873265+0000","last_active":"2024-09-17T03:00:54.891526+0000","last_peered":"2024-09-17T03:00:54.891526+0000","last_clean":"2024-09-17T03:00:54.891526+0000","last_became_active":"2024-09-17T03:00:53.872966+0000","last_became_peered":"2024-09-17T03:00:53.872966+0000","last_unstale":"2024-09-17T03:00:54.891526+0000","last_undegraded":"2024-09-17T03:00:54.891526+0000","last_fullsized":"2024-09-17T03:00:54.891526+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:10.568493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901844+0000","last_change":"2024-09-17T03:00:52.880765+0000","last_active":"2024-09-17T03:00:54.901844+0000","last_peered":"2024-09-17T03:00:54.901844+0000","last_clean":"2024-09-17T03:00:54.901844+0000","last_became_active":"2024-09-17T03:00:52.879777+0000","last_became_peered":"2024-09-17T03:00:52.879777+0000","last_unstale":"2024-09-17T03:00:54.901844+0000","last_undegraded":"2024-09-17T03:00:54.901844+0000","last_fullsized":"2024-09-17T03:00:54.901844+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:47.506315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872217+0000","last_change":"2024-09-17T03:00:53.889264+0000","last_active":"2024-09-17T03:00:54.872217+0000","last_peered":"2024-09-17T03:00:54.872217+0000","last_clean":"2024-09-17T03:00:54.872217+0000","last_became_active":"2024-09-17T03:00:53.888922+0000","last_became_peered":"2024-09-17T03:00:53.888922+0000","last_unstale":"2024-09-17T03:00:54.872217+0000","last_undegraded":"2024-09-17T03:00:54.872217+0000","last_fullsized":"2024-09-17T03:00:54.872217+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:16.474422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873593+0000","last_change":"2024-09-17T03:00:52.875996+0000","last_active":"2024-09-17T03:00:54.873593+0000","last_peered":"2024-09-17T03:00:54.873593+0000","last_clean":"2024-09-17T03:00:54.873593+0000","last_became_active":"2024-09-17T03:00:52.875718+0000","last_became_peered":"2024-09-17T03:00:52.875718+0000","last_unstale":"2024-09-17T03:00:54.873593+0000","last_undegraded":"2024-09-17T03:00:54.873593+0000","last_fullsized":"2024-09-17T03:00:54.873593+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:36.736041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873477+0000","last_change":"2024-09-17T03:00:53.887970+0000","last_active":"2024-09-17T03:00:54.873477+0000","last_peered":"2024-09-17T03:00:54.873477+0000","last_clean":"2024-09-17T03:00:54.873477+0000","last_became_active":"2024-09-17T03:00:53.887658+0000","last_became_peered":"2024-09-17T03:00:53.887658+0000","last_unstale":"2024-09-17T03:00:54.873477+0000","last_undegraded":"2024-09-17T03:00:54.873477+0000","last_fullsized":"2024-09-17T03:00:54.873477+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:46.637328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"136'3","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903262+0000","last_change":"2024-09-17T03:00:52.886525+0000","last_active":"2024-09-17T03:00:54.903262+0000","last_peered":"2024-09-17T03:00:54.903262+0000","last_clean":"2024-09-17T03:00:54.903262+0000","last_became_active":"2024-09-17T03:00:52.885317+0000","last_became_peered":"2024-09-17T03:00:52.885317+0000","last_unstale":"2024-09-17T03:00:54.903262+0000","last_undegraded":"2024-09-17T03:00:54.903262+0000","last_fullsized":"2024-09-17T03:00:54.903262+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:33.701860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891374+0000","last_change":"2024-09-17T03:00:53.882046+0000","last_active":"2024-09-17T03:00:54.891374+0000","last_peered":"2024-09-17T03:00:54.891374+0000","last_clean":"2024-09-17T03:00:54.891374+0000","last_became_active":"2024-09-17T03:00:53.881759+0000","last_became_peered":"2024-09-17T03:00:53.881759+0000","last_unstale":"2024-09-17T03:00:54.891374+0000","last_undegraded":"2024-09-17T03:00:54.891374+0000","last_fullsized":"2024-09-17T03:00:54.891374+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:21.913882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"136'6","reported_seq":21,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903059+0000","last_change":"2024-09-17T03:00:52.885857+0000","last_active":"2024-09-17T03:00:54.903059+0000","last_peered":"2024-09-17T03:00:54.903059+0000","last_clean":"2024-09-17T03:00:54.903059+0000","last_became_active":"2024-09-17T03:00:52.884895+0000","last_became_peered":"2024-09-17T03:00:52.884895+0000","last_unstale":"2024-09-17T03:00:54.903059+0000","last_undegraded":"2024-09-17T03:00:54.903059+0000","last_fullsized":"2024-09-17T03:00:54.903059+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:01.004488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873520+0000","last_change":"2024-09-17T03:00:53.878919+0000","last_active":"2024-09-17T03:00:54.873520+0000","last_peered":"2024-09-17T03:00:54.873520+0000","last_clean":"2024-09-17T03:00:54.873520+0000","last_became_active":"2024-09-17T03:00:53.878662+0000","last_became_peered":"2024-09-17T03:00:53.878662+0000","last_unstale":"2024-09-17T03:00:54.873520+0000","last_undegraded":"2024-09-17T03:00:54.873520+0000","last_fullsized":"2024-09-17T03:00:54.873520+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:28.559523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902486+0000","last_change":"2024-09-17T03:00:52.880779+0000","last_active":"2024-09-17T03:00:54.902486+0000","last_peered":"2024-09-17T03:00:54.902486+0000","last_clean":"2024-09-17T03:00:54.902486+0000","last_became_active":"2024-09-17T03:00:52.880491+0000","last_became_peered":"2024-09-17T03:00:52.880491+0000","last_unstale":"2024-09-17T03:00:54.902486+0000","last_undegraded":"2024-09-17T03:00:54.902486+0000","last_fullsized":"2024-09-17T03:00:54.902486+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:54.359896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873524+0000","last_change":"2024-09-17T03:00:53.881248+0000","last_active":"2024-09-17T03:00:54.873524+0000","last_peered":"2024-09-17T03:00:54.873524+0000","last_clean":"2024-09-17T03:00:54.873524+0000","last_became_active":"2024-09-17T03:00:53.880303+0000","last_became_peered":"2024-09-17T03:00:53.880303+0000","last_unstale":"2024-09-17T03:00:54.873524+0000","last_undegraded":"2024-09-17T03:00:54.873524+0000","last_fullsized":"2024-09-17T03:00:54.873524+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:37.750607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872351+0000","last_change":"2024-09-17T03:00:52.882158+0000","last_active":"2024-09-17T03:00:54.872351+0000","last_peered":"2024-09-17T03:00:54.872351+0000","last_clean":"2024-09-17T03:00:54.872351+0000","last_became_active":"2024-09-17T03:00:52.881597+0000","last_became_peered":"2024-09-17T03:00:52.881597+0000","last_unstale":"2024-09-17T03:00:54.872351+0000","last_undegraded":"2024-09-17T03:00:54.872351+0000","last_fullsized":"2024-09-17T03:00:54.872351+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:37.098133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873483+0000","last_change":"2024-09-17T03:00:53.887594+0000","last_active":"2024-09-17T03:00:54.873483+0000","last_peered":"2024-09-17T03:00:54.873483+0000","last_clean":"2024-09-17T03:00:54.873483+0000","last_became_active":"2024-09-17T03:00:53.887302+0000","last_became_peered":"2024-09-17T03:00:53.887302+0000","last_unstale":"2024-09-17T03:00:54.873483+0000","last_undegraded":"2024-09-17T03:00:54.873483+0000","last_fullsized":"2024-09-17T03:00:54.873483+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:07.116260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":23,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901725+0000","last_change":"2024-09-17T03:00:52.877431+0000","last_active":"2024-09-17T03:00:54.901725+0000","last_peered":"2024-09-17T03:00:54.901725+0000","last_clean":"2024-09-17T03:00:54.901725+0000","last_became_active":"2024-09-17T03:00:52.876828+0000","last_became_peered":"2024-09-17T03:00:52.876828+0000","last_unstale":"2024-09-17T03:00:54.901725+0000","last_undegraded":"2024-09-17T03:00:54.901725+0000","last_fullsized":"2024-09-17T03:00:54.901725+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:37.176604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902256+0000","last_change":"2024-09-17T03:00:53.884402+0000","last_active":"2024-09-17T03:00:54.902256+0000","last_peered":"2024-09-17T03:00:54.902256+0000","last_clean":"2024-09-17T03:00:54.902256+0000","last_became_active":"2024-09-17T03:00:53.884134+0000","last_became_peered":"2024-09-17T03:00:53.884134+0000","last_unstale":"2024-09-17T03:00:54.902256+0000","last_undegraded":"2024-09-17T03:00:54.902256+0000","last_fullsized":"2024-09-17T03:00:54.902256+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:40.868357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903161+0000","last_change":"2024-09-17T03:00:52.879989+0000","last_active":"2024-09-17T03:00:54.903161+0000","last_peered":"2024-09-17T03:00:54.903161+0000","last_clean":"2024-09-17T03:00:54.903161+0000","last_became_active":"2024-09-17T03:00:52.878876+0000","last_became_peered":"2024-09-17T03:00:52.878876+0000","last_unstale":"2024-09-17T03:00:54.903161+0000","last_undegraded":"2024-09-17T03:00:54.903161+0000","last_fullsized":"2024-09-17T03:00:54.903161+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:06.587131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901646+0000","last_change":"2024-09-17T03:00:53.889370+0000","last_active":"2024-09-17T03:00:54.901646+0000","last_peered":"2024-09-17T03:00:54.901646+0000","last_clean":"2024-09-17T03:00:54.901646+0000","last_became_active":"2024-09-17T03:00:53.889096+0000","last_became_peered":"2024-09-17T03:00:53.889096+0000","last_unstale":"2024-09-17T03:00:54.901646+0000","last_undegraded":"2024-09-17T03:00:54.901646+0000","last_fullsized":"2024-09-17T03:00:54.901646+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:52.603670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902575+0000","last_change":"2024-09-17T03:00:52.875812+0000","last_active":"2024-09-17T03:00:54.902575+0000","last_peered":"2024-09-17T03:00:54.902575+0000","last_clean":"2024-09-17T03:00:54.902575+0000","last_became_active":"2024-09-17T03:00:52.875470+0000","last_became_peered":"2024-09-17T03:00:52.875470+0000","last_unstale":"2024-09-17T03:00:54.902575+0000","last_undegraded":"2024-09-17T03:00:54.902575+0000","last_fullsized":"2024-09-17T03:00:54.902575+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:25.606689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901403+0000","last_change":"2024-09-17T03:00:53.886903+0000","last_active":"2024-09-17T03:00:54.901403+0000","last_peered":"2024-09-17T03:00:54.901403+0000","last_clean":"2024-09-17T03:00:54.901403+0000","last_became_active":"2024-09-17T03:00:53.886603+0000","last_became_peered":"2024-09-17T03:00:53.886603+0000","last_unstale":"2024-09-17T03:00:54.901403+0000","last_undegraded":"2024-09-17T03:00:54.901403+0000","last_fullsized":"2024-09-17T03:00:54.901403+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:57.290259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"136'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872485+0000","last_change":"2024-09-17T03:00:52.877913+0000","last_active":"2024-09-17T03:00:54.872485+0000","last_peered":"2024-09-17T03:00:54.872485+0000","last_clean":"2024-09-17T03:00:54.872485+0000","last_became_active":"2024-09-17T03:00:52.877633+0000","last_became_peered":"2024-09-17T03:00:52.877633+0000","last_unstale":"2024-09-17T03:00:54.872485+0000","last_undegraded":"2024-09-17T03:00:54.872485+0000","last_fullsized":"2024-09-17T03:00:54.872485+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:52.930031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901476+0000","last_change":"2024-09-17T03:00:53.885263+0000","last_active":"2024-09-17T03:00:54.901476+0000","last_peered":"2024-09-17T03:00:54.901476+0000","last_clean":"2024-09-17T03:00:54.901476+0000","last_became_active":"2024-09-17T03:00:53.884709+0000","last_became_peered":"2024-09-17T03:00:53.884709+0000","last_unstale":"2024-09-17T03:00:54.901476+0000","last_undegraded":"2024-09-17T03:00:54.901476+0000","last_fullsized":"2024-09-17T03:00:54.901476+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:04.315461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.892207+0000","last_change":"2024-09-17T03:00:52.884785+0000","last_active":"2024-09-17T03:00:54.892207+0000","last_peered":"2024-09-17T03:00:54.892207+0000","last_clean":"2024-09-17T03:00:54.892207+0000","last_became_active":"2024-09-17T03:00:52.884333+0000","last_became_peered":"2024-09-17T03:00:52.884333+0000","last_unstale":"2024-09-17T03:00:54.892207+0000","last_undegraded":"2024-09-17T03:00:54.892207+0000","last_fullsized":"2024-09-17T03:00:54.892207+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:12.266482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902061+0000","last_change":"2024-09-17T03:00:53.888558+0000","last_active":"2024-09-17T03:00:54.902061+0000","last_peered":"2024-09-17T03:00:54.902061+0000","last_clean":"2024-09-17T03:00:54.902061+0000","last_became_active":"2024-09-17T03:00:53.888036+0000","last_became_peered":"2024-09-17T03:00:53.888036+0000","last_unstale":"2024-09-17T03:00:54.902061+0000","last_undegraded":"2024-09-17T03:00:54.902061+0000","last_fullsized":"2024-09-17T03:00:54.902061+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:29.247064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902391+0000","last_change":"2024-09-17T03:00:52.882567+0000","last_active":"2024-09-17T03:00:54.902391+0000","last_peered":"2024-09-17T03:00:54.902391+0000","last_clean":"2024-09-17T03:00:54.902391+0000","last_became_active":"2024-09-17T03:00:52.881639+0000","last_became_peered":"2024-09-17T03:00:52.881639+0000","last_unstale":"2024-09-17T03:00:54.902391+0000","last_undegraded":"2024-09-17T03:00:54.902391+0000","last_fullsized":"2024-09-17T03:00:54.902391+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:35.128554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903066+0000","last_change":"2024-09-17T03:00:53.887047+0000","last_active":"2024-09-17T03:00:54.903066+0000","last_peered":"2024-09-17T03:00:54.903066+0000","last_clean":"2024-09-17T03:00:54.903066+0000","last_became_active":"2024-09-17T03:00:53.886438+0000","last_became_peered":"2024-09-17T03:00:53.886438+0000","last_unstale":"2024-09-17T03:00:54.903066+0000","last_undegraded":"2024-09-17T03:00:54.903066+0000","last_fullsized":"2024-09-17T03:00:54.903066+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:30.964407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901447+0000","last_change":"2024-09-17T03:00:52.877467+0000","last_active":"2024-09-17T03:00:54.901447+0000","last_peered":"2024-09-17T03:00:54.901447+0000","last_clean":"2024-09-17T03:00:54.901447+0000","last_became_active":"2024-09-17T03:00:52.877064+0000","last_became_peered":"2024-09-17T03:00:52.877064+0000","last_unstale":"2024-09-17T03:00:54.901447+0000","last_undegraded":"2024-09-17T03:00:54.901447+0000","last_fullsized":"2024-09-17T03:00:54.901447+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:07.901182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901726+0000","last_change":"2024-09-17T03:00:53.884137+0000","last_active":"2024-09-17T03:00:54.901726+0000","last_peered":"2024-09-17T03:00:54.901726+0000","last_clean":"2024-09-17T03:00:54.901726+0000","last_became_active":"2024-09-17T03:00:53.879707+0000","last_became_peered":"2024-09-17T03:00:53.879707+0000","last_unstale":"2024-09-17T03:00:54.901726+0000","last_undegraded":"2024-09-17T03:00:54.901726+0000","last_fullsized":"2024-09-17T03:00:54.901726+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:03.742753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902590+0000","last_change":"2024-09-17T03:00:52.881563+0000","last_active":"2024-09-17T03:00:54.902590+0000","last_peered":"2024-09-17T03:00:54.902590+0000","last_clean":"2024-09-17T03:00:54.902590+0000","last_became_active":"2024-09-17T03:00:52.881211+0000","last_became_peered":"2024-09-17T03:00:52.881211+0000","last_unstale":"2024-09-17T03:00:54.902590+0000","last_undegraded":"2024-09-17T03:00:54.902590+0000","last_fullsized":"2024-09-17T03:00:54.902590+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:25.945976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873742+0000","last_change":"2024-09-17T03:00:53.882092+0000","last_active":"2024-09-17T03:00:54.873742+0000","last_peered":"2024-09-17T03:00:54.873742+0000","last_clean":"2024-09-17T03:00:54.873742+0000","last_became_active":"2024-09-17T03:00:53.881824+0000","last_became_peered":"2024-09-17T03:00:53.881824+0000","last_unstale":"2024-09-17T03:00:54.873742+0000","last_undegraded":"2024-09-17T03:00:54.873742+0000","last_fullsized":"2024-09-17T03:00:54.873742+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:25.919498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902902+0000","last_change":"2024-09-17T03:00:52.886093+0000","last_active":"2024-09-17T03:00:54.902902+0000","last_peered":"2024-09-17T03:00:54.902902+0000","last_clean":"2024-09-17T03:00:54.902902+0000","last_became_active":"2024-09-17T03:00:52.885604+0000","last_became_peered":"2024-09-17T03:00:52.885604+0000","last_unstale":"2024-09-17T03:00:54.902902+0000","last_undegraded":"2024-09-17T03:00:54.902902+0000","last_fullsized":"2024-09-17T03:00:54.902902+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:41.971212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872365+0000","last_change":"2024-09-17T03:00:53.889256+0000","last_active":"2024-09-17T03:00:54.872365+0000","last_peered":"2024-09-17T03:00:54.872365+0000","last_clean":"2024-09-17T03:00:54.872365+0000","last_became_active":"2024-09-17T03:00:53.888985+0000","last_became_peered":"2024-09-17T03:00:53.888985+0000","last_unstale":"2024-09-17T03:00:54.872365+0000","last_undegraded":"2024-09-17T03:00:54.872365+0000","last_fullsized":"2024-09-17T03:00:54.872365+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:45.620241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873726+0000","last_change":"2024-09-17T03:00:52.877017+0000","last_active":"2024-09-17T03:00:54.873726+0000","last_peered":"2024-09-17T03:00:54.873726+0000","last_clean":"2024-09-17T03:00:54.873726+0000","last_became_active":"2024-09-17T03:00:52.876760+0000","last_became_peered":"2024-09-17T03:00:52.876760+0000","last_unstale":"2024-09-17T03:00:54.873726+0000","last_undegraded":"2024-09-17T03:00:54.873726+0000","last_fullsized":"2024-09-17T03:00:54.873726+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:35.600688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902951+0000","last_change":"2024-09-17T03:00:53.888004+0000","last_active":"2024-09-17T03:00:54.902951+0000","last_peered":"2024-09-17T03:00:54.902951+0000","last_clean":"2024-09-17T03:00:54.902951+0000","last_became_active":"2024-09-17T03:00:53.887496+0000","last_became_peered":"2024-09-17T03:00:53.887496+0000","last_unstale":"2024-09-17T03:00:54.902951+0000","last_undegraded":"2024-09-17T03:00:54.902951+0000","last_fullsized":"2024-09-17T03:00:54.902951+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:32.471441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"137'1","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891170+0000","last_change":"2024-09-17T03:00:52.878222+0000","last_active":"2024-09-17T03:00:54.891170+0000","last_peered":"2024-09-17T03:00:54.891170+0000","last_clean":"2024-09-17T03:00:54.891170+0000","last_became_active":"2024-09-17T03:00:52.877962+0000","last_became_peered":"2024-09-17T03:00:52.877962+0000","last_unstale":"2024-09-17T03:00:54.891170+0000","last_undegraded":"2024-09-17T03:00:54.891170+0000","last_fullsized":"2024-09-17T03:00:54.891170+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:31.101800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902210+0000","last_change":"2024-09-17T03:00:53.887846+0000","last_active":"2024-09-17T03:00:54.902210+0000","last_peered":"2024-09-17T03:00:54.902210+0000","last_clean":"2024-09-17T03:00:54.902210+0000","last_became_active":"2024-09-17T03:00:53.887590+0000","last_became_peered":"2024-09-17T03:00:53.887590+0000","last_unstale":"2024-09-17T03:00:54.902210+0000","last_undegraded":"2024-09-17T03:00:54.902210+0000","last_fullsized":"2024-09-17T03:00:54.902210+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:52.657055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903221+0000","last_change":"2024-09-17T03:00:52.886139+0000","last_active":"2024-09-17T03:00:54.903221+0000","last_peered":"2024-09-17T03:00:54.903221+0000","last_clean":"2024-09-17T03:00:54.903221+0000","last_became_active":"2024-09-17T03:00:52.885237+0000","last_became_peered":"2024-09-17T03:00:52.885237+0000","last_unstale":"2024-09-17T03:00:54.903221+0000","last_undegraded":"2024-09-17T03:00:54.903221+0000","last_fullsized":"2024-09-17T03:00:54.903221+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:48.424841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872199+0000","last_change":"2024-09-17T03:00:53.880710+0000","last_active":"2024-09-17T03:00:54.872199+0000","last_peered":"2024-09-17T03:00:54.872199+0000","last_clean":"2024-09-17T03:00:54.872199+0000","last_became_active":"2024-09-17T03:00:53.880392+0000","last_became_peered":"2024-09-17T03:00:53.880392+0000","last_unstale":"2024-09-17T03:00:54.872199+0000","last_undegraded":"2024-09-17T03:00:54.872199+0000","last_fullsized":"2024-09-17T03:00:54.872199+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:02.100846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873801+0000","last_change":"2024-09-17T03:00:52.882188+0000","last_active":"2024-09-17T03:00:54.873801+0000","last_peered":"2024-09-17T03:00:54.873801+0000","last_clean":"2024-09-17T03:00:54.873801+0000","last_became_active":"2024-09-17T03:00:52.881793+0000","last_became_peered":"2024-09-17T03:00:52.881793+0000","last_unstale":"2024-09-17T03:00:54.873801+0000","last_undegraded":"2024-09-17T03:00:54.873801+0000","last_fullsized":"2024-09-17T03:00:54.873801+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:10.652451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872774+0000","last_change":"2024-09-17T03:00:53.881635+0000","last_active":"2024-09-17T03:00:54.872774+0000","last_peered":"2024-09-17T03:00:54.872774+0000","last_clean":"2024-09-17T03:00:54.872774+0000","last_became_active":"2024-09-17T03:00:53.880355+0000","last_became_peered":"2024-09-17T03:00:53.880355+0000","last_unstale":"2024-09-17T03:00:54.872774+0000","last_undegraded":"2024-09-17T03:00:54.872774+0000","last_fullsized":"2024-09-17T03:00:54.872774+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:41.314871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.891599+0000","last_change":"2024-09-17T03:00:52.879137+0000","last_active":"2024-09-17T03:00:54.891599+0000","last_peered":"2024-09-17T03:00:54.891599+0000","last_clean":"2024-09-17T03:00:54.891599+0000","last_became_active":"2024-09-17T03:00:52.878490+0000","last_became_peered":"2024-09-17T03:00:52.878490+0000","last_unstale":"2024-09-17T03:00:54.891599+0000","last_undegraded":"2024-09-17T03:00:54.891599+0000","last_fullsized":"2024-09-17T03:00:54.891599+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:08.953575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873365+0000","last_change":"2024-09-17T03:00:53.883054+0000","last_active":"2024-09-17T03:00:54.873365+0000","last_peered":"2024-09-17T03:00:54.873365+0000","last_clean":"2024-09-17T03:00:54.873365+0000","last_became_active":"2024-09-17T03:00:53.880141+0000","last_became_peered":"2024-09-17T03:00:53.880141+0000","last_unstale":"2024-09-17T03:00:54.873365+0000","last_undegraded":"2024-09-17T03:00:54.873365+0000","last_fullsized":"2024-09-17T03:00:54.873365+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:21.898845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.872913+0000","last_change":"2024-09-17T03:00:52.879952+0000","last_active":"2024-09-17T03:00:54.872913+0000","last_peered":"2024-09-17T03:00:54.872913+0000","last_clean":"2024-09-17T03:00:54.872913+0000","last_became_active":"2024-09-17T03:00:52.879675+0000","last_became_peered":"2024-09-17T03:00:52.879675+0000","last_unstale":"2024-09-17T03:00:54.872913+0000","last_undegraded":"2024-09-17T03:00:54.872913+0000","last_fullsized":"2024-09-17T03:00:54.872913+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:16.806679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901914+0000","last_change":"2024-09-17T03:00:53.884467+0000","last_active":"2024-09-17T03:00:54.901914+0000","last_peered":"2024-09-17T03:00:54.901914+0000","last_clean":"2024-09-17T03:00:54.901914+0000","last_became_active":"2024-09-17T03:00:53.883534+0000","last_became_peered":"2024-09-17T03:00:53.883534+0000","last_unstale":"2024-09-17T03:00:54.901914+0000","last_undegraded":"2024-09-17T03:00:54.901914+0000","last_fullsized":"2024-09-17T03:00:54.901914+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:10.553370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.901828+0000","last_change":"2024-09-17T03:00:52.877112+0000","last_active":"2024-09-17T03:00:54.901828+0000","last_peered":"2024-09-17T03:00:54.901828+0000","last_clean":"2024-09-17T03:00:54.901828+0000","last_became_active":"2024-09-17T03:00:52.876367+0000","last_became_peered":"2024-09-17T03:00:52.876367+0000","last_unstale":"2024-09-17T03:00:54.901828+0000","last_undegraded":"2024-09-17T03:00:54.901828+0000","last_fullsized":"2024-09-17T03:00:54.901828+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:34.403558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902767+0000","last_change":"2024-09-17T03:00:53.886699+0000","last_active":"2024-09-17T03:00:54.902767+0000","last_peered":"2024-09-17T03:00:54.902767+0000","last_clean":"2024-09-17T03:00:54.902767+0000","last_became_active":"2024-09-17T03:00:53.886062+0000","last_became_peered":"2024-09-17T03:00:53.886062+0000","last_unstale":"2024-09-17T03:00:54.902767+0000","last_undegraded":"2024-09-17T03:00:54.902767+0000","last_fullsized":"2024-09-17T03:00:54.902767+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:56:12.300075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.903272+0000","last_change":"2024-09-17T03:00:52.886428+0000","last_active":"2024-09-17T03:00:54.903272+0000","last_peered":"2024-09-17T03:00:54.903272+0000","last_clean":"2024-09-17T03:00:54.903272+0000","last_became_active":"2024-09-17T03:00:52.885582+0000","last_became_peered":"2024-09-17T03:00:52.885582+0000","last_unstale":"2024-09-17T03:00:54.903272+0000","last_undegraded":"2024-09-17T03:00:54.903272+0000","last_fullsized":"2024-09-17T03:00:54.903272+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:33.968252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.873500+0000","last_change":"2024-09-17T03:00:53.883298+0000","last_active":"2024-09-17T03:00:54.873500+0000","last_peered":"2024-09-17T03:00:54.873500+0000","last_clean":"2024-09-17T03:00:54.873500+0000","last_became_active":"2024-09-17T03:00:53.882880+0000","last_became_peered":"2024-09-17T03:00:53.882880+0000","last_unstale":"2024-09-17T03:00:54.873500+0000","last_undegraded":"2024-09-17T03:00:54.873500+0000","last_fullsized":"2024-09-17T03:00:54.873500+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:52.857599+0000","last_clean_scrub_stamp":"2024-09-17T03:00:52.857599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:21.906322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.892072+0000","last_change":"2024-09-17T03:00:52.885018+0000","last_active":"2024-09-17T03:00:54.892072+0000","last_peered":"2024-09-17T03:00:54.892072+0000","last_clean":"2024-09-17T03:00:54.892072+0000","last_became_active":"2024-09-17T03:00:52.884598+0000","last_became_peered":"2024-09-17T03:00:52.884598+0000","last_unstale":"2024-09-17T03:00:54.892072+0000","last_undegraded":"2024-09-17T03:00:54.892072+0000","last_fullsized":"2024-09-17T03:00:54.892072+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:00:51.851456+0000","last_clean_scrub_stamp":"2024-09-17T03:00:51.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:50.980522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":341,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T03:00:54.902173+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:00:54.902173+0000","last_peered":"2024-09-17T03:00:54.902173+0000","last_clean":"2024-09-17T03:00:54.902173+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:00:54.902173+0000","last_undegraded":"2024-09-17T03:00:54.902173+0000","last_fullsized":"2024-09-17T03:00:54.902173+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1314,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193997,"statfs":{"total":200000000,"available":198653483,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244397,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":738,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199243863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244467,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194573,"statfs":{"total":200000000,"available":199242785,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244467,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":737,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194574,"statfs":{"total":200000000,"available":199244343,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193996,"statfs":{"total":200000000,"available":198652375,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:01:01.679 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:01:01.679 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:01:01.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.835+0000 7f92930b6640 1 -- 172.21.15.104:0/943119528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0b7ae0 msgr2=0x7f928c0b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:01.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.835+0000 7f92930b6640 1 --2- 172.21.15.104:0/943119528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0b7ae0 0x7f928c0b5730 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f927c009820 tx=0x7f927c02a480 comp rx=0 tx=0).stop 2024-09-17T03:01:01.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.835+0000 7f92930b6640 1 -- 172.21.15.104:0/943119528 shutdown_connections 2024-09-17T03:01:01.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.835+0000 7f92930b6640 1 --2- 172.21.15.104:0/943119528 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0b7ae0 0x7f928c0b5730 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.835+0000 7f92930b6640 1 -- 172.21.15.104:0/943119528 >> 172.21.15.104:0/943119528 conn(0x7f928c0d28e0 msgr2=0x7f928c0d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:01.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.835+0000 7f92930b6640 1 -- 172.21.15.104:0/943119528 shutdown_connections 2024-09-17T03:01:01.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.835+0000 7f92930b6640 1 -- 172.21.15.104:0/943119528 wait complete. 2024-09-17T03:01:01.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.836+0000 7f92930b6640 1 Processor -- start 2024-09-17T03:01:01.836 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.837+0000 7f92930b6640 1 -- start start 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f92930b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f928c0b7ae0 0x7f928c14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f92930b6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c0d1180 0x7f928c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f92930b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0d1590 0x7f928c14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f92930b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f928c168350 con 0x7f928c0d1590 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f92930b6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1681d0 con 0x7f928c0d1180 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f92930b6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f928c1684d0 con 0x7f928c0b7ae0 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9291653640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0d1590 0x7f928c14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9291653640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0d1590 0x7f928c14ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35548/0 (socket says 172.21.15.104:35548) 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9291653640 1 -- 172.21.15.104:0/2768612658 learned_addr learned my addr 172.21.15.104:0/2768612658 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:01.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f928bfff640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c0d1180 0x7f928c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9290e52640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f928c0b7ae0 0x7f928c14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9291653640 1 -- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f928c0b7ae0 msgr2=0x7f928c14a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9291653640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f928c0b7ae0 0x7f928c14a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9291653640 1 -- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c0d1180 msgr2=0x7f928c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9291653640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c0d1180 0x7f928c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.838+0000 7f9291653640 1 -- 172.21.15.104:0/2768612658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c14e820 con 0x7f928c0d1590 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.839+0000 7f9291653640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0d1590 0x7f928c14ba30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f928400b410 tx=0x7f928400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.839+0000 7f92897fa640 1 -- 172.21.15.104:0/2768612658 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284015020 con 0x7f928c0d1590 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.839+0000 7f92897fa640 1 -- 172.21.15.104:0/2768612658 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9284011920 con 0x7f928c0d1590 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.839+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c150800 con 0x7f928c0d1590 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.839+0000 7f92897fa640 1 -- 172.21.15.104:0/2768612658 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284011d70 con 0x7f928c0d1590 2024-09-17T03:01:01.840 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.839+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c14af50 con 0x7f928c0d1590 2024-09-17T03:01:01.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.840+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928c06a700 con 0x7f928c0d1590 2024-09-17T03:01:01.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.841+0000 7f92897fa640 1 -- 172.21.15.104:0/2768612658 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9284018020 con 0x7f928c0d1590 2024-09-17T03:01:01.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.841+0000 7f92897fa640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9278078bc0 0x7f927807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:01.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.841+0000 7f92897fa640 1 -- 172.21.15.104:0/2768612658 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f928409ab80 con 0x7f928c0d1590 2024-09-17T03:01:01.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.841+0000 7f9290e52640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9278078bc0 0x7f927807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:01.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.842+0000 7f9290e52640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9278078bc0 0x7f927807b0d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f927c034000 tx=0x7f927c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:01.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:01.846+0000 7f92897fa640 1 -- 172.21.15.104:0/2768612658 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f928c06a700 con 0x7f928c0d1590 2024-09-17T03:01:02.092 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.093+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f928c15d680 con 0x7f928c0d1590 2024-09-17T03:01:02.094 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.095+0000 7f92897fa640 1 -- 172.21.15.104:0/2768612658 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v31) ==== 190+0+147 (secure 0 0 0) 0x7f928401f020 con 0x7f928c0d1590 2024-09-17T03:01:02.095 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T03:01:02.095 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T03:01:02.095 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T03:01:02.095 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T03:01:02.095 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:01:02.095 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9278078bc0 msgr2=0x7f927807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9278078bc0 0x7f927807b0d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f927c034000 tx=0x7f927c004730 comp rx=0 tx=0).stop 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0d1590 msgr2=0x7f928c14ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0d1590 0x7f928c14ba30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f928400b410 tx=0x7f928400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 shutdown_connections 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9278078bc0 0x7f927807b0d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c0d1180 0x7f928c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f928c0d1590 0x7f928c14ba30 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 --2- 172.21.15.104:0/2768612658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f928c0b7ae0 0x7f928c14a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 >> 172.21.15.104:0/2768612658 conn(0x7f928c0d28e0 msgr2=0x7f928c155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 shutdown_connections 2024-09-17T03:01:02.098 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.098+0000 7f92930b6640 1 -- 172.21.15.104:0/2768612658 wait complete. 2024-09-17T03:01:02.109 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:02.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.222+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/2839513328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c940ce280 msgr2=0x7f5c940ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.222+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/2839513328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c940ce280 0x7f5c940ce690 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5c94070910 tx=0x7f5c8c02a980 comp rx=0 tx=0).stop 2024-09-17T03:01:02.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.222+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/2839513328 shutdown_connections 2024-09-17T03:01:02.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.222+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/2839513328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c940ce280 0x7f5c940ce690 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.222+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/2839513328 >> v2:172.21.15.192:3300/0 conn(0x7f5c9415bc00 0x7f5c94072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.222+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/2839513328 >> 172.21.15.104:0/2839513328 conn(0x7f5c940b2450 msgr2=0x7f5c940b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:02.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.222+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/2839513328 shutdown_connections 2024-09-17T03:01:02.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.222+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/2839513328 wait complete. 2024-09-17T03:01:02.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.224+0000 7f5c9a5a1640 1 Processor -- start 2024-09-17T03:01:02.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.224+0000 7f5c9a5a1640 1 -- start start 2024-09-17T03:01:02.225 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c9a5a1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c940ce280 0x7f5c940af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c9a5a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c9415b7f0 0x7f5c9414fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c9a5a1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c9415bc00 0x7f5c9406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c9a5a1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5c940cebd0 con 0x7f5c9415b7f0 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c9a5a1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5c940700c0 con 0x7f5c9415bc00 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c9a5a1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5c940ced50 con 0x7f5c940ce280 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c8bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c9415b7f0 0x7f5c9414fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c8bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c9415b7f0 0x7f5c9414fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35552/0 (socket says 172.21.15.104:35552) 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c8bfff640 1 -- 172.21.15.104:0/1747439875 learned_addr learned my addr 172.21.15.104:0/1747439875 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c93fff640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c940ce280 0x7f5c940af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c98b3e640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c9415bc00 0x7f5c9406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c8bfff640 1 -- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c940ce280 msgr2=0x7f5c940af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c8bfff640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c940ce280 0x7f5c940af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c8bfff640 1 -- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c9415bc00 msgr2=0x7f5c9406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c8bfff640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c9415bc00 0x7f5c9406ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.225+0000 7f5c8bfff640 1 -- 172.21.15.104:0/1747439875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c941f3d20 con 0x7f5c9415b7f0 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.226+0000 7f5c8bfff640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c9415b7f0 0x7f5c9414fac0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b440 tx=0x7f5c7c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.226+0000 7f5c917fa640 1 -- 172.21.15.104:0/1747439875 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c015020 con 0x7f5c9415b7f0 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.226+0000 7f5c917fa640 1 -- 172.21.15.104:0/1747439875 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c7c011920 con 0x7f5c9415b7f0 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.226+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c94155e80 con 0x7f5c9415b7f0 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.226+0000 7f5c917fa640 1 -- 172.21.15.104:0/1747439875 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c011d70 con 0x7f5c9415b7f0 2024-09-17T03:01:02.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.226+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c94156440 con 0x7f5c9415b7f0 2024-09-17T03:01:02.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.227+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c940cf250 con 0x7f5c9415b7f0 2024-09-17T03:01:02.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.228+0000 7f5c917fa640 1 -- 172.21.15.104:0/1747439875 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c7c018020 con 0x7f5c9415b7f0 2024-09-17T03:01:02.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.228+0000 7f5c917fa640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c74078bc0 0x7f5c7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.228+0000 7f5c917fa640 1 -- 172.21.15.104:0/1747439875 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f5c7c09aca0 con 0x7f5c9415b7f0 2024-09-17T03:01:02.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.228+0000 7f5c93fff640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c74078bc0 0x7f5c7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.228 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.229+0000 7f5c93fff640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c74078bc0 0x7f5c7407b0d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5c84006fd0 tx=0x7f5c84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:02.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.232+0000 7f5c917fa640 1 -- 172.21.15.104:0/1747439875 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c7c01f020 con 0x7f5c9415b7f0 2024-09-17T03:01:02.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.441+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c94157770 con 0x7f5c9415b7f0 2024-09-17T03:01:02.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.442+0000 7f5c917fa640 1 -- 172.21.15.104:0/1747439875 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f5c7c0630e0 con 0x7f5c9415b7f0 2024-09-17T03:01:02.442 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:02.442 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:01:02.442 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c74078bc0 msgr2=0x7f5c7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c74078bc0 0x7f5c7407b0d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5c84006fd0 tx=0x7f5c84008040 comp rx=0 tx=0).stop 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c9415b7f0 msgr2=0x7f5c9414fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c9415b7f0 0x7f5c9414fac0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c00b440 tx=0x7f5c7c00b900 comp rx=0 tx=0).stop 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 shutdown_connections 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5c74078bc0 0x7f5c7407b0d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c9415bc00 0x7f5c9406ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5c9415b7f0 0x7f5c9414fac0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 --2- 172.21.15.104:0/1747439875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5c940ce280 0x7f5c940af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 >> 172.21.15.104:0/1747439875 conn(0x7f5c940b2450 msgr2=0x7f5c940b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:02.444 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 shutdown_connections 2024-09-17T03:01:02.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.444+0000 7f5c9a5a1640 1 -- 172.21.15.104:0/1747439875 wait complete. 2024-09-17T03:01:02.857 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:00:53.229480+0000', 'modified': '2024-09-17T03:00:55.235571+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7044}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7044': {'gid': 7044, 'name': 'd', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/1420152986', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 1420152986}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 1420152986}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7044, 'qdb_cluster': [7044]} 2024-09-17T03:01:02.858 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:01:02.858 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:01:02.973 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.974+0000 7f1393ac4640 1 -- 172.21.15.104:0/2057048132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0b7bb0 msgr2=0x7f138c0cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.974+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2057048132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0b7bb0 0x7f138c0cde90 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f138c0b4270 tx=0x7f137c02a910 comp rx=0 tx=0).stop 2024-09-17T03:01:02.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.974+0000 7f1393ac4640 1 -- 172.21.15.104:0/2057048132 shutdown_connections 2024-09-17T03:01:02.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.974+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2057048132 >> v2:172.21.15.192:3300/0 conn(0x7f138c0d0470 0x7f138c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.974+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2057048132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0b7bb0 0x7f138c0cde90 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.974+0000 7f1393ac4640 1 -- 172.21.15.104:0/2057048132 >> 172.21.15.104:0/2057048132 conn(0x7f138c0d28a0 msgr2=0x7f138c0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:02.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.974+0000 7f1393ac4640 1 -- 172.21.15.104:0/2057048132 shutdown_connections 2024-09-17T03:01:02.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.974+0000 7f1393ac4640 1 -- 172.21.15.104:0/2057048132 wait complete. 2024-09-17T03:01:02.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.976+0000 7f1393ac4640 1 Processor -- start 2024-09-17T03:01:02.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.976+0000 7f1393ac4640 1 -- start start 2024-09-17T03:01:02.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1393ac4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f138c0b7bb0 0x7f138c1f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1393ac4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138c0cefb0 0x7f138c1e8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1393ac4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0d0470 0x7f138c1e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1393ac4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0b3590 con 0x7f138c0d0470 2024-09-17T03:01:02.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1393ac4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0ce5e0 con 0x7f138c0cefb0 2024-09-17T03:01:02.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1393ac4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f138c0cfad0 con 0x7f138c0b7bb0 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1392061640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0d0470 0x7f138c1e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1392061640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0d0470 0x7f138c1e8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35576/0 (socket says 172.21.15.104:35576) 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1392061640 1 -- 172.21.15.104:0/2030321530 learned_addr learned my addr 172.21.15.104:0/2030321530 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f139105f640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138c0cefb0 0x7f138c1e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1391860640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f138c0b7bb0 0x7f138c1f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1392061640 1 -- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f138c0b7bb0 msgr2=0x7f138c1f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1392061640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f138c0b7bb0 0x7f138c1f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1392061640 1 -- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138c0cefb0 msgr2=0x7f138c1e8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1392061640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138c0cefb0 0x7f138c1e8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.977+0000 7f1392061640 1 -- 172.21.15.104:0/2030321530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c0afb60 con 0x7f138c0d0470 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.978+0000 7f1392061640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0d0470 0x7f138c1e8b90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f138400c3c0 tx=0x7f138400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:02.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.978+0000 7f138a7fc640 1 -- 172.21.15.104:0/2030321530 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384017070 con 0x7f138c0d0470 2024-09-17T03:01:02.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.978+0000 7f138a7fc640 1 -- 172.21.15.104:0/2030321530 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13840053c0 con 0x7f138c0d0470 2024-09-17T03:01:02.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.978+0000 7f1393ac4640 1 -- 172.21.15.104:0/2030321530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138c0afe40 con 0x7f138c0d0470 2024-09-17T03:01:02.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.978+0000 7f138a7fc640 1 -- 172.21.15.104:0/2030321530 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384003850 con 0x7f138c0d0470 2024-09-17T03:01:02.980 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.978+0000 7f1393ac4640 1 -- 172.21.15.104:0/2030321530 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138c0b0400 con 0x7f138c0d0470 2024-09-17T03:01:02.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.980+0000 7f138a7fc640 1 -- 172.21.15.104:0/2030321530 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f138401a070 con 0x7f138c0d0470 2024-09-17T03:01:02.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.981+0000 7f138a7fc640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1378078b90 0x7f137807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.981+0000 7f138a7fc640 1 -- 172.21.15.104:0/2030321530 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f1384099ef0 con 0x7f138c0d0470 2024-09-17T03:01:02.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.981+0000 7f1391860640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1378078b90 0x7f137807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.981+0000 7f139aa30740 1 Processor -- start 2024-09-17T03:01:02.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.981+0000 7f139aa30740 1 -- start start 2024-09-17T03:01:02.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.982+0000 7f1391860640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1378078b90 0x7f137807b0a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f137c035000 tx=0x7f137c004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:02.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139aa30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e30270 0x558226201fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139aa30740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x5582262024e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139aa30740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e0f590 0x55822621f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139aa30740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55822614a820 con 0x558225e073b0 2024-09-17T03:01:02.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139aa30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558226139c50 con 0x558225e30270 2024-09-17T03:01:02.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139aa30740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55822613da60 con 0x558225e0f590 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x5582262024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x5582262024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35584/0 (socket says 172.21.15.104:35584) 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 -- 172.21.15.104:0/4126054328 learned_addr learned my addr 172.21.15.104:0/4126054328 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f1391860640 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e30270 0x558226201fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f1392061640 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e0f590 0x55822621f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 -- 172.21.15.104:0/4126054328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e0f590 msgr2=0x55822621f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e0f590 0x55822621f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 -- 172.21.15.104:0/4126054328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e30270 msgr2=0x558226201fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e30270 0x558226201fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 -- 172.21.15.104:0/4126054328 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558225e9b850 con 0x558225e073b0 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f139105f640 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x5582262024e0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f1380003620 tx=0x7f1380003a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145bebf0ec564e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f13737fe640 1 -- 172.21.15.104:0/4126054328 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138000ba60 con 0x558225e073b0 2024-09-17T03:01:02.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f13737fe640 1 -- 172.21.15.104:0/4126054328 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1380015070 con 0x558225e073b0 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.983+0000 7f13737fe640 1 -- 172.21.15.104:0/4126054328 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380005020 con 0x558225e073b0 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 -- 172.21.15.104:0/4126054328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 msgr2=0x5582262024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x5582262024e0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f1380003620 tx=0x7f1380003a20 comp rx=0 tx=0).stop 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 -- 172.21.15.104:0/4126054328 shutdown_connections 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e0f590 0x55822621f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x5582262024e0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 --2- 172.21.15.104:0/4126054328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e30270 0x558226201fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 -- 172.21.15.104:0/4126054328 >> 172.21.15.104:0/4126054328 conn(0x558225e243c0 msgr2=0x5582261d8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 -- 172.21.15.104:0/4126054328 shutdown_connections 2024-09-17T03:01:02.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.984+0000 7f139aa30740 1 -- 172.21.15.104:0/4126054328 wait complete. 2024-09-17T03:01:02.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.985+0000 7f139aa30740 1 -- start start 2024-09-17T03:01:02.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.985+0000 7f139aa30740 1 Processor -- start 2024-09-17T03:01:02.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139aa30740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226212d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139aa30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x558226214d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139aa30740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x55822622f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139aa30740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x558225eaa620 con 0x558225e073b0 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139aa30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5582260df5f0 con 0x558225e0f590 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139aa30740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x558226202a20 con 0x558225e30270 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139aa30740 10 client.0 _ll_register_callbacks cb 0x5582260e30a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226212d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226212d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35588/0 (socket says 172.21.15.104:35588) 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 -- 172.21.15.104:0/1842130230 learned_addr learned my addr 172.21.15.104:0/1842130230 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1392061640 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x55822622f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139105f640 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x558226214d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 -- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 msgr2=0x55822622f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x55822622f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 -- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 msgr2=0x558226214d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x558226214d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 -- 172.21.15.104:0/1842130230 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558225f126b0 con 0x558225e073b0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1391860640 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226212d50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f137c033040 tx=0x7f137c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386c50dfbcb6551 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1370ff9640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1370ff9640 1 -- 172.21.15.104:0/1842130230 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c034040 con 0x558225e073b0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f1370ff9640 1 -- 172.21.15.104:0/1842130230 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f137c040030 con 0x558225e073b0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.987+0000 7f139aa30740 1 -- 172.21.15.104:0/1842130230 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1380015070 con 0x558225e073b0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f1370ff9640 1 -- 172.21.15.104:0/1842130230 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f137c0047a0 con 0x558225e073b0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139aa30740 10 client.7188 fetch_fsmap learned FSMap version 55 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139aa30740 1 -- 172.21.15.104:0/1842130230 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x5582262163d0 con 0x558225e073b0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f1370ff9640 1 -- 172.21.15.104:0/1842130230 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1380015070 con 0x558225e073b0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f1370ff9640 1 -- 172.21.15.104:0/1842130230 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f137c05a050 con 0x558225e073b0 2024-09-17T03:01:02.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139aa30740 10 client.7188 fetch_fsmap finished waiting for FSMap version 55 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139aa30740 10 client.7188 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139aa30740 20 client.7188 populate_metadata read hostname 'smithi104' 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139aa30740 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] conn(0x558225deee40 0x5582262394d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139aa30740 4 client.7188 mds_command: new command op to 7044 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139aa30740 1 -- 172.21.15.104:0/1842130230 --> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55822614c770 con 0x558225deee40 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.988+0000 7f139105f640 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] conn(0x558225deee40 0x5582262394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.989+0000 7f139105f640 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] conn(0x558225deee40 0x5582262394d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34c7dd3287f78189 server_cookie=d858f08c0cd017a in_seq=0 out_seq=0 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.989+0000 7f1370ff9640 10 client.7188 ms_handle_connect on v2:172.21.15.192:6835/1420152986 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.989+0000 7f1370ff9640 1 -- 172.21.15.104:0/1842130230 <== mds.0 v2:172.21.15.192:6835/1420152986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55822614c770 con 0x558225deee40 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.989+0000 7f1370ff9640 10 client.7188 handle_command_reply: tid=0 2024-09-17T03:01:02.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.989+0000 7f139aa30740 1 client.7188 shutdown 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 -- 172.21.15.104:0/1842130230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 msgr2=0x558226212d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226212d50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f137c033040 tx=0x7f137c009560 comp rx=0 tx=0).stop 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 -- 172.21.15.104:0/1842130230 shutdown_connections 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] conn(0x558225deee40 0x5582262394d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x558226214d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x55822622f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f1370ff9640 0 client.7188 ms_handle_reset on v2:172.21.15.192:6835/1420152986 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 --2- 172.21.15.104:0/1842130230 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226212d50 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 -- 172.21.15.104:0/1842130230 >> 172.21.15.104:0/1842130230 conn(0x558225e243c0 msgr2=0x5582261d8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 -- 172.21.15.104:0/1842130230 shutdown_connections 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 1 -- 172.21.15.104:0/1842130230 wait complete. 2024-09-17T03:01:02.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:02.990+0000 7f139aa30740 20 client.7188 trim_cache size 0 max 16384 2024-09-17T03:01:03.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.008+0000 7f139aa30740 1 Processor -- start 2024-09-17T03:01:03.008 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.008+0000 7f139aa30740 1 -- start start 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.009+0000 7f139aa30740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226291fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.009+0000 7f139aa30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x5582261f0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.009+0000 7f139aa30740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x5582261f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.009+0000 7f139aa30740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f138c1ff440 con 0x558225e073b0 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.009+0000 7f139aa30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f138c09f7f0 con 0x558225e0f590 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.009+0000 7f139aa30740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f138c09fe40 con 0x558225e30270 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.009+0000 7f1391860640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226291fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1391860640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226291fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35592/0 (socket says 172.21.15.104:35592) 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1391860640 1 -- 172.21.15.104:0/2512474866 learned_addr learned my addr 172.21.15.104:0/2512474866 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f139105f640 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x5582261f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1391860640 1 -- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 msgr2=0x5582261f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1392061640 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x5582261f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1391860640 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x5582261f0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1391860640 1 -- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 msgr2=0x5582261f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1391860640 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x5582261f0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1391860640 1 -- 172.21.15.104:0/2512474866 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55822614a4c0 con 0x558225e073b0 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f139105f640 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x5582261f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1392061640 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x5582261f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1391860640 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226291fe0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f137c009a00 tx=0x7f137c045440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40262a4a12e6d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1372ffd640 1 -- 172.21.15.104:0/2512474866 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c034070 con 0x558225e073b0 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1372ffd640 1 -- 172.21.15.104:0/2512474866 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f137c0457e0 con 0x558225e073b0 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.010+0000 7f1372ffd640 1 -- 172.21.15.104:0/2512474866 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c045bd0 con 0x558225e073b0 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 -- 172.21.15.104:0/2512474866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 msgr2=0x558226291fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226291fe0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f137c009a00 tx=0x7f137c045440 comp rx=0 tx=0).stop 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 -- 172.21.15.104:0/2512474866 shutdown_connections 2024-09-17T03:01:03.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e0f590 0x5582261f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x5582261f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 --2- 172.21.15.104:0/2512474866 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e073b0 0x558226291fe0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 -- 172.21.15.104:0/2512474866 >> 172.21.15.104:0/2512474866 conn(0x558225e243c0 msgr2=0x5582261d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:03.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 -- 172.21.15.104:0/2512474866 shutdown_connections 2024-09-17T03:01:03.013 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.011+0000 7f139aa30740 1 -- 172.21.15.104:0/2512474866 wait complete. 2024-09-17T03:01:03.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.012+0000 7f139aa30740 1 -- start start 2024-09-17T03:01:03.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.012+0000 7f139aa30740 1 Processor -- start 2024-09-17T03:01:03.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139aa30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e073b0 0x55822628bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139aa30740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e0f590 0x558226294600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139aa30740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x558226201c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139aa30740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55822622ba60 con 0x558225e0f590 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139aa30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5582262152d0 con 0x558225e073b0 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139aa30740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55822622c020 con 0x558225e30270 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139aa30740 10 client.0 _ll_register_callbacks cb 0x7f137c0039f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139105f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e0f590 0x558226294600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139105f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e0f590 0x558226294600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35596/0 (socket says 172.21.15.104:35596) 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f139105f640 1 -- 172.21.15.104:0/208780514 learned_addr learned my addr 172.21.15.104:0/208780514 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.013+0000 7f1391860640 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e073b0 0x55822628bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f1392061640 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x558226201c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139105f640 1 -- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 msgr2=0x558226201c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139105f640 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x558226201c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139105f640 1 -- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e073b0 msgr2=0x55822628bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:01:03.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139105f640 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e073b0 0x55822628bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139105f640 1 -- 172.21.15.104:0/208780514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582261dfcf0 con 0x558225e0f590 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f1392061640 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x558226201c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139105f640 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e0f590 0x558226294600 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f1380004430 tx=0x7f13800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b463732308bde43 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f1370ff9640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f1370ff9640 1 -- 172.21.15.104:0/208780514 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380026630 con 0x558225e0f590 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f1370ff9640 1 -- 172.21.15.104:0/208780514 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f13800267d0 con 0x558225e0f590 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 1 -- 172.21.15.104:0/208780514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f137c0457e0 con 0x558225e0f590 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f1370ff9640 1 -- 172.21.15.104:0/208780514 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1380033050 con 0x558225e0f590 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 10 client.7194 fetch_fsmap learned FSMap version 55 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 1 -- 172.21.15.104:0/208780514 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55822622b7b0 con 0x558225e0f590 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f1370ff9640 1 -- 172.21.15.104:0/208780514 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f137c0457e0 con 0x558225e0f590 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f1370ff9640 1 -- 172.21.15.104:0/208780514 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 55) ==== 3502+0+0 (secure 0 0 0) 0x7f1380036020 con 0x558225e0f590 2024-09-17T03:01:03.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 10 client.7194 fetch_fsmap finished waiting for FSMap version 55 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 10 client.7194 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 20 client.7194 populate_metadata read hostname 'smithi104' 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] conn(0x558226202180 0x558226213b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 4 client.7194 mds_command: new command op to 7044 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.014+0000 7f139aa30740 1 -- 172.21.15.104:0/208780514 --> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] -- command(tid 0: {"prefix": "status"}) -- 0x558226148220 con 0x558226202180 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f1391860640 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] conn(0x558226202180 0x558226213b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f1391860640 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] conn(0x558226202180 0x558226213b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d41ed36317182db0 server_cookie=9bf6dd17e8819c76 in_seq=0 out_seq=0 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f1370ff9640 10 client.7194 ms_handle_connect on v2:172.21.15.192:6835/1420152986 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f1370ff9640 1 -- 172.21.15.104:0/208780514 <== mds.0 v2:172.21.15.192:6835/1420152986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558226148220 con 0x558226202180 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f1370ff9640 10 client.7194 handle_command_reply: tid=0 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 client.7194 shutdown 2024-09-17T03:01:03.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 -- 172.21.15.104:0/208780514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e0f590 msgr2=0x558226294600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e0f590 0x558226294600 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f1380004430 tx=0x7f13800046c0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 -- 172.21.15.104:0/208780514 shutdown_connections 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:6835/1420152986,v1:172.21.15.192:6837/1420152986] conn(0x558226202180 0x558226213b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x558225e30270 0x558226201c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x558225e0f590 0x558226294600 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f1370ff9640 0 client.7194 ms_handle_reset on v2:172.21.15.192:6835/1420152986 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 --2- 172.21.15.104:0/208780514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558225e073b0 0x55822628bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 -- 172.21.15.104:0/208780514 >> 172.21.15.104:0/208780514 conn(0x558225e243c0 msgr2=0x5582261d2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.015+0000 7f139aa30740 1 -- 172.21.15.104:0/208780514 shutdown_connections 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f139aa30740 1 -- 172.21.15.104:0/208780514 wait complete. 2024-09-17T03:01:03.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f139aa30740 20 client.7194 trim_cache size 0 max 16384 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 7044, 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.1328042840000005, 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 55, 2024-09-17T03:01:03.022 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 137, 2024-09-17T03:01:03.023 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 137, 2024-09-17T03:01:03.023 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 13.830470812 2024-09-17T03:01:03.023 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 -- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1378078b90 msgr2=0x7f137807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1378078b90 0x7f137807b0a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f137c035000 tx=0x7f137c004ab0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 -- 172.21.15.104:0/2030321530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0d0470 msgr2=0x7f138c1e8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0d0470 0x7f138c1e8b90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f138400c3c0 tx=0x7f138400c880 comp rx=0 tx=0).stop 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 -- 172.21.15.104:0/2030321530 shutdown_connections 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1378078b90 0x7f137807b0a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f138c0cefb0 0x7f138c1e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f138c0d0470 0x7f138c1e8b90 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 --2- 172.21.15.104:0/2030321530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f138c0b7bb0 0x7f138c1f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 -- 172.21.15.104:0/2030321530 >> 172.21.15.104:0/2030321530 conn(0x7f138c0d28a0 msgr2=0x7f138c070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:03.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 -- 172.21.15.104:0/2030321530 shutdown_connections 2024-09-17T03:01:03.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.016+0000 7f1393ac4640 1 -- 172.21.15.104:0/2030321530 wait complete. 2024-09-17T03:01:03.027 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:01:03.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.140+0000 7f8acb558640 1 -- 172.21.15.104:0/3928439996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac406fc60 msgr2=0x7f8ac415cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.140+0000 7f8acb558640 1 --2- 172.21.15.104:0/3928439996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac406fc60 0x7f8ac415cd90 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8abc005fd0 tx=0x7f8abc02aa10 comp rx=0 tx=0).stop 2024-09-17T03:01:03.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.140+0000 7f8acb558640 1 -- 172.21.15.104:0/3928439996 shutdown_connections 2024-09-17T03:01:03.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.140+0000 7f8acb558640 1 --2- 172.21.15.104:0/3928439996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac406fc60 0x7f8ac415cd90 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.140+0000 7f8acb558640 1 --2- 172.21.15.104:0/3928439996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac41610a0 0x7f8ac40d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.140+0000 7f8acb558640 1 -- 172.21.15.104:0/3928439996 >> 172.21.15.104:0/3928439996 conn(0x7f8ac406d200 msgr2=0x7f8ac406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:03.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.140+0000 7f8acb558640 1 -- 172.21.15.104:0/3928439996 shutdown_connections 2024-09-17T03:01:03.140 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.140+0000 7f8acb558640 1 -- 172.21.15.104:0/3928439996 wait complete. 2024-09-17T03:01:03.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.142+0000 7f8acb558640 1 Processor -- start 2024-09-17T03:01:03.141 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.142+0000 7f8acb558640 1 -- start start 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8acb558640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac406fc60 0x7f8ac41f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8acb558640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac40d2180 0x7f8ac4146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8acb558640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac41610a0 0x7f8ac4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8acb558640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac415d2d0 con 0x7f8ac40d2180 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8acb558640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac4074770 con 0x7f8ac41610a0 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8acb558640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac415d450 con 0x7f8ac406fc60 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac8af3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac40d2180 0x7f8ac4146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac8af3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac40d2180 0x7f8ac4146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:35604/0 (socket says 172.21.15.104:35604) 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac8af3640 1 -- 172.21.15.104:0/1362834092 learned_addr learned my addr 172.21.15.104:0/1362834092 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:03.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac9af5640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac41610a0 0x7f8ac4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac92f4640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac406fc60 0x7f8ac41f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac8af3640 1 -- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac406fc60 msgr2=0x7f8ac41f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac8af3640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac406fc60 0x7f8ac41f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac8af3640 1 -- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac41610a0 msgr2=0x7f8ac4159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac8af3640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac41610a0 0x7f8ac4159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac8af3640 1 -- 172.21.15.104:0/1362834092 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac40af2c0 con 0x7f8ac40d2180 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac9af5640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac41610a0 0x7f8ac4159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.143+0000 7f8ac92f4640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac406fc60 0x7f8ac41f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:03.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.144+0000 7f8ac8af3640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac40d2180 0x7f8ac4146dc0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c340 tx=0x7f8ab400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:03.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.144+0000 7f8ab9ffb640 1 -- 172.21.15.104:0/1362834092 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40052d0 con 0x7f8ac40d2180 2024-09-17T03:01:03.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.144+0000 7f8ab9ffb640 1 -- 172.21.15.104:0/1362834092 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ab4007020 con 0x7f8ac40d2180 2024-09-17T03:01:03.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.144+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac4149a60 con 0x7f8ac40d2180 2024-09-17T03:01:03.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.144+0000 7f8ab9ffb640 1 -- 172.21.15.104:0/1362834092 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4007470 con 0x7f8ac40d2180 2024-09-17T03:01:03.146 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.144+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac414a020 con 0x7f8ac40d2180 2024-09-17T03:01:03.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.145+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac415cd90 con 0x7f8ac40d2180 2024-09-17T03:01:03.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.145+0000 7f8ab9ffb640 1 -- 172.21.15.104:0/1362834092 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ab40067d0 con 0x7f8ac40d2180 2024-09-17T03:01:03.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.146+0000 7f8ab9ffb640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8aa8078b90 0x7f8aa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:03.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.146+0000 7f8ab9ffb640 1 -- 172.21.15.104:0/1362834092 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f8ab409a200 con 0x7f8ac40d2180 2024-09-17T03:01:03.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.146+0000 7f8ac92f4640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8aa8078b90 0x7f8aa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:03.147 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.147+0000 7f8ac92f4640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8aa8078b90 0x7f8aa807b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009890 tx=0x7f8ac0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:03.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.151+0000 7f8ab9ffb640 1 -- 172.21.15.104:0/1362834092 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ac40d2590 con 0x7f8ac40d2180 2024-09-17T03:01:03.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.357+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8ac40af050 con 0x7f8ac40d2180 2024-09-17T03:01:03.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.358+0000 7f8ab9ffb640 1 -- 172.21.15.104:0/1362834092 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) ==== 53+0+73 (secure 0 0 0) 0x7f8ab4062640 con 0x7f8ac40d2180 2024-09-17T03:01:03.357 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8aa8078b90 msgr2=0x7f8aa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8aa8078b90 0x7f8aa807b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009890 tx=0x7f8ac0008040 comp rx=0 tx=0).stop 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac40d2180 msgr2=0x7f8ac4146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac40d2180 0x7f8ac4146dc0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400c340 tx=0x7f8ab400c800 comp rx=0 tx=0).stop 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 shutdown_connections 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8aa8078b90 0x7f8aa807b0a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ac41610a0 0x7f8ac4159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ac40d2180 0x7f8ac4146dc0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 --2- 172.21.15.104:0/1362834092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ac406fc60 0x7f8ac41f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:03.360 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 >> 172.21.15.104:0/1362834092 conn(0x7f8ac406d200 msgr2=0x7f8ac4070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:03.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 shutdown_connections 2024-09-17T03:01:03.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03.360+0000 7f8acb558640 1 -- 172.21.15.104:0/1362834092 wait complete. 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:01:03.371 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:01:03.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:03.372 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T03:01:03.387 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:01:03.387 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:01:03.387 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:01:03.387 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:03.388 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T03:01:03.389 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:03.390 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:01:03.390 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:01:03.390 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T03:01:03.390 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:03.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:03.390 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:01:03.450 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T03:01:03.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:03.452 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T03:01:03.508 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T03:01:03.508 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:01:03.508 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:01:03.508 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:01:03.508 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:01:03.509 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:01:03.509 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T03:01:03.509 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:01:03.509 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:01:03.509 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:01:03.509 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T03:01:03.596 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:01:03.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:01:03.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:03.634 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T03:01:03.649 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:01:03.649 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:01:03.650 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:01:03.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:03.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T03:01:03.715 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:01:03.715 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:01:03.771 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:01:03.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:01:03.771 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:01:03.826 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:01:03.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:03.826 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:01:03.921 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:01:03.921 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:01:03.921 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:01:03.932 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:01:03.932 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:01:03.932 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:01:03.932 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:01:03.932 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:01:03.939 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:01:03.939 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:01:03.939 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:01:03.939 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:01:03.939 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:01:03.939 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:01:03.939 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:01:03.939 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:01:03.940 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:01:03.940 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:01:03.940 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:01:03.940 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:01:03.940 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:01:03.941 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:01:03.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:03.941 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:01:03.966 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:01:04.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:01:04.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:01:04.070 INFO:teuthology.orchestra.run.smithi104.stdout:client6658 2024-09-17T03:01:04.070 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:04.070 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:04.088 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:01:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.240+0000 7f0287d2b640 1 -- 172.21.15.104:0/1017038874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f028015cc30 msgr2=0x7f02800cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.240+0000 7f0287d2b640 1 --2- 172.21.15.104:0/1017038874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f028015cc30 0x7f02800cd770 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f0274009830 tx=0x7f027402a510 comp rx=0 tx=0).stop 2024-09-17T03:01:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.240+0000 7f0287d2b640 1 -- 172.21.15.104:0/1017038874 shutdown_connections 2024-09-17T03:01:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.240+0000 7f0287d2b640 1 --2- 172.21.15.104:0/1017038874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f028015cc30 0x7f02800cd770 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.240+0000 7f0287d2b640 1 -- 172.21.15.104:0/1017038874 >> 172.21.15.104:0/1017038874 conn(0x7f028006eb90 msgr2=0x7f028006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.240+0000 7f0287d2b640 1 -- 172.21.15.104:0/1017038874 shutdown_connections 2024-09-17T03:01:04.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.240+0000 7f0287d2b640 1 -- 172.21.15.104:0/1017038874 wait complete. 2024-09-17T03:01:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.242+0000 7f0287d2b640 1 Processor -- start 2024-09-17T03:01:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.242+0000 7f0287d2b640 1 -- start start 2024-09-17T03:01:04.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f0287d2b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280073e00 0x7f02801571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f0287d2b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02800cdcb0 0x7f02801593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f0287d2b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015cc30 0x7f0280151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f0287d2b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f02800d0360 con 0x7f02800cdcb0 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f0287d2b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f02800d01e0 con 0x7f028015cc30 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f0287d2b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f02800d04e0 con 0x7f0280073e00 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f02852c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02800cdcb0 0x7f02801593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f02852c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02800cdcb0 0x7f02801593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46700/0 (socket says 172.21.15.104:46700) 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f02852c6640 1 -- 172.21.15.104:0/877148037 learned_addr learned my addr 172.21.15.104:0/877148037 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f02862c8640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015cc30 0x7f0280151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.243+0000 7f0285ac7640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280073e00 0x7f02801571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f02852c6640 1 -- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280073e00 msgr2=0x7f02801571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f02852c6640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280073e00 0x7f02801571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f02852c6640 1 -- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015cc30 msgr2=0x7f0280151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:04.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f02852c6640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015cc30 0x7f0280151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f02852c6640 1 -- 172.21.15.104:0/877148037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0280157730 con 0x7f02800cdcb0 2024-09-17T03:01:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f02852c6640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02800cdcb0 0x7f02801593c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0274009950 tx=0x7f0274033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f027e7fc640 1 -- 172.21.15.104:0/877148037 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0274031d60 con 0x7f02800cdcb0 2024-09-17T03:01:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f027e7fc640 1 -- 172.21.15.104:0/877148037 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0274005020 con 0x7f02800cdcb0 2024-09-17T03:01:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0280156b50 con 0x7f02800cdcb0 2024-09-17T03:01:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f027e7fc640 1 -- 172.21.15.104:0/877148037 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0274005470 con 0x7f02800cdcb0 2024-09-17T03:01:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.244+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0280151120 con 0x7f02800cdcb0 2024-09-17T03:01:04.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.245+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02801568c0 con 0x7f02800cdcb0 2024-09-17T03:01:04.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.246+0000 7f027e7fc640 1 -- 172.21.15.104:0/877148037 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02740047a0 con 0x7f02800cdcb0 2024-09-17T03:01:04.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.246+0000 7f027e7fc640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f026c078b90 0x7f026c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:04.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.246+0000 7f027e7fc640 1 -- 172.21.15.104:0/877148037 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f02740bc2c0 con 0x7f02800cdcb0 2024-09-17T03:01:04.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.246+0000 7f0285ac7640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f026c078b90 0x7f026c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:04.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.247+0000 7f0285ac7640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f026c078b90 0x7f026c07b0a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0278001720 tx=0x7f0278007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:04.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.250+0000 7f027e7fc640 1 -- 172.21.15.104:0/877148037 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f027403f030 con 0x7f02800cdcb0 2024-09-17T03:01:04.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.458+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f02800cda90 con 0x7f02800cdcb0 2024-09-17T03:01:04.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.459+0000 7f027e7fc640 1 -- 172.21.15.104:0/877148037 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) ==== 53+0+73 (secure 0 0 0) 0x7f02800cda90 con 0x7f02800cdcb0 2024-09-17T03:01:04.458 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:01:04.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f026c078b90 msgr2=0x7f026c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f026c078b90 0x7f026c07b0a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0278001720 tx=0x7f0278007e90 comp rx=0 tx=0).stop 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02800cdcb0 msgr2=0x7f02801593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02800cdcb0 0x7f02801593c0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f0274009950 tx=0x7f0274033ce0 comp rx=0 tx=0).stop 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 shutdown_connections 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f026c078b90 0x7f026c07b0a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015cc30 0x7f0280151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f02800cdcb0 0x7f02801593c0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 --2- 172.21.15.104:0/877148037 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280073e00 0x7f02801571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 >> 172.21.15.104:0/877148037 conn(0x7f028006eb90 msgr2=0x7f028015b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 shutdown_connections 2024-09-17T03:01:04.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:04.461+0000 7f0287d2b640 1 -- 172.21.15.104:0/877148037 wait complete. 2024-09-17T03:01:04.471 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:01:04.471 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:01:04.471 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T03:01:04.472 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:01:04.472 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:01:04.472 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:01:04.472 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:01:04.472 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:01:04.472 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:01:04.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:04.473 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:01:04.493 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42430sec preferred_lft 42430sec 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:01:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:01:04.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:04.496 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:01:04.562 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T03:01:04.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:04.564 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T03:01:04.622 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T03:01:04.623 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:01:04.623 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:01:04.623 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:01:04.623 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:01:04.623 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:01:04.623 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T03:01:04.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:01:04.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:01:04.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:01:04.623 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T03:01:04.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:01:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:01:04.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:01:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:01:04.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:04.759 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T03:01:04.775 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:01:04.775 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:01:04.775 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:01:04.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:04.775 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T03:01:04.841 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:01:04.841 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:01:04.896 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:01:04.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:01:04.897 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:01:04.952 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:01:04.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:04.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:01:05.047 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:01:05.047 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:01:05.047 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:01:05.058 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:01:05.058 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:01:05.058 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:01:05.058 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:01:05.058 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:01:05.063 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:01:05.063 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:01:05.063 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:01:05.063 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:01:05.063 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:01:05.064 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:01:05.064 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:01:05.064 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:01:05.064 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:01:05.064 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:01:05.064 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:01:05.064 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:01:05.064 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:01:05.066 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:01:05.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:05.066 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:01:05.090 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:01:05.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:01:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:01:05.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:01:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:01:05.187 INFO:teuthology.orchestra.run.smithi192.stdout:client6005 2024-09-17T03:01:05.187 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:01:05.187 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:05.203 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:05.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.320+0000 7f8a896da640 1 -- 172.21.15.104:0/950926846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 msgr2=0x7f8a840b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:05.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.320+0000 7f8a896da640 1 --2- 172.21.15.104:0/950926846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 0x7f8a840b65a0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009820 tx=0x7f8a7402a510 comp rx=0 tx=0).stop 2024-09-17T03:01:05.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.320+0000 7f8a896da640 1 -- 172.21.15.104:0/950926846 shutdown_connections 2024-09-17T03:01:05.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.320+0000 7f8a896da640 1 --2- 172.21.15.104:0/950926846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a840b6ae0 0x7f8a841600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.320+0000 7f8a896da640 1 --2- 172.21.15.104:0/950926846 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 0x7f8a840b65a0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.320+0000 7f8a896da640 1 -- 172.21.15.104:0/950926846 >> 172.21.15.104:0/950926846 conn(0x7f8a84069120 msgr2=0x7f8a84069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:05.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.320+0000 7f8a896da640 1 -- 172.21.15.104:0/950926846 shutdown_connections 2024-09-17T03:01:05.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.320+0000 7f8a896da640 1 -- 172.21.15.104:0/950926846 wait complete. 2024-09-17T03:01:05.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.322+0000 7f8a896da640 1 Processor -- start 2024-09-17T03:01:05.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.322+0000 7f8a896da640 1 -- start start 2024-09-17T03:01:05.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.323+0000 7f8a896da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a840b6ae0 0x7f8a8415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.323+0000 7f8a896da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 0x7f8a840ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.323+0000 7f8a896da640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a841630c0 0x7f8a840ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.323+0000 7f8a896da640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84161e10 con 0x7f8a84162cb0 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.323+0000 7f8a896da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84161c90 con 0x7f8a840b6ae0 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.323+0000 7f8a896da640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8a84161f90 con 0x7f8a841630c0 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 0x7f8a840ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 0x7f8a840ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46722/0 (socket says 172.21.15.104:46722) 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 -- 172.21.15.104:0/2839198463 learned_addr learned my addr 172.21.15.104:0/2839198463 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a82ffd640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a840b6ae0 0x7f8a8415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a837fe640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a841630c0 0x7f8a840ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 -- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a841630c0 msgr2=0x7f8a840ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:05.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a841630c0 0x7f8a840ce790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 -- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a840b6ae0 msgr2=0x7f8a8415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a840b6ae0 0x7f8a8415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 -- 172.21.15.104:0/2839198463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a841e8e20 con 0x7f8a84162cb0 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a827fc640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 0x7f8a840ce250 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c3f0 tx=0x7f8a7800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a6b7fe640 1 -- 172.21.15.104:0/2839198463 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78017070 con 0x7f8a84162cb0 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a6b7fe640 1 -- 172.21.15.104:0/2839198463 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a780035f0 con 0x7f8a84162cb0 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a841e9100 con 0x7f8a84162cb0 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a6b7fe640 1 -- 172.21.15.104:0/2839198463 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78003a40 con 0x7f8a84162cb0 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.324+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a841e96c0 con 0x7f8a84162cb0 2024-09-17T03:01:05.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.325+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a840b65a0 con 0x7f8a84162cb0 2024-09-17T03:01:05.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.326+0000 7f8a6b7fe640 1 -- 172.21.15.104:0/2839198463 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a7801a070 con 0x7f8a84162cb0 2024-09-17T03:01:05.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.327+0000 7f8a6b7fe640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a70078bc0 0x7f8a7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:05.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.327+0000 7f8a6b7fe640 1 -- 172.21.15.104:0/2839198463 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f8a78099f90 con 0x7f8a84162cb0 2024-09-17T03:01:05.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.327+0000 7f8a82ffd640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a70078bc0 0x7f8a7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:05.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.327+0000 7f8a82ffd640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a70078bc0 0x7f8a7007b0d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8a74034000 tx=0x7f8a74004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:05.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.331+0000 7f8a6b7fe640 1 -- 172.21.15.104:0/2839198463 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8a840b6ef0 con 0x7f8a84162cb0 2024-09-17T03:01:05.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.540+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a8406d410 con 0x7f8a84162cb0 2024-09-17T03:01:05.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.541+0000 7f8a6b7fe640 1 -- 172.21.15.104:0/2839198463 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f8a78062520 con 0x7f8a84162cb0 2024-09-17T03:01:05.541 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:05.541 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:01:05.541 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a70078bc0 msgr2=0x7f8a7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a70078bc0 0x7f8a7007b0d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8a74034000 tx=0x7f8a74004730 comp rx=0 tx=0).stop 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 msgr2=0x7f8a840ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 0x7f8a840ce250 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f8a7800c3f0 tx=0x7f8a7800c8b0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 shutdown_connections 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8a70078bc0 0x7f8a7007b0d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a841630c0 0x7f8a840ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8a84162cb0 0x7f8a840ce250 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 --2- 172.21.15.104:0/2839198463 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a840b6ae0 0x7f8a8415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 >> 172.21.15.104:0/2839198463 conn(0x7f8a84069120 msgr2=0x7f8a840d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:05.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 shutdown_connections 2024-09-17T03:01:05.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.543+0000 7f8a896da640 1 -- 172.21.15.104:0/2839198463 wait complete. 2024-09-17T03:01:05.554 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-17T03:01:05.680 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":7044,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.78901113,"mdsmap_epoch":55,"osdmap_epoch":137,"osdmap_epoch_barrier":137,"uptime":16.486678133000002} 2024-09-17T03:01:05.680 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 7044, "mdsmap_epoch": 55, "osdmap_epoch": 137, "osdmap_epoch_barrier": 137, "rank_uptime": 11.78901113, "state": "up:active", "uptime": 16.486678133, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:01:05.680 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-17T03:01:05.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 -- 172.21.15.104:0/1006155056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 msgr2=0x7fc828070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:05.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 --2- 172.21.15.104:0/1006155056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 0x7fc828070120 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fc828070a90 tx=0x7fc82002aa30 comp rx=0 tx=0).stop 2024-09-17T03:01:05.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 -- 172.21.15.104:0/1006155056 shutdown_connections 2024-09-17T03:01:05.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 --2- 172.21.15.104:0/1006155056 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 0x7fc828070120 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 --2- 172.21.15.104:0/1006155056 >> v2:172.21.15.192:3300/0 conn(0x7fc828152c00 0x7fc8280b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 --2- 172.21.15.104:0/1006155056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc82815c290 0x7fc8280725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 -- 172.21.15.104:0/1006155056 >> 172.21.15.104:0/1006155056 conn(0x7fc828069610 msgr2=0x7fc8280b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:05.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 -- 172.21.15.104:0/1006155056 shutdown_connections 2024-09-17T03:01:05.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.798+0000 7fc82ff01640 1 -- 172.21.15.104:0/1006155056 wait complete. 2024-09-17T03:01:05.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.800+0000 7fc82ff01640 1 Processor -- start 2024-09-17T03:01:05.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.800+0000 7fc82ff01640 1 -- start start 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82ff01640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 0x7fc828156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82ff01640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc828152c00 0x7fc828156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82ff01640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc82815c290 0x7fc8280cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82ff01640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc8280b3e00 con 0x7fc82806fd10 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82ff01640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc8280b3c80 con 0x7fc82815c290 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82ff01640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc8280b3f80 con 0x7fc828152c00 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82dc9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 0x7fc828156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82dc9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 0x7fc828156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46736/0 (socket says 172.21.15.104:46736) 2024-09-17T03:01:05.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82dc9d640 1 -- 172.21.15.104:0/2147968412 learned_addr learned my addr 172.21.15.104:0/2147968412 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.801+0000 7fc82d49c640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc828152c00 0x7fc828156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82e49e640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc82815c290 0x7fc8280cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82dc9d640 1 -- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc828152c00 msgr2=0x7fc828156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82dc9d640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc828152c00 0x7fc828156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82dc9d640 1 -- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc82815c290 msgr2=0x7fc8280cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82dc9d640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc82815c290 0x7fc8280cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82dc9d640 1 -- 172.21.15.104:0/2147968412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc828157810 con 0x7fc82806fd10 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82e49e640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc82815c290 0x7fc8280cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82dc9d640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 0x7fc828156a50 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fc81800e7f0 tx=0x7fc81800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc8267fc640 1 -- 172.21.15.104:0/2147968412 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81800cc60 con 0x7fc82806fd10 2024-09-17T03:01:05.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc8267fc640 1 -- 172.21.15.104:0/2147968412 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc81800ce20 con 0x7fc82806fd10 2024-09-17T03:01:05.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8281432d0 con 0x7fc82806fd10 2024-09-17T03:01:05.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc8267fc640 1 -- 172.21.15.104:0/2147968412 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818005280 con 0x7fc82806fd10 2024-09-17T03:01:05.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.802+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc828143890 con 0x7fc82806fd10 2024-09-17T03:01:05.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.803+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8280b4e30 con 0x7fc82806fd10 2024-09-17T03:01:05.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.804+0000 7fc8267fc640 1 -- 172.21.15.104:0/2147968412 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc818005420 con 0x7fc82806fd10 2024-09-17T03:01:05.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.804+0000 7fc8267fc640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc814078b90 0x7fc81407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:05.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.804+0000 7fc8267fc640 1 -- 172.21.15.104:0/2147968412 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7fc81809b5c0 con 0x7fc82806fd10 2024-09-17T03:01:05.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.804+0000 7fc82d49c640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc814078b90 0x7fc81407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:05.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.805+0000 7fc82d49c640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc814078b90 0x7fc81407b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc82815a940 tx=0x7fc81c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:05.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.809+0000 7fc8267fc640 1 -- 172.21.15.104:0/2147968412 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc818063b20 con 0x7fc82806fd10 2024-09-17T03:01:05.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:05.985+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7fc8280701c0 con 0x7fc82806fd10 2024-09-17T03:01:06.162 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:01:06.165 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:01:06.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.929+0000 7fc8267fc640 1 -- 172.21.15.104:0/2147968412 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v138) ==== 181+0+0 (secure 0 0 0) 0x7fc818063420 con 0x7fc82806fd10 2024-09-17T03:01:06.929 INFO:teuthology.orchestra.run.smithi104.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-17T03:01:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc814078b90 msgr2=0x7fc81407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc814078b90 0x7fc81407b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc82815a940 tx=0x7fc81c005f90 comp rx=0 tx=0).stop 2024-09-17T03:01:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 msgr2=0x7fc828156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 0x7fc828156a50 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fc81800e7f0 tx=0x7fc81800ecb0 comp rx=0 tx=0).stop 2024-09-17T03:01:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 shutdown_connections 2024-09-17T03:01:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc814078b90 0x7fc81407b0a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc82815c290 0x7fc8280cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:06.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc828152c00 0x7fc828156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:06.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 --2- 172.21.15.104:0/2147968412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc82806fd10 0x7fc828156a50 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:06.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 >> 172.21.15.104:0/2147968412 conn(0x7fc828069610 msgr2=0x7fc828160050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:06.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 shutdown_connections 2024-09-17T03:01:06.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:06.932+0000 7fc82ff01640 1 -- 172.21.15.104:0/2147968412 wait complete. 2024-09-17T03:01:06.944 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-17T03:01:07.063 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_mon_report_interval":"5"} 2024-09-17T03:01:07.063 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-17T03:01:07.063 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-17T03:01:07.064 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:07.064 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:07.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:07.079 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-17T03:01:07.208 INFO:teuthology.orchestra.run.smithi104.stderr:16+0 records in 2024-09-17T03:01:07.208 INFO:teuthology.orchestra.run.smithi104.stderr:16+0 records out 2024-09-17T03:01:07.208 INFO:teuthology.orchestra.run.smithi104.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0659799 s, 254 MB/s 2024-09-17T03:01:07.208 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:07.208 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:07.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:07.225 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-17T03:01:07.377 INFO:teuthology.orchestra.run.smithi104.stderr:17+0 records in 2024-09-17T03:01:07.377 INFO:teuthology.orchestra.run.smithi104.stderr:17+0 records out 2024-09-17T03:01:07.377 INFO:teuthology.orchestra.run.smithi104.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0945237 s, 189 MB/s 2024-09-17T03:01:07.377 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-17T03:01:07.378 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:07.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.490+0000 7f0280f5e640 1 -- 172.21.15.104:0/3654669026 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0268003a00 msgr2=0x7f0268003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:07.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.490+0000 7f0280f5e640 1 --2- 172.21.15.104:0/3654669026 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0268003a00 0x7f0268003e70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0274009ed0 tx=0x7f0268005830 comp rx=0 tx=0).stop 2024-09-17T03:01:07.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.490+0000 7f027ad9d640 1 -- 172.21.15.104:0/3654669026 reap_dead start 2024-09-17T03:01:07.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.490+0000 7f0280f5e640 1 -- 172.21.15.104:0/3654669026 shutdown_connections 2024-09-17T03:01:07.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.490+0000 7f0280f5e640 1 -- 172.21.15.104:0/3654669026 >> 172.21.15.104:0/3654669026 conn(0x7f027c0b2450 msgr2=0x7f027c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:07.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.490+0000 7f0280f5e640 1 -- 172.21.15.104:0/3654669026 shutdown_connections 2024-09-17T03:01:07.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.490+0000 7f0280f5e640 1 -- 172.21.15.104:0/3654669026 wait complete. 2024-09-17T03:01:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.492+0000 7f0280f5e640 1 Processor -- start 2024-09-17T03:01:07.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.492+0000 7f0280f5e640 1 -- start start 2024-09-17T03:01:07.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0280f5e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0268003a00 0x7f027c1f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0280f5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f027c154ad0 0x7f027c152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0280f5e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c153270 0x7f027c153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0280f5e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f027c0b3c90 con 0x7f027c154ad0 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0280f5e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f027c06fe60 con 0x7f0268003a00 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0280f5e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f027c0b3e10 con 0x7f027c153270 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0279d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f027c154ad0 0x7f027c152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0279d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f027c154ad0 0x7f027c152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46748/0 (socket says 172.21.15.104:46748) 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f027a59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0268003a00 0x7f027c1f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0279d9b640 1 -- 172.21.15.104:0/806821095 learned_addr learned my addr 172.21.15.104:0/806821095 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f027ad9d640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c153270 0x7f027c153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0279d9b640 1 -- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c153270 msgr2=0x7f027c153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0279d9b640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c153270 0x7f027c153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:07.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0279d9b640 1 -- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0268003a00 msgr2=0x7f027c1f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0279d9b640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0268003a00 0x7f027c1f33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.493+0000 7f0279d9b640 1 -- 172.21.15.104:0/806821095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c1550b0 con 0x7f027c154ad0 2024-09-17T03:01:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.494+0000 7f0279d9b640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f027c154ad0 0x7f027c152d30 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0264006630 tx=0x7f02640039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.494+0000 7f0272ffd640 1 -- 172.21.15.104:0/806821095 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264015070 con 0x7f027c154ad0 2024-09-17T03:01:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.494+0000 7f0272ffd640 1 -- 172.21.15.104:0/806821095 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0264011860 con 0x7f027c154ad0 2024-09-17T03:01:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.494+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c152250 con 0x7f027c154ad0 2024-09-17T03:01:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.494+0000 7f0272ffd640 1 -- 172.21.15.104:0/806821095 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264011cb0 con 0x7f027c154ad0 2024-09-17T03:01:07.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.494+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c14ecd0 con 0x7f027c154ad0 2024-09-17T03:01:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.495+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027c0b3750 con 0x7f027c154ad0 2024-09-17T03:01:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.496+0000 7f0272ffd640 1 -- 172.21.15.104:0/806821095 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0264018070 con 0x7f027c154ad0 2024-09-17T03:01:07.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.496+0000 7f0272ffd640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f025c078b90 0x7f025c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:07.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.496+0000 7f0272ffd640 1 -- 172.21.15.104:0/806821095 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f026409bab0 con 0x7f027c154ad0 2024-09-17T03:01:07.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.497+0000 7f027a59c640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f025c078b90 0x7f025c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:07.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.498+0000 7f027a59c640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f025c078b90 0x7f025c07b0a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0274009ed0 tx=0x7f027402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:07.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.500+0000 7f0272ffd640 1 -- 172.21.15.104:0/806821095 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0264063930 con 0x7f027c154ad0 2024-09-17T03:01:07.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.673+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f027c0b1f00 con 0x7f027c154ad0 2024-09-17T03:01:07.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.674+0000 7f0272ffd640 1 -- 172.21.15.104:0/806821095 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) ==== 81+0+34274 (secure 0 0 0) 0x7f0264068360 con 0x7f027c154ad0 2024-09-17T03:01:07.674 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:07.675 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:07.675 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 138, 2024-09-17T03:01:07.675 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:07.675 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:07.675 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:06.925302+0000", 2024-09-17T03:01:07.675 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:07.675 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:07.675 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:07.676 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:07.677 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:07.678 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:07.679 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:07.680 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:07.681 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:07.682 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:07.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:07.684 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.685 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:07.686 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:07.687 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:07.688 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:07.689 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:07.690 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.691 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:07.692 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:07.693 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:07.694 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "138", 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:07.695 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:07.696 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:07.696 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:07.696 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:07.696 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:07.696 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:07.696 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:07.696 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:07.696 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:07.697 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:07.697 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:07.697 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:07.697 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:07.697 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:07.697 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:07.698 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:07.698 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:07.698 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:07.698 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:07.699 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:07.701 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:07.702 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:07.703 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.704 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:07.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:07.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.707 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:07.707 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:07.707 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.707 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.707 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:07.708 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.711 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:07.712 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:07.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:07.714 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:07.715 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:07.716 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.718 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.718 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:07.718 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:07.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.718 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.718 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:07.718 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:07.719 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:07.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:07.721 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:07.722 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:07.723 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.724 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.726 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:07.727 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:07.728 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:07.729 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:07.730 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.731 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.732 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.734 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:07.736 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.737 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:07.738 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:07.739 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:07.740 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.740 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.740 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:07.740 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.740 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.741 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:07.741 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:07.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.741 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.741 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:07.741 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:07.741 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.743 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:07.743 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:07.743 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:07.743 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:07.743 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:07.743 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:07.743 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:07.743 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:07.744 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:07.744 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:07.744 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:07.744 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:07.744 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:07.744 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.745 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.745 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:07.745 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:07.745 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.745 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.746 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:07.746 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:07.746 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.746 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.746 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:07.747 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.747 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.747 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:07.747 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.748 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.749 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:07.750 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:07.751 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:07.751 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:07.751 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:07.751 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:07.751 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:07.751 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:07.752 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.753 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.754 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:07.755 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.756 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:07.757 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:07.758 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.760 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.762 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:07.763 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:07.764 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:07.765 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:07.766 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:07.767 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:07.767 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:07.767 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:07.767 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:07.767 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f025c078b90 msgr2=0x7f025c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f025c078b90 0x7f025c07b0a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0274009ed0 tx=0x7f027402d040 comp rx=0 tx=0).stop 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f027c154ad0 msgr2=0x7f027c152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f027c154ad0 0x7f027c152d30 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0264006630 tx=0x7f02640039c0 comp rx=0 tx=0).stop 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 shutdown_connections 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f025c078b90 0x7f025c07b0a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c153270 0x7f027c153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f027c154ad0 0x7f027c152d30 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 --2- 172.21.15.104:0/806821095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0268003a00 0x7f027c1f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:07.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 >> 172.21.15.104:0/806821095 conn(0x7f027c0b2450 msgr2=0x7f027c072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:07.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 shutdown_connections 2024-09-17T03:01:07.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:07.677+0000 7f0280f5e640 1 -- 172.21.15.104:0/806821095 wait complete. 2024-09-17T03:01:07.770 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T03:01:12.771 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:12.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 -- 172.21.15.104:0/3930787506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d0fd0 msgr2=0x7ff7ac160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:12.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3930787506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d0fd0 0x7ff7ac160ec0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0b5cb0 tx=0x7ff79402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:01:12.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 -- 172.21.15.104:0/3930787506 shutdown_connections 2024-09-17T03:01:12.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3930787506 >> v2:172.21.15.192:3300/0 conn(0x7ff7ac0d13e0 0x7ff7ac161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:12.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3930787506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d0fd0 0x7ff7ac160ec0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:12.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3930787506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7ac0d3490 0x7ff7ac0b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:12.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 -- 172.21.15.104:0/3930787506 >> 172.21.15.104:0/3930787506 conn(0x7ff7ac0d2970 msgr2=0x7ff7ac0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:12.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 -- 172.21.15.104:0/3930787506 shutdown_connections 2024-09-17T03:01:12.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.898+0000 7ff7b1700640 1 -- 172.21.15.104:0/3930787506 wait complete. 2024-09-17T03:01:12.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.900+0000 7ff7b1700640 1 Processor -- start 2024-09-17T03:01:12.899 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.900+0000 7ff7b1700640 1 -- start start 2024-09-17T03:01:12.902 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7b1700640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7ac0d0fd0 0x7ff7ac152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7b1700640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d13e0 0x7ff7ac160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7b1700640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7ac0d3490 0x7ff7ac1610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7b1700640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac0b2270 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7b1700640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac0b20f0 con 0x7ff7ac0d3490 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7b1700640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac0b23f0 con 0x7ff7ac0d0fd0 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7a27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d13e0 0x7ff7ac160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7a27fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d13e0 0x7ff7ac160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46772/0 (socket says 172.21.15.104:46772) 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7a27fc640 1 -- 172.21.15.104:0/3473042137 learned_addr learned my addr 172.21.15.104:0/3473042137 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7aaffd640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7ac0d0fd0 0x7ff7ac152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7ab7fe640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7ac0d3490 0x7ff7ac1610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7a27fc640 1 -- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7ac0d0fd0 msgr2=0x7ff7ac152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7a27fc640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7ac0d0fd0 0x7ff7ac152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7a27fc640 1 -- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7ac0d3490 msgr2=0x7ff7ac1610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:12.903 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7a27fc640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7ac0d3490 0x7ff7ac1610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:12.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.902+0000 7ff7a27fc640 1 -- 172.21.15.104:0/3473042137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac0c8c90 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.903+0000 7ff7a27fc640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d13e0 0x7ff7ac160b90 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ff794034040 tx=0x7ff794003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:12.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.903+0000 7ff7a3fff640 1 -- 172.21.15.104:0/3473042137 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79403e030 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.903+0000 7ff7a3fff640 1 -- 172.21.15.104:0/3473042137 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff794003e00 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.903+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac0c8f70 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.903+0000 7ff7a3fff640 1 -- 172.21.15.104:0/3473042137 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794035040 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.903+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac0cb6e0 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.904+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ac0b7c80 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.905+0000 7ff7a3fff640 1 -- 172.21.15.104:0/3473042137 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff794041030 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.905+0000 7ff7a3fff640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff78c078b90 0x7ff78c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:12.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.905+0000 7ff7a3fff640 1 -- 172.21.15.104:0/3473042137 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7ff7940bb410 con 0x7ff7ac0d13e0 2024-09-17T03:01:12.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.906+0000 7ff7aaffd640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff78c078b90 0x7ff78c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:12.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.906+0000 7ff7aaffd640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff78c078b90 0x7ff78c07b0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff79c004630 tx=0x7ff79c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:12.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:12.910+0000 7ff7a3fff640 1 -- 172.21.15.104:0/3473042137 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff794083200 con 0x7ff7ac0d13e0 2024-09-17T03:01:13.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.087+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff7ac0c8a20 con 0x7ff7ac0d13e0 2024-09-17T03:01:13.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.088+0000 7ff7a3fff640 1 -- 172.21.15.104:0/3473042137 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) ==== 81+0+34274 (secure 0 0 0) 0x7ff794087c30 con 0x7ff7ac0d13e0 2024-09-17T03:01:13.088 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:13.088 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:13.088 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 138, 2024-09-17T03:01:13.088 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:13.088 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:13.088 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:06.925302+0000", 2024-09-17T03:01:13.088 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:13.088 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:13.089 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:13.090 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:13.091 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:13.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:13.093 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.094 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:13.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:13.096 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:13.097 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:13.098 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:13.099 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:13.100 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:13.101 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:13.104 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:13.105 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "138", 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:13.106 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:13.107 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:13.108 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:13.109 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:13.110 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:13.113 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:13.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:13.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:13.116 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:13.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:13.118 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:13.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:13.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:13.121 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.124 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.125 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.126 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.127 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:13.128 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:13.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:13.130 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:13.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:13.132 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:13.133 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:13.134 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:13.135 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.136 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:13.140 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.141 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.142 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.143 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:13.144 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:13.145 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.146 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:13.149 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.150 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.150 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.150 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:13.150 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:13.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.150 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.150 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.150 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:13.151 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:13.152 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.153 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.154 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:13.155 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:13.156 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.157 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.158 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:13.159 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:13.160 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:13.162 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:13.163 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:13.164 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:13.165 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:13.166 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:13.166 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:13.166 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:13.166 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:13.166 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:13.166 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:13.166 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff78c078b90 msgr2=0x7ff78c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff78c078b90 0x7ff78c07b0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff79c004630 tx=0x7ff79c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d13e0 msgr2=0x7ff7ac160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d13e0 0x7ff7ac160b90 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ff794034040 tx=0x7ff794003910 comp rx=0 tx=0).stop 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 shutdown_connections 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff78c078b90 0x7ff78c07b0a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7ac0d3490 0x7ff7ac1610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff7ac0d13e0 0x7ff7ac160b90 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:13.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 --2- 172.21.15.104:0/3473042137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff7ac0d0fd0 0x7ff7ac152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:13.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 >> 172.21.15.104:0/3473042137 conn(0x7ff7ac0d2970 msgr2=0x7ff7ac071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:13.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 shutdown_connections 2024-09-17T03:01:13.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:13.090+0000 7ff7b1700640 1 -- 172.21.15.104:0/3473042137 wait complete. 2024-09-17T03:01:13.169 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T03:01:18.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:18.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.297+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/452378878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eb815b7f0 msgr2=0x7f6eb815bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:18.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.297+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/452378878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eb815b7f0 0x7f6eb815bc00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6eb806ecb0 tx=0x7f6eb002a6f0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.297+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/452378878 shutdown_connections 2024-09-17T03:01:18.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.297+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/452378878 >> v2:172.21.15.192:3300/0 conn(0x7f6eb8072470 0x7f6eb8072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.297+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/452378878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eb815b7f0 0x7f6eb815bc00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.297+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/452378878 >> 172.21.15.104:0/452378878 conn(0x7f6eb80b2450 msgr2=0x7f6eb80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:18.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.297+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/452378878 shutdown_connections 2024-09-17T03:01:18.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.297+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/452378878 wait complete. 2024-09-17T03:01:18.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.299+0000 7f6ebd6fa640 1 Processor -- start 2024-09-17T03:01:18.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.299+0000 7f6ebd6fa640 1 -- start start 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6ebd6fa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb8072470 0x7f6eb814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6ebd6fa640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eb8072dc0 0x7f6eb806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6ebd6fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb815b7f0 0x7f6eb806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6ebd6fa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb815fe30 con 0x7f6eb815b7f0 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6ebd6fa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb80cf4a0 con 0x7f6eb8072470 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6ebd6fa640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb815ffb0 con 0x7f6eb8072dc0 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6eb77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb815b7f0 0x7f6eb806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6eb6ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb8072470 0x7f6eb814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6eb77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb815b7f0 0x7f6eb806f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45088/0 (socket says 172.21.15.104:45088) 2024-09-17T03:01:18.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6eb67fc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eb8072dc0 0x7f6eb806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.300+0000 7f6eb77fe640 1 -- 172.21.15.104:0/91372085 learned_addr learned my addr 172.21.15.104:0/91372085 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eb77fe640 1 -- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eb8072dc0 msgr2=0x7f6eb806ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eb77fe640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eb8072dc0 0x7f6eb806ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eb77fe640 1 -- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb8072470 msgr2=0x7f6eb814d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eb77fe640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb8072470 0x7f6eb814d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eb77fe640 1 -- 172.21.15.104:0/91372085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb81f75d0 con 0x7f6eb815b7f0 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eb77fe640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb815b7f0 0x7f6eb806f2a0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c4d0 tx=0x7f6ea800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eaf7fe640 1 -- 172.21.15.104:0/91372085 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8017070 con 0x7f6eb815b7f0 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eaf7fe640 1 -- 172.21.15.104:0/91372085 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ea80035f0 con 0x7f6eb815b7f0 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb814d690 con 0x7f6eb815b7f0 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6eaf7fe640 1 -- 172.21.15.104:0/91372085 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8003a40 con 0x7f6eb815b7f0 2024-09-17T03:01:18.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.301+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb81f7b90 con 0x7f6eb815b7f0 2024-09-17T03:01:18.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.302+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb80cc960 con 0x7f6eb815b7f0 2024-09-17T03:01:18.303 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.303+0000 7f6eaf7fe640 1 -- 172.21.15.104:0/91372085 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ea801a070 con 0x7f6eb815b7f0 2024-09-17T03:01:18.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.303+0000 7f6eaf7fe640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e98078bc0 0x7f6e9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:18.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.303+0000 7f6eaf7fe640 1 -- 172.21.15.104:0/91372085 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f6ea809a050 con 0x7f6eb815b7f0 2024-09-17T03:01:18.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.304+0000 7f6eaf7fe640 1 -- 172.21.15.104:0/91372085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=140}) -- 0x7f6e98080740 con 0x7f6eb815b7f0 2024-09-17T03:01:18.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.304+0000 7f6eb6ffd640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e98078bc0 0x7f6e9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:18.304 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.304+0000 7f6eb6ffd640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e98078bc0 0x7f6e9807b0d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0033000 tx=0x7f6eb0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:18.307 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.308+0000 7f6eaf7fe640 1 -- 172.21.15.104:0/91372085 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6eb80cc960 con 0x7f6eb815b7f0 2024-09-17T03:01:18.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.485+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f6eb81f7340 con 0x7f6eb815b7f0 2024-09-17T03:01:18.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.486+0000 7f6eaf7fe640 1 -- 172.21.15.104:0/91372085 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) ==== 81+0+34293 (secure 0 0 0) 0x7f6ea8061ed0 con 0x7f6eb815b7f0 2024-09-17T03:01:18.486 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:18.486 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:18.486 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 139, 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:13.141837+0000", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:18.487 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:18.488 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:18.489 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:18.490 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:18.491 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:18.492 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:18.493 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:18.494 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:18.495 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:18.496 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:18.497 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:18.498 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:18.499 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.500 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:18.501 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1027, 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:18.502 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:18.503 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "139", 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:18.504 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:18.505 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:18.506 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:18.508 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:18.509 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.512 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:18.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:18.514 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:18.515 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:18.516 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:18.517 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:18.518 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:18.519 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:18.520 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:18.521 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.522 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:18.525 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:18.526 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:18.527 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:18.528 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:18.529 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.530 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.531 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:18.533 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:18.538 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:18.539 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.540 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.541 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.542 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:18.543 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:18.544 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.545 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.546 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.547 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.548 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:18.549 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:18.550 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.551 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.552 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:18.553 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:18.554 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:18.555 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:18.556 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:18.557 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:18.557 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:18.557 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:18.557 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:18.557 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:18.557 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:18.557 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:18.560 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.561 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:18.562 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:18.563 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:18.564 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:18.565 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:18.566 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:18.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e98078bc0 msgr2=0x7f6e9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:18.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e98078bc0 0x7f6e9807b0d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0033000 tx=0x7f6eb0004ab0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb815b7f0 msgr2=0x7f6eb806f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb815b7f0 0x7f6eb806f2a0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800c4d0 tx=0x7f6ea800c990 comp rx=0 tx=0).stop 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 shutdown_connections 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e98078bc0 0x7f6e9807b0d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6eb815b7f0 0x7f6eb806f2a0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6eb8072dc0 0x7f6eb806ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 --2- 172.21.15.104:0/91372085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6eb8072470 0x7f6eb814d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 >> 172.21.15.104:0/91372085 conn(0x7f6eb80b2450 msgr2=0x7f6eb8158650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 shutdown_connections 2024-09-17T03:01:18.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.489+0000 7f6ebd6fa640 1 -- 172.21.15.104:0/91372085 wait complete. 2024-09-17T03:01:18.570 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-17T03:01:18.570 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:18.570 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:18.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:18.586 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-17T03:01:18.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:01:18.787 INFO:teuthology.orchestra.run.smithi104.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-17T03:01:18.787 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records in 2024-09-17T03:01:18.787 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records out 2024-09-17T03:01:18.787 INFO:teuthology.orchestra.run.smithi104.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.140698 s, 373 MB/s 2024-09-17T03:01:18.788 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:18.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.900+0000 7f76ce269640 1 -- 172.21.15.104:0/1254352631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76b00053a0 msgr2=0x7f76b000ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:18.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.900+0000 7f76ce269640 1 --2- 172.21.15.104:0/1254352631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76b00053a0 0x7f76b000ba20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f76c0001c80 tx=0x7f76b0005830 comp rx=0 tx=0).stop 2024-09-17T03:01:18.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.900+0000 7f76ce269640 1 -- 172.21.15.104:0/1254352631 shutdown_connections 2024-09-17T03:01:18.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.900+0000 7f76ce269640 1 --2- 172.21.15.104:0/1254352631 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76b00053a0 0x7f76b000ba20 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.900+0000 7f76ce269640 1 -- 172.21.15.104:0/1254352631 >> 172.21.15.104:0/1254352631 conn(0x7f76c80b4400 msgr2=0x7f76c80b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:18.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.900+0000 7f76ce269640 1 -- 172.21.15.104:0/1254352631 shutdown_connections 2024-09-17T03:01:18.900 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.900+0000 7f76ce269640 1 -- 172.21.15.104:0/1254352631 wait complete. 2024-09-17T03:01:18.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.902+0000 7f76ce269640 1 Processor -- start 2024-09-17T03:01:18.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.902+0000 7f76ce269640 1 -- start start 2024-09-17T03:01:18.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.903+0000 7f76ce269640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76b00053a0 0x7f76c81516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:18.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.903+0000 7f76ce269640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c806eac0 0x7f76c81525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:18.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.903+0000 7f76ce269640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c8151fc0 0x7f76c8152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:18.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.903+0000 7f76ce269640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f76c8161580 con 0x7f76c8151fc0 2024-09-17T03:01:18.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.903+0000 7f76ce269640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76c80b5340 con 0x7f76c806eac0 2024-09-17T03:01:18.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.903+0000 7f76ce269640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f76c8161700 con 0x7f76b00053a0 2024-09-17T03:01:18.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c8151fc0 0x7f76c8152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c8151fc0 0x7f76c8152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45110/0 (socket says 172.21.15.104:45110) 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 -- 172.21.15.104:0/2209624751 learned_addr learned my addr 172.21.15.104:0/2209624751 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76c7fff640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76b00053a0 0x7f76c81516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 -- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76b00053a0 msgr2=0x7f76c81516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76b00053a0 0x7f76c81516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 -- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c806eac0 msgr2=0x7f76c81525c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c806eac0 0x7f76c81525c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 -- 172.21.15.104:0/2209624751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c815ecf0 con 0x7f76c8151fc0 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76cc806640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c8151fc0 0x7f76c8152b00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f76c0001da0 tx=0x7f76c0006690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76c4ff9640 1 -- 172.21.15.104:0/2209624751 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0006c80 con 0x7f76c8151fc0 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76c4ff9640 1 -- 172.21.15.104:0/2209624751 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76c0033530 con 0x7f76c8151fc0 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76c4ff9640 1 -- 172.21.15.104:0/2209624751 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0033940 con 0x7f76c8151fc0 2024-09-17T03:01:18.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c815b520 con 0x7f76c8151fc0 2024-09-17T03:01:18.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.904+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c815f240 con 0x7f76c8151fc0 2024-09-17T03:01:18.906 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.905+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c815b290 con 0x7f76c8151fc0 2024-09-17T03:01:18.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.906+0000 7f76c4ff9640 1 -- 172.21.15.104:0/2209624751 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f76c0033ae0 con 0x7f76c8151fc0 2024-09-17T03:01:18.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.906+0000 7f76c4ff9640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b4078b90 0x7f76b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:18.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.906+0000 7f76c4ff9640 1 -- 172.21.15.104:0/2209624751 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f76c00baf30 con 0x7f76c8151fc0 2024-09-17T03:01:18.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.907+0000 7f76c4ff9640 1 -- 172.21.15.104:0/2209624751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=140}) -- 0x7f76b4080710 con 0x7f76c8151fc0 2024-09-17T03:01:18.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.907+0000 7f76c7fff640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b4078b90 0x7f76b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:18.907 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.907+0000 7f76c7fff640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b4078b90 0x7f76b407b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f76b8001eb0 tx=0x7f76b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:18.910 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:18.911+0000 7f76c4ff9640 1 -- 172.21.15.104:0/2209624751 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f76c0083400 con 0x7f76c8151fc0 2024-09-17T03:01:19.086 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.087+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f76c80b22d0 con 0x7f76c8151fc0 2024-09-17T03:01:19.087 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.088+0000 7f76c4ff9640 1 -- 172.21.15.104:0/2209624751 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) ==== 81+0+34293 (secure 0 0 0) 0x7f76c0082d00 con 0x7f76c8151fc0 2024-09-17T03:01:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:19.088 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 139, 2024-09-17T03:01:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:19.088 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:13.141837+0000", 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:19.089 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:19.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:19.091 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:19.092 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:19.093 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:19.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:19.095 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:19.096 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:19.097 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:19.098 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:19.099 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:19.100 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:19.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:19.102 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:19.103 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1027, 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:19.104 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:19.105 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "139", 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:19.106 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:19.107 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:19.108 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.109 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:19.110 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:19.111 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.112 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.115 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:19.117 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.120 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:19.122 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:19.123 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:19.124 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.127 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:19.128 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:19.129 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:19.130 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:19.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:19.132 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.133 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:19.134 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:19.135 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:19.136 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:19.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:19.138 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:19.139 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:19.140 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:19.141 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:19.142 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.143 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.144 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.145 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:19.147 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:19.148 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:19.149 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.150 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.151 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:19.152 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:19.153 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.154 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:19.155 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.156 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:19.157 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:19.158 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.159 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:19.160 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:19.161 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.162 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:19.163 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:19.164 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:19.165 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:19.166 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:19.167 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:19.167 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:19.167 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:19.167 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:19.167 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:19.167 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:19.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b4078b90 msgr2=0x7f76b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b4078b90 0x7f76b407b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f76b8001eb0 tx=0x7f76b8009040 comp rx=0 tx=0).stop 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c8151fc0 msgr2=0x7f76c8152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c8151fc0 0x7f76c8152b00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f76c0001da0 tx=0x7f76c0006690 comp rx=0 tx=0).stop 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 shutdown_connections 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f76b4078b90 0x7f76b407b0a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76c806eac0 0x7f76c81525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f76c8151fc0 0x7f76c8152b00 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 --2- 172.21.15.104:0/2209624751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76b00053a0 0x7f76c81516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 >> 172.21.15.104:0/2209624751 conn(0x7f76c80b4400 msgr2=0x7f76c80b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 shutdown_connections 2024-09-17T03:01:19.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.091+0000 7f76ce269640 1 -- 172.21.15.104:0/2209624751 wait complete. 2024-09-17T03:01:19.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:19.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.283+0000 7f7b697f1640 1 -- 172.21.15.104:0/1889908697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b4fc0 msgr2=0x7f7b640b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:19.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.283+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1889908697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b4fc0 0x7f7b640b39c0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7b640a0a60 tx=0x7f7b5402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.283+0000 7f7b697f1640 1 -- 172.21.15.104:0/1889908697 shutdown_connections 2024-09-17T03:01:19.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.283+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1889908697 >> v2:172.21.15.192:3300/0 conn(0x7f7b640b3f00 0x7f7b640b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.283+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1889908697 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b4fc0 0x7f7b640b39c0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.283+0000 7f7b697f1640 1 -- 172.21.15.104:0/1889908697 >> 172.21.15.104:0/1889908697 conn(0x7f7b640b44a0 msgr2=0x7f7b640b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:19.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.283+0000 7f7b697f1640 1 -- 172.21.15.104:0/1889908697 shutdown_connections 2024-09-17T03:01:19.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.283+0000 7f7b697f1640 1 -- 172.21.15.104:0/1889908697 wait complete. 2024-09-17T03:01:19.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.285+0000 7f7b697f1640 1 Processor -- start 2024-09-17T03:01:19.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.285+0000 7f7b697f1640 1 -- start start 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b697f1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b640b3f00 0x7f7b641fa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b697f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b640b4fc0 0x7f7b640ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b697f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b5d20 0x7f7b640b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b697f1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640ce120 con 0x7f7b640b5d20 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b697f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640d0320 con 0x7f7b640b4fc0 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b697f1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7b640cb180 con 0x7f7b640b3f00 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b5d20 0x7f7b640b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b637fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b5d20 0x7f7b640b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45132/0 (socket says 172.21.15.104:45132) 2024-09-17T03:01:19.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b637fe640 1 -- 172.21.15.104:0/1948590171 learned_addr learned my addr 172.21.15.104:0/1948590171 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b627fc640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b640b4fc0 0x7f7b640ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.286+0000 7f7b62ffd640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b640b3f00 0x7f7b641fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b637fe640 1 -- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b640b3f00 msgr2=0x7f7b641fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b637fe640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b640b3f00 0x7f7b641fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b637fe640 1 -- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b640b4fc0 msgr2=0x7f7b640ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b637fe640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b640b4fc0 0x7f7b640ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b637fe640 1 -- 172.21.15.104:0/1948590171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b64160490 con 0x7f7b640b5d20 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b637fe640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b5d20 0x7f7b640b1d20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c3f0 tx=0x7f7b5c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b4b7fe640 1 -- 172.21.15.104:0/1948590171 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c017070 con 0x7f7b640b5d20 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b4b7fe640 1 -- 172.21.15.104:0/1948590171 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b5c0035f0 con 0x7f7b640b5d20 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b64160770 con 0x7f7b640b5d20 2024-09-17T03:01:19.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b4b7fe640 1 -- 172.21.15.104:0/1948590171 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c003a40 con 0x7f7b640b5d20 2024-09-17T03:01:19.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.287+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b6415e290 con 0x7f7b640b5d20 2024-09-17T03:01:19.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.288+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b640b57e0 con 0x7f7b640b5d20 2024-09-17T03:01:19.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.289+0000 7f7b4b7fe640 1 -- 172.21.15.104:0/1948590171 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b5c01a070 con 0x7f7b640b5d20 2024-09-17T03:01:19.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.289+0000 7f7b4b7fe640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7b50078b90 0x7f7b5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:19.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.289+0000 7f7b4b7fe640 1 -- 172.21.15.104:0/1948590171 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f7b5c099ef0 con 0x7f7b640b5d20 2024-09-17T03:01:19.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.290+0000 7f7b4b7fe640 1 -- 172.21.15.104:0/1948590171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=140}) -- 0x7f7b50080770 con 0x7f7b640b5d20 2024-09-17T03:01:19.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.290+0000 7f7b62ffd640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7b50078b90 0x7f7b5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:19.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.290+0000 7f7b62ffd640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7b50078b90 0x7f7b5007b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7b54034000 tx=0x7f7b54004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:19.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.294+0000 7f7b4b7fe640 1 -- 172.21.15.104:0/1948590171 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b5c061ce0 con 0x7f7b640b5d20 2024-09-17T03:01:19.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.501+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b640cead0 con 0x7f7b640b5d20 2024-09-17T03:01:19.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.502+0000 7f7b4b7fe640 1 -- 172.21.15.104:0/1948590171 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f7b5c066710 con 0x7f7b640b5d20 2024-09-17T03:01:19.502 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:19.502 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:01:19.502 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:01:19.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7b50078b90 msgr2=0x7f7b5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7b50078b90 0x7f7b5007b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7b54034000 tx=0x7f7b54004ab0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b5d20 msgr2=0x7f7b640b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b5d20 0x7f7b640b1d20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c3f0 tx=0x7f7b5c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 shutdown_connections 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7b50078b90 0x7f7b5007b0a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b640b4fc0 0x7f7b640ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7b640b5d20 0x7f7b640b1d20 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 --2- 172.21.15.104:0/1948590171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b640b3f00 0x7f7b641fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 >> 172.21.15.104:0/1948590171 conn(0x7f7b640b44a0 msgr2=0x7f7b640c84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 shutdown_connections 2024-09-17T03:01:19.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.504+0000 7f7b697f1640 1 -- 172.21.15.104:0/1948590171 wait complete. 2024-09-17T03:01:19.515 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-17T03:01:19.653 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":7044,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":25.762151471999999,"mdsmap_epoch":55,"osdmap_epoch":139,"osdmap_epoch_barrier":139,"uptime":30.459817931} 2024-09-17T03:01:19.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 7044, "mdsmap_epoch": 55, "osdmap_epoch": 139, "osdmap_epoch_barrier": 139, "rank_uptime": 25.762151472, "state": "up:active", "uptime": 30.459817931, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:01:19.654 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:01:19.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:19.654 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-17T03:01:19.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:19.672 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-17T03:01:19.732 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:19.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.886+0000 7f847924d640 1 -- 172.21.15.104:0/2240067874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 msgr2=0x7f846000b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:19.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.886+0000 7f847924d640 1 --2- 172.21.15.104:0/2240067874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 0x7f846000b9e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f84740b8520 tx=0x7f8460005830 comp rx=0 tx=0).stop 2024-09-17T03:01:19.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.886+0000 7f847924d640 1 -- 172.21.15.104:0/2240067874 shutdown_connections 2024-09-17T03:01:19.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.886+0000 7f847924d640 1 --2- 172.21.15.104:0/2240067874 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 0x7f846000b9e0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.886+0000 7f847924d640 1 -- 172.21.15.104:0/2240067874 >> 172.21.15.104:0/2240067874 conn(0x7f84740d28a0 msgr2=0x7f84740d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:19.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.886+0000 7f847924d640 1 -- 172.21.15.104:0/2240067874 shutdown_connections 2024-09-17T03:01:19.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.886+0000 7f847924d640 1 -- 172.21.15.104:0/2240067874 wait complete. 2024-09-17T03:01:19.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.888+0000 7f847924d640 1 Processor -- start 2024-09-17T03:01:19.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.888+0000 7f847924d640 1 -- start start 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f847924d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 0x7f847409c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f847924d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84741e84f0 0x7f84741e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f847924d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f847409fbd0 0x7f847409ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f847924d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f84740ce220 con 0x7f8460005350 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f847924d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f84740ce0a0 con 0x7f84741e84f0 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f847924d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f84740ce3a0 con 0x7f847409fbd0 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f8472d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 0x7f847409c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f8472d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 0x7f847409c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:45160/0 (socket says 172.21.15.104:45160) 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f8472d9d640 1 -- 172.21.15.104:0/2349429971 learned_addr learned my addr 172.21.15.104:0/2349429971 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f8472d9d640 1 -- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f847409fbd0 msgr2=0x7f847409ffe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:01:19.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f8472d9d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f847409fbd0 0x7f847409ffe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.889+0000 7f8472d9d640 1 -- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84741e84f0 msgr2=0x7f84741e2ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.890+0000 7f8472d9d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84741e84f0 0x7f84741e2ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.890+0000 7f8472d9d640 1 -- 172.21.15.104:0/2349429971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84740a0520 con 0x7f8460005350 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.890+0000 7f8472d9d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 0x7f847409c720 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f846400f650 tx=0x7f846400fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.890+0000 7f846b7fe640 1 -- 172.21.15.104:0/2349429971 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464015070 con 0x7f8460005350 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.890+0000 7f846b7fe640 1 -- 172.21.15.104:0/2349429971 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8464006170 con 0x7f8460005350 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.890+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847409cf70 con 0x7f8460005350 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.890+0000 7f846b7fe640 1 -- 172.21.15.104:0/2349429971 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846400c840 con 0x7f8460005350 2024-09-17T03:01:19.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.890+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847409d530 con 0x7f8460005350 2024-09-17T03:01:19.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.891+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84740d0a90 con 0x7f8460005350 2024-09-17T03:01:19.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.892+0000 7f846b7fe640 1 -- 172.21.15.104:0/2349429971 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8464018070 con 0x7f8460005350 2024-09-17T03:01:19.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.892+0000 7f846b7fe640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8454078bf0 0x7f845407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:19.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.892+0000 7f846b7fe640 1 -- 172.21.15.104:0/2349429971 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f846409b230 con 0x7f8460005350 2024-09-17T03:01:19.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.892+0000 7f846bfff640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8454078bf0 0x7f845407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:19.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.892+0000 7f846b7fe640 1 -- 172.21.15.104:0/2349429971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=140}) -- 0x7f84540807d0 con 0x7f8460005350 2024-09-17T03:01:19.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.893+0000 7f846bfff640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8454078bf0 0x7f845407b100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f845c0057c0 tx=0x7f845c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:19.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:19.897+0000 7f846b7fe640 1 -- 172.21.15.104:0/2349429971 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f846401f020 con 0x7f8460005350 2024-09-17T03:01:20.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.071+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f84740b78f0 con 0x7f8460005350 2024-09-17T03:01:20.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.073+0000 7f846b7fe640 1 -- 172.21.15.104:0/2349429971 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) ==== 81+0+34293 (secure 0 0 0) 0x7f84740a0520 con 0x7f8460005350 2024-09-17T03:01:20.072 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 139, 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:13.141837+0000", 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:20.073 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:01:20.074 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:20.075 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:20.076 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:20.077 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:20.078 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:20.079 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:20.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:20.082 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:20.083 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:20.084 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:20.085 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:20.086 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:20.087 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1027, 2024-09-17T03:01:20.088 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:20.089 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.090 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "139", 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:20.091 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.092 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:20.093 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:20.094 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:20.095 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:20.097 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:20.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:20.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:20.100 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:20.101 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.102 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:20.103 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:20.104 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:20.105 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.106 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.107 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.108 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:20.109 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.110 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:20.111 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:20.112 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:20.113 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:20.114 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:20.115 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:20.116 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:20.117 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:20.118 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:20.119 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:20.120 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:20.121 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:20.122 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.123 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:20.124 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:20.125 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:20.126 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.127 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.128 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:20.129 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.130 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.131 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.132 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.133 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.134 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.135 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:20.136 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.137 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:20.138 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:20.139 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:20.140 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:20.141 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:20.142 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:20.143 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:20.144 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:20.145 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:20.146 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:20.147 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:20.148 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:20.149 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:20.150 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:20.150 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8454078bf0 msgr2=0x7f845407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8454078bf0 0x7f845407b100 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f845c0057c0 tx=0x7f845c005850 comp rx=0 tx=0).stop 2024-09-17T03:01:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 msgr2=0x7f847409c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 0x7f847409c720 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f846400f650 tx=0x7f846400fb10 comp rx=0 tx=0).stop 2024-09-17T03:01:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 shutdown_connections 2024-09-17T03:01:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8454078bf0 0x7f845407b100 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:20.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84741e84f0 0x7f84741e2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f847409fbd0 0x7f847409ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 --2- 172.21.15.104:0/2349429971 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8460005350 0x7f847409c720 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 >> 172.21.15.104:0/2349429971 conn(0x7f84740d28a0 msgr2=0x7f8474071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 shutdown_connections 2024-09-17T03:01:20.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:20.075+0000 7f847924d640 1 -- 172.21.15.104:0/2349429971 wait complete. 2024-09-17T03:01:20.152 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T03:01:25.153 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.281+0000 7f11be407640 1 -- 172.21.15.104:0/1040049621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11b80d0470 msgr2=0x7f11b80d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.281+0000 7f11be407640 1 --2- 172.21.15.104:0/1040049621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11b80d0470 0x7f11b80d0880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f11ac005fd0 tx=0x7f11ac02a4b0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.281+0000 7f11be407640 1 -- 172.21.15.104:0/1040049621 shutdown_connections 2024-09-17T03:01:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.281+0000 7f11be407640 1 --2- 172.21.15.104:0/1040049621 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11b80d0470 0x7f11b80d0880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.281+0000 7f11be407640 1 --2- 172.21.15.104:0/1040049621 >> v2:172.21.15.192:3300/0 conn(0x7f11b80b7bb0 0x7f11b80cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.281+0000 7f11be407640 1 -- 172.21.15.104:0/1040049621 >> 172.21.15.104:0/1040049621 conn(0x7f11b80d28a0 msgr2=0x7f11b80d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.282+0000 7f11be407640 1 -- 172.21.15.104:0/1040049621 shutdown_connections 2024-09-17T03:01:25.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.282+0000 7f11be407640 1 -- 172.21.15.104:0/1040049621 wait complete. 2024-09-17T03:01:25.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.283+0000 7f11be407640 1 Processor -- start 2024-09-17T03:01:25.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.284+0000 7f11be407640 1 -- start start 2024-09-17T03:01:25.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11be407640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11b80b7bb0 0x7f11b80cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11be407640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b80cefb0 0x7f11b81e8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11be407640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11b80d0470 0x7f11b81e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11be407640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f11b80cfad0 con 0x7f11b80cefb0 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11be407640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f11b80ce5e0 con 0x7f11b80b7bb0 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11be407640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f11b80cfc50 con 0x7f11b80d0470 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b80cefb0 0x7f11b81e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b80cefb0 0x7f11b81e8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37494/0 (socket says 172.21.15.104:37494) 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 -- 172.21.15.104:0/2998000327 learned_addr learned my addr 172.21.15.104:0/2998000327 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b7fff640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11b80b7bb0 0x7f11b80cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 -- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11b80d0470 msgr2=0x7f11b81e2c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11b80d0470 0x7f11b81e2c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 -- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11b80b7bb0 msgr2=0x7f11b80cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11b80b7bb0 0x7f11b80cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 -- 172.21.15.104:0/2998000327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b81f6f00 con 0x7f11b80cefb0 2024-09-17T03:01:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.285+0000 7f11b77fe640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b80cefb0 0x7f11b81e8180 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f11ac034040 tx=0x7f11ac0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.286+0000 7f11b4ff9640 1 -- 172.21.15.104:0/2998000327 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac03e030 con 0x7f11b80cefb0 2024-09-17T03:01:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.286+0000 7f11b4ff9640 1 -- 172.21.15.104:0/2998000327 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11ac003ca0 con 0x7f11b80cefb0 2024-09-17T03:01:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.286+0000 7f11b4ff9640 1 -- 172.21.15.104:0/2998000327 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac035040 con 0x7f11b80cefb0 2024-09-17T03:01:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.286+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b81f38c0 con 0x7f11b80cefb0 2024-09-17T03:01:25.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.286+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b81f76e0 con 0x7f11b80cefb0 2024-09-17T03:01:25.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.287+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b81f7170 con 0x7f11b80cefb0 2024-09-17T03:01:25.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.288+0000 7f11b4ff9640 1 -- 172.21.15.104:0/2998000327 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11ac041030 con 0x7f11b80cefb0 2024-09-17T03:01:25.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.288+0000 7f11b4ff9640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f11a4078b90 0x7f11a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:25.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.288+0000 7f11b4ff9640 1 -- 172.21.15.104:0/2998000327 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f11ac0bb6c0 con 0x7f11b80cefb0 2024-09-17T03:01:25.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.288+0000 7f11b4ff9640 1 -- 172.21.15.104:0/2998000327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=140}) -- 0x7f11a4080710 con 0x7f11b80cefb0 2024-09-17T03:01:25.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.288+0000 7f11b7fff640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f11a4078b90 0x7f11a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:25.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.289+0000 7f11b7fff640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f11a4078b90 0x7f11a407b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009590 tx=0x7f11a8005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:25.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.292+0000 7f11b4ff9640 1 -- 172.21.15.104:0/2998000327 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11ac083590 con 0x7f11b80cefb0 2024-09-17T03:01:25.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.466+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f11b80cde90 con 0x7f11b80cefb0 2024-09-17T03:01:25.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.467+0000 7f11b4ff9640 1 -- 172.21.15.104:0/2998000327 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) ==== 81+0+34293 (secure 0 0 0) 0x7f11ac087fc0 con 0x7f11b80cefb0 2024-09-17T03:01:25.467 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:25.467 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:25.467 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 139, 2024-09-17T03:01:25.467 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:13.141837+0000", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:25.468 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:25.469 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:25.470 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:25.471 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:25.472 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:25.473 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:25.474 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:25.475 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.476 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:25.477 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:25.478 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:25.479 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:25.480 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:25.481 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.482 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:25.483 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1027, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:25.484 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:25.485 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "139", 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:25.486 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:25.487 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:25.488 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:25.489 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.490 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:25.491 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.492 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:25.493 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:25.494 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.495 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:25.496 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:25.497 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.498 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.499 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.500 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.501 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:25.502 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:25.503 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.504 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.505 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.506 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:25.507 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:25.508 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:25.509 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:25.510 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.511 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.512 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:25.513 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.514 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:25.515 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:25.516 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:25.517 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:25.518 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:25.519 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:25.520 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:25.521 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:25.522 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:25.523 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.524 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.525 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:25.526 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:25.527 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:25.528 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.529 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:25.530 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.531 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.532 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:25.533 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:25.534 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:25.535 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:25.536 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:25.537 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:25.538 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.539 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:25.540 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:25.541 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:25.542 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:25.543 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:25.544 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:25.544 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:25.544 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:25.544 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:25.544 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:25.545 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f11a4078b90 msgr2=0x7f11a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f11a4078b90 0x7f11a407b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009590 tx=0x7f11a8005f30 comp rx=0 tx=0).stop 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b80cefb0 msgr2=0x7f11b81e8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b80cefb0 0x7f11b81e8180 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f11ac034040 tx=0x7f11ac0038a0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 shutdown_connections 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f11a4078b90 0x7f11a407b0a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11b80d0470 0x7f11b81e2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11b80cefb0 0x7f11b81e8180 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 --2- 172.21.15.104:0/2998000327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11b80b7bb0 0x7f11b80cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 >> 172.21.15.104:0/2998000327 conn(0x7f11b80d28a0 msgr2=0x7f11b80b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 shutdown_connections 2024-09-17T03:01:25.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:25.469+0000 7f11be407640 1 -- 172.21.15.104:0/2998000327 wait complete. 2024-09-17T03:01:25.547 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T03:01:30.548 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:30.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.675+0000 7f99f412b640 1 -- 172.21.15.104:0/2848642139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0d18e0 msgr2=0x7f99ec0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:30.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.675+0000 7f99f412b640 1 --2- 172.21.15.104:0/2848642139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0d18e0 0x7f99ec0d34f0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f99e4005fd0 tx=0x7f99e402a9f0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.675+0000 7f99f412b640 1 -- 172.21.15.104:0/2848642139 shutdown_connections 2024-09-17T03:01:30.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.675+0000 7f99f412b640 1 --2- 172.21.15.104:0/2848642139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0d18e0 0x7f99ec0d34f0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.675+0000 7f99f412b640 1 --2- 172.21.15.104:0/2848642139 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec0b6f70 0x7f99ec15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.675+0000 7f99f412b640 1 -- 172.21.15.104:0/2848642139 >> 172.21.15.104:0/2848642139 conn(0x7f99ec073df0 msgr2=0x7f99ec068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:30.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.675+0000 7f99f412b640 1 -- 172.21.15.104:0/2848642139 shutdown_connections 2024-09-17T03:01:30.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.675+0000 7f99f412b640 1 -- 172.21.15.104:0/2848642139 wait complete. 2024-09-17T03:01:30.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.677+0000 7f99f412b640 1 Processor -- start 2024-09-17T03:01:30.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.677+0000 7f99f412b640 1 -- start start 2024-09-17T03:01:30.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f412b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec0b3b00 0x7f99ec0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:30.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f412b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0b6f70 0x7f99ec148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:30.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f412b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec0d18e0 0x7f99ec1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:30.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f412b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec0d3dc0 con 0x7f99ec0b6f70 2024-09-17T03:01:30.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f412b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f99ec0d3c40 con 0x7f99ec0d18e0 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f412b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f99ec0d3f40 con 0x7f99ec0b3b00 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0b6f70 0x7f99ec148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0b6f70 0x7f99ec148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37524/0 (socket says 172.21.15.104:37524) 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 -- 172.21.15.104:0/3701857439 learned_addr learned my addr 172.21.15.104:0/3701857439 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f1ec7640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec0b3b00 0x7f99ec0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f26c8640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec0d18e0 0x7f99ec1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 -- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec0b3b00 msgr2=0x7f99ec0cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec0b3b00 0x7f99ec0cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 -- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec0d18e0 msgr2=0x7f99ec1493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec0d18e0 0x7f99ec1493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 -- 172.21.15.104:0/3701857439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ec1f6330 con 0x7f99ec0b6f70 2024-09-17T03:01:30.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f16c6640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0b6f70 0x7f99ec148e70 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f99e000b420 tx=0x7f99e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:30.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99ea7fc640 1 -- 172.21.15.104:0/3701857439 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0011830 con 0x7f99ec0b6f70 2024-09-17T03:01:30.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99ea7fc640 1 -- 172.21.15.104:0/3701857439 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99e0016070 con 0x7f99ec0b6f70 2024-09-17T03:01:30.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ec1f6610 con 0x7f99ec0b6f70 2024-09-17T03:01:30.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99ea7fc640 1 -- 172.21.15.104:0/3701857439 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e0011d60 con 0x7f99ec0b6f70 2024-09-17T03:01:30.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.679+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ec1f6bd0 con 0x7f99ec0b6f70 2024-09-17T03:01:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.680+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99ec0d4480 con 0x7f99ec0b6f70 2024-09-17T03:01:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.681+0000 7f99ea7fc640 1 -- 172.21.15.104:0/3701857439 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99e0004020 con 0x7f99ec0b6f70 2024-09-17T03:01:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.682+0000 7f99ea7fc640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f99d8078bc0 0x7f99d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.682+0000 7f99ea7fc640 1 -- 172.21.15.104:0/3701857439 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5767+0+0 (secure 0 0 0) 0x7f99e009ae70 con 0x7f99ec0b6f70 2024-09-17T03:01:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.682+0000 7f99ea7fc640 1 -- 172.21.15.104:0/3701857439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=142}) -- 0x7f99d8080800 con 0x7f99ec0b6f70 2024-09-17T03:01:30.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.683+0000 7f99f1ec7640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f99d8078bc0 0x7f99d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:30.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.684+0000 7f99f1ec7640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f99d8078bc0 0x7f99d807b0d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f99dc005fd0 tx=0x7f99dc005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:30.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.686+0000 7f99ea7fc640 1 -- 172.21.15.104:0/3701857439 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99e0020020 con 0x7f99ec0b6f70 2024-09-17T03:01:30.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.860+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f99ec0cf140 con 0x7f99ec0b6f70 2024-09-17T03:01:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.862+0000 7f99ea7fc640 1 -- 172.21.15.104:0/3701857439 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) ==== 81+0+34665 (secure 0 0 0) 0x7f99e0063350 con 0x7f99ec0b6f70 2024-09-17T03:01:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:30.862 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 141, 2024-09-17T03:01:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:29.187860+0000", 2024-09-17T03:01:30.862 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:30.863 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "luminous", 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:30.864 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:30.865 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:30.866 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:30.867 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:30.868 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:30.869 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:30.870 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:30.871 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:30.872 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.873 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:30.874 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:30.875 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:30.877 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1027, 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:30.878 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:30.879 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "139", 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:30.880 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:30.881 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:30.882 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.883 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.5, 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.5, 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.5, 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.5, 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:30.884 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:30.885 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:30.886 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.887 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.888 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.889 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:30.890 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:30.891 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.892 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.893 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.894 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:30.895 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:30.896 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 140, 2024-09-17T03:01:30.897 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.898 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.899 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:30.900 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:30.901 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:30.902 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:30.902 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:30.902 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:30.902 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:30.903 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:30.904 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.905 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.906 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:30.907 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:30.908 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:30.909 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.910 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.911 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.912 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:30.913 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:30.914 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:30.915 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 140, 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:30.916 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:30.917 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.918 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.919 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:30.920 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:30.921 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:30.922 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.923 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.924 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.925 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:30.926 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:30.927 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.928 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.929 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.930 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:30.931 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.932 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.933 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:30.934 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.935 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:30.936 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:30.937 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:30.938 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [ 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: "pgid": "17.7", 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: "mappings": [ 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: "from": 0, 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: "to": 2 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: "pgid": "17.36", 2024-09-17T03:01:30.939 INFO:teuthology.orchestra.run.smithi104.stdout: "mappings": [ 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: "from": 0, 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: "to": 5 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:30.940 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:30.941 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:30.942 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:30.942 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:30.942 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:30.942 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:30.942 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:30.942 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:30.942 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:30.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f99d8078bc0 msgr2=0x7f99d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:30.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f99d8078bc0 0x7f99d807b0d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f99dc005fd0 tx=0x7f99dc005850 comp rx=0 tx=0).stop 2024-09-17T03:01:30.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0b6f70 msgr2=0x7f99ec148e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:30.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0b6f70 0x7f99ec148e70 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f99e000b420 tx=0x7f99e000b8e0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 shutdown_connections 2024-09-17T03:01:30.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f99d8078bc0 0x7f99d807b0d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99ec0d18e0 0x7f99ec1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f99ec0b6f70 0x7f99ec148e70 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 --2- 172.21.15.104:0/3701857439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f99ec0b3b00 0x7f99ec0cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:30.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 >> 172.21.15.104:0/3701857439 conn(0x7f99ec073df0 msgr2=0x7f99ec0d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:30.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 shutdown_connections 2024-09-17T03:01:30.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:30.864+0000 7f99f412b640 1 -- 172.21.15.104:0/3701857439 wait complete. 2024-09-17T03:01:30.945 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T03:01:35.946 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.073+0000 7f2f48c8b640 1 -- 172.21.15.104:0/574997691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f4415cc30 msgr2=0x7f2f440cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.073+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/574997691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f4415cc30 0x7f2f440cfa80 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2f44072ca0 tx=0x7f2f3c02a820 comp rx=0 tx=0).stop 2024-09-17T03:01:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.073+0000 7f2f48c8b640 1 -- 172.21.15.104:0/574997691 shutdown_connections 2024-09-17T03:01:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.073+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/574997691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f4415cc30 0x7f2f440cfa80 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.073+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/574997691 >> v2:172.21.15.192:3300/0 conn(0x7f2f440cde80 0x7f2f44156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.073+0000 7f2f48c8b640 1 -- 172.21.15.104:0/574997691 >> 172.21.15.104:0/574997691 conn(0x7f2f4406eb90 msgr2=0x7f2f4406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.073+0000 7f2f48c8b640 1 -- 172.21.15.104:0/574997691 shutdown_connections 2024-09-17T03:01:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.073+0000 7f2f48c8b640 1 -- 172.21.15.104:0/574997691 wait complete. 2024-09-17T03:01:36.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.075+0000 7f2f48c8b640 1 Processor -- start 2024-09-17T03:01:36.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.075+0000 7f2f48c8b640 1 -- start start 2024-09-17T03:01:36.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f48c8b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f44073e00 0x7f2f4414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f48c8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4415cc30 0x7f2f44151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f48c8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f441567e0 0x7f2f441519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f48c8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2f440d0350 con 0x7f2f441567e0 2024-09-17T03:01:36.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f48c8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2f440d01d0 con 0x7f2f4415cc30 2024-09-17T03:01:36.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f48c8b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2f440d04d0 con 0x7f2f44073e00 2024-09-17T03:01:36.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f42d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f441567e0 0x7f2f441519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f42d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f441567e0 0x7f2f441519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41244/0 (socket says 172.21.15.104:41244) 2024-09-17T03:01:36.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f42d9d640 1 -- 172.21.15.104:0/2224413446 learned_addr learned my addr 172.21.15.104:0/2224413446 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:36.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.076+0000 7f2f4259c640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f44073e00 0x7f2f4414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f41d9b640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4415cc30 0x7f2f44151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f42d9d640 1 -- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f44073e00 msgr2=0x7f2f4414e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f42d9d640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f44073e00 0x7f2f4414e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f42d9d640 1 -- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4415cc30 msgr2=0x7f2f44151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.078 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f42d9d640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4415cc30 0x7f2f44151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f42d9d640 1 -- 172.21.15.104:0/2224413446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4414f120 con 0x7f2f441567e0 2024-09-17T03:01:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f42d9d640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f441567e0 0x7f2f441519c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009b30 tx=0x7f2f3c032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f32ffd640 1 -- 172.21.15.104:0/2224413446 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c037040 con 0x7f2f441567e0 2024-09-17T03:01:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f32ffd640 1 -- 172.21.15.104:0/2224413446 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f3c042070 con 0x7f2f441567e0 2024-09-17T03:01:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f441f9eb0 con 0x7f2f441567e0 2024-09-17T03:01:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f32ffd640 1 -- 172.21.15.104:0/2224413446 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c004280 con 0x7f2f441567e0 2024-09-17T03:01:36.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.077+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f44070a00 con 0x7f2f441567e0 2024-09-17T03:01:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.078+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f441535e0 con 0x7f2f441567e0 2024-09-17T03:01:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.079+0000 7f2f32ffd640 1 -- 172.21.15.104:0/2224413446 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f3c004420 con 0x7f2f441567e0 2024-09-17T03:01:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.080+0000 7f2f32ffd640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2f24078bc0 0x7f2f2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.080+0000 7f2f32ffd640 1 -- 172.21.15.104:0/2224413446 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f2f3c0bbb70 con 0x7f2f441567e0 2024-09-17T03:01:36.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.080+0000 7f2f4259c640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2f24078bc0 0x7f2f2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.081 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.081+0000 7f2f4259c640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2f24078bc0 0x7f2f2407b0d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2f440b6710 tx=0x7f2f34007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:36.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.084+0000 7f2f32ffd640 1 -- 172.21.15.104:0/2224413446 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2f441535e0 con 0x7f2f441567e0 2024-09-17T03:01:36.219 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:01:36.221 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:01:36.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.262+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f2f440d0980 con 0x7f2f441567e0 2024-09-17T03:01:36.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.264+0000 7f2f32ffd640 1 -- 172.21.15.104:0/2224413446 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) ==== 81+0+34646 (secure 0 0 0) 0x7f2f4414f120 con 0x7f2f441567e0 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 142, 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:33.146751+0000", 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:36.264 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:36.265 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "luminous", 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:36.266 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:36.267 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:36.268 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:36.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:36.270 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:36.271 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:36.272 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:36.273 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:36.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:36.275 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:36.276 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.277 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:36.278 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:36.279 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:36.280 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "142", 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:36.281 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:36.282 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:36.283 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:36.284 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.5, 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.5, 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.5, 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.5, 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.285 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.286 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:36.290 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.291 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:36.292 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:36.293 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:36.296 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.297 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 140, 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:36.298 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:36.302 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.303 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:36.306 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:36.308 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.309 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.311 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.312 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.313 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.314 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 140, 2024-09-17T03:01:36.315 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.316 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.317 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.318 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:36.319 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.320 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.321 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.324 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.325 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:36.326 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.327 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.329 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.330 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.332 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.334 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.335 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.336 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:36.337 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:36.338 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [ 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: "pgid": "17.7", 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: "mappings": [ 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: "from": 0, 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: "to": 2 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: "pgid": "17.36", 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: "mappings": [ 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.339 INFO:teuthology.orchestra.run.smithi104.stdout: "from": 0, 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "to": 5 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:36.340 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:36.341 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:36.342 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:36.342 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:36.342 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.342 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:36.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2f24078bc0 msgr2=0x7f2f2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2f24078bc0 0x7f2f2407b0d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2f440b6710 tx=0x7f2f34007e90 comp rx=0 tx=0).stop 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f441567e0 msgr2=0x7f2f441519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f441567e0 0x7f2f441519c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009b30 tx=0x7f2f3c032c90 comp rx=0 tx=0).stop 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 shutdown_connections 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2f24078bc0 0x7f2f2407b0d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4415cc30 0x7f2f44151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2f441567e0 0x7f2f441519c0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 --2- 172.21.15.104:0/2224413446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f44073e00 0x7f2f4414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 >> 172.21.15.104:0/2224413446 conn(0x7f2f4406eb90 msgr2=0x7f2f441eae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 shutdown_connections 2024-09-17T03:01:36.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.266+0000 7f2f48c8b640 1 -- 172.21.15.104:0/2224413446 wait complete. 2024-09-17T03:01:36.346 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2024-09-17T03:01:36.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:01:36.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.498+0000 7f9e12ea2640 1 -- 172.21.15.104:0/2324427614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0b4fc0 msgr2=0x7f9e0c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.498+0000 7f9e12ea2640 1 --2- 172.21.15.104:0/2324427614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0b4fc0 0x7f9e0c0b39c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0cf770 tx=0x7f9e0802a890 comp rx=0 tx=0).stop 2024-09-17T03:01:36.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.498+0000 7f9e12ea2640 1 -- 172.21.15.104:0/2324427614 shutdown_connections 2024-09-17T03:01:36.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.498+0000 7f9e12ea2640 1 --2- 172.21.15.104:0/2324427614 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0b4fc0 0x7f9e0c0b39c0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.498+0000 7f9e12ea2640 1 -- 172.21.15.104:0/2324427614 >> 172.21.15.104:0/2324427614 conn(0x7f9e0c0b44a0 msgr2=0x7f9e0c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:36.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.498+0000 7f9e12ea2640 1 -- 172.21.15.104:0/2324427614 shutdown_connections 2024-09-17T03:01:36.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.498+0000 7f9e12ea2640 1 -- 172.21.15.104:0/2324427614 wait complete. 2024-09-17T03:01:36.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.499+0000 7f9e12ea2640 1 Processor -- start 2024-09-17T03:01:36.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.499+0000 7f9e12ea2640 1 -- start start 2024-09-17T03:01:36.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e12ea2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e0c0b3f00 0x7f9e0c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e12ea2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e0c0b4fc0 0x7f9e0c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e12ea2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0cdf10 0x7f9e0c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e12ea2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c168210 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e12ea2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c168390 con 0x7f9e0c0b3f00 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e12ea2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c168510 con 0x7f9e0c0b4fc0 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0cdf10 0x7f9e0c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0cdf10 0x7f9e0c156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41258/0 (socket says 172.21.15.104:41258) 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 -- 172.21.15.104:0/1994338782 learned_addr learned my addr 172.21.15.104:0/1994338782 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e10c3e640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e0c0b3f00 0x7f9e0c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e03fff640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e0c0b4fc0 0x7f9e0c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 -- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e0c0b4fc0 msgr2=0x7f9e0c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e0c0b4fc0 0x7f9e0c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 -- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e0c0b3f00 msgr2=0x7f9e0c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e0c0b3f00 0x7f9e0c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 -- 172.21.15.104:0/1994338782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c0afb50 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e10c3e640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e0c0b3f00 0x7f9e0c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.501+0000 7f9e1143f640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0cdf10 0x7f9e0c156c50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400c390 tx=0x7f9e0400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.502+0000 7f9e017fa640 1 -- 172.21.15.104:0/1994338782 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04011790 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.502+0000 7f9e017fa640 1 -- 172.21.15.104:0/1994338782 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e04017070 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.502+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c156520 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.502+0000 7f9e017fa640 1 -- 172.21.15.104:0/1994338782 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04011c60 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.502+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0c0b21e0 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.503+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0c0b57c0 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.503+0000 7f9e017fa640 1 -- 172.21.15.104:0/1994338782 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e0401c460 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.504+0000 7f9e017fa640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df8078b90 0x7f9df807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.504+0000 7f9e017fa640 1 -- 172.21.15.104:0/1994338782 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f9e0409aa70 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.504+0000 7f9e10c3e640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df8078b90 0x7f9df807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.505+0000 7f9e10c3e640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df8078b90 0x7f9df807b0a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9e08034000 tx=0x7f9e08004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:36.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.508+0000 7f9e017fa640 1 -- 172.21.15.104:0/1994338782 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e0c0b57c0 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.683+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f9e0c0b39c0 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.684+0000 7f9e017fa640 1 -- 172.21.15.104:0/1994338782 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) ==== 81+0+34646 (secure 0 0 0) 0x7f9e04062f00 con 0x7f9e0c0cdf10 2024-09-17T03:01:36.684 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:36.684 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:36.684 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 142, 2024-09-17T03:01:36.684 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:01:36.684 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:01:36.684 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:01:33.146751+0000", 2024-09-17T03:01:36.684 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:01:36.685 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 17, 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "luminous", 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:36.686 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:01:36.687 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:36.688 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:36.689 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:36.690 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:36.690 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:36.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:36.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:36.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:36.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:36.690 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:36.690 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:36.691 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:01:36.692 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 16, 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:50.865818+0000", 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:36.693 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:01:36.694 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "136", 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:36.695 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:36.696 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:36.697 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.698 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.75, 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.75, 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.75, 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.75, 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:36.699 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 17, 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:00:52.188131+0000", 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:01:36.700 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:01:36.701 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:01:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:01:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:01:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:01:36.704 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "142", 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:01:36.705 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:01:36.706 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:01:36.707 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:01:36.708 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.5, 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.5, 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.5, 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.5, 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.710 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.712 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.713 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.714 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:36.715 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.716 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.717 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.718 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.719 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:01:36.720 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:36.721 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 140, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.724 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.725 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:01:36.726 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.727 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.728 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:01:36.729 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:01:36.730 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.731 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:01:36.732 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.733 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.734 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.735 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.736 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.737 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.738 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 140, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.739 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.740 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.741 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.742 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:01:36.743 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:36.744 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.745 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.746 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.747 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.748 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:01:36.749 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:01:36.750 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 135, 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.751 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.752 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.753 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.753 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:01:36.753 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.753 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.753 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.753 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.753 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.754 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.755 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:01:36.756 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.757 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.758 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.759 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:01:36.760 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:01:36.761 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [ 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "pgid": "17.7", 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "mappings": [ 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.762 INFO:teuthology.orchestra.run.smithi104.stdout: "from": 0, 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: "to": 2 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: "pgid": "17.36", 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: "mappings": [ 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: "from": 0, 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: "to": 5 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.763 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:36.765 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:36.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df8078b90 msgr2=0x7f9df807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df8078b90 0x7f9df807b0a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9e08034000 tx=0x7f9e08004ab0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0cdf10 msgr2=0x7f9e0c156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0cdf10 0x7f9e0c156c50 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400c390 tx=0x7f9e0400c850 comp rx=0 tx=0).stop 2024-09-17T03:01:36.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 shutdown_connections 2024-09-17T03:01:36.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9df8078b90 0x7f9df807b0a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e0c0cdf10 0x7f9e0c156c50 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e0c0b4fc0 0x7f9e0c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 --2- 172.21.15.104:0/1994338782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e0c0b3f00 0x7f9e0c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 >> 172.21.15.104:0/1994338782 conn(0x7f9e0c0b44a0 msgr2=0x7f9e0c071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:36.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 shutdown_connections 2024-09-17T03:01:36.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.686+0000 7f9e12ea2640 1 -- 172.21.15.104:0/1994338782 wait complete. 2024-09-17T03:01:36.769 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:36.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.881+0000 7f2c27112640 1 -- 172.21.15.104:0/1599773329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c20072f90 msgr2=0x7f2c200ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.881+0000 7f2c27112640 1 --2- 172.21.15.104:0/1599773329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c20072f90 0x7f2c200ce280 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f2c2006ecb0 tx=0x7f2c1802a4b0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.881+0000 7f2c27112640 1 -- 172.21.15.104:0/1599773329 shutdown_connections 2024-09-17T03:01:36.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.881+0000 7f2c27112640 1 --2- 172.21.15.104:0/1599773329 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c20072f90 0x7f2c200ce280 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.881+0000 7f2c27112640 1 --2- 172.21.15.104:0/1599773329 >> v2:172.21.15.192:3300/0 conn(0x7f2c2015b7f0 0x7f2c2015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.881+0000 7f2c27112640 1 -- 172.21.15.104:0/1599773329 >> 172.21.15.104:0/1599773329 conn(0x7f2c200b2450 msgr2=0x7f2c200b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:36.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.881+0000 7f2c27112640 1 -- 172.21.15.104:0/1599773329 shutdown_connections 2024-09-17T03:01:36.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.881+0000 7f2c27112640 1 -- 172.21.15.104:0/1599773329 wait complete. 2024-09-17T03:01:36.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.883+0000 7f2c27112640 1 Processor -- start 2024-09-17T03:01:36.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.883+0000 7f2c27112640 1 -- start start 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.884+0000 7f2c27112640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c20072470 0x7f2c2006f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.884+0000 7f2c27112640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20072f90 0x7f2c20155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.884+0000 7f2c27112640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c2015b7f0 0x7f2c200ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.884+0000 7f2c27112640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2c200ceb90 con 0x7f2c2015b7f0 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.884+0000 7f2c27112640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c200cea10 con 0x7f2c20072470 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.884+0000 7f2c27112640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c200ced10 con 0x7f2c20072f90 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c2015b7f0 0x7f2c200ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c2015b7f0 0x7f2c200ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41274/0 (socket says 172.21.15.104:41274) 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 -- 172.21.15.104:0/2819996311 learned_addr learned my addr 172.21.15.104:0/2819996311 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:36.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c1ffff640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20072f90 0x7f2c20155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c24eae640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c20072470 0x7f2c2006f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 -- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20072f90 msgr2=0x7f2c20155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20072f90 0x7f2c20155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 -- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c20072470 msgr2=0x7f2c2006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c20072470 0x7f2c2006f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 -- 172.21.15.104:0/2819996311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2006fb90 con 0x7f2c2015b7f0 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c256af640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c2015b7f0 0x7f2c200ae8e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f2c18034040 tx=0x7f2c18003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c1d7fa640 1 -- 172.21.15.104:0/2819996311 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1803e030 con 0x7f2c2015b7f0 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c1d7fa640 1 -- 172.21.15.104:0/2819996311 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c18003e50 con 0x7f2c2015b7f0 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c201f95b0 con 0x7f2c2015b7f0 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c1d7fa640 1 -- 172.21.15.104:0/2819996311 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c18035040 con 0x7f2c2015b7f0 2024-09-17T03:01:36.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.885+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c201f9b70 con 0x7f2c2015b7f0 2024-09-17T03:01:36.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.886+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c200ce280 con 0x7f2c2015b7f0 2024-09-17T03:01:36.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.887+0000 7f2c1d7fa640 1 -- 172.21.15.104:0/2819996311 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c18041030 con 0x7f2c2015b7f0 2024-09-17T03:01:36.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.888+0000 7f2c1d7fa640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bc0 0x7f2c0c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:36.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.888+0000 7f2c1d7fa640 1 -- 172.21.15.104:0/2819996311 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f2c180bb580 con 0x7f2c2015b7f0 2024-09-17T03:01:36.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.888+0000 7f2c24eae640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bc0 0x7f2c0c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:36.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.889+0000 7f2c24eae640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bc0 0x7f2c0c07b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2c100058c0 tx=0x7f2c1000c440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:36.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:36.892+0000 7f2c1d7fa640 1 -- 172.21.15.104:0/2819996311 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2c2006fb90 con 0x7f2c2015b7f0 2024-09-17T03:01:37.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.101+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c20157640 con 0x7f2c2015b7f0 2024-09-17T03:01:37.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.102+0000 7f2c1d7fa640 1 -- 172.21.15.104:0/2819996311 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f2c180832b0 con 0x7f2c2015b7f0 2024-09-17T03:01:37.102 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:37.102 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:01:37.102 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:01:37.103 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bc0 msgr2=0x7f2c0c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bc0 0x7f2c0c07b0d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2c100058c0 tx=0x7f2c1000c440 comp rx=0 tx=0).stop 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c2015b7f0 msgr2=0x7f2c200ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c2015b7f0 0x7f2c200ae8e0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f2c18034040 tx=0x7f2c18003960 comp rx=0 tx=0).stop 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 shutdown_connections 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2c0c078bc0 0x7f2c0c07b0d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c2015b7f0 0x7f2c200ae8e0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c20072f90 0x7f2c20155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 --2- 172.21.15.104:0/2819996311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c20072470 0x7f2c2006f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 >> 172.21.15.104:0/2819996311 conn(0x7f2c200b2450 msgr2=0x7f2c200b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 shutdown_connections 2024-09-17T03:01:37.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.104+0000 7f2c27112640 1 -- 172.21.15.104:0/2819996311 wait complete. 2024-09-17T03:01:37.115 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-17T03:01:37.257 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":7044,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":43.365870596000001,"mdsmap_epoch":55,"osdmap_epoch":142,"osdmap_epoch_barrier":139,"uptime":48.063539589000001} 2024-09-17T03:01:37.257 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 7044, "mdsmap_epoch": 55, "osdmap_epoch": 142, "osdmap_epoch_barrier": 139, "rank_uptime": 43.365870596, "state": "up:active", "uptime": 48.063539589, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:01:37.257 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:01:37.258 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:37.258 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:37.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:37.274 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-17T03:01:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records in 2024-09-17T03:01:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records out 2024-09-17T03:01:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.174458 s, 301 MB/s 2024-09-17T03:01:37.507 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:01:37.507 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:01:37.553 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:01:37.600 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:01:37.600 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:01:37.601 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:37.601 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:37.616 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:37.616 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:37.672 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:01:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.825+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/1180836003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00b6f70 msgr2=0x7f0ca015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.825+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/1180836003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00b6f70 0x7f0ca015ef90 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00b44d0 tx=0x7f0c9c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.825+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/1180836003 shutdown_connections 2024-09-17T03:01:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.825+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/1180836003 >> v2:172.21.15.192:3300/0 conn(0x7f0ca00b3b00 0x7f0ca00d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.825+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/1180836003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00b6f70 0x7f0ca015ef90 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.825+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/1180836003 >> 172.21.15.104:0/1180836003 conn(0x7f0ca0073df0 msgr2=0x7f0ca0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.825+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/1180836003 shutdown_connections 2024-09-17T03:01:37.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.825+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/1180836003 wait complete. 2024-09-17T03:01:37.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.827+0000 7f0ca7c8b640 1 Processor -- start 2024-09-17T03:01:37.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.827+0000 7f0ca7c8b640 1 -- start start 2024-09-17T03:01:37.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca7c8b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00b3b00 0x7f0ca00cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:37.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca7c8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00b6f70 0x7f0ca015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:37.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca7c8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00d1710 0x7f0ca014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca7c8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca00d01b0 con 0x7f0ca00d1710 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca7c8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca00d0030 con 0x7f0ca00b6f70 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca7c8b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca00d0330 con 0x7f0ca00b3b00 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca6228640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00d1710 0x7f0ca014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca6228640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00d1710 0x7f0ca014ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41286/0 (socket says 172.21.15.104:41286) 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca6228640 1 -- 172.21.15.104:0/3663311449 learned_addr learned my addr 172.21.15.104:0/3663311449 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca5a27640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00b3b00 0x7f0ca00cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca6228640 1 -- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00b3b00 msgr2=0x7f0ca00cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca6228640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00b3b00 0x7f0ca00cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca6228640 1 -- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00b6f70 msgr2=0x7f0ca015b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca5226640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00b6f70 0x7f0ca015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca6228640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00b6f70 0x7f0ca015b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.828+0000 7f0ca6228640 1 -- 172.21.15.104:0/3663311449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca00ce4b0 con 0x7f0ca00d1710 2024-09-17T03:01:37.829 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.829+0000 7f0ca6228640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00d1710 0x7f0ca014ee90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c730 tx=0x7f0c9800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:37.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.829+0000 7f0c967fc640 1 -- 172.21.15.104:0/3663311449 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98003b70 con 0x7f0ca00d1710 2024-09-17T03:01:37.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.829+0000 7f0c967fc640 1 -- 172.21.15.104:0/3663311449 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c98003d10 con 0x7f0ca00d1710 2024-09-17T03:01:37.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.829+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca00cbbc0 con 0x7f0ca00d1710 2024-09-17T03:01:37.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.829+0000 7f0c967fc640 1 -- 172.21.15.104:0/3663311449 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c980052d0 con 0x7f0ca00d1710 2024-09-17T03:01:37.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.829+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca00cc180 con 0x7f0ca00d1710 2024-09-17T03:01:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.830+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca0068d00 con 0x7f0ca00d1710 2024-09-17T03:01:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.831+0000 7f0c967fc640 1 -- 172.21.15.104:0/3663311449 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c98005470 con 0x7f0ca00d1710 2024-09-17T03:01:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.831+0000 7f0c967fc640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0c84078b90 0x7f0c8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.831+0000 7f0c967fc640 1 -- 172.21.15.104:0/3663311449 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f0c9809abc0 con 0x7f0ca00d1710 2024-09-17T03:01:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.831+0000 7f0ca5a27640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0c84078b90 0x7f0c8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:37.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.832+0000 7f0ca5a27640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0c84078b90 0x7f0c8407b0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c034000 tx=0x7f0c9c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:37.835 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:37.836+0000 7f0c967fc640 1 -- 172.21.15.104:0/3663311449 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ca0068d00 con 0x7f0ca00d1710 2024-09-17T03:01:38.017 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.018+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0ca00b4fa0 con 0x7f0ca00d1710 2024-09-17T03:01:38.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.018+0000 7f0c967fc640 1 -- 172.21.15.104:0/3663311449 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) ==== 80+0+0 (secure 0 0 0) 0x7f0c98062fc0 con 0x7f0ca00d1710 2024-09-17T03:01:38.018 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0c84078b90 msgr2=0x7f0c8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0c84078b90 0x7f0c8407b0a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c034000 tx=0x7f0c9c004730 comp rx=0 tx=0).stop 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00d1710 msgr2=0x7f0ca014ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00d1710 0x7f0ca014ee90 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c730 tx=0x7f0c9800cb30 comp rx=0 tx=0).stop 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 shutdown_connections 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0c84078b90 0x7f0c8407b0a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ca00b6f70 0x7f0ca015b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ca00d1710 0x7f0ca014ee90 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 --2- 172.21.15.104:0/3663311449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ca00b3b00 0x7f0ca00cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 >> 172.21.15.104:0/3663311449 conn(0x7f0ca0073df0 msgr2=0x7f0ca015e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:38.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 shutdown_connections 2024-09-17T03:01:38.021 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.020+0000 7f0ca7c8b640 1 -- 172.21.15.104:0/3663311449 wait complete. 2024-09-17T03:01:38.031 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:01:38.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:38.031 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:01:38.087 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:01:38.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:38.087 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:01:38.105 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:01:38.105 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:01:38.105 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:38.121 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:01:38.121 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:38.177 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:01:38.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.291+0000 7f7e68b0b640 1 -- 172.21.15.104:0/2600329373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e640cff70 msgr2=0x7f7e6415b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.291+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/2600329373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e640cff70 0x7f7e6415b170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7e54005fd0 tx=0x7f7e5402a820 comp rx=0 tx=0).stop 2024-09-17T03:01:38.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.291+0000 7f7e68b0b640 1 -- 172.21.15.104:0/2600329373 shutdown_connections 2024-09-17T03:01:38.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.291+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/2600329373 >> v2:172.21.15.192:3300/0 conn(0x7f7e6406f840 0x7f7e64072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.291+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/2600329373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e640cff70 0x7f7e6415b170 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.291+0000 7f7e68b0b640 1 -- 172.21.15.104:0/2600329373 >> 172.21.15.104:0/2600329373 conn(0x7f7e640b2450 msgr2=0x7f7e640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:38.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.291+0000 7f7e68b0b640 1 -- 172.21.15.104:0/2600329373 shutdown_connections 2024-09-17T03:01:38.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.291+0000 7f7e68b0b640 1 -- 172.21.15.104:0/2600329373 wait complete. 2024-09-17T03:01:38.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.293+0000 7f7e68b0b640 1 Processor -- start 2024-09-17T03:01:38.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.293+0000 7f7e68b0b640 1 -- start start 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.294+0000 7f7e68b0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e6406f840 0x7f7e64146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.294+0000 7f7e68b0b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e64073370 0x7f7e641493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.294+0000 7f7e68b0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e640cff70 0x7f7e641498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.294+0000 7f7e68b0b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7e640d0580 con 0x7f7e640cff70 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.294+0000 7f7e68b0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6406fe60 con 0x7f7e6406f840 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.294+0000 7f7e68b0b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7e640b3e60 con 0x7f7e64073370 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.294+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e640cff70 0x7f7e641498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e62d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e640cff70 0x7f7e641498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41298/0 (socket says 172.21.15.104:41298) 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e62d9d640 1 -- 172.21.15.104:0/927836996 learned_addr learned my addr 172.21.15.104:0/927836996 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:38.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e6259c640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e6406f840 0x7f7e64146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e61d9b640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e64073370 0x7f7e641493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e62d9d640 1 -- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e64073370 msgr2=0x7f7e641493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e62d9d640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e64073370 0x7f7e641493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e62d9d640 1 -- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e6406f840 msgr2=0x7f7e64146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e62d9d640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e6406f840 0x7f7e64146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e62d9d640 1 -- 172.21.15.104:0/927836996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e64147020 con 0x7f7e640cff70 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e62d9d640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e640cff70 0x7f7e641498e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c3c0 tx=0x7f7e5c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e5affd640 1 -- 172.21.15.104:0/927836996 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c017070 con 0x7f7e640cff70 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e5affd640 1 -- 172.21.15.104:0/927836996 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e5c0053c0 con 0x7f7e640cff70 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e641f4160 con 0x7f7e640cff70 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e5affd640 1 -- 172.21.15.104:0/927836996 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c003850 con 0x7f7e640cff70 2024-09-17T03:01:38.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.295+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e641f4970 con 0x7f7e640cff70 2024-09-17T03:01:38.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.296+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e6415ad70 con 0x7f7e640cff70 2024-09-17T03:01:38.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.297+0000 7f7e5affd640 1 -- 172.21.15.104:0/927836996 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e5c01a070 con 0x7f7e640cff70 2024-09-17T03:01:38.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.297+0000 7f7e5affd640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e44078b90 0x7f7e4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:38.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.297+0000 7f7e5affd640 1 -- 172.21.15.104:0/927836996 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f7e5c099fc0 con 0x7f7e640cff70 2024-09-17T03:01:38.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.298+0000 7f7e6259c640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e44078b90 0x7f7e4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:38.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.298+0000 7f7e6259c640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e44078b90 0x7f7e4407b0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7e54034000 tx=0x7f7e54004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:38.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.302+0000 7f7e5affd640 1 -- 172.21.15.104:0/927836996 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e6415ad70 con 0x7f7e640cff70 2024-09-17T03:01:38.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.488+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7e64072e60 con 0x7f7e640cff70 2024-09-17T03:01:38.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.488+0000 7f7e5affd640 1 -- 172.21.15.104:0/927836996 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) ==== 80+0+0 (secure 0 0 0) 0x7f7e64072e60 con 0x7f7e640cff70 2024-09-17T03:01:38.488 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e44078b90 msgr2=0x7f7e4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e44078b90 0x7f7e4407b0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7e54034000 tx=0x7f7e54004ab0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e640cff70 msgr2=0x7f7e641498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e640cff70 0x7f7e641498e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c3c0 tx=0x7f7e5c00c7c0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 shutdown_connections 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7e44078b90 0x7f7e4407b0a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7e640cff70 0x7f7e641498e0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e64073370 0x7f7e641493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 --2- 172.21.15.104:0/927836996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e6406f840 0x7f7e64146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 >> 172.21.15.104:0/927836996 conn(0x7f7e640b2450 msgr2=0x7f7e6415a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:38.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 shutdown_connections 2024-09-17T03:01:38.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.490+0000 7f7e68b0b640 1 -- 172.21.15.104:0/927836996 wait complete. 2024-09-17T03:01:38.501 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:01:38.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:38.501 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:01:38.529 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:01:38.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:01:38.530 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:01:38.585 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:01:38.585 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:38.586 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:38.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:01:38.601 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:01:38.602 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:01:38.602 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:38.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:01:38.641 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:38.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.754+0000 7fd41af5e640 1 -- 172.21.15.104:0/3113910656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd414073e00 msgr2=0x7fd414156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.754+0000 7fd41af5e640 1 --2- 172.21.15.104:0/3113910656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd414073e00 0x7fd414156200 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd414072ac0 tx=0x7fd40c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:01:38.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.754+0000 7fd41af5e640 1 -- 172.21.15.104:0/3113910656 shutdown_connections 2024-09-17T03:01:38.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.754+0000 7fd41af5e640 1 --2- 172.21.15.104:0/3113910656 >> v2:172.21.15.192:3300/0 conn(0x7fd4140cde80 0x7fd4140cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.754+0000 7fd41af5e640 1 --2- 172.21.15.104:0/3113910656 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd414073e00 0x7fd414156200 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.754+0000 7fd41af5e640 1 -- 172.21.15.104:0/3113910656 >> 172.21.15.104:0/3113910656 conn(0x7fd41406eb90 msgr2=0x7fd41406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:38.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.754+0000 7fd41af5e640 1 -- 172.21.15.104:0/3113910656 shutdown_connections 2024-09-17T03:01:38.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.754+0000 7fd41af5e640 1 -- 172.21.15.104:0/3113910656 wait complete. 2024-09-17T03:01:38.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.755+0000 7fd41af5e640 1 Processor -- start 2024-09-17T03:01:38.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.756+0000 7fd41af5e640 1 -- start start 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd41af5e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd414073e00 0x7fd4141e37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd41af5e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd41415cc30 0x7fd4141567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd41af5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd41414cda0 0x7fd4141e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd41af5e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd4140d0350 con 0x7fd41414cda0 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd41af5e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd4140d01d0 con 0x7fd41415cc30 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd41af5e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd4140d04d0 con 0x7fd414073e00 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd41414cda0 0x7fd4141e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd41414cda0 0x7fd4141e2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41316/0 (socket says 172.21.15.104:41316) 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 -- 172.21.15.104:0/958128642 learned_addr learned my addr 172.21.15.104:0/958128642 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd418cfa640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd414073e00 0x7fd4141e37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd413fff640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd41415cc30 0x7fd4141567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:38.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 -- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd414073e00 msgr2=0x7fd4141e37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd414073e00 0x7fd4141e37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 -- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd41415cc30 msgr2=0x7fd4141567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd41415cc30 0x7fd4141567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 -- 172.21.15.104:0/958128642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4141e8ae0 con 0x7fd41414cda0 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd413fff640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd41415cc30 0x7fd4141567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.757+0000 7fd4194fb640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd41414cda0 0x7fd4141e2850 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00e700 tx=0x7fd3fc00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.758+0000 7fd4117fa640 1 -- 172.21.15.104:0/958128642 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00cab0 con 0x7fd41414cda0 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.758+0000 7fd4117fa640 1 -- 172.21.15.104:0/958128642 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3fc00cc50 con 0x7fd41414cda0 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.758+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4141e8dc0 con 0x7fd41414cda0 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.758+0000 7fd4117fa640 1 -- 172.21.15.104:0/958128642 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc005020 con 0x7fd41414cda0 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.758+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4141e2330 con 0x7fd41414cda0 2024-09-17T03:01:38.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.759+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4140d0980 con 0x7fd41414cda0 2024-09-17T03:01:38.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.759+0000 7fd4117fa640 1 -- 172.21.15.104:0/958128642 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3fc0051c0 con 0x7fd41414cda0 2024-09-17T03:01:38.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.760+0000 7fd4117fa640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd3f4078bc0 0x7fd3f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:38.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.760+0000 7fd4117fa640 1 -- 172.21.15.104:0/958128642 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7fd3fc09b5b0 con 0x7fd41414cda0 2024-09-17T03:01:38.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.760+0000 7fd418cfa640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd3f4078bc0 0x7fd3f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:38.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.761+0000 7fd418cfa640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd3f4078bc0 0x7fd3f407b0d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd40c035000 tx=0x7fd40c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:38.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.764+0000 7fd4117fa640 1 -- 172.21.15.104:0/958128642 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd3fc063a40 con 0x7fd41414cda0 2024-09-17T03:01:38.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.975+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd414156520 con 0x7fd41414cda0 2024-09-17T03:01:38.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.976+0000 7fd4117fa640 1 -- 172.21.15.104:0/958128642 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7fd3fc063340 con 0x7fd41414cda0 2024-09-17T03:01:38.975 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:38.975 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:01:38.975 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:01:38.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd3f4078bc0 msgr2=0x7fd3f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd3f4078bc0 0x7fd3f407b0d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd40c035000 tx=0x7fd40c03b040 comp rx=0 tx=0).stop 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd41414cda0 msgr2=0x7fd4141e2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd41414cda0 0x7fd4141e2850 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00e700 tx=0x7fd3fc00ebc0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 shutdown_connections 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd3f4078bc0 0x7fd3f407b0d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd41415cc30 0x7fd4141567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd41414cda0 0x7fd4141e2850 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 --2- 172.21.15.104:0/958128642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd414073e00 0x7fd4141e37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 >> 172.21.15.104:0/958128642 conn(0x7fd41406eb90 msgr2=0x7fd414153a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 shutdown_connections 2024-09-17T03:01:38.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:38.978+0000 7fd41af5e640 1 -- 172.21.15.104:0/958128642 wait complete. 2024-09-17T03:01:38.989 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:39.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.100+0000 7f75a9d0b640 1 -- 172.21.15.104:0/3834075192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40b3b00 msgr2=0x7f75a40d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.100+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/3834075192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40b3b00 0x7f75a40d11d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f75a408daa0 tx=0x7f759802a560 comp rx=0 tx=0).stop 2024-09-17T03:01:39.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.100+0000 7f75a9d0b640 1 -- 172.21.15.104:0/3834075192 shutdown_connections 2024-09-17T03:01:39.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.100+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/3834075192 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40b3b00 0x7f75a40d11d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.100+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/3834075192 >> v2:172.21.15.192:3300/0 conn(0x7f75a40b6f70 0x7f75a415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.100+0000 7f75a9d0b640 1 -- 172.21.15.104:0/3834075192 >> 172.21.15.104:0/3834075192 conn(0x7f75a4073df0 msgr2=0x7f75a4068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.100+0000 7f75a9d0b640 1 -- 172.21.15.104:0/3834075192 shutdown_connections 2024-09-17T03:01:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.100+0000 7f75a9d0b640 1 -- 172.21.15.104:0/3834075192 wait complete. 2024-09-17T03:01:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.102+0000 7f75a9d0b640 1 Processor -- start 2024-09-17T03:01:39.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.102+0000 7f75a9d0b640 1 -- start start 2024-09-17T03:01:39.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a9d0b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75a40b3b00 0x7f75a40b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a9d0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75a40b6f70 0x7f75a415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a9d0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40d1710 0x7f75a41f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a9d0b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40d01b0 con 0x7f75a40d1710 2024-09-17T03:01:39.104 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a9d0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40d0030 con 0x7f75a40b6f70 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a9d0b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f75a40d0330 con 0x7f75a40b3b00 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40d1710 0x7f75a41f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40d1710 0x7f75a41f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41334/0 (socket says 172.21.15.104:41334) 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 -- 172.21.15.104:0/1559720181 learned_addr learned my addr 172.21.15.104:0/1559720181 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a37fe640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75a40b3b00 0x7f75a40b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a2ffd640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75a40b6f70 0x7f75a415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 -- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75a40b3b00 msgr2=0x7f75a40b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75a40b3b00 0x7f75a40b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 -- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75a40b6f70 msgr2=0x7f75a415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75a40b6f70 0x7f75a415adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 -- 172.21.15.104:0/1559720181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a415b2f0 con 0x7f75a40d1710 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a2ffd640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75a40b6f70 0x7f75a415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:39.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a3fff640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40d1710 0x7f75a41f9080 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c6b0 tx=0x7f759c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:39.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f758bfff640 1 -- 172.21.15.104:0/1559720181 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c003b70 con 0x7f75a40d1710 2024-09-17T03:01:39.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f758bfff640 1 -- 172.21.15.104:0/1559720181 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f759c003d30 con 0x7f75a40d1710 2024-09-17T03:01:39.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f758bfff640 1 -- 172.21.15.104:0/1559720181 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c005330 con 0x7f75a40d1710 2024-09-17T03:01:39.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a4161be0 con 0x7f75a40d1710 2024-09-17T03:01:39.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.104+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a41621a0 con 0x7f75a40d1710 2024-09-17T03:01:39.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.105+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a4162910 con 0x7f75a40d1710 2024-09-17T03:01:39.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.106+0000 7f758bfff640 1 -- 172.21.15.104:0/1559720181 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f759c0054d0 con 0x7f75a40d1710 2024-09-17T03:01:39.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.107+0000 7f758bfff640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7590078b90 0x7f759007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.107+0000 7f758bfff640 1 -- 172.21.15.104:0/1559720181 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f759c09aa20 con 0x7f75a40d1710 2024-09-17T03:01:39.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.107+0000 7f75a37fe640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7590078b90 0x7f759007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.107+0000 7f75a37fe640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7590078b90 0x7f759007b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7594009b30 tx=0x7f7594005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:39.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.111+0000 7f758bfff640 1 -- 172.21.15.104:0/1559720181 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f759c062eb0 con 0x7f75a40d1710 2024-09-17T03:01:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.321+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75a40cf240 con 0x7f75a40d1710 2024-09-17T03:01:39.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.322+0000 7f758bfff640 1 -- 172.21.15.104:0/1559720181 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f759c0627b0 con 0x7f75a40d1710 2024-09-17T03:01:39.322 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:39.322 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:01:39.322 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:01:39.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7590078b90 msgr2=0x7f759007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7590078b90 0x7f759007b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7594009b30 tx=0x7f7594005f90 comp rx=0 tx=0).stop 2024-09-17T03:01:39.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40d1710 msgr2=0x7f75a41f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40d1710 0x7f75a41f9080 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f759c00c6b0 tx=0x7f759c00cb70 comp rx=0 tx=0).stop 2024-09-17T03:01:39.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 shutdown_connections 2024-09-17T03:01:39.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7590078b90 0x7f759007b0a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75a40b6f70 0x7f75a415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f75a40d1710 0x7f75a41f9080 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 --2- 172.21.15.104:0/1559720181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f75a40b3b00 0x7f75a40b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 >> 172.21.15.104:0/1559720181 conn(0x7f75a4073df0 msgr2=0x7f75a40d54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:39.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 shutdown_connections 2024-09-17T03:01:39.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.324+0000 7f75a9d0b640 1 -- 172.21.15.104:0/1559720181 wait complete. 2024-09-17T03:01:39.335 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:01:39.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.448+0000 7fb652558640 1 -- 172.21.15.104:0/2037720097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb64c0d18e0 msgr2=0x7fb64c15ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.448+0000 7fb652558640 1 --2- 172.21.15.104:0/2037720097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb64c0d18e0 0x7fb64c15ef90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb634009860 tx=0x7fb63402a530 comp rx=0 tx=0).stop 2024-09-17T03:01:39.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.448+0000 7fb652558640 1 -- 172.21.15.104:0/2037720097 shutdown_connections 2024-09-17T03:01:39.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.448+0000 7fb652558640 1 --2- 172.21.15.104:0/2037720097 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb64c0d18e0 0x7fb64c15ef90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.448+0000 7fb652558640 1 -- 172.21.15.104:0/2037720097 >> 172.21.15.104:0/2037720097 conn(0x7fb64c073df0 msgr2=0x7fb64c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:39.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.448+0000 7fb652558640 1 -- 172.21.15.104:0/2037720097 shutdown_connections 2024-09-17T03:01:39.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.449+0000 7fb652558640 1 -- 172.21.15.104:0/2037720097 wait complete. 2024-09-17T03:01:39.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.450+0000 7fb652558640 1 Processor -- start 2024-09-17T03:01:39.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.450+0000 7fb652558640 1 -- start start 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb652558640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64c0b3b00 0x7fb64c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb652558640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64c0b6f70 0x7fb64c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb652558640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb64c0d18e0 0x7fb64c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb652558640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c0d3fc0 con 0x7fb64c0b3b00 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb652558640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c0d3e40 con 0x7fb64c0b6f70 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb652558640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb64c0d4140 con 0x7fb64c0d18e0 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64c0b3b00 0x7fb64c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64c0b3b00 0x7fb64c14efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41338/0 (socket says 172.21.15.104:41338) 2024-09-17T03:01:39.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 -- 172.21.15.104:0/3991108789 learned_addr learned my addr 172.21.15.104:0/3991108789 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64b7fe640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64c0b6f70 0x7fb64c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb650af5640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb64c0d18e0 0x7fb64c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 -- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb64c0d18e0 msgr2=0x7fb64c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb64c0d18e0 0x7fb64c0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 -- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64c0b6f70 msgr2=0x7fb64c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64c0b6f70 0x7fb64c0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 -- 172.21.15.104:0/3991108789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c0cace0 con 0x7fb64c0b3b00 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb64bfff640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64c0b3b00 0x7fb64c14efe0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00c460 tx=0x7fb63c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb648ff9640 1 -- 172.21.15.104:0/3991108789 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0052d0 con 0x7fb64c0b3b00 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64c0c9060 con 0x7fb64c0b3b00 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb648ff9640 1 -- 172.21.15.104:0/3991108789 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb63c005490 con 0x7fb64c0b3b00 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.452+0000 7fb648ff9640 1 -- 172.21.15.104:0/3991108789 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c012870 con 0x7fb64c0b3b00 2024-09-17T03:01:39.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.453+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64c0c9620 con 0x7fb64c0b3b00 2024-09-17T03:01:39.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.454+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c15ef90 con 0x7fb64c0b3b00 2024-09-17T03:01:39.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.454+0000 7fb648ff9640 1 -- 172.21.15.104:0/3991108789 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb63c012a10 con 0x7fb64c0b3b00 2024-09-17T03:01:39.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.455+0000 7fb648ff9640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb62c078b90 0x7fb62c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.455+0000 7fb648ff9640 1 -- 172.21.15.104:0/3991108789 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7fb63c09a7d0 con 0x7fb64c0b3b00 2024-09-17T03:01:39.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.455+0000 7fb64b7fe640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb62c078b90 0x7fb62c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.456+0000 7fb64b7fe640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb62c078b90 0x7fb62c07b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb634034000 tx=0x7fb634004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:39.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.460+0000 7fb648ff9640 1 -- 172.21.15.104:0/3991108789 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb63c062590 con 0x7fb64c0b3b00 2024-09-17T03:01:39.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.632+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb64c14f520 con 0x7fb64c0b3b00 2024-09-17T03:01:39.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.633+0000 7fb648ff9640 1 -- 172.21.15.104:0/3991108789 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16836 (secure 0 0 0) 0x7fb63c066fc0 con 0x7fb64c0b3b00 2024-09-17T03:01:39.633 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:39.633 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":142,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:01:33.146751+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:50.865818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:52.188131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":2}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:01:39.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb62c078b90 msgr2=0x7fb62c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb62c078b90 0x7fb62c07b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb634034000 tx=0x7fb634004730 comp rx=0 tx=0).stop 2024-09-17T03:01:39.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64c0b3b00 msgr2=0x7fb64c14efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64c0b3b00 0x7fb64c14efe0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00c460 tx=0x7fb63c00c920 comp rx=0 tx=0).stop 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 shutdown_connections 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb62c078b90 0x7fb62c07b0a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64c0b6f70 0x7fb64c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb64c0d18e0 0x7fb64c0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 --2- 172.21.15.104:0/3991108789 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb64c0b3b00 0x7fb64c14efe0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 >> 172.21.15.104:0/3991108789 conn(0x7fb64c073df0 msgr2=0x7fb64c15e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 shutdown_connections 2024-09-17T03:01:39.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.636+0000 7fb652558640 1 -- 172.21.15.104:0/3991108789 wait complete. 2024-09-17T03:01:39.647 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:01:39.647 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:39.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.760+0000 7f0f04ebd640 1 -- 172.21.15.104:0/1569500701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ee8004000 msgr2=0x7f0ee8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.760+0000 7f0f04ebd640 1 --2- 172.21.15.104:0/1569500701 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0ee8004000 0x7f0ee8004800 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f0f000b0390 tx=0x7f0ee8005830 comp rx=0 tx=0).stop 2024-09-17T03:01:39.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.760+0000 7f0efed9d640 1 -- 172.21.15.104:0/1569500701 reap_dead start 2024-09-17T03:01:39.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.760+0000 7f0f04ebd640 1 -- 172.21.15.104:0/1569500701 shutdown_connections 2024-09-17T03:01:39.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.760+0000 7f0f04ebd640 1 -- 172.21.15.104:0/1569500701 >> 172.21.15.104:0/1569500701 conn(0x7f0f000b2450 msgr2=0x7f0f000b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:39.760 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.760+0000 7f0f04ebd640 1 -- 172.21.15.104:0/1569500701 shutdown_connections 2024-09-17T03:01:39.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.760+0000 7f0f04ebd640 1 -- 172.21.15.104:0/1569500701 wait complete. 2024-09-17T03:01:39.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.762+0000 7f0f04ebd640 1 Processor -- start 2024-09-17T03:01:39.761 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.762+0000 7f0f04ebd640 1 -- start start 2024-09-17T03:01:39.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.763+0000 7f0f04ebd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ee8004000 0x7f0f001432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.763+0000 7f0f04ebd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f0014d340 0x7f0f001533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.763+0000 7f0f04ebd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f001f9a80 0x7f0f001408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.763+0000 7f0f04ebd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0f000ce990 con 0x7f0f0014d340 2024-09-17T03:01:39.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.763+0000 7f0f04ebd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0015bec0 con 0x7f0ee8004000 2024-09-17T03:01:39.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.763+0000 7f0f04ebd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0f000ceb10 con 0x7f0f001f9a80 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.763+0000 7f0efdd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f0014d340 0x7f0f001533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efdd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f0014d340 0x7f0f001533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41354/0 (socket says 172.21.15.104:41354) 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efdd9b640 1 -- 172.21.15.104:0/3430861856 learned_addr learned my addr 172.21.15.104:0/3430861856 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efed9d640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f001f9a80 0x7f0f001408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efe59c640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ee8004000 0x7f0f001432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efdd9b640 1 -- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f001f9a80 msgr2=0x7f0f001408a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efdd9b640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f001f9a80 0x7f0f001408a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efdd9b640 1 -- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ee8004000 msgr2=0x7f0f001432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efdd9b640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ee8004000 0x7f0f001432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efdd9b640 1 -- 172.21.15.104:0/3430861856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f00143bd0 con 0x7f0f0014d340 2024-09-17T03:01:39.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0efdd9b640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f0014d340 0x7f0f001533b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f0ef402b060 tx=0x7f0ef4006cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:39.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0eeeffd640 1 -- 172.21.15.104:0/3430861856 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4032070 con 0x7f0f0014d340 2024-09-17T03:01:39.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0eeeffd640 1 -- 172.21.15.104:0/3430861856 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ef40038e0 con 0x7f0f0014d340 2024-09-17T03:01:39.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f00143eb0 con 0x7f0f0014d340 2024-09-17T03:01:39.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0eeeffd640 1 -- 172.21.15.104:0/3430861856 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4003cb0 con 0x7f0f0014d340 2024-09-17T03:01:39.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.764+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f001f9280 con 0x7f0f0014d340 2024-09-17T03:01:39.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.765+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f000cf070 con 0x7f0f0014d340 2024-09-17T03:01:39.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.766+0000 7f0eeeffd640 1 -- 172.21.15.104:0/3430861856 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ef4035020 con 0x7f0f0014d340 2024-09-17T03:01:39.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.766+0000 7f0eeeffd640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ee0078b90 0x7f0ee007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:39.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.767+0000 7f0eeeffd640 1 -- 172.21.15.104:0/3430861856 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f0ef40baaf0 con 0x7f0f0014d340 2024-09-17T03:01:39.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.767+0000 7f0efe59c640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ee0078b90 0x7f0ee007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:39.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.767+0000 7f0efe59c640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ee0078b90 0x7f0ee007b0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009c50 tx=0x7f0ef0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:39.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.771+0000 7f0eeeffd640 1 -- 172.21.15.104:0/3430861856 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ef4046030 con 0x7f0f0014d340 2024-09-17T03:01:39.978 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.979+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f00143960 con 0x7f0f0014d340 2024-09-17T03:01:39.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.979+0000 7f0eeeffd640 1 -- 172.21.15.104:0/3430861856 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f0ef403d070 con 0x7f0f0014d340 2024-09-17T03:01:39.979 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:39.979 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:01:39.980 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:01:39.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ee0078b90 msgr2=0x7f0ee007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ee0078b90 0x7f0ee007b0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009c50 tx=0x7f0ef0005f90 comp rx=0 tx=0).stop 2024-09-17T03:01:39.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f0014d340 msgr2=0x7f0f001533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:39.981 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f0014d340 0x7f0f001533b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f0ef402b060 tx=0x7f0ef4006cb0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 shutdown_connections 2024-09-17T03:01:39.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ee0078b90 0x7f0ee007b0a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f001f9a80 0x7f0f001408a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0f0014d340 0x7f0f001533b0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 --2- 172.21.15.104:0/3430861856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ee8004000 0x7f0f001432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:39.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 >> 172.21.15.104:0/3430861856 conn(0x7f0f000b2450 msgr2=0x7f0f000b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:39.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 shutdown_connections 2024-09-17T03:01:39.982 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:39.982+0000 7f0f04ebd640 1 -- 172.21.15.104:0/3430861856 wait complete. 2024-09-17T03:01:39.993 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:40.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.105+0000 7f5170af2640 1 -- 172.21.15.104:0/3921722984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c152ce0 msgr2=0x7f516c06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.105+0000 7f5170af2640 1 --2- 172.21.15.104:0/3921722984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c152ce0 0x7f516c06f540 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f516c15d1d0 tx=0x7f515c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.105+0000 7f5170af2640 1 -- 172.21.15.104:0/3921722984 shutdown_connections 2024-09-17T03:01:40.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.105+0000 7f5170af2640 1 --2- 172.21.15.104:0/3921722984 >> v2:172.21.15.192:3300/0 conn(0x7f516c073c90 0x7f516c0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.105+0000 7f5170af2640 1 --2- 172.21.15.104:0/3921722984 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c152ce0 0x7f516c06f540 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.105+0000 7f5170af2640 1 -- 172.21.15.104:0/3921722984 >> 172.21.15.104:0/3921722984 conn(0x7f516c0b3640 msgr2=0x7f516c0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:40.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.105+0000 7f5170af2640 1 -- 172.21.15.104:0/3921722984 shutdown_connections 2024-09-17T03:01:40.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.105+0000 7f5170af2640 1 -- 172.21.15.104:0/3921722984 wait complete. 2024-09-17T03:01:40.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.107+0000 7f5170af2640 1 Processor -- start 2024-09-17T03:01:40.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.107+0000 7f5170af2640 1 -- start start 2024-09-17T03:01:40.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.108+0000 7f5170af2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c06fa80 0x7f516c143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.109 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.108+0000 7f5170af2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c152ce0 0x7f516c0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f5170af2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c158770 0x7f516c158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f5170af2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f516c0b5860 con 0x7f516c06fa80 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f5170af2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f516c0b56e0 con 0x7f516c152ce0 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f5170af2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f516c0b59e0 con 0x7f516c158770 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c06fa80 0x7f516c143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c06fa80 0x7f516c143e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41372/0 (socket says 172.21.15.104:41372) 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 -- 172.21.15.104:0/1478074054 learned_addr learned my addr 172.21.15.104:0/1478074054 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f5161d9b640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c152ce0 0x7f516c0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516ad9d640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c158770 0x7f516c158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 -- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c158770 msgr2=0x7f516c158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c158770 0x7f516c158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 -- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c152ce0 msgr2=0x7f516c0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c152ce0 0x7f516c0c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 -- 172.21.15.104:0/1478074054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c1590c0 con 0x7f516c06fa80 2024-09-17T03:01:40.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f516a59c640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c06fa80 0x7f516c143e40 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f515c02aa90 tx=0x7f515c033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:40.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f51637fe640 1 -- 172.21.15.104:0/1478074054 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c031d60 con 0x7f516c06fa80 2024-09-17T03:01:40.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f51637fe640 1 -- 172.21.15.104:0/1478074054 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f515c005020 con 0x7f516c06fa80 2024-09-17T03:01:40.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516c146650 con 0x7f516c06fa80 2024-09-17T03:01:40.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f51637fe640 1 -- 172.21.15.104:0/1478074054 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c005470 con 0x7f516c06fa80 2024-09-17T03:01:40.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.109+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f516c146c30 con 0x7f516c06fa80 2024-09-17T03:01:40.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.110+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516c0b5e90 con 0x7f516c06fa80 2024-09-17T03:01:40.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.111+0000 7f51637fe640 1 -- 172.21.15.104:0/1478074054 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f515c0047a0 con 0x7f516c06fa80 2024-09-17T03:01:40.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.112+0000 7f51637fe640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f514c078b90 0x7f514c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.112+0000 7f51637fe640 1 -- 172.21.15.104:0/1478074054 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f515c0bbe00 con 0x7f516c06fa80 2024-09-17T03:01:40.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.112+0000 7f5161d9b640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f514c078b90 0x7f514c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.112+0000 7f5161d9b640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f514c078b90 0x7f514c07b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f516c159530 tx=0x7f5154007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:40.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.116+0000 7f51637fe640 1 -- 172.21.15.104:0/1478074054 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f516c1590c0 con 0x7f516c06fa80 2024-09-17T03:01:40.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.326+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f516c06f860 con 0x7f516c06fa80 2024-09-17T03:01:40.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.327+0000 7f51637fe640 1 -- 172.21.15.104:0/1478074054 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5237 (secure 0 0 0) 0x7f515c03f030 con 0x7f516c06fa80 2024-09-17T03:01:40.326 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:40.326 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":55,"btime":"2024-09-17T03:00:55:890512+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:00:53.229480+0000","modified":"2024-09-17T03:00:55.235571+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7044},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7044":{"gid":7044,"name":"d","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1420152986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1420152986},{"type":"v1","addr":"172.21.15.192:6837","nonce":1420152986}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7044,"qdb_cluster":[7044]},"id":8}]} 2024-09-17T03:01:40.327 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 55 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f514c078b90 msgr2=0x7f514c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f514c078b90 0x7f514c07b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f516c159530 tx=0x7f5154007e90 comp rx=0 tx=0).stop 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c06fa80 msgr2=0x7f516c143e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c06fa80 0x7f516c143e40 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f515c02aa90 tx=0x7f515c033c90 comp rx=0 tx=0).stop 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 shutdown_connections 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f514c078b90 0x7f514c07b0a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f516c152ce0 0x7f516c0c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f516c158770 0x7f516c158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 --2- 172.21.15.104:0/1478074054 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f516c06fa80 0x7f516c143e40 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 >> 172.21.15.104:0/1478074054 conn(0x7f516c0b3640 msgr2=0x7f516c159cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 shutdown_connections 2024-09-17T03:01:40.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.329+0000 7f5170af2640 1 -- 172.21.15.104:0/1478074054 wait complete. 2024-09-17T03:01:40.340 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:01:40.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 -- 172.21.15.104:0/165916098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00744d0 msgr2=0x7f12f006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 --2- 172.21.15.104:0/165916098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00744d0 0x7f12f006fad0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f12f00afcd0 tx=0x7f12ec02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 -- 172.21.15.104:0/165916098 shutdown_connections 2024-09-17T03:01:40.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 --2- 172.21.15.104:0/165916098 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12f00cd6b0 0x7f12f0156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 --2- 172.21.15.104:0/165916098 >> v2:172.21.15.192:3300/0 conn(0x7f12f015dd20 0x7f12f00cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 --2- 172.21.15.104:0/165916098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00744d0 0x7f12f006fad0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 -- 172.21.15.104:0/165916098 >> 172.21.15.104:0/165916098 conn(0x7f12f00b2450 msgr2=0x7f12f00b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:40.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 -- 172.21.15.104:0/165916098 shutdown_connections 2024-09-17T03:01:40.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.452+0000 7f12f7d39640 1 -- 172.21.15.104:0/165916098 wait complete. 2024-09-17T03:01:40.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.454+0000 7f12f7d39640 1 Processor -- start 2024-09-17T03:01:40.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.454+0000 7f12f7d39640 1 -- start start 2024-09-17T03:01:40.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.455+0000 7f12f7d39640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12f00744d0 0x7f12f015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.455+0000 7f12f7d39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00cd6b0 0x7f12f0145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.455+0000 7f12f7d39640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12f015dd20 0x7f12f0146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f7d39640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01572d0 con 0x7f12f00cd6b0 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f7d39640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0157150 con 0x7f12f00744d0 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f7d39640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f12f0157450 con 0x7f12f015dd20 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00cd6b0 0x7f12f0145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00cd6b0 0x7f12f0145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41388/0 (socket says 172.21.15.104:41388) 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 -- 172.21.15.104:0/4146849749 learned_addr learned my addr 172.21.15.104:0/4146849749 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f5ad5640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12f00744d0 0x7f12f015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f62d6640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12f015dd20 0x7f12f0146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 -- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12f015dd20 msgr2=0x7f12f0146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12f015dd20 0x7f12f0146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 -- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12f00744d0 msgr2=0x7f12f015c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12f00744d0 0x7f12f015c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 -- 172.21.15.104:0/4146849749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f01491a0 con 0x7f12f00cd6b0 2024-09-17T03:01:40.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f5ad5640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12f00744d0 0x7f12f015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:40.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f52d4640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00cd6b0 0x7f12f0145b20 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c9a0 tx=0x7f12e000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:40.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12e67fc640 1 -- 172.21.15.104:0/4146849749 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e0007b50 con 0x7f12f00cd6b0 2024-09-17T03:01:40.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12e67fc640 1 -- 172.21.15.104:0/4146849749 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12e0007de0 con 0x7f12f00cd6b0 2024-09-17T03:01:40.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12e67fc640 1 -- 172.21.15.104:0/4146849749 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e0005280 con 0x7f12f00cd6b0 2024-09-17T03:01:40.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f0149480 con 0x7f12f00cd6b0 2024-09-17T03:01:40.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.456+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f00ac9d0 con 0x7f12f00cd6b0 2024-09-17T03:01:40.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.457+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f00b30b0 con 0x7f12f00cd6b0 2024-09-17T03:01:40.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.458+0000 7f12e67fc640 1 -- 172.21.15.104:0/4146849749 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f12e0005420 con 0x7f12f00cd6b0 2024-09-17T03:01:40.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.458+0000 7f12e67fc640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12d4078bc0 0x7f12d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.459+0000 7f12e67fc640 1 -- 172.21.15.104:0/4146849749 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7f12e009b110 con 0x7f12f00cd6b0 2024-09-17T03:01:40.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.459+0000 7f12f5ad5640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12d4078bc0 0x7f12d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.459+0000 7f12f5ad5640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12d4078bc0 0x7f12d407b0d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f12ec033000 tx=0x7f12ec004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:40.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.463+0000 7f12e67fc640 1 -- 172.21.15.104:0/4146849749 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f12e0014030 con 0x7f12f00cd6b0 2024-09-17T03:01:40.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.636+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12f015f440 con 0x7f12f00cd6b0 2024-09-17T03:01:40.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.637+0000 7f12e67fc640 1 -- 172.21.15.104:0/4146849749 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16836 (secure 0 0 0) 0x7f12e0063660 con 0x7f12f00cd6b0 2024-09-17T03:01:40.637 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:40.637 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":142,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:01:33.146751+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:00:50.865818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T03:00:52.188131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":2}]},{"pgid":"17.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:01:40.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12d4078bc0 msgr2=0x7f12d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12d4078bc0 0x7f12d407b0d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f12ec033000 tx=0x7f12ec004730 comp rx=0 tx=0).stop 2024-09-17T03:01:40.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00cd6b0 msgr2=0x7f12f0145b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00cd6b0 0x7f12f0145b20 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c9a0 tx=0x7f12e000ce60 comp rx=0 tx=0).stop 2024-09-17T03:01:40.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 shutdown_connections 2024-09-17T03:01:40.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12d4078bc0 0x7f12d407b0d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.639 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12f015dd20 0x7f12f0146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12f00cd6b0 0x7f12f0145b20 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 --2- 172.21.15.104:0/4146849749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12f00744d0 0x7f12f015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 >> 172.21.15.104:0/4146849749 conn(0x7f12f00b2450 msgr2=0x7f12f015e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:40.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 shutdown_connections 2024-09-17T03:01:40.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.639+0000 7f12f7d39640 1 -- 172.21.15.104:0/4146849749 wait complete. 2024-09-17T03:01:40.650 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:01:40.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.764+0000 7fd3543e4640 1 -- 172.21.15.104:0/1862169158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd338004080 msgr2=0x7fd338004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.764+0000 7fd3543e4640 1 --2- 172.21.15.104:0/1862169158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd338004080 0x7fd338004800 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00bb20 tx=0x7fd338005830 comp rx=0 tx=0).stop 2024-09-17T03:01:40.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.764+0000 7fd352981640 1 -- 172.21.15.104:0/1862169158 reap_dead start 2024-09-17T03:01:40.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.764+0000 7fd3543e4640 1 -- 172.21.15.104:0/1862169158 shutdown_connections 2024-09-17T03:01:40.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.764+0000 7fd3543e4640 1 -- 172.21.15.104:0/1862169158 >> 172.21.15.104:0/1862169158 conn(0x7fd34c0b2450 msgr2=0x7fd34c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:40.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.764+0000 7fd3543e4640 1 -- 172.21.15.104:0/1862169158 shutdown_connections 2024-09-17T03:01:40.764 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.764+0000 7fd3543e4640 1 -- 172.21.15.104:0/1862169158 wait complete. 2024-09-17T03:01:40.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.766+0000 7fd3543e4640 1 Processor -- start 2024-09-17T03:01:40.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.766+0000 7fd3543e4640 1 -- start start 2024-09-17T03:01:40.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd3543e4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd338004080 0x7fd34c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd3543e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd34c1f80d0 0x7fd34c151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd3543e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd34c1f7450 0x7fd34c1f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd3543e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c0cd500 con 0x7fd34c1f80d0 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd3543e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c0cd380 con 0x7fd34c1f7450 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd3543e4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd34c156f40 con 0x7fd338004080 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd35197f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd34c1f80d0 0x7fd34c151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd35197f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd34c1f80d0 0x7fd34c151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41416/0 (socket says 172.21.15.104:41416) 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd35197f640 1 -- 172.21.15.104:0/2889284141 learned_addr learned my addr 172.21.15.104:0/2889284141 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd352180640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd338004080 0x7fd34c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.767+0000 7fd352981640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd34c1f7450 0x7fd34c1f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd35197f640 1 -- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd338004080 msgr2=0x7fd34c153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd35197f640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd338004080 0x7fd34c153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd35197f640 1 -- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd34c1f7450 msgr2=0x7fd34c1f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd35197f640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd34c1f7450 0x7fd34c1f7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd35197f640 1 -- 172.21.15.104:0/2889284141 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c1f7da0 con 0x7fd34c1f80d0 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd352180640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd338004080 0x7fd34c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd352981640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd34c1f7450 0x7fd34c1f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd35197f640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd34c1f80d0 0x7fd34c151f90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00bb20 tx=0x7fd33c031f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd342ffd640 1 -- 172.21.15.104:0/2889284141 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c040070 con 0x7fd34c1f80d0 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd342ffd640 1 -- 172.21.15.104:0/2889284141 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd33c004120 con 0x7fd34c1f80d0 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34c0ae580 con 0x7fd34c1f80d0 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd342ffd640 1 -- 172.21.15.104:0/2889284141 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c035040 con 0x7fd34c1f80d0 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.768+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34c0aeb40 con 0x7fd34c1f80d0 2024-09-17T03:01:40.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.769+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34c153e60 con 0x7fd34c1f80d0 2024-09-17T03:01:40.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.770+0000 7fd342ffd640 1 -- 172.21.15.104:0/2889284141 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd33c038020 con 0x7fd34c1f80d0 2024-09-17T03:01:40.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.770+0000 7fd342ffd640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd330078b90 0x7fd33007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:40.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.770+0000 7fd342ffd640 1 -- 172.21.15.104:0/2889284141 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5767+0+0 (secure 0 0 0) 0x7fd33c0bbb40 con 0x7fd34c1f80d0 2024-09-17T03:01:40.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.771+0000 7fd352180640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd330078b90 0x7fd33007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:40.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.771+0000 7fd352180640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd330078b90 0x7fd33007b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0ce510 tx=0x7fd348005040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:40.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.775+0000 7fd342ffd640 1 -- 172.21.15.104:0/2889284141 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd33c04a060 con 0x7fd34c1f80d0 2024-09-17T03:01:40.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.984+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd34c1574a0 con 0x7fd34c1f80d0 2024-09-17T03:01:40.984 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T03:01:40.985+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:01:40.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.987+0000 7fd342ffd640 1 -- 172.21.15.104:0/2889284141 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) ==== 161+0+0 (secure 0 0 0) 0x7fd34c1f7da0 con 0x7fd34c1f80d0 2024-09-17T03:01:40.986 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:01:40.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd330078b90 msgr2=0x7fd33007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd330078b90 0x7fd33007b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0ce510 tx=0x7fd348005040 comp rx=0 tx=0).stop 2024-09-17T03:01:40.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd34c1f80d0 msgr2=0x7fd34c151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:40.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd34c1f80d0 0x7fd34c151f90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00bb20 tx=0x7fd33c031f80 comp rx=0 tx=0).stop 2024-09-17T03:01:40.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 shutdown_connections 2024-09-17T03:01:40.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd330078b90 0x7fd33007b0a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd34c1f7450 0x7fd34c1f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd34c1f80d0 0x7fd34c151f90 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 --2- 172.21.15.104:0/2889284141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd338004080 0x7fd34c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:40.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 >> 172.21.15.104:0/2889284141 conn(0x7fd34c0b2450 msgr2=0x7fd34c0b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:40.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 shutdown_connections 2024-09-17T03:01:40.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:40.990+0000 7fd3543e4640 1 -- 172.21.15.104:0/2889284141 wait complete. 2024-09-17T03:01:41.002 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:01:41.056 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T03:01:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.117+0000 7f013b215640 1 -- 172.21.15.104:0/3815198263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340d0470 msgr2=0x7f01340d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.117+0000 7f013b215640 1 --2- 172.21.15.104:0/3815198263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340d0470 0x7f01340d0880 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0134074350 tx=0x7f012402a410 comp rx=0 tx=0).stop 2024-09-17T03:01:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.117+0000 7f013b215640 1 -- 172.21.15.104:0/3815198263 shutdown_connections 2024-09-17T03:01:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.117+0000 7f013b215640 1 --2- 172.21.15.104:0/3815198263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340d0470 0x7f01340d0880 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.117+0000 7f013b215640 1 --2- 172.21.15.104:0/3815198263 >> v2:172.21.15.192:3300/0 conn(0x7f01340b7bb0 0x7f01340cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.117+0000 7f013b215640 1 -- 172.21.15.104:0/3815198263 >> 172.21.15.104:0/3815198263 conn(0x7f01340d28a0 msgr2=0x7f01340d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:41.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.117+0000 7f013b215640 1 -- 172.21.15.104:0/3815198263 shutdown_connections 2024-09-17T03:01:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.117+0000 7f013b215640 1 -- 172.21.15.104:0/3815198263 wait complete. 2024-09-17T03:01:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.119+0000 7f013b215640 1 Processor -- start 2024-09-17T03:01:41.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.119+0000 7f013b215640 1 -- start start 2024-09-17T03:01:41.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f013b215640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01340b7bb0 0x7f01341cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:41.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f013b215640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340cefb0 0x7f0134071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:41.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f013b215640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01340d0470 0x7f0134071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:41.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f013b215640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f01340b3590 con 0x7f01340cefb0 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f013b215640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f01340ce5e0 con 0x7f01340d0470 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f013b215640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f01340cfad0 con 0x7f01340b7bb0 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340cefb0 0x7f0134071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340cefb0 0x7f0134071880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41430/0 (socket says 172.21.15.104:41430) 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 -- 172.21.15.104:0/2520225845 learned_addr learned my addr 172.21.15.104:0/2520225845 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f0138fb1640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01340b7bb0 0x7f01341cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f01397b2640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01340d0470 0x7f0134071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 -- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01340b7bb0 msgr2=0x7f01341cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01340b7bb0 0x7f01341cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:41.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 -- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01340d0470 msgr2=0x7f0134071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:41.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01340d0470 0x7f0134071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:41.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 -- 172.21.15.104:0/2520225845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01341cd490 con 0x7f01340cefb0 2024-09-17T03:01:41.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f012bfff640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340cefb0 0x7f0134071880 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f012402aa00 tx=0x7f0124033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:41.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f01297fa640 1 -- 172.21.15.104:0/2520225845 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124031e20 con 0x7f01340cefb0 2024-09-17T03:01:41.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f01297fa640 1 -- 172.21.15.104:0/2520225845 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0124005110 con 0x7f01340cefb0 2024-09-17T03:01:41.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01341cd770 con 0x7f01340cefb0 2024-09-17T03:01:41.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f01297fa640 1 -- 172.21.15.104:0/2520225845 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124005560 con 0x7f01340cefb0 2024-09-17T03:01:41.123 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.121+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01341cdd30 con 0x7f01340cefb0 2024-09-17T03:01:41.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.122+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01340d15f0 con 0x7f01340cefb0 2024-09-17T03:01:41.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.124+0000 7f01297fa640 1 -- 172.21.15.104:0/2520225845 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f01240047a0 con 0x7f01340cefb0 2024-09-17T03:01:41.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.124+0000 7f01297fa640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0120078b90 0x7f012007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:41.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.124+0000 7f01297fa640 1 -- 172.21.15.104:0/2520225845 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5853+0+0 (secure 0 0 0) 0x7f01240bc3d0 con 0x7f01340cefb0 2024-09-17T03:01:41.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.125+0000 7f0138fb1640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0120078b90 0x7f012007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:41.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.125+0000 7f0138fb1640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0120078b90 0x7f012007b0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0130009960 tx=0x7f0130009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:41.127 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.128+0000 7f01297fa640 1 -- 172.21.15.104:0/2520225845 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f01340d15f0 con 0x7f01340cefb0 2024-09-17T03:01:41.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.337+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f01340cde90 con 0x7f01340cefb0 2024-09-17T03:01:41.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.988+0000 7f01297fa640 1 -- 172.21.15.104:0/2520225845 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) ==== 104+0+0 (secure 0 0 0) 0x7f012403f030 con 0x7f01340cefb0 2024-09-17T03:01:41.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0120078b90 msgr2=0x7f012007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0120078b90 0x7f012007b0a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0130009960 tx=0x7f0130009060 comp rx=0 tx=0).stop 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340cefb0 msgr2=0x7f0134071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340cefb0 0x7f0134071880 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f012402aa00 tx=0x7f0124033d60 comp rx=0 tx=0).stop 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 shutdown_connections 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0120078b90 0x7f012007b0a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01340d0470 0x7f0134071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f01340cefb0 0x7f0134071880 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 --2- 172.21.15.104:0/2520225845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01340b7bb0 0x7f01341cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 >> 172.21.15.104:0/2520225845 conn(0x7f01340d28a0 msgr2=0x7f01341e4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:41.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 shutdown_connections 2024-09-17T03:01:41.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:41.991+0000 7f013b215640 1 -- 172.21.15.104:0/2520225845 wait complete. 2024-09-17T03:01:42.004 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:01:42.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.125+0000 7ff5371c6640 1 -- 172.21.15.104:0/86200313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b3ea0 msgr2=0x7ff5300b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:42.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.125+0000 7ff5371c6640 1 --2- 172.21.15.104:0/86200313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b3ea0 0x7ff5300b2300 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff53006a240 tx=0x7ff52002a440 comp rx=0 tx=0).stop 2024-09-17T03:01:42.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.125+0000 7ff5371c6640 1 -- 172.21.15.104:0/86200313 shutdown_connections 2024-09-17T03:01:42.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.125+0000 7ff5371c6640 1 --2- 172.21.15.104:0/86200313 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b3ea0 0x7ff5300b2300 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:42.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.125+0000 7ff5371c6640 1 --2- 172.21.15.104:0/86200313 >> v2:172.21.15.192:3300/0 conn(0x7ff5300b81a0 0x7ff5300b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:42.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.125+0000 7ff5371c6640 1 -- 172.21.15.104:0/86200313 >> 172.21.15.104:0/86200313 conn(0x7ff5300d29c0 msgr2=0x7ff5300d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:42.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.125+0000 7ff5371c6640 1 -- 172.21.15.104:0/86200313 shutdown_connections 2024-09-17T03:01:42.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.125+0000 7ff5371c6640 1 -- 172.21.15.104:0/86200313 wait complete. 2024-09-17T03:01:42.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.126+0000 7ff5371c6640 1 Processor -- start 2024-09-17T03:01:42.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.126+0000 7ff5371c6640 1 -- start start 2024-09-17T03:01:42.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff5371c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5300b2840 0x7ff5300cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:42.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff5371c6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5300b3ea0 0x7ff5301fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:42.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff5371c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b81a0 0x7ff53006fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:42.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff5371c6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff5300b7200 con 0x7ff5300b81a0 2024-09-17T03:01:42.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff5371c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff5300b3570 con 0x7ff5300b2840 2024-09-17T03:01:42.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff5371c6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff5300b7380 con 0x7ff5300b3ea0 2024-09-17T03:01:42.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff535763640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b81a0 0x7ff53006fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff535763640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b81a0 0x7ff53006fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41450/0 (socket says 172.21.15.104:41450) 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff535763640 1 -- 172.21.15.104:0/1072992580 learned_addr learned my addr 172.21.15.104:0/1072992580 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff534f62640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5300b2840 0x7ff5300cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff527fff640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5300b3ea0 0x7ff5301fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff535763640 1 -- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5300b3ea0 msgr2=0x7ff5301fa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff535763640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5300b3ea0 0x7ff5301fa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff535763640 1 -- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5300b2840 msgr2=0x7ff5300cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff535763640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5300b2840 0x7ff5300cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.128+0000 7ff535763640 1 -- 172.21.15.104:0/1072992580 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5300cc2d0 con 0x7ff5300b81a0 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.129+0000 7ff535763640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b81a0 0x7ff53006fa30 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ff52800b9a0 tx=0x7ff52800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:42.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.129+0000 7ff5257fa640 1 -- 172.21.15.104:0/1072992580 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528019070 con 0x7ff5300b81a0 2024-09-17T03:01:42.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.129+0000 7ff5257fa640 1 -- 172.21.15.104:0/1072992580 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff52800cc90 con 0x7ff5300b81a0 2024-09-17T03:01:42.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.129+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5300cc5b0 con 0x7ff5300b81a0 2024-09-17T03:01:42.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.129+0000 7ff5257fa640 1 -- 172.21.15.104:0/1072992580 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280146a0 con 0x7ff5300b81a0 2024-09-17T03:01:42.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.129+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5301f5880 con 0x7ff5300b81a0 2024-09-17T03:01:42.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.130+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5300b2300 con 0x7ff5300b81a0 2024-09-17T03:01:42.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.131+0000 7ff5257fa640 1 -- 172.21.15.104:0/1072992580 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff52801c070 con 0x7ff5300b81a0 2024-09-17T03:01:42.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.131+0000 7ff5257fa640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff51c078b90 0x7ff51c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:42.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.131+0000 7ff5257fa640 1 -- 172.21.15.104:0/1072992580 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5853+0+0 (secure 0 0 0) 0x7ff52809a950 con 0x7ff5300b81a0 2024-09-17T03:01:42.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.131+0000 7ff534f62640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff51c078b90 0x7ff51c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:42.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.132+0000 7ff534f62640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff51c078b90 0x7ff51c07b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff52c004630 tx=0x7ff52c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:42.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.136+0000 7ff5257fa640 1 -- 172.21.15.104:0/1072992580 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff528062740 con 0x7ff5300b81a0 2024-09-17T03:01:42.312 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:42.311+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff5300cf990 con 0x7ff5300b81a0 2024-09-17T03:01:43.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.149+0000 7ff5257fa640 1 -- 172.21.15.104:0/1072992580 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) ==== 181+0+0 (secure 0 0 0) 0x7ff528067170 con 0x7ff5300b81a0 2024-09-17T03:01:43.149 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:01:43.152 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff51c078b90 msgr2=0x7ff51c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff51c078b90 0x7ff51c07b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff52c004630 tx=0x7ff52c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b81a0 msgr2=0x7ff53006fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b81a0 0x7ff53006fa30 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7ff52800b9a0 tx=0x7ff52800be60 comp rx=0 tx=0).stop 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 shutdown_connections 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff51c078b90 0x7ff51c07b0a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff5300b81a0 0x7ff53006fa30 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5300b3ea0 0x7ff5301fa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 --2- 172.21.15.104:0/1072992580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5300b2840 0x7ff5300cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 >> 172.21.15.104:0/1072992580 conn(0x7ff5300d29c0 msgr2=0x7ff530160ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 shutdown_connections 2024-09-17T03:01:43.153 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.153+0000 7ff5371c6640 1 -- 172.21.15.104:0/1072992580 wait complete. 2024-09-17T03:01:43.167 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:01:43.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.292+0000 7fe8a5493640 1 -- 172.21.15.104:0/2785838248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe888004db0 msgr2=0x7fe888005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:43.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.292+0000 7fe8a5493640 1 --2- 172.21.15.104:0/2785838248 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe888004db0 0x7fe888005280 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0074150 tx=0x7fe888005830 comp rx=0 tx=0).stop 2024-09-17T03:01:43.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.292+0000 7fe89f7fe640 1 -- 172.21.15.104:0/2785838248 reap_dead start 2024-09-17T03:01:43.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.292+0000 7fe8a5493640 1 -- 172.21.15.104:0/2785838248 shutdown_connections 2024-09-17T03:01:43.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.292+0000 7fe8a5493640 1 -- 172.21.15.104:0/2785838248 >> 172.21.15.104:0/2785838248 conn(0x7fe8a0074240 msgr2=0x7fe8a0074650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:43.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.292+0000 7fe8a5493640 1 -- 172.21.15.104:0/2785838248 shutdown_connections 2024-09-17T03:01:43.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.292+0000 7fe8a5493640 1 -- 172.21.15.104:0/2785838248 wait complete. 2024-09-17T03:01:43.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.294+0000 7fe8a5493640 1 Processor -- start 2024-09-17T03:01:43.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.294+0000 7fe8a5493640 1 -- start start 2024-09-17T03:01:43.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe8a5493640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe888004db0 0x7fe8a0145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:43.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe8a5493640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8a01e6340 0x7fe8a01e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe8a5493640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8a01f7000 0x7fe8a01f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe8a5493640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a0076830 con 0x7fe8a01e6340 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe8a5493640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a00766b0 con 0x7fe8a01f7000 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe8a5493640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a00769b0 con 0x7fe888004db0 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8a01e6340 0x7fe8a01e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8a01e6340 0x7fe8a01e6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:41460/0 (socket says 172.21.15.104:41460) 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 -- 172.21.15.104:0/922676987 learned_addr learned my addr 172.21.15.104:0/922676987 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89effd640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe888004db0 0x7fe8a0145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 -- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe888004db0 msgr2=0x7fe8a0145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89f7fe640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8a01f7000 0x7fe8a01f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe888004db0 0x7fe8a0145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 -- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8a01f7000 msgr2=0x7fe8a01f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:43.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8a01f7000 0x7fe8a01f7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:43.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 -- 172.21.15.104:0/922676987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a009c2a0 con 0x7fe8a01e6340 2024-09-17T03:01:43.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe89e7fc640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8a01e6340 0x7fe8a01e6750 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fe894006680 tx=0x7fe8940066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:43.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.295+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894015070 con 0x7fe8a01e6340 2024-09-17T03:01:43.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.296+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe894011900 con 0x7fe8a01e6340 2024-09-17T03:01:43.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.296+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a01e6c90 con 0x7fe8a01e6340 2024-09-17T03:01:43.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.296+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894011d30 con 0x7fe8a01e6340 2024-09-17T03:01:43.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.296+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a01e9530 con 0x7fe8a01e6340 2024-09-17T03:01:43.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.297+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a01e8590 con 0x7fe8a01e6340 2024-09-17T03:01:43.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.297+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe894018070 con 0x7fe8a01e6340 2024-09-17T03:01:43.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.298+0000 7fe8877fe640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe88c078bc0 0x7fe88c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:43.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.298+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5415+0+0 (secure 0 0 0) 0x7fe89409b9e0 con 0x7fe8a01e6340 2024-09-17T03:01:43.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.298+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=145}) -- 0x7fe88c07fb00 con 0x7fe8a01e6340 2024-09-17T03:01:43.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.298+0000 7fe89effd640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe88c078bc0 0x7fe88c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:43.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.299+0000 7fe89effd640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe88c078bc0 0x7fe88c07b0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe890005fd0 tx=0x7fe890009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:43.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.302+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8a01e6c90 con 0x7fe8a01e6340 2024-09-17T03:01:43.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:43.482+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8a00d1690 con 0x7fe8a01e6340 2024-09-17T03:01:44.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.241+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) ==== 169+0+0 (secure 0 0 0) 0x7fe894063f40 con 0x7fe8a01e6340 2024-09-17T03:01:44.241 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T03:01:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.244+0000 7fe8877fe640 1 -- 172.21.15.104:0/922676987 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(145..145 src has 1..145) ==== 330+0+0 (secure 0 0 0) 0x7fe89409a140 con 0x7fe8a01e6340 2024-09-17T03:01:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.244+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe88c078bc0 msgr2=0x7fe88c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.244+0000 7fe8a5493640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe88c078bc0 0x7fe88c07b0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe890005fd0 tx=0x7fe890009500 comp rx=0 tx=0).stop 2024-09-17T03:01:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.244+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8a01e6340 msgr2=0x7fe8a01e6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.244+0000 7fe8a5493640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8a01e6340 0x7fe8a01e6750 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fe894006680 tx=0x7fe8940066b0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.247+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 shutdown_connections 2024-09-17T03:01:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.247+0000 7fe8a5493640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe88c078bc0 0x7fe88c07b0d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.247+0000 7fe8a5493640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8a01f7000 0x7fe8a01f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.247+0000 7fe8a5493640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe8a01e6340 0x7fe8a01e6750 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.247+0000 7fe8a5493640 1 --2- 172.21.15.104:0/922676987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe888004db0 0x7fe8a0145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.247+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 >> 172.21.15.104:0/922676987 conn(0x7fe8a0074240 msgr2=0x7fe8a006eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:44.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.254+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 shutdown_connections 2024-09-17T03:01:44.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.255+0000 7fe8a5493640 1 -- 172.21.15.104:0/922676987 wait complete. 2024-09-17T03:01:44.269 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T03:01:44.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.386+0000 7f649dacc640 1 -- 172.21.15.104:0/4100237916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980cdf10 msgr2=0x7f64980b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.386+0000 7f649dacc640 1 --2- 172.21.15.104:0/4100237916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980cdf10 0x7f64980b57e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f64980c98b0 tx=0x7f648c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.386+0000 7f649dacc640 1 -- 172.21.15.104:0/4100237916 shutdown_connections 2024-09-17T03:01:44.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.386+0000 7f649dacc640 1 --2- 172.21.15.104:0/4100237916 >> v2:172.21.15.192:3300/0 conn(0x7f64980b5d20 0x7f64980cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.386+0000 7f649dacc640 1 --2- 172.21.15.104:0/4100237916 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980cdf10 0x7f64980b57e0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.386+0000 7f649dacc640 1 -- 172.21.15.104:0/4100237916 >> 172.21.15.104:0/4100237916 conn(0x7f64980b44a0 msgr2=0x7f64980b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:44.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.386+0000 7f649dacc640 1 -- 172.21.15.104:0/4100237916 shutdown_connections 2024-09-17T03:01:44.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.386+0000 7f649dacc640 1 -- 172.21.15.104:0/4100237916 wait complete. 2024-09-17T03:01:44.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.388+0000 7f649dacc640 1 Processor -- start 2024-09-17T03:01:44.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.388+0000 7f649dacc640 1 -- start start 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f649dacc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980b4fc0 0x7f64981f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f649dacc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64980b5d20 0x7f649814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f649dacc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64980cdf10 0x7f64980c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f649dacc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64980d18c0 con 0x7f64980b4fc0 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f649dacc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64980d01d0 con 0x7f64980cdf10 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f649dacc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6498160f50 con 0x7f64980b5d20 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980b4fc0 0x7f64981f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980b4fc0 0x7f64981f7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40684/0 (socket says 172.21.15.104:40684) 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 -- 172.21.15.104:0/2962475922 learned_addr learned my addr 172.21.15.104:0/2962475922 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:44.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f6497fff640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64980cdf10 0x7f64980c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f6496ffd640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64980b5d20 0x7f649814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 -- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64980b5d20 msgr2=0x7f649814fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64980b5d20 0x7f649814fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 -- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64980cdf10 msgr2=0x7f64980c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64980cdf10 0x7f64980c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 -- 172.21.15.104:0/2962475922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64980b1cc0 con 0x7f64980b4fc0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f64977fe640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980b4fc0 0x7f64981f7870 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f648800c3a0 tx=0x7f648800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f647ffff640 1 -- 172.21.15.104:0/2962475922 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488017070 con 0x7f64980b4fc0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f647ffff640 1 -- 172.21.15.104:0/2962475922 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64880053c0 con 0x7f64980b4fc0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.390+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64980b1fa0 con 0x7f64980b4fc0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.391+0000 7f647ffff640 1 -- 172.21.15.104:0/2962475922 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488003850 con 0x7f64980b4fc0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.391+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64981f7350 con 0x7f64980b4fc0 2024-09-17T03:01:44.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.392+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64980cfa80 con 0x7f64980b4fc0 2024-09-17T03:01:44.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.392+0000 7f647ffff640 1 -- 172.21.15.104:0/2962475922 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f648801a070 con 0x7f64980b4fc0 2024-09-17T03:01:44.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.393+0000 7f647ffff640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6484078b90 0x7f648407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:44.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.393+0000 7f647ffff640 1 -- 172.21.15.104:0/2962475922 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f6488099cd0 con 0x7f64980b4fc0 2024-09-17T03:01:44.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.393+0000 7f6496ffd640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6484078b90 0x7f648407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:44.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.394+0000 7f6496ffd640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6484078b90 0x7f648407b0a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f648c033000 tx=0x7f648c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:44.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.397+0000 7f647ffff640 1 -- 172.21.15.104:0/2962475922 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6488061e50 con 0x7f64980b4fc0 2024-09-17T03:01:44.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.573+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f64980cead0 con 0x7f64980b4fc0 2024-09-17T03:01:44.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.577+0000 7f647ffff640 1 -- 172.21.15.104:0/2962475922 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7f6488066880 con 0x7f64980b4fc0 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6484078b90 msgr2=0x7f648407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6484078b90 0x7f648407b0a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f648c033000 tx=0x7f648c004730 comp rx=0 tx=0).stop 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980b4fc0 msgr2=0x7f64981f7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980b4fc0 0x7f64981f7870 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f648800c3a0 tx=0x7f648800c860 comp rx=0 tx=0).stop 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 shutdown_connections 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6484078b90 0x7f648407b0a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64980cdf10 0x7f64980c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64980b5d20 0x7f649814fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 --2- 172.21.15.104:0/2962475922 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64980b4fc0 0x7f64981f7870 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 >> 172.21.15.104:0/2962475922 conn(0x7f64980b44a0 msgr2=0x7f6498071fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:44.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.579+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 shutdown_connections 2024-09-17T03:01:44.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.580+0000 7f649dacc640 1 -- 172.21.15.104:0/2962475922 wait complete. 2024-09-17T03:01:44.590 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-17T03:01:44.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.702+0000 7f9cab81d640 1 -- 172.21.15.104:0/4069560300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 msgr2=0x7f9ca40cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.702+0000 7f9cab81d640 1 --2- 172.21.15.104:0/4069560300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 0x7f9ca40cffb0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4074d40 tx=0x7f9ca002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.702+0000 7f9cab81d640 1 -- 172.21.15.104:0/4069560300 shutdown_connections 2024-09-17T03:01:44.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.702+0000 7f9cab81d640 1 --2- 172.21.15.104:0/4069560300 >> v2:172.21.15.192:3300/0 conn(0x7f9ca40c70a0 0x7f9ca415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.702+0000 7f9cab81d640 1 --2- 172.21.15.104:0/4069560300 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 0x7f9ca40cffb0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.702+0000 7f9cab81d640 1 -- 172.21.15.104:0/4069560300 >> 172.21.15.104:0/4069560300 conn(0x7f9ca40b2710 msgr2=0x7f9ca40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:44.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.702+0000 7f9cab81d640 1 -- 172.21.15.104:0/4069560300 shutdown_connections 2024-09-17T03:01:44.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.702+0000 7f9cab81d640 1 -- 172.21.15.104:0/4069560300 wait complete. 2024-09-17T03:01:44.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.704+0000 7f9cab81d640 1 Processor -- start 2024-09-17T03:01:44.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.704+0000 7f9cab81d640 1 -- start start 2024-09-17T03:01:44.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9cab81d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 0x7f9ca41f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:44.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9cab81d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ca415c230 0x7f9ca41484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:44.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9cab81d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca4153380 0x7f9ca40c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:44.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9cab81d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4073de0 con 0x7f9ca4156280 2024-09-17T03:01:44.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9cab81d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4073c60 con 0x7f9ca4153380 2024-09-17T03:01:44.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9cab81d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca4073f60 con 0x7f9ca415c230 2024-09-17T03:01:44.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9ca95b9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 0x7f9ca41f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:44.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9ca95b9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 0x7f9ca41f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40700/0 (socket says 172.21.15.104:40700) 2024-09-17T03:01:44.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9ca95b9640 1 -- 172.21.15.104:0/2972930888 learned_addr learned my addr 172.21.15.104:0/2972930888 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:44.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9ca9dba640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca4153380 0x7f9ca40c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:44.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.705+0000 7f9ca8db8640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ca415c230 0x7f9ca41484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:44.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9ca95b9640 1 -- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ca415c230 msgr2=0x7f9ca41484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9ca95b9640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ca415c230 0x7f9ca41484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9ca95b9640 1 -- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca4153380 msgr2=0x7f9ca40c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9ca95b9640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca4153380 0x7f9ca40c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9ca95b9640 1 -- 172.21.15.104:0/2972930888 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca41f41d0 con 0x7f9ca4156280 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9ca9dba640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca4153380 0x7f9ca40c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9ca8db8640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ca415c230 0x7f9ca41484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9ca95b9640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 0x7f9ca41f3910 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0034040 tx=0x7f9ca00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9c99ffb640 1 -- 172.21.15.104:0/2972930888 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca003e030 con 0x7f9ca4156280 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9c99ffb640 1 -- 172.21.15.104:0/2972930888 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ca00047a0 con 0x7f9ca4156280 2024-09-17T03:01:44.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9c99ffb640 1 -- 172.21.15.104:0/2972930888 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0035040 con 0x7f9ca4156280 2024-09-17T03:01:44.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41f44b0 con 0x7f9ca4156280 2024-09-17T03:01:44.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.706+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca40c7ba0 con 0x7f9ca4156280 2024-09-17T03:01:44.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.707+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca4074450 con 0x7f9ca4156280 2024-09-17T03:01:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.708+0000 7f9c99ffb640 1 -- 172.21.15.104:0/2972930888 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ca0041030 con 0x7f9ca4156280 2024-09-17T03:01:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.708+0000 7f9c99ffb640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c88078b90 0x7f9c8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.709+0000 7f9c99ffb640 1 -- 172.21.15.104:0/2972930888 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f9ca00bb3a0 con 0x7f9ca4156280 2024-09-17T03:01:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.709+0000 7f9ca8db8640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c88078b90 0x7f9c8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:44.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.710+0000 7f9ca8db8640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c88078b90 0x7f9c8807b0a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9c94007fd0 tx=0x7f9c94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:44.712 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.713+0000 7f9c99ffb640 1 -- 172.21.15.104:0/2972930888 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ca0083a60 con 0x7f9ca4156280 2024-09-17T03:01:44.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:44.954+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7f9ca40cca60 con 0x7f9ca4156280 2024-09-17T03:01:45.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.237+0000 7f9c99ffb640 1 -- 172.21.15.104:0/2972930888 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v359) ==== 140+0+0 (secure 0 0 0) 0x7f9ca0083360 con 0x7f9ca4156280 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c88078b90 msgr2=0x7f9c8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c88078b90 0x7f9c8807b0a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9c94007fd0 tx=0x7f9c94009040 comp rx=0 tx=0).stop 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 msgr2=0x7f9ca41f3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 0x7f9ca41f3910 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0034040 tx=0x7f9ca00039e0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 shutdown_connections 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9c88078b90 0x7f9c8807b0a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca4153380 0x7f9ca40c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ca415c230 0x7f9ca41484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 --2- 172.21.15.104:0/2972930888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca4156280 0x7f9ca41f3910 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 >> 172.21.15.104:0/2972930888 conn(0x7f9ca40b2710 msgr2=0x7f9ca40b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 shutdown_connections 2024-09-17T03:01:45.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.239+0000 7f9cab81d640 1 -- 172.21.15.104:0/2972930888 wait complete. 2024-09-17T03:01:45.250 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-17T03:01:45.250 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2024-09-17T03:01:45.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:01:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.364+0000 7f4183807640 1 -- 172.21.15.104:0/4018123655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c073e00 msgr2=0x7f417c156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.364+0000 7f4183807640 1 --2- 172.21.15.104:0/4018123655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c073e00 0x7f417c156200 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f417c072ca0 tx=0x7f417802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.364+0000 7f4183807640 1 -- 172.21.15.104:0/4018123655 shutdown_connections 2024-09-17T03:01:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.364+0000 7f4183807640 1 --2- 172.21.15.104:0/4018123655 >> v2:172.21.15.192:3300/0 conn(0x7f417c15cc30 0x7f417c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.364+0000 7f4183807640 1 --2- 172.21.15.104:0/4018123655 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c073e00 0x7f417c156200 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.364+0000 7f4183807640 1 -- 172.21.15.104:0/4018123655 >> 172.21.15.104:0/4018123655 conn(0x7f417c06eb90 msgr2=0x7f417c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.364+0000 7f4183807640 1 -- 172.21.15.104:0/4018123655 shutdown_connections 2024-09-17T03:01:45.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.364+0000 7f4183807640 1 -- 172.21.15.104:0/4018123655 wait complete. 2024-09-17T03:01:45.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.366+0000 7f4183807640 1 Processor -- start 2024-09-17T03:01:45.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.366+0000 7f4183807640 1 -- start start 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4183807640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f417c073e00 0x7f417c147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4183807640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c0cdcb0 0x7f417c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4183807640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f417c15cc30 0x7f417c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4183807640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f417c15feb0 con 0x7f417c0cdcb0 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4183807640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f417c15d2c0 con 0x7f417c15cc30 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4183807640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f417c160030 con 0x7f417c073e00 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4180da2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c0cdcb0 0x7f417c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4180da2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c0cdcb0 0x7f417c0c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40724/0 (socket says 172.21.15.104:40724) 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4180da2640 1 -- 172.21.15.104:0/4027533275 learned_addr learned my addr 172.21.15.104:0/4027533275 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:45.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f41815a3640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f417c073e00 0x7f417c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.367+0000 7f4181da4640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f417c15cc30 0x7f417c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4180da2640 1 -- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f417c073e00 msgr2=0x7f417c147560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4180da2640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f417c073e00 0x7f417c147560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4180da2640 1 -- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f417c15cc30 msgr2=0x7f417c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4180da2640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f417c15cc30 0x7f417c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4180da2640 1 -- 172.21.15.104:0/4027533275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c156a30 con 0x7f417c0cdcb0 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4180da2640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c0cdcb0 0x7f417c0c6010 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f416c00b440 tx=0x7f416c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4171ffb640 1 -- 172.21.15.104:0/4027533275 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c015020 con 0x7f417c0cdcb0 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4171ffb640 1 -- 172.21.15.104:0/4027533275 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f416c011980 con 0x7f417c0cdcb0 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4171ffb640 1 -- 172.21.15.104:0/4027533275 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c011dd0 con 0x7f417c0cdcb0 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c147aa0 con 0x7f417c0cdcb0 2024-09-17T03:01:45.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.368+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c156ff0 con 0x7f417c0cdcb0 2024-09-17T03:01:45.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.369+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417c06a680 con 0x7f417c0cdcb0 2024-09-17T03:01:45.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.370+0000 7f4171ffb640 1 -- 172.21.15.104:0/4027533275 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f416c018020 con 0x7f417c0cdcb0 2024-09-17T03:01:45.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.370+0000 7f4171ffb640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4160078bc0 0x7f416007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.370+0000 7f4171ffb640 1 -- 172.21.15.104:0/4027533275 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f416c09aa60 con 0x7f417c0cdcb0 2024-09-17T03:01:45.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.370+0000 7f41815a3640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4160078bc0 0x7f416007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.371+0000 7f41815a3640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4160078bc0 0x7f416007b0d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4178034000 tx=0x7f4178004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:45.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.375+0000 7f4171ffb640 1 -- 172.21.15.104:0/4027533275 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f416c01f020 con 0x7f417c0cdcb0 2024-09-17T03:01:45.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.547+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f417c160590 con 0x7f417c0cdcb0 2024-09-17T03:01:45.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.548+0000 7f4171ffb640 1 -- 172.21.15.104:0/4027533275 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) ==== 74+0+13093 (secure 0 0 0) 0x7f416c00d040 con 0x7f417c0cdcb0 2024-09-17T03:01:45.548 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:45.548 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":145,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:01:44.235955+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/1420152986":"2024-09-18T03:01:40.986649+0000","172.21.15.192:6835/1420152986":"2024-09-18T03:01:40.986649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:01:45.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.550+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4160078bc0 msgr2=0x7f416007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.550+0000 7f4183807640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4160078bc0 0x7f416007b0d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4178034000 tx=0x7f4178004730 comp rx=0 tx=0).stop 2024-09-17T03:01:45.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c0cdcb0 msgr2=0x7f417c0c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c0cdcb0 0x7f417c0c6010 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f416c00b440 tx=0x7f416c00b900 comp rx=0 tx=0).stop 2024-09-17T03:01:45.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 shutdown_connections 2024-09-17T03:01:45.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4160078bc0 0x7f416007b0d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f417c15cc30 0x7f417c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f417c0cdcb0 0x7f417c0c6010 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 --2- 172.21.15.104:0/4027533275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f417c073e00 0x7f417c147560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 >> 172.21.15.104:0/4027533275 conn(0x7f417c06eb90 msgr2=0x7f417c153880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:45.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 shutdown_connections 2024-09-17T03:01:45.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.551+0000 7f4183807640 1 -- 172.21.15.104:0/4027533275 wait complete. 2024-09-17T03:01:45.562 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:01:45.563 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:01:45.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.679+0000 7fdf4be15640 1 -- 172.21.15.104:0/30836343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf44073e00 msgr2=0x7fdf44156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.679+0000 7fdf4be15640 1 --2- 172.21.15.104:0/30836343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf44073e00 0x7fdf44156200 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf34005fd0 tx=0x7fdf3402a820 comp rx=0 tx=0).stop 2024-09-17T03:01:45.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.679+0000 7fdf4be15640 1 -- 172.21.15.104:0/30836343 shutdown_connections 2024-09-17T03:01:45.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.679+0000 7fdf4be15640 1 --2- 172.21.15.104:0/30836343 >> v2:172.21.15.192:3300/0 conn(0x7fdf440cde80 0x7fdf440cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.679+0000 7fdf4be15640 1 --2- 172.21.15.104:0/30836343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf44073e00 0x7fdf44156200 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.679+0000 7fdf4be15640 1 -- 172.21.15.104:0/30836343 >> 172.21.15.104:0/30836343 conn(0x7fdf4406eb90 msgr2=0x7fdf4406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:45.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.679+0000 7fdf4be15640 1 -- 172.21.15.104:0/30836343 shutdown_connections 2024-09-17T03:01:45.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.679+0000 7fdf4be15640 1 -- 172.21.15.104:0/30836343 wait complete. 2024-09-17T03:01:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.681+0000 7fdf4be15640 1 Processor -- start 2024-09-17T03:01:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.681+0000 7fdf4be15640 1 -- start start 2024-09-17T03:01:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf4be15640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf44073e00 0x7fdf441f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf4be15640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4415cc30 0x7fdf441469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf4be15640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf440cc5d0 0x7fdf44147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf4be15640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440d0350 con 0x7fdf44073e00 2024-09-17T03:01:45.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf4be15640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440d01d0 con 0x7fdf440cc5d0 2024-09-17T03:01:45.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf4be15640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdf440d04d0 con 0x7fdf4415cc30 2024-09-17T03:01:45.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf49bb1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf44073e00 0x7fdf441f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf49bb1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf44073e00 0x7fdf441f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40726/0 (socket says 172.21.15.104:40726) 2024-09-17T03:01:45.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf49bb1640 1 -- 172.21.15.104:0/2335138630 learned_addr learned my addr 172.21.15.104:0/2335138630 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:45.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf493b0640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4415cc30 0x7fdf441469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.682+0000 7fdf4a3b2640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf440cc5d0 0x7fdf44147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf49bb1640 1 -- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4415cc30 msgr2=0x7fdf441469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf49bb1640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4415cc30 0x7fdf441469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf49bb1640 1 -- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf440cc5d0 msgr2=0x7fdf44147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf49bb1640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf440cc5d0 0x7fdf44147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf49bb1640 1 -- 172.21.15.104:0/2335138630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf440cb530 con 0x7fdf44073e00 2024-09-17T03:01:45.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf49bb1640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf44073e00 0x7fdf441f75a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009cd0 tx=0x7fdf34032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:45.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf427fc640 1 -- 172.21.15.104:0/2335138630 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34037040 con 0x7fdf44073e00 2024-09-17T03:01:45.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf427fc640 1 -- 172.21.15.104:0/2335138630 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf34042070 con 0x7fdf44073e00 2024-09-17T03:01:45.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf440cb810 con 0x7fdf44073e00 2024-09-17T03:01:45.690 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf427fc640 1 -- 172.21.15.104:0/2335138630 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34004280 con 0x7fdf44073e00 2024-09-17T03:01:45.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.683+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf440cbdd0 con 0x7fdf44073e00 2024-09-17T03:01:45.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.684+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf440d09f0 con 0x7fdf44073e00 2024-09-17T03:01:45.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.685+0000 7fdf427fc640 1 -- 172.21.15.104:0/2335138630 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf34004420 con 0x7fdf44073e00 2024-09-17T03:01:45.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.685+0000 7fdf427fc640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdf30078b90 0x7fdf3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.685+0000 7fdf427fc640 1 -- 172.21.15.104:0/2335138630 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fdf340bb5d0 con 0x7fdf44073e00 2024-09-17T03:01:45.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.686+0000 7fdf493b0640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdf30078b90 0x7fdf3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.691 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.686+0000 7fdf493b0640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdf30078b90 0x7fdf3007b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdf38007fd0 tx=0x7fdf38001390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:45.692 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.690+0000 7fdf427fc640 1 -- 172.21.15.104:0/2335138630 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdf340836d0 con 0x7fdf44073e00 2024-09-17T03:01:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.864+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf44150960 con 0x7fdf44073e00 2024-09-17T03:01:45.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.864+0000 7fdf427fc640 1 -- 172.21.15.104:0/2335138630 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) ==== 93+0+10 (secure 0 0 0) 0x7fdf34088100 con 0x7fdf44073e00 2024-09-17T03:01:45.864 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdf30078b90 msgr2=0x7fdf3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdf30078b90 0x7fdf3007b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdf38007fd0 tx=0x7fdf38001390 comp rx=0 tx=0).stop 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf44073e00 msgr2=0x7fdf441f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf44073e00 0x7fdf441f75a0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009cd0 tx=0x7fdf34032c60 comp rx=0 tx=0).stop 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 shutdown_connections 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdf30078b90 0x7fdf3007b0a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf440cc5d0 0x7fdf44147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4415cc30 0x7fdf441469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 --2- 172.21.15.104:0/2335138630 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdf44073e00 0x7fdf441f75a0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 >> 172.21.15.104:0/2335138630 conn(0x7fdf4406eb90 msgr2=0x7fdf4414f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:45.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 shutdown_connections 2024-09-17T03:01:45.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.866+0000 7fdf4be15640 1 -- 172.21.15.104:0/2335138630 wait complete. 2024-09-17T03:01:45.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-17T03:01:45.989 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.990+0000 7f5f9db6e640 1 -- 172.21.15.104:0/2155516993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 msgr2=0x7f5f980cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.990+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/2155516993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 0x7f5f980cf3c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f5f980b4270 tx=0x7f5f9002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.990+0000 7f5f9db6e640 1 -- 172.21.15.104:0/2155516993 shutdown_connections 2024-09-17T03:01:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.990+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/2155516993 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 0x7f5f980cf3c0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.990+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/2155516993 >> v2:172.21.15.192:3300/0 conn(0x7f5f980d0470 0x7f5f980d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.990+0000 7f5f9db6e640 1 -- 172.21.15.104:0/2155516993 >> 172.21.15.104:0/2155516993 conn(0x7f5f980d28a0 msgr2=0x7f5f980d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.990+0000 7f5f9db6e640 1 -- 172.21.15.104:0/2155516993 shutdown_connections 2024-09-17T03:01:45.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.990+0000 7f5f9db6e640 1 -- 172.21.15.104:0/2155516993 wait complete. 2024-09-17T03:01:45.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.992+0000 7f5f9db6e640 1 Processor -- start 2024-09-17T03:01:45.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.992+0000 7f5f9db6e640 1 -- start start 2024-09-17T03:01:45.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f9db6e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980b7bb0 0x7f5f981e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f9db6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 0x7f5f980b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f9db6e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f980d0470 0x7f5f980b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f9db6e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5f980cf900 con 0x7f5f980cefb0 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f9db6e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5f980b35b0 con 0x7f5f980b7bb0 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f9db6e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5f980cfa80 con 0x7f5f980d0470 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f96ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 0x7f5f980b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f96ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 0x7f5f980b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40746/0 (socket says 172.21.15.104:40746) 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f977fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980b7bb0 0x7f5f981e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f96ffd640 1 -- 172.21.15.104:0/3085034121 learned_addr learned my addr 172.21.15.104:0/3085034121 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f97fff640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f980d0470 0x7f5f980b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f96ffd640 1 -- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f980d0470 msgr2=0x7f5f980b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f96ffd640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f980d0470 0x7f5f980b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f96ffd640 1 -- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980b7bb0 msgr2=0x7f5f981e3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.993+0000 7f5f96ffd640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980b7bb0 0x7f5f981e3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.994+0000 7f5f96ffd640 1 -- 172.21.15.104:0/3085034121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f981e4f50 con 0x7f5f980cefb0 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.994+0000 7f5f96ffd640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 0x7f5f980b0660 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00d6d0 tx=0x7f5f8c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.994+0000 7f5f7ffff640 1 -- 172.21.15.104:0/3085034121 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c017070 con 0x7f5f980cefb0 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.994+0000 7f5f7ffff640 1 -- 172.21.15.104:0/3085034121 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f8c005330 con 0x7f5f980cefb0 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.994+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9809f440 con 0x7f5f980cefb0 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.994+0000 7f5f7ffff640 1 -- 172.21.15.104:0/3085034121 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c009820 con 0x7f5f980cefb0 2024-09-17T03:01:45.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.994+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9809f9e0 con 0x7f5f980cefb0 2024-09-17T03:01:45.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.995+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9809d380 con 0x7f5f980cefb0 2024-09-17T03:01:45.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.996+0000 7f5f7ffff640 1 -- 172.21.15.104:0/3085034121 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f8c009bd0 con 0x7f5f980cefb0 2024-09-17T03:01:45.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.996+0000 7f5f7ffff640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5f84078bc0 0x7f5f8407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:45.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.996+0000 7f5f7ffff640 1 -- 172.21.15.104:0/3085034121 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f5f8c09ac60 con 0x7f5f980cefb0 2024-09-17T03:01:45.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.997+0000 7f5f977fe640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5f84078bc0 0x7f5f8407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:45.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:45.997+0000 7f5f977fe640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5f84078bc0 0x7f5f8407b0d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5f88007fd0 tx=0x7f5f88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:46.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:46.001+0000 7f5f7ffff640 1 -- 172.21.15.104:0/3085034121 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5f981e4f50 con 0x7f5f980cefb0 2024-09-17T03:01:46.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:46.247+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7f5f980cf3c0 con 0x7f5f980cefb0 2024-09-17T03:01:47.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.244+0000 7f5f7ffff640 1 -- 172.21.15.104:0/3085034121 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v361) ==== 135+0+0 (secure 0 0 0) 0x7f5f8c062de0 con 0x7f5f980cefb0 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5f84078bc0 msgr2=0x7f5f8407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5f84078bc0 0x7f5f8407b0d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5f88007fd0 tx=0x7f5f88009040 comp rx=0 tx=0).stop 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 msgr2=0x7f5f980b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 0x7f5f980b0660 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00d6d0 tx=0x7f5f8c00db90 comp rx=0 tx=0).stop 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 shutdown_connections 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5f84078bc0 0x7f5f8407b0d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f980d0470 0x7f5f980b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5f980cefb0 0x7f5f980b0660 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 --2- 172.21.15.104:0/3085034121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980b7bb0 0x7f5f981e3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 >> 172.21.15.104:0/3085034121 conn(0x7f5f980d28a0 msgr2=0x7f5f980b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:47.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 shutdown_connections 2024-09-17T03:01:47.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.247+0000 7f5f9db6e640 1 -- 172.21.15.104:0/3085034121 wait complete. 2024-09-17T03:01:47.261 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:01:47.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.380+0000 7fe9fdc94640 1 -- 172.21.15.104:0/2460578652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e0004800 msgr2=0x7fe9e0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.380+0000 7fe9fdc94640 1 --2- 172.21.15.104:0/2460578652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e0004800 0x7fe9e0004c10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00bb20 tx=0x7fe9e0005830 comp rx=0 tx=0).stop 2024-09-17T03:01:47.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.380+0000 7fe9fdc94640 1 -- 172.21.15.104:0/2460578652 shutdown_connections 2024-09-17T03:01:47.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.380+0000 7fe9fdc94640 1 --2- 172.21.15.104:0/2460578652 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9e0004800 0x7fe9e0004c10 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.380+0000 7fe9fdc94640 1 -- 172.21.15.104:0/2460578652 >> 172.21.15.104:0/2460578652 conn(0x7fe9f80d2970 msgr2=0x7fe9f80d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:47.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.380+0000 7fe9fdc94640 1 -- 172.21.15.104:0/2460578652 shutdown_connections 2024-09-17T03:01:47.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.380+0000 7fe9fdc94640 1 -- 172.21.15.104:0/2460578652 wait complete. 2024-09-17T03:01:47.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.382+0000 7fe9fdc94640 1 Processor -- start 2024-09-17T03:01:47.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.382+0000 7fe9fdc94640 1 -- start start 2024-09-17T03:01:47.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9fdc94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e0004800 0x7fe9f809cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:47.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9fdc94640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9f8157070 0x7fe9f809ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:47.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9fdc94640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9f815bb00 0x7fe9f815fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:47.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9fdc94640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f80b2a40 con 0x7fe9f8157070 2024-09-17T03:01:47.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9fdc94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f80b23b0 con 0x7fe9e0004800 2024-09-17T03:01:47.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9fdc94640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f80b2bc0 con 0x7fe9f815bb00 2024-09-17T03:01:47.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9f6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9f8157070 0x7fe9f809ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9f6ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9f8157070 0x7fe9f809ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40772/0 (socket says 172.21.15.104:40772) 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.383+0000 7fe9f6ffd640 1 -- 172.21.15.104:0/3906319991 learned_addr learned my addr 172.21.15.104:0/3906319991 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f7fff640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9f815bb00 0x7fe9f815fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f77fe640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e0004800 0x7fe9f809cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f6ffd640 1 -- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9f815bb00 msgr2=0x7fe9f815fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f6ffd640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9f815bb00 0x7fe9f815fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f6ffd640 1 -- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e0004800 msgr2=0x7fe9f809cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f6ffd640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e0004800 0x7fe9f809cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f6ffd640 1 -- 172.21.15.104:0/3906319991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f809d7b0 con 0x7fe9f8157070 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f77fe640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e0004800 0x7fe9f809cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f7fff640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9f815bb00 0x7fe9f815fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9f6ffd640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9f8157070 0x7fe9f809ef60 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec034040 tx=0x7fe9ec031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:47.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9dffff640 1 -- 172.21.15.104:0/3906319991 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec040070 con 0x7fe9f8157070 2024-09-17T03:01:47.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f815b020 con 0x7fe9f8157070 2024-09-17T03:01:47.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9dffff640 1 -- 172.21.15.104:0/3906319991 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9ec004230 con 0x7fe9f8157070 2024-09-17T03:01:47.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9dffff640 1 -- 172.21.15.104:0/3906319991 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec035040 con 0x7fe9f8157070 2024-09-17T03:01:47.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.384+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f815b5e0 con 0x7fe9f8157070 2024-09-17T03:01:47.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.385+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f815ae10 con 0x7fe9f8157070 2024-09-17T03:01:47.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.386+0000 7fe9dffff640 1 -- 172.21.15.104:0/3906319991 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9ec038020 con 0x7fe9f8157070 2024-09-17T03:01:47.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.386+0000 7fe9dffff640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe9e4078b90 0x7fe9e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:47.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.387+0000 7fe9dffff640 1 -- 172.21.15.104:0/3906319991 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fe9ec0bbd30 con 0x7fe9f8157070 2024-09-17T03:01:47.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.387+0000 7fe9f77fe640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe9e4078b90 0x7fe9e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:47.387 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.387+0000 7fe9f77fe640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe9e4078b90 0x7fe9e407b0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80067f0 tx=0x7fe9e8006ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:47.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.390+0000 7fe9dffff640 1 -- 172.21.15.104:0/3906319991 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe9ec0844f0 con 0x7fe9f8157070 2024-09-17T03:01:47.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.564+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe9f80d0fd0 con 0x7fe9f8157070 2024-09-17T03:01:47.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.564+0000 7fe9dffff640 1 -- 172.21.15.104:0/3906319991 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+1472 (secure 0 0 0) 0x7fe9ec083df0 con 0x7fe9f8157070 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:01:47.564 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T03:01:47.565 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T03:01:47.566 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T03:01:47.566 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:01:47.566 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe9e4078b90 msgr2=0x7fe9e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe9e4078b90 0x7fe9e407b0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80067f0 tx=0x7fe9e8006ef0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9f8157070 msgr2=0x7fe9f809ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9f8157070 0x7fe9f809ef60 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec034040 tx=0x7fe9ec031430 comp rx=0 tx=0).stop 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 shutdown_connections 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe9e4078b90 0x7fe9e407b0a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9f815bb00 0x7fe9f815fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9f8157070 0x7fe9f809ef60 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 --2- 172.21.15.104:0/3906319991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9e0004800 0x7fe9f809cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 >> 172.21.15.104:0/3906319991 conn(0x7fe9f80d2970 msgr2=0x7fe9f8071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 shutdown_connections 2024-09-17T03:01:47.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.566+0000 7fe9fdc94640 1 -- 172.21.15.104:0/3906319991 wait complete. 2024-09-17T03:01:47.577 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:01:47.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.693+0000 7f855f74a640 1 -- 172.21.15.104:0/3018137337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 msgr2=0x7f85580b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.693+0000 7f855f74a640 1 --2- 172.21.15.104:0/3018137337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 0x7f85580b3750 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f8558069fb0 tx=0x7f855002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.693 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.693+0000 7f855f74a640 1 -- 172.21.15.104:0/3018137337 shutdown_connections 2024-09-17T03:01:47.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.693+0000 7f855f74a640 1 --2- 172.21.15.104:0/3018137337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 0x7f85580b3750 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.693+0000 7f855f74a640 1 --2- 172.21.15.104:0/3018137337 >> v2:172.21.15.192:3300/0 conn(0x7f85580cff70 0x7f855815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.693+0000 7f855f74a640 1 -- 172.21.15.104:0/3018137337 >> 172.21.15.104:0/3018137337 conn(0x7f85580b2450 msgr2=0x7f85580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:47.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.693+0000 7f855f74a640 1 -- 172.21.15.104:0/3018137337 shutdown_connections 2024-09-17T03:01:47.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.693+0000 7f855f74a640 1 -- 172.21.15.104:0/3018137337 wait complete. 2024-09-17T03:01:47.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.695+0000 7f855f74a640 1 Processor -- start 2024-09-17T03:01:47.694 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.695+0000 7f855f74a640 1 -- start start 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855f74a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f855806f840 0x7f855813edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855f74a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 0x7f85580aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855f74a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580cff70 0x7f855813ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855f74a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f85580b3c90 con 0x7f8558073540 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855f74a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f855806fe60 con 0x7f855806f840 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855f74a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f85580b3e10 con 0x7f85580cff70 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855cce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 0x7f85580aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855cce5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 0x7f85580aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40776/0 (socket says 172.21.15.104:40776) 2024-09-17T03:01:47.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855cce5640 1 -- 172.21.15.104:0/3524205431 learned_addr learned my addr 172.21.15.104:0/3524205431 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855d4e6640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f855806f840 0x7f855813edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855dce7640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580cff70 0x7f855813ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855cce5640 1 -- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580cff70 msgr2=0x7f855813ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855cce5640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580cff70 0x7f855813ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855cce5640 1 -- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f855806f840 msgr2=0x7f855813edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855cce5640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f855806f840 0x7f855813edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855cce5640 1 -- 172.21.15.104:0/3524205431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85581f5e30 con 0x7f8558073540 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.696+0000 7f855d4e6640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f855806f840 0x7f855813edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.697+0000 7f855cce5640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 0x7f85580aa4a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f854800c3c0 tx=0x7f854800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.697+0000 7f854dffb640 1 -- 172.21.15.104:0/3524205431 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548017070 con 0x7f8558073540 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.697+0000 7f854dffb640 1 -- 172.21.15.104:0/3524205431 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85480035f0 con 0x7f8558073540 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.697+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85581f6110 con 0x7f8558073540 2024-09-17T03:01:47.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.697+0000 7f854dffb640 1 -- 172.21.15.104:0/3524205431 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548003a20 con 0x7f8558073540 2024-09-17T03:01:47.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.697+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85581f66d0 con 0x7f8558073540 2024-09-17T03:01:47.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.698+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85580b3750 con 0x7f8558073540 2024-09-17T03:01:47.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.699+0000 7f854dffb640 1 -- 172.21.15.104:0/3524205431 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f854801a070 con 0x7f8558073540 2024-09-17T03:01:47.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.699+0000 7f854dffb640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f853c078b90 0x7f853c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:47.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.699+0000 7f854dffb640 1 -- 172.21.15.104:0/3524205431 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f8548099cf0 con 0x7f8558073540 2024-09-17T03:01:47.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.699+0000 7f855d4e6640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f853c078b90 0x7f853c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:47.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.700+0000 7f855d4e6640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f853c078b90 0x7f853c07b0a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8554005c40 tx=0x7f8554005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:47.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.703+0000 7f854dffb640 1 -- 172.21.15.104:0/3524205431 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f854809e070 con 0x7f8558073540 2024-09-17T03:01:47.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.877+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f85580aab30 con 0x7f8558073540 2024-09-17T03:01:47.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.881+0000 7f854dffb640 1 -- 172.21.15.104:0/3524205431 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f8548062430 con 0x7f8558073540 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f853c078b90 msgr2=0x7f853c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f853c078b90 0x7f853c07b0a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8554005c40 tx=0x7f8554005f90 comp rx=0 tx=0).stop 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 msgr2=0x7f85580aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 0x7f85580aa4a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f854800c3c0 tx=0x7f854800c880 comp rx=0 tx=0).stop 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 shutdown_connections 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f853c078b90 0x7f853c07b0a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85580cff70 0x7f855813ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8558073540 0x7f85580aa4a0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 --2- 172.21.15.104:0/3524205431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f855806f840 0x7f855813edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:47.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 >> 172.21.15.104:0/3524205431 conn(0x7f85580b2450 msgr2=0x7f85580b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:47.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 shutdown_connections 2024-09-17T03:01:47.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:47.883+0000 7f855f74a640 1 -- 172.21.15.104:0/3524205431 wait complete. 2024-09-17T03:01:47.893 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:01:47.894 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:01:47.939 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:01:47.984 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:01:47.985 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:47.985 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:48.001 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:01:48.001 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:01:48.001 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:48.019 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:01:48.019 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:01:48.019 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:48.057 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:01:48.058 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:01:48.058 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:01:48.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:01:48.077 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:01:48.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:48.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.210+0000 7fbb8f36a640 1 -- 172.21.15.104:0/1601297139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb8815c220 msgr2=0x7fbb8806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.210+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/1601297139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb8815c220 0x7fbb8806f550 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fbb880ce050 tx=0x7fbb8402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.210+0000 7fbb8f36a640 1 -- 172.21.15.104:0/1601297139 shutdown_connections 2024-09-17T03:01:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.210+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/1601297139 >> v2:172.21.15.192:3300/0 conn(0x7fbb880734f0 0x7fbb88073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.210+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/1601297139 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb8815c220 0x7fbb8806f550 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.210+0000 7fbb8f36a640 1 -- 172.21.15.104:0/1601297139 >> 172.21.15.104:0/1601297139 conn(0x7fbb8806d200 msgr2=0x7fbb8806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.210+0000 7fbb8f36a640 1 -- 172.21.15.104:0/1601297139 shutdown_connections 2024-09-17T03:01:48.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.210+0000 7fbb8f36a640 1 -- 172.21.15.104:0/1601297139 wait complete. 2024-09-17T03:01:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.212+0000 7fbb8f36a640 1 Processor -- start 2024-09-17T03:01:48.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.212+0000 7fbb8f36a640 1 -- start start 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8f36a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb880734f0 0x7fbb88144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8f36a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb880b0500 0x7fbb8815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8f36a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb8815c220 0x7fbb8815e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8f36a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbb880b4f20 con 0x7fbb880734f0 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8f36a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbb880b1230 con 0x7fbb8815c220 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8f36a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbb880b50a0 con 0x7fbb880b0500 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d106640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb880734f0 0x7fbb88144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d106640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb880734f0 0x7fbb88144030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40788/0 (socket says 172.21.15.104:40788) 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d106640 1 -- 172.21.15.104:0/665720102 learned_addr learned my addr 172.21.15.104:0/665720102 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8c905640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb880b0500 0x7fbb8815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d907640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb8815c220 0x7fbb8815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:48.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d106640 1 -- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb880b0500 msgr2=0x7fbb8815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d106640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb880b0500 0x7fbb8815e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d106640 1 -- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb8815c220 msgr2=0x7fbb8815e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d106640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb8815c220 0x7fbb8815e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.213+0000 7fbb8d106640 1 -- 172.21.15.104:0/665720102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb880b3660 con 0x7fbb880734f0 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.214+0000 7fbb8d106640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb880734f0 0x7fbb88144030 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fbb840099c0 tx=0x7fbb840039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.214+0000 7fbb7dffb640 1 -- 172.21.15.104:0/665720102 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8403e030 con 0x7fbb880734f0 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.214+0000 7fbb7dffb640 1 -- 172.21.15.104:0/665720102 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb840047a0 con 0x7fbb880734f0 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.214+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb880b3940 con 0x7fbb880734f0 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.214+0000 7fbb7dffb640 1 -- 172.21.15.104:0/665720102 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb84035040 con 0x7fbb880734f0 2024-09-17T03:01:48.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.214+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8815f140 con 0x7fbb880734f0 2024-09-17T03:01:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.215+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb88073900 con 0x7fbb880734f0 2024-09-17T03:01:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.216+0000 7fbb7dffb640 1 -- 172.21.15.104:0/665720102 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb84041030 con 0x7fbb880734f0 2024-09-17T03:01:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.216+0000 7fbb7dffb640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb6c078b90 0x7fbb6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.216+0000 7fbb7dffb640 1 -- 172.21.15.104:0/665720102 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fbb840bb270 con 0x7fbb880734f0 2024-09-17T03:01:48.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.217+0000 7fbb8c905640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb6c078b90 0x7fbb6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:48.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.217+0000 7fbb8c905640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb6c078b90 0x7fbb6c07b0a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbb880711c0 tx=0x7fbb78005c20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:48.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.221+0000 7fbb7dffb640 1 -- 172.21.15.104:0/665720102 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbb84083a50 con 0x7fbb880734f0 2024-09-17T03:01:48.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.431+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb88070810 con 0x7fbb880734f0 2024-09-17T03:01:48.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.431+0000 7fbb7dffb640 1 -- 172.21.15.104:0/665720102 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+3923 (secure 0 0 0) 0x7fbb84083350 con 0x7fbb880734f0 2024-09-17T03:01:48.431 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:48.431 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":57,"btime":"2024-09-17T03:01:41:988561+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6092,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2936605453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2936605453},{"type":"v1","addr":"172.21.15.192:6837","nonce":2936605453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7026,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/1470886367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":1470886367},{"type":"v1","addr":"172.21.15.104:6834","nonce":1470886367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7029,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/3973214888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":3973214888},{"type":"v1","addr":"172.21.15.104:6835","nonce":3973214888}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":7041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1213945756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1213945756},{"type":"v1","addr":"172.21.15.192:6836","nonce":1213945756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[]} 2024-09-17T03:01:48.432 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 57 2024-09-17T03:01:48.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb6c078b90 msgr2=0x7fbb6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:48.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb6c078b90 0x7fbb6c07b0a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbb880711c0 tx=0x7fbb78005c20 comp rx=0 tx=0).stop 2024-09-17T03:01:48.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb880734f0 msgr2=0x7fbb88144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb880734f0 0x7fbb88144030 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fbb840099c0 tx=0x7fbb840039e0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 shutdown_connections 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbb6c078b90 0x7fbb6c07b0a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb8815c220 0x7fbb8815e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbb880b0500 0x7fbb8815e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 --2- 172.21.15.104:0/665720102 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbb880734f0 0x7fbb88144030 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 >> 172.21.15.104:0/665720102 conn(0x7fbb8806d200 msgr2=0x7fbb8806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 shutdown_connections 2024-09-17T03:01:48.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.434+0000 7fbb8f36a640 1 -- 172.21.15.104:0/665720102 wait complete. 2024-09-17T03:01:48.445 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:01:48.445 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:01:48.445 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:01:48.445 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:01:48.445 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:01:48.445 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:01:48.446 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:01:48.446 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:01:48.446 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:01:48.446 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:01:48.446 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:01:48.446 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:01:48.446 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:01:48.446 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:01:48.447 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:01:48.447 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:01:48.455 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:01:48.455 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:01:48.456 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:01:48.456 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:01:48.458 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:01:48.459 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:01:48.461 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:01:48.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:01:48.498 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:01:48.498 DEBUG:teuthology.parallel:result is None 2024-09-17T03:01:48.499 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:01:48.499 DEBUG:teuthology.parallel:result is None 2024-09-17T03:01:48.502 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:01:48.503 DEBUG:teuthology.parallel:result is None 2024-09-17T03:01:48.504 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:01:48.504 DEBUG:teuthology.parallel:result is None 2024-09-17T03:01:48.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:01:48.585 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T03:01:48.585 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T03:01:48.599 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T03:01:48.599 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T03:01:48.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.626+0000 7ff80d44d640 1 -- 172.21.15.104:0/3012370750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080d18e0 msgr2=0x7ff8080d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:48.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.626+0000 7ff80d44d640 1 --2- 172.21.15.104:0/3012370750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080d18e0 0x7ff8080d34f0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff800005fd0 tx=0x7ff80002a9f0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.626+0000 7ff80d44d640 1 -- 172.21.15.104:0/3012370750 shutdown_connections 2024-09-17T03:01:48.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.626+0000 7ff80d44d640 1 --2- 172.21.15.104:0/3012370750 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080d18e0 0x7ff8080d34f0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.626+0000 7ff80d44d640 1 --2- 172.21.15.104:0/3012370750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8080b6f70 0x7ff80815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.626+0000 7ff80d44d640 1 -- 172.21.15.104:0/3012370750 >> 172.21.15.104:0/3012370750 conn(0x7ff808073df0 msgr2=0x7ff808068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:48.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.626+0000 7ff80d44d640 1 -- 172.21.15.104:0/3012370750 shutdown_connections 2024-09-17T03:01:48.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.626+0000 7ff80d44d640 1 -- 172.21.15.104:0/3012370750 wait complete. 2024-09-17T03:01:48.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.628+0000 7ff80d44d640 1 Processor -- start 2024-09-17T03:01:48.627 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.628+0000 7ff80d44d640 1 -- start start 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff80d44d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080b3b00 0x7ff80814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff80d44d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8080b6f70 0x7ff8081f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff80d44d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8080d18e0 0x7ff8081f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff80d44d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff8080d3dc0 con 0x7ff8080b3b00 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff80d44d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8080d3c40 con 0x7ff8080b6f70 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff80d44d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff8080d3f40 con 0x7ff8080d18e0 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080b3b00 0x7ff80814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080b3b00 0x7ff80814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40844/0 (socket says 172.21.15.104:40844) 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 -- 172.21.15.104:0/1745872740 learned_addr learned my addr 172.21.15.104:0/1745872740 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:48.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff8077fe640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8080d18e0 0x7ff8081f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 -- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8080d18e0 msgr2=0x7ff8081f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8080d18e0 0x7ff8081f98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff8067fc640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8080b6f70 0x7ff8081f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 -- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8080b6f70 msgr2=0x7ff8081f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8080b6f70 0x7ff8081f9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 -- 172.21.15.104:0/1745872740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8081fa140 con 0x7ff8080b3b00 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.629+0000 7ff806ffd640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080b3b00 0x7ff80814ee00 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800d740 tx=0x7ff7f800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.630+0000 7ff7ef7fe640 1 -- 172.21.15.104:0/1745872740 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8017070 con 0x7ff8080b3b00 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.630+0000 7ff7ef7fe640 1 -- 172.21.15.104:0/1745872740 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7f8009d20 con 0x7ff8080b3b00 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.630+0000 7ff7ef7fe640 1 -- 172.21.15.104:0/1745872740 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80106c0 con 0x7ff8080b3b00 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.630+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8080cdb50 con 0x7ff8080b3b00 2024-09-17T03:01:48.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.630+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff808158530 con 0x7ff8080b3b00 2024-09-17T03:01:48.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.631+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8080d4460 con 0x7ff8080b3b00 2024-09-17T03:01:48.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.632+0000 7ff7ef7fe640 1 -- 172.21.15.104:0/1745872740 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7f801a070 con 0x7ff8080b3b00 2024-09-17T03:01:48.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.633+0000 7ff7ef7fe640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7f4078b90 0x7ff7f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:48.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.633+0000 7ff7ef7fe640 1 -- 172.21.15.104:0/1745872740 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7ff7f809ab60 con 0x7ff8080b3b00 2024-09-17T03:01:48.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.633+0000 7ff8067fc640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7f4078b90 0x7ff7f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:48.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.633+0000 7ff8067fc640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7f4078b90 0x7ff7f407b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006fd0 tx=0x7ff7fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:48.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.637+0000 7ff7ef7fe640 1 -- 172.21.15.104:0/1745872740 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7f8063330 con 0x7ff8080b3b00 2024-09-17T03:01:48.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-17T03:01:48.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-17T03:01:48.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-17T03:01:48.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:48.822+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff808068da0 con 0x7ff8080b3b00 2024-09-17T03:01:49.266 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.266+0000 7ff7ef7fe640 1 -- 172.21.15.104:0/1745872740 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v147) ==== 97+0+0 (secure 0 0 0) 0x7ff7f8062c30 con 0x7ff8080b3b00 2024-09-17T03:01:49.266 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T03:01:49.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7f4078b90 msgr2=0x7ff7f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7f4078b90 0x7ff7f407b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006fd0 tx=0x7ff7fc008040 comp rx=0 tx=0).stop 2024-09-17T03:01:49.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080b3b00 msgr2=0x7ff80814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080b3b00 0x7ff80814ee00 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800d740 tx=0x7ff7f800dc00 comp rx=0 tx=0).stop 2024-09-17T03:01:49.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 shutdown_connections 2024-09-17T03:01:49.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff7f4078b90 0x7ff7f407b0a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8080b6f70 0x7ff8081f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8080d18e0 0x7ff8081f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 --2- 172.21.15.104:0/1745872740 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff8080b3b00 0x7ff80814ee00 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 >> 172.21.15.104:0/1745872740 conn(0x7ff808073df0 msgr2=0x7ff80815e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:49.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 shutdown_connections 2024-09-17T03:01:49.270 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.268+0000 7ff80d44d640 1 -- 172.21.15.104:0/1745872740 wait complete. 2024-09-17T03:01:49.281 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:01:49.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.392+0000 7f088e6ec640 1 -- 172.21.15.104:0/1325360322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 msgr2=0x7f0888072880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.393+0000 7f088e6ec640 1 --2- 172.21.15.104:0/1325360322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 0x7f0888072880 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f088806e780 tx=0x7f087c02a4b0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.393+0000 7f088e6ec640 1 -- 172.21.15.104:0/1325360322 shutdown_connections 2024-09-17T03:01:49.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.393+0000 7f088e6ec640 1 --2- 172.21.15.104:0/1325360322 >> v2:172.21.15.192:3300/0 conn(0x7f0888072dc0 0x7f088815f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.393+0000 7f088e6ec640 1 --2- 172.21.15.104:0/1325360322 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 0x7f0888072880 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.393+0000 7f088e6ec640 1 --2- 172.21.15.104:0/1325360322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f088815b7f0 0x7f088815bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.393+0000 7f088e6ec640 1 -- 172.21.15.104:0/1325360322 >> 172.21.15.104:0/1325360322 conn(0x7f08880b2450 msgr2=0x7f08880b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:49.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.393+0000 7f088e6ec640 1 -- 172.21.15.104:0/1325360322 shutdown_connections 2024-09-17T03:01:49.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.393+0000 7f088e6ec640 1 -- 172.21.15.104:0/1325360322 wait complete. 2024-09-17T03:01:49.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.394+0000 7f088e6ec640 1 Processor -- start 2024-09-17T03:01:49.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.395+0000 7f088e6ec640 1 -- start start 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f088e6ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 0x7f0888153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f088e6ec640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0888072dc0 0x7f0888155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f088e6ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f088815b7f0 0x7f0888156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f088e6ec640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f088815fff0 con 0x7f0888072470 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f088e6ec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f088815fe70 con 0x7f088815b7f0 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f088e6ec640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0888160170 con 0x7f0888072dc0 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 0x7f0888153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 0x7f0888153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40856/0 (socket says 172.21.15.104:40856) 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 -- 172.21.15.104:0/2147420665 learned_addr learned my addr 172.21.15.104:0/2147420665 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f08877fe640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0888072dc0 0x7f0888155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f088cc89640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f088815b7f0 0x7f0888156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:49.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 -- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0888072dc0 msgr2=0x7f0888155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0888072dc0 0x7f0888155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 -- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f088815b7f0 msgr2=0x7f0888156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f088815b7f0 0x7f0888156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 -- 172.21.15.104:0/2147420665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0888154740 con 0x7f0888072470 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f08877fe640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0888072dc0 0x7f0888155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f088cc89640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f088815b7f0 0x7f0888156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.396+0000 7f0887fff640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 0x7f0888153770 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f0878007850 tx=0x7f0878007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.397+0000 7f0884ff9640 1 -- 172.21.15.104:0/2147420665 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087800e630 con 0x7f0888072470 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.397+0000 7f0884ff9640 1 -- 172.21.15.104:0/2147420665 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f087800e7d0 con 0x7f0888072470 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.397+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088815c800 con 0x7f0888072470 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.397+0000 7f0884ff9640 1 -- 172.21.15.104:0/2147420665 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087800ec20 con 0x7f0888072470 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.397+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088815cdc0 con 0x7f0888072470 2024-09-17T03:01:49.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.398+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088815f720 con 0x7f0888072470 2024-09-17T03:01:49.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.398+0000 7f0884ff9640 1 -- 172.21.15.104:0/2147420665 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f087800a440 con 0x7f0888072470 2024-09-17T03:01:49.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.399+0000 7f0884ff9640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0874078b90 0x7f087407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:49.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.399+0000 7f0884ff9640 1 -- 172.21.15.104:0/2147420665 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4857+0+0 (secure 0 0 0) 0x7f087809c840 con 0x7f0888072470 2024-09-17T03:01:49.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.399+0000 7f08877fe640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0874078b90 0x7f087407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:49.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.400+0000 7f08877fe640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0874078b90 0x7f087407b0a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f087c033000 tx=0x7f087c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:49.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.403+0000 7f0884ff9640 1 -- 172.21.15.104:0/2147420665 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0878065060 con 0x7f0888072470 2024-09-17T03:01:49.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.642+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0888157660 con 0x7f0888072470 2024-09-17T03:01:49.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.643+0000 7f0884ff9640 1 -- 172.21.15.104:0/2147420665 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) ==== 80+0+5304 (secure 0 0 0) 0x7f0878064960 con 0x7f0888072470 2024-09-17T03:01:49.642 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:49.642 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:01:49.642 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.643 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T03:01:49.644 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.645 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:01:49.645 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:01:49.645 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:01:49.645 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.645 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.645 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.645 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T03:01:49.646 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.647 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.648 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:01:49.649 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.650 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T03:01:49.651 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:01:49.652 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.653 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.654 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T03:01:49.655 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T03:01:49.656 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:01:49.657 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.658 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.658 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:01:49.658 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:01:49.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0874078b90 msgr2=0x7f087407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.660 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0874078b90 0x7f087407b0a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f087c033000 tx=0x7f087c004730 comp rx=0 tx=0).stop 2024-09-17T03:01:49.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 msgr2=0x7f0888153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 0x7f0888153770 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f0878007850 tx=0x7f0878007d10 comp rx=0 tx=0).stop 2024-09-17T03:01:49.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 shutdown_connections 2024-09-17T03:01:49.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0874078b90 0x7f087407b0a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f088815b7f0 0x7f0888156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0888072dc0 0x7f0888155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 --2- 172.21.15.104:0/2147420665 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0888072470 0x7f0888153770 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 >> 172.21.15.104:0/2147420665 conn(0x7f08880b2450 msgr2=0x7f08880cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:49.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 shutdown_connections 2024-09-17T03:01:49.662 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.645+0000 7f088e6ec640 1 -- 172.21.15.104:0/2147420665 wait complete. 2024-09-17T03:01:49.662 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:01:49.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.775+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/85699978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740cefb0 msgr2=0x7fbc740cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.775+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/85699978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740cefb0 0x7fbc740cf3c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c005fd0 tx=0x7fbc6c02a980 comp rx=0 tx=0).stop 2024-09-17T03:01:49.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.775+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/85699978 shutdown_connections 2024-09-17T03:01:49.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.775+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/85699978 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740cefb0 0x7fbc740cf3c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.775+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/85699978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740d0470 0x7fbc740d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.775+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/85699978 >> 172.21.15.104:0/85699978 conn(0x7fbc740d28a0 msgr2=0x7fbc740d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:49.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.775+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/85699978 shutdown_connections 2024-09-17T03:01:49.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.775+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/85699978 wait complete. 2024-09-17T03:01:49.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.777+0000 7fbc7a3f1640 1 Processor -- start 2024-09-17T03:01:49.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.777+0000 7fbc7a3f1640 1 -- start start 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc7a3f1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740b7bb0 0x7fbc741e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc7a3f1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740cefb0 0x7fbc740c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc7a3f1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740d0470 0x7fbc741f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc7a3f1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbc740cf900 con 0x7fbc740b7bb0 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc7a3f1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbc740b35e0 con 0x7fbc740d0470 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc7a3f1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fbc740cfa80 con 0x7fbc740cefb0 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc73fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740b7bb0 0x7fbc741e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc73fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740b7bb0 0x7fbc741e1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40874/0 (socket says 172.21.15.104:40874) 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc73fff640 1 -- 172.21.15.104:0/3577553293 learned_addr learned my addr 172.21.15.104:0/3577553293 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:49.779 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc737fe640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740cefb0 0x7fbc740c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.778+0000 7fbc7898e640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740d0470 0x7fbc741f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc73fff640 1 -- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740cefb0 msgr2=0x7fbc740c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc73fff640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740cefb0 0x7fbc740c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc73fff640 1 -- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740d0470 msgr2=0x7fbc741f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc73fff640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740d0470 0x7fbc741f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc73fff640 1 -- 172.21.15.104:0/3577553293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc740c9a80 con 0x7fbc740b7bb0 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc7898e640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740d0470 0x7fbc741f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc73fff640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740b7bb0 0x7fbc741e1e80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c390 tx=0x7fbc6400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc70ff9640 1 -- 172.21.15.104:0/3577553293 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64017070 con 0x7fbc740b7bb0 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc70ff9640 1 -- 172.21.15.104:0/3577553293 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc640035f0 con 0x7fbc740b7bb0 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc740c9d60 con 0x7fbc740b7bb0 2024-09-17T03:01:49.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc70ff9640 1 -- 172.21.15.104:0/3577553293 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc64003a20 con 0x7fbc740b7bb0 2024-09-17T03:01:49.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.779+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc740ca320 con 0x7fbc740b7bb0 2024-09-17T03:01:49.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.780+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc740cf3c0 con 0x7fbc740b7bb0 2024-09-17T03:01:49.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.781+0000 7fbc70ff9640 1 -- 172.21.15.104:0/3577553293 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc6401a070 con 0x7fbc740b7bb0 2024-09-17T03:01:49.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.781+0000 7fbc70ff9640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc60078b90 0x7fbc6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:49.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.781+0000 7fbc70ff9640 1 -- 172.21.15.104:0/3577553293 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4857+0+0 (secure 0 0 0) 0x7fbc64099c50 con 0x7fbc740b7bb0 2024-09-17T03:01:49.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.781+0000 7fbc737fe640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc60078b90 0x7fbc6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:49.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.782+0000 7fbc737fe640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc60078b90 0x7fbc6007b0a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbc68005fd0 tx=0x7fbc68005bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:49.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.787+0000 7fbc70ff9640 1 -- 172.21.15.104:0/3577553293 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc6409f020 con 0x7fbc740b7bb0 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.965+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbc740b2670 con 0x7fbc740b7bb0 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.965+0000 7fbc70ff9640 1 -- 172.21.15.104:0/3577553293 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) ==== 84+0+65 (secure 0 0 0) 0x7fbc64062470 con 0x7fbc740b7bb0 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:01:49.965 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T03:01:49.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc60078b90 msgr2=0x7fbc6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc60078b90 0x7fbc6007b0a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbc68005fd0 tx=0x7fbc68005bc0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740b7bb0 msgr2=0x7fbc741e1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:49.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740b7bb0 0x7fbc741e1e80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400c390 tx=0x7fbc6400c850 comp rx=0 tx=0).stop 2024-09-17T03:01:49.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 shutdown_connections 2024-09-17T03:01:49.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fbc60078b90 0x7fbc6007b0a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc740d0470 0x7fbc741f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc740cefb0 0x7fbc740c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 --2- 172.21.15.104:0/3577553293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fbc740b7bb0 0x7fbc741e1e80 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:49.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 >> 172.21.15.104:0/3577553293 conn(0x7fbc740d28a0 msgr2=0x7fbc74075d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:49.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 shutdown_connections 2024-09-17T03:01:49.968 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:49.968+0000 7fbc7a3f1640 1 -- 172.21.15.104:0/3577553293 wait complete. 2024-09-17T03:01:49.978 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:01:49.978 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:01:50.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.095+0000 7f2eee589640 1 -- 172.21.15.104:0/2339347090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ed4003a30 msgr2=0x7f2ed4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:50.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.095+0000 7f2eee589640 1 --2- 172.21.15.104:0/2339347090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ed4003a30 0x7f2ed4003e60 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8006f90 tx=0x7f2ed4005830 comp rx=0 tx=0).stop 2024-09-17T03:01:50.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.095+0000 7f2eecb26640 1 -- 172.21.15.104:0/2339347090 reap_dead start 2024-09-17T03:01:50.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.095+0000 7f2eee589640 1 -- 172.21.15.104:0/2339347090 shutdown_connections 2024-09-17T03:01:50.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.095+0000 7f2eee589640 1 -- 172.21.15.104:0/2339347090 >> 172.21.15.104:0/2339347090 conn(0x7f2ee80d29c0 msgr2=0x7f2ee80d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:50.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.095+0000 7f2eee589640 1 -- 172.21.15.104:0/2339347090 shutdown_connections 2024-09-17T03:01:50.095 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.095+0000 7f2eee589640 1 -- 172.21.15.104:0/2339347090 wait complete. 2024-09-17T03:01:50.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.097+0000 7f2eee589640 1 Processor -- start 2024-09-17T03:01:50.096 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.097+0000 7f2eee589640 1 -- start start 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eee589640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ed4003a30 0x7f2ee81d1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eee589640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee81f6f20 0x7f2ee81d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eee589640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ee81d3ca0 0x7f2ee81d40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eee589640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80b6dd0 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eee589640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee80b6c50 con 0x7f2ee81f6f20 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eee589640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee80b6f50 con 0x7f2ed4003a30 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ee81d3ca0 0x7f2ee81d40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ee81d3ca0 0x7f2ee81d40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40884/0 (socket says 172.21.15.104:40884) 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 -- 172.21.15.104:0/186807207 learned_addr learned my addr 172.21.15.104:0/186807207 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:50.099 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2ee7fff640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ed4003a30 0x7f2ee81d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2ee77fe640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee81f6f20 0x7f2ee81d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 -- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ed4003a30 msgr2=0x7f2ee81d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ed4003a30 0x7f2ee81d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 -- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee81f6f20 msgr2=0x7f2ee81d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee81f6f20 0x7f2ee81d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 -- 172.21.15.104:0/186807207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee81e2d90 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eecb26640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ee81d3ca0 0x7f2ee81d40b0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0005fd0 tx=0x7f2ee0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2ee4ff9640 1 -- 172.21.15.104:0/186807207 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0003970 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2ee4ff9640 1 -- 172.21.15.104:0/186807207 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ee0015070 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee81f4030 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2ee4ff9640 1 -- 172.21.15.104:0/186807207 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0004030 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.100 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.099+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee81f45f0 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.100+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee80b61f0 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.101+0000 7f2ee4ff9640 1 -- 172.21.15.104:0/186807207 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ee00041d0 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.101+0000 7f2ee4ff9640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ec8078b90 0x7f2ec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:50.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.101+0000 7f2ee4ff9640 1 -- 172.21.15.104:0/186807207 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4857+0+0 (secure 0 0 0) 0x7f2ee009af70 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.102+0000 7f2ee7fff640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ec8078b90 0x7f2ec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:50.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.102+0000 7f2ee7fff640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ec8078b90 0x7f2ec807b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8033000 tx=0x7f2ed80019a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:50.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.107+0000 7f2ee4ff9640 1 -- 172.21.15.104:0/186807207 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2ee0063140 con 0x7f2ee81d3ca0 2024-09-17T03:01:50.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:50.281+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2ee81f3dc0 con 0x7f2ee81d3ca0 2024-09-17T03:01:51.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.278+0000 7f2ee4ff9640 1 -- 172.21.15.104:0/186807207 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) ==== 138+0+0 (secure 0 0 0) 0x7f2ee0067b70 con 0x7f2ee81d3ca0 2024-09-17T03:01:51.278 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T03:01:51.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ec8078b90 msgr2=0x7f2ec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:51.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ec8078b90 0x7f2ec807b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8033000 tx=0x7f2ed80019a0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.280 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ee81d3ca0 msgr2=0x7f2ee81d40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ee81d3ca0 0x7f2ee81d40b0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0005fd0 tx=0x7f2ee0010f40 comp rx=0 tx=0).stop 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 shutdown_connections 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ec8078b90 0x7f2ec807b0a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee81f6f20 0x7f2ee81d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ee81d3ca0 0x7f2ee81d40b0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 --2- 172.21.15.104:0/186807207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ed4003a30 0x7f2ee81d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.280+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 >> 172.21.15.104:0/186807207 conn(0x7f2ee80d29c0 msgr2=0x7f2ee80af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.281+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 shutdown_connections 2024-09-17T03:01:51.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.281+0000 7f2eee589640 1 -- 172.21.15.104:0/186807207 wait complete. 2024-09-17T03:01:51.294 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:01:51.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.417+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1899340293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c0ce280 msgr2=0x7f8f0c0ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:51.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.417+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1899340293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c0ce280 0x7f8f0c0ce690 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8f04005fd0 tx=0x7f8f0402a540 comp rx=0 tx=0).stop 2024-09-17T03:01:51.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.417+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1899340293 shutdown_connections 2024-09-17T03:01:51.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.417+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1899340293 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c0ce280 0x7f8f0c0ce690 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.417+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1899340293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f0c15bc00 0x7f8f0c072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.417+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1899340293 >> 172.21.15.104:0/1899340293 conn(0x7f8f0c0b2450 msgr2=0x7f8f0c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:51.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.417+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1899340293 shutdown_connections 2024-09-17T03:01:51.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.417+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1899340293 wait complete. 2024-09-17T03:01:51.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.419+0000 7f8f12f7b640 1 Processor -- start 2024-09-17T03:01:51.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.419+0000 7f8f12f7b640 1 -- start start 2024-09-17T03:01:51.419 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f12f7b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0ce280 0x7f8f0c154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f12f7b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c15b7f0 0x7f8f0c0ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f12f7b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f0c15bc00 0x7f8f0c0abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f12f7b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c0ced50 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f12f7b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8f0c0cebd0 con 0x7f8f0c0ce280 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f12f7b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8f0c0ceed0 con 0x7f8f0c15bc00 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c15b7f0 0x7f8f0c0ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f0bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c15b7f0 0x7f8f0c0ab730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40904/0 (socket says 172.21.15.104:40904) 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f0bfff640 1 -- 172.21.15.104:0/1109480002 learned_addr learned my addr 172.21.15.104:0/1109480002 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f10d17640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0ce280 0x7f8f0c154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.420+0000 7f8f11518640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f0c15bc00 0x7f8f0c0abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f0bfff640 1 -- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f0c15bc00 msgr2=0x7f8f0c0abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f0bfff640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f0c15bc00 0x7f8f0c0abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f0bfff640 1 -- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0ce280 msgr2=0x7f8f0c154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:51.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f0bfff640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0ce280 0x7f8f0c154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:51.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f0bfff640 1 -- 172.21.15.104:0/1109480002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0c1f6270 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f0bfff640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c15b7f0 0x7f8f0c0ab730 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000cd40 tx=0x7f8f000075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:51.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f097fa640 1 -- 172.21.15.104:0/1109480002 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000f450 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f097fa640 1 -- 172.21.15.104:0/1109480002 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f0000f5f0 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f097fa640 1 -- 172.21.15.104:0/1109480002 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0000fa20 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0c1f6550 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.421+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0c1f6b10 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.422+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0c076440 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.423+0000 7f8f097fa640 1 -- 172.21.15.104:0/1109480002 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f0000fbc0 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.423+0000 7f8f097fa640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ef8078bc0 0x7f8ef807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:51.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.424+0000 7f8f097fa640 1 -- 172.21.15.104:0/1109480002 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5227+0+0 (secure 0 0 0) 0x7f8f0009b4b0 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.424+0000 7f8f10d17640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ef8078bc0 0x7f8ef807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:51.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.424+0000 7f8f10d17640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ef8078bc0 0x7f8ef807b0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8efc001720 tx=0x7f8efc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:51.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.428+0000 7f8f097fa640 1 -- 172.21.15.104:0/1109480002 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f0c076440 con 0x7f8f0c15b7f0 2024-09-17T03:01:51.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:51.602+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8f0c0cf410 con 0x7f8f0c15b7f0 2024-09-17T03:01:52.286 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.287+0000 7f8f097fa640 1 -- 172.21.15.104:0/1109480002 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) ==== 170+0+0 (secure 0 0 0) 0x7f8f00014070 con 0x7f8f0c15b7f0 2024-09-17T03:01:52.286 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T03:01:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ef8078bc0 msgr2=0x7f8ef807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ef8078bc0 0x7f8ef807b0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8efc001720 tx=0x7f8efc009040 comp rx=0 tx=0).stop 2024-09-17T03:01:52.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c15b7f0 msgr2=0x7f8f0c0ab730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:52.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c15b7f0 0x7f8f0c0ab730 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000cd40 tx=0x7f8f000075f0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 shutdown_connections 2024-09-17T03:01:52.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ef8078bc0 0x7f8ef807b0d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f0c15bc00 0x7f8f0c0abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f0c15b7f0 0x7f8f0c0ab730 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 --2- 172.21.15.104:0/1109480002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0ce280 0x7f8f0c154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.289+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 >> 172.21.15.104:0/1109480002 conn(0x7f8f0c0b2450 msgr2=0x7f8f0c0b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:52.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.290+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 shutdown_connections 2024-09-17T03:01:52.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.290+0000 7f8f12f7b640 1 -- 172.21.15.104:0/1109480002 wait complete. 2024-09-17T03:01:52.305 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:01:52.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.422+0000 7f824e638640 1 -- 172.21.15.104:0/4184899546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 msgr2=0x7f82480b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:52.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.422+0000 7f824e638640 1 --2- 172.21.15.104:0/4184899546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 0x7f82480b3750 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f8248069fb0 tx=0x7f824002a980 comp rx=0 tx=0).stop 2024-09-17T03:01:52.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.422+0000 7f824e638640 1 -- 172.21.15.104:0/4184899546 shutdown_connections 2024-09-17T03:01:52.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.422+0000 7f824e638640 1 --2- 172.21.15.104:0/4184899546 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 0x7f82480b3750 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.422+0000 7f824e638640 1 --2- 172.21.15.104:0/4184899546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f824806f840 0x7f8248072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.422+0000 7f824e638640 1 --2- 172.21.15.104:0/4184899546 >> v2:172.21.15.192:3300/0 conn(0x7f82480cff70 0x7f824815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.422+0000 7f824e638640 1 -- 172.21.15.104:0/4184899546 >> 172.21.15.104:0/4184899546 conn(0x7f82480b2450 msgr2=0x7f82480b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:52.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.423+0000 7f824e638640 1 -- 172.21.15.104:0/4184899546 shutdown_connections 2024-09-17T03:01:52.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.423+0000 7f824e638640 1 -- 172.21.15.104:0/4184899546 wait complete. 2024-09-17T03:01:52.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.424+0000 7f824e638640 1 Processor -- start 2024-09-17T03:01:52.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.424+0000 7f824e638640 1 -- start start 2024-09-17T03:01:52.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f824e638640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824806f840 0x7f82481567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f824e638640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 0x7f8248166040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f824e638640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82480cff70 0x7f8248166580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f824e638640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f824806fdd0 con 0x7f8248073370 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f824e638640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f824806fc50 con 0x7f824806f840 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f824e638640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f82480b3c90 con 0x7f82480cff70 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 0x7f8248166040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 0x7f8248166040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40920/0 (socket says 172.21.15.104:40920) 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 -- 172.21.15.104:0/1545099717 learned_addr learned my addr 172.21.15.104:0/1545099717 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f8247fff640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824806f840 0x7f82481567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f824cbd5640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82480cff70 0x7f8248166580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 -- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82480cff70 msgr2=0x7f8248166580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:52.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82480cff70 0x7f8248166580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 -- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824806f840 msgr2=0x7f82481567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824806f840 0x7f82481567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 -- 172.21.15.104:0/1545099717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8248157730 con 0x7f8248073370 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f82477fe640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 0x7f8248166040 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f823c00d6b0 tx=0x7f823c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f8244ff9640 1 -- 172.21.15.104:0/1545099717 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c017020 con 0x7f8248073370 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f8244ff9640 1 -- 172.21.15.104:0/1545099717 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f823c004320 con 0x7f8248073370 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.426+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82481f7bc0 con 0x7f8248073370 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.427+0000 7f8244ff9640 1 -- 172.21.15.104:0/1545099717 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c009a80 con 0x7f8248073370 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.427+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82481f8180 con 0x7f8248073370 2024-09-17T03:01:52.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.427+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480b40e0 con 0x7f8248073370 2024-09-17T03:01:52.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.428+0000 7f8244ff9640 1 -- 172.21.15.104:0/1545099717 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f823c01a020 con 0x7f8248073370 2024-09-17T03:01:52.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.429+0000 7f8244ff9640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8234078b90 0x7f823407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:52.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.429+0000 7f8244ff9640 1 -- 172.21.15.104:0/1545099717 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5609+0+0 (secure 0 0 0) 0x7f823c09aea0 con 0x7f8248073370 2024-09-17T03:01:52.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.429+0000 7f8247fff640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8234078b90 0x7f823407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:52.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.429+0000 7f8247fff640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8234078b90 0x7f823407b0a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f823800bb50 tx=0x7f823800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:52.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.433+0000 7f8244ff9640 1 -- 172.21.15.104:0/1545099717 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f823c021020 con 0x7f8248073370 2024-09-17T03:01:52.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:52.647+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f82481f7950 con 0x7f8248073370 2024-09-17T03:01:53.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.289+0000 7f8244ff9640 1 -- 172.21.15.104:0/1545099717 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v60) ==== 174+0+0 (secure 0 0 0) 0x7f823c062d00 con 0x7f8248073370 2024-09-17T03:01:53.287 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 18 and data pool 19 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8234078b90 msgr2=0x7f823407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8234078b90 0x7f823407b0a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f823800bb50 tx=0x7f823800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 msgr2=0x7f8248166040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 0x7f8248166040 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f823c00d6b0 tx=0x7f823c00db70 comp rx=0 tx=0).stop 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 shutdown_connections 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8234078b90 0x7f823407b0a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82480cff70 0x7f8248166580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8248073370 0x7f8248166040 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 --2- 172.21.15.104:0/1545099717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824806f840 0x7f82481567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 >> 172.21.15.104:0/1545099717 conn(0x7f82480b2450 msgr2=0x7f824815a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:53.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.292+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 shutdown_connections 2024-09-17T03:01:53.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.293+0000 7f824e638640 1 -- 172.21.15.104:0/1545099717 wait complete. 2024-09-17T03:01:53.319 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:01:53.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.434+0000 7f931d85c640 1 -- 172.21.15.104:0/3736906646 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 msgr2=0x7f9300004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.434+0000 7f931d85c640 1 --2- 172.21.15.104:0/3736906646 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 0x7f9300004c10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f930c009b20 tx=0x7f9300005830 comp rx=0 tx=0).stop 2024-09-17T03:01:53.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.434+0000 7f93177fe640 1 -- 172.21.15.104:0/3736906646 reap_dead start 2024-09-17T03:01:53.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.434+0000 7f931d85c640 1 -- 172.21.15.104:0/3736906646 shutdown_connections 2024-09-17T03:01:53.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.434+0000 7f931d85c640 1 -- 172.21.15.104:0/3736906646 >> 172.21.15.104:0/3736906646 conn(0x7f9318068ee0 msgr2=0x7f93180692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:53.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.434+0000 7f931d85c640 1 -- 172.21.15.104:0/3736906646 shutdown_connections 2024-09-17T03:01:53.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.434+0000 7f931d85c640 1 -- 172.21.15.104:0/3736906646 wait complete. 2024-09-17T03:01:53.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.436+0000 7f931d85c640 1 Processor -- start 2024-09-17T03:01:53.434 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.436+0000 7f931d85c640 1 -- start start 2024-09-17T03:01:53.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f931d85c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 0x7f93180b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:53.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f931d85c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f931814fac0 0x7f93181f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:53.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f931d85c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93181f96f0 0x7f93180ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:53.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f931d85c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f93180d1a60 con 0x7f9300004800 2024-09-17T03:01:53.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f931d85c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93180d18e0 con 0x7f931814fac0 2024-09-17T03:01:53.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f931d85c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f93180d1be0 con 0x7f93181f96f0 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f9316ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 0x7f93180b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f9316ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 0x7f93180b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40942/0 (socket says 172.21.15.104:40942) 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f9316ffd640 1 -- 172.21.15.104:0/4191742986 learned_addr learned my addr 172.21.15.104:0/4191742986 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f93167fc640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f931814fac0 0x7f93181f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f9316ffd640 1 -- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93181f96f0 msgr2=0x7f93180ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f93177fe640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93181f96f0 0x7f93180ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f9316ffd640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93181f96f0 0x7f93180ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f9316ffd640 1 -- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f931814fac0 msgr2=0x7f93181f91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f9316ffd640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f931814fac0 0x7f93181f91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f9316ffd640 1 -- 172.21.15.104:0/4191742986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93181f9b00 con 0x7f9300004800 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f93167fc640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f931814fac0 0x7f93181f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:53.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.437+0000 7f93177fe640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93181f96f0 0x7f93180ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:01:53.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.438+0000 7f9316ffd640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 0x7f93180b2bb0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9308006730 tx=0x7f93080049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:53.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.438+0000 7f92fffff640 1 -- 172.21.15.104:0/4191742986 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308015020 con 0x7f9300004800 2024-09-17T03:01:53.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.438+0000 7f92fffff640 1 -- 172.21.15.104:0/4191742986 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9308010980 con 0x7f9300004800 2024-09-17T03:01:53.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.438+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93180b36c0 con 0x7f9300004800 2024-09-17T03:01:53.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.438+0000 7f92fffff640 1 -- 172.21.15.104:0/4191742986 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308010dd0 con 0x7f9300004800 2024-09-17T03:01:53.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.438+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93180ab570 con 0x7f9300004800 2024-09-17T03:01:53.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.439+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93180b3ee0 con 0x7f9300004800 2024-09-17T03:01:53.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.439+0000 7f92fffff640 1 -- 172.21.15.104:0/4191742986 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9308018020 con 0x7f9300004800 2024-09-17T03:01:53.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.440+0000 7f92fffff640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9304078b90 0x7f930407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:53.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.440+0000 7f92fffff640 1 -- 172.21.15.104:0/4191742986 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5709+0+0 (secure 0 0 0) 0x7f930809b870 con 0x7f9300004800 2024-09-17T03:01:53.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.440+0000 7f93167fc640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9304078b90 0x7f930407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:53.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.441+0000 7f93167fc640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9304078b90 0x7f930407b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f930c035000 tx=0x7f930c02d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:53.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.445+0000 7f92fffff640 1 -- 172.21.15.104:0/4191742986 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f930801f020 con 0x7f9300004800 2024-09-17T03:01:53.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.617+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93180ba4f0 con 0x7f9300004800 2024-09-17T03:01:53.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.618+0000 7f92fffff640 1 -- 172.21.15.104:0/4191742986 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16801 (secure 0 0 0) 0x7f93181f9b00 con 0x7f9300004800 2024-09-17T03:01:53.617 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:53.617 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":152,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:01:52.648322+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:01:50.286371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:01:51.606939+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9304078b90 msgr2=0x7f930407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9304078b90 0x7f930407b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f930c035000 tx=0x7f930c02d040 comp rx=0 tx=0).stop 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 msgr2=0x7f93180b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 0x7f93180b2bb0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9308006730 tx=0x7f93080049d0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 shutdown_connections 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9304078b90 0x7f930407b0a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f931814fac0 0x7f93181f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93181f96f0 0x7f93180ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 --2- 172.21.15.104:0/4191742986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9300004800 0x7f93180b2bb0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 >> 172.21.15.104:0/4191742986 conn(0x7f9318068ee0 msgr2=0x7f93180cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:53.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 shutdown_connections 2024-09-17T03:01:53.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.621+0000 7f931d85c640 1 -- 172.21.15.104:0/4191742986 wait complete. 2024-09-17T03:01:53.634 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:01:53.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.749+0000 7f6e64ed5640 1 -- 172.21.15.104:0/1062077219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600cd880 msgr2=0x7f6e60156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.749+0000 7f6e64ed5640 1 --2- 172.21.15.104:0/1062077219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600cd880 0x7f6e60156a00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009830 tx=0x7f6e5802a480 comp rx=0 tx=0).stop 2024-09-17T03:01:53.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.749+0000 7f6e64ed5640 1 -- 172.21.15.104:0/1062077219 shutdown_connections 2024-09-17T03:01:53.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.749+0000 7f6e64ed5640 1 --2- 172.21.15.104:0/1062077219 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600cd880 0x7f6e60156a00 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.749+0000 7f6e64ed5640 1 -- 172.21.15.104:0/1062077219 >> 172.21.15.104:0/1062077219 conn(0x7f6e600b2450 msgr2=0x7f6e600b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:53.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.749+0000 7f6e64ed5640 1 -- 172.21.15.104:0/1062077219 shutdown_connections 2024-09-17T03:01:53.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.749+0000 7f6e64ed5640 1 -- 172.21.15.104:0/1062077219 wait complete. 2024-09-17T03:01:53.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.751+0000 7f6e64ed5640 1 Processor -- start 2024-09-17T03:01:53.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.751+0000 7f6e64ed5640 1 -- start start 2024-09-17T03:01:53.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.752+0000 7f6e64ed5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e6006fad0 0x7f6e6014bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:53.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.752+0000 7f6e64ed5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600744d0 0x7f6e600aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:53.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.752+0000 7f6e64ed5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e601f7f30 0x7f6e600aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:53.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.752+0000 7f6e64ed5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6e601572d0 con 0x7f6e600744d0 2024-09-17T03:01:53.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.752+0000 7f6e64ed5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e60157150 con 0x7f6e601f7f30 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.752+0000 7f6e64ed5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6e60157450 con 0x7f6e6006fad0 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600744d0 0x7f6e600aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600744d0 0x7f6e600aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:40956/0 (socket says 172.21.15.104:40956) 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 -- 172.21.15.104:0/4228959268 learned_addr learned my addr 172.21.15.104:0/4228959268 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5e59c640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e6006fad0 0x7f6e6014bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5ed9d640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e601f7f30 0x7f6e600aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 -- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e6006fad0 msgr2=0x7f6e6014bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e6006fad0 0x7f6e6014bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 -- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e601f7f30 msgr2=0x7f6e600aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e601f7f30 0x7f6e600aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 -- 172.21.15.104:0/4228959268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6015f2a0 con 0x7f6e600744d0 2024-09-17T03:01:53.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e5dd9b640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600744d0 0x7f6e600aea10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c370 tx=0x7f6e5400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:53.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e4effd640 1 -- 172.21.15.104:0/4228959268 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54017070 con 0x7f6e600744d0 2024-09-17T03:01:53.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e601f7450 con 0x7f6e600744d0 2024-09-17T03:01:53.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e4effd640 1 -- 172.21.15.104:0/4228959268 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e540035f0 con 0x7f6e600744d0 2024-09-17T03:01:53.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e4effd640 1 -- 172.21.15.104:0/4228959268 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e54003a40 con 0x7f6e600744d0 2024-09-17T03:01:53.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.753+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e601f7a10 con 0x7f6e600744d0 2024-09-17T03:01:53.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.754+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6015f010 con 0x7f6e600744d0 2024-09-17T03:01:53.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.755+0000 7f6e4effd640 1 -- 172.21.15.104:0/4228959268 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e5401a070 con 0x7f6e600744d0 2024-09-17T03:01:53.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.756+0000 7f6e4effd640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e40078b90 0x7f6e4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:53.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.756+0000 7f6e4effd640 1 -- 172.21.15.104:0/4228959268 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5709+0+0 (secure 0 0 0) 0x7f6e5409a000 con 0x7f6e600744d0 2024-09-17T03:01:53.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.756+0000 7f6e5e59c640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e40078b90 0x7f6e4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:53.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.756+0000 7f6e5e59c640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e40078b90 0x7f6e4007b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6e600ce510 tx=0x7f6e5000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:53.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.760+0000 7f6e4effd640 1 -- 172.21.15.104:0/4228959268 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e54061d70 con 0x7f6e600744d0 2024-09-17T03:01:53.933 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.934+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e601614d0 con 0x7f6e600744d0 2024-09-17T03:01:53.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.935+0000 7f6e4effd640 1 -- 172.21.15.104:0/4228959268 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16801 (secure 0 0 0) 0x7f6e601614d0 con 0x7f6e600744d0 2024-09-17T03:01:53.934 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:53.935 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":152,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:01:52.648322+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:01:50.286371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:01:51.606939+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:01:53.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e40078b90 msgr2=0x7f6e4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e40078b90 0x7f6e4007b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6e600ce510 tx=0x7f6e5000d040 comp rx=0 tx=0).stop 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600744d0 msgr2=0x7f6e600aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600744d0 0x7f6e600aea10 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6e5400c370 tx=0x7f6e5400c830 comp rx=0 tx=0).stop 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 shutdown_connections 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e40078b90 0x7f6e4007b0a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e601f7f30 0x7f6e600aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e600744d0 0x7f6e600aea10 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 --2- 172.21.15.104:0/4228959268 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e6006fad0 0x7f6e6014bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 >> 172.21.15.104:0/4228959268 conn(0x7f6e600b2450 msgr2=0x7f6e600aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 shutdown_connections 2024-09-17T03:01:53.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:53.938+0000 7f6e64ed5640 1 -- 172.21.15.104:0/4228959268 wait complete. 2024-09-17T03:01:53.948 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:01:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.065+0000 7f6275fda640 1 -- 172.21.15.104:0/351808822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700b6920 msgr2=0x7f62700b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.065+0000 7f6275fda640 1 --2- 172.21.15.104:0/351808822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700b6920 0x7f62700b6d30 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6268005fd0 tx=0x7f626802aae0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.065+0000 7f6275fda640 1 -- 172.21.15.104:0/351808822 shutdown_connections 2024-09-17T03:01:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.065+0000 7f6275fda640 1 --2- 172.21.15.104:0/351808822 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700b6920 0x7f62700b6d30 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.065+0000 7f6275fda640 1 --2- 172.21.15.104:0/351808822 >> v2:172.21.15.192:3300/0 conn(0x7f62700d0ff0 0x7f6270160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.065+0000 7f6275fda640 1 -- 172.21.15.104:0/351808822 >> 172.21.15.104:0/351808822 conn(0x7f62700b44a0 msgr2=0x7f62700b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.065+0000 7f6275fda640 1 -- 172.21.15.104:0/351808822 shutdown_connections 2024-09-17T03:01:54.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.065+0000 7f6275fda640 1 -- 172.21.15.104:0/351808822 wait complete. 2024-09-17T03:01:54.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.067+0000 7f6275fda640 1 Processor -- start 2024-09-17T03:01:54.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.067+0000 7f6275fda640 1 -- start start 2024-09-17T03:01:54.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f6275fda640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62700b6920 0x7f6270152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:54.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f6275fda640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62700d0ff0 0x7f62700cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:54.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f6275fda640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700d1400 0x7f62700cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:54.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f6275fda640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f62700b7270 con 0x7f62700d1400 2024-09-17T03:01:54.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f6275fda640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6270161cb0 con 0x7f62700d0ff0 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f6275fda640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f62700b73f0 con 0x7f62700b6920 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f626ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700d1400 0x7f62700cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f626ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700d1400 0x7f62700cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50050/0 (socket says 172.21.15.104:50050) 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f626ffff640 1 -- 172.21.15.104:0/1420350728 learned_addr learned my addr 172.21.15.104:0/1420350728 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f626f7fe640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62700b6920 0x7f6270152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.068+0000 7f626effd640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62700d0ff0 0x7f62700cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f626ffff640 1 -- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62700b6920 msgr2=0x7f6270152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f626ffff640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62700b6920 0x7f6270152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f626ffff640 1 -- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62700d0ff0 msgr2=0x7f62700cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:54.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f626ffff640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62700d0ff0 0x7f62700cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f626ffff640 1 -- 172.21.15.104:0/1420350728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62700c81e0 con 0x7f62700d1400 2024-09-17T03:01:54.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f626ffff640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700d1400 0x7f62700cdf80 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6268009bf0 tx=0x7f6268003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:54.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f6257fff640 1 -- 172.21.15.104:0/1420350728 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268044070 con 0x7f62700d1400 2024-09-17T03:01:54.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f6257fff640 1 -- 172.21.15.104:0/1420350728 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6268004250 con 0x7f62700d1400 2024-09-17T03:01:54.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62700c84c0 con 0x7f62700d1400 2024-09-17T03:01:54.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f6257fff640 1 -- 172.21.15.104:0/1420350728 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268004660 con 0x7f62700d1400 2024-09-17T03:01:54.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.069+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62700c8a80 con 0x7f62700d1400 2024-09-17T03:01:54.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.070+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62700b6d30 con 0x7f62700d1400 2024-09-17T03:01:54.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.071+0000 7f6257fff640 1 -- 172.21.15.104:0/1420350728 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6268047070 con 0x7f62700d1400 2024-09-17T03:01:54.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.071+0000 7f6257fff640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f625c078b90 0x7f625c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:54.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.072+0000 7f6257fff640 1 -- 172.21.15.104:0/1420350728 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5709+0+0 (secure 0 0 0) 0x7f62680bbc60 con 0x7f62700d1400 2024-09-17T03:01:54.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.072+0000 7f626f7fe640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f625c078b90 0x7f625c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:54.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.072+0000 7f626f7fe640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f625c078b90 0x7f625c07b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6270074650 tx=0x7f626000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:54.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.076+0000 7f6257fff640 1 -- 172.21.15.104:0/1420350728 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6268032030 con 0x7f62700d1400 2024-09-17T03:01:54.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.282+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f62700d0920 con 0x7f62700d1400 2024-09-17T03:01:54.311 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.313+0000 7f6257fff640 1 -- 172.21.15.104:0/1420350728 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) ==== 118+0+0 (secure 0 0 0) 0x7f6268083a50 con 0x7f62700d1400 2024-09-17T03:01:54.313 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f625c078b90 msgr2=0x7f625c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f625c078b90 0x7f625c07b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6270074650 tx=0x7f626000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700d1400 msgr2=0x7f62700cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700d1400 0x7f62700cdf80 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6268009bf0 tx=0x7f6268003ce0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 shutdown_connections 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f625c078b90 0x7f625c07b0a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62700d0ff0 0x7f62700cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f62700d1400 0x7f62700cdf80 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 --2- 172.21.15.104:0/1420350728 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62700b6920 0x7f6270152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 >> 172.21.15.104:0/1420350728 conn(0x7f62700b44a0 msgr2=0x7f62700b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 shutdown_connections 2024-09-17T03:01:54.314 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.315+0000 7f6275fda640 1 -- 172.21.15.104:0/1420350728 wait complete. 2024-09-17T03:01:54.325 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:01:54.326 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:01:54.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.443+0000 7f06e96c4640 1 -- 172.21.15.104:0/3236488953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 msgr2=0x7f06e40b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:54.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.443+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3236488953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 0x7f06e40b5200 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f06d4005fd0 tx=0x7f06d402a4a0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.443+0000 7f06e96c4640 1 -- 172.21.15.104:0/3236488953 shutdown_connections 2024-09-17T03:01:54.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.443+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3236488953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06e415c060 0x7f06e415c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.443+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3236488953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 0x7f06e40b5200 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.443+0000 7f06e96c4640 1 -- 172.21.15.104:0/3236488953 >> 172.21.15.104:0/3236488953 conn(0x7f06e40b35d0 msgr2=0x7f06e40b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:54.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.443+0000 7f06e96c4640 1 -- 172.21.15.104:0/3236488953 shutdown_connections 2024-09-17T03:01:54.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.443+0000 7f06e96c4640 1 -- 172.21.15.104:0/3236488953 wait complete. 2024-09-17T03:01:54.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.445+0000 7f06e96c4640 1 Processor -- start 2024-09-17T03:01:54.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.445+0000 7f06e96c4640 1 -- start start 2024-09-17T03:01:54.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06e96c4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06e4073560 0x7f06e4158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:54.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06e96c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 0x7f06e4140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:54.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06e96c4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06e415c060 0x7f06e4156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:54.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06e96c4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f06e406f7d0 con 0x7f06e4152cd0 2024-09-17T03:01:54.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06e96c4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06e406f650 con 0x7f06e4073560 2024-09-17T03:01:54.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06e96c4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f06e406f950 con 0x7f06e415c060 2024-09-17T03:01:54.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06da7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 0x7f06e4140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:54.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06da7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 0x7f06e4140010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50068/0 (socket says 172.21.15.104:50068) 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06da7fc640 1 -- 172.21.15.104:0/3438164501 learned_addr learned my addr 172.21.15.104:0/3438164501 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06e2ffd640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06e4073560 0x7f06e4158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.446+0000 7f06e37fe640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06e415c060 0x7f06e4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06da7fc640 1 -- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06e415c060 msgr2=0x7f06e4156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06da7fc640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06e415c060 0x7f06e4156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06da7fc640 1 -- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06e4073560 msgr2=0x7f06e4158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06da7fc640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06e4073560 0x7f06e4158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06da7fc640 1 -- 172.21.15.104:0/3438164501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e41f4510 con 0x7f06e4152cd0 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06da7fc640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 0x7f06e4140010 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00d6a0 tx=0x7f06cc00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06dbfff640 1 -- 172.21.15.104:0/3438164501 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc017070 con 0x7f06e4152cd0 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06dbfff640 1 -- 172.21.15.104:0/3438164501 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06cc005310 con 0x7f06e4152cd0 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e41f4220 con 0x7f06e4152cd0 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06dbfff640 1 -- 172.21.15.104:0/3438164501 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc009820 con 0x7f06e4152cd0 2024-09-17T03:01:54.447 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.447+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e41f4ad0 con 0x7f06e4152cd0 2024-09-17T03:01:54.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.448+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e406fe40 con 0x7f06e4152cd0 2024-09-17T03:01:54.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.449+0000 7f06dbfff640 1 -- 172.21.15.104:0/3438164501 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06cc0099c0 con 0x7f06e4152cd0 2024-09-17T03:01:54.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.449+0000 7f06dbfff640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06c4078b90 0x7f06c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:54.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.449+0000 7f06dbfff640 1 -- 172.21.15.104:0/3438164501 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f06cc09ad80 con 0x7f06e4152cd0 2024-09-17T03:01:54.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.449+0000 7f06e2ffd640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06c4078b90 0x7f06c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:54.449 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.450+0000 7f06e2ffd640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06c4078b90 0x7f06c407b0a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f06d4033000 tx=0x7f06d4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:54.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.454+0000 7f06dbfff640 1 -- 172.21.15.104:0/3438164501 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06cc062c00 con 0x7f06e4152cd0 2024-09-17T03:01:54.661 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:54.663+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f06e40b6120 con 0x7f06e4152cd0 2024-09-17T03:01:55.268 INFO:tasks.ceph.mds.a.smithi104.stderr:2024-09-17T03:01:55.269+0000 7f052b767640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:01:55.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.322+0000 7f06dbfff640 1 -- 172.21.15.104:0/3438164501 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7f06cc067630 con 0x7f06e4152cd0 2024-09-17T03:01:55.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06c4078b90 msgr2=0x7f06c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06c4078b90 0x7f06c407b0a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f06d4033000 tx=0x7f06d4004730 comp rx=0 tx=0).stop 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 msgr2=0x7f06e4140010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 0x7f06e4140010 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00d6a0 tx=0x7f06cc00db60 comp rx=0 tx=0).stop 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 shutdown_connections 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06c4078b90 0x7f06c407b0a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06e415c060 0x7f06e4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06e4152cd0 0x7f06e4140010 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 --2- 172.21.15.104:0/3438164501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06e4073560 0x7f06e4158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 >> 172.21.15.104:0/3438164501 conn(0x7f06e40b35d0 msgr2=0x7f06e40b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 shutdown_connections 2024-09-17T03:01:55.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.326+0000 7f06e96c4640 1 -- 172.21.15.104:0/3438164501 wait complete. 2024-09-17T03:01:55.337 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:01:55.337 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:01:55.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-17T03:01:55.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-17T03:01:55.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-17T03:01:55.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.453+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/3869375770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc0cff70 msgr2=0x7f9fdc15b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.453+0000 7f9fe3b5e640 1 --2- 172.21.15.104:0/3869375770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc0cff70 0x7f9fdc15b170 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8005fd0 tx=0x7f9fd802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.453+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/3869375770 shutdown_connections 2024-09-17T03:01:55.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.453+0000 7f9fe3b5e640 1 --2- 172.21.15.104:0/3869375770 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc0cff70 0x7f9fdc15b170 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.453+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/3869375770 >> 172.21.15.104:0/3869375770 conn(0x7f9fdc0b2450 msgr2=0x7f9fdc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:55.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.453+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/3869375770 shutdown_connections 2024-09-17T03:01:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.453+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/3869375770 wait complete. 2024-09-17T03:01:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.455+0000 7f9fe3b5e640 1 Processor -- start 2024-09-17T03:01:55.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.455+0000 7f9fe3b5e640 1 -- start start 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe3b5e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fdc06f840 0x7f9fdc157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe3b5e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc073540 0x7f9fdc0aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe3b5e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fdc0cff70 0x7f9fdc1f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe3b5e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc0d0570 con 0x7f9fdc073540 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe3b5e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc06fe60 con 0x7f9fdc0cff70 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe3b5e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9fdc0b3e60 con 0x7f9fdc06f840 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe10f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc073540 0x7f9fdc0aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe10f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc073540 0x7f9fdc0aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50090/0 (socket says 172.21.15.104:50090) 2024-09-17T03:01:55.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe10f9640 1 -- 172.21.15.104:0/2400218464 learned_addr learned my addr 172.21.15.104:0/2400218464 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe18fa640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fdc06f840 0x7f9fdc157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.456+0000 7f9fe20fb640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fdc0cff70 0x7f9fdc1f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fe10f9640 1 -- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fdc06f840 msgr2=0x7f9fdc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fe10f9640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fdc06f840 0x7f9fdc157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fe10f9640 1 -- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fdc0cff70 msgr2=0x7f9fdc1f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fe10f9640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fdc0cff70 0x7f9fdc1f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fe10f9640 1 -- 172.21.15.104:0/2400218464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc157900 con 0x7f9fdc073540 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fe10f9640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc073540 0x7f9fdc0aeea0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00d990 tx=0x7f9fcc00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:55.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fd27fc640 1 -- 172.21.15.104:0/2400218464 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc00ed40 con 0x7f9fdc073540 2024-09-17T03:01:55.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fd27fc640 1 -- 172.21.15.104:0/2400218464 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fcc004020 con 0x7f9fdc073540 2024-09-17T03:01:55.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc157be0 con 0x7f9fdc073540 2024-09-17T03:01:55.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fd27fc640 1 -- 172.21.15.104:0/2400218464 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0035f0 con 0x7f9fdc073540 2024-09-17T03:01:55.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.457+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc1581a0 con 0x7f9fdc073540 2024-09-17T03:01:55.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.458+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fdc15b170 con 0x7f9fdc073540 2024-09-17T03:01:55.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.459+0000 7f9fd27fc640 1 -- 172.21.15.104:0/2400218464 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9fcc003790 con 0x7f9fdc073540 2024-09-17T03:01:55.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.459+0000 7f9fd27fc640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fc0078b90 0x7f9fc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:55.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.460+0000 7f9fd27fc640 1 -- 172.21.15.104:0/2400218464 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f9fcc09cc10 con 0x7f9fdc073540 2024-09-17T03:01:55.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.460+0000 7f9fe18fa640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fc0078b90 0x7f9fc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:55.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.460+0000 7f9fe18fa640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fc0078b90 0x7f9fc007b0a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8033000 tx=0x7f9fd8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:55.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.464+0000 7f9fd27fc640 1 -- 172.21.15.104:0/2400218464 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9fcc064a10 con 0x7f9fdc073540 2024-09-17T03:01:55.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.673+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fdc0b2fe0 con 0x7f9fdc073540 2024-09-17T03:01:55.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.673+0000 7f9fd27fc640 1 -- 172.21.15.104:0/2400218464 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5237 (secure 0 0 0) 0x7f9fcc069440 con 0x7f9fdc073540 2024-09-17T03:01:55.672 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:55.672 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":62,"btime":"2024-09-17T03:01:55:313759+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1088380573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1088380573},{"type":"v1","addr":"172.21.15.192:6836","nonce":1088380573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3930263372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3930263372},{"type":"v1","addr":"172.21.15.192:6837","nonce":3930263372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7449,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2263721697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2263721697},{"type":"v1","addr":"172.21.15.104:6834","nonce":2263721697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:01:52.648279+0000","modified":"2024-09-17T03:01:54.664367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1696726463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1696726463},{"type":"v1","addr":"172.21.15.104:6835","nonce":1696726463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7452,"qdb_cluster":[7452]},"id":9}]} 2024-09-17T03:01:55.673 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 62 2024-09-17T03:01:55.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fc0078b90 msgr2=0x7f9fc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.674 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fc0078b90 0x7f9fc007b0a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8033000 tx=0x7f9fd8004730 comp rx=0 tx=0).stop 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc073540 msgr2=0x7f9fdc0aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc073540 0x7f9fdc0aeea0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00d990 tx=0x7f9fcc00de50 comp rx=0 tx=0).stop 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 shutdown_connections 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fc0078b90 0x7f9fc007b0a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fdc0cff70 0x7f9fdc1f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9fdc073540 0x7f9fdc0aeea0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 --2- 172.21.15.104:0/2400218464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fdc06f840 0x7f9fdc157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 >> 172.21.15.104:0/2400218464 conn(0x7f9fdc0b2450 msgr2=0x7f9fdc159530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 shutdown_connections 2024-09-17T03:01:55.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.676+0000 7f9fe3b5e640 1 -- 172.21.15.104:0/2400218464 wait complete. 2024-09-17T03:01:55.686 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:01:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.800+0000 7fb8823e4640 1 -- 172.21.15.104:0/826155134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 msgr2=0x7fb864003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.800+0000 7fb8823e4640 1 --2- 172.21.15.104:0/826155134 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 0x7fb864003e10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb86c001790 tx=0x7fb864005830 comp rx=0 tx=0).stop 2024-09-17T03:01:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.800+0000 7fb880981640 1 -- 172.21.15.104:0/826155134 reap_dead start 2024-09-17T03:01:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.800+0000 7fb8823e4640 1 -- 172.21.15.104:0/826155134 shutdown_connections 2024-09-17T03:01:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.800+0000 7fb8823e4640 1 -- 172.21.15.104:0/826155134 >> 172.21.15.104:0/826155134 conn(0x7fb87c0d28a0 msgr2=0x7fb87c0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.800+0000 7fb8823e4640 1 -- 172.21.15.104:0/826155134 shutdown_connections 2024-09-17T03:01:55.799 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.800+0000 7fb8823e4640 1 -- 172.21.15.104:0/826155134 wait complete. 2024-09-17T03:01:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.802+0000 7fb8823e4640 1 Processor -- start 2024-09-17T03:01:55.800 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.802+0000 7fb8823e4640 1 -- start start 2024-09-17T03:01:55.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb8823e4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 0x7fb87c1f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:55.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb8823e4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87c1dd120 0x7fb87c1e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:55.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb8823e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb87c1e49f0 0x7fb87c1e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:55.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb8823e4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c0cf5d0 con 0x7fb8640039e0 2024-09-17T03:01:55.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb8823e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb87c0b35e0 con 0x7fb87c1e49f0 2024-09-17T03:01:55.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb8823e4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb87c0cf750 con 0x7fb87c1dd120 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb87bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 0x7fb87c1f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb87bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 0x7fb87c1f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50106/0 (socket says 172.21.15.104:50106) 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.803+0000 7fb87bfff640 1 -- 172.21.15.104:0/1498815189 learned_addr learned my addr 172.21.15.104:0/1498815189 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb87b7fe640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87c1dd120 0x7fb87c1e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb880981640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb87c1e49f0 0x7fb87c1e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb87bfff640 1 -- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87c1dd120 msgr2=0x7fb87c1e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb87bfff640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87c1dd120 0x7fb87c1e44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb87bfff640 1 -- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb87c1e49f0 msgr2=0x7fb87c1e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb87bfff640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb87c1e49f0 0x7fb87c1e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb87bfff640 1 -- 172.21.15.104:0/1498815189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87c1e4e00 con 0x7fb8640039e0 2024-09-17T03:01:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb880981640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb87c1e49f0 0x7fb87c1e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:01:55.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb87bfff640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 0x7fb87c1f7610 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb86c001880 tx=0x7fb86c0065f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:55.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb878ff9640 1 -- 172.21.15.104:0/1498815189 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c042070 con 0x7fb8640039e0 2024-09-17T03:01:55.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb878ff9640 1 -- 172.21.15.104:0/1498815189 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb86c003840 con 0x7fb8640039e0 2024-09-17T03:01:55.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb878ff9640 1 -- 172.21.15.104:0/1498815189 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c037040 con 0x7fb8640039e0 2024-09-17T03:01:55.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb87c1f3a40 con 0x7fb8640039e0 2024-09-17T03:01:55.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.804+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb87c1f4000 con 0x7fb8640039e0 2024-09-17T03:01:55.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.805+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb87c0cfce0 con 0x7fb8640039e0 2024-09-17T03:01:55.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.806+0000 7fb878ff9640 1 -- 172.21.15.104:0/1498815189 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb86c045070 con 0x7fb8640039e0 2024-09-17T03:01:55.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.806+0000 7fb878ff9640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb868078b90 0x7fb86807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:55.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.806+0000 7fb878ff9640 1 -- 172.21.15.104:0/1498815189 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fb86c0ba8e0 con 0x7fb8640039e0 2024-09-17T03:01:55.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.807+0000 7fb87b7fe640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb868078b90 0x7fb86807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:55.806 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.807+0000 7fb87b7fe640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb868078b90 0x7fb86807b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb87c1dc220 tx=0x7fb870001080 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:55.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.811+0000 7fb878ff9640 1 -- 172.21.15.104:0/1498815189 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb87c1e4e00 con 0x7fb8640039e0 2024-09-17T03:01:55.983 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.985+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb87c1f35a0 con 0x7fb8640039e0 2024-09-17T03:01:55.984 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.986+0000 7fb878ff9640 1 -- 172.21.15.104:0/1498815189 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16788 (secure 0 0 0) 0x7fb86c082840 con 0x7fb8640039e0 2024-09-17T03:01:55.985 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:55.985 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":153,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:01:54.289382+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:01:50.286371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:01:51.606939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb868078b90 msgr2=0x7fb86807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb868078b90 0x7fb86807b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb87c1dc220 tx=0x7fb870001080 comp rx=0 tx=0).stop 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 msgr2=0x7fb87c1f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 0x7fb87c1f7610 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb86c001880 tx=0x7fb86c0065f0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 shutdown_connections 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb868078b90 0x7fb86807b0a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb87c1e49f0 0x7fb87c1e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87c1dd120 0x7fb87c1e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 --2- 172.21.15.104:0/1498815189 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8640039e0 0x7fb87c1f7610 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 >> 172.21.15.104:0/1498815189 conn(0x7fb87c0d28a0 msgr2=0x7fb87c0b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 shutdown_connections 2024-09-17T03:01:55.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:55.988+0000 7fb8823e4640 1 -- 172.21.15.104:0/1498815189 wait complete. 2024-09-17T03:01:55.998 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:01:55.999 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:01:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.112+0000 7f78a9b6e640 1 -- 172.21.15.104:0/842284658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a4072cf0 msgr2=0x7f78a4073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.112+0000 7f78a9b6e640 1 --2- 172.21.15.104:0/842284658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a4072cf0 0x7f78a4073100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f78a40cde80 tx=0x7f789802a3f0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.112+0000 7f78a9b6e640 1 -- 172.21.15.104:0/842284658 shutdown_connections 2024-09-17T03:01:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.112+0000 7f78a9b6e640 1 --2- 172.21.15.104:0/842284658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a4072cf0 0x7f78a4073100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.112+0000 7f78a9b6e640 1 -- 172.21.15.104:0/842284658 >> 172.21.15.104:0/842284658 conn(0x7f78a406eb90 msgr2=0x7f78a406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.112+0000 7f78a9b6e640 1 -- 172.21.15.104:0/842284658 shutdown_connections 2024-09-17T03:01:56.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.112+0000 7f78a9b6e640 1 -- 172.21.15.104:0/842284658 wait complete. 2024-09-17T03:01:56.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.114+0000 7f78a9b6e640 1 Processor -- start 2024-09-17T03:01:56.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.114+0000 7f78a9b6e640 1 -- start start 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a9b6e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a406f6b0 0x7f78a40aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a9b6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78a4072cf0 0x7f78a4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a9b6e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a415ce00 0x7f78a41f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a9b6e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f78a415dcb0 con 0x7f78a4072cf0 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a9b6e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78a415db30 con 0x7f78a406f6b0 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a9b6e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f78a415de30 con 0x7f78a415ce00 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78a4072cf0 0x7f78a4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a2ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78a4072cf0 0x7f78a4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50122/0 (socket says 172.21.15.104:50122) 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a2ffd640 1 -- 172.21.15.104:0/3457441717 learned_addr learned my addr 172.21.15.104:0/3457441717 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:56.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a37fe640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a406f6b0 0x7f78a40aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.115+0000 7f78a3fff640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a415ce00 0x7f78a41f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f78a2ffd640 1 -- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a415ce00 msgr2=0x7f78a41f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f78a2ffd640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a415ce00 0x7f78a41f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f78a2ffd640 1 -- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a406f6b0 msgr2=0x7f78a40aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f78a2ffd640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a406f6b0 0x7f78a40aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f78a2ffd640 1 -- 172.21.15.104:0/3457441717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a41f7cf0 con 0x7f78a4072cf0 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f78a2ffd640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78a4072cf0 0x7f78a4155fe0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f7898009950 tx=0x7f7898003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f788bfff640 1 -- 172.21.15.104:0/3457441717 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789803f020 con 0x7f78a4072cf0 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f788bfff640 1 -- 172.21.15.104:0/3457441717 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7898004510 con 0x7f78a4072cf0 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a41f3980 con 0x7f78a4072cf0 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f788bfff640 1 -- 172.21.15.104:0/3457441717 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7898037040 con 0x7f78a4072cf0 2024-09-17T03:01:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.116+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a41f3f40 con 0x7f78a4072cf0 2024-09-17T03:01:56.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.117+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a4073100 con 0x7f78a4072cf0 2024-09-17T03:01:56.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.118+0000 7f788bfff640 1 -- 172.21.15.104:0/3457441717 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7898042020 con 0x7f78a4072cf0 2024-09-17T03:01:56.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.118+0000 7f788bfff640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7890078b90 0x7f789007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.118+0000 7f788bfff640 1 -- 172.21.15.104:0/3457441717 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f78980bab30 con 0x7f78a4072cf0 2024-09-17T03:01:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.118+0000 7f78a37fe640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7890078b90 0x7f789007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.119+0000 7f78a37fe640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7890078b90 0x7f789007b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f78940014a0 tx=0x7f7894009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:56.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.122+0000 7f788bfff640 1 -- 172.21.15.104:0/3457441717 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7898049030 con 0x7f78a4072cf0 2024-09-17T03:01:56.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.292+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78a4074fc0 con 0x7f7890078b90 2024-09-17T03:01:56.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.296+0000 7f788bfff640 1 -- 172.21.15.104:0/3457441717 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237594 (secure 0 0 0) 0x7f78a4074fc0 con 0x7f7890078b90 2024-09-17T03:01:56.297 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:56.299 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:01:56.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7890078b90 msgr2=0x7f789007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7890078b90 0x7f789007b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f78940014a0 tx=0x7f7894009040 comp rx=0 tx=0).stop 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78a4072cf0 msgr2=0x7f78a4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78a4072cf0 0x7f78a4155fe0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f7898009950 tx=0x7f7898003b60 comp rx=0 tx=0).stop 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 shutdown_connections 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7890078b90 0x7f789007b0a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a415ce00 0x7f78a41f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78a4072cf0 0x7f78a4155fe0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 --2- 172.21.15.104:0/3457441717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a406f6b0 0x7f78a40aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.299+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 >> 172.21.15.104:0/3457441717 conn(0x7f78a406eb90 msgr2=0x7f78a415b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:56.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.300+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 shutdown_connections 2024-09-17T03:01:56.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.300+0000 7f78a9b6e640 1 -- 172.21.15.104:0/3457441717 wait complete. 2024-09-17T03:01:56.309 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-17T03:01:55.730585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7604,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554895,"statfs":{"total":1600000000,"available":1592212863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.445637"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287780+0000","last_change":"2024-09-17T03:01:51.287780+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287780+0000","last_undegraded":"2024-09-17T03:01:51.287780+0000","last_fullsized":"2024-09-17T03:01:51.287780+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286430+0000","last_change":"2024-09-17T03:01:51.286430+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286430+0000","last_undegraded":"2024-09-17T03:01:51.286430+0000","last_fullsized":"2024-09-17T03:01:51.286430+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285511+0000","last_change":"2024-09-17T03:01:51.285511+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285511+0000","last_undegraded":"2024-09-17T03:01:51.285511+0000","last_fullsized":"2024-09-17T03:01:51.285511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.288207+0000","last_change":"2024-09-17T03:01:51.288207+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.288207+0000","last_undegraded":"2024-09-17T03:01:51.288207+0000","last_fullsized":"2024-09-17T03:01:51.288207+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.288350+0000","last_change":"2024-09-17T03:01:51.288350+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.288350+0000","last_undegraded":"2024-09-17T03:01:51.288350+0000","last_fullsized":"2024-09-17T03:01:51.288350+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283455+0000","last_change":"2024-09-17T03:01:51.283455+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283455+0000","last_undegraded":"2024-09-17T03:01:51.283455+0000","last_fullsized":"2024-09-17T03:01:51.283455+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285775+0000","last_change":"2024-09-17T03:01:51.285775+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285775+0000","last_undegraded":"2024-09-17T03:01:51.285775+0000","last_fullsized":"2024-09-17T03:01:51.285775+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287836+0000","last_change":"2024-09-17T03:01:51.287836+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287836+0000","last_undegraded":"2024-09-17T03:01:51.287836+0000","last_fullsized":"2024-09-17T03:01:51.287836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287193+0000","last_change":"2024-09-17T03:01:51.287193+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287193+0000","last_undegraded":"2024-09-17T03:01:51.287193+0000","last_fullsized":"2024-09-17T03:01:51.287193+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283036+0000","last_change":"2024-09-17T03:01:51.283036+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283036+0000","last_undegraded":"2024-09-17T03:01:51.283036+0000","last_fullsized":"2024-09-17T03:01:51.283036+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286446+0000","last_change":"2024-09-17T03:01:51.286446+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286446+0000","last_undegraded":"2024-09-17T03:01:51.286446+0000","last_fullsized":"2024-09-17T03:01:51.286446+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285115+0000","last_change":"2024-09-17T03:01:51.285115+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285115+0000","last_undegraded":"2024-09-17T03:01:51.285115+0000","last_fullsized":"2024-09-17T03:01:51.285115+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287530+0000","last_change":"2024-09-17T03:01:51.287530+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287530+0000","last_undegraded":"2024-09-17T03:01:51.287530+0000","last_fullsized":"2024-09-17T03:01:51.287530+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287694+0000","last_change":"2024-09-17T03:01:51.287694+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287694+0000","last_undegraded":"2024-09-17T03:01:51.287694+0000","last_fullsized":"2024-09-17T03:01:51.287694+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285321+0000","last_change":"2024-09-17T03:01:51.285321+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285321+0000","last_undegraded":"2024-09-17T03:01:51.285321+0000","last_fullsized":"2024-09-17T03:01:51.285321+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285570+0000","last_change":"2024-09-17T03:01:51.285570+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285570+0000","last_undegraded":"2024-09-17T03:01:51.285570+0000","last_fullsized":"2024-09-17T03:01:51.285570+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285280+0000","last_change":"2024-09-17T03:01:51.285280+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285280+0000","last_undegraded":"2024-09-17T03:01:51.285280+0000","last_fullsized":"2024-09-17T03:01:51.285280+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286247+0000","last_change":"2024-09-17T03:01:51.286247+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286247+0000","last_undegraded":"2024-09-17T03:01:51.286247+0000","last_fullsized":"2024-09-17T03:01:51.286247+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285999+0000","last_change":"2024-09-17T03:01:51.285999+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285999+0000","last_undegraded":"2024-09-17T03:01:51.285999+0000","last_fullsized":"2024-09-17T03:01:51.285999+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285777+0000","last_change":"2024-09-17T03:01:51.285777+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285777+0000","last_undegraded":"2024-09-17T03:01:51.285777+0000","last_fullsized":"2024-09-17T03:01:51.285777+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283102+0000","last_change":"2024-09-17T03:01:51.283102+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283102+0000","last_undegraded":"2024-09-17T03:01:51.283102+0000","last_fullsized":"2024-09-17T03:01:51.283102+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283037+0000","last_change":"2024-09-17T03:01:51.283037+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283037+0000","last_undegraded":"2024-09-17T03:01:51.283037+0000","last_fullsized":"2024-09-17T03:01:51.283037+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.284945+0000","last_change":"2024-09-17T03:01:51.284945+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.284945+0000","last_undegraded":"2024-09-17T03:01:51.284945+0000","last_fullsized":"2024-09-17T03:01:51.284945+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287516+0000","last_change":"2024-09-17T03:01:51.287516+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287516+0000","last_undegraded":"2024-09-17T03:01:51.287516+0000","last_fullsized":"2024-09-17T03:01:51.287516+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287405+0000","last_change":"2024-09-17T03:01:51.287405+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287405+0000","last_undegraded":"2024-09-17T03:01:51.287405+0000","last_fullsized":"2024-09-17T03:01:51.287405+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287760+0000","last_change":"2024-09-17T03:01:51.287760+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287760+0000","last_undegraded":"2024-09-17T03:01:51.287760+0000","last_fullsized":"2024-09-17T03:01:51.287760+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.284937+0000","last_change":"2024-09-17T03:01:51.284937+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.284937+0000","last_undegraded":"2024-09-17T03:01:51.284937+0000","last_fullsized":"2024-09-17T03:01:51.284937+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287665+0000","last_change":"2024-09-17T03:01:51.287665+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287665+0000","last_undegraded":"2024-09-17T03:01:51.287665+0000","last_fullsized":"2024-09-17T03:01:51.287665+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286495+0000","last_change":"2024-09-17T03:01:51.286495+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286495+0000","last_undegraded":"2024-09-17T03:01:51.286495+0000","last_fullsized":"2024-09-17T03:01:51.286495+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283100+0000","last_change":"2024-09-17T03:01:51.283100+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283100+0000","last_undegraded":"2024-09-17T03:01:51.283100+0000","last_fullsized":"2024-09-17T03:01:51.283100+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285014+0000","last_change":"2024-09-17T03:01:51.285014+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285014+0000","last_undegraded":"2024-09-17T03:01:51.285014+0000","last_fullsized":"2024-09-17T03:01:51.285014+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286949+0000","last_change":"2024-09-17T03:01:51.286949+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286949+0000","last_undegraded":"2024-09-17T03:01:51.286949+0000","last_fullsized":"2024-09-17T03:01:51.286949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":366,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T03:01:51.286404+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:01:51.286404+0000","last_peered":"2024-09-17T03:01:51.286404+0000","last_clean":"2024-09-17T03:01:51.286404+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:01:51.286404+0000","last_undegraded":"2024-09-17T03:01:51.286404+0000","last_fullsized":"2024-09-17T03:01:51.286404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1382,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193930,"statfs":{"total":200000000,"available":198584559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169110,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1382,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193930,"statfs":{"total":200000000,"available":198584559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:01:56.315 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:01:56.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.463+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3115962178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680b27c0 msgr2=0x7faf680b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.464+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3115962178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680b27c0 0x7faf680b5740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faf50009830 tx=0x7faf5002a510 comp rx=0 tx=0).stop 2024-09-17T03:01:56.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.464+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3115962178 shutdown_connections 2024-09-17T03:01:56.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.464+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3115962178 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680b27c0 0x7faf680b5740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.464+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3115962178 >> v2:172.21.15.192:3300/0 conn(0x7faf680b7c00 0x7faf680b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.464+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3115962178 >> 172.21.15.104:0/3115962178 conn(0x7faf680b4400 msgr2=0x7faf680b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:56.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.464+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3115962178 shutdown_connections 2024-09-17T03:01:56.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.464+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3115962178 wait complete. 2024-09-17T03:01:56.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.465+0000 7faf6d6d5640 1 Processor -- start 2024-09-17T03:01:56.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.466+0000 7faf6d6d5640 1 -- start start 2024-09-17T03:01:56.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf6d6d5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b27c0 0x7faf681f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf6d6d5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf680b5c80 0x7faf68152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf6d6d5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680b7c00 0x7faf680cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf6d6d5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faf680b7970 con 0x7faf680b5c80 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf6d6d5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faf680b77f0 con 0x7faf680b27c0 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf6d6d5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faf680b6090 con 0x7faf680b7c00 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf680b5c80 0x7faf68152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf680b5c80 0x7faf68152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50134/0 (socket says 172.21.15.104:50134) 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 -- 172.21.15.104:0/3703325312 learned_addr learned my addr 172.21.15.104:0/3703325312 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf677fe640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680b7c00 0x7faf680cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf66ffd640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b27c0 0x7faf681f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 -- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680b7c00 msgr2=0x7faf680cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680b7c00 0x7faf680cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 -- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b27c0 msgr2=0x7faf681f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b27c0 0x7faf681f7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 -- 172.21.15.104:0/3703325312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf681f7dc0 con 0x7faf680b5c80 2024-09-17T03:01:56.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.467+0000 7faf667fc640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf680b5c80 0x7faf68152d90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7faf5002ab00 tx=0x7faf50033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:56.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.468+0000 7faf5f7fe640 1 -- 172.21.15.104:0/3703325312 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50031d60 con 0x7faf680b5c80 2024-09-17T03:01:56.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.468+0000 7faf5f7fe640 1 -- 172.21.15.104:0/3703325312 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf50033e10 con 0x7faf680b5c80 2024-09-17T03:01:56.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.468+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf681f80a0 con 0x7faf680b5c80 2024-09-17T03:01:56.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.468+0000 7faf5f7fe640 1 -- 172.21.15.104:0/3703325312 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf50005260 con 0x7faf680b5c80 2024-09-17T03:01:56.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.468+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6815f190 con 0x7faf680b5c80 2024-09-17T03:01:56.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.469+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf680b6540 con 0x7faf680b5c80 2024-09-17T03:01:56.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.469+0000 7faf5f7fe640 1 -- 172.21.15.104:0/3703325312 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf50005400 con 0x7faf680b5c80 2024-09-17T03:01:56.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.470+0000 7faf5f7fe640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faf48078b90 0x7faf4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.470+0000 7faf5f7fe640 1 -- 172.21.15.104:0/3703325312 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7faf500bbec0 con 0x7faf680b5c80 2024-09-17T03:01:56.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.470+0000 7faf66ffd640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faf48078b90 0x7faf4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.471+0000 7faf66ffd640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faf48078b90 0x7faf4807b0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7faf60009920 tx=0x7faf600094a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:56.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.475+0000 7faf5f7fe640 1 -- 172.21.15.104:0/3703325312 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf5003f030 con 0x7faf680b5c80 2024-09-17T03:01:56.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.649+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf680b2580 con 0x7faf48078b90 2024-09-17T03:01:56.652 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.654+0000 7faf5f7fe640 1 -- 172.21.15.104:0/3703325312 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237594 (secure 0 0 0) 0x7faf680b2580 con 0x7faf48078b90 2024-09-17T03:01:56.655 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:56.656 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:01:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faf48078b90 msgr2=0x7faf4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faf48078b90 0x7faf4807b0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7faf60009920 tx=0x7faf600094a0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf680b5c80 msgr2=0x7faf68152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf680b5c80 0x7faf68152d90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7faf5002ab00 tx=0x7faf50033c20 comp rx=0 tx=0).stop 2024-09-17T03:01:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 shutdown_connections 2024-09-17T03:01:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faf48078b90 0x7faf4807b0a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf680b7c00 0x7faf680cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faf680b5c80 0x7faf68152d90 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 --2- 172.21.15.104:0/3703325312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf680b27c0 0x7faf681f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 >> 172.21.15.104:0/3703325312 conn(0x7faf680b4400 msgr2=0x7faf680b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:56.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 shutdown_connections 2024-09-17T03:01:56.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.657+0000 7faf6d6d5640 1 -- 172.21.15.104:0/3703325312 wait complete. 2024-09-17T03:01:56.667 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-17T03:01:55.730585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7604,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554895,"statfs":{"total":1600000000,"available":1592212863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.445637"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287780+0000","last_change":"2024-09-17T03:01:51.287780+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287780+0000","last_undegraded":"2024-09-17T03:01:51.287780+0000","last_fullsized":"2024-09-17T03:01:51.287780+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286430+0000","last_change":"2024-09-17T03:01:51.286430+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286430+0000","last_undegraded":"2024-09-17T03:01:51.286430+0000","last_fullsized":"2024-09-17T03:01:51.286430+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285511+0000","last_change":"2024-09-17T03:01:51.285511+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285511+0000","last_undegraded":"2024-09-17T03:01:51.285511+0000","last_fullsized":"2024-09-17T03:01:51.285511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.288207+0000","last_change":"2024-09-17T03:01:51.288207+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.288207+0000","last_undegraded":"2024-09-17T03:01:51.288207+0000","last_fullsized":"2024-09-17T03:01:51.288207+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.288350+0000","last_change":"2024-09-17T03:01:51.288350+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.288350+0000","last_undegraded":"2024-09-17T03:01:51.288350+0000","last_fullsized":"2024-09-17T03:01:51.288350+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283455+0000","last_change":"2024-09-17T03:01:51.283455+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283455+0000","last_undegraded":"2024-09-17T03:01:51.283455+0000","last_fullsized":"2024-09-17T03:01:51.283455+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285775+0000","last_change":"2024-09-17T03:01:51.285775+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285775+0000","last_undegraded":"2024-09-17T03:01:51.285775+0000","last_fullsized":"2024-09-17T03:01:51.285775+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287836+0000","last_change":"2024-09-17T03:01:51.287836+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287836+0000","last_undegraded":"2024-09-17T03:01:51.287836+0000","last_fullsized":"2024-09-17T03:01:51.287836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287193+0000","last_change":"2024-09-17T03:01:51.287193+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287193+0000","last_undegraded":"2024-09-17T03:01:51.287193+0000","last_fullsized":"2024-09-17T03:01:51.287193+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283036+0000","last_change":"2024-09-17T03:01:51.283036+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283036+0000","last_undegraded":"2024-09-17T03:01:51.283036+0000","last_fullsized":"2024-09-17T03:01:51.283036+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286446+0000","last_change":"2024-09-17T03:01:51.286446+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286446+0000","last_undegraded":"2024-09-17T03:01:51.286446+0000","last_fullsized":"2024-09-17T03:01:51.286446+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285115+0000","last_change":"2024-09-17T03:01:51.285115+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285115+0000","last_undegraded":"2024-09-17T03:01:51.285115+0000","last_fullsized":"2024-09-17T03:01:51.285115+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287530+0000","last_change":"2024-09-17T03:01:51.287530+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287530+0000","last_undegraded":"2024-09-17T03:01:51.287530+0000","last_fullsized":"2024-09-17T03:01:51.287530+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287694+0000","last_change":"2024-09-17T03:01:51.287694+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287694+0000","last_undegraded":"2024-09-17T03:01:51.287694+0000","last_fullsized":"2024-09-17T03:01:51.287694+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285321+0000","last_change":"2024-09-17T03:01:51.285321+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285321+0000","last_undegraded":"2024-09-17T03:01:51.285321+0000","last_fullsized":"2024-09-17T03:01:51.285321+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285570+0000","last_change":"2024-09-17T03:01:51.285570+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285570+0000","last_undegraded":"2024-09-17T03:01:51.285570+0000","last_fullsized":"2024-09-17T03:01:51.285570+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285280+0000","last_change":"2024-09-17T03:01:51.285280+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285280+0000","last_undegraded":"2024-09-17T03:01:51.285280+0000","last_fullsized":"2024-09-17T03:01:51.285280+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286247+0000","last_change":"2024-09-17T03:01:51.286247+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286247+0000","last_undegraded":"2024-09-17T03:01:51.286247+0000","last_fullsized":"2024-09-17T03:01:51.286247+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285999+0000","last_change":"2024-09-17T03:01:51.285999+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285999+0000","last_undegraded":"2024-09-17T03:01:51.285999+0000","last_fullsized":"2024-09-17T03:01:51.285999+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285777+0000","last_change":"2024-09-17T03:01:51.285777+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285777+0000","last_undegraded":"2024-09-17T03:01:51.285777+0000","last_fullsized":"2024-09-17T03:01:51.285777+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283102+0000","last_change":"2024-09-17T03:01:51.283102+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283102+0000","last_undegraded":"2024-09-17T03:01:51.283102+0000","last_fullsized":"2024-09-17T03:01:51.283102+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283037+0000","last_change":"2024-09-17T03:01:51.283037+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283037+0000","last_undegraded":"2024-09-17T03:01:51.283037+0000","last_fullsized":"2024-09-17T03:01:51.283037+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.284945+0000","last_change":"2024-09-17T03:01:51.284945+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.284945+0000","last_undegraded":"2024-09-17T03:01:51.284945+0000","last_fullsized":"2024-09-17T03:01:51.284945+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287516+0000","last_change":"2024-09-17T03:01:51.287516+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287516+0000","last_undegraded":"2024-09-17T03:01:51.287516+0000","last_fullsized":"2024-09-17T03:01:51.287516+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287405+0000","last_change":"2024-09-17T03:01:51.287405+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287405+0000","last_undegraded":"2024-09-17T03:01:51.287405+0000","last_fullsized":"2024-09-17T03:01:51.287405+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287760+0000","last_change":"2024-09-17T03:01:51.287760+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287760+0000","last_undegraded":"2024-09-17T03:01:51.287760+0000","last_fullsized":"2024-09-17T03:01:51.287760+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.284937+0000","last_change":"2024-09-17T03:01:51.284937+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.284937+0000","last_undegraded":"2024-09-17T03:01:51.284937+0000","last_fullsized":"2024-09-17T03:01:51.284937+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287665+0000","last_change":"2024-09-17T03:01:51.287665+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287665+0000","last_undegraded":"2024-09-17T03:01:51.287665+0000","last_fullsized":"2024-09-17T03:01:51.287665+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286495+0000","last_change":"2024-09-17T03:01:51.286495+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286495+0000","last_undegraded":"2024-09-17T03:01:51.286495+0000","last_fullsized":"2024-09-17T03:01:51.286495+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283100+0000","last_change":"2024-09-17T03:01:51.283100+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283100+0000","last_undegraded":"2024-09-17T03:01:51.283100+0000","last_fullsized":"2024-09-17T03:01:51.283100+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285014+0000","last_change":"2024-09-17T03:01:51.285014+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285014+0000","last_undegraded":"2024-09-17T03:01:51.285014+0000","last_fullsized":"2024-09-17T03:01:51.285014+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286949+0000","last_change":"2024-09-17T03:01:51.286949+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286949+0000","last_undegraded":"2024-09-17T03:01:51.286949+0000","last_fullsized":"2024-09-17T03:01:51.286949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":366,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T03:01:51.286404+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:01:51.286404+0000","last_peered":"2024-09-17T03:01:51.286404+0000","last_clean":"2024-09-17T03:01:51.286404+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:01:51.286404+0000","last_undegraded":"2024-09-17T03:01:51.286404+0000","last_fullsized":"2024-09-17T03:01:51.286404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1382,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193930,"statfs":{"total":200000000,"available":198584559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169110,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1382,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193930,"statfs":{"total":200000000,"available":198584559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:01:56.671 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 -- 172.21.15.104:0/985176406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde40b65e0 msgr2=0x7efde40b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 --2- 172.21.15.104:0/985176406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde40b65e0 0x7efde40b69f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7efde406dd60 tx=0x7efdd402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 -- 172.21.15.104:0/985176406 shutdown_connections 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 --2- 172.21.15.104:0/985176406 >> v2:172.21.15.192:3300/0 conn(0x7efde415fb40 0x7efde4162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 --2- 172.21.15.104:0/985176406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde415f1f0 0x7efde415f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 --2- 172.21.15.104:0/985176406 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde40b65e0 0x7efde40b69f0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 -- 172.21.15.104:0/985176406 >> 172.21.15.104:0/985176406 conn(0x7efde4069120 msgr2=0x7efde4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 -- 172.21.15.104:0/985176406 shutdown_connections 2024-09-17T03:01:56.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.821+0000 7efde95df640 1 -- 172.21.15.104:0/985176406 wait complete. 2024-09-17T03:01:56.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.823+0000 7efde95df640 1 Processor -- start 2024-09-17T03:01:56.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.823+0000 7efde95df640 1 -- start start 2024-09-17T03:01:56.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde95df640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde40b65e0 0x7efde4151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde95df640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde415f1f0 0x7efde40ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde95df640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde415fb40 0x7efde40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde95df640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7efde4163650 con 0x7efde415fb40 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde95df640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efde41634d0 con 0x7efde415f1f0 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde95df640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7efde41637d0 con 0x7efde40b65e0 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde415fb40 0x7efde40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde415fb40 0x7efde40ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50150/0 (socket says 172.21.15.104:50150) 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde37fe640 1 -- 172.21.15.104:0/4024657015 learned_addr learned my addr 172.21.15.104:0/4024657015 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efdda7fc640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde415f1f0 0x7efde40ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.824+0000 7efde2ffd640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde40b65e0 0x7efde4151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efde37fe640 1 -- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde40b65e0 msgr2=0x7efde4151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efde37fe640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde40b65e0 0x7efde4151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efde37fe640 1 -- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde415f1f0 msgr2=0x7efde40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efde37fe640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde415f1f0 0x7efde40ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efde37fe640 1 -- 172.21.15.104:0/4024657015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde415b870 con 0x7efde415fb40 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efde37fe640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde415fb40 0x7efde40ca6b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e990 tx=0x7efddc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efddbfff640 1 -- 172.21.15.104:0/4024657015 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc004d20 con 0x7efde415fb40 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efddbfff640 1 -- 172.21.15.104:0/4024657015 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efddc00ca40 con 0x7efde415fb40 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efddbfff640 1 -- 172.21.15.104:0/4024657015 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc005020 con 0x7efde415fb40 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde40c8b80 con 0x7efde415fb40 2024-09-17T03:01:56.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.825+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde40c9140 con 0x7efde415fb40 2024-09-17T03:01:56.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.826+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde415f600 con 0x7efde415fb40 2024-09-17T03:01:56.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.827+0000 7efddbfff640 1 -- 172.21.15.104:0/4024657015 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efddc0051c0 con 0x7efde415fb40 2024-09-17T03:01:56.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.827+0000 7efddbfff640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efdc4078bc0 0x7efdc407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:56.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.827+0000 7efddbfff640 1 -- 172.21.15.104:0/4024657015 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7efddc09b5f0 con 0x7efde415fb40 2024-09-17T03:01:56.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.828+0000 7efde2ffd640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efdc4078bc0 0x7efdc407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:56.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.828+0000 7efde2ffd640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efdc4078bc0 0x7efdc407b0d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efdd4033000 tx=0x7efdd4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:56.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:56.832+0000 7efddbfff640 1 -- 172.21.15.104:0/4024657015 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efddc016030 con 0x7efde415fb40 2024-09-17T03:01:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.002+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efde40d1f80 con 0x7efdc4078bc0 2024-09-17T03:01:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.006+0000 7efddbfff640 1 -- 172.21.15.104:0/4024657015 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237594 (secure 0 0 0) 0x7efde40d1f80 con 0x7efdc4078bc0 2024-09-17T03:01:57.007 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:01:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.009+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efdc4078bc0 msgr2=0x7efdc407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.009+0000 7efde95df640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efdc4078bc0 0x7efdc407b0d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efdd4033000 tx=0x7efdd4004730 comp rx=0 tx=0).stop 2024-09-17T03:01:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.009+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde415fb40 msgr2=0x7efde40ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde415fb40 0x7efde40ca6b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e990 tx=0x7efddc00ee50 comp rx=0 tx=0).stop 2024-09-17T03:01:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 shutdown_connections 2024-09-17T03:01:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7efdc4078bc0 0x7efdc407b0d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde415f1f0 0x7efde40ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7efde415fb40 0x7efde40ca6b0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 --2- 172.21.15.104:0/4024657015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde40b65e0 0x7efde4151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 >> 172.21.15.104:0/4024657015 conn(0x7efde4069120 msgr2=0x7efde415e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 shutdown_connections 2024-09-17T03:01:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.010+0000 7efde95df640 1 -- 172.21.15.104:0/4024657015 wait complete. 2024-09-17T03:01:57.019 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-17T03:01:55.730585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7604,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554895,"statfs":{"total":1600000000,"available":1592212863,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.445637"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287780+0000","last_change":"2024-09-17T03:01:51.287780+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287780+0000","last_undegraded":"2024-09-17T03:01:51.287780+0000","last_fullsized":"2024-09-17T03:01:51.287780+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286430+0000","last_change":"2024-09-17T03:01:51.286430+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286430+0000","last_undegraded":"2024-09-17T03:01:51.286430+0000","last_fullsized":"2024-09-17T03:01:51.286430+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285511+0000","last_change":"2024-09-17T03:01:51.285511+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285511+0000","last_undegraded":"2024-09-17T03:01:51.285511+0000","last_fullsized":"2024-09-17T03:01:51.285511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.288207+0000","last_change":"2024-09-17T03:01:51.288207+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.288207+0000","last_undegraded":"2024-09-17T03:01:51.288207+0000","last_fullsized":"2024-09-17T03:01:51.288207+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.288350+0000","last_change":"2024-09-17T03:01:51.288350+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.288350+0000","last_undegraded":"2024-09-17T03:01:51.288350+0000","last_fullsized":"2024-09-17T03:01:51.288350+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283455+0000","last_change":"2024-09-17T03:01:51.283455+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283455+0000","last_undegraded":"2024-09-17T03:01:51.283455+0000","last_fullsized":"2024-09-17T03:01:51.283455+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285775+0000","last_change":"2024-09-17T03:01:51.285775+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285775+0000","last_undegraded":"2024-09-17T03:01:51.285775+0000","last_fullsized":"2024-09-17T03:01:51.285775+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287836+0000","last_change":"2024-09-17T03:01:51.287836+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287836+0000","last_undegraded":"2024-09-17T03:01:51.287836+0000","last_fullsized":"2024-09-17T03:01:51.287836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287193+0000","last_change":"2024-09-17T03:01:51.287193+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287193+0000","last_undegraded":"2024-09-17T03:01:51.287193+0000","last_fullsized":"2024-09-17T03:01:51.287193+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283036+0000","last_change":"2024-09-17T03:01:51.283036+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283036+0000","last_undegraded":"2024-09-17T03:01:51.283036+0000","last_fullsized":"2024-09-17T03:01:51.283036+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286446+0000","last_change":"2024-09-17T03:01:51.286446+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286446+0000","last_undegraded":"2024-09-17T03:01:51.286446+0000","last_fullsized":"2024-09-17T03:01:51.286446+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285115+0000","last_change":"2024-09-17T03:01:51.285115+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285115+0000","last_undegraded":"2024-09-17T03:01:51.285115+0000","last_fullsized":"2024-09-17T03:01:51.285115+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287530+0000","last_change":"2024-09-17T03:01:51.287530+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287530+0000","last_undegraded":"2024-09-17T03:01:51.287530+0000","last_fullsized":"2024-09-17T03:01:51.287530+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287694+0000","last_change":"2024-09-17T03:01:51.287694+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287694+0000","last_undegraded":"2024-09-17T03:01:51.287694+0000","last_fullsized":"2024-09-17T03:01:51.287694+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285321+0000","last_change":"2024-09-17T03:01:51.285321+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285321+0000","last_undegraded":"2024-09-17T03:01:51.285321+0000","last_fullsized":"2024-09-17T03:01:51.285321+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285570+0000","last_change":"2024-09-17T03:01:51.285570+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285570+0000","last_undegraded":"2024-09-17T03:01:51.285570+0000","last_fullsized":"2024-09-17T03:01:51.285570+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285280+0000","last_change":"2024-09-17T03:01:51.285280+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285280+0000","last_undegraded":"2024-09-17T03:01:51.285280+0000","last_fullsized":"2024-09-17T03:01:51.285280+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286247+0000","last_change":"2024-09-17T03:01:51.286247+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286247+0000","last_undegraded":"2024-09-17T03:01:51.286247+0000","last_fullsized":"2024-09-17T03:01:51.286247+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285999+0000","last_change":"2024-09-17T03:01:51.285999+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285999+0000","last_undegraded":"2024-09-17T03:01:51.285999+0000","last_fullsized":"2024-09-17T03:01:51.285999+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285777+0000","last_change":"2024-09-17T03:01:51.285777+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285777+0000","last_undegraded":"2024-09-17T03:01:51.285777+0000","last_fullsized":"2024-09-17T03:01:51.285777+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283102+0000","last_change":"2024-09-17T03:01:51.283102+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283102+0000","last_undegraded":"2024-09-17T03:01:51.283102+0000","last_fullsized":"2024-09-17T03:01:51.283102+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283037+0000","last_change":"2024-09-17T03:01:51.283037+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283037+0000","last_undegraded":"2024-09-17T03:01:51.283037+0000","last_fullsized":"2024-09-17T03:01:51.283037+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.284945+0000","last_change":"2024-09-17T03:01:51.284945+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.284945+0000","last_undegraded":"2024-09-17T03:01:51.284945+0000","last_fullsized":"2024-09-17T03:01:51.284945+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287516+0000","last_change":"2024-09-17T03:01:51.287516+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287516+0000","last_undegraded":"2024-09-17T03:01:51.287516+0000","last_fullsized":"2024-09-17T03:01:51.287516+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287405+0000","last_change":"2024-09-17T03:01:51.287405+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287405+0000","last_undegraded":"2024-09-17T03:01:51.287405+0000","last_fullsized":"2024-09-17T03:01:51.287405+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287760+0000","last_change":"2024-09-17T03:01:51.287760+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287760+0000","last_undegraded":"2024-09-17T03:01:51.287760+0000","last_fullsized":"2024-09-17T03:01:51.287760+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.284937+0000","last_change":"2024-09-17T03:01:51.284937+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.284937+0000","last_undegraded":"2024-09-17T03:01:51.284937+0000","last_fullsized":"2024-09-17T03:01:51.284937+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.287665+0000","last_change":"2024-09-17T03:01:51.287665+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.287665+0000","last_undegraded":"2024-09-17T03:01:51.287665+0000","last_fullsized":"2024-09-17T03:01:51.287665+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286495+0000","last_change":"2024-09-17T03:01:51.286495+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286495+0000","last_undegraded":"2024-09-17T03:01:51.286495+0000","last_fullsized":"2024-09-17T03:01:51.286495+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.283100+0000","last_change":"2024-09-17T03:01:51.283100+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.283100+0000","last_undegraded":"2024-09-17T03:01:51.283100+0000","last_fullsized":"2024-09-17T03:01:51.283100+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.285014+0000","last_change":"2024-09-17T03:01:51.285014+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.285014+0000","last_undegraded":"2024-09-17T03:01:51.285014+0000","last_fullsized":"2024-09-17T03:01:51.285014+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:01:52.279992+0000","last_change":"2024-09-17T03:01:52.279992+0000","last_active":"2024-09-17T03:01:52.279992+0000","last_peered":"2024-09-17T03:01:52.279992+0000","last_clean":"2024-09-17T03:01:52.279992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:52.279992+0000","last_undegraded":"2024-09-17T03:01:52.279992+0000","last_fullsized":"2024-09-17T03:01:52.279992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T03:01:51.286949+0000","last_change":"2024-09-17T03:01:51.286949+0000","last_active":"2024-09-17T03:01:51.277971+0000","last_peered":"2024-09-17T03:01:51.277971+0000","last_clean":"2024-09-17T03:01:51.277971+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:01:51.286949+0000","last_undegraded":"2024-09-17T03:01:51.286949+0000","last_fullsized":"2024-09-17T03:01:51.286949+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":366,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T03:01:51.286404+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:01:51.286404+0000","last_peered":"2024-09-17T03:01:51.286404+0000","last_clean":"2024-09-17T03:01:51.286404+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:01:51.286404+0000","last_undegraded":"2024-09-17T03:01:51.286404+0000","last_fullsized":"2024-09-17T03:01:51.286404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1382,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193930,"statfs":{"total":200000000,"available":198584559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169110,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":805,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1382,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193930,"statfs":{"total":200000000,"available":198584559,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:01:57.023 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3f is not active+clean 2024-09-17T03:01:57.023 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.023 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3e is not active+clean 2024-09-17T03:01:57.023 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.023 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-09-17T03:01:57.023 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3c is not active+clean 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3b is not active+clean 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3a is not active+clean 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:PG 19.39 is not active+clean 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-09-17T03:01:57.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:PG 19.36 is not active+clean 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:PG 19.35 is not active+clean 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:PG 19.33 is not active+clean 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.025 INFO:tasks.ceph.ceph_manager.ceph:PG 19.32 is not active+clean 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:PG 19.31 is not active+clean 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:PG 19.30 is not active+clean 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2f is not active+clean 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2e is not active+clean 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2d is not active+clean 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.026 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2c is not active+clean 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2b is not active+clean 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2a is not active+clean 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:PG 19.28 is not active+clean 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.027 INFO:tasks.ceph.ceph_manager.ceph:PG 19.27 is not active+clean 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:PG 19.26 is not active+clean 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:PG 19.25 is not active+clean 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:PG 19.24 is not active+clean 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:PG 19.23 is not active+clean 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:PG 19.22 is not active+clean 2024-09-17T03:01:57.028 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:PG 19.21 is not active+clean 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:PG 19.20 is not active+clean 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1e is not active+clean 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1f is not active+clean 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287780+0000', 'last_change': '2024-09-17T03:01:51.287780+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287780+0000', 'last_undegraded': '2024-09-17T03:01:51.287780+0000', 'last_fullsized': '2024-09-17T03:01:51.287780+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-09-17T03:01:57.029 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1e is not active+clean 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.286430+0000', 'last_change': '2024-09-17T03:01:51.286430+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.286430+0000', 'last_undegraded': '2024-09-17T03:01:51.286430+0000', 'last_fullsized': '2024-09-17T03:01:51.286430+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1c is not active+clean 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1d is not active+clean 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285511+0000', 'last_change': '2024-09-17T03:01:51.285511+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285511+0000', 'last_undegraded': '2024-09-17T03:01:51.285511+0000', 'last_fullsized': '2024-09-17T03:01:51.285511+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1d is not active+clean 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1c is not active+clean 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.288207+0000', 'last_change': '2024-09-17T03:01:51.288207+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.288207+0000', 'last_undegraded': '2024-09-17T03:01:51.288207+0000', 'last_fullsized': '2024-09-17T03:01:51.288207+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:01:57.030 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1a is not active+clean 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1b is not active+clean 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.288350+0000', 'last_change': '2024-09-17T03:01:51.288350+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.288350+0000', 'last_undegraded': '2024-09-17T03:01:51.288350+0000', 'last_fullsized': '2024-09-17T03:01:51.288350+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1b is not active+clean 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1a is not active+clean 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.283455+0000', 'last_change': '2024-09-17T03:01:51.283455+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.283455+0000', 'last_undegraded': '2024-09-17T03:01:51.283455+0000', 'last_fullsized': '2024-09-17T03:01:51.283455+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.031 INFO:tasks.ceph.ceph_manager.ceph:PG 18.19 is not active+clean 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285775+0000', 'last_change': '2024-09-17T03:01:51.285775+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285775+0000', 'last_undegraded': '2024-09-17T03:01:51.285775+0000', 'last_fullsized': '2024-09-17T03:01:51.285775+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:PG 19.19 is not active+clean 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:PG 18.18 is not active+clean 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287836+0000', 'last_change': '2024-09-17T03:01:51.287836+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287836+0000', 'last_undegraded': '2024-09-17T03:01:51.287836+0000', 'last_fullsized': '2024-09-17T03:01:51.287836+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:PG 19.16 is not active+clean 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:PG 18.17 is not active+clean 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287193+0000', 'last_change': '2024-09-17T03:01:51.287193+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287193+0000', 'last_undegraded': '2024-09-17T03:01:51.287193+0000', 'last_fullsized': '2024-09-17T03:01:51.287193+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:PG 19.17 is not active+clean 2024-09-17T03:01:57.032 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:PG 18.16 is not active+clean 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.283036+0000', 'last_change': '2024-09-17T03:01:51.283036+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.283036+0000', 'last_undegraded': '2024-09-17T03:01:51.283036+0000', 'last_fullsized': '2024-09-17T03:01:51.283036+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:PG 19.14 is not active+clean 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:PG 18.15 is not active+clean 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.286446+0000', 'last_change': '2024-09-17T03:01:51.286446+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.286446+0000', 'last_undegraded': '2024-09-17T03:01:51.286446+0000', 'last_fullsized': '2024-09-17T03:01:51.286446+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:PG 19.15 is not active+clean 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:PG 18.14 is not active+clean 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285115+0000', 'last_change': '2024-09-17T03:01:51.285115+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285115+0000', 'last_undegraded': '2024-09-17T03:01:51.285115+0000', 'last_fullsized': '2024-09-17T03:01:51.285115+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:01:57.033 INFO:tasks.ceph.ceph_manager.ceph:PG 19.13 is not active+clean 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:PG 18.12 is not active+clean 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287530+0000', 'last_change': '2024-09-17T03:01:51.287530+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287530+0000', 'last_undegraded': '2024-09-17T03:01:51.287530+0000', 'last_fullsized': '2024-09-17T03:01:51.287530+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:PG 19.10 is not active+clean 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:PG 18.11 is not active+clean 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287694+0000', 'last_change': '2024-09-17T03:01:51.287694+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287694+0000', 'last_undegraded': '2024-09-17T03:01:51.287694+0000', 'last_fullsized': '2024-09-17T03:01:51.287694+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:PG 18.10 is not active+clean 2024-09-17T03:01:57.034 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285321+0000', 'last_change': '2024-09-17T03:01:51.285321+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285321+0000', 'last_undegraded': '2024-09-17T03:01:51.285321+0000', 'last_fullsized': '2024-09-17T03:01:51.285321+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:PG 18.f is not active+clean 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285570+0000', 'last_change': '2024-09-17T03:01:51.285570+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285570+0000', 'last_undegraded': '2024-09-17T03:01:51.285570+0000', 'last_fullsized': '2024-09-17T03:01:51.285570+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:PG 19.f is not active+clean 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:PG 18.e is not active+clean 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285280+0000', 'last_change': '2024-09-17T03:01:51.285280+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285280+0000', 'last_undegraded': '2024-09-17T03:01:51.285280+0000', 'last_fullsized': '2024-09-17T03:01:51.285280+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:PG 19.c is not active+clean 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.035 INFO:tasks.ceph.ceph_manager.ceph:PG 18.d is not active+clean 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.286247+0000', 'last_change': '2024-09-17T03:01:51.286247+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.286247+0000', 'last_undegraded': '2024-09-17T03:01:51.286247+0000', 'last_fullsized': '2024-09-17T03:01:51.286247+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:PG 19.d is not active+clean 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:PG 18.c is not active+clean 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285999+0000', 'last_change': '2024-09-17T03:01:51.285999+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285999+0000', 'last_undegraded': '2024-09-17T03:01:51.285999+0000', 'last_fullsized': '2024-09-17T03:01:51.285999+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:PG 19.a is not active+clean 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:PG 18.b is not active+clean 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285777+0000', 'last_change': '2024-09-17T03:01:51.285777+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285777+0000', 'last_undegraded': '2024-09-17T03:01:51.285777+0000', 'last_fullsized': '2024-09-17T03:01:51.285777+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:PG 19.b is not active+clean 2024-09-17T03:01:57.036 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:PG 18.a is not active+clean 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.283102+0000', 'last_change': '2024-09-17T03:01:51.283102+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.283102+0000', 'last_undegraded': '2024-09-17T03:01:51.283102+0000', 'last_fullsized': '2024-09-17T03:01:51.283102+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:PG 19.8 is not active+clean 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:PG 18.9 is not active+clean 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.283037+0000', 'last_change': '2024-09-17T03:01:51.283037+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.283037+0000', 'last_undegraded': '2024-09-17T03:01:51.283037+0000', 'last_fullsized': '2024-09-17T03:01:51.283037+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:PG 19.9 is not active+clean 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:PG 18.8 is not active+clean 2024-09-17T03:01:57.037 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.284945+0000', 'last_change': '2024-09-17T03:01:51.284945+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.284945+0000', 'last_undegraded': '2024-09-17T03:01:51.284945+0000', 'last_fullsized': '2024-09-17T03:01:51.284945+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:PG 19.6 is not active+clean 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:PG 18.7 is not active+clean 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287516+0000', 'last_change': '2024-09-17T03:01:51.287516+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287516+0000', 'last_undegraded': '2024-09-17T03:01:51.287516+0000', 'last_fullsized': '2024-09-17T03:01:51.287516+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:PG 19.7 is not active+clean 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:PG 18.6 is not active+clean 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287405+0000', 'last_change': '2024-09-17T03:01:51.287405+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287405+0000', 'last_undegraded': '2024-09-17T03:01:51.287405+0000', 'last_fullsized': '2024-09-17T03:01:51.287405+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:PG 19.4 is not active+clean 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:PG 18.5 is not active+clean 2024-09-17T03:01:57.038 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287760+0000', 'last_change': '2024-09-17T03:01:51.287760+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287760+0000', 'last_undegraded': '2024-09-17T03:01:51.287760+0000', 'last_fullsized': '2024-09-17T03:01:51.287760+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:PG 19.5 is not active+clean 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:PG 18.4 is not active+clean 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.284937+0000', 'last_change': '2024-09-17T03:01:51.284937+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.284937+0000', 'last_undegraded': '2024-09-17T03:01:51.284937+0000', 'last_fullsized': '2024-09-17T03:01:51.284937+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2 is not active+clean 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3 is not active+clean 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.287665+0000', 'last_change': '2024-09-17T03:01:51.287665+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.287665+0000', 'last_undegraded': '2024-09-17T03:01:51.287665+0000', 'last_fullsized': '2024-09-17T03:01:51.287665+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3 is not active+clean 2024-09-17T03:01:57.039 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2 is not active+clean 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.286495+0000', 'last_change': '2024-09-17T03:01:51.286495+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.286495+0000', 'last_undegraded': '2024-09-17T03:01:51.286495+0000', 'last_fullsized': '2024-09-17T03:01:51.286495+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:PG 19.0 is not active+clean 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1 is not active+clean 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.283100+0000', 'last_change': '2024-09-17T03:01:51.283100+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.283100+0000', 'last_undegraded': '2024-09-17T03:01:51.283100+0000', 'last_fullsized': '2024-09-17T03:01:51.283100+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1 is not active+clean 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:PG 18.0 is not active+clean 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.285014+0000', 'last_change': '2024-09-17T03:01:51.285014+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.285014+0000', 'last_undegraded': '2024-09-17T03:01:51.285014+0000', 'last_fullsized': '2024-09-17T03:01:51.285014+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:01:57.040 INFO:tasks.ceph.ceph_manager.ceph:PG 19.12 is not active+clean 2024-09-17T03:01:57.041 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:01:52.279992+0000', 'last_change': '2024-09-17T03:01:52.279992+0000', 'last_active': '2024-09-17T03:01:52.279992+0000', 'last_peered': '2024-09-17T03:01:52.279992+0000', 'last_clean': '2024-09-17T03:01:52.279992+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:52.279992+0000', 'last_undegraded': '2024-09-17T03:01:52.279992+0000', 'last_fullsized': '2024-09-17T03:01:52.279992+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:52.279992+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:01:57.041 INFO:tasks.ceph.ceph_manager.ceph:PG 18.13 is not active+clean 2024-09-17T03:01:57.041 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:01:51.286949+0000', 'last_change': '2024-09-17T03:01:51.286949+0000', 'last_active': '2024-09-17T03:01:51.277971+0000', 'last_peered': '2024-09-17T03:01:51.277971+0000', 'last_clean': '2024-09-17T03:01:51.277971+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:01:51.286949+0000', 'last_undegraded': '2024-09-17T03:01:51.286949+0000', 'last_fullsized': '2024-09-17T03:01:51.286949+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'last_clean_scrub_stamp': '2024-09-17T03:01:51.277971+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:01:57.041 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:01:57.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.175+0000 7fc89959d640 1 -- 172.21.15.104:0/3986827807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc87c003a30 msgr2=0x7fc87c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.175+0000 7fc89959d640 1 --2- 172.21.15.104:0/3986827807 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc87c003a30 0x7fc87c003ea0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fc884009b50 tx=0x7fc87c005830 comp rx=0 tx=0).stop 2024-09-17T03:01:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.175+0000 7fc898d9c640 1 -- 172.21.15.104:0/3986827807 reap_dead start 2024-09-17T03:01:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.175+0000 7fc89959d640 1 -- 172.21.15.104:0/3986827807 shutdown_connections 2024-09-17T03:01:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.175+0000 7fc89959d640 1 -- 172.21.15.104:0/3986827807 >> 172.21.15.104:0/3986827807 conn(0x7fc894074520 msgr2=0x7fc894074930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.175+0000 7fc89959d640 1 -- 172.21.15.104:0/3986827807 shutdown_connections 2024-09-17T03:01:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.175+0000 7fc89959d640 1 -- 172.21.15.104:0/3986827807 wait complete. 2024-09-17T03:01:57.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.176+0000 7fc89959d640 1 Processor -- start 2024-09-17T03:01:57.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.177+0000 7fc89959d640 1 -- start start 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc89959d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc87c003a30 0x7fc89414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc89959d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc894151ce0 0x7fc8941520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc89959d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8941f2bb0 0x7fc8941f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc89959d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc894069a80 con 0x7fc894151ce0 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc89959d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc894069900 con 0x7fc8941f2bb0 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc89959d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc894069c00 con 0x7fc87c003a30 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc8937fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc894151ce0 0x7fc8941520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc8937fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc894151ce0 0x7fc8941520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50172/0 (socket says 172.21.15.104:50172) 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc8937fe640 1 -- 172.21.15.104:0/762604714 learned_addr learned my addr 172.21.15.104:0/762604714 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc893fff640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc87c003a30 0x7fc89414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc898d9c640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8941f2bb0 0x7fc8941f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc8937fe640 1 -- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc87c003a30 msgr2=0x7fc89414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc8937fe640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc87c003a30 0x7fc89414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc8937fe640 1 -- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8941f2bb0 msgr2=0x7fc8941f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc8937fe640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8941f2bb0 0x7fc8941f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.178+0000 7fc8937fe640 1 -- 172.21.15.104:0/762604714 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89414fc40 con 0x7fc894151ce0 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.179+0000 7fc8937fe640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc894151ce0 0x7fc8941520f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fc888004e20 tx=0x7fc888001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.179+0000 7fc890ff9640 1 -- 172.21.15.104:0/762604714 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc888015020 con 0x7fc894151ce0 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.179+0000 7fc890ff9640 1 -- 172.21.15.104:0/762604714 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc888011960 con 0x7fc894151ce0 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.179+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc894152630 con 0x7fc894151ce0 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.179+0000 7fc890ff9640 1 -- 172.21.15.104:0/762604714 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc888011d70 con 0x7fc894151ce0 2024-09-17T03:01:57.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.179+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8941555f0 con 0x7fc894151ce0 2024-09-17T03:01:57.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.180+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8940d2cb0 con 0x7fc894151ce0 2024-09-17T03:01:57.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.180+0000 7fc890ff9640 1 -- 172.21.15.104:0/762604714 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc888018020 con 0x7fc894151ce0 2024-09-17T03:01:57.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.181+0000 7fc890ff9640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc880078bc0 0x7fc88007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:57.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.181+0000 7fc890ff9640 1 -- 172.21.15.104:0/762604714 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fc88809b690 con 0x7fc894151ce0 2024-09-17T03:01:57.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.181+0000 7fc893fff640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc880078bc0 0x7fc88007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:57.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.182+0000 7fc893fff640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc880078bc0 0x7fc88007b0d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc884035000 tx=0x7fc88402d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:57.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.185+0000 7fc890ff9640 1 -- 172.21.15.104:0/762604714 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc88801f020 con 0x7fc894151ce0 2024-09-17T03:01:57.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.425+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc8940b1a50 con 0x7fc894151ce0 2024-09-17T03:01:57.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.426+0000 7fc890ff9640 1 -- 172.21.15.104:0/762604714 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1565 (secure 0 0 0) 0x7fc894152630 con 0x7fc894151ce0 2024-09-17T03:01:57.424 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:57.425 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":454,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":153,"num_osds":8,"num_up_osds":8,"osd_up_since":1726541670,"num_in_osds":8,"osd_in_since":1726541667,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":7787137,"bytes_avail":1592212863,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":62,"btime":"2024-09-17T03:01:55:313759+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":7452}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-17T03:01:41.727156+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc880078bc0 msgr2=0x7fc88007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc880078bc0 0x7fc88007b0d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc884035000 tx=0x7fc88402d040 comp rx=0 tx=0).stop 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc894151ce0 msgr2=0x7fc8941520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc894151ce0 0x7fc8941520f0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fc888004e20 tx=0x7fc888001630 comp rx=0 tx=0).stop 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 shutdown_connections 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc880078bc0 0x7fc88007b0d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8941f2bb0 0x7fc8941f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc894151ce0 0x7fc8941520f0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 --2- 172.21.15.104:0/762604714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc87c003a30 0x7fc89414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 >> 172.21.15.104:0/762604714 conn(0x7fc894074520 msgr2=0x7fc894160a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:57.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 shutdown_connections 2024-09-17T03:01:57.428 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.428+0000 7fc89959d640 1 -- 172.21.15.104:0/762604714 wait complete. 2024-09-17T03:01:57.438 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:01:57.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:01:57.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.551+0000 7fed7b016640 1 -- 172.21.15.104:0/2396939462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed740ce280 msgr2=0x7fed740ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.551+0000 7fed7b016640 1 --2- 172.21.15.104:0/2396939462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed740ce280 0x7fed740ce690 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fed6c005fd0 tx=0x7fed6c02a970 comp rx=0 tx=0).stop 2024-09-17T03:01:57.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.551+0000 7fed7b016640 1 -- 172.21.15.104:0/2396939462 shutdown_connections 2024-09-17T03:01:57.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.551+0000 7fed7b016640 1 --2- 172.21.15.104:0/2396939462 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed740ce280 0x7fed740ce690 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.551+0000 7fed7b016640 1 --2- 172.21.15.104:0/2396939462 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed7415bc00 0x7fed74072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.551+0000 7fed7b016640 1 -- 172.21.15.104:0/2396939462 >> 172.21.15.104:0/2396939462 conn(0x7fed740b2450 msgr2=0x7fed740b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:57.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.552+0000 7fed7b016640 1 -- 172.21.15.104:0/2396939462 shutdown_connections 2024-09-17T03:01:57.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.552+0000 7fed7b016640 1 -- 172.21.15.104:0/2396939462 wait complete. 2024-09-17T03:01:57.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.553+0000 7fed7b016640 1 Processor -- start 2024-09-17T03:01:57.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.553+0000 7fed7b016640 1 -- start start 2024-09-17T03:01:57.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed7b016640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed740ce280 0x7fed741e5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:57.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed7b016640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7415b7f0 0x7fed741537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:57.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed7b016640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7415bc00 0x7fed741e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed7b016640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fed740ced50 con 0x7fed7415b7f0 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed7b016640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fed740cebd0 con 0x7fed7415bc00 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed7b016640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fed740ceed0 con 0x7fed740ce280 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7415b7f0 0x7fed741537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7415b7f0 0x7fed741537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50190/0 (socket says 172.21.15.104:50190) 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 -- 172.21.15.104:0/3617609083 learned_addr learned my addr 172.21.15.104:0/3617609083 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed78db2640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed740ce280 0x7fed741e5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed795b3640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7415bc00 0x7fed741e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 -- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed740ce280 msgr2=0x7fed741e5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed740ce280 0x7fed741e5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 -- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7415bc00 msgr2=0x7fed741e9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7415bc00 0x7fed741e9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 -- 172.21.15.104:0/3617609083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed740b4200 con 0x7fed7415b7f0 2024-09-17T03:01:57.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed6bfff640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7415b7f0 0x7fed741537e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fed6400d6b0 tx=0x7fed6400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:57.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed697fa640 1 -- 172.21.15.104:0/3617609083 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64017070 con 0x7fed7415b7f0 2024-09-17T03:01:57.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed697fa640 1 -- 172.21.15.104:0/3617609083 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed64005310 con 0x7fed7415b7f0 2024-09-17T03:01:57.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.555+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed740b44e0 con 0x7fed7415b7f0 2024-09-17T03:01:57.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.556+0000 7fed697fa640 1 -- 172.21.15.104:0/3617609083 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed640097c0 con 0x7fed7415b7f0 2024-09-17T03:01:57.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.556+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed741e9460 con 0x7fed7415b7f0 2024-09-17T03:01:57.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.556+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed741f6f60 con 0x7fed7415b7f0 2024-09-17T03:01:57.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.557+0000 7fed697fa640 1 -- 172.21.15.104:0/3617609083 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed64009960 con 0x7fed7415b7f0 2024-09-17T03:01:57.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.558+0000 7fed697fa640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed60078bc0 0x7fed6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:01:57.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.558+0000 7fed697fa640 1 -- 172.21.15.104:0/3617609083 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fed6409acd0 con 0x7fed7415b7f0 2024-09-17T03:01:57.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.558+0000 7fed78db2640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed60078bc0 0x7fed6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:01:57.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.558+0000 7fed78db2640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed60078bc0 0x7fed6007b0d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fed70006fd0 tx=0x7fed70009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:01:57.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.562+0000 7fed697fa640 1 -- 172.21.15.104:0/3617609083 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed64062ac0 con 0x7fed7415b7f0 2024-09-17T03:01:57.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.732+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed74076440 con 0x7fed60078bc0 2024-09-17T03:01:57.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.737+0000 7fed697fa640 1 -- 172.21.15.104:0/3617609083 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7fed74076440 con 0x7fed60078bc0 2024-09-17T03:01:57.738 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:01:57.740 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:01:57.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.740+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed60078bc0 msgr2=0x7fed6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.740+0000 7fed7b016640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed60078bc0 0x7fed6007b0d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fed70006fd0 tx=0x7fed70009060 comp rx=0 tx=0).stop 2024-09-17T03:01:57.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.740+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7415b7f0 msgr2=0x7fed741537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:01:57.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.740+0000 7fed7b016640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7415b7f0 0x7fed741537e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fed6400d6b0 tx=0x7fed6400db70 comp rx=0 tx=0).stop 2024-09-17T03:01:57.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.741+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 shutdown_connections 2024-09-17T03:01:57.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.741+0000 7fed7b016640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed60078bc0 0x7fed6007b0d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.741+0000 7fed7b016640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7415bc00 0x7fed741e9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.741+0000 7fed7b016640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed7415b7f0 0x7fed741537e0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.741+0000 7fed7b016640 1 --2- 172.21.15.104:0/3617609083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed740ce280 0x7fed741e5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:01:57.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.741+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 >> 172.21.15.104:0/3617609083 conn(0x7fed740b2450 msgr2=0x7fed741574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:01:57.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.741+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 shutdown_connections 2024-09-17T03:01:57.743 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:01:57.741+0000 7fed7b016640 1 -- 172.21.15.104:0/3617609083 wait complete. 2024-09-17T03:01:57.750 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-17T03:01:57.731109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7800,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554699,"statfs":{"total":1600000000,"available":1592012524,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001674"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426926+0000","last_change":"2024-09-17T03:01:53.306340+0000","last_active":"2024-09-17T03:01:54.426926+0000","last_peered":"2024-09-17T03:01:54.426926+0000","last_clean":"2024-09-17T03:01:54.426926+0000","last_became_active":"2024-09-17T03:01:53.305959+0000","last_became_peered":"2024-09-17T03:01:53.305959+0000","last_unstale":"2024-09-17T03:01:54.426926+0000","last_undegraded":"2024-09-17T03:01:54.426926+0000","last_fullsized":"2024-09-17T03:01:54.426926+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:53.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426317+0000","last_change":"2024-09-17T03:01:53.300617+0000","last_active":"2024-09-17T03:01:54.426317+0000","last_peered":"2024-09-17T03:01:54.426317+0000","last_clean":"2024-09-17T03:01:54.426317+0000","last_became_active":"2024-09-17T03:01:53.300365+0000","last_became_peered":"2024-09-17T03:01:53.300365+0000","last_unstale":"2024-09-17T03:01:54.426317+0000","last_undegraded":"2024-09-17T03:01:54.426317+0000","last_fullsized":"2024-09-17T03:01:54.426317+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:53.687930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295008+0000","last_change":"2024-09-17T03:01:53.300948+0000","last_active":"2024-09-17T03:01:54.295008+0000","last_peered":"2024-09-17T03:01:54.295008+0000","last_clean":"2024-09-17T03:01:54.295008+0000","last_became_active":"2024-09-17T03:01:53.300463+0000","last_became_peered":"2024-09-17T03:01:53.300463+0000","last_unstale":"2024-09-17T03:01:54.295008+0000","last_undegraded":"2024-09-17T03:01:54.295008+0000","last_fullsized":"2024-09-17T03:01:54.295008+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:01.180342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425222+0000","last_change":"2024-09-17T03:01:53.303950+0000","last_active":"2024-09-17T03:01:54.425222+0000","last_peered":"2024-09-17T03:01:54.425222+0000","last_clean":"2024-09-17T03:01:54.425222+0000","last_became_active":"2024-09-17T03:01:53.303701+0000","last_became_peered":"2024-09-17T03:01:53.303701+0000","last_unstale":"2024-09-17T03:01:54.425222+0000","last_undegraded":"2024-09-17T03:01:54.425222+0000","last_fullsized":"2024-09-17T03:01:54.425222+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:33.412409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292402+0000","last_change":"2024-09-17T03:01:53.309032+0000","last_active":"2024-09-17T03:01:54.292402+0000","last_peered":"2024-09-17T03:01:54.292402+0000","last_clean":"2024-09-17T03:01:54.292402+0000","last_became_active":"2024-09-17T03:01:53.308736+0000","last_became_peered":"2024-09-17T03:01:53.308736+0000","last_unstale":"2024-09-17T03:01:54.292402+0000","last_undegraded":"2024-09-17T03:01:54.292402+0000","last_fullsized":"2024-09-17T03:01:54.292402+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:26.807681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296627+0000","last_change":"2024-09-17T03:01:53.304588+0000","last_active":"2024-09-17T03:01:54.296627+0000","last_peered":"2024-09-17T03:01:54.296627+0000","last_clean":"2024-09-17T03:01:54.296627+0000","last_became_active":"2024-09-17T03:01:53.304215+0000","last_became_peered":"2024-09-17T03:01:53.304215+0000","last_unstale":"2024-09-17T03:01:54.296627+0000","last_undegraded":"2024-09-17T03:01:54.296627+0000","last_fullsized":"2024-09-17T03:01:54.296627+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:06.695317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295547+0000","last_change":"2024-09-17T03:01:53.297424+0000","last_active":"2024-09-17T03:01:54.295547+0000","last_peered":"2024-09-17T03:01:54.295547+0000","last_clean":"2024-09-17T03:01:54.295547+0000","last_became_active":"2024-09-17T03:01:53.297195+0000","last_became_peered":"2024-09-17T03:01:53.297195+0000","last_unstale":"2024-09-17T03:01:54.295547+0000","last_undegraded":"2024-09-17T03:01:54.295547+0000","last_fullsized":"2024-09-17T03:01:54.295547+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:14.501782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295283+0000","last_change":"2024-09-17T03:01:53.302271+0000","last_active":"2024-09-17T03:01:54.295283+0000","last_peered":"2024-09-17T03:01:54.295283+0000","last_clean":"2024-09-17T03:01:54.295283+0000","last_became_active":"2024-09-17T03:01:53.301965+0000","last_became_peered":"2024-09-17T03:01:53.301965+0000","last_unstale":"2024-09-17T03:01:54.295283+0000","last_undegraded":"2024-09-17T03:01:54.295283+0000","last_fullsized":"2024-09-17T03:01:54.295283+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:49.538513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295905+0000","last_change":"2024-09-17T03:01:53.308217+0000","last_active":"2024-09-17T03:01:54.295905+0000","last_peered":"2024-09-17T03:01:54.295905+0000","last_clean":"2024-09-17T03:01:54.295905+0000","last_became_active":"2024-09-17T03:01:53.307697+0000","last_became_peered":"2024-09-17T03:01:53.307697+0000","last_unstale":"2024-09-17T03:01:54.295905+0000","last_undegraded":"2024-09-17T03:01:54.295905+0000","last_fullsized":"2024-09-17T03:01:54.295905+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:32.822529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427400+0000","last_change":"2024-09-17T03:01:53.310079+0000","last_active":"2024-09-17T03:01:54.427400+0000","last_peered":"2024-09-17T03:01:54.427400+0000","last_clean":"2024-09-17T03:01:54.427400+0000","last_became_active":"2024-09-17T03:01:53.309807+0000","last_became_peered":"2024-09-17T03:01:53.309807+0000","last_unstale":"2024-09-17T03:01:54.427400+0000","last_undegraded":"2024-09-17T03:01:54.427400+0000","last_fullsized":"2024-09-17T03:01:54.427400+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:33.045092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426682+0000","last_change":"2024-09-17T03:01:53.309911+0000","last_active":"2024-09-17T03:01:54.426682+0000","last_peered":"2024-09-17T03:01:54.426682+0000","last_clean":"2024-09-17T03:01:54.426682+0000","last_became_active":"2024-09-17T03:01:53.309626+0000","last_became_peered":"2024-09-17T03:01:53.309626+0000","last_unstale":"2024-09-17T03:01:54.426682+0000","last_undegraded":"2024-09-17T03:01:54.426682+0000","last_fullsized":"2024-09-17T03:01:54.426682+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:37.804052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296607+0000","last_change":"2024-09-17T03:01:53.311000+0000","last_active":"2024-09-17T03:01:54.296607+0000","last_peered":"2024-09-17T03:01:54.296607+0000","last_clean":"2024-09-17T03:01:54.296607+0000","last_became_active":"2024-09-17T03:01:53.310690+0000","last_became_peered":"2024-09-17T03:01:53.310690+0000","last_unstale":"2024-09-17T03:01:54.296607+0000","last_undegraded":"2024-09-17T03:01:54.296607+0000","last_fullsized":"2024-09-17T03:01:54.296607+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:55.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426183+0000","last_change":"2024-09-17T03:01:53.306783+0000","last_active":"2024-09-17T03:01:54.426183+0000","last_peered":"2024-09-17T03:01:54.426183+0000","last_clean":"2024-09-17T03:01:54.426183+0000","last_became_active":"2024-09-17T03:01:53.306288+0000","last_became_peered":"2024-09-17T03:01:53.306288+0000","last_unstale":"2024-09-17T03:01:54.426183+0000","last_undegraded":"2024-09-17T03:01:54.426183+0000","last_fullsized":"2024-09-17T03:01:54.426183+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:25.421022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425683+0000","last_change":"2024-09-17T03:01:53.311037+0000","last_active":"2024-09-17T03:01:54.425683+0000","last_peered":"2024-09-17T03:01:54.425683+0000","last_clean":"2024-09-17T03:01:54.425683+0000","last_became_active":"2024-09-17T03:01:53.310815+0000","last_became_peered":"2024-09-17T03:01:53.310815+0000","last_unstale":"2024-09-17T03:01:54.425683+0000","last_undegraded":"2024-09-17T03:01:54.425683+0000","last_fullsized":"2024-09-17T03:01:54.425683+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:13.612677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426284+0000","last_change":"2024-09-17T03:01:53.309489+0000","last_active":"2024-09-17T03:01:54.426284+0000","last_peered":"2024-09-17T03:01:54.426284+0000","last_clean":"2024-09-17T03:01:54.426284+0000","last_became_active":"2024-09-17T03:01:53.308816+0000","last_became_peered":"2024-09-17T03:01:53.308816+0000","last_unstale":"2024-09-17T03:01:54.426284+0000","last_undegraded":"2024-09-17T03:01:54.426284+0000","last_fullsized":"2024-09-17T03:01:54.426284+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:59.794342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426052+0000","last_change":"2024-09-17T03:01:53.306965+0000","last_active":"2024-09-17T03:01:54.426052+0000","last_peered":"2024-09-17T03:01:54.426052+0000","last_clean":"2024-09-17T03:01:54.426052+0000","last_became_active":"2024-09-17T03:01:53.306353+0000","last_became_peered":"2024-09-17T03:01:53.306353+0000","last_unstale":"2024-09-17T03:01:54.426052+0000","last_undegraded":"2024-09-17T03:01:54.426052+0000","last_fullsized":"2024-09-17T03:01:54.426052+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:40.498146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296020+0000","last_change":"2024-09-17T03:01:53.295548+0000","last_active":"2024-09-17T03:01:54.296020+0000","last_peered":"2024-09-17T03:01:54.296020+0000","last_clean":"2024-09-17T03:01:54.296020+0000","last_became_active":"2024-09-17T03:01:53.295122+0000","last_became_peered":"2024-09-17T03:01:53.295122+0000","last_unstale":"2024-09-17T03:01:54.296020+0000","last_undegraded":"2024-09-17T03:01:54.296020+0000","last_fullsized":"2024-09-17T03:01:54.296020+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:02.609787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427242+0000","last_change":"2024-09-17T03:01:53.301620+0000","last_active":"2024-09-17T03:01:54.427242+0000","last_peered":"2024-09-17T03:01:54.427242+0000","last_clean":"2024-09-17T03:01:54.427242+0000","last_became_active":"2024-09-17T03:01:53.300991+0000","last_became_peered":"2024-09-17T03:01:53.300991+0000","last_unstale":"2024-09-17T03:01:54.427242+0000","last_undegraded":"2024-09-17T03:01:54.427242+0000","last_fullsized":"2024-09-17T03:01:54.427242+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:14.448060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425144+0000","last_change":"2024-09-17T03:01:53.293922+0000","last_active":"2024-09-17T03:01:54.425144+0000","last_peered":"2024-09-17T03:01:54.425144+0000","last_clean":"2024-09-17T03:01:54.425144+0000","last_became_active":"2024-09-17T03:01:53.293585+0000","last_became_peered":"2024-09-17T03:01:53.293585+0000","last_unstale":"2024-09-17T03:01:54.425144+0000","last_undegraded":"2024-09-17T03:01:54.425144+0000","last_fullsized":"2024-09-17T03:01:54.425144+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:50.239446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425264+0000","last_change":"2024-09-17T03:01:53.310106+0000","last_active":"2024-09-17T03:01:54.425264+0000","last_peered":"2024-09-17T03:01:54.425264+0000","last_clean":"2024-09-17T03:01:54.425264+0000","last_became_active":"2024-09-17T03:01:53.309860+0000","last_became_peered":"2024-09-17T03:01:53.309860+0000","last_unstale":"2024-09-17T03:01:54.425264+0000","last_undegraded":"2024-09-17T03:01:54.425264+0000","last_fullsized":"2024-09-17T03:01:54.425264+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:05.896796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.291985+0000","last_change":"2024-09-17T03:01:53.312423+0000","last_active":"2024-09-17T03:01:54.291985+0000","last_peered":"2024-09-17T03:01:54.291985+0000","last_clean":"2024-09-17T03:01:54.291985+0000","last_became_active":"2024-09-17T03:01:53.312146+0000","last_became_peered":"2024-09-17T03:01:53.312146+0000","last_unstale":"2024-09-17T03:01:54.291985+0000","last_undegraded":"2024-09-17T03:01:54.291985+0000","last_fullsized":"2024-09-17T03:01:54.291985+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:28.373671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425475+0000","last_change":"2024-09-17T03:01:53.299102+0000","last_active":"2024-09-17T03:01:54.425475+0000","last_peered":"2024-09-17T03:01:54.425475+0000","last_clean":"2024-09-17T03:01:54.425475+0000","last_became_active":"2024-09-17T03:01:53.298862+0000","last_became_peered":"2024-09-17T03:01:53.298862+0000","last_unstale":"2024-09-17T03:01:54.425475+0000","last_undegraded":"2024-09-17T03:01:54.425475+0000","last_fullsized":"2024-09-17T03:01:54.425475+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:25.972057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295671+0000","last_change":"2024-09-17T03:01:53.309748+0000","last_active":"2024-09-17T03:01:54.295671+0000","last_peered":"2024-09-17T03:01:54.295671+0000","last_clean":"2024-09-17T03:01:54.295671+0000","last_became_active":"2024-09-17T03:01:53.309439+0000","last_became_peered":"2024-09-17T03:01:53.309439+0000","last_unstale":"2024-09-17T03:01:54.295671+0000","last_undegraded":"2024-09-17T03:01:54.295671+0000","last_fullsized":"2024-09-17T03:01:54.295671+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:16.354114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425356+0000","last_change":"2024-09-17T03:01:53.310896+0000","last_active":"2024-09-17T03:01:54.425356+0000","last_peered":"2024-09-17T03:01:54.425356+0000","last_clean":"2024-09-17T03:01:54.425356+0000","last_became_active":"2024-09-17T03:01:53.308991+0000","last_became_peered":"2024-09-17T03:01:53.308991+0000","last_unstale":"2024-09-17T03:01:54.425356+0000","last_undegraded":"2024-09-17T03:01:54.425356+0000","last_fullsized":"2024-09-17T03:01:54.425356+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:59.262579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427110+0000","last_change":"2024-09-17T03:01:53.305314+0000","last_active":"2024-09-17T03:01:54.427110+0000","last_peered":"2024-09-17T03:01:54.427110+0000","last_clean":"2024-09-17T03:01:54.427110+0000","last_became_active":"2024-09-17T03:01:53.305028+0000","last_became_peered":"2024-09-17T03:01:53.305028+0000","last_unstale":"2024-09-17T03:01:54.427110+0000","last_undegraded":"2024-09-17T03:01:54.427110+0000","last_fullsized":"2024-09-17T03:01:54.427110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:29.995013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426275+0000","last_change":"2024-09-17T03:01:53.307991+0000","last_active":"2024-09-17T03:01:54.426275+0000","last_peered":"2024-09-17T03:01:54.426275+0000","last_clean":"2024-09-17T03:01:54.426275+0000","last_became_active":"2024-09-17T03:01:53.306677+0000","last_became_peered":"2024-09-17T03:01:53.306677+0000","last_unstale":"2024-09-17T03:01:54.426275+0000","last_undegraded":"2024-09-17T03:01:54.426275+0000","last_fullsized":"2024-09-17T03:01:54.426275+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:35.967649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425205+0000","last_change":"2024-09-17T03:01:53.300084+0000","last_active":"2024-09-17T03:01:54.425205+0000","last_peered":"2024-09-17T03:01:54.425205+0000","last_clean":"2024-09-17T03:01:54.425205+0000","last_became_active":"2024-09-17T03:01:53.299312+0000","last_became_peered":"2024-09-17T03:01:53.299312+0000","last_unstale":"2024-09-17T03:01:54.425205+0000","last_undegraded":"2024-09-17T03:01:54.425205+0000","last_fullsized":"2024-09-17T03:01:54.425205+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:48.585798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425389+0000","last_change":"2024-09-17T03:01:53.309544+0000","last_active":"2024-09-17T03:01:54.425389+0000","last_peered":"2024-09-17T03:01:54.425389+0000","last_clean":"2024-09-17T03:01:54.425389+0000","last_became_active":"2024-09-17T03:01:53.309093+0000","last_became_peered":"2024-09-17T03:01:53.309093+0000","last_unstale":"2024-09-17T03:01:54.425389+0000","last_undegraded":"2024-09-17T03:01:54.425389+0000","last_fullsized":"2024-09-17T03:01:54.425389+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:35.979315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425522+0000","last_change":"2024-09-17T03:01:53.302355+0000","last_active":"2024-09-17T03:01:54.425522+0000","last_peered":"2024-09-17T03:01:54.425522+0000","last_clean":"2024-09-17T03:01:54.425522+0000","last_became_active":"2024-09-17T03:01:53.302088+0000","last_became_peered":"2024-09-17T03:01:53.302088+0000","last_unstale":"2024-09-17T03:01:54.425522+0000","last_undegraded":"2024-09-17T03:01:54.425522+0000","last_fullsized":"2024-09-17T03:01:54.425522+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:58.697927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426497+0000","last_change":"2024-09-17T03:01:53.309830+0000","last_active":"2024-09-17T03:01:54.426497+0000","last_peered":"2024-09-17T03:01:54.426497+0000","last_clean":"2024-09-17T03:01:54.426497+0000","last_became_active":"2024-09-17T03:01:53.309159+0000","last_became_peered":"2024-09-17T03:01:53.309159+0000","last_unstale":"2024-09-17T03:01:54.426497+0000","last_undegraded":"2024-09-17T03:01:54.426497+0000","last_fullsized":"2024-09-17T03:01:54.426497+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:39.893593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292255+0000","last_change":"2024-09-17T03:01:53.307019+0000","last_active":"2024-09-17T03:01:54.292255+0000","last_peered":"2024-09-17T03:01:54.292255+0000","last_clean":"2024-09-17T03:01:54.292255+0000","last_became_active":"2024-09-17T03:01:53.306420+0000","last_became_peered":"2024-09-17T03:01:53.306420+0000","last_unstale":"2024-09-17T03:01:54.292255+0000","last_undegraded":"2024-09-17T03:01:54.292255+0000","last_fullsized":"2024-09-17T03:01:54.292255+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:21.972537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295781+0000","last_change":"2024-09-17T03:01:53.301298+0000","last_active":"2024-09-17T03:01:54.295781+0000","last_peered":"2024-09-17T03:01:54.295781+0000","last_clean":"2024-09-17T03:01:54.295781+0000","last_became_active":"2024-09-17T03:01:53.300929+0000","last_became_peered":"2024-09-17T03:01:53.300929+0000","last_unstale":"2024-09-17T03:01:54.295781+0000","last_undegraded":"2024-09-17T03:01:54.295781+0000","last_fullsized":"2024-09-17T03:01:54.295781+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:30.910526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426361+0000","last_change":"2024-09-17T03:01:53.304941+0000","last_active":"2024-09-17T03:01:54.426361+0000","last_peered":"2024-09-17T03:01:54.426361+0000","last_clean":"2024-09-17T03:01:54.426361+0000","last_became_active":"2024-09-17T03:01:53.304527+0000","last_became_peered":"2024-09-17T03:01:53.304527+0000","last_unstale":"2024-09-17T03:01:54.426361+0000","last_undegraded":"2024-09-17T03:01:54.426361+0000","last_fullsized":"2024-09-17T03:01:54.426361+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:58.639975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"152'4","reported_seq":19,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292086+0000","last_change":"2024-09-17T03:01:52.303205+0000","last_active":"2024-09-17T03:01:54.292086+0000","last_peered":"2024-09-17T03:01:54.292086+0000","last_clean":"2024-09-17T03:01:54.292086+0000","last_became_active":"2024-09-17T03:01:52.302889+0000","last_became_peered":"2024-09-17T03:01:52.302889+0000","last_unstale":"2024-09-17T03:01:54.292086+0000","last_undegraded":"2024-09-17T03:01:54.292086+0000","last_fullsized":"2024-09-17T03:01:54.292086+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.825647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295910+0000","last_change":"2024-09-17T03:01:53.305574+0000","last_active":"2024-09-17T03:01:54.295910+0000","last_peered":"2024-09-17T03:01:54.295910+0000","last_clean":"2024-09-17T03:01:54.295910+0000","last_became_active":"2024-09-17T03:01:53.305093+0000","last_became_peered":"2024-09-17T03:01:53.305093+0000","last_unstale":"2024-09-17T03:01:54.295910+0000","last_undegraded":"2024-09-17T03:01:54.295910+0000","last_fullsized":"2024-09-17T03:01:54.295910+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:35.246436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425402+0000","last_change":"2024-09-17T03:01:52.304330+0000","last_active":"2024-09-17T03:01:54.425402+0000","last_peered":"2024-09-17T03:01:54.425402+0000","last_clean":"2024-09-17T03:01:54.425402+0000","last_became_active":"2024-09-17T03:01:52.303598+0000","last_became_peered":"2024-09-17T03:01:52.303598+0000","last_unstale":"2024-09-17T03:01:54.425402+0000","last_undegraded":"2024-09-17T03:01:54.425402+0000","last_fullsized":"2024-09-17T03:01:54.425402+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:19.538876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292436+0000","last_change":"2024-09-17T03:01:53.311577+0000","last_active":"2024-09-17T03:01:54.292436+0000","last_peered":"2024-09-17T03:01:54.292436+0000","last_clean":"2024-09-17T03:01:54.292436+0000","last_became_active":"2024-09-17T03:01:53.309020+0000","last_became_peered":"2024-09-17T03:01:53.309020+0000","last_unstale":"2024-09-17T03:01:54.292436+0000","last_undegraded":"2024-09-17T03:01:54.292436+0000","last_fullsized":"2024-09-17T03:01:54.292436+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:22.231258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425617+0000","last_change":"2024-09-17T03:01:52.296300+0000","last_active":"2024-09-17T03:01:54.425617+0000","last_peered":"2024-09-17T03:01:54.425617+0000","last_clean":"2024-09-17T03:01:54.425617+0000","last_became_active":"2024-09-17T03:01:52.295954+0000","last_became_peered":"2024-09-17T03:01:52.295954+0000","last_unstale":"2024-09-17T03:01:54.425617+0000","last_undegraded":"2024-09-17T03:01:54.425617+0000","last_fullsized":"2024-09-17T03:01:54.425617+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:27.882613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292555+0000","last_change":"2024-09-17T03:01:53.313729+0000","last_active":"2024-09-17T03:01:54.292555+0000","last_peered":"2024-09-17T03:01:54.292555+0000","last_clean":"2024-09-17T03:01:54.292555+0000","last_became_active":"2024-09-17T03:01:53.313081+0000","last_became_peered":"2024-09-17T03:01:53.313081+0000","last_unstale":"2024-09-17T03:01:54.292555+0000","last_undegraded":"2024-09-17T03:01:54.292555+0000","last_fullsized":"2024-09-17T03:01:54.292555+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:16.810724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426947+0000","last_change":"2024-09-17T03:01:52.304836+0000","last_active":"2024-09-17T03:01:54.426947+0000","last_peered":"2024-09-17T03:01:54.426947+0000","last_clean":"2024-09-17T03:01:54.426947+0000","last_became_active":"2024-09-17T03:01:52.304573+0000","last_became_peered":"2024-09-17T03:01:52.304573+0000","last_unstale":"2024-09-17T03:01:54.426947+0000","last_undegraded":"2024-09-17T03:01:54.426947+0000","last_fullsized":"2024-09-17T03:01:54.426947+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:39.705145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427448+0000","last_change":"2024-09-17T03:01:53.302092+0000","last_active":"2024-09-17T03:01:54.427448+0000","last_peered":"2024-09-17T03:01:54.427448+0000","last_clean":"2024-09-17T03:01:54.427448+0000","last_became_active":"2024-09-17T03:01:53.301338+0000","last_became_peered":"2024-09-17T03:01:53.301338+0000","last_unstale":"2024-09-17T03:01:54.427448+0000","last_undegraded":"2024-09-17T03:01:54.427448+0000","last_fullsized":"2024-09-17T03:01:54.427448+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:16.533035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426392+0000","last_change":"2024-09-17T03:01:52.304212+0000","last_active":"2024-09-17T03:01:54.426392+0000","last_peered":"2024-09-17T03:01:54.426392+0000","last_clean":"2024-09-17T03:01:54.426392+0000","last_became_active":"2024-09-17T03:01:52.303954+0000","last_became_peered":"2024-09-17T03:01:52.303954+0000","last_unstale":"2024-09-17T03:01:54.426392+0000","last_undegraded":"2024-09-17T03:01:54.426392+0000","last_fullsized":"2024-09-17T03:01:54.426392+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:32.435046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296249+0000","last_change":"2024-09-17T03:01:53.293757+0000","last_active":"2024-09-17T03:01:54.296249+0000","last_peered":"2024-09-17T03:01:54.296249+0000","last_clean":"2024-09-17T03:01:54.296249+0000","last_became_active":"2024-09-17T03:01:53.293415+0000","last_became_peered":"2024-09-17T03:01:53.293415+0000","last_unstale":"2024-09-17T03:01:54.296249+0000","last_undegraded":"2024-09-17T03:01:54.296249+0000","last_fullsized":"2024-09-17T03:01:54.296249+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:26.611534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427491+0000","last_change":"2024-09-17T03:01:52.300015+0000","last_active":"2024-09-17T03:01:54.427491+0000","last_peered":"2024-09-17T03:01:54.427491+0000","last_clean":"2024-09-17T03:01:54.427491+0000","last_became_active":"2024-09-17T03:01:52.299756+0000","last_became_peered":"2024-09-17T03:01:52.299756+0000","last_unstale":"2024-09-17T03:01:54.427491+0000","last_undegraded":"2024-09-17T03:01:54.427491+0000","last_fullsized":"2024-09-17T03:01:54.427491+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:49.156240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295444+0000","last_change":"2024-09-17T03:01:53.308021+0000","last_active":"2024-09-17T03:01:54.295444+0000","last_peered":"2024-09-17T03:01:54.295444+0000","last_clean":"2024-09-17T03:01:54.295444+0000","last_became_active":"2024-09-17T03:01:53.307236+0000","last_became_peered":"2024-09-17T03:01:53.307236+0000","last_unstale":"2024-09-17T03:01:54.295444+0000","last_undegraded":"2024-09-17T03:01:54.295444+0000","last_fullsized":"2024-09-17T03:01:54.295444+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:42.437943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295539+0000","last_change":"2024-09-17T03:01:52.300007+0000","last_active":"2024-09-17T03:01:54.295539+0000","last_peered":"2024-09-17T03:01:54.295539+0000","last_clean":"2024-09-17T03:01:54.295539+0000","last_became_active":"2024-09-17T03:01:52.299526+0000","last_became_peered":"2024-09-17T03:01:52.299526+0000","last_unstale":"2024-09-17T03:01:54.295539+0000","last_undegraded":"2024-09-17T03:01:54.295539+0000","last_fullsized":"2024-09-17T03:01:54.295539+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:00.746200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425901+0000","last_change":"2024-09-17T03:01:53.301417+0000","last_active":"2024-09-17T03:01:54.425901+0000","last_peered":"2024-09-17T03:01:54.425901+0000","last_clean":"2024-09-17T03:01:54.425901+0000","last_became_active":"2024-09-17T03:01:53.301160+0000","last_became_peered":"2024-09-17T03:01:53.301160+0000","last_unstale":"2024-09-17T03:01:54.425901+0000","last_undegraded":"2024-09-17T03:01:54.425901+0000","last_fullsized":"2024-09-17T03:01:54.425901+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:02.884802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427688+0000","last_change":"2024-09-17T03:01:52.307300+0000","last_active":"2024-09-17T03:01:54.427688+0000","last_peered":"2024-09-17T03:01:54.427688+0000","last_clean":"2024-09-17T03:01:54.427688+0000","last_became_active":"2024-09-17T03:01:52.307008+0000","last_became_peered":"2024-09-17T03:01:52.307008+0000","last_unstale":"2024-09-17T03:01:54.427688+0000","last_undegraded":"2024-09-17T03:01:54.427688+0000","last_fullsized":"2024-09-17T03:01:54.427688+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:26.343082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425540+0000","last_change":"2024-09-17T03:01:53.305143+0000","last_active":"2024-09-17T03:01:54.425540+0000","last_peered":"2024-09-17T03:01:54.425540+0000","last_clean":"2024-09-17T03:01:54.425540+0000","last_became_active":"2024-09-17T03:01:53.303754+0000","last_became_peered":"2024-09-17T03:01:53.303754+0000","last_unstale":"2024-09-17T03:01:54.425540+0000","last_undegraded":"2024-09-17T03:01:54.425540+0000","last_fullsized":"2024-09-17T03:01:54.425540+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:07.132099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425583+0000","last_change":"2024-09-17T03:01:52.305415+0000","last_active":"2024-09-17T03:01:54.425583+0000","last_peered":"2024-09-17T03:01:54.425583+0000","last_clean":"2024-09-17T03:01:54.425583+0000","last_became_active":"2024-09-17T03:01:52.305113+0000","last_became_peered":"2024-09-17T03:01:52.305113+0000","last_unstale":"2024-09-17T03:01:54.425583+0000","last_undegraded":"2024-09-17T03:01:54.425583+0000","last_fullsized":"2024-09-17T03:01:54.425583+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:53.477184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425337+0000","last_change":"2024-09-17T03:01:53.310674+0000","last_active":"2024-09-17T03:01:54.425337+0000","last_peered":"2024-09-17T03:01:54.425337+0000","last_clean":"2024-09-17T03:01:54.425337+0000","last_became_active":"2024-09-17T03:01:53.309966+0000","last_became_peered":"2024-09-17T03:01:53.309966+0000","last_unstale":"2024-09-17T03:01:54.425337+0000","last_undegraded":"2024-09-17T03:01:54.425337+0000","last_fullsized":"2024-09-17T03:01:54.425337+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:35.699402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425919+0000","last_change":"2024-09-17T03:01:52.307250+0000","last_active":"2024-09-17T03:01:54.425919+0000","last_peered":"2024-09-17T03:01:54.425919+0000","last_clean":"2024-09-17T03:01:54.425919+0000","last_became_active":"2024-09-17T03:01:52.306999+0000","last_became_peered":"2024-09-17T03:01:52.306999+0000","last_unstale":"2024-09-17T03:01:54.425919+0000","last_undegraded":"2024-09-17T03:01:54.425919+0000","last_fullsized":"2024-09-17T03:01:54.425919+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:53.809978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292152+0000","last_change":"2024-09-17T03:01:53.301548+0000","last_active":"2024-09-17T03:01:54.292152+0000","last_peered":"2024-09-17T03:01:54.292152+0000","last_clean":"2024-09-17T03:01:54.292152+0000","last_became_active":"2024-09-17T03:01:53.301275+0000","last_became_peered":"2024-09-17T03:01:53.301275+0000","last_unstale":"2024-09-17T03:01:54.292152+0000","last_undegraded":"2024-09-17T03:01:54.292152+0000","last_fullsized":"2024-09-17T03:01:54.292152+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:13.027685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"152'3","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425451+0000","last_change":"2024-09-17T03:01:52.306213+0000","last_active":"2024-09-17T03:01:54.425451+0000","last_peered":"2024-09-17T03:01:54.425451+0000","last_clean":"2024-09-17T03:01:54.425451+0000","last_became_active":"2024-09-17T03:01:52.305296+0000","last_became_peered":"2024-09-17T03:01:52.305296+0000","last_unstale":"2024-09-17T03:01:54.425451+0000","last_undegraded":"2024-09-17T03:01:54.425451+0000","last_fullsized":"2024-09-17T03:01:54.425451+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:33.101039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.291990+0000","last_change":"2024-09-17T03:01:53.302163+0000","last_active":"2024-09-17T03:01:54.291990+0000","last_peered":"2024-09-17T03:01:54.291990+0000","last_clean":"2024-09-17T03:01:54.291990+0000","last_became_active":"2024-09-17T03:01:53.301881+0000","last_became_peered":"2024-09-17T03:01:53.301881+0000","last_unstale":"2024-09-17T03:01:54.291990+0000","last_undegraded":"2024-09-17T03:01:54.291990+0000","last_fullsized":"2024-09-17T03:01:54.291990+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:41.748979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"152'6","reported_seq":21,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296163+0000","last_change":"2024-09-17T03:01:52.306378+0000","last_active":"2024-09-17T03:01:54.296163+0000","last_peered":"2024-09-17T03:01:54.296163+0000","last_clean":"2024-09-17T03:01:54.296163+0000","last_became_active":"2024-09-17T03:01:52.306022+0000","last_became_peered":"2024-09-17T03:01:52.306022+0000","last_unstale":"2024-09-17T03:01:54.296163+0000","last_undegraded":"2024-09-17T03:01:54.296163+0000","last_fullsized":"2024-09-17T03:01:54.296163+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:12.832713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426781+0000","last_change":"2024-09-17T03:01:53.305553+0000","last_active":"2024-09-17T03:01:54.426781+0000","last_peered":"2024-09-17T03:01:54.426781+0000","last_clean":"2024-09-17T03:01:54.426781+0000","last_became_active":"2024-09-17T03:01:53.304065+0000","last_became_peered":"2024-09-17T03:01:53.304065+0000","last_unstale":"2024-09-17T03:01:54.426781+0000","last_undegraded":"2024-09-17T03:01:54.426781+0000","last_fullsized":"2024-09-17T03:01:54.426781+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:12.939868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426989+0000","last_change":"2024-09-17T03:01:52.303738+0000","last_active":"2024-09-17T03:01:54.426989+0000","last_peered":"2024-09-17T03:01:54.426989+0000","last_clean":"2024-09-17T03:01:54.426989+0000","last_became_active":"2024-09-17T03:01:52.303484+0000","last_became_peered":"2024-09-17T03:01:52.303484+0000","last_unstale":"2024-09-17T03:01:54.426989+0000","last_undegraded":"2024-09-17T03:01:54.426989+0000","last_fullsized":"2024-09-17T03:01:54.426989+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:39.094292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425140+0000","last_change":"2024-09-17T03:01:53.303318+0000","last_active":"2024-09-17T03:01:54.425140+0000","last_peered":"2024-09-17T03:01:54.425140+0000","last_clean":"2024-09-17T03:01:54.425140+0000","last_became_active":"2024-09-17T03:01:53.303076+0000","last_became_peered":"2024-09-17T03:01:53.303076+0000","last_unstale":"2024-09-17T03:01:54.425140+0000","last_undegraded":"2024-09-17T03:01:54.425140+0000","last_fullsized":"2024-09-17T03:01:54.425140+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.571182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426513+0000","last_change":"2024-09-17T03:01:52.305015+0000","last_active":"2024-09-17T03:01:54.426513+0000","last_peered":"2024-09-17T03:01:54.426513+0000","last_clean":"2024-09-17T03:01:54.426513+0000","last_became_active":"2024-09-17T03:01:52.304751+0000","last_became_peered":"2024-09-17T03:01:52.304751+0000","last_unstale":"2024-09-17T03:01:54.426513+0000","last_undegraded":"2024-09-17T03:01:54.426513+0000","last_fullsized":"2024-09-17T03:01:54.426513+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:19.079233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296785+0000","last_change":"2024-09-17T03:01:53.308695+0000","last_active":"2024-09-17T03:01:54.296785+0000","last_peered":"2024-09-17T03:01:54.296785+0000","last_clean":"2024-09-17T03:01:54.296785+0000","last_became_active":"2024-09-17T03:01:53.308435+0000","last_became_peered":"2024-09-17T03:01:53.308435+0000","last_unstale":"2024-09-17T03:01:54.296785+0000","last_undegraded":"2024-09-17T03:01:54.296785+0000","last_fullsized":"2024-09-17T03:01:54.296785+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:32.892833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"152'8","reported_seq":23,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296008+0000","last_change":"2024-09-17T03:01:52.308068+0000","last_active":"2024-09-17T03:01:54.296008+0000","last_peered":"2024-09-17T03:01:54.296008+0000","last_clean":"2024-09-17T03:01:54.296008+0000","last_became_active":"2024-09-17T03:01:52.307607+0000","last_became_peered":"2024-09-17T03:01:52.307607+0000","last_unstale":"2024-09-17T03:01:54.296008+0000","last_undegraded":"2024-09-17T03:01:54.296008+0000","last_fullsized":"2024-09-17T03:01:54.296008+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:36.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295724+0000","last_change":"2024-09-17T03:01:53.309995+0000","last_active":"2024-09-17T03:01:54.295724+0000","last_peered":"2024-09-17T03:01:54.295724+0000","last_clean":"2024-09-17T03:01:54.295724+0000","last_became_active":"2024-09-17T03:01:53.307615+0000","last_became_peered":"2024-09-17T03:01:53.307615+0000","last_unstale":"2024-09-17T03:01:54.295724+0000","last_undegraded":"2024-09-17T03:01:54.295724+0000","last_fullsized":"2024-09-17T03:01:54.295724+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:41.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425496+0000","last_change":"2024-09-17T03:01:52.304632+0000","last_active":"2024-09-17T03:01:54.425496+0000","last_peered":"2024-09-17T03:01:54.425496+0000","last_clean":"2024-09-17T03:01:54.425496+0000","last_became_active":"2024-09-17T03:01:52.304029+0000","last_became_peered":"2024-09-17T03:01:52.304029+0000","last_unstale":"2024-09-17T03:01:54.425496+0000","last_undegraded":"2024-09-17T03:01:54.425496+0000","last_fullsized":"2024-09-17T03:01:54.425496+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:47.549818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425348+0000","last_change":"2024-09-17T03:01:53.310535+0000","last_active":"2024-09-17T03:01:54.425348+0000","last_peered":"2024-09-17T03:01:54.425348+0000","last_clean":"2024-09-17T03:01:54.425348+0000","last_became_active":"2024-09-17T03:01:53.310254+0000","last_became_peered":"2024-09-17T03:01:53.310254+0000","last_unstale":"2024-09-17T03:01:54.425348+0000","last_undegraded":"2024-09-17T03:01:54.425348+0000","last_fullsized":"2024-09-17T03:01:54.425348+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:59.984122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425729+0000","last_change":"2024-09-17T03:01:52.303034+0000","last_active":"2024-09-17T03:01:54.425729+0000","last_peered":"2024-09-17T03:01:54.425729+0000","last_clean":"2024-09-17T03:01:54.425729+0000","last_became_active":"2024-09-17T03:01:52.302291+0000","last_became_peered":"2024-09-17T03:01:52.302291+0000","last_unstale":"2024-09-17T03:01:54.425729+0000","last_undegraded":"2024-09-17T03:01:54.425729+0000","last_fullsized":"2024-09-17T03:01:54.425729+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:17.868010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425852+0000","last_change":"2024-09-17T03:01:53.307497+0000","last_active":"2024-09-17T03:01:54.425852+0000","last_peered":"2024-09-17T03:01:54.425852+0000","last_clean":"2024-09-17T03:01:54.425852+0000","last_became_active":"2024-09-17T03:01:53.307226+0000","last_became_peered":"2024-09-17T03:01:53.307226+0000","last_unstale":"2024-09-17T03:01:54.425852+0000","last_undegraded":"2024-09-17T03:01:54.425852+0000","last_fullsized":"2024-09-17T03:01:54.425852+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:12.221781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296806+0000","last_change":"2024-09-17T03:01:52.302525+0000","last_active":"2024-09-17T03:01:54.296806+0000","last_peered":"2024-09-17T03:01:54.296806+0000","last_clean":"2024-09-17T03:01:54.296806+0000","last_became_active":"2024-09-17T03:01:52.302011+0000","last_became_peered":"2024-09-17T03:01:52.302011+0000","last_unstale":"2024-09-17T03:01:54.296806+0000","last_undegraded":"2024-09-17T03:01:54.296806+0000","last_fullsized":"2024-09-17T03:01:54.296806+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:51.323047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427224+0000","last_change":"2024-09-17T03:01:53.308214+0000","last_active":"2024-09-17T03:01:54.427224+0000","last_peered":"2024-09-17T03:01:54.427224+0000","last_clean":"2024-09-17T03:01:54.427224+0000","last_became_active":"2024-09-17T03:01:53.307963+0000","last_became_peered":"2024-09-17T03:01:53.307963+0000","last_unstale":"2024-09-17T03:01:54.427224+0000","last_undegraded":"2024-09-17T03:01:54.427224+0000","last_fullsized":"2024-09-17T03:01:54.427224+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:02.882199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425283+0000","last_change":"2024-09-17T03:01:52.304911+0000","last_active":"2024-09-17T03:01:54.425283+0000","last_peered":"2024-09-17T03:01:54.425283+0000","last_clean":"2024-09-17T03:01:54.425283+0000","last_became_active":"2024-09-17T03:01:52.304608+0000","last_became_peered":"2024-09-17T03:01:52.304608+0000","last_unstale":"2024-09-17T03:01:54.425283+0000","last_undegraded":"2024-09-17T03:01:54.425283+0000","last_fullsized":"2024-09-17T03:01:54.425283+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:18.379136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425737+0000","last_change":"2024-09-17T03:01:53.305125+0000","last_active":"2024-09-17T03:01:54.425737+0000","last_peered":"2024-09-17T03:01:54.425737+0000","last_clean":"2024-09-17T03:01:54.425737+0000","last_became_active":"2024-09-17T03:01:53.304831+0000","last_became_peered":"2024-09-17T03:01:53.304831+0000","last_unstale":"2024-09-17T03:01:54.425737+0000","last_undegraded":"2024-09-17T03:01:54.425737+0000","last_fullsized":"2024-09-17T03:01:54.425737+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:32.355099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425535+0000","last_change":"2024-09-17T03:01:52.305830+0000","last_active":"2024-09-17T03:01:54.425535+0000","last_peered":"2024-09-17T03:01:54.425535+0000","last_clean":"2024-09-17T03:01:54.425535+0000","last_became_active":"2024-09-17T03:01:52.303818+0000","last_became_peered":"2024-09-17T03:01:52.303818+0000","last_unstale":"2024-09-17T03:01:54.425535+0000","last_undegraded":"2024-09-17T03:01:54.425535+0000","last_fullsized":"2024-09-17T03:01:54.425535+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:44.158779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296335+0000","last_change":"2024-09-17T03:01:53.300341+0000","last_active":"2024-09-17T03:01:54.296335+0000","last_peered":"2024-09-17T03:01:54.296335+0000","last_clean":"2024-09-17T03:01:54.296335+0000","last_became_active":"2024-09-17T03:01:53.300030+0000","last_became_peered":"2024-09-17T03:01:53.300030+0000","last_unstale":"2024-09-17T03:01:54.296335+0000","last_undegraded":"2024-09-17T03:01:54.296335+0000","last_fullsized":"2024-09-17T03:01:54.296335+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426653+0000","last_change":"2024-09-17T03:01:52.307321+0000","last_active":"2024-09-17T03:01:54.426653+0000","last_peered":"2024-09-17T03:01:54.426653+0000","last_clean":"2024-09-17T03:01:54.426653+0000","last_became_active":"2024-09-17T03:01:52.307044+0000","last_became_peered":"2024-09-17T03:01:52.307044+0000","last_unstale":"2024-09-17T03:01:54.426653+0000","last_undegraded":"2024-09-17T03:01:54.426653+0000","last_fullsized":"2024-09-17T03:01:54.426653+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:24.246505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426878+0000","last_change":"2024-09-17T03:01:53.311163+0000","last_active":"2024-09-17T03:01:54.426878+0000","last_peered":"2024-09-17T03:01:54.426878+0000","last_clean":"2024-09-17T03:01:54.426878+0000","last_became_active":"2024-09-17T03:01:53.310787+0000","last_became_peered":"2024-09-17T03:01:53.310787+0000","last_unstale":"2024-09-17T03:01:54.426878+0000","last_undegraded":"2024-09-17T03:01:54.426878+0000","last_fullsized":"2024-09-17T03:01:54.426878+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:45.224464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425421+0000","last_change":"2024-09-17T03:01:52.303292+0000","last_active":"2024-09-17T03:01:54.425421+0000","last_peered":"2024-09-17T03:01:54.425421+0000","last_clean":"2024-09-17T03:01:54.425421+0000","last_became_active":"2024-09-17T03:01:52.303040+0000","last_became_peered":"2024-09-17T03:01:52.303040+0000","last_unstale":"2024-09-17T03:01:54.425421+0000","last_undegraded":"2024-09-17T03:01:54.425421+0000","last_fullsized":"2024-09-17T03:01:54.425421+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:49.227026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292167+0000","last_change":"2024-09-17T03:01:53.303364+0000","last_active":"2024-09-17T03:01:54.292167+0000","last_peered":"2024-09-17T03:01:54.292167+0000","last_clean":"2024-09-17T03:01:54.292167+0000","last_became_active":"2024-09-17T03:01:53.302112+0000","last_became_peered":"2024-09-17T03:01:53.302112+0000","last_unstale":"2024-09-17T03:01:54.292167+0000","last_undegraded":"2024-09-17T03:01:54.292167+0000","last_fullsized":"2024-09-17T03:01:54.292167+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:06.567200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426746+0000","last_change":"2024-09-17T03:01:52.303314+0000","last_active":"2024-09-17T03:01:54.426746+0000","last_peered":"2024-09-17T03:01:54.426746+0000","last_clean":"2024-09-17T03:01:54.426746+0000","last_became_active":"2024-09-17T03:01:52.303019+0000","last_became_peered":"2024-09-17T03:01:52.303019+0000","last_unstale":"2024-09-17T03:01:54.426746+0000","last_undegraded":"2024-09-17T03:01:54.426746+0000","last_fullsized":"2024-09-17T03:01:54.426746+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:45.317901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296610+0000","last_change":"2024-09-17T03:01:53.305439+0000","last_active":"2024-09-17T03:01:54.296610+0000","last_peered":"2024-09-17T03:01:54.296610+0000","last_clean":"2024-09-17T03:01:54.296610+0000","last_became_active":"2024-09-17T03:01:53.304349+0000","last_became_peered":"2024-09-17T03:01:53.304349+0000","last_unstale":"2024-09-17T03:01:54.296610+0000","last_undegraded":"2024-09-17T03:01:54.296610+0000","last_fullsized":"2024-09-17T03:01:54.296610+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:26.308040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425844+0000","last_change":"2024-09-17T03:01:52.303733+0000","last_active":"2024-09-17T03:01:54.425844+0000","last_peered":"2024-09-17T03:01:54.425844+0000","last_clean":"2024-09-17T03:01:54.425844+0000","last_became_active":"2024-09-17T03:01:52.303424+0000","last_became_peered":"2024-09-17T03:01:52.303424+0000","last_unstale":"2024-09-17T03:01:54.425844+0000","last_undegraded":"2024-09-17T03:01:54.425844+0000","last_fullsized":"2024-09-17T03:01:54.425844+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:11.884059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425772+0000","last_change":"2024-09-17T03:01:53.300918+0000","last_active":"2024-09-17T03:01:54.425772+0000","last_peered":"2024-09-17T03:01:54.425772+0000","last_clean":"2024-09-17T03:01:54.425772+0000","last_became_active":"2024-09-17T03:01:53.300664+0000","last_became_peered":"2024-09-17T03:01:53.300664+0000","last_unstale":"2024-09-17T03:01:54.425772+0000","last_undegraded":"2024-09-17T03:01:54.425772+0000","last_fullsized":"2024-09-17T03:01:54.425772+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:20.092322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"153'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292271+0000","last_change":"2024-09-17T03:01:52.300246+0000","last_active":"2024-09-17T03:01:54.292271+0000","last_peered":"2024-09-17T03:01:54.292271+0000","last_clean":"2024-09-17T03:01:54.292271+0000","last_became_active":"2024-09-17T03:01:52.299949+0000","last_became_peered":"2024-09-17T03:01:52.299949+0000","last_unstale":"2024-09-17T03:01:54.292271+0000","last_undegraded":"2024-09-17T03:01:54.292271+0000","last_fullsized":"2024-09-17T03:01:54.292271+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:24.460970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427618+0000","last_change":"2024-09-17T03:01:53.304271+0000","last_active":"2024-09-17T03:01:54.427618+0000","last_peered":"2024-09-17T03:01:54.427618+0000","last_clean":"2024-09-17T03:01:54.427618+0000","last_became_active":"2024-09-17T03:01:53.304020+0000","last_became_peered":"2024-09-17T03:01:53.304020+0000","last_unstale":"2024-09-17T03:01:54.427618+0000","last_undegraded":"2024-09-17T03:01:54.427618+0000","last_fullsized":"2024-09-17T03:01:54.427618+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:18.760563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425965+0000","last_change":"2024-09-17T03:01:52.307286+0000","last_active":"2024-09-17T03:01:54.425965+0000","last_peered":"2024-09-17T03:01:54.425965+0000","last_clean":"2024-09-17T03:01:54.425965+0000","last_became_active":"2024-09-17T03:01:52.306996+0000","last_became_peered":"2024-09-17T03:01:52.306996+0000","last_unstale":"2024-09-17T03:01:54.425965+0000","last_undegraded":"2024-09-17T03:01:54.425965+0000","last_fullsized":"2024-09-17T03:01:54.425965+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:23.461762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295465+0000","last_change":"2024-09-17T03:01:53.304003+0000","last_active":"2024-09-17T03:01:54.295465+0000","last_peered":"2024-09-17T03:01:54.295465+0000","last_clean":"2024-09-17T03:01:54.295465+0000","last_became_active":"2024-09-17T03:01:53.303629+0000","last_became_peered":"2024-09-17T03:01:53.303629+0000","last_unstale":"2024-09-17T03:01:54.295465+0000","last_undegraded":"2024-09-17T03:01:54.295465+0000","last_fullsized":"2024-09-17T03:01:54.295465+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:03.226496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425839+0000","last_change":"2024-09-17T03:01:52.302691+0000","last_active":"2024-09-17T03:01:54.425839+0000","last_peered":"2024-09-17T03:01:54.425839+0000","last_clean":"2024-09-17T03:01:54.425839+0000","last_became_active":"2024-09-17T03:01:52.301934+0000","last_became_peered":"2024-09-17T03:01:52.301934+0000","last_unstale":"2024-09-17T03:01:54.425839+0000","last_undegraded":"2024-09-17T03:01:54.425839+0000","last_fullsized":"2024-09-17T03:01:54.425839+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:44.994618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.291904+0000","last_change":"2024-09-17T03:01:53.308062+0000","last_active":"2024-09-17T03:01:54.291904+0000","last_peered":"2024-09-17T03:01:54.291904+0000","last_clean":"2024-09-17T03:01:54.291904+0000","last_became_active":"2024-09-17T03:01:53.307748+0000","last_became_peered":"2024-09-17T03:01:53.307748+0000","last_unstale":"2024-09-17T03:01:54.291904+0000","last_undegraded":"2024-09-17T03:01:54.291904+0000","last_fullsized":"2024-09-17T03:01:54.291904+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:28.683613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427290+0000","last_change":"2024-09-17T03:01:52.305460+0000","last_active":"2024-09-17T03:01:54.427290+0000","last_peered":"2024-09-17T03:01:54.427290+0000","last_clean":"2024-09-17T03:01:54.427290+0000","last_became_active":"2024-09-17T03:01:52.305143+0000","last_became_peered":"2024-09-17T03:01:52.305143+0000","last_unstale":"2024-09-17T03:01:54.427290+0000","last_undegraded":"2024-09-17T03:01:54.427290+0000","last_fullsized":"2024-09-17T03:01:54.427290+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:48.734469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425529+0000","last_change":"2024-09-17T03:01:53.312584+0000","last_active":"2024-09-17T03:01:54.425529+0000","last_peered":"2024-09-17T03:01:54.425529+0000","last_clean":"2024-09-17T03:01:54.425529+0000","last_became_active":"2024-09-17T03:01:53.310337+0000","last_became_peered":"2024-09-17T03:01:53.310337+0000","last_unstale":"2024-09-17T03:01:54.425529+0000","last_undegraded":"2024-09-17T03:01:54.425529+0000","last_fullsized":"2024-09-17T03:01:54.425529+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:11.078501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292037+0000","last_change":"2024-09-17T03:01:52.302201+0000","last_active":"2024-09-17T03:01:54.292037+0000","last_peered":"2024-09-17T03:01:54.292037+0000","last_clean":"2024-09-17T03:01:54.292037+0000","last_became_active":"2024-09-17T03:01:52.300845+0000","last_became_peered":"2024-09-17T03:01:52.300845+0000","last_unstale":"2024-09-17T03:01:54.292037+0000","last_undegraded":"2024-09-17T03:01:54.292037+0000","last_fullsized":"2024-09-17T03:01:54.292037+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:04.343358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426587+0000","last_change":"2024-09-17T03:01:53.299585+0000","last_active":"2024-09-17T03:01:54.426587+0000","last_peered":"2024-09-17T03:01:54.426587+0000","last_clean":"2024-09-17T03:01:54.426587+0000","last_became_active":"2024-09-17T03:01:53.298052+0000","last_became_peered":"2024-09-17T03:01:53.298052+0000","last_unstale":"2024-09-17T03:01:54.426587+0000","last_undegraded":"2024-09-17T03:01:54.426587+0000","last_fullsized":"2024-09-17T03:01:54.426587+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:37.715357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427555+0000","last_change":"2024-09-17T03:01:52.302306+0000","last_active":"2024-09-17T03:01:54.427555+0000","last_peered":"2024-09-17T03:01:54.427555+0000","last_clean":"2024-09-17T03:01:54.427555+0000","last_became_active":"2024-09-17T03:01:52.301398+0000","last_became_peered":"2024-09-17T03:01:52.301398+0000","last_unstale":"2024-09-17T03:01:54.427555+0000","last_undegraded":"2024-09-17T03:01:54.427555+0000","last_fullsized":"2024-09-17T03:01:54.427555+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:28.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425376+0000","last_change":"2024-09-17T03:01:53.302067+0000","last_active":"2024-09-17T03:01:54.425376+0000","last_peered":"2024-09-17T03:01:54.425376+0000","last_clean":"2024-09-17T03:01:54.425376+0000","last_became_active":"2024-09-17T03:01:53.301818+0000","last_became_peered":"2024-09-17T03:01:53.301818+0000","last_unstale":"2024-09-17T03:01:54.425376+0000","last_undegraded":"2024-09-17T03:01:54.425376+0000","last_fullsized":"2024-09-17T03:01:54.425376+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:27.911972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425418+0000","last_change":"2024-09-17T03:01:52.298846+0000","last_active":"2024-09-17T03:01:54.425418+0000","last_peered":"2024-09-17T03:01:54.425418+0000","last_clean":"2024-09-17T03:01:54.425418+0000","last_became_active":"2024-09-17T03:01:52.298408+0000","last_became_peered":"2024-09-17T03:01:52.298408+0000","last_unstale":"2024-09-17T03:01:54.425418+0000","last_undegraded":"2024-09-17T03:01:54.425418+0000","last_fullsized":"2024-09-17T03:01:54.425418+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:30.088914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292595+0000","last_change":"2024-09-17T03:01:53.308596+0000","last_active":"2024-09-17T03:01:54.292595+0000","last_peered":"2024-09-17T03:01:54.292595+0000","last_clean":"2024-09-17T03:01:54.292595+0000","last_became_active":"2024-09-17T03:01:53.306753+0000","last_became_peered":"2024-09-17T03:01:53.306753+0000","last_unstale":"2024-09-17T03:01:54.292595+0000","last_undegraded":"2024-09-17T03:01:54.292595+0000","last_fullsized":"2024-09-17T03:01:54.292595+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:44.569633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292603+0000","last_change":"2024-09-17T03:01:52.301250+0000","last_active":"2024-09-17T03:01:54.292603+0000","last_peered":"2024-09-17T03:01:54.292603+0000","last_clean":"2024-09-17T03:01:54.292603+0000","last_became_active":"2024-09-17T03:01:52.300821+0000","last_became_peered":"2024-09-17T03:01:52.300821+0000","last_unstale":"2024-09-17T03:01:54.292603+0000","last_undegraded":"2024-09-17T03:01:54.292603+0000","last_fullsized":"2024-09-17T03:01:54.292603+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:33.795828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":372,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292246+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:01:54.292246+0000","last_peered":"2024-09-17T03:01:54.292246+0000","last_clean":"2024-09-17T03:01:54.292246+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:01:54.292246+0000","last_undegraded":"2024-09-17T03:01:54.292246+0000","last_fullsized":"2024-09-17T03:01:54.292246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193903,"statfs":{"total":200000000,"available":198557142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194480,"statfs":{"total":200000000,"available":199148148,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199149648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199149690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199149600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199149760,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1406,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193905,"statfs":{"total":200000000,"available":198559392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:02:00.755 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:02:00.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.885+0000 7fdb2624a640 1 -- 172.21.15.104:0/2241035247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb08004d40 msgr2=0x7fdb08005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:00.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.885+0000 7fdb2624a640 1 --2- 172.21.15.104:0/2241035247 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb08004d40 0x7fdb08005150 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fdb200d2870 tx=0x7fdb08005830 comp rx=0 tx=0).stop 2024-09-17T03:02:00.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.885+0000 7fdb1ffff640 1 -- 172.21.15.104:0/2241035247 reap_dead start 2024-09-17T03:02:00.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.885+0000 7fdb2624a640 1 -- 172.21.15.104:0/2241035247 shutdown_connections 2024-09-17T03:02:00.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.885+0000 7fdb2624a640 1 -- 172.21.15.104:0/2241035247 >> 172.21.15.104:0/2241035247 conn(0x7fdb200d28a0 msgr2=0x7fdb200d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:00.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.885+0000 7fdb2624a640 1 -- 172.21.15.104:0/2241035247 shutdown_connections 2024-09-17T03:02:00.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.885+0000 7fdb2624a640 1 -- 172.21.15.104:0/2241035247 wait complete. 2024-09-17T03:02:00.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.886+0000 7fdb2624a640 1 Processor -- start 2024-09-17T03:02:00.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.887+0000 7fdb2624a640 1 -- start start 2024-09-17T03:02:00.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb2624a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb2009d8f0 0x7fdb200b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb2624a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb201e3f40 0x7fdb200b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb2624a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb200b0ba0 0x7fdb200b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb2624a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdb200b3560 con 0x7fdb2009d8f0 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb2624a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdb200cfce0 con 0x7fdb200b0ba0 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb2624a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdb200cde90 con 0x7fdb201e3f40 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb2009d8f0 0x7fdb200b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb2009d8f0 0x7fdb200b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50202/0 (socket says 172.21.15.104:50202) 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1f7fe640 1 -- 172.21.15.104:0/3421037883 learned_addr learned my addr 172.21.15.104:0/3421037883 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1effd640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb201e3f40 0x7fdb200b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1ffff640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb200b0ba0 0x7fdb200b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1f7fe640 1 -- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb201e3f40 msgr2=0x7fdb200b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:00.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1f7fe640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb201e3f40 0x7fdb200b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1f7fe640 1 -- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb200b0ba0 msgr2=0x7fdb200b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1f7fe640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb200b0ba0 0x7fdb200b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.888+0000 7fdb1f7fe640 1 -- 172.21.15.104:0/3421037883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2009c850 con 0x7fdb2009d8f0 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.889+0000 7fdb1f7fe640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb2009d8f0 0x7fdb200b2950 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fdb10011ae0 tx=0x7fdb10011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.889+0000 7fdb07fff640 1 -- 172.21.15.104:0/3421037883 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1000fe70 con 0x7fdb2009d8f0 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.889+0000 7fdb07fff640 1 -- 172.21.15.104:0/3421037883 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb10004030 con 0x7fdb2009d8f0 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.889+0000 7fdb07fff640 1 -- 172.21.15.104:0/3421037883 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10004480 con 0x7fdb2009d8f0 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.889+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2009cb30 con 0x7fdb2009d8f0 2024-09-17T03:02:00.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.889+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2009d0f0 con 0x7fdb2009d8f0 2024-09-17T03:02:00.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.890+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb200ce420 con 0x7fdb2009d8f0 2024-09-17T03:02:00.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.891+0000 7fdb07fff640 1 -- 172.21.15.104:0/3421037883 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb100035f0 con 0x7fdb2009d8f0 2024-09-17T03:02:00.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.891+0000 7fdb07fff640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb0c078b90 0x7fdb0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:00.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.891+0000 7fdb07fff640 1 -- 172.21.15.104:0/3421037883 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fdb1009ba10 con 0x7fdb2009d8f0 2024-09-17T03:02:00.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.891+0000 7fdb1effd640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb0c078b90 0x7fdb0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:00.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.892+0000 7fdb1effd640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb0c078b90 0x7fdb0c07b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009cd0 tx=0x7fdb14005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:00.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:00.896+0000 7fdb07fff640 1 -- 172.21.15.104:0/3421037883 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdb10063810 con 0x7fdb2009d8f0 2024-09-17T03:02:01.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.067+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb201e96f0 con 0x7fdb0c078b90 2024-09-17T03:02:01.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.072+0000 7fdb07fff640 1 -- 172.21.15.104:0/3421037883 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7fdb1405d8c0 con 0x7fdb0c078b90 2024-09-17T03:02:01.073 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:02:01.074 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb0c078b90 msgr2=0x7fdb0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb0c078b90 0x7fdb0c07b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009cd0 tx=0x7fdb14005f90 comp rx=0 tx=0).stop 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb2009d8f0 msgr2=0x7fdb200b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb2009d8f0 0x7fdb200b2950 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fdb10011ae0 tx=0x7fdb10011ee0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 shutdown_connections 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdb0c078b90 0x7fdb0c07b0a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb200b0ba0 0x7fdb200b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb201e3f40 0x7fdb200b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 --2- 172.21.15.104:0/3421037883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdb2009d8f0 0x7fdb200b2950 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 >> 172.21.15.104:0/3421037883 conn(0x7fdb200d28a0 msgr2=0x7fdb20075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:01.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 shutdown_connections 2024-09-17T03:02:01.077 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.075+0000 7fdb2624a640 1 -- 172.21.15.104:0/3421037883 wait complete. 2024-09-17T03:02:01.085 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2024-09-17T03:01:59.731901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":178,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7800,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554699,"statfs":{"total":1600000000,"available":1592012524,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.438215"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426926+0000","last_change":"2024-09-17T03:01:53.306340+0000","last_active":"2024-09-17T03:01:54.426926+0000","last_peered":"2024-09-17T03:01:54.426926+0000","last_clean":"2024-09-17T03:01:54.426926+0000","last_became_active":"2024-09-17T03:01:53.305959+0000","last_became_peered":"2024-09-17T03:01:53.305959+0000","last_unstale":"2024-09-17T03:01:54.426926+0000","last_undegraded":"2024-09-17T03:01:54.426926+0000","last_fullsized":"2024-09-17T03:01:54.426926+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:53.388811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426317+0000","last_change":"2024-09-17T03:01:53.300617+0000","last_active":"2024-09-17T03:01:54.426317+0000","last_peered":"2024-09-17T03:01:54.426317+0000","last_clean":"2024-09-17T03:01:54.426317+0000","last_became_active":"2024-09-17T03:01:53.300365+0000","last_became_peered":"2024-09-17T03:01:53.300365+0000","last_unstale":"2024-09-17T03:01:54.426317+0000","last_undegraded":"2024-09-17T03:01:54.426317+0000","last_fullsized":"2024-09-17T03:01:54.426317+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:53.687930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295008+0000","last_change":"2024-09-17T03:01:53.300948+0000","last_active":"2024-09-17T03:01:54.295008+0000","last_peered":"2024-09-17T03:01:54.295008+0000","last_clean":"2024-09-17T03:01:54.295008+0000","last_became_active":"2024-09-17T03:01:53.300463+0000","last_became_peered":"2024-09-17T03:01:53.300463+0000","last_unstale":"2024-09-17T03:01:54.295008+0000","last_undegraded":"2024-09-17T03:01:54.295008+0000","last_fullsized":"2024-09-17T03:01:54.295008+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:01.180342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425222+0000","last_change":"2024-09-17T03:01:53.303950+0000","last_active":"2024-09-17T03:01:54.425222+0000","last_peered":"2024-09-17T03:01:54.425222+0000","last_clean":"2024-09-17T03:01:54.425222+0000","last_became_active":"2024-09-17T03:01:53.303701+0000","last_became_peered":"2024-09-17T03:01:53.303701+0000","last_unstale":"2024-09-17T03:01:54.425222+0000","last_undegraded":"2024-09-17T03:01:54.425222+0000","last_fullsized":"2024-09-17T03:01:54.425222+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:33.412409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292402+0000","last_change":"2024-09-17T03:01:53.309032+0000","last_active":"2024-09-17T03:01:54.292402+0000","last_peered":"2024-09-17T03:01:54.292402+0000","last_clean":"2024-09-17T03:01:54.292402+0000","last_became_active":"2024-09-17T03:01:53.308736+0000","last_became_peered":"2024-09-17T03:01:53.308736+0000","last_unstale":"2024-09-17T03:01:54.292402+0000","last_undegraded":"2024-09-17T03:01:54.292402+0000","last_fullsized":"2024-09-17T03:01:54.292402+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:26.807681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296627+0000","last_change":"2024-09-17T03:01:53.304588+0000","last_active":"2024-09-17T03:01:54.296627+0000","last_peered":"2024-09-17T03:01:54.296627+0000","last_clean":"2024-09-17T03:01:54.296627+0000","last_became_active":"2024-09-17T03:01:53.304215+0000","last_became_peered":"2024-09-17T03:01:53.304215+0000","last_unstale":"2024-09-17T03:01:54.296627+0000","last_undegraded":"2024-09-17T03:01:54.296627+0000","last_fullsized":"2024-09-17T03:01:54.296627+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:06.695317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295547+0000","last_change":"2024-09-17T03:01:53.297424+0000","last_active":"2024-09-17T03:01:54.295547+0000","last_peered":"2024-09-17T03:01:54.295547+0000","last_clean":"2024-09-17T03:01:54.295547+0000","last_became_active":"2024-09-17T03:01:53.297195+0000","last_became_peered":"2024-09-17T03:01:53.297195+0000","last_unstale":"2024-09-17T03:01:54.295547+0000","last_undegraded":"2024-09-17T03:01:54.295547+0000","last_fullsized":"2024-09-17T03:01:54.295547+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:14.501782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295283+0000","last_change":"2024-09-17T03:01:53.302271+0000","last_active":"2024-09-17T03:01:54.295283+0000","last_peered":"2024-09-17T03:01:54.295283+0000","last_clean":"2024-09-17T03:01:54.295283+0000","last_became_active":"2024-09-17T03:01:53.301965+0000","last_became_peered":"2024-09-17T03:01:53.301965+0000","last_unstale":"2024-09-17T03:01:54.295283+0000","last_undegraded":"2024-09-17T03:01:54.295283+0000","last_fullsized":"2024-09-17T03:01:54.295283+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:49.538513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295905+0000","last_change":"2024-09-17T03:01:53.308217+0000","last_active":"2024-09-17T03:01:54.295905+0000","last_peered":"2024-09-17T03:01:54.295905+0000","last_clean":"2024-09-17T03:01:54.295905+0000","last_became_active":"2024-09-17T03:01:53.307697+0000","last_became_peered":"2024-09-17T03:01:53.307697+0000","last_unstale":"2024-09-17T03:01:54.295905+0000","last_undegraded":"2024-09-17T03:01:54.295905+0000","last_fullsized":"2024-09-17T03:01:54.295905+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:32.822529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427400+0000","last_change":"2024-09-17T03:01:53.310079+0000","last_active":"2024-09-17T03:01:54.427400+0000","last_peered":"2024-09-17T03:01:54.427400+0000","last_clean":"2024-09-17T03:01:54.427400+0000","last_became_active":"2024-09-17T03:01:53.309807+0000","last_became_peered":"2024-09-17T03:01:53.309807+0000","last_unstale":"2024-09-17T03:01:54.427400+0000","last_undegraded":"2024-09-17T03:01:54.427400+0000","last_fullsized":"2024-09-17T03:01:54.427400+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:33.045092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426682+0000","last_change":"2024-09-17T03:01:53.309911+0000","last_active":"2024-09-17T03:01:54.426682+0000","last_peered":"2024-09-17T03:01:54.426682+0000","last_clean":"2024-09-17T03:01:54.426682+0000","last_became_active":"2024-09-17T03:01:53.309626+0000","last_became_peered":"2024-09-17T03:01:53.309626+0000","last_unstale":"2024-09-17T03:01:54.426682+0000","last_undegraded":"2024-09-17T03:01:54.426682+0000","last_fullsized":"2024-09-17T03:01:54.426682+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:37.804052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296607+0000","last_change":"2024-09-17T03:01:53.311000+0000","last_active":"2024-09-17T03:01:54.296607+0000","last_peered":"2024-09-17T03:01:54.296607+0000","last_clean":"2024-09-17T03:01:54.296607+0000","last_became_active":"2024-09-17T03:01:53.310690+0000","last_became_peered":"2024-09-17T03:01:53.310690+0000","last_unstale":"2024-09-17T03:01:54.296607+0000","last_undegraded":"2024-09-17T03:01:54.296607+0000","last_fullsized":"2024-09-17T03:01:54.296607+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:55.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426183+0000","last_change":"2024-09-17T03:01:53.306783+0000","last_active":"2024-09-17T03:01:54.426183+0000","last_peered":"2024-09-17T03:01:54.426183+0000","last_clean":"2024-09-17T03:01:54.426183+0000","last_became_active":"2024-09-17T03:01:53.306288+0000","last_became_peered":"2024-09-17T03:01:53.306288+0000","last_unstale":"2024-09-17T03:01:54.426183+0000","last_undegraded":"2024-09-17T03:01:54.426183+0000","last_fullsized":"2024-09-17T03:01:54.426183+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:25.421022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425683+0000","last_change":"2024-09-17T03:01:53.311037+0000","last_active":"2024-09-17T03:01:54.425683+0000","last_peered":"2024-09-17T03:01:54.425683+0000","last_clean":"2024-09-17T03:01:54.425683+0000","last_became_active":"2024-09-17T03:01:53.310815+0000","last_became_peered":"2024-09-17T03:01:53.310815+0000","last_unstale":"2024-09-17T03:01:54.425683+0000","last_undegraded":"2024-09-17T03:01:54.425683+0000","last_fullsized":"2024-09-17T03:01:54.425683+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:13.612677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426284+0000","last_change":"2024-09-17T03:01:53.309489+0000","last_active":"2024-09-17T03:01:54.426284+0000","last_peered":"2024-09-17T03:01:54.426284+0000","last_clean":"2024-09-17T03:01:54.426284+0000","last_became_active":"2024-09-17T03:01:53.308816+0000","last_became_peered":"2024-09-17T03:01:53.308816+0000","last_unstale":"2024-09-17T03:01:54.426284+0000","last_undegraded":"2024-09-17T03:01:54.426284+0000","last_fullsized":"2024-09-17T03:01:54.426284+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:59.794342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426052+0000","last_change":"2024-09-17T03:01:53.306965+0000","last_active":"2024-09-17T03:01:54.426052+0000","last_peered":"2024-09-17T03:01:54.426052+0000","last_clean":"2024-09-17T03:01:54.426052+0000","last_became_active":"2024-09-17T03:01:53.306353+0000","last_became_peered":"2024-09-17T03:01:53.306353+0000","last_unstale":"2024-09-17T03:01:54.426052+0000","last_undegraded":"2024-09-17T03:01:54.426052+0000","last_fullsized":"2024-09-17T03:01:54.426052+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:40.498146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296020+0000","last_change":"2024-09-17T03:01:53.295548+0000","last_active":"2024-09-17T03:01:54.296020+0000","last_peered":"2024-09-17T03:01:54.296020+0000","last_clean":"2024-09-17T03:01:54.296020+0000","last_became_active":"2024-09-17T03:01:53.295122+0000","last_became_peered":"2024-09-17T03:01:53.295122+0000","last_unstale":"2024-09-17T03:01:54.296020+0000","last_undegraded":"2024-09-17T03:01:54.296020+0000","last_fullsized":"2024-09-17T03:01:54.296020+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:02.609787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427242+0000","last_change":"2024-09-17T03:01:53.301620+0000","last_active":"2024-09-17T03:01:54.427242+0000","last_peered":"2024-09-17T03:01:54.427242+0000","last_clean":"2024-09-17T03:01:54.427242+0000","last_became_active":"2024-09-17T03:01:53.300991+0000","last_became_peered":"2024-09-17T03:01:53.300991+0000","last_unstale":"2024-09-17T03:01:54.427242+0000","last_undegraded":"2024-09-17T03:01:54.427242+0000","last_fullsized":"2024-09-17T03:01:54.427242+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:14.448060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425144+0000","last_change":"2024-09-17T03:01:53.293922+0000","last_active":"2024-09-17T03:01:54.425144+0000","last_peered":"2024-09-17T03:01:54.425144+0000","last_clean":"2024-09-17T03:01:54.425144+0000","last_became_active":"2024-09-17T03:01:53.293585+0000","last_became_peered":"2024-09-17T03:01:53.293585+0000","last_unstale":"2024-09-17T03:01:54.425144+0000","last_undegraded":"2024-09-17T03:01:54.425144+0000","last_fullsized":"2024-09-17T03:01:54.425144+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:50.239446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425264+0000","last_change":"2024-09-17T03:01:53.310106+0000","last_active":"2024-09-17T03:01:54.425264+0000","last_peered":"2024-09-17T03:01:54.425264+0000","last_clean":"2024-09-17T03:01:54.425264+0000","last_became_active":"2024-09-17T03:01:53.309860+0000","last_became_peered":"2024-09-17T03:01:53.309860+0000","last_unstale":"2024-09-17T03:01:54.425264+0000","last_undegraded":"2024-09-17T03:01:54.425264+0000","last_fullsized":"2024-09-17T03:01:54.425264+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:05.896796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.291985+0000","last_change":"2024-09-17T03:01:53.312423+0000","last_active":"2024-09-17T03:01:54.291985+0000","last_peered":"2024-09-17T03:01:54.291985+0000","last_clean":"2024-09-17T03:01:54.291985+0000","last_became_active":"2024-09-17T03:01:53.312146+0000","last_became_peered":"2024-09-17T03:01:53.312146+0000","last_unstale":"2024-09-17T03:01:54.291985+0000","last_undegraded":"2024-09-17T03:01:54.291985+0000","last_fullsized":"2024-09-17T03:01:54.291985+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:28.373671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425475+0000","last_change":"2024-09-17T03:01:53.299102+0000","last_active":"2024-09-17T03:01:54.425475+0000","last_peered":"2024-09-17T03:01:54.425475+0000","last_clean":"2024-09-17T03:01:54.425475+0000","last_became_active":"2024-09-17T03:01:53.298862+0000","last_became_peered":"2024-09-17T03:01:53.298862+0000","last_unstale":"2024-09-17T03:01:54.425475+0000","last_undegraded":"2024-09-17T03:01:54.425475+0000","last_fullsized":"2024-09-17T03:01:54.425475+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:25.972057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295671+0000","last_change":"2024-09-17T03:01:53.309748+0000","last_active":"2024-09-17T03:01:54.295671+0000","last_peered":"2024-09-17T03:01:54.295671+0000","last_clean":"2024-09-17T03:01:54.295671+0000","last_became_active":"2024-09-17T03:01:53.309439+0000","last_became_peered":"2024-09-17T03:01:53.309439+0000","last_unstale":"2024-09-17T03:01:54.295671+0000","last_undegraded":"2024-09-17T03:01:54.295671+0000","last_fullsized":"2024-09-17T03:01:54.295671+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:16.354114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425356+0000","last_change":"2024-09-17T03:01:53.310896+0000","last_active":"2024-09-17T03:01:54.425356+0000","last_peered":"2024-09-17T03:01:54.425356+0000","last_clean":"2024-09-17T03:01:54.425356+0000","last_became_active":"2024-09-17T03:01:53.308991+0000","last_became_peered":"2024-09-17T03:01:53.308991+0000","last_unstale":"2024-09-17T03:01:54.425356+0000","last_undegraded":"2024-09-17T03:01:54.425356+0000","last_fullsized":"2024-09-17T03:01:54.425356+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:59.262579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427110+0000","last_change":"2024-09-17T03:01:53.305314+0000","last_active":"2024-09-17T03:01:54.427110+0000","last_peered":"2024-09-17T03:01:54.427110+0000","last_clean":"2024-09-17T03:01:54.427110+0000","last_became_active":"2024-09-17T03:01:53.305028+0000","last_became_peered":"2024-09-17T03:01:53.305028+0000","last_unstale":"2024-09-17T03:01:54.427110+0000","last_undegraded":"2024-09-17T03:01:54.427110+0000","last_fullsized":"2024-09-17T03:01:54.427110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:29.995013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426275+0000","last_change":"2024-09-17T03:01:53.307991+0000","last_active":"2024-09-17T03:01:54.426275+0000","last_peered":"2024-09-17T03:01:54.426275+0000","last_clean":"2024-09-17T03:01:54.426275+0000","last_became_active":"2024-09-17T03:01:53.306677+0000","last_became_peered":"2024-09-17T03:01:53.306677+0000","last_unstale":"2024-09-17T03:01:54.426275+0000","last_undegraded":"2024-09-17T03:01:54.426275+0000","last_fullsized":"2024-09-17T03:01:54.426275+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:35.967649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425205+0000","last_change":"2024-09-17T03:01:53.300084+0000","last_active":"2024-09-17T03:01:54.425205+0000","last_peered":"2024-09-17T03:01:54.425205+0000","last_clean":"2024-09-17T03:01:54.425205+0000","last_became_active":"2024-09-17T03:01:53.299312+0000","last_became_peered":"2024-09-17T03:01:53.299312+0000","last_unstale":"2024-09-17T03:01:54.425205+0000","last_undegraded":"2024-09-17T03:01:54.425205+0000","last_fullsized":"2024-09-17T03:01:54.425205+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:09:48.585798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425389+0000","last_change":"2024-09-17T03:01:53.309544+0000","last_active":"2024-09-17T03:01:54.425389+0000","last_peered":"2024-09-17T03:01:54.425389+0000","last_clean":"2024-09-17T03:01:54.425389+0000","last_became_active":"2024-09-17T03:01:53.309093+0000","last_became_peered":"2024-09-17T03:01:53.309093+0000","last_unstale":"2024-09-17T03:01:54.425389+0000","last_undegraded":"2024-09-17T03:01:54.425389+0000","last_fullsized":"2024-09-17T03:01:54.425389+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:35.979315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425522+0000","last_change":"2024-09-17T03:01:53.302355+0000","last_active":"2024-09-17T03:01:54.425522+0000","last_peered":"2024-09-17T03:01:54.425522+0000","last_clean":"2024-09-17T03:01:54.425522+0000","last_became_active":"2024-09-17T03:01:53.302088+0000","last_became_peered":"2024-09-17T03:01:53.302088+0000","last_unstale":"2024-09-17T03:01:54.425522+0000","last_undegraded":"2024-09-17T03:01:54.425522+0000","last_fullsized":"2024-09-17T03:01:54.425522+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:58.697927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426497+0000","last_change":"2024-09-17T03:01:53.309830+0000","last_active":"2024-09-17T03:01:54.426497+0000","last_peered":"2024-09-17T03:01:54.426497+0000","last_clean":"2024-09-17T03:01:54.426497+0000","last_became_active":"2024-09-17T03:01:53.309159+0000","last_became_peered":"2024-09-17T03:01:53.309159+0000","last_unstale":"2024-09-17T03:01:54.426497+0000","last_undegraded":"2024-09-17T03:01:54.426497+0000","last_fullsized":"2024-09-17T03:01:54.426497+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:39.893593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292255+0000","last_change":"2024-09-17T03:01:53.307019+0000","last_active":"2024-09-17T03:01:54.292255+0000","last_peered":"2024-09-17T03:01:54.292255+0000","last_clean":"2024-09-17T03:01:54.292255+0000","last_became_active":"2024-09-17T03:01:53.306420+0000","last_became_peered":"2024-09-17T03:01:53.306420+0000","last_unstale":"2024-09-17T03:01:54.292255+0000","last_undegraded":"2024-09-17T03:01:54.292255+0000","last_fullsized":"2024-09-17T03:01:54.292255+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:21.972537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295781+0000","last_change":"2024-09-17T03:01:53.301298+0000","last_active":"2024-09-17T03:01:54.295781+0000","last_peered":"2024-09-17T03:01:54.295781+0000","last_clean":"2024-09-17T03:01:54.295781+0000","last_became_active":"2024-09-17T03:01:53.300929+0000","last_became_peered":"2024-09-17T03:01:53.300929+0000","last_unstale":"2024-09-17T03:01:54.295781+0000","last_undegraded":"2024-09-17T03:01:54.295781+0000","last_fullsized":"2024-09-17T03:01:54.295781+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:30.910526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426361+0000","last_change":"2024-09-17T03:01:53.304941+0000","last_active":"2024-09-17T03:01:54.426361+0000","last_peered":"2024-09-17T03:01:54.426361+0000","last_clean":"2024-09-17T03:01:54.426361+0000","last_became_active":"2024-09-17T03:01:53.304527+0000","last_became_peered":"2024-09-17T03:01:53.304527+0000","last_unstale":"2024-09-17T03:01:54.426361+0000","last_undegraded":"2024-09-17T03:01:54.426361+0000","last_fullsized":"2024-09-17T03:01:54.426361+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:58.639975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"152'4","reported_seq":19,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292086+0000","last_change":"2024-09-17T03:01:52.303205+0000","last_active":"2024-09-17T03:01:54.292086+0000","last_peered":"2024-09-17T03:01:54.292086+0000","last_clean":"2024-09-17T03:01:54.292086+0000","last_became_active":"2024-09-17T03:01:52.302889+0000","last_became_peered":"2024-09-17T03:01:52.302889+0000","last_unstale":"2024-09-17T03:01:54.292086+0000","last_undegraded":"2024-09-17T03:01:54.292086+0000","last_fullsized":"2024-09-17T03:01:54.292086+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:38.825647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295910+0000","last_change":"2024-09-17T03:01:53.305574+0000","last_active":"2024-09-17T03:01:54.295910+0000","last_peered":"2024-09-17T03:01:54.295910+0000","last_clean":"2024-09-17T03:01:54.295910+0000","last_became_active":"2024-09-17T03:01:53.305093+0000","last_became_peered":"2024-09-17T03:01:53.305093+0000","last_unstale":"2024-09-17T03:01:54.295910+0000","last_undegraded":"2024-09-17T03:01:54.295910+0000","last_fullsized":"2024-09-17T03:01:54.295910+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:35.246436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425402+0000","last_change":"2024-09-17T03:01:52.304330+0000","last_active":"2024-09-17T03:01:54.425402+0000","last_peered":"2024-09-17T03:01:54.425402+0000","last_clean":"2024-09-17T03:01:54.425402+0000","last_became_active":"2024-09-17T03:01:52.303598+0000","last_became_peered":"2024-09-17T03:01:52.303598+0000","last_unstale":"2024-09-17T03:01:54.425402+0000","last_undegraded":"2024-09-17T03:01:54.425402+0000","last_fullsized":"2024-09-17T03:01:54.425402+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:19.538876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292436+0000","last_change":"2024-09-17T03:01:53.311577+0000","last_active":"2024-09-17T03:01:54.292436+0000","last_peered":"2024-09-17T03:01:54.292436+0000","last_clean":"2024-09-17T03:01:54.292436+0000","last_became_active":"2024-09-17T03:01:53.309020+0000","last_became_peered":"2024-09-17T03:01:53.309020+0000","last_unstale":"2024-09-17T03:01:54.292436+0000","last_undegraded":"2024-09-17T03:01:54.292436+0000","last_fullsized":"2024-09-17T03:01:54.292436+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:39:22.231258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425617+0000","last_change":"2024-09-17T03:01:52.296300+0000","last_active":"2024-09-17T03:01:54.425617+0000","last_peered":"2024-09-17T03:01:54.425617+0000","last_clean":"2024-09-17T03:01:54.425617+0000","last_became_active":"2024-09-17T03:01:52.295954+0000","last_became_peered":"2024-09-17T03:01:52.295954+0000","last_unstale":"2024-09-17T03:01:54.425617+0000","last_undegraded":"2024-09-17T03:01:54.425617+0000","last_fullsized":"2024-09-17T03:01:54.425617+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:27.882613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292555+0000","last_change":"2024-09-17T03:01:53.313729+0000","last_active":"2024-09-17T03:01:54.292555+0000","last_peered":"2024-09-17T03:01:54.292555+0000","last_clean":"2024-09-17T03:01:54.292555+0000","last_became_active":"2024-09-17T03:01:53.313081+0000","last_became_peered":"2024-09-17T03:01:53.313081+0000","last_unstale":"2024-09-17T03:01:54.292555+0000","last_undegraded":"2024-09-17T03:01:54.292555+0000","last_fullsized":"2024-09-17T03:01:54.292555+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:16.810724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426947+0000","last_change":"2024-09-17T03:01:52.304836+0000","last_active":"2024-09-17T03:01:54.426947+0000","last_peered":"2024-09-17T03:01:54.426947+0000","last_clean":"2024-09-17T03:01:54.426947+0000","last_became_active":"2024-09-17T03:01:52.304573+0000","last_became_peered":"2024-09-17T03:01:52.304573+0000","last_unstale":"2024-09-17T03:01:54.426947+0000","last_undegraded":"2024-09-17T03:01:54.426947+0000","last_fullsized":"2024-09-17T03:01:54.426947+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:39.705145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427448+0000","last_change":"2024-09-17T03:01:53.302092+0000","last_active":"2024-09-17T03:01:54.427448+0000","last_peered":"2024-09-17T03:01:54.427448+0000","last_clean":"2024-09-17T03:01:54.427448+0000","last_became_active":"2024-09-17T03:01:53.301338+0000","last_became_peered":"2024-09-17T03:01:53.301338+0000","last_unstale":"2024-09-17T03:01:54.427448+0000","last_undegraded":"2024-09-17T03:01:54.427448+0000","last_fullsized":"2024-09-17T03:01:54.427448+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:16.533035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426392+0000","last_change":"2024-09-17T03:01:52.304212+0000","last_active":"2024-09-17T03:01:54.426392+0000","last_peered":"2024-09-17T03:01:54.426392+0000","last_clean":"2024-09-17T03:01:54.426392+0000","last_became_active":"2024-09-17T03:01:52.303954+0000","last_became_peered":"2024-09-17T03:01:52.303954+0000","last_unstale":"2024-09-17T03:01:54.426392+0000","last_undegraded":"2024-09-17T03:01:54.426392+0000","last_fullsized":"2024-09-17T03:01:54.426392+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:32.435046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296249+0000","last_change":"2024-09-17T03:01:53.293757+0000","last_active":"2024-09-17T03:01:54.296249+0000","last_peered":"2024-09-17T03:01:54.296249+0000","last_clean":"2024-09-17T03:01:54.296249+0000","last_became_active":"2024-09-17T03:01:53.293415+0000","last_became_peered":"2024-09-17T03:01:53.293415+0000","last_unstale":"2024-09-17T03:01:54.296249+0000","last_undegraded":"2024-09-17T03:01:54.296249+0000","last_fullsized":"2024-09-17T03:01:54.296249+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:26.611534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427491+0000","last_change":"2024-09-17T03:01:52.300015+0000","last_active":"2024-09-17T03:01:54.427491+0000","last_peered":"2024-09-17T03:01:54.427491+0000","last_clean":"2024-09-17T03:01:54.427491+0000","last_became_active":"2024-09-17T03:01:52.299756+0000","last_became_peered":"2024-09-17T03:01:52.299756+0000","last_unstale":"2024-09-17T03:01:54.427491+0000","last_undegraded":"2024-09-17T03:01:54.427491+0000","last_fullsized":"2024-09-17T03:01:54.427491+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:49.156240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295444+0000","last_change":"2024-09-17T03:01:53.308021+0000","last_active":"2024-09-17T03:01:54.295444+0000","last_peered":"2024-09-17T03:01:54.295444+0000","last_clean":"2024-09-17T03:01:54.295444+0000","last_became_active":"2024-09-17T03:01:53.307236+0000","last_became_peered":"2024-09-17T03:01:53.307236+0000","last_unstale":"2024-09-17T03:01:54.295444+0000","last_undegraded":"2024-09-17T03:01:54.295444+0000","last_fullsized":"2024-09-17T03:01:54.295444+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:42.437943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295539+0000","last_change":"2024-09-17T03:01:52.300007+0000","last_active":"2024-09-17T03:01:54.295539+0000","last_peered":"2024-09-17T03:01:54.295539+0000","last_clean":"2024-09-17T03:01:54.295539+0000","last_became_active":"2024-09-17T03:01:52.299526+0000","last_became_peered":"2024-09-17T03:01:52.299526+0000","last_unstale":"2024-09-17T03:01:54.295539+0000","last_undegraded":"2024-09-17T03:01:54.295539+0000","last_fullsized":"2024-09-17T03:01:54.295539+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:00.746200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425901+0000","last_change":"2024-09-17T03:01:53.301417+0000","last_active":"2024-09-17T03:01:54.425901+0000","last_peered":"2024-09-17T03:01:54.425901+0000","last_clean":"2024-09-17T03:01:54.425901+0000","last_became_active":"2024-09-17T03:01:53.301160+0000","last_became_peered":"2024-09-17T03:01:53.301160+0000","last_unstale":"2024-09-17T03:01:54.425901+0000","last_undegraded":"2024-09-17T03:01:54.425901+0000","last_fullsized":"2024-09-17T03:01:54.425901+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:02.884802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427688+0000","last_change":"2024-09-17T03:01:52.307300+0000","last_active":"2024-09-17T03:01:54.427688+0000","last_peered":"2024-09-17T03:01:54.427688+0000","last_clean":"2024-09-17T03:01:54.427688+0000","last_became_active":"2024-09-17T03:01:52.307008+0000","last_became_peered":"2024-09-17T03:01:52.307008+0000","last_unstale":"2024-09-17T03:01:54.427688+0000","last_undegraded":"2024-09-17T03:01:54.427688+0000","last_fullsized":"2024-09-17T03:01:54.427688+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:26.343082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425540+0000","last_change":"2024-09-17T03:01:53.305143+0000","last_active":"2024-09-17T03:01:54.425540+0000","last_peered":"2024-09-17T03:01:54.425540+0000","last_clean":"2024-09-17T03:01:54.425540+0000","last_became_active":"2024-09-17T03:01:53.303754+0000","last_became_peered":"2024-09-17T03:01:53.303754+0000","last_unstale":"2024-09-17T03:01:54.425540+0000","last_undegraded":"2024-09-17T03:01:54.425540+0000","last_fullsized":"2024-09-17T03:01:54.425540+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:07.132099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425583+0000","last_change":"2024-09-17T03:01:52.305415+0000","last_active":"2024-09-17T03:01:54.425583+0000","last_peered":"2024-09-17T03:01:54.425583+0000","last_clean":"2024-09-17T03:01:54.425583+0000","last_became_active":"2024-09-17T03:01:52.305113+0000","last_became_peered":"2024-09-17T03:01:52.305113+0000","last_unstale":"2024-09-17T03:01:54.425583+0000","last_undegraded":"2024-09-17T03:01:54.425583+0000","last_fullsized":"2024-09-17T03:01:54.425583+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:53.477184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425337+0000","last_change":"2024-09-17T03:01:53.310674+0000","last_active":"2024-09-17T03:01:54.425337+0000","last_peered":"2024-09-17T03:01:54.425337+0000","last_clean":"2024-09-17T03:01:54.425337+0000","last_became_active":"2024-09-17T03:01:53.309966+0000","last_became_peered":"2024-09-17T03:01:53.309966+0000","last_unstale":"2024-09-17T03:01:54.425337+0000","last_undegraded":"2024-09-17T03:01:54.425337+0000","last_fullsized":"2024-09-17T03:01:54.425337+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:35.699402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425919+0000","last_change":"2024-09-17T03:01:52.307250+0000","last_active":"2024-09-17T03:01:54.425919+0000","last_peered":"2024-09-17T03:01:54.425919+0000","last_clean":"2024-09-17T03:01:54.425919+0000","last_became_active":"2024-09-17T03:01:52.306999+0000","last_became_peered":"2024-09-17T03:01:52.306999+0000","last_unstale":"2024-09-17T03:01:54.425919+0000","last_undegraded":"2024-09-17T03:01:54.425919+0000","last_fullsized":"2024-09-17T03:01:54.425919+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:53.809978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292152+0000","last_change":"2024-09-17T03:01:53.301548+0000","last_active":"2024-09-17T03:01:54.292152+0000","last_peered":"2024-09-17T03:01:54.292152+0000","last_clean":"2024-09-17T03:01:54.292152+0000","last_became_active":"2024-09-17T03:01:53.301275+0000","last_became_peered":"2024-09-17T03:01:53.301275+0000","last_unstale":"2024-09-17T03:01:54.292152+0000","last_undegraded":"2024-09-17T03:01:54.292152+0000","last_fullsized":"2024-09-17T03:01:54.292152+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:13.027685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"152'3","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425451+0000","last_change":"2024-09-17T03:01:52.306213+0000","last_active":"2024-09-17T03:01:54.425451+0000","last_peered":"2024-09-17T03:01:54.425451+0000","last_clean":"2024-09-17T03:01:54.425451+0000","last_became_active":"2024-09-17T03:01:52.305296+0000","last_became_peered":"2024-09-17T03:01:52.305296+0000","last_unstale":"2024-09-17T03:01:54.425451+0000","last_undegraded":"2024-09-17T03:01:54.425451+0000","last_fullsized":"2024-09-17T03:01:54.425451+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:33.101039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.291990+0000","last_change":"2024-09-17T03:01:53.302163+0000","last_active":"2024-09-17T03:01:54.291990+0000","last_peered":"2024-09-17T03:01:54.291990+0000","last_clean":"2024-09-17T03:01:54.291990+0000","last_became_active":"2024-09-17T03:01:53.301881+0000","last_became_peered":"2024-09-17T03:01:53.301881+0000","last_unstale":"2024-09-17T03:01:54.291990+0000","last_undegraded":"2024-09-17T03:01:54.291990+0000","last_fullsized":"2024-09-17T03:01:54.291990+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:26:41.748979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"152'6","reported_seq":21,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296163+0000","last_change":"2024-09-17T03:01:52.306378+0000","last_active":"2024-09-17T03:01:54.296163+0000","last_peered":"2024-09-17T03:01:54.296163+0000","last_clean":"2024-09-17T03:01:54.296163+0000","last_became_active":"2024-09-17T03:01:52.306022+0000","last_became_peered":"2024-09-17T03:01:52.306022+0000","last_unstale":"2024-09-17T03:01:54.296163+0000","last_undegraded":"2024-09-17T03:01:54.296163+0000","last_fullsized":"2024-09-17T03:01:54.296163+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:12.832713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426781+0000","last_change":"2024-09-17T03:01:53.305553+0000","last_active":"2024-09-17T03:01:54.426781+0000","last_peered":"2024-09-17T03:01:54.426781+0000","last_clean":"2024-09-17T03:01:54.426781+0000","last_became_active":"2024-09-17T03:01:53.304065+0000","last_became_peered":"2024-09-17T03:01:53.304065+0000","last_unstale":"2024-09-17T03:01:54.426781+0000","last_undegraded":"2024-09-17T03:01:54.426781+0000","last_fullsized":"2024-09-17T03:01:54.426781+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:12.939868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426989+0000","last_change":"2024-09-17T03:01:52.303738+0000","last_active":"2024-09-17T03:01:54.426989+0000","last_peered":"2024-09-17T03:01:54.426989+0000","last_clean":"2024-09-17T03:01:54.426989+0000","last_became_active":"2024-09-17T03:01:52.303484+0000","last_became_peered":"2024-09-17T03:01:52.303484+0000","last_unstale":"2024-09-17T03:01:54.426989+0000","last_undegraded":"2024-09-17T03:01:54.426989+0000","last_fullsized":"2024-09-17T03:01:54.426989+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:39.094292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425140+0000","last_change":"2024-09-17T03:01:53.303318+0000","last_active":"2024-09-17T03:01:54.425140+0000","last_peered":"2024-09-17T03:01:54.425140+0000","last_clean":"2024-09-17T03:01:54.425140+0000","last_became_active":"2024-09-17T03:01:53.303076+0000","last_became_peered":"2024-09-17T03:01:53.303076+0000","last_unstale":"2024-09-17T03:01:54.425140+0000","last_undegraded":"2024-09-17T03:01:54.425140+0000","last_fullsized":"2024-09-17T03:01:54.425140+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:20.571182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426513+0000","last_change":"2024-09-17T03:01:52.305015+0000","last_active":"2024-09-17T03:01:54.426513+0000","last_peered":"2024-09-17T03:01:54.426513+0000","last_clean":"2024-09-17T03:01:54.426513+0000","last_became_active":"2024-09-17T03:01:52.304751+0000","last_became_peered":"2024-09-17T03:01:52.304751+0000","last_unstale":"2024-09-17T03:01:54.426513+0000","last_undegraded":"2024-09-17T03:01:54.426513+0000","last_fullsized":"2024-09-17T03:01:54.426513+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:19.079233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296785+0000","last_change":"2024-09-17T03:01:53.308695+0000","last_active":"2024-09-17T03:01:54.296785+0000","last_peered":"2024-09-17T03:01:54.296785+0000","last_clean":"2024-09-17T03:01:54.296785+0000","last_became_active":"2024-09-17T03:01:53.308435+0000","last_became_peered":"2024-09-17T03:01:53.308435+0000","last_unstale":"2024-09-17T03:01:54.296785+0000","last_undegraded":"2024-09-17T03:01:54.296785+0000","last_fullsized":"2024-09-17T03:01:54.296785+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:32.892833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"152'8","reported_seq":23,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296008+0000","last_change":"2024-09-17T03:01:52.308068+0000","last_active":"2024-09-17T03:01:54.296008+0000","last_peered":"2024-09-17T03:01:54.296008+0000","last_clean":"2024-09-17T03:01:54.296008+0000","last_became_active":"2024-09-17T03:01:52.307607+0000","last_became_peered":"2024-09-17T03:01:52.307607+0000","last_unstale":"2024-09-17T03:01:54.296008+0000","last_undegraded":"2024-09-17T03:01:54.296008+0000","last_fullsized":"2024-09-17T03:01:54.296008+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:36.438980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295724+0000","last_change":"2024-09-17T03:01:53.309995+0000","last_active":"2024-09-17T03:01:54.295724+0000","last_peered":"2024-09-17T03:01:54.295724+0000","last_clean":"2024-09-17T03:01:54.295724+0000","last_became_active":"2024-09-17T03:01:53.307615+0000","last_became_peered":"2024-09-17T03:01:53.307615+0000","last_unstale":"2024-09-17T03:01:54.295724+0000","last_undegraded":"2024-09-17T03:01:54.295724+0000","last_fullsized":"2024-09-17T03:01:54.295724+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:41.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425496+0000","last_change":"2024-09-17T03:01:52.304632+0000","last_active":"2024-09-17T03:01:54.425496+0000","last_peered":"2024-09-17T03:01:54.425496+0000","last_clean":"2024-09-17T03:01:54.425496+0000","last_became_active":"2024-09-17T03:01:52.304029+0000","last_became_peered":"2024-09-17T03:01:52.304029+0000","last_unstale":"2024-09-17T03:01:54.425496+0000","last_undegraded":"2024-09-17T03:01:54.425496+0000","last_fullsized":"2024-09-17T03:01:54.425496+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:47.549818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425348+0000","last_change":"2024-09-17T03:01:53.310535+0000","last_active":"2024-09-17T03:01:54.425348+0000","last_peered":"2024-09-17T03:01:54.425348+0000","last_clean":"2024-09-17T03:01:54.425348+0000","last_became_active":"2024-09-17T03:01:53.310254+0000","last_became_peered":"2024-09-17T03:01:53.310254+0000","last_unstale":"2024-09-17T03:01:54.425348+0000","last_undegraded":"2024-09-17T03:01:54.425348+0000","last_fullsized":"2024-09-17T03:01:54.425348+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:59.984122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425729+0000","last_change":"2024-09-17T03:01:52.303034+0000","last_active":"2024-09-17T03:01:54.425729+0000","last_peered":"2024-09-17T03:01:54.425729+0000","last_clean":"2024-09-17T03:01:54.425729+0000","last_became_active":"2024-09-17T03:01:52.302291+0000","last_became_peered":"2024-09-17T03:01:52.302291+0000","last_unstale":"2024-09-17T03:01:54.425729+0000","last_undegraded":"2024-09-17T03:01:54.425729+0000","last_fullsized":"2024-09-17T03:01:54.425729+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:17.868010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425852+0000","last_change":"2024-09-17T03:01:53.307497+0000","last_active":"2024-09-17T03:01:54.425852+0000","last_peered":"2024-09-17T03:01:54.425852+0000","last_clean":"2024-09-17T03:01:54.425852+0000","last_became_active":"2024-09-17T03:01:53.307226+0000","last_became_peered":"2024-09-17T03:01:53.307226+0000","last_unstale":"2024-09-17T03:01:54.425852+0000","last_undegraded":"2024-09-17T03:01:54.425852+0000","last_fullsized":"2024-09-17T03:01:54.425852+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:12.221781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"152'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296806+0000","last_change":"2024-09-17T03:01:52.302525+0000","last_active":"2024-09-17T03:01:54.296806+0000","last_peered":"2024-09-17T03:01:54.296806+0000","last_clean":"2024-09-17T03:01:54.296806+0000","last_became_active":"2024-09-17T03:01:52.302011+0000","last_became_peered":"2024-09-17T03:01:52.302011+0000","last_unstale":"2024-09-17T03:01:54.296806+0000","last_undegraded":"2024-09-17T03:01:54.296806+0000","last_fullsized":"2024-09-17T03:01:54.296806+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:51.323047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427224+0000","last_change":"2024-09-17T03:01:53.308214+0000","last_active":"2024-09-17T03:01:54.427224+0000","last_peered":"2024-09-17T03:01:54.427224+0000","last_clean":"2024-09-17T03:01:54.427224+0000","last_became_active":"2024-09-17T03:01:53.307963+0000","last_became_peered":"2024-09-17T03:01:53.307963+0000","last_unstale":"2024-09-17T03:01:54.427224+0000","last_undegraded":"2024-09-17T03:01:54.427224+0000","last_fullsized":"2024-09-17T03:01:54.427224+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:02.882199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425283+0000","last_change":"2024-09-17T03:01:52.304911+0000","last_active":"2024-09-17T03:01:54.425283+0000","last_peered":"2024-09-17T03:01:54.425283+0000","last_clean":"2024-09-17T03:01:54.425283+0000","last_became_active":"2024-09-17T03:01:52.304608+0000","last_became_peered":"2024-09-17T03:01:52.304608+0000","last_unstale":"2024-09-17T03:01:54.425283+0000","last_undegraded":"2024-09-17T03:01:54.425283+0000","last_fullsized":"2024-09-17T03:01:54.425283+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:18.379136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425737+0000","last_change":"2024-09-17T03:01:53.305125+0000","last_active":"2024-09-17T03:01:54.425737+0000","last_peered":"2024-09-17T03:01:54.425737+0000","last_clean":"2024-09-17T03:01:54.425737+0000","last_became_active":"2024-09-17T03:01:53.304831+0000","last_became_peered":"2024-09-17T03:01:53.304831+0000","last_unstale":"2024-09-17T03:01:54.425737+0000","last_undegraded":"2024-09-17T03:01:54.425737+0000","last_fullsized":"2024-09-17T03:01:54.425737+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:32.355099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425535+0000","last_change":"2024-09-17T03:01:52.305830+0000","last_active":"2024-09-17T03:01:54.425535+0000","last_peered":"2024-09-17T03:01:54.425535+0000","last_clean":"2024-09-17T03:01:54.425535+0000","last_became_active":"2024-09-17T03:01:52.303818+0000","last_became_peered":"2024-09-17T03:01:52.303818+0000","last_unstale":"2024-09-17T03:01:54.425535+0000","last_undegraded":"2024-09-17T03:01:54.425535+0000","last_fullsized":"2024-09-17T03:01:54.425535+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:44.158779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296335+0000","last_change":"2024-09-17T03:01:53.300341+0000","last_active":"2024-09-17T03:01:54.296335+0000","last_peered":"2024-09-17T03:01:54.296335+0000","last_clean":"2024-09-17T03:01:54.296335+0000","last_became_active":"2024-09-17T03:01:53.300030+0000","last_became_peered":"2024-09-17T03:01:53.300030+0000","last_unstale":"2024-09-17T03:01:54.296335+0000","last_undegraded":"2024-09-17T03:01:54.296335+0000","last_fullsized":"2024-09-17T03:01:54.296335+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:18:25.908255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426653+0000","last_change":"2024-09-17T03:01:52.307321+0000","last_active":"2024-09-17T03:01:54.426653+0000","last_peered":"2024-09-17T03:01:54.426653+0000","last_clean":"2024-09-17T03:01:54.426653+0000","last_became_active":"2024-09-17T03:01:52.307044+0000","last_became_peered":"2024-09-17T03:01:52.307044+0000","last_unstale":"2024-09-17T03:01:54.426653+0000","last_undegraded":"2024-09-17T03:01:54.426653+0000","last_fullsized":"2024-09-17T03:01:54.426653+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:24.246505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426878+0000","last_change":"2024-09-17T03:01:53.311163+0000","last_active":"2024-09-17T03:01:54.426878+0000","last_peered":"2024-09-17T03:01:54.426878+0000","last_clean":"2024-09-17T03:01:54.426878+0000","last_became_active":"2024-09-17T03:01:53.310787+0000","last_became_peered":"2024-09-17T03:01:53.310787+0000","last_unstale":"2024-09-17T03:01:54.426878+0000","last_undegraded":"2024-09-17T03:01:54.426878+0000","last_fullsized":"2024-09-17T03:01:54.426878+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:45.224464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425421+0000","last_change":"2024-09-17T03:01:52.303292+0000","last_active":"2024-09-17T03:01:54.425421+0000","last_peered":"2024-09-17T03:01:54.425421+0000","last_clean":"2024-09-17T03:01:54.425421+0000","last_became_active":"2024-09-17T03:01:52.303040+0000","last_became_peered":"2024-09-17T03:01:52.303040+0000","last_unstale":"2024-09-17T03:01:54.425421+0000","last_undegraded":"2024-09-17T03:01:54.425421+0000","last_fullsized":"2024-09-17T03:01:54.425421+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:49.227026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292167+0000","last_change":"2024-09-17T03:01:53.303364+0000","last_active":"2024-09-17T03:01:54.292167+0000","last_peered":"2024-09-17T03:01:54.292167+0000","last_clean":"2024-09-17T03:01:54.292167+0000","last_became_active":"2024-09-17T03:01:53.302112+0000","last_became_peered":"2024-09-17T03:01:53.302112+0000","last_unstale":"2024-09-17T03:01:54.292167+0000","last_undegraded":"2024-09-17T03:01:54.292167+0000","last_fullsized":"2024-09-17T03:01:54.292167+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:06.567200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426746+0000","last_change":"2024-09-17T03:01:52.303314+0000","last_active":"2024-09-17T03:01:54.426746+0000","last_peered":"2024-09-17T03:01:54.426746+0000","last_clean":"2024-09-17T03:01:54.426746+0000","last_became_active":"2024-09-17T03:01:52.303019+0000","last_became_peered":"2024-09-17T03:01:52.303019+0000","last_unstale":"2024-09-17T03:01:54.426746+0000","last_undegraded":"2024-09-17T03:01:54.426746+0000","last_fullsized":"2024-09-17T03:01:54.426746+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:45.317901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.296610+0000","last_change":"2024-09-17T03:01:53.305439+0000","last_active":"2024-09-17T03:01:54.296610+0000","last_peered":"2024-09-17T03:01:54.296610+0000","last_clean":"2024-09-17T03:01:54.296610+0000","last_became_active":"2024-09-17T03:01:53.304349+0000","last_became_peered":"2024-09-17T03:01:53.304349+0000","last_unstale":"2024-09-17T03:01:54.296610+0000","last_undegraded":"2024-09-17T03:01:54.296610+0000","last_fullsized":"2024-09-17T03:01:54.296610+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:26.308040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425844+0000","last_change":"2024-09-17T03:01:52.303733+0000","last_active":"2024-09-17T03:01:54.425844+0000","last_peered":"2024-09-17T03:01:54.425844+0000","last_clean":"2024-09-17T03:01:54.425844+0000","last_became_active":"2024-09-17T03:01:52.303424+0000","last_became_peered":"2024-09-17T03:01:52.303424+0000","last_unstale":"2024-09-17T03:01:54.425844+0000","last_undegraded":"2024-09-17T03:01:54.425844+0000","last_fullsized":"2024-09-17T03:01:54.425844+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:11.884059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425772+0000","last_change":"2024-09-17T03:01:53.300918+0000","last_active":"2024-09-17T03:01:54.425772+0000","last_peered":"2024-09-17T03:01:54.425772+0000","last_clean":"2024-09-17T03:01:54.425772+0000","last_became_active":"2024-09-17T03:01:53.300664+0000","last_became_peered":"2024-09-17T03:01:53.300664+0000","last_unstale":"2024-09-17T03:01:54.425772+0000","last_undegraded":"2024-09-17T03:01:54.425772+0000","last_fullsized":"2024-09-17T03:01:54.425772+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:20.092322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"153'1","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292271+0000","last_change":"2024-09-17T03:01:52.300246+0000","last_active":"2024-09-17T03:01:54.292271+0000","last_peered":"2024-09-17T03:01:54.292271+0000","last_clean":"2024-09-17T03:01:54.292271+0000","last_became_active":"2024-09-17T03:01:52.299949+0000","last_became_peered":"2024-09-17T03:01:52.299949+0000","last_unstale":"2024-09-17T03:01:54.292271+0000","last_undegraded":"2024-09-17T03:01:54.292271+0000","last_fullsized":"2024-09-17T03:01:54.292271+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:24.460970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427618+0000","last_change":"2024-09-17T03:01:53.304271+0000","last_active":"2024-09-17T03:01:54.427618+0000","last_peered":"2024-09-17T03:01:54.427618+0000","last_clean":"2024-09-17T03:01:54.427618+0000","last_became_active":"2024-09-17T03:01:53.304020+0000","last_became_peered":"2024-09-17T03:01:53.304020+0000","last_unstale":"2024-09-17T03:01:54.427618+0000","last_undegraded":"2024-09-17T03:01:54.427618+0000","last_fullsized":"2024-09-17T03:01:54.427618+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:40:18.760563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425965+0000","last_change":"2024-09-17T03:01:52.307286+0000","last_active":"2024-09-17T03:01:54.425965+0000","last_peered":"2024-09-17T03:01:54.425965+0000","last_clean":"2024-09-17T03:01:54.425965+0000","last_became_active":"2024-09-17T03:01:52.306996+0000","last_became_peered":"2024-09-17T03:01:52.306996+0000","last_unstale":"2024-09-17T03:01:54.425965+0000","last_undegraded":"2024-09-17T03:01:54.425965+0000","last_fullsized":"2024-09-17T03:01:54.425965+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:48:23.461762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.295465+0000","last_change":"2024-09-17T03:01:53.304003+0000","last_active":"2024-09-17T03:01:54.295465+0000","last_peered":"2024-09-17T03:01:54.295465+0000","last_clean":"2024-09-17T03:01:54.295465+0000","last_became_active":"2024-09-17T03:01:53.303629+0000","last_became_peered":"2024-09-17T03:01:53.303629+0000","last_unstale":"2024-09-17T03:01:54.295465+0000","last_undegraded":"2024-09-17T03:01:54.295465+0000","last_fullsized":"2024-09-17T03:01:54.295465+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:55:03.226496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425839+0000","last_change":"2024-09-17T03:01:52.302691+0000","last_active":"2024-09-17T03:01:54.425839+0000","last_peered":"2024-09-17T03:01:54.425839+0000","last_clean":"2024-09-17T03:01:54.425839+0000","last_became_active":"2024-09-17T03:01:52.301934+0000","last_became_peered":"2024-09-17T03:01:52.301934+0000","last_unstale":"2024-09-17T03:01:54.425839+0000","last_undegraded":"2024-09-17T03:01:54.425839+0000","last_fullsized":"2024-09-17T03:01:54.425839+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:44.994618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.291904+0000","last_change":"2024-09-17T03:01:53.308062+0000","last_active":"2024-09-17T03:01:54.291904+0000","last_peered":"2024-09-17T03:01:54.291904+0000","last_clean":"2024-09-17T03:01:54.291904+0000","last_became_active":"2024-09-17T03:01:53.307748+0000","last_became_peered":"2024-09-17T03:01:53.307748+0000","last_unstale":"2024-09-17T03:01:54.291904+0000","last_undegraded":"2024-09-17T03:01:54.291904+0000","last_fullsized":"2024-09-17T03:01:54.291904+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:28.683613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427290+0000","last_change":"2024-09-17T03:01:52.305460+0000","last_active":"2024-09-17T03:01:54.427290+0000","last_peered":"2024-09-17T03:01:54.427290+0000","last_clean":"2024-09-17T03:01:54.427290+0000","last_became_active":"2024-09-17T03:01:52.305143+0000","last_became_peered":"2024-09-17T03:01:52.305143+0000","last_unstale":"2024-09-17T03:01:54.427290+0000","last_undegraded":"2024-09-17T03:01:54.427290+0000","last_fullsized":"2024-09-17T03:01:54.427290+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:48.734469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425529+0000","last_change":"2024-09-17T03:01:53.312584+0000","last_active":"2024-09-17T03:01:54.425529+0000","last_peered":"2024-09-17T03:01:54.425529+0000","last_clean":"2024-09-17T03:01:54.425529+0000","last_became_active":"2024-09-17T03:01:53.310337+0000","last_became_peered":"2024-09-17T03:01:53.310337+0000","last_unstale":"2024-09-17T03:01:54.425529+0000","last_undegraded":"2024-09-17T03:01:54.425529+0000","last_fullsized":"2024-09-17T03:01:54.425529+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:11.078501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292037+0000","last_change":"2024-09-17T03:01:52.302201+0000","last_active":"2024-09-17T03:01:54.292037+0000","last_peered":"2024-09-17T03:01:54.292037+0000","last_clean":"2024-09-17T03:01:54.292037+0000","last_became_active":"2024-09-17T03:01:52.300845+0000","last_became_peered":"2024-09-17T03:01:52.300845+0000","last_unstale":"2024-09-17T03:01:54.292037+0000","last_undegraded":"2024-09-17T03:01:54.292037+0000","last_fullsized":"2024-09-17T03:01:54.292037+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:04.343358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.426587+0000","last_change":"2024-09-17T03:01:53.299585+0000","last_active":"2024-09-17T03:01:54.426587+0000","last_peered":"2024-09-17T03:01:54.426587+0000","last_clean":"2024-09-17T03:01:54.426587+0000","last_became_active":"2024-09-17T03:01:53.298052+0000","last_became_peered":"2024-09-17T03:01:53.298052+0000","last_unstale":"2024-09-17T03:01:54.426587+0000","last_undegraded":"2024-09-17T03:01:54.426587+0000","last_fullsized":"2024-09-17T03:01:54.426587+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:37.715357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.427555+0000","last_change":"2024-09-17T03:01:52.302306+0000","last_active":"2024-09-17T03:01:54.427555+0000","last_peered":"2024-09-17T03:01:54.427555+0000","last_clean":"2024-09-17T03:01:54.427555+0000","last_became_active":"2024-09-17T03:01:52.301398+0000","last_became_peered":"2024-09-17T03:01:52.301398+0000","last_unstale":"2024-09-17T03:01:54.427555+0000","last_undegraded":"2024-09-17T03:01:54.427555+0000","last_fullsized":"2024-09-17T03:01:54.427555+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:28.863701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425376+0000","last_change":"2024-09-17T03:01:53.302067+0000","last_active":"2024-09-17T03:01:54.425376+0000","last_peered":"2024-09-17T03:01:54.425376+0000","last_clean":"2024-09-17T03:01:54.425376+0000","last_became_active":"2024-09-17T03:01:53.301818+0000","last_became_peered":"2024-09-17T03:01:53.301818+0000","last_unstale":"2024-09-17T03:01:54.425376+0000","last_undegraded":"2024-09-17T03:01:54.425376+0000","last_fullsized":"2024-09-17T03:01:54.425376+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:27.911972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.425418+0000","last_change":"2024-09-17T03:01:52.298846+0000","last_active":"2024-09-17T03:01:54.425418+0000","last_peered":"2024-09-17T03:01:54.425418+0000","last_clean":"2024-09-17T03:01:54.425418+0000","last_became_active":"2024-09-17T03:01:52.298408+0000","last_became_peered":"2024-09-17T03:01:52.298408+0000","last_unstale":"2024-09-17T03:01:54.425418+0000","last_undegraded":"2024-09-17T03:01:54.425418+0000","last_fullsized":"2024-09-17T03:01:54.425418+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:30.088914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292595+0000","last_change":"2024-09-17T03:01:53.308596+0000","last_active":"2024-09-17T03:01:54.292595+0000","last_peered":"2024-09-17T03:01:54.292595+0000","last_clean":"2024-09-17T03:01:54.292595+0000","last_became_active":"2024-09-17T03:01:53.306753+0000","last_became_peered":"2024-09-17T03:01:53.306753+0000","last_unstale":"2024-09-17T03:01:54.292595+0000","last_undegraded":"2024-09-17T03:01:54.292595+0000","last_fullsized":"2024-09-17T03:01:54.292595+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:52.279992+0000","last_clean_scrub_stamp":"2024-09-17T03:01:52.279992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:44.569633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"152'2","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292603+0000","last_change":"2024-09-17T03:01:52.301250+0000","last_active":"2024-09-17T03:01:54.292603+0000","last_peered":"2024-09-17T03:01:54.292603+0000","last_clean":"2024-09-17T03:01:54.292603+0000","last_became_active":"2024-09-17T03:01:52.300821+0000","last_became_peered":"2024-09-17T03:01:52.300821+0000","last_unstale":"2024-09-17T03:01:54.292603+0000","last_undegraded":"2024-09-17T03:01:54.292603+0000","last_fullsized":"2024-09-17T03:01:54.292603+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:01:51.277971+0000","last_clean_scrub_stamp":"2024-09-17T03:01:51.277971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:33.795828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":372,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-17T03:01:54.292246+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:01:54.292246+0000","last_peered":"2024-09-17T03:01:54.292246+0000","last_clean":"2024-09-17T03:01:54.292246+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:01:54.292246+0000","last_undegraded":"2024-09-17T03:01:54.292246+0000","last_fullsized":"2024-09-17T03:01:54.292246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193903,"statfs":{"total":200000000,"available":198557142,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574940,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194480,"statfs":{"total":200000000,"available":199148148,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199149648,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199149690,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199149600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194482,"statfs":{"total":200000000,"available":199149760,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1406,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193905,"statfs":{"total":200000000,"available":198559392,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:02:01.089 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:02:01.089 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:02:01.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.245+0000 7fce6060e640 1 -- 172.21.15.104:0/285424981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce58069410 msgr2=0x7fce580d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.245+0000 7fce6060e640 1 --2- 172.21.15.104:0/285424981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce58069410 0x7fce580d0810 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fce50005fd0 tx=0x7fce5002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.245+0000 7fce6060e640 1 -- 172.21.15.104:0/285424981 shutdown_connections 2024-09-17T03:02:01.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.245+0000 7fce6060e640 1 --2- 172.21.15.104:0/285424981 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce58069410 0x7fce580d0810 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.245+0000 7fce6060e640 1 --2- 172.21.15.104:0/285424981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce5806f540 0x7fce581608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.245+0000 7fce6060e640 1 -- 172.21.15.104:0/285424981 >> 172.21.15.104:0/285424981 conn(0x7fce580b3640 msgr2=0x7fce580b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:01.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.245+0000 7fce6060e640 1 -- 172.21.15.104:0/285424981 shutdown_connections 2024-09-17T03:02:01.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.245+0000 7fce6060e640 1 -- 172.21.15.104:0/285424981 wait complete. 2024-09-17T03:02:01.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.247+0000 7fce6060e640 1 Processor -- start 2024-09-17T03:02:01.245 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.247+0000 7fce6060e640 1 -- start start 2024-09-17T03:02:01.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.248+0000 7fce6060e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce5806f540 0x7fce58152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:01.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.248+0000 7fce6060e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5815d3b0 0x7fce58155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:01.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.248+0000 7fce6060e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce581571a0 0x7fce58155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:01.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.248+0000 7fce6060e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fce580d0ed0 con 0x7fce5815d3b0 2024-09-17T03:02:01.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.248+0000 7fce6060e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce580d0d50 con 0x7fce5806f540 2024-09-17T03:02:01.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.248+0000 7fce6060e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fce580d1050 con 0x7fce581571a0 2024-09-17T03:02:01.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.248+0000 7fce5dba9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5815d3b0 0x7fce58155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5dba9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5815d3b0 0x7fce58155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50216/0 (socket says 172.21.15.104:50216) 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5dba9640 1 -- 172.21.15.104:0/1950230950 learned_addr learned my addr 172.21.15.104:0/1950230950 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5ebab640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce581571a0 0x7fce58155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5e3aa640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce5806f540 0x7fce58152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5dba9640 1 -- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce581571a0 msgr2=0x7fce58155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5dba9640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce581571a0 0x7fce58155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5dba9640 1 -- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce5806f540 msgr2=0x7fce58152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5dba9640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce5806f540 0x7fce58152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5dba9640 1 -- 172.21.15.104:0/1950230950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5815a7a0 con 0x7fce5815d3b0 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce5dba9640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5815d3b0 0x7fce58155140 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c370 tx=0x7fce4c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce56ffd640 1 -- 172.21.15.104:0/1950230950 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c017070 con 0x7fce5815d3b0 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce56ffd640 1 -- 172.21.15.104:0/1950230950 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce4c0053c0 con 0x7fce5815d3b0 2024-09-17T03:02:01.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5815aa80 con 0x7fce5815d3b0 2024-09-17T03:02:01.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce56ffd640 1 -- 172.21.15.104:0/1950230950 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c003850 con 0x7fce5815d3b0 2024-09-17T03:02:01.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.249+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce581f3f50 con 0x7fce5815d3b0 2024-09-17T03:02:01.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.250+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5806a8a0 con 0x7fce5815d3b0 2024-09-17T03:02:01.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.251+0000 7fce56ffd640 1 -- 172.21.15.104:0/1950230950 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce4c01a070 con 0x7fce5815d3b0 2024-09-17T03:02:01.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.251+0000 7fce56ffd640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce44078bc0 0x7fce4407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:01.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.251+0000 7fce56ffd640 1 -- 172.21.15.104:0/1950230950 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fce4c099fa0 con 0x7fce5815d3b0 2024-09-17T03:02:01.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.252+0000 7fce5e3aa640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce44078bc0 0x7fce4407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:01.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.252+0000 7fce5e3aa640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce44078bc0 0x7fce4407b0d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fce48005fd0 tx=0x7fce480095e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:01.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.256+0000 7fce56ffd640 1 -- 172.21.15.104:0/1950230950 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce5806a8a0 con 0x7fce5815d3b0 2024-09-17T03:02:01.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.502+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fce580d1570 con 0x7fce5815d3b0 2024-09-17T03:02:01.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.505+0000 7fce56ffd640 1 -- 172.21.15.104:0/1950230950 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v32) ==== 190+0+147 (secure 0 0 0) 0x7fce4c061e20 con 0x7fce5815d3b0 2024-09-17T03:02:01.503 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T03:02:01.503 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T03:02:01.503 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T03:02:01.503 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T03:02:01.504 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:02:01.504 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce44078bc0 msgr2=0x7fce4407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce44078bc0 0x7fce4407b0d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fce48005fd0 tx=0x7fce480095e0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5815d3b0 msgr2=0x7fce58155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5815d3b0 0x7fce58155140 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c370 tx=0x7fce4c00c830 comp rx=0 tx=0).stop 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 shutdown_connections 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce44078bc0 0x7fce4407b0d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fce581571a0 0x7fce58155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce5815d3b0 0x7fce58155140 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 --2- 172.21.15.104:0/1950230950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce5806f540 0x7fce58152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 >> 172.21.15.104:0/1950230950 conn(0x7fce580b3640 msgr2=0x7fce5815ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:01.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 shutdown_connections 2024-09-17T03:02:01.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.507+0000 7fce6060e640 1 -- 172.21.15.104:0/1950230950 wait complete. 2024-09-17T03:02:01.517 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:02:01.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.630+0000 7f644084d640 1 -- 172.21.15.104:0/3088699872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 msgr2=0x7f643c0b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.630+0000 7f644084d640 1 --2- 172.21.15.104:0/3088699872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 0x7f643c0b7c80 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f6434009860 tx=0x7f643402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.630+0000 7f644084d640 1 -- 172.21.15.104:0/3088699872 shutdown_connections 2024-09-17T03:02:01.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.630+0000 7f644084d640 1 --2- 172.21.15.104:0/3088699872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f643c0d13e0 0x7f643c1615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.630+0000 7f644084d640 1 --2- 172.21.15.104:0/3088699872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 0x7f643c0b7c80 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.630+0000 7f644084d640 1 -- 172.21.15.104:0/3088699872 >> 172.21.15.104:0/3088699872 conn(0x7f643c0d2970 msgr2=0x7f643c0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:01.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.630+0000 7f644084d640 1 -- 172.21.15.104:0/3088699872 shutdown_connections 2024-09-17T03:02:01.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.630+0000 7f644084d640 1 -- 172.21.15.104:0/3088699872 wait complete. 2024-09-17T03:02:01.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.632+0000 7f644084d640 1 Processor -- start 2024-09-17T03:02:01.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.632+0000 7f644084d640 1 -- start start 2024-09-17T03:02:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f644084d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c0d0fd0 0x7f643c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f644084d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f643c0d13e0 0x7f643c14c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f644084d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 0x7f643c14c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f644084d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f643c0b6bd0 con 0x7f643c0d3490 2024-09-17T03:02:01.633 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f644084d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f643c0b6a50 con 0x7f643c0d0fd0 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f644084d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f643c0b6d50 con 0x7f643c0d13e0 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 0x7f643c14c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 0x7f643c14c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50230/0 (socket says 172.21.15.104:50230) 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 -- 172.21.15.104:0/3606702926 learned_addr learned my addr 172.21.15.104:0/3606702926 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643a59c640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c0d0fd0 0x7f643c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f6439d9b640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f643c0d13e0 0x7f643c14c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 -- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f643c0d13e0 msgr2=0x7f643c14c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f643c0d13e0 0x7f643c14c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 -- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c0d0fd0 msgr2=0x7f643c151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c0d0fd0 0x7f643c151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 -- 172.21.15.104:0/3606702926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c1f35b0 con 0x7f643c0d3490 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f643ad9d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 0x7f643c14c970 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f642c005d00 tx=0x7f642c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:01.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f642affd640 1 -- 172.21.15.104:0/3606702926 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c017070 con 0x7f643c0d3490 2024-09-17T03:02:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f642affd640 1 -- 172.21.15.104:0/3606702926 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f642c005330 con 0x7f643c0d3490 2024-09-17T03:02:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c152290 con 0x7f643c0d3490 2024-09-17T03:02:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f642affd640 1 -- 172.21.15.104:0/3606702926 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c0047a0 con 0x7f643c0d3490 2024-09-17T03:02:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.634+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c0b15f0 con 0x7f643c0d3490 2024-09-17T03:02:01.635 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.635+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643c0b7c80 con 0x7f643c0d3490 2024-09-17T03:02:01.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.636+0000 7f642affd640 1 -- 172.21.15.104:0/3606702926 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f642c004940 con 0x7f643c0d3490 2024-09-17T03:02:01.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.637+0000 7f642affd640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f641c078b90 0x7f641c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:01.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.637+0000 7f642affd640 1 -- 172.21.15.104:0/3606702926 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f642c09ad40 con 0x7f643c0d3490 2024-09-17T03:02:01.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.637+0000 7f643a59c640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f641c078b90 0x7f641c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:01.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.638+0000 7f643a59c640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f641c078b90 0x7f641c07b0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6434034000 tx=0x7f6434004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:01.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.642+0000 7f642affd640 1 -- 172.21.15.104:0/3606702926 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f642c063210 con 0x7f643c0d3490 2024-09-17T03:02:01.851 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.853+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f643c0d0900 con 0x7f643c0d3490 2024-09-17T03:02:01.852 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.853+0000 7f642affd640 1 -- 172.21.15.104:0/3606702926 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5237 (secure 0 0 0) 0x7f642c062b10 con 0x7f643c0d3490 2024-09-17T03:02:01.852 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:02:01.852 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":62,"btime":"2024-09-17T03:01:55:313759+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1088380573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1088380573},{"type":"v1","addr":"172.21.15.192:6836","nonce":1088380573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3930263372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3930263372},{"type":"v1","addr":"172.21.15.192:6837","nonce":3930263372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7449,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2263721697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2263721697},{"type":"v1","addr":"172.21.15.104:6834","nonce":2263721697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:01:52.648279+0000","modified":"2024-09-17T03:01:54.664367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1696726463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1696726463},{"type":"v1","addr":"172.21.15.104:6835","nonce":1696726463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7452,"qdb_cluster":[7452]},"id":9}]} 2024-09-17T03:02:01.852 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 62 2024-09-17T03:02:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f641c078b90 msgr2=0x7f641c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f641c078b90 0x7f641c07b0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6434034000 tx=0x7f6434004730 comp rx=0 tx=0).stop 2024-09-17T03:02:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 msgr2=0x7f643c14c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 0x7f643c14c970 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f642c005d00 tx=0x7f642c00dae0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 shutdown_connections 2024-09-17T03:02:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f641c078b90 0x7f641c07b0a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f643c0d3490 0x7f643c14c970 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f643c0d13e0 0x7f643c14c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 --2- 172.21.15.104:0/3606702926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f643c0d0fd0 0x7f643c151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:01.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 >> 172.21.15.104:0/3606702926 conn(0x7f643c0d2970 msgr2=0x7f643c0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:01.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 shutdown_connections 2024-09-17T03:02:01.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:01.855+0000 7f644084d640 1 -- 172.21.15.104:0/3606702926 wait complete. 2024-09-17T03:02:02.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:01:52.648279+0000', 'modified': '2024-09-17T03:01:54.664367+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7452}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7452': {'gid': 7452, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/1696726463', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6833', 'nonce': 1696726463}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 1696726463}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7452, 'qdb_cluster': [7452]} 2024-09-17T03:02:02.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:02:02.268 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:02:02.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.386+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/3599157261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 msgr2=0x7f3ce40b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.386+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/3599157261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 0x7f3ce40b57e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8005fd0 tx=0x7f3cd802a530 comp rx=0 tx=0).stop 2024-09-17T03:02:02.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.386+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/3599157261 shutdown_connections 2024-09-17T03:02:02.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.386+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/3599157261 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce40b5d20 0x7f3ce40cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.386+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/3599157261 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 0x7f3ce40b57e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.386+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/3599157261 >> 172.21.15.104:0/3599157261 conn(0x7f3ce40b44a0 msgr2=0x7f3ce40b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:02.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.386+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/3599157261 shutdown_connections 2024-09-17T03:02:02.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.386+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/3599157261 wait complete. 2024-09-17T03:02:02.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.388+0000 7f3ce9cb6640 1 Processor -- start 2024-09-17T03:02:02.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.388+0000 7f3ce9cb6640 1 -- start start 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce9cb6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce40b4fc0 0x7f3ce40c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce9cb6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce40b5d20 0x7f3ce40cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce9cb6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 0x7f3ce4155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce9cb6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce4160f50 con 0x7f3ce40cdf10 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce9cb6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce40d0210 con 0x7f3ce40b5d20 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce9cb6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce41610d0 con 0x7f3ce40b4fc0 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 0x7f3ce4155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 0x7f3ce4155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50254/0 (socket says 172.21.15.104:50254) 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce3fff640 1 -- 172.21.15.104:0/2780704346 learned_addr learned my addr 172.21.15.104:0/2780704346 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce40b5d20 0x7f3ce40cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.389+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce40b4fc0 0x7f3ce40c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ce3fff640 1 -- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce40b4fc0 msgr2=0x7f3ce40c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce40b4fc0 0x7f3ce40c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ce3fff640 1 -- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce40b5d20 msgr2=0x7f3ce40cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce40b5d20 0x7f3ce40cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ce3fff640 1 -- 172.21.15.104:0/2780704346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce40c6a00 con 0x7f3ce40cdf10 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 0x7f3ce4155790 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00e990 tx=0x7f3cdc00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ccbfff640 1 -- 172.21.15.104:0/2780704346 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc004d20 con 0x7f3ce40cdf10 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ccbfff640 1 -- 172.21.15.104:0/2780704346 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cdc00ca40 con 0x7f3ce40cdf10 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/2780704346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce40c85c0 con 0x7f3ce40cdf10 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ccbfff640 1 -- 172.21.15.104:0/2780704346 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc005020 con 0x7f3ce40cdf10 2024-09-17T03:02:02.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.390+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/2780704346 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce415a4b0 con 0x7f3ce40cdf10 2024-09-17T03:02:02.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.392+0000 7f3ccbfff640 1 -- 172.21.15.104:0/2780704346 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3cdc0051c0 con 0x7f3ce40cdf10 2024-09-17T03:02:02.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.392+0000 7f3ccbfff640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3cd0078bc0 0x7f3cd007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.392+0000 7f3ccbfff640 1 -- 172.21.15.104:0/2780704346 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f3cdc09b570 con 0x7f3ce40cdf10 2024-09-17T03:02:02.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.393+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3cd0078bc0 0x7f3cd007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.393+0000 7f3cf0c1f740 1 Processor -- start 2024-09-17T03:02:02.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.393+0000 7f3cf0c1f740 1 -- start start 2024-09-17T03:02:02.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.393+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3cd0078bc0 0x7f3cd007b0d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4006fd0 tx=0x7f3cd4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:02.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc467fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc468500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561ccc3b0820 con 0x561ccc096270 2024-09-17T03:02:02.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561ccc39fc50 con 0x561ccc075590 2024-09-17T03:02:02.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x561ccc3a3a60 con 0x561ccc06d3b0 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc467fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc467fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50262/0 (socket says 172.21.15.104:50262) 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 -- 172.21.15.104:0/1296797423 learned_addr learned my addr 172.21.15.104:0/1296797423 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc468500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 -- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 msgr2=0x561ccc468500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc468500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 -- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 msgr2=0x561ccc485400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 -- 172.21.15.104:0/1296797423 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccc101850 con 0x561ccc096270 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc468500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:02:02.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc467fc0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400eb70 tx=0x7f3cd4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7889ee076cd97d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.395+0000 7f3cc97fa640 1 -- 172.21.15.104:0/1296797423 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd401b040 con 0x561ccc096270 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cc97fa640 1 -- 172.21.15.104:0/1296797423 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd4024070 con 0x561ccc096270 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cc97fa640 1 -- 172.21.15.104:0/1296797423 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4015e50 con 0x561ccc096270 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/1296797423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 msgr2=0x561ccc467fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc467fc0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400eb70 tx=0x7f3cd4011000 comp rx=0 tx=0).stop 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/1296797423 shutdown_connections 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc468500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/1296797423 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc467fc0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/1296797423 >> 172.21.15.104:0/1296797423 conn(0x561ccc08a3c0 msgr2=0x561ccc43e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/1296797423 shutdown_connections 2024-09-17T03:02:02.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.396+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/1296797423 wait complete. 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.397+0000 7f3cf0c1f740 1 -- start start 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.397+0000 7f3cf0c1f740 1 Processor -- start 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc456400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc486350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 0x561ccc486890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561ccc110620 con 0x561ccc06d3b0 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561ccc3455f0 con 0x561ccc075590 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x561ccc468a40 con 0x561ccc096270 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cf0c1f740 10 client.0 _ll_register_callbacks cb 0x561ccc3490a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc456400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc456400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50272/0 (socket says 172.21.15.104:50272) 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 -- 172.21.15.104:0/2252987982 learned_addr learned my addr 172.21.15.104:0/2252987982 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 -- 172.21.15.104:0/2252987982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 msgr2=0x561ccc486890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 0x561ccc486890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 -- 172.21.15.104:0/2252987982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 msgr2=0x561ccc486350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc486350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 -- 172.21.15.104:0/2252987982 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ccc1786b0 con 0x561ccc06d3b0 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc456400 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd4013450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99956e5c5cada552 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cc27fc640 1 -- 172.21.15.104:0/2252987982 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4013a50 con 0x561ccc06d3b0 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cc27fc640 1 -- 172.21.15.104:0/2252987982 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f3cd4013bf0 con 0x561ccc06d3b0 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.399+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/2252987982 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd4024070 con 0x561ccc06d3b0 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cc27fc640 1 -- 172.21.15.104:0/2252987982 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3cd4013df0 con 0x561ccc06d3b0 2024-09-17T03:02:02.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cf0c1f740 10 client.7611 fetch_fsmap learned FSMap version 62 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/2252987982 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x561ccc47e110 con 0x561ccc06d3b0 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cc27fc640 1 -- 172.21.15.104:0/2252987982 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cd4024070 con 0x561ccc06d3b0 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cc27fc640 1 -- 172.21.15.104:0/2252987982 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7f3cd403e080 con 0x561ccc06d3b0 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cf0c1f740 10 client.7611 fetch_fsmap finished waiting for FSMap version 62 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cf0c1f740 10 client.7611 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cf0c1f740 20 client.7611 populate_metadata read hostname 'smithi104' 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] conn(0x561ccc054e40 0x561ccc479bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cf0c1f740 4 client.7611 mds_command: new command op to 7452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/2252987982 --> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ccc3b2770 con 0x561ccc054e40 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] conn(0x561ccc054e40 0x561ccc479bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3cc27fc640 10 client.7611 ms_handle_connect on v2:172.21.15.104:6833/1696726463 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.400+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] conn(0x561ccc054e40 0x561ccc479bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d883ca4607c5a8 server_cookie=8172429ce31fa70f in_seq=0 out_seq=0 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cc27fc640 1 -- 172.21.15.104:0/2252987982 <== mds.0 v2:172.21.15.104:6833/1696726463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ccc3b2770 con 0x561ccc054e40 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cc27fc640 10 client.7611 handle_command_reply: tid=0 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 client.7611 shutdown 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/2252987982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 msgr2=0x561ccc456400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc456400 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd4013450 comp rx=0 tx=0).stop 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/2252987982 shutdown_connections 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] conn(0x561ccc054e40 0x561ccc479bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc486350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 0x561ccc486890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/2252987982 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc456400 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cc27fc640 0 client.7611 ms_handle_reset on v2:172.21.15.104:6833/1696726463 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/2252987982 >> 172.21.15.104:0/2252987982 conn(0x561ccc08a3c0 msgr2=0x561ccc4849d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:02.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/2252987982 shutdown_connections 2024-09-17T03:02:02.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.401+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/2252987982 wait complete. 2024-09-17T03:02:02.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.402+0000 7f3cf0c1f740 20 client.7611 trim_cache size 0 max 16384 2024-09-17T03:02:02.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.420+0000 7f3cf0c1f740 1 Processor -- start 2024-09-17T03:02:02.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.420+0000 7f3cf0c1f740 1 -- start start 2024-09-17T03:02:02.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc4855b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc456120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc4a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce41ff580 con 0x561ccc096270 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce40ca820 con 0x561ccc075590 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce41fef10 con 0x561ccc06d3b0 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc4a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3ce3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc4a55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50274/0 (socket says 172.21.15.104:50274) 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3ce3fff640 1 -- 172.21.15.104:0/4072390525 learned_addr learned my addr 172.21.15.104:0/4072390525 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc456120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.421+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc4855b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3ce3fff640 1 -- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 msgr2=0x561ccc4855b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc4855b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3ce3fff640 1 -- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 msgr2=0x561ccc456120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:02:02.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc456120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3ce3fff640 1 -- 172.21.15.104:0/4072390525 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ccc484280 con 0x561ccc096270 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc456120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc4a55d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c640 tx=0x7f3cdc05fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b4db8eeaa56e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3cc8ff9640 1 -- 172.21.15.104:0/4072390525 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc01f040 con 0x561ccc096270 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3cc8ff9640 1 -- 172.21.15.104:0/4072390525 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cdc0633f0 con 0x561ccc096270 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.422+0000 7f3cc8ff9640 1 -- 172.21.15.104:0/4072390525 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc06a320 con 0x561ccc096270 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/4072390525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 msgr2=0x561ccc4a55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc4a55d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c640 tx=0x7f3cdc05fb60 comp rx=0 tx=0).stop 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/4072390525 shutdown_connections 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc456120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc096270 0x561ccc4a55d0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/4072390525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc06d3b0 0x561ccc4855b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/4072390525 >> 172.21.15.104:0/4072390525 conn(0x561ccc08a3c0 msgr2=0x561ccc491260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:02.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/4072390525 shutdown_connections 2024-09-17T03:02:02.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.423+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/4072390525 wait complete. 2024-09-17T03:02:02.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.424+0000 7f3cf0c1f740 1 -- start start 2024-09-17T03:02:02.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.424+0000 7f3cf0c1f740 1 Processor -- start 2024-09-17T03:02:02.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc4ff770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.429 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3cf0c1f740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 0x561ccc4856a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x561ccc47cdd0 con 0x561ccc06d3b0 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561ccc491c80 con 0x561ccc075590 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3cf0c1f740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x561ccc47c060 con 0x561ccc096270 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3cf0c1f740 10 client.0 _ll_register_callbacks cb 0x7f3cd400ea70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc4ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce37fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc4ff770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50280/0 (socket says 172.21.15.104:50280) 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce37fe640 1 -- 172.21.15.104:0/934084475 learned_addr learned my addr 172.21.15.104:0/934084475 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 0x561ccc4856a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce37fe640 1 -- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 msgr2=0x561ccc4856a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 0x561ccc4856a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.430 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce37fe640 1 -- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 msgr2=0x561ccc485160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce37fe640 1 -- 172.21.15.104:0/934084475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ccc4a6200 con 0x561ccc06d3b0 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.425+0000 7f3ce3fff640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 0x561ccc4856a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3ce37fe640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc4ff770 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd40134c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349ce4a77e5c882f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cc27fc640 1 -- 172.21.15.104:0/934084475 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4044060 con 0x561ccc06d3b0 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cc27fc640 1 -- 172.21.15.104:0/934084475 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f3cd4034d80 con 0x561ccc06d3b0 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/934084475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cdc0633f0 con 0x561ccc06d3b0 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cc27fc640 1 -- 172.21.15.104:0/934084475 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3cd404a050 con 0x561ccc06d3b0 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 10 client.7617 fetch_fsmap learned FSMap version 62 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/934084475 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x561ccc4960e0 con 0x561ccc06d3b0 2024-09-17T03:02:02.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cc27fc640 1 -- 172.21.15.104:0/934084475 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cdc0633f0 con 0x561ccc06d3b0 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cc27fc640 1 -- 172.21.15.104:0/934084475 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7f3cd404d020 con 0x561ccc06d3b0 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 10 client.7617 fetch_fsmap finished waiting for FSMap version 62 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 10 client.7617 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 20 client.7617 populate_metadata read hostname 'smithi104' 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] conn(0x561ccc486310 0x561ccc437550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 4 client.7617 mds_command: new command op to 7452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/934084475 --> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] -- command(tid 0: {"prefix": "status"}) -- 0x561ccc47f2a0 con 0x561ccc486310 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.426+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] conn(0x561ccc486310 0x561ccc437550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cc27fc640 10 client.7617 ms_handle_connect on v2:172.21.15.104:6833/1696726463 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3ce2ffd640 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] conn(0x561ccc486310 0x561ccc437550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ff44c0e1f8a7ea8 server_cookie=cd6bc0d984e99e in_seq=0 out_seq=0 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cc27fc640 1 -- 172.21.15.104:0/934084475 <== mds.0 v2:172.21.15.104:6833/1696726463 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x561ccc47f2a0 con 0x561ccc486310 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cc27fc640 10 client.7617 handle_command_reply: tid=0 2024-09-17T03:02:02.432 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 client.7617 shutdown 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/934084475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 msgr2=0x561ccc4ff770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc4ff770 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd40134c0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/934084475 shutdown_connections 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.104:6833/1696726463,v1:172.21.15.104:6835/1696726463] conn(0x561ccc486310 0x561ccc437550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ccc075590 0x561ccc485160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cc27fc640 0 client.7617 ms_handle_reset on v2:172.21.15.104:6833/1696726463 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x561ccc096270 0x561ccc4856a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 --2- 172.21.15.104:0/934084475 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x561ccc06d3b0 0x561ccc4ff770 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/934084475 >> 172.21.15.104:0/934084475 conn(0x561ccc08a3c0 msgr2=0x561ccc494380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/934084475 shutdown_connections 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 1 -- 172.21.15.104:0/934084475 wait complete. 2024-09-17T03:02:02.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.427+0000 7f3cf0c1f740 20 client.7617 trim_cache size 0 max 16384 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 7452, 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.1377002530000002, 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 62, 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 153, 2024-09-17T03:02:02.434 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 153, 2024-09-17T03:02:02.435 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 13.83907531 2024-09-17T03:02:02.435 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3cd0078bc0 msgr2=0x7f3cd007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3cd0078bc0 0x7f3cd007b0d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4006fd0 tx=0x7f3cd4009060 comp rx=0 tx=0).stop 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/2780704346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 msgr2=0x7f3ce4155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 0x7f3ce4155790 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00e990 tx=0x7f3cdc00ee50 comp rx=0 tx=0).stop 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/2780704346 shutdown_connections 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3cd0078bc0 0x7f3cd007b0d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ce40b5d20 0x7f3ce40cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3ce40cdf10 0x7f3ce4155790 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 --2- 172.21.15.104:0/2780704346 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ce40b4fc0 0x7f3ce40c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/2780704346 >> 172.21.15.104:0/2780704346 conn(0x7f3ce40b44a0 msgr2=0x7f3ce40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/2780704346 shutdown_connections 2024-09-17T03:02:02.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.428+0000 7f3ce9cb6640 1 -- 172.21.15.104:0/2780704346 wait complete. 2024-09-17T03:02:02.438 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:02:02.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.551+0000 7f072f1c3640 1 -- 172.21.15.104:0/2439397393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07280b65e0 msgr2=0x7f07280b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.551+0000 7f072f1c3640 1 --2- 172.21.15.104:0/2439397393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07280b65e0 0x7f07280b69f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0724009830 tx=0x7f072402a480 comp rx=0 tx=0).stop 2024-09-17T03:02:02.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.551+0000 7f072f1c3640 1 -- 172.21.15.104:0/2439397393 shutdown_connections 2024-09-17T03:02:02.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.551+0000 7f072f1c3640 1 --2- 172.21.15.104:0/2439397393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f072815fd10 0x7f0728161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.551+0000 7f072f1c3640 1 --2- 172.21.15.104:0/2439397393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07280b65e0 0x7f07280b69f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.551+0000 7f072f1c3640 1 -- 172.21.15.104:0/2439397393 >> 172.21.15.104:0/2439397393 conn(0x7f0728069120 msgr2=0x7f0728069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:02.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.551+0000 7f072f1c3640 1 -- 172.21.15.104:0/2439397393 shutdown_connections 2024-09-17T03:02:02.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.551+0000 7f072f1c3640 1 -- 172.21.15.104:0/2439397393 wait complete. 2024-09-17T03:02:02.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.553+0000 7f072f1c3640 1 Processor -- start 2024-09-17T03:02:02.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.553+0000 7f072f1c3640 1 -- start start 2024-09-17T03:02:02.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.554+0000 7f072f1c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07280b65e0 0x7f07281f9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.554+0000 7f072f1c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f072815f1f0 0x7f0728150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.554+0000 7f072f1c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f072815fd10 0x7f07280ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072f1c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0728161e40 con 0x7f072815fd10 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072f1c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0728161cc0 con 0x7f07280b65e0 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072f1c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0728161fc0 con 0x7f072815f1f0 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f072815fd10 0x7f07280ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f072815fd10 0x7f07280ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50290/0 (socket says 172.21.15.104:50290) 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 -- 172.21.15.104:0/3791187520 learned_addr learned my addr 172.21.15.104:0/3791187520 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072cf5f640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07280b65e0 0x7f07281f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f071ffff640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f072815f1f0 0x7f0728150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 -- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f072815f1f0 msgr2=0x7f0728150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f072815f1f0 0x7f0728150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 -- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07280b65e0 msgr2=0x7f07281f9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07280b65e0 0x7f07281f9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 -- 172.21.15.104:0/3791187520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07281fa380 con 0x7f072815fd10 2024-09-17T03:02:02.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072d760640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f072815fd10 0x7f07280ce3a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f072000ec20 tx=0x7f072000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:02.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f071d7fa640 1 -- 172.21.15.104:0/3791187520 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720003b70 con 0x7f072815fd10 2024-09-17T03:02:02.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f071d7fa640 1 -- 172.21.15.104:0/3791187520 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0720003d10 con 0x7f072815fd10 2024-09-17T03:02:02.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07281fa660 con 0x7f072815fd10 2024-09-17T03:02:02.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f071d7fa640 1 -- 172.21.15.104:0/3791187520 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720004280 con 0x7f072815fd10 2024-09-17T03:02:02.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.555+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07281f9e40 con 0x7f072815fd10 2024-09-17T03:02:02.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.556+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07281fa0f0 con 0x7f072815fd10 2024-09-17T03:02:02.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.557+0000 7f071d7fa640 1 -- 172.21.15.104:0/3791187520 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0720004420 con 0x7f072815fd10 2024-09-17T03:02:02.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.558+0000 7f071d7fa640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0714078bc0 0x7f071407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:02.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.558+0000 7f071d7fa640 1 -- 172.21.15.104:0/3791187520 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f072009b9f0 con 0x7f072815fd10 2024-09-17T03:02:02.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.558+0000 7f072cf5f640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0714078bc0 0x7f071407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:02.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.559+0000 7f072cf5f640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0714078bc0 0x7f071407b0d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0724034000 tx=0x7f0724004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:02.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.562+0000 7f071d7fa640 1 -- 172.21.15.104:0/3791187520 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0720063e40 con 0x7f072815fd10 2024-09-17T03:02:02.765 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.767+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f07280d1f80 con 0x7f072815fd10 2024-09-17T03:02:02.766 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.768+0000 7f071d7fa640 1 -- 172.21.15.104:0/3791187520 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) ==== 53+0+73 (secure 0 0 0) 0x7f0720063740 con 0x7f072815fd10 2024-09-17T03:02:02.766 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:02:02.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0714078bc0 msgr2=0x7f071407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.768 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0714078bc0 0x7f071407b0d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0724034000 tx=0x7f0724004730 comp rx=0 tx=0).stop 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f072815fd10 msgr2=0x7f07280ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f072815fd10 0x7f07280ce3a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f072000ec20 tx=0x7f072000c6a0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 shutdown_connections 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0714078bc0 0x7f071407b0d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f072815fd10 0x7f07280ce3a0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f072815f1f0 0x7f0728150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 --2- 172.21.15.104:0/3791187520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07280b65e0 0x7f07281f9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 >> 172.21.15.104:0/3791187520 conn(0x7f0728069120 msgr2=0x7f07280d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 shutdown_connections 2024-09-17T03:02:02.769 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:02.770+0000 7f072f1c3640 1 -- 172.21.15.104:0/3791187520 wait complete. 2024-09-17T03:02:02.779 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:02:02.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:02:02.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T03:02:02.780 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:02:02.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:02:02.780 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:02:02.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:02:02.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:02:02.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:02:02.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:02.780 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T03:02:02.796 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:02:02.796 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:02:02.796 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:02:02.796 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:02.796 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T03:02:02.796 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:02.796 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:02:02.797 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42376sec preferred_lft 42376sec 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:02.798 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T03:02:02.799 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:02.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:02.800 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:02:02.859 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T03:02:02.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:02.861 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T03:02:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T03:02:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:02:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:02:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:02:02.917 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:02:02.918 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:02:02.918 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T03:02:02.918 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:02:02.918 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:02:02.918 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:02:02.918 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T03:02:03.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:02:03.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:02:03.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:03.043 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T03:02:03.058 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:02:03.058 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:02:03.058 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:02:03.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:03.059 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T03:02:03.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:02:03.123 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:02:03.179 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:02:03.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:02:03.179 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:02:03.234 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:02:03.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:03.234 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:02:03.328 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:02:03.329 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:02:03.329 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:02:03.339 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:02:03.340 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:02:03.340 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:02:03.340 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:02:03.340 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:02:03.349 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:02:03.350 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:02:03.350 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:02:03.350 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:02:03.350 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:02:03.350 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:02:03.350 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:02:03.350 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:02:03.355 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:02:03.355 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:02:03.355 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:02:03.355 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:02:03.355 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:02:03.355 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:02:03.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:03.356 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:02:03.380 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:02:03.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:02:03.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:02:03.480 INFO:teuthology.orchestra.run.smithi104.stdout:client6251 2024-09-17T03:02:03.480 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:02:03.480 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:02:03.496 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:02:03.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.650+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1742210456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc994004800 msgr2=0x7fc994004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:03.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.650+0000 7fc9b2b6e640 1 --2- 172.21.15.104:0/1742210456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc994004800 0x7fc994004c10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc99c00ac30 tx=0x7fc994005830 comp rx=0 tx=0).stop 2024-09-17T03:02:03.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.651+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1742210456 shutdown_connections 2024-09-17T03:02:03.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.651+0000 7fc9b2b6e640 1 --2- 172.21.15.104:0/1742210456 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc994004800 0x7fc994004c10 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:03.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.651+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1742210456 >> 172.21.15.104:0/1742210456 conn(0x7fc9ac0b2450 msgr2=0x7fc9ac0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:03.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.651+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1742210456 shutdown_connections 2024-09-17T03:02:03.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.651+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1742210456 wait complete. 2024-09-17T03:02:03.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.652+0000 7fc9b2b6e640 1 Processor -- start 2024-09-17T03:02:03.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.652+0000 7fc9b2b6e640 1 -- start start 2024-09-17T03:02:03.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b2b6e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc994004800 0x7fc9ac1f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:03.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b2b6e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9ac15e1c0 0x7fc9ac1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:03.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b2b6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9ac0b1570 0x7fc9ac0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:03.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b2b6e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac072e30 con 0x7fc9ac0b1570 2024-09-17T03:02:03.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b2b6e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac06fe60 con 0x7fc994004800 2024-09-17T03:02:03.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b2b6e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ac072fb0 con 0x7fc9ac15e1c0 2024-09-17T03:02:03.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b110b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9ac0b1570 0x7fc9ac0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:03.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b110b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9ac0b1570 0x7fc9ac0b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:50308/0 (socket says 172.21.15.104:50308) 2024-09-17T03:02:03.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b110b640 1 -- 172.21.15.104:0/1379129124 learned_addr learned my addr 172.21.15.104:0/1379129124 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:03.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b090a640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc994004800 0x7fc9ac1f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:03.655 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9a3fff640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9ac15e1c0 0x7fc9ac1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b110b640 1 -- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9ac15e1c0 msgr2=0x7fc9ac1541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b110b640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9ac15e1c0 0x7fc9ac1541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b110b640 1 -- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc994004800 msgr2=0x7fc9ac1f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b110b640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc994004800 0x7fc9ac1f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.654+0000 7fc9b110b640 1 -- 172.21.15.104:0/1379129124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac0b1ec0 con 0x7fc9ac0b1570 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.655+0000 7fc9b110b640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9ac0b1570 0x7fc9ac0b1980 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac15b910 tx=0x7fc9a4006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.655+0000 7fc9a17fa640 1 -- 172.21.15.104:0/1379129124 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a400fab0 con 0x7fc9ac0b1570 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.655+0000 7fc9a17fa640 1 -- 172.21.15.104:0/1379129124 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9a400fc50 con 0x7fc9ac0b1570 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.655+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac1f4430 con 0x7fc9ac0b1570 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.655+0000 7fc9a17fa640 1 -- 172.21.15.104:0/1379129124 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4011430 con 0x7fc9ac0b1570 2024-09-17T03:02:03.656 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.655+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac1f49f0 con 0x7fc9ac0b1570 2024-09-17T03:02:03.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.656+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ac1f41a0 con 0x7fc9ac0b1570 2024-09-17T03:02:03.657 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.657+0000 7fc9a17fa640 1 -- 172.21.15.104:0/1379129124 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9a40115d0 con 0x7fc9ac0b1570 2024-09-17T03:02:03.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.657+0000 7fc9a17fa640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc998078bf0 0x7fc99807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:03.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.657+0000 7fc9a17fa640 1 -- 172.21.15.104:0/1379129124 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fc9a409b400 con 0x7fc9ac0b1570 2024-09-17T03:02:03.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.657+0000 7fc9b090a640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc998078bf0 0x7fc99807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:03.658 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.658+0000 7fc9b090a640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc998078bf0 0x7fc99807b100 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac06b910 tx=0x7fc9a8006ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:03.659 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.661+0000 7fc9a17fa640 1 -- 172.21.15.104:0/1379129124 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc9ac0b1ec0 con 0x7fc9ac0b1570 2024-09-17T03:02:03.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.870+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc9ac15b2e0 con 0x7fc9ac0b1570 2024-09-17T03:02:03.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.871+0000 7fc9a17fa640 1 -- 172.21.15.104:0/1379129124 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) ==== 53+0+73 (secure 0 0 0) 0x7fc9a4063310 con 0x7fc9ac0b1570 2024-09-17T03:02:03.869 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:02:03.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc998078bf0 msgr2=0x7fc99807b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc998078bf0 0x7fc99807b100 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac06b910 tx=0x7fc9a8006ce0 comp rx=0 tx=0).stop 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9ac0b1570 msgr2=0x7fc9ac0b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9ac0b1570 0x7fc9ac0b1980 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac15b910 tx=0x7fc9a4006720 comp rx=0 tx=0).stop 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 shutdown_connections 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc998078bf0 0x7fc99807b100 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc9ac0b1570 0x7fc9ac0b1980 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc9ac15e1c0 0x7fc9ac1541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 --2- 172.21.15.104:0/1379129124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc994004800 0x7fc9ac1f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 >> 172.21.15.104:0/1379129124 conn(0x7fc9ac0b2450 msgr2=0x7fc9ac0cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 shutdown_connections 2024-09-17T03:02:03.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:03.873+0000 7fc9b2b6e640 1 -- 172.21.15.104:0/1379129124 wait complete. 2024-09-17T03:02:03.882 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:02:03.883 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:02:03.883 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T03:02:03.883 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:02:03.883 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:02:03.883 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:02:03.883 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:02:03.883 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:02:03.883 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:02:03.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:03.883 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T03:02:03.903 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:02:03.903 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:02:03.903 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:02:03.903 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:03.903 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:02:03.904 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42370sec preferred_lft 42370sec 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:03.905 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:02:03.906 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:02:03.906 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T03:02:03.906 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:02:03.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:03.906 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:02:03.971 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T03:02:03.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:03.973 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T03:02:04.032 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T03:02:04.032 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:02:04.032 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:02:04.032 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:02:04.032 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:02:04.033 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:02:04.033 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T03:02:04.033 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:02:04.033 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:02:04.033 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:02:04.033 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T03:02:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:02:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:02:04.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:02:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:02:04.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:04.163 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T03:02:04.178 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:02:04.178 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:02:04.179 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:02:04.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:04.179 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T03:02:04.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:02:04.244 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:02:04.299 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:02:04.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:02:04.299 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:02:04.353 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:02:04.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:04.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:02:04.448 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:02:04.449 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:02:04.449 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:02:04.459 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:02:04.460 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:02:04.460 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:02:04.460 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:02:04.460 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:02:04.465 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:02:04.465 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:02:04.465 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:02:04.465 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:02:04.465 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:02:04.465 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:02:04.465 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:02:04.465 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:02:04.466 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:02:04.466 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:02:04.466 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:02:04.466 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:02:04.466 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:02:04.467 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:02:04.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:02:04.467 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:02:04.491 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:02:04.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:02:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:02:04.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:02:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:02:04.588 INFO:teuthology.orchestra.run.smithi192.stdout:client6955 2024-09-17T03:02:04.588 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:02:04.589 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:02:04.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:02:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.720+0000 7f0783a9d640 1 -- 172.21.15.104:0/2010446368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 msgr2=0x7f077c0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.720+0000 7f0783a9d640 1 --2- 172.21.15.104:0/2010446368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 0x7f077c0d0880 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f077c0d0380 tx=0x7f076c02a440 comp rx=0 tx=0).stop 2024-09-17T03:02:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.720+0000 7f0783a9d640 1 -- 172.21.15.104:0/2010446368 shutdown_connections 2024-09-17T03:02:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.720+0000 7f0783a9d640 1 --2- 172.21.15.104:0/2010446368 >> v2:172.21.15.192:3300/0 conn(0x7f077c0cefb0 0x7f077c0cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.720+0000 7f0783a9d640 1 --2- 172.21.15.104:0/2010446368 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 0x7f077c0d0880 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.720+0000 7f0783a9d640 1 --2- 172.21.15.104:0/2010446368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077c0b7bb0 0x7f077c0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.720+0000 7f0783a9d640 1 -- 172.21.15.104:0/2010446368 >> 172.21.15.104:0/2010446368 conn(0x7f077c0d28a0 msgr2=0x7f077c0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:04.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.721+0000 7f0783a9d640 1 -- 172.21.15.104:0/2010446368 shutdown_connections 2024-09-17T03:02:04.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.721+0000 7f0783a9d640 1 -- 172.21.15.104:0/2010446368 wait complete. 2024-09-17T03:02:04.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.722+0000 7f0783a9d640 1 Processor -- start 2024-09-17T03:02:04.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.722+0000 7f0783a9d640 1 -- start start 2024-09-17T03:02:04.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f0783a9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f077c0b7bb0 0x7f077c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:04.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f0783a9d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077c0cefb0 0x7f077c0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:04.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f0783a9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 0x7f077c0cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:04.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f0783a9d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f077c0b3590 con 0x7f077c0d0470 2024-09-17T03:02:04.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f0783a9d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f077c0ce5e0 con 0x7f077c0b7bb0 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f0783a9d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f077c0cf900 con 0x7f077c0cefb0 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 0x7f077c0cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f0781839640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f077c0b7bb0 0x7f077c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 0x7f077c0cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38444/0 (socket says 172.21.15.104:38444) 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 -- 172.21.15.104:0/723306425 learned_addr learned my addr 172.21.15.104:0/723306425 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f0781038640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077c0cefb0 0x7f077c0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 -- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077c0cefb0 msgr2=0x7f077c0b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077c0cefb0 0x7f077c0b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 -- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f077c0b7bb0 msgr2=0x7f077c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f077c0b7bb0 0x7f077c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 -- 172.21.15.104:0/723306425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c0cc880 con 0x7f077c0d0470 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f078203a640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 0x7f077c0cb590 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f077400caa0 tx=0x7f077400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:04.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.724+0000 7f07727fc640 1 -- 172.21.15.104:0/723306425 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077400adf0 con 0x7f077c0d0470 2024-09-17T03:02:04.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.725+0000 7f07727fc640 1 -- 172.21.15.104:0/723306425 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f077400f540 con 0x7f077c0d0470 2024-09-17T03:02:04.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.725+0000 7f07727fc640 1 -- 172.21.15.104:0/723306425 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077400f990 con 0x7f077c0d0470 2024-09-17T03:02:04.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.725+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c0ccb60 con 0x7f077c0d0470 2024-09-17T03:02:04.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.725+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c0c9c60 con 0x7f077c0d0470 2024-09-17T03:02:04.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.726+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c0b5900 con 0x7f077c0d0470 2024-09-17T03:02:04.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.726+0000 7f07727fc640 1 -- 172.21.15.104:0/723306425 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f077400fb30 con 0x7f077c0d0470 2024-09-17T03:02:04.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.727+0000 7f07727fc640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0760078b90 0x7f076007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:04.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.727+0000 7f07727fc640 1 -- 172.21.15.104:0/723306425 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f077409b6a0 con 0x7f077c0d0470 2024-09-17T03:02:04.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.727+0000 7f0781839640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0760078b90 0x7f076007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:04.726 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.728+0000 7f0781839640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0760078b90 0x7f076007b0a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0778005860 tx=0x7f0778005f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:04.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.732+0000 7f07727fc640 1 -- 172.21.15.104:0/723306425 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f077c0b5900 con 0x7f077c0d0470 2024-09-17T03:02:04.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.939+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f077c0d3030 con 0x7f077c0d0470 2024-09-17T03:02:04.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.940+0000 7f07727fc640 1 -- 172.21.15.104:0/723306425 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5237 (secure 0 0 0) 0x7f0774014030 con 0x7f077c0d0470 2024-09-17T03:02:04.938 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:02:04.938 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":62,"btime":"2024-09-17T03:01:55:313759+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1088380573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1088380573},{"type":"v1","addr":"172.21.15.192:6836","nonce":1088380573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3930263372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3930263372},{"type":"v1","addr":"172.21.15.192:6837","nonce":3930263372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7449,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2263721697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2263721697},{"type":"v1","addr":"172.21.15.104:6834","nonce":2263721697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:01:52.648279+0000","modified":"2024-09-17T03:01:54.664367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1696726463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1696726463},{"type":"v1","addr":"172.21.15.104:6835","nonce":1696726463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7452,"qdb_cluster":[7452]},"id":9}]} 2024-09-17T03:02:04.939 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 62 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0760078b90 msgr2=0x7f076007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0760078b90 0x7f076007b0a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0778005860 tx=0x7f0778005f50 comp rx=0 tx=0).stop 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 msgr2=0x7f077c0cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 0x7f077c0cb590 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f077400caa0 tx=0x7f077400cf60 comp rx=0 tx=0).stop 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 shutdown_connections 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0760078b90 0x7f076007b0a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f077c0d0470 0x7f077c0cb590 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f077c0cefb0 0x7f077c0b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 --2- 172.21.15.104:0/723306425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f077c0b7bb0 0x7f077c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 >> 172.21.15.104:0/723306425 conn(0x7f077c0d28a0 msgr2=0x7f077c071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:04.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 shutdown_connections 2024-09-17T03:02:04.942 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:04.942+0000 7f0783a9d640 1 -- 172.21.15.104:0/723306425 wait complete. 2024-09-17T03:02:04.952 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-17T03:02:05.076 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":7452,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.779845549999999,"mdsmap_epoch":62,"osdmap_epoch":153,"osdmap_epoch_barrier":153,"uptime":16.481222043999999} 2024-09-17T03:02:05.077 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 7452, "mdsmap_epoch": 62, "osdmap_epoch": 153, "osdmap_epoch_barrier": 153, "rank_uptime": 11.77984555, "state": "up:active", "uptime": 16.481222044, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:02:05.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-17T03:02:05.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.194+0000 7f1c2bba1640 1 -- 172.21.15.104:0/2883090628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c240d1c80 msgr2=0x7f1c240d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:05.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.194+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/2883090628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c240d1c80 0x7f1c240d2090 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1c240b46b0 tx=0x7f1c1402a560 comp rx=0 tx=0).stop 2024-09-17T03:02:05.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.194+0000 7f1c2bba1640 1 -- 172.21.15.104:0/2883090628 shutdown_connections 2024-09-17T03:02:05.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.194+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/2883090628 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c240d1c80 0x7f1c240d2090 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:05.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.194+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/2883090628 >> v2:172.21.15.192:3300/0 conn(0x7f1c24155d90 0x7f1c241561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:05.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.194+0000 7f1c2bba1640 1 -- 172.21.15.104:0/2883090628 >> 172.21.15.104:0/2883090628 conn(0x7f1c24068ee0 msgr2=0x7f1c240692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:05.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.194+0000 7f1c2bba1640 1 -- 172.21.15.104:0/2883090628 shutdown_connections 2024-09-17T03:02:05.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.194+0000 7f1c2bba1640 1 -- 172.21.15.104:0/2883090628 wait complete. 2024-09-17T03:02:05.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.196+0000 7f1c2bba1640 1 Processor -- start 2024-09-17T03:02:05.194 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.196+0000 7f1c2bba1640 1 -- start start 2024-09-17T03:02:05.196 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2bba1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c240d1c80 0x7f1c241f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2bba1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c24155d90 0x7f1c241538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2bba1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2415f7f0 0x7f1c240aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2bba1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24070f80 con 0x7f1c24155d90 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2bba1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24070e00 con 0x7f1c2415f7f0 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2bba1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1c24071100 con 0x7f1c240d1c80 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2913c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c24155d90 0x7f1c241538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2913c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c24155d90 0x7f1c241538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38470/0 (socket says 172.21.15.104:38470) 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2913c640 1 -- 172.21.15.104:0/3781297117 learned_addr learned my addr 172.21.15.104:0/3781297117 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2a13e640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2415f7f0 0x7f1c240aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2993d640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c240d1c80 0x7f1c241f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2913c640 1 -- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c240d1c80 msgr2=0x7f1c241f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:05.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2913c640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c240d1c80 0x7f1c241f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2913c640 1 -- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2415f7f0 msgr2=0x7f1c240aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2913c640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2415f7f0 0x7f1c240aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2913c640 1 -- 172.21.15.104:0/3781297117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c24158450 con 0x7f1c24155d90 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2a13e640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2415f7f0 0x7f1c240aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.197+0000 7f1c2993d640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c240d1c80 0x7f1c241f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.198+0000 7f1c2913c640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c24155d90 0x7f1c241538c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1c14000c00 tx=0x7f1c140039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.198+0000 7f1c1a7fc640 1 -- 172.21.15.104:0/3781297117 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1403e030 con 0x7f1c24155d90 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.198+0000 7f1c1a7fc640 1 -- 172.21.15.104:0/3781297117 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c140047a0 con 0x7f1c24155d90 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.198+0000 7f1c1a7fc640 1 -- 172.21.15.104:0/3781297117 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14035040 con 0x7f1c24155d90 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.198+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c24158730 con 0x7f1c24155d90 2024-09-17T03:02:05.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.198+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c241f4000 con 0x7f1c24155d90 2024-09-17T03:02:05.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.199+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c240d2090 con 0x7f1c24155d90 2024-09-17T03:02:05.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.200+0000 7f1c1a7fc640 1 -- 172.21.15.104:0/3781297117 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c14041030 con 0x7f1c24155d90 2024-09-17T03:02:05.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.200+0000 7f1c1a7fc640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c08078b90 0x7f1c0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:02:05.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.200+0000 7f1c1a7fc640 1 -- 172.21.15.104:0/3781297117 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f1c140bb9c0 con 0x7f1c24155d90 2024-09-17T03:02:05.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.200+0000 7f1c2993d640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c08078b90 0x7f1c0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:02:05.200 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.201+0000 7f1c2993d640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c08078b90 0x7f1c0807b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1c20005860 tx=0x7f1c20005c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:02:05.202 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.204+0000 7f1c1a7fc640 1 -- 172.21.15.104:0/3781297117 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c240d25d0 con 0x7f1c24155d90 2024-09-17T03:02:05.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:05.381+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f1c240b5970 con 0x7f1c24155d90 2024-09-17T03:02:06.346 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:02:06.349 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:02:06.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.370+0000 7f1c1a7fc640 1 -- 172.21.15.104:0/3781297117 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v154) ==== 181+0+0 (secure 0 0 0) 0x7f1c14083ee0 con 0x7f1c24155d90 2024-09-17T03:02:06.369 INFO:teuthology.orchestra.run.smithi104.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c08078b90 msgr2=0x7f1c0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c08078b90 0x7f1c0807b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1c20005860 tx=0x7f1c20005c80 comp rx=0 tx=0).stop 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c24155d90 msgr2=0x7f1c241538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c24155d90 0x7f1c241538c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1c14000c00 tx=0x7f1c140039e0 comp rx=0 tx=0).stop 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 shutdown_connections 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1c08078b90 0x7f1c0807b0a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c2415f7f0 0x7f1c240aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1c24155d90 0x7f1c241538c0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 --2- 172.21.15.104:0/3781297117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c240d1c80 0x7f1c241f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 >> 172.21.15.104:0/3781297117 conn(0x7f1c24068ee0 msgr2=0x7f1c2415fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:02:06.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 shutdown_connections 2024-09-17T03:02:06.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:02:06.373+0000 7f1c2bba1640 1 -- 172.21.15.104:0/3781297117 wait complete. 2024-09-17T03:02:06.387 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-17T03:02:06.576 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_mon_report_interval":"5"} 2024-09-17T03:02:06.576 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-17T03:02:06.577 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-17T03:02:06.689 INFO:teuthology.orchestra.run.smithi104.stdout:{"mon_tick_interval":"5"} 2024-09-17T03:02:06.689 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-17T03:02:06.690 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> import time 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> import datetime 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> # Write some buffered data through before going full, all should be well 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> print("writing some data through which we expect to succeed") 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> bytes = 0 2024-09-17T03:02:06.690 DEBUG:teuthology.orchestra.run.smithi104:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(f) 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> # buffered IO, the error should always only appear from fsync and not 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> # from write 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> full = False 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> for n in range(0, int(32 * 0.9)): 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-17T03:02:06.691 DEBUG:teuthology.orchestra.run.smithi104:> print("done writing {0} bytes".format(bytes)) 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> # OK, now we should sneak in under the full condition 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> # due to the time it takes the OSDs to report to the 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> # mons, and get a successful fsync on our full-making data 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(f) 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> # buffered write, add more dirty data to the buffer 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> print("starting buffered write") 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> try: 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> for n in range(0, int(32 * 0.2)): 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-17T03:02:06.692 DEBUG:teuthology.orchestra.run.smithi104:> time.sleep(15.0) 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> except OSError: 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> pass; 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> # Wait long enough for a background flush that should fail 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> time.sleep(30) 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> if False: 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> # ...and check that the failed background flush is reflected in fclose 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> try: 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> os.close(f) 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> except OSError: 2024-09-17T03:02:06.693 DEBUG:teuthology.orchestra.run.smithi104:> print("close() returned an error as expected") 2024-09-17T03:02:06.694 DEBUG:teuthology.orchestra.run.smithi104:> else: 2024-09-17T03:02:06.694 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("close() failed to raise error") 2024-09-17T03:02:06.694 DEBUG:teuthology.orchestra.run.smithi104:> else: 2024-09-17T03:02:06.694 DEBUG:teuthology.orchestra.run.smithi104:> # The kernel cephfs client does not raise errors on fclose 2024-09-17T03:02:06.694 DEBUG:teuthology.orchestra.run.smithi104:> os.close(f) 2024-09-17T03:02:06.694 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:02:06.694 DEBUG:teuthology.orchestra.run.smithi104:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-17T03:02:06.694 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T03:02:36.466 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:02:36.470 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:03:06.558 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:03:06.561 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:03:36.711 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:03:36.715 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:04:06.977 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:04:06.981 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:04:08.715 INFO:teuthology.orchestra.run.smithi104.stdout:writing some data through which we expect to succeed 2024-09-17T03:04:08.715 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-17T03:04:08.715 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-17T03:04:08.715 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-17T03:04:08.715 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-17T03:04:08.715 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-17T03:04:08.715 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-17T03:04:08.715 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-17T03:04:08.716 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:done writing 29884416 bytes 2024-09-17T03:04:08.717 INFO:teuthology.orchestra.run.smithi104.stdout:successfully fsync'ed prior to getting full state reported 2024-09-17T03:04:08.718 INFO:teuthology.orchestra.run.smithi104.stdout:starting buffered write 2024-09-17T03:04:08.718 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:04:08.718 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:04:08.718 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:04:08.718 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:04:08.718 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:04:08.718 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:04:08.718 INFO:teuthology.orchestra.run.smithi104.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-17T03:04:08.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:04:08.729 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:04:08.729 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:04:08.771 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:04:08.825 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:04:08.825 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:04:08.825 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:04:08.825 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:08.843 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:04:08.843 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:08.901 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:04:09.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 -- 172.21.15.104:0/2345663516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 msgr2=0x7fa83006f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 --2- 172.21.15.104:0/2345663516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 0x7fa83006f540 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fa8300ce520 tx=0x7fa82002a560 comp rx=0 tx=0).stop 2024-09-17T03:04:09.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 -- 172.21.15.104:0/2345663516 shutdown_connections 2024-09-17T03:04:09.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 --2- 172.21.15.104:0/2345663516 >> v2:172.21.15.192:3300/0 conn(0x7fa830073ac0 0x7fa83015f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 --2- 172.21.15.104:0/2345663516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa83006fa80 0x7fa830073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 --2- 172.21.15.104:0/2345663516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 0x7fa83006f540 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 -- 172.21.15.104:0/2345663516 >> 172.21.15.104:0/2345663516 conn(0x7fa8300b3640 msgr2=0x7fa8300b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 -- 172.21.15.104:0/2345663516 shutdown_connections 2024-09-17T03:04:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.063+0000 7fa835816640 1 -- 172.21.15.104:0/2345663516 wait complete. 2024-09-17T03:04:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.065+0000 7fa835816640 1 Processor -- start 2024-09-17T03:04:09.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.065+0000 7fa835816640 1 -- start start 2024-09-17T03:04:09.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa835816640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa83006fa80 0x7fa83013ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa835816640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa830073ac0 0x7fa8301f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa835816640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 0x7fa8301e8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa835816640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa83015ff60 con 0x7fa830152ce0 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa835816640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa83015fde0 con 0x7fa830073ac0 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa835816640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa8301600e0 con 0x7fa83006fa80 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 0x7fa8301e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 0x7fa8301e8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49454/0 (socket says 172.21.15.104:49454) 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 -- 172.21.15.104:0/3176294161 learned_addr learned my addr 172.21.15.104:0/3176294161 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa8267fc640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa830073ac0 0x7fa8301f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82effd640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa83006fa80 0x7fa83013ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:09.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 -- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa83006fa80 msgr2=0x7fa83013ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa83006fa80 0x7fa83013ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 -- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa830073ac0 msgr2=0x7fa8301f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa830073ac0 0x7fa8301f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 -- 172.21.15.104:0/3176294161 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83013f100 con 0x7fa830152ce0 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82f7fe640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 0x7fa8301e8940 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa82800e960 tx=0x7fa82800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82cff9640 1 -- 172.21.15.104:0/3176294161 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828004d20 con 0x7fa830152ce0 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82cff9640 1 -- 172.21.15.104:0/3176294161 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa82800cb20 con 0x7fa830152ce0 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8301f8250 con 0x7fa830152ce0 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.067+0000 7fa82cff9640 1 -- 172.21.15.104:0/3176294161 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828005020 con 0x7fa830152ce0 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.068+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa830141890 con 0x7fa830152ce0 2024-09-17T03:04:09.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.068+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83015f690 con 0x7fa830152ce0 2024-09-17T03:04:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.069+0000 7fa82cff9640 1 -- 172.21.15.104:0/3176294161 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8280051c0 con 0x7fa830152ce0 2024-09-17T03:04:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.070+0000 7fa82cff9640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa810078b90 0x7fa81007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.070+0000 7fa82cff9640 1 -- 172.21.15.104:0/3176294161 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7fa82809b5b0 con 0x7fa830152ce0 2024-09-17T03:04:09.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.070+0000 7fa82cff9640 1 -- 172.21.15.104:0/3176294161 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7fa8100807d0 con 0x7fa830152ce0 2024-09-17T03:04:09.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.070+0000 7fa82effd640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa810078b90 0x7fa81007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:09.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.071+0000 7fa82effd640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa810078b90 0x7fa81007b0a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa820033000 tx=0x7fa820004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:09.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.074+0000 7fa82cff9640 1 -- 172.21.15.104:0/3176294161 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa828016030 con 0x7fa830152ce0 2024-09-17T03:04:09.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.257+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa8300d2270 con 0x7fa830152ce0 2024-09-17T03:04:09.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.257+0000 7fa82cff9640 1 -- 172.21.15.104:0/3176294161 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v157) ==== 80+0+0 (secure 0 0 0) 0x7fa8280633f0 con 0x7fa830152ce0 2024-09-17T03:04:09.257 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:04:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa810078b90 msgr2=0x7fa81007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa810078b90 0x7fa81007b0a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa820033000 tx=0x7fa820004730 comp rx=0 tx=0).stop 2024-09-17T03:04:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 msgr2=0x7fa8301e8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.259 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 0x7fa8301e8940 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa82800e960 tx=0x7fa82800ee20 comp rx=0 tx=0).stop 2024-09-17T03:04:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 shutdown_connections 2024-09-17T03:04:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa810078b90 0x7fa81007b0a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa830073ac0 0x7fa8301f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa830152ce0 0x7fa8301e8940 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 --2- 172.21.15.104:0/3176294161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa83006fa80 0x7fa83013ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.259+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 >> 172.21.15.104:0/3176294161 conn(0x7fa8300b3640 msgr2=0x7fa8301551d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.260+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 shutdown_connections 2024-09-17T03:04:09.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.260+0000 7fa835816640 1 -- 172.21.15.104:0/3176294161 wait complete. 2024-09-17T03:04:09.270 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:04:09.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:09.271 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:04:09.300 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:04:09.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:09.301 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:04:09.357 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:04:09.357 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:04:09.357 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:09.377 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:04:09.378 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:09.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:04:09.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.554+0000 7f24572b6640 1 -- 172.21.15.104:0/3686256130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500d18e0 msgr2=0x7f245015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.554+0000 7f24572b6640 1 --2- 172.21.15.104:0/3686256130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500d18e0 0x7f245015ef90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f24500d0c10 tx=0x7f244002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.554+0000 7f24572b6640 1 -- 172.21.15.104:0/3686256130 shutdown_connections 2024-09-17T03:04:09.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.554+0000 7f24572b6640 1 --2- 172.21.15.104:0/3686256130 >> v2:172.21.15.192:3300/0 conn(0x7f24500b3b00 0x7f24500d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.554+0000 7f24572b6640 1 --2- 172.21.15.104:0/3686256130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500d18e0 0x7f245015ef90 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.554+0000 7f24572b6640 1 -- 172.21.15.104:0/3686256130 >> 172.21.15.104:0/3686256130 conn(0x7f2450073df0 msgr2=0x7f2450068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:09.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.554+0000 7f24572b6640 1 -- 172.21.15.104:0/3686256130 shutdown_connections 2024-09-17T03:04:09.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.554+0000 7f24572b6640 1 -- 172.21.15.104:0/3686256130 wait complete. 2024-09-17T03:04:09.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.556+0000 7f24572b6640 1 Processor -- start 2024-09-17T03:04:09.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.556+0000 7f24572b6640 1 -- start start 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f24572b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500b3b00 0x7f2450155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f24572b6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24500b6f70 0x7f24500c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f24572b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24500d18e0 0x7f24500c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f24572b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f24500d3dc0 con 0x7f24500b3b00 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f24572b6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24500d3c40 con 0x7f24500b6f70 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f24572b6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f24500d3f40 con 0x7f24500d18e0 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2455052640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500b3b00 0x7f2450155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2455052640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500b3b00 0x7f2450155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49462/0 (socket says 172.21.15.104:49462) 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2455052640 1 -- 172.21.15.104:0/3200626263 learned_addr learned my addr 172.21.15.104:0/3200626263 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2454851640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24500b6f70 0x7f24500c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2455853640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24500d18e0 0x7f24500c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:09.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2455052640 1 -- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24500d18e0 msgr2=0x7f24500c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2455052640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24500d18e0 0x7f24500c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2455052640 1 -- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24500b6f70 msgr2=0x7f24500c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.557+0000 7f2455052640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24500b6f70 0x7f24500c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.558+0000 7f2455052640 1 -- 172.21.15.104:0/3200626263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24500cdac0 con 0x7f24500b3b00 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.558+0000 7f2454851640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24500b6f70 0x7f24500c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.558+0000 7f2455052640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500b3b00 0x7f2450155d40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b410 tx=0x7f244c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.558+0000 7f2445ffb640 1 -- 172.21.15.104:0/3200626263 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c015020 con 0x7f24500b3b00 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.558+0000 7f2445ffb640 1 -- 172.21.15.104:0/3200626263 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f244c011920 con 0x7f24500b3b00 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.558+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24500cdd60 con 0x7f24500b3b00 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.558+0000 7f2445ffb640 1 -- 172.21.15.104:0/3200626263 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c011d70 con 0x7f24500b3b00 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.558+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24500cd1f0 con 0x7f24500b3b00 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.559+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24500d4490 con 0x7f24500b3b00 2024-09-17T03:04:09.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.560+0000 7f2445ffb640 1 -- 172.21.15.104:0/3200626263 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f244c018020 con 0x7f24500b3b00 2024-09-17T03:04:09.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.560+0000 7f2445ffb640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2434078bc0 0x7f243407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:09.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.560+0000 7f2445ffb640 1 -- 172.21.15.104:0/3200626263 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7f244c09ad10 con 0x7f24500b3b00 2024-09-17T03:04:09.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.561+0000 7f2445ffb640 1 -- 172.21.15.104:0/3200626263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7f2434080800 con 0x7f24500b3b00 2024-09-17T03:04:09.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.561+0000 7f2454851640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2434078bc0 0x7f243407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:09.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.561+0000 7f2454851640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2434078bc0 0x7f243407b0d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2440033000 tx=0x7f2440004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:09.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.565+0000 7f2445ffb640 1 -- 172.21.15.104:0/3200626263 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f244c01f020 con 0x7f24500b3b00 2024-09-17T03:04:09.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.750+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f245015f2b0 con 0x7f24500b3b00 2024-09-17T03:04:09.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.751+0000 7f2445ffb640 1 -- 172.21.15.104:0/3200626263 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v157) ==== 80+0+0 (secure 0 0 0) 0x7f244c0631a0 con 0x7f24500b3b00 2024-09-17T03:04:09.751 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2434078bc0 msgr2=0x7f243407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2434078bc0 0x7f243407b0d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2440033000 tx=0x7f2440004730 comp rx=0 tx=0).stop 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500b3b00 msgr2=0x7f2450155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500b3b00 0x7f2450155d40 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f244c00b410 tx=0x7f244c00b8d0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 shutdown_connections 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2434078bc0 0x7f243407b0d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24500b6f70 0x7f24500c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24500d18e0 0x7f24500c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 --2- 172.21.15.104:0/3200626263 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f24500b3b00 0x7f2450155d40 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 >> 172.21.15.104:0/3200626263 conn(0x7f2450073df0 msgr2=0x7f24500d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:09.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 shutdown_connections 2024-09-17T03:04:09.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:09.753+0000 7f24572b6640 1 -- 172.21.15.104:0/3200626263 wait complete. 2024-09-17T03:04:09.764 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:04:09.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:09.764 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:04:09.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:04:09.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:09.799 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:04:09.857 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:04:09.857 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:04:09.857 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:09.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:04:09.873 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:04:09.873 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:04:09.874 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:09.914 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:04:09.914 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:04:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.027+0000 7f2cf076e640 1 -- 172.21.15.104:0/4009780506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d3490 msgr2=0x7f2ce80b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.027+0000 7f2cf076e640 1 --2- 172.21.15.104:0/4009780506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d3490 0x7f2ce80b7c80 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4005fd0 tx=0x7f2ce402a510 comp rx=0 tx=0).stop 2024-09-17T03:04:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.027+0000 7f2cf076e640 1 -- 172.21.15.104:0/4009780506 shutdown_connections 2024-09-17T03:04:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.027+0000 7f2cf076e640 1 --2- 172.21.15.104:0/4009780506 >> v2:172.21.15.192:3300/0 conn(0x7f2ce80d13e0 0x7f2ce81615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.027+0000 7f2cf076e640 1 --2- 172.21.15.104:0/4009780506 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d3490 0x7f2ce80b7c80 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.027 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.027+0000 7f2cf076e640 1 -- 172.21.15.104:0/4009780506 >> 172.21.15.104:0/4009780506 conn(0x7f2ce80d2970 msgr2=0x7f2ce80d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.027+0000 7f2cf076e640 1 -- 172.21.15.104:0/4009780506 shutdown_connections 2024-09-17T03:04:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.027+0000 7f2cf076e640 1 -- 172.21.15.104:0/4009780506 wait complete. 2024-09-17T03:04:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.029+0000 7f2cf076e640 1 Processor -- start 2024-09-17T03:04:10.028 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.029+0000 7f2cf076e640 1 -- start start 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.030+0000 7f2cf076e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ce80d0fd0 0x7f2ce8152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.030+0000 7f2cf076e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d13e0 0x7f2ce8156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.030+0000 7f2cf076e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80d3490 0x7f2ce8156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.030+0000 7f2cf076e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80b6bd0 con 0x7f2ce80d13e0 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.030+0000 7f2cf076e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80b6a50 con 0x7f2ce80d3490 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.030+0000 7f2cf076e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce80b6d50 con 0x7f2ce80d0fd0 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.030+0000 7f2cedd09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d13e0 0x7f2ce8156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cedd09640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d13e0 0x7f2ce8156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49482/0 (socket says 172.21.15.104:49482) 2024-09-17T03:04:10.031 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cedd09640 1 -- 172.21.15.104:0/2459023572 learned_addr learned my addr 172.21.15.104:0/2459023572 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2ceed0b640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80d3490 0x7f2ce8156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cee50a640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ce80d0fd0 0x7f2ce8152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cedd09640 1 -- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ce80d0fd0 msgr2=0x7f2ce8152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cedd09640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ce80d0fd0 0x7f2ce8152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cedd09640 1 -- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80d3490 msgr2=0x7f2ce8156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cedd09640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80d3490 0x7f2ce8156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cedd09640 1 -- 172.21.15.104:0/2459023572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce8157850 con 0x7f2ce80d13e0 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cedd09640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d13e0 0x7f2ce8156a90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c3a0 tx=0x7f2cd800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cdeffd640 1 -- 172.21.15.104:0/2459023572 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8017070 con 0x7f2ce80d13e0 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cdeffd640 1 -- 172.21.15.104:0/2459023572 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cd80035f0 con 0x7f2ce80d13e0 2024-09-17T03:04:10.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce81f7820 con 0x7f2ce80d13e0 2024-09-17T03:04:10.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cdeffd640 1 -- 172.21.15.104:0/2459023572 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8003a40 con 0x7f2ce80d13e0 2024-09-17T03:04:10.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.031+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce81f7da0 con 0x7f2ce80d13e0 2024-09-17T03:04:10.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.032+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce80b7c80 con 0x7f2ce80d13e0 2024-09-17T03:04:10.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.033+0000 7f2cdeffd640 1 -- 172.21.15.104:0/2459023572 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2cd801a070 con 0x7f2ce80d13e0 2024-09-17T03:04:10.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.033+0000 7f2cdeffd640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.033+0000 7f2cdeffd640 1 -- 172.21.15.104:0/2459023572 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7f2cd8099f80 con 0x7f2ce80d13e0 2024-09-17T03:04:10.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.034+0000 7f2cdeffd640 1 -- 172.21.15.104:0/2459023572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7f2ccc080860 con 0x7f2ce80d13e0 2024-09-17T03:04:10.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.034+0000 7f2cee50a640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.034 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.034+0000 7f2cee50a640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4033000 tx=0x7f2ce4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:10.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.038+0000 7f2cdeffd640 1 -- 172.21.15.104:0/2459023572 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2cd8061dc0 con 0x7f2ce80d13e0 2024-09-17T03:04:10.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.248+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ce80d0900 con 0x7f2ce80d13e0 2024-09-17T03:04:10.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.249+0000 7f2cdeffd640 1 -- 172.21.15.104:0/2459023572 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5237 (secure 0 0 0) 0x7f2cd80667f0 con 0x7f2ce80d13e0 2024-09-17T03:04:10.249 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:10.249 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":62,"btime":"2024-09-17T03:01:55:313759+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1088380573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1088380573},{"type":"v1","addr":"172.21.15.192:6836","nonce":1088380573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3930263372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3930263372},{"type":"v1","addr":"172.21.15.192:6837","nonce":3930263372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7449,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2263721697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2263721697},{"type":"v1","addr":"172.21.15.104:6834","nonce":2263721697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:01:52.648279+0000","modified":"2024-09-17T03:01:54.664367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1696726463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1696726463},{"type":"v1","addr":"172.21.15.104:6835","nonce":1696726463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7452,"qdb_cluster":[7452]},"id":9}]} 2024-09-17T03:04:10.249 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 62 2024-09-17T03:04:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ccc078bc0 msgr2=0x7f2ccc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4033000 tx=0x7f2ce4004730 comp rx=0 tx=0).stop 2024-09-17T03:04:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d13e0 msgr2=0x7f2ce8156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d13e0 0x7f2ce8156a90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c3a0 tx=0x7f2cd800c860 comp rx=0 tx=0).stop 2024-09-17T03:04:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 shutdown_connections 2024-09-17T03:04:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2ccc078bc0 0x7f2ccc07b0d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80d3490 0x7f2ce8156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2ce80d13e0 0x7f2ce8156a90 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 --2- 172.21.15.104:0/2459023572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ce80d0fd0 0x7f2ce8152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 >> 172.21.15.104:0/2459023572 conn(0x7f2ce80d2970 msgr2=0x7f2ce80d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:10.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 shutdown_connections 2024-09-17T03:04:10.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.251+0000 7f2cf076e640 1 -- 172.21.15.104:0/2459023572 wait complete. 2024-09-17T03:04:10.262 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:04:10.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 -- 172.21.15.104:0/3130744207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 msgr2=0x7f442015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 --2- 172.21.15.104:0/3130744207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 0x7f442015ef90 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f44200b44d0 tx=0x7f441c02a4f0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 -- 172.21.15.104:0/3130744207 shutdown_connections 2024-09-17T03:04:10.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 --2- 172.21.15.104:0/3130744207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200d1710 0x7f44200cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 --2- 172.21.15.104:0/3130744207 >> v2:172.21.15.192:3300/0 conn(0x7f44200b3b00 0x7f44200d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 --2- 172.21.15.104:0/3130744207 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 0x7f442015ef90 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 -- 172.21.15.104:0/3130744207 >> 172.21.15.104:0/3130744207 conn(0x7f4420073df0 msgr2=0x7f4420068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 -- 172.21.15.104:0/3130744207 shutdown_connections 2024-09-17T03:04:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.375+0000 7f4427bc6640 1 -- 172.21.15.104:0/3130744207 wait complete. 2024-09-17T03:04:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.377+0000 7f4427bc6640 1 Processor -- start 2024-09-17T03:04:10.376 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.377+0000 7f4427bc6640 1 -- start start 2024-09-17T03:04:10.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.378+0000 7f4427bc6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200b3b00 0x7f44201fe590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4427bc6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 0x7f4420158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4427bc6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200d1710 0x7f44200cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4427bc6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f44200d01f0 con 0x7f44200b6f70 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4427bc6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f44200d0070 con 0x7f44200b3b00 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4427bc6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f44200d0370 con 0x7f44200d1710 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 0x7f4420158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 0x7f4420158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49496/0 (socket says 172.21.15.104:49496) 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 -- 172.21.15.104:0/371954776 learned_addr learned my addr 172.21.15.104:0/371954776 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 -- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200d1710 msgr2=0x7f44200cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425962640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200b3b00 0x7f44201fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4426163640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200d1710 0x7f44200cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200d1710 0x7f44200cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 -- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200b3b00 msgr2=0x7f44201fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200b3b00 0x7f44201fe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 -- 172.21.15.104:0/371954776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44201fead0 con 0x7f44200b6f70 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425962640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200b3b00 0x7f44201fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4426163640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200d1710 0x7f44200cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4425161640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 0x7f4420158a90 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f441000c940 tx=0x7f441000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f44167fc640 1 -- 172.21.15.104:0/371954776 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410004220 con 0x7f44200b6f70 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f44167fc640 1 -- 172.21.15.104:0/371954776 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44100079b0 con 0x7f44200b6f70 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44200cbf70 con 0x7f44200b6f70 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f44167fc640 1 -- 172.21.15.104:0/371954776 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410007e20 con 0x7f44200b6f70 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.379+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44200cc530 con 0x7f44200b6f70 2024-09-17T03:04:10.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.380+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44200cbce0 con 0x7f44200b6f70 2024-09-17T03:04:10.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.381+0000 7f44167fc640 1 -- 172.21.15.104:0/371954776 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4410005020 con 0x7f44200b6f70 2024-09-17T03:04:10.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.382+0000 7f44167fc640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4404078b90 0x7f440407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.382+0000 7f44167fc640 1 -- 172.21.15.104:0/371954776 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7f441009b500 con 0x7f44200b6f70 2024-09-17T03:04:10.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.382+0000 7f44167fc640 1 -- 172.21.15.104:0/371954776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7f4404080830 con 0x7f44200b6f70 2024-09-17T03:04:10.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.382+0000 7f4425962640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4404078b90 0x7f440407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.383+0000 7f4425962640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4404078b90 0x7f440407b0a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f441c033000 tx=0x7f441c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:10.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.385+0000 7f44167fc640 1 -- 172.21.15.104:0/371954776 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4410014030 con 0x7f44200b6f70 2024-09-17T03:04:10.594 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.595+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44200b4a60 con 0x7f44200b6f70 2024-09-17T03:04:10.595 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.595+0000 7f44167fc640 1 -- 172.21.15.104:0/371954776 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5237 (secure 0 0 0) 0x7f44200b4a60 con 0x7f44200b6f70 2024-09-17T03:04:10.595 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:10.595 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":62,"btime":"2024-09-17T03:01:55:313759+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1088380573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1088380573},{"type":"v1","addr":"172.21.15.192:6836","nonce":1088380573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3930263372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3930263372},{"type":"v1","addr":"172.21.15.192:6837","nonce":3930263372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7449,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2263721697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2263721697},{"type":"v1","addr":"172.21.15.104:6834","nonce":2263721697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:01:52.648279+0000","modified":"2024-09-17T03:01:54.664367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1696726463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1696726463},{"type":"v1","addr":"172.21.15.104:6835","nonce":1696726463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7452,"qdb_cluster":[7452]},"id":9}]} 2024-09-17T03:04:10.595 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 62 2024-09-17T03:04:10.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4404078b90 msgr2=0x7f440407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4404078b90 0x7f440407b0a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f441c033000 tx=0x7f441c004730 comp rx=0 tx=0).stop 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 msgr2=0x7f4420158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 0x7f4420158a90 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f441000c940 tx=0x7f441000ce00 comp rx=0 tx=0).stop 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 shutdown_connections 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4404078b90 0x7f440407b0a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f44200d1710 0x7f44200cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f44200b6f70 0x7f4420158a90 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 --2- 172.21.15.104:0/371954776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44200b3b00 0x7f44201fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 >> 172.21.15.104:0/371954776 conn(0x7f4420073df0 msgr2=0x7f44200b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 shutdown_connections 2024-09-17T03:04:10.598 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.598+0000 7f4427bc6640 1 -- 172.21.15.104:0/371954776 wait complete. 2024-09-17T03:04:10.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:04:10.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.720+0000 7f070068c640 1 -- 172.21.15.104:0/1140198703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f80cf290 msgr2=0x7f06f81668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.720+0000 7f070068c640 1 --2- 172.21.15.104:0/1140198703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f80cf290 0x7f06f81668a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f06e8005fd0 tx=0x7f06e802a820 comp rx=0 tx=0).stop 2024-09-17T03:04:10.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.720+0000 7f070068c640 1 -- 172.21.15.104:0/1140198703 shutdown_connections 2024-09-17T03:04:10.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.720+0000 7f070068c640 1 --2- 172.21.15.104:0/1140198703 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f80cf290 0x7f06f81668a0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.720+0000 7f070068c640 1 -- 172.21.15.104:0/1140198703 >> 172.21.15.104:0/1140198703 conn(0x7f06f80b2450 msgr2=0x7f06f80b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:10.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.720+0000 7f070068c640 1 -- 172.21.15.104:0/1140198703 shutdown_connections 2024-09-17T03:04:10.720 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.720+0000 7f070068c640 1 -- 172.21.15.104:0/1140198703 wait complete. 2024-09-17T03:04:10.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.721+0000 7f070068c640 1 Processor -- start 2024-09-17T03:04:10.721 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.722+0000 7f070068c640 1 -- start start 2024-09-17T03:04:10.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f070068c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06f80cf290 0x7f06f814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f070068c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f815b7f0 0x7f06f81f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f070068c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06f815bc00 0x7f06f815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f070068c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8166f60 con 0x7f06f815b7f0 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f070068c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8166de0 con 0x7f06f815bc00 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f070068c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f06f81670e0 con 0x7f06f80cf290 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fdc27640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f815b7f0 0x7f06f81f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fdc27640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f815b7f0 0x7f06f81f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49508/0 (socket says 172.21.15.104:49508) 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fdc27640 1 -- 172.21.15.104:0/1697845203 learned_addr learned my addr 172.21.15.104:0/1697845203 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fe428640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06f80cf290 0x7f06f814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fec29640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06f815bc00 0x7f06f815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fdc27640 1 -- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06f80cf290 msgr2=0x7f06f814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fdc27640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06f80cf290 0x7f06f814c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fdc27640 1 -- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06f815bc00 msgr2=0x7f06f815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fdc27640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06f815bc00 0x7f06f815cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.723+0000 7f06fdc27640 1 -- 172.21.15.104:0/1697845203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f814eff0 con 0x7f06f815b7f0 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.724+0000 7f06fdc27640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f815b7f0 0x7f06f81f4410 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c3d0 tx=0x7f06ec00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.724+0000 7f06f6ffd640 1 -- 172.21.15.104:0/1697845203 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec011790 con 0x7f06f815b7f0 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.724+0000 7f06f6ffd640 1 -- 172.21.15.104:0/1697845203 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06ec017070 con 0x7f06f815b7f0 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.724+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f814f2d0 con 0x7f06f815b7f0 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.724+0000 7f06f6ffd640 1 -- 172.21.15.104:0/1697845203 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec011cc0 con 0x7f06f815b7f0 2024-09-17T03:04:10.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.724+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f815c480 con 0x7f06f815b7f0 2024-09-17T03:04:10.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.725+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f8072470 con 0x7f06f815b7f0 2024-09-17T03:04:10.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.725+0000 7f06f6ffd640 1 -- 172.21.15.104:0/1697845203 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06ec01c460 con 0x7f06f815b7f0 2024-09-17T03:04:10.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.726+0000 7f06f6ffd640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06e4078b90 0x7f06e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:10.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.726+0000 7f06f6ffd640 1 -- 172.21.15.104:0/1697845203 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7f06ec09aa90 con 0x7f06f815b7f0 2024-09-17T03:04:10.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.726+0000 7f06fe428640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06e4078b90 0x7f06e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:10.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.726+0000 7f06f6ffd640 1 -- 172.21.15.104:0/1697845203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7f06e4080830 con 0x7f06f815b7f0 2024-09-17T03:04:10.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.727+0000 7f06fe428640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06e4078b90 0x7f06e407b0a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f06f0006fd0 tx=0x7f06f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:10.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.731+0000 7f06f6ffd640 1 -- 172.21.15.104:0/1697845203 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f06ec062f20 con 0x7f06f815b7f0 2024-09-17T03:04:10.904 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.905+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06f81539e0 con 0x7f06f815b7f0 2024-09-17T03:04:10.905 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.906+0000 7f06f6ffd640 1 -- 172.21.15.104:0/1697845203 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+16856 (secure 0 0 0) 0x7f06ec062820 con 0x7f06f815b7f0 2024-09-17T03:04:10.906 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:10.906 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":157,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:03:03.165083+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:01:50.286371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:01:51.606939+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.23","mappings":[{"from":2,"to":0}]},{"pgid":"19.33","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:04:10.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06e4078b90 msgr2=0x7f06e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06e4078b90 0x7f06e407b0a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f06f0006fd0 tx=0x7f06f0008040 comp rx=0 tx=0).stop 2024-09-17T03:04:10.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f815b7f0 msgr2=0x7f06f81f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:10.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f815b7f0 0x7f06f81f4410 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c3d0 tx=0x7f06ec00c890 comp rx=0 tx=0).stop 2024-09-17T03:04:10.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 shutdown_connections 2024-09-17T03:04:10.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f06e4078b90 0x7f06e407b0a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06f815bc00 0x7f06f815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.908 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f06f815b7f0 0x7f06f81f4410 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 --2- 172.21.15.104:0/1697845203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06f80cf290 0x7f06f814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:10.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 >> 172.21.15.104:0/1697845203 conn(0x7f06f80b2450 msgr2=0x7f06f8153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:10.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 shutdown_connections 2024-09-17T03:04:10.909 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:10.908+0000 7f070068c640 1 -- 172.21.15.104:0/1697845203 wait complete. 2024-09-17T03:04:10.920 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:04:10.920 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:04:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.032+0000 7f9d5098b640 1 -- 172.21.15.104:0/4022578858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d34006460 msgr2=0x7f9d3400cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.032+0000 7f9d5098b640 1 --2- 172.21.15.104:0/4022578858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d34006460 0x7f9d3400cad0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c610 tx=0x7f9d34006940 comp rx=0 tx=0).stop 2024-09-17T03:04:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.032+0000 7f9d5098b640 1 -- 172.21.15.104:0/4022578858 shutdown_connections 2024-09-17T03:04:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.032+0000 7f9d5098b640 1 --2- 172.21.15.104:0/4022578858 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d34006460 0x7f9d3400cad0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.032+0000 7f9d5098b640 1 -- 172.21.15.104:0/4022578858 >> 172.21.15.104:0/4022578858 conn(0x7f9d4c0b2450 msgr2=0x7f9d4c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.032+0000 7f9d5098b640 1 -- 172.21.15.104:0/4022578858 shutdown_connections 2024-09-17T03:04:11.032 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.032+0000 7f9d5098b640 1 -- 172.21.15.104:0/4022578858 wait complete. 2024-09-17T03:04:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.034+0000 7f9d5098b640 1 Processor -- start 2024-09-17T03:04:11.033 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.034+0000 7f9d5098b640 1 -- start start 2024-09-17T03:04:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.035+0000 7f9d5098b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d34006460 0x7f9d4c154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.035+0000 7f9d5098b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d4c156d40 0x7f9d4c1f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.035+0000 7f9d5098b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d4c157150 0x7f9d4c1f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.035+0000 7f9d5098b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c072e30 con 0x7f9d4c157150 2024-09-17T03:04:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.035+0000 7f9d5098b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4c06fe60 con 0x7f9d4c156d40 2024-09-17T03:04:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.035+0000 7f9d5098b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4c072fb0 con 0x7f9d34006460 2024-09-17T03:04:11.036 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d4c157150 0x7f9d4c1f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d4c157150 0x7f9d4c1f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49520/0 (socket says 172.21.15.104:49520) 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 -- 172.21.15.104:0/120370096 learned_addr learned my addr 172.21.15.104:0/120370096 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4a59c640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d34006460 0x7f9d4c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d49d9b640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d4c156d40 0x7f9d4c1f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 -- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d34006460 msgr2=0x7f9d4c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d34006460 0x7f9d4c154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 -- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d4c156d40 msgr2=0x7f9d4c1f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d4c156d40 0x7f9d4c1f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 -- 172.21.15.104:0/120370096 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4c0af090 con 0x7f9d4c157150 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d49d9b640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d4c156d40 0x7f9d4c1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d4ad9d640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d4c157150 0x7f9d4c1f57b0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c730 tx=0x7f9d44003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d3affd640 1 -- 172.21.15.104:0/120370096 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4402bb70 con 0x7f9d4c157150 2024-09-17T03:04:11.037 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d3affd640 1 -- 172.21.15.104:0/120370096 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d4403a070 con 0x7f9d4c157150 2024-09-17T03:04:11.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d3affd640 1 -- 172.21.15.104:0/120370096 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4402be60 con 0x7f9d4c157150 2024-09-17T03:04:11.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4c0ae510 con 0x7f9d4c157150 2024-09-17T03:04:11.038 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.036+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4c0aead0 con 0x7f9d4c157150 2024-09-17T03:04:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.037+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d4c15b2e0 con 0x7f9d4c157150 2024-09-17T03:04:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.038+0000 7f9d3affd640 1 -- 172.21.15.104:0/120370096 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d44006330 con 0x7f9d4c157150 2024-09-17T03:04:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.039+0000 7f9d3affd640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9d2c078b90 0x7f9d2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.039+0000 7f9d3affd640 1 -- 172.21.15.104:0/120370096 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7f9d440bb130 con 0x7f9d4c157150 2024-09-17T03:04:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.039+0000 7f9d4a59c640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9d2c078b90 0x7f9d2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.039+0000 7f9d3affd640 1 -- 172.21.15.104:0/120370096 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7f9d2c0807d0 con 0x7f9d4c157150 2024-09-17T03:04:11.039 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.040+0000 7f9d4a59c640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9d2c078b90 0x7f9d2c07b0a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c006540 tx=0x7f9d3c006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:11.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.044+0000 7f9d3affd640 1 -- 172.21.15.104:0/120370096 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9d440835c0 con 0x7f9d4c157150 2024-09-17T03:04:11.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.253+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d4c0b2fe0 con 0x7f9d4c157150 2024-09-17T03:04:11.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.253+0000 7f9d3affd640 1 -- 172.21.15.104:0/120370096 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5237 (secure 0 0 0) 0x7f9d44082ec0 con 0x7f9d4c157150 2024-09-17T03:04:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:11.253 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":62,"btime":"2024-09-17T03:01:55:313759+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1088380573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1088380573},{"type":"v1","addr":"172.21.15.192:6836","nonce":1088380573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3930263372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3930263372},{"type":"v1","addr":"172.21.15.192:6837","nonce":3930263372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7449,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2263721697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2263721697},{"type":"v1","addr":"172.21.15.104:6834","nonce":2263721697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:01:52.648279+0000","modified":"2024-09-17T03:01:54.664367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1696726463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1696726463},{"type":"v1","addr":"172.21.15.104:6835","nonce":1696726463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7452,"qdb_cluster":[7452]},"id":9}]} 2024-09-17T03:04:11.253 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 62 2024-09-17T03:04:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9d2c078b90 msgr2=0x7f9d2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9d2c078b90 0x7f9d2c07b0a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c006540 tx=0x7f9d3c006b70 comp rx=0 tx=0).stop 2024-09-17T03:04:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d4c157150 msgr2=0x7f9d4c1f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d4c157150 0x7f9d4c1f57b0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400c730 tx=0x7f9d44003c20 comp rx=0 tx=0).stop 2024-09-17T03:04:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 shutdown_connections 2024-09-17T03:04:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9d2c078b90 0x7f9d2c07b0a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d4c156d40 0x7f9d4c1f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d4c157150 0x7f9d4c1f57b0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 --2- 172.21.15.104:0/120370096 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d34006460 0x7f9d4c154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.255+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 >> 172.21.15.104:0/120370096 conn(0x7f9d4c0b2450 msgr2=0x7f9d4c0af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.256+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 shutdown_connections 2024-09-17T03:04:11.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.256+0000 7f9d5098b640 1 -- 172.21.15.104:0/120370096 wait complete. 2024-09-17T03:04:11.266 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:04:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.379+0000 7fdc9b44d640 1 -- 172.21.15.104:0/2951690099 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 msgr2=0x7fdc80004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.379+0000 7fdc9b44d640 1 --2- 172.21.15.104:0/2951690099 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 0x7fdc80004c10 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fdc9406f260 tx=0x7fdc80005830 comp rx=0 tx=0).stop 2024-09-17T03:04:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.379+0000 7fdc999ea640 1 -- 172.21.15.104:0/2951690099 reap_dead start 2024-09-17T03:04:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.380+0000 7fdc9b44d640 1 -- 172.21.15.104:0/2951690099 shutdown_connections 2024-09-17T03:04:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.380+0000 7fdc9b44d640 1 -- 172.21.15.104:0/2951690099 >> 172.21.15.104:0/2951690099 conn(0x7fdc940b44a0 msgr2=0x7fdc940b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:11.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.380+0000 7fdc9b44d640 1 -- 172.21.15.104:0/2951690099 shutdown_connections 2024-09-17T03:04:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.380+0000 7fdc9b44d640 1 -- 172.21.15.104:0/2951690099 wait complete. 2024-09-17T03:04:11.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.381+0000 7fdc9b44d640 1 Processor -- start 2024-09-17T03:04:11.381 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.381+0000 7fdc9b44d640 1 -- start start 2024-09-17T03:04:11.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc9b44d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 0x7fdc941f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc9b44d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc941f48f0 0x7fdc940b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc9b44d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc940c8fb0 0x7fdc940b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc9b44d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdc940d0010 con 0x7fdc80004800 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc9b44d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdc940cfe90 con 0x7fdc941f48f0 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc9b44d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdc940d0190 con 0x7fdc940c8fb0 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 0x7fdc941f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 0x7fdc941f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49530/0 (socket says 172.21.15.104:49530) 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 -- 172.21.15.104:0/541945930 learned_addr learned my addr 172.21.15.104:0/541945930 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc989e8640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc941f48f0 0x7fdc940b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc999ea640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc940c8fb0 0x7fdc940b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 -- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc940c8fb0 msgr2=0x7fdc940b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc940c8fb0 0x7fdc940b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 -- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc941f48f0 msgr2=0x7fdc940b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc941f48f0 0x7fdc940b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 -- 172.21.15.104:0/541945930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc940af7b0 con 0x7fdc80004800 2024-09-17T03:04:11.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc999ea640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc940c8fb0 0x7fdc940b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:11.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc991e9640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 0x7fdc941f14a0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fdc90004e20 tx=0x7fdc90001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:11.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc89ffb640 1 -- 172.21.15.104:0/541945930 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90015020 con 0x7fdc80004800 2024-09-17T03:04:11.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc89ffb640 1 -- 172.21.15.104:0/541945930 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc90011960 con 0x7fdc80004800 2024-09-17T03:04:11.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc940afa90 con 0x7fdc80004800 2024-09-17T03:04:11.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.383+0000 7fdc89ffb640 1 -- 172.21.15.104:0/541945930 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90011d70 con 0x7fdc80004800 2024-09-17T03:04:11.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.384+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc940b0050 con 0x7fdc80004800 2024-09-17T03:04:11.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.384+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc940b61c0 con 0x7fdc80004800 2024-09-17T03:04:11.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.385+0000 7fdc89ffb640 1 -- 172.21.15.104:0/541945930 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc90018020 con 0x7fdc80004800 2024-09-17T03:04:11.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.385+0000 7fdc89ffb640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc78078bc0 0x7fdc7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.386+0000 7fdc89ffb640 1 -- 172.21.15.104:0/541945930 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7fdc9009b730 con 0x7fdc80004800 2024-09-17T03:04:11.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.386+0000 7fdc89ffb640 1 -- 172.21.15.104:0/541945930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7fdc78080860 con 0x7fdc80004800 2024-09-17T03:04:11.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.386+0000 7fdc989e8640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc78078bc0 0x7fdc7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.386+0000 7fdc989e8640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc78078bc0 0x7fdc7807b0d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdc84033000 tx=0x7fdc84000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:11.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.390+0000 7fdc89ffb640 1 -- 172.21.15.104:0/541945930 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdc940b61c0 con 0x7fdc80004800 2024-09-17T03:04:11.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.597+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc940b39c0 con 0x7fdc80004800 2024-09-17T03:04:11.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.598+0000 7fdc89ffb640 1 -- 172.21.15.104:0/541945930 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5237 (secure 0 0 0) 0x7fdc9001f020 con 0x7fdc80004800 2024-09-17T03:04:11.598 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:11.598 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":62,"btime":"2024-09-17T03:01:55:313759+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1088380573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1088380573},{"type":"v1","addr":"172.21.15.192:6836","nonce":1088380573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3930263372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3930263372},{"type":"v1","addr":"172.21.15.192:6837","nonce":3930263372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7449,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2263721697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2263721697},{"type":"v1","addr":"172.21.15.104:6834","nonce":2263721697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:01:52.648279+0000","modified":"2024-09-17T03:01:54.664367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7452},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7452":{"gid":7452,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/1696726463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1696726463},{"type":"v1","addr":"172.21.15.104:6835","nonce":1696726463}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7452,"qdb_cluster":[7452]},"id":9}]} 2024-09-17T03:04:11.598 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 62 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc78078bc0 msgr2=0x7fdc7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc78078bc0 0x7fdc7807b0d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdc84033000 tx=0x7fdc84000fe0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 msgr2=0x7fdc941f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 0x7fdc941f14a0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fdc90004e20 tx=0x7fdc90001630 comp rx=0 tx=0).stop 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 shutdown_connections 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdc78078bc0 0x7fdc7807b0d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc941f48f0 0x7fdc940b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdc940c8fb0 0x7fdc940b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 --2- 172.21.15.104:0/541945930 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdc80004800 0x7fdc941f14a0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 >> 172.21.15.104:0/541945930 conn(0x7fdc940b44a0 msgr2=0x7fdc9415cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:11.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 shutdown_connections 2024-09-17T03:04:11.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.600+0000 7fdc9b44d640 1 -- 172.21.15.104:0/541945930 wait complete. 2024-09-17T03:04:11.611 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:04:11.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.724+0000 7f7f238f9640 1 -- 172.21.15.104:0/441920441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 msgr2=0x7f7f04004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.724+0000 7f7f238f9640 1 --2- 172.21.15.104:0/441920441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 0x7f7f04004c10 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000c2e0 tx=0x7f7f04005830 comp rx=0 tx=0).stop 2024-09-17T03:04:11.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.724+0000 7f7f21e96640 1 -- 172.21.15.104:0/441920441 reap_dead start 2024-09-17T03:04:11.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.724+0000 7f7f238f9640 1 -- 172.21.15.104:0/441920441 shutdown_connections 2024-09-17T03:04:11.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.724+0000 7f7f238f9640 1 -- 172.21.15.104:0/441920441 >> 172.21.15.104:0/441920441 conn(0x7f7f1c06d200 msgr2=0x7f7f1c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:11.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.724+0000 7f7f238f9640 1 -- 172.21.15.104:0/441920441 shutdown_connections 2024-09-17T03:04:11.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.724+0000 7f7f238f9640 1 -- 172.21.15.104:0/441920441 wait complete. 2024-09-17T03:04:11.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.726+0000 7f7f238f9640 1 Processor -- start 2024-09-17T03:04:11.725 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.726+0000 7f7f238f9640 1 -- start start 2024-09-17T03:04:11.727 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f238f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 0x7f7f1c14abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f238f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f1c0b1460 0x7f7f1c0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f238f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f1c154650 0x7f7f1c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f238f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c0b0e10 con 0x7f7f04004800 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f238f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c0b0c90 con 0x7f7f1c0b1460 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f238f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7f1c0b0f90 con 0x7f7f1c154650 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 0x7f7f1c14abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 0x7f7f1c14abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49546/0 (socket says 172.21.15.104:49546) 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 -- 172.21.15.104:0/968023042 learned_addr learned my addr 172.21.15.104:0/968023042 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21e96640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f1c154650 0x7f7f1c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f20e94640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f1c0b1460 0x7f7f1c0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 -- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f1c154650 msgr2=0x7f7f1c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f1c154650 0x7f7f1c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 -- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f1c0b1460 msgr2=0x7f7f1c0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f1c0b1460 0x7f7f1c0b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 -- 172.21.15.104:0/968023042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1c14b110 con 0x7f7f04004800 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21e96640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f1c154650 0x7f7f1c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f21695640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 0x7f7f1c14abd0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c011d60 tx=0x7f7f0c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.727+0000 7f7f19ffb640 1 -- 172.21.15.104:0/968023042 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c003d80 con 0x7f7f04004800 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.728+0000 7f7f19ffb640 1 -- 172.21.15.104:0/968023042 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f0c011e50 con 0x7f7f04004800 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.728+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1c0b1c40 con 0x7f7f04004800 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.728+0000 7f7f19ffb640 1 -- 172.21.15.104:0/968023042 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c004d60 con 0x7f7f04004800 2024-09-17T03:04:11.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.728+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1c0b2200 con 0x7f7f04004800 2024-09-17T03:04:11.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.729+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1c070810 con 0x7f7f04004800 2024-09-17T03:04:11.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.729+0000 7f7f19ffb640 1 -- 172.21.15.104:0/968023042 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f0c004050 con 0x7f7f04004800 2024-09-17T03:04:11.730 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.730+0000 7f7f19ffb640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7f08078bc0 0x7f7f0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:11.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.730+0000 7f7f19ffb640 1 -- 172.21.15.104:0/968023042 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7f7f0c09bd30 con 0x7f7f04004800 2024-09-17T03:04:11.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.731+0000 7f7f20e94640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7f08078bc0 0x7f7f0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:11.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.731+0000 7f7f19ffb640 1 -- 172.21.15.104:0/968023042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7f7f08080860 con 0x7f7f04004800 2024-09-17T03:04:11.731 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.731+0000 7f7f20e94640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7f08078bc0 0x7f7f0807b0d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7f10033000 tx=0x7f7f1002d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:11.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.735+0000 7f7f19ffb640 1 -- 172.21.15.104:0/968023042 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f0c0641c0 con 0x7f7f04004800 2024-09-17T03:04:11.912 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.913+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f1c0d23c0 con 0x7f7f04004800 2024-09-17T03:04:11.913 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.914+0000 7f7f19ffb640 1 -- 172.21.15.104:0/968023042 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) ==== 74+0+16856 (secure 0 0 0) 0x7f7f0c063ac0 con 0x7f7f04004800 2024-09-17T03:04:11.914 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:11.914 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":157,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:03:03.165083+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:01:50.286371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T03:01:51.606939+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.23","mappings":[{"from":2,"to":0}]},{"pgid":"19.33","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:04:11.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.916+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7f08078bc0 msgr2=0x7f7f0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.916+0000 7f7f238f9640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7f08078bc0 0x7f7f0807b0d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7f10033000 tx=0x7f7f1002d000 comp rx=0 tx=0).stop 2024-09-17T03:04:11.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.916+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 msgr2=0x7f7f1c14abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:11.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.916+0000 7f7f238f9640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 0x7f7f1c14abd0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c011d60 tx=0x7f7f0c00f790 comp rx=0 tx=0).stop 2024-09-17T03:04:11.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.917+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 shutdown_connections 2024-09-17T03:04:11.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.917+0000 7f7f238f9640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7f08078bc0 0x7f7f0807b0d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.917+0000 7f7f238f9640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f1c0b1460 0x7f7f1c0b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.917+0000 7f7f238f9640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f1c154650 0x7f7f1c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.917+0000 7f7f238f9640 1 --2- 172.21.15.104:0/968023042 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7f04004800 0x7f7f1c14abd0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:11.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.917+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 >> 172.21.15.104:0/968023042 conn(0x7f7f1c06d200 msgr2=0x7f7f1c155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:11.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.917+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 shutdown_connections 2024-09-17T03:04:11.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:11.917+0000 7f7f238f9640 1 -- 172.21.15.104:0/968023042 wait complete. 2024-09-17T03:04:11.927 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:04:12.041 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.042+0000 7f4907dba640 1 -- 172.21.15.104:0/3942399911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8004800 msgr2=0x7f48e8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:12.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.042+0000 7f4907dba640 1 --2- 172.21.15.104:0/3942399911 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f48e8004800 0x7f48e8004c10 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f48f400ac30 tx=0x7f48e8005830 comp rx=0 tx=0).stop 2024-09-17T03:04:12.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.042+0000 7f4906357640 1 -- 172.21.15.104:0/3942399911 reap_dead start 2024-09-17T03:04:12.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.042+0000 7f4907dba640 1 -- 172.21.15.104:0/3942399911 shutdown_connections 2024-09-17T03:04:12.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.042+0000 7f4907dba640 1 -- 172.21.15.104:0/3942399911 >> 172.21.15.104:0/3942399911 conn(0x7f49000b2450 msgr2=0x7f49000b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:12.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.042+0000 7f4907dba640 1 -- 172.21.15.104:0/3942399911 shutdown_connections 2024-09-17T03:04:12.042 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.042+0000 7f4907dba640 1 -- 172.21.15.104:0/3942399911 wait complete. 2024-09-17T03:04:12.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.043+0000 7f4907dba640 1 Processor -- start 2024-09-17T03:04:12.043 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.044+0000 7f4907dba640 1 -- start start 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4907dba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e8004800 0x7f4900152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4907dba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4900154e10 0x7f490015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4907dba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49001f63c0 0x7f49001f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4907dba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4900072fb0 con 0x7f4900154e10 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4907dba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4900072e30 con 0x7f48e8004800 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4907dba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4900073130 con 0x7f49001f63c0 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4900154e10 0x7f490015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4900154e10 0x7f490015a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49560/0 (socket says 172.21.15.104:49560) 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 -- 172.21.15.104:0/3663627199 learned_addr learned my addr 172.21.15.104:0/3663627199 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:12.046 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4906357640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49001f63c0 0x7f49001f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905b56640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e8004800 0x7f4900152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 -- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49001f63c0 msgr2=0x7f49001f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49001f63c0 0x7f49001f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 -- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e8004800 msgr2=0x7f4900152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e8004800 0x7f4900152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 -- 172.21.15.104:0/3663627199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49001533c0 con 0x7f4900154e10 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4906357640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49001f63c0 0x7f49001f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905b56640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e8004800 0x7f4900152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f4905355640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4900154e10 0x7f490015a170 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f48f400ac30 tx=0x7f48f4034e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.045+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4039040 con 0x7f4900154e10 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.046+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48f402c960 con 0x7f4900154e10 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.046+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49001f6d10 con 0x7f4900154e10 2024-09-17T03:04:12.047 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.046+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4005280 con 0x7f4900154e10 2024-09-17T03:04:12.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.046+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49001f9c20 con 0x7f4900154e10 2024-09-17T03:04:12.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.046+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49000b4070 con 0x7f4900154e10 2024-09-17T03:04:12.048 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.047+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48f4046020 con 0x7f4900154e10 2024-09-17T03:04:12.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.048+0000 7f48fe7fc640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f48ec078b90 0x7f48ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:12.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.048+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5767+0+0 (secure 0 0 0) 0x7f48f40bc070 con 0x7f4900154e10 2024-09-17T03:04:12.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.048+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7f48ec0807d0 con 0x7f4900154e10 2024-09-17T03:04:12.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.048+0000 7f4905b56640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f48ec078b90 0x7f48ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:12.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.049+0000 7f4905b56640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f48ec078b90 0x7f48ec07b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f48f0000c00 tx=0x7f48f0006b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:12.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.052+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f48f4084470 con 0x7f4900154e10 2024-09-17T03:04:12.260 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.261+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f49000b2fe0 con 0x7f4900154e10 2024-09-17T03:04:12.261 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T03:04:12.262+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:04:12.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.263+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) ==== 161+0+0 (secure 0 0 0) 0x7f48f4083d70 con 0x7f4900154e10 2024-09-17T03:04:12.263 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:04:12.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.264+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(158..158 src has 1..158) ==== 374+0+0 (secure 0 0 0) 0x7f48f40f2d90 con 0x7f4900154e10 2024-09-17T03:04:12.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.264+0000 7f48fe7fc640 1 -- 172.21.15.104:0/3663627199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=159}) -- 0x7f48ec0811a0 con 0x7f4900154e10 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f48ec078b90 msgr2=0x7f48ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f48ec078b90 0x7f48ec07b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f48f0000c00 tx=0x7f48f0006b50 comp rx=0 tx=0).stop 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4900154e10 msgr2=0x7f490015a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4900154e10 0x7f490015a170 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f48f400ac30 tx=0x7f48f4034e40 comp rx=0 tx=0).stop 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 shutdown_connections 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f48ec078b90 0x7f48ec07b0a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49001f63c0 0x7f49001f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4900154e10 0x7f490015a170 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 --2- 172.21.15.104:0/3663627199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e8004800 0x7f4900152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 >> 172.21.15.104:0/3663627199 conn(0x7f49000b2450 msgr2=0x7f490015ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:12.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 shutdown_connections 2024-09-17T03:04:12.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.267+0000 7f4907dba640 1 -- 172.21.15.104:0/3663627199 wait complete. 2024-09-17T03:04:12.279 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:04:12.326 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T03:04:12.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.396+0000 7fdae56a9640 1 -- 172.21.15.104:0/251987698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae0162cb0 msgr2=0x7fdae00b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:12.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.396+0000 7fdae56a9640 1 --2- 172.21.15.104:0/251987698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae0162cb0 0x7fdae00b65a0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009bb0 tx=0x7fdad002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.396+0000 7fdae56a9640 1 -- 172.21.15.104:0/251987698 shutdown_connections 2024-09-17T03:04:12.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.396+0000 7fdae56a9640 1 --2- 172.21.15.104:0/251987698 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae0162cb0 0x7fdae00b65a0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.396 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.396+0000 7fdae56a9640 1 -- 172.21.15.104:0/251987698 >> 172.21.15.104:0/251987698 conn(0x7fdae0069120 msgr2=0x7fdae0069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:12.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.396+0000 7fdae56a9640 1 -- 172.21.15.104:0/251987698 shutdown_connections 2024-09-17T03:04:12.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.396+0000 7fdae56a9640 1 -- 172.21.15.104:0/251987698 wait complete. 2024-09-17T03:04:12.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.398+0000 7fdae56a9640 1 Processor -- start 2024-09-17T03:04:12.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.398+0000 7fdae56a9640 1 -- start start 2024-09-17T03:04:12.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.399+0000 7fdae56a9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdae00b6ae0 0x7fdae00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:12.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdae56a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdae0162cb0 0x7fdae00cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:12.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdae56a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae01630c0 0x7fdae01f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:12.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdae56a9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdae0161ff0 con 0x7fdae01630c0 2024-09-17T03:04:12.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdae56a9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdae0160530 con 0x7fdae0162cb0 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdae56a9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdae0162170 con 0x7fdae00b6ae0 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae01630c0 0x7fdae01f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae01630c0 0x7fdae01f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49594/0 (socket says 172.21.15.104:49594) 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 -- 172.21.15.104:0/1961952963 learned_addr learned my addr 172.21.15.104:0/1961952963 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadeffd640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdae00b6ae0 0x7fdae00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdade7fc640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdae0162cb0 0x7fdae00cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 -- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdae00b6ae0 msgr2=0x7fdae00caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdae00b6ae0 0x7fdae00caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 -- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdae0162cb0 msgr2=0x7fdae00cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdae0162cb0 0x7fdae00cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 -- 172.21.15.104:0/1961952963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae00cded0 con 0x7fdae01630c0 2024-09-17T03:04:12.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadeffd640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdae00b6ae0 0x7fdae00caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:12.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdadf7fe640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae01630c0 0x7fdae01f6210 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c3f0 tx=0x7fdad800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:12.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8011790 con 0x7fdae01630c0 2024-09-17T03:04:12.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdad8017070 con 0x7fdae01630c0 2024-09-17T03:04:12.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8011ca0 con 0x7fdae01630c0 2024-09-17T03:04:12.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae00ce1b0 con 0x7fdae01630c0 2024-09-17T03:04:12.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.400+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae01f6750 con 0x7fdae01630c0 2024-09-17T03:04:12.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.401+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdae00ce3f0 con 0x7fdae01630c0 2024-09-17T03:04:12.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.402+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdad801c460 con 0x7fdae01630c0 2024-09-17T03:04:12.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.403+0000 7fdad77fe640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdac0078b90 0x7fdac007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:12.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.403+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5853+0+0 (secure 0 0 0) 0x7fdad809a9b0 con 0x7fdae01630c0 2024-09-17T03:04:12.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.403+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=159}) -- 0x7fdac00808e0 con 0x7fdae01630c0 2024-09-17T03:04:12.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.403+0000 7fdadeffd640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdac0078b90 0x7fdac007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:12.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.403+0000 7fdadeffd640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdac0078b90 0x7fdac007b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdae00b7b80 tx=0x7fdad0004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:12.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.407+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdae00ce3f0 con 0x7fdae01630c0 2024-09-17T03:04:12.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:12.619+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdae00cdc60 con 0x7fdae01630c0 2024-09-17T03:04:13.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.181+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 <== mon.0 v2:172.21.15.104:3300/0 7 ==== osd_map(159..159 src has 1..159) ==== 679+0+0 (secure 0 0 0) 0x7fdad8098f60 con 0x7fdae01630c0 2024-09-17T03:04:13.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.181+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7fdac00814b0 con 0x7fdae01630c0 2024-09-17T03:04:13.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.265+0000 7fdad77fe640 1 -- 172.21.15.104:0/1961952963 <== mon.0 v2:172.21.15.104:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7fdae00b6ef0 con 0x7fdae01630c0 2024-09-17T03:04:13.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdac0078b90 msgr2=0x7fdac007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:13.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdac0078b90 0x7fdac007b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdae00b7b80 tx=0x7fdad0004ab0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae01630c0 msgr2=0x7fdae01f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:13.268 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae01630c0 0x7fdae01f6210 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c3f0 tx=0x7fdad800c8b0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 shutdown_connections 2024-09-17T03:04:13.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdac0078b90 0x7fdac007b0a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdae0162cb0 0x7fdae00cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdae01630c0 0x7fdae01f6210 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 --2- 172.21.15.104:0/1961952963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdae00b6ae0 0x7fdae00caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 >> 172.21.15.104:0/1961952963 conn(0x7fdae0069120 msgr2=0x7fdae00d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:13.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 shutdown_connections 2024-09-17T03:04:13.269 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.269+0000 7fdae56a9640 1 -- 172.21.15.104:0/1961952963 wait complete. 2024-09-17T03:04:13.281 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:04:13.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.402+0000 7fcfe1f19640 1 -- 172.21.15.104:0/1494209991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 msgr2=0x7fcfdc0d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:13.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.402+0000 7fcfe1f19640 1 --2- 172.21.15.104:0/1494209991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 0x7fcfdc0d0860 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009830 tx=0x7fcfd002a530 comp rx=0 tx=0).stop 2024-09-17T03:04:13.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.402+0000 7fcfe1f19640 1 -- 172.21.15.104:0/1494209991 shutdown_connections 2024-09-17T03:04:13.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.402+0000 7fcfe1f19640 1 --2- 172.21.15.104:0/1494209991 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 0x7fcfdc0d0860 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.402+0000 7fcfe1f19640 1 -- 172.21.15.104:0/1494209991 >> 172.21.15.104:0/1494209991 conn(0x7fcfdc0d4c20 msgr2=0x7fcfdc0d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:13.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.402+0000 7fcfe1f19640 1 -- 172.21.15.104:0/1494209991 shutdown_connections 2024-09-17T03:04:13.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.402+0000 7fcfe1f19640 1 -- 172.21.15.104:0/1494209991 wait complete. 2024-09-17T03:04:13.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.404+0000 7fcfe1f19640 1 Processor -- start 2024-09-17T03:04:13.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.404+0000 7fcfe1f19640 1 -- start start 2024-09-17T03:04:13.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfe1f19640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfdc0b2800 0x7fcfdc156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfe1f19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 0x7fcfdc0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfe1f19640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfdc15f3f0 0x7fcfdc0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfe1f19640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc0b37f0 con 0x7fcfdc0d3110 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfe1f19640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc0b3670 con 0x7fcfdc15f3f0 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfe1f19640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcfdc0b3970 con 0x7fcfdc0b2800 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfdaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 0x7fcfdc0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfdaffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 0x7fcfdc0b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49620/0 (socket says 172.21.15.104:49620) 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfdaffd640 1 -- 172.21.15.104:0/831839485 learned_addr learned my addr 172.21.15.104:0/831839485 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfdb7fe640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfdc0b2800 0x7fcfdc156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.405+0000 7fcfdbfff640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfdc15f3f0 0x7fcfdc0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfdaffd640 1 -- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfdc0b2800 msgr2=0x7fcfdc156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:13.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfdaffd640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfdc0b2800 0x7fcfdc156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfdaffd640 1 -- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfdc15f3f0 msgr2=0x7fcfdc0b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:13.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfdaffd640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfdc15f3f0 0x7fcfdc0b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:13.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfdaffd640 1 -- 172.21.15.104:0/831839485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc0d0990 con 0x7fcfdc0d3110 2024-09-17T03:04:13.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfdaffd640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 0x7fcfdc0b4cf0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fcfd002ab20 tx=0x7fcfd0033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:13.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfc3fff640 1 -- 172.21.15.104:0/831839485 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0031b60 con 0x7fcfdc0d3110 2024-09-17T03:04:13.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfc3fff640 1 -- 172.21.15.104:0/831839485 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfd0031df0 con 0x7fcfdc0d3110 2024-09-17T03:04:13.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfdc156fb0 con 0x7fcfdc0d3110 2024-09-17T03:04:13.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfc3fff640 1 -- 172.21.15.104:0/831839485 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0005280 con 0x7fcfdc0d3110 2024-09-17T03:04:13.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.406+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfdc158080 con 0x7fcfdc0d3110 2024-09-17T03:04:13.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.407+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfdc0b7260 con 0x7fcfdc0d3110 2024-09-17T03:04:13.409 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.409+0000 7fcfc3fff640 1 -- 172.21.15.104:0/831839485 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcfd0005420 con 0x7fcfdc0d3110 2024-09-17T03:04:13.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.409+0000 7fcfc3fff640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfc8078b90 0x7fcfc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:13.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.409+0000 7fcfc3fff640 1 -- 172.21.15.104:0/831839485 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5853+0+0 (secure 0 0 0) 0x7fcfd00bc3a0 con 0x7fcfdc0d3110 2024-09-17T03:04:13.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.409+0000 7fcfdb7fe640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfc8078b90 0x7fcfc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:13.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.410+0000 7fcfdb7fe640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfc8078b90 0x7fcfc807b0a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000f60 tx=0x7fcfcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:13.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.413+0000 7fcfc3fff640 1 -- 172.21.15.104:0/831839485 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcfdc0d0990 con 0x7fcfdc0d3110 2024-09-17T03:04:13.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:13.585+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcfdc0b3e90 con 0x7fcfdc0d3110 2024-09-17T03:04:14.348 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.349+0000 7fcfc3fff640 1 -- 172.21.15.104:0/831839485 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v160) ==== 181+0+0 (secure 0 0 0) 0x7fcfd003f030 con 0x7fcfdc0d3110 2024-09-17T03:04:14.352 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:04:14.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfc8078b90 msgr2=0x7fcfc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:14.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfc8078b90 0x7fcfc807b0a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000f60 tx=0x7fcfcc009040 comp rx=0 tx=0).stop 2024-09-17T03:04:14.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 msgr2=0x7fcfdc0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:14.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 0x7fcfdc0b4cf0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fcfd002ab20 tx=0x7fcfd0033c10 comp rx=0 tx=0).stop 2024-09-17T03:04:14.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 shutdown_connections 2024-09-17T03:04:14.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcfc8078b90 0x7fcfc807b0a0 secure :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000f60 tx=0x7fcfcc009040 comp rx=0 tx=0).stop 2024-09-17T03:04:14.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfdc15f3f0 0x7fcfdc0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:14.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcfdc0d3110 0x7fcfdc0b4cf0 secure :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fcfd002ab20 tx=0x7fcfd0033c10 comp rx=0 tx=0).stop 2024-09-17T03:04:14.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 --2- 172.21.15.104:0/831839485 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfdc0b2800 0x7fcfdc156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:14.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.355+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 >> 172.21.15.104:0/831839485 conn(0x7fcfdc0d4c20 msgr2=0x7fcfdc06d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:14.356 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.357+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 shutdown_connections 2024-09-17T03:04:14.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.357+0000 7fcfe1f19640 1 -- 172.21.15.104:0/831839485 wait complete. 2024-09-17T03:04:14.369 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:04:14.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.489+0000 7fb575989640 1 -- 172.21.15.104:0/2476459681 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 msgr2=0x7fb5700d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:14.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.489+0000 7fb575989640 1 --2- 172.21.15.104:0/2476459681 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 0x7fb5700d2a00 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fb560009830 tx=0x7fb56002a480 comp rx=0 tx=0).stop 2024-09-17T03:04:14.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.489+0000 7fb575989640 1 -- 172.21.15.104:0/2476459681 shutdown_connections 2024-09-17T03:04:14.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.489+0000 7fb575989640 1 --2- 172.21.15.104:0/2476459681 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 0x7fb5700d2a00 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:14.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.489+0000 7fb575989640 1 -- 172.21.15.104:0/2476459681 >> 172.21.15.104:0/2476459681 conn(0x7fb5700d4c20 msgr2=0x7fb5700d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:14.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.489+0000 7fb575989640 1 -- 172.21.15.104:0/2476459681 shutdown_connections 2024-09-17T03:04:14.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.489+0000 7fb575989640 1 -- 172.21.15.104:0/2476459681 wait complete. 2024-09-17T03:04:14.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.491+0000 7fb575989640 1 Processor -- start 2024-09-17T03:04:14.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.491+0000 7fb575989640 1 -- start start 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb575989640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5700b2800 0x7fb570156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb575989640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5700d2f40 0x7fb5700b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb575989640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 0x7fb5701f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb575989640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5700b37f0 con 0x7fb57015f3f0 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb575989640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb5700b3670 con 0x7fb5700b2800 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb575989640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb5700b3970 con 0x7fb5700d2f40 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb56f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 0x7fb5701f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb56f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 0x7fb5701f9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49504/0 (socket says 172.21.15.104:49504) 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb56f7fe640 1 -- 172.21.15.104:0/3551516119 learned_addr learned my addr 172.21.15.104:0/3551516119 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb56effd640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5700b2800 0x7fb570156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:14.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.492+0000 7fb5667fc640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5700d2f40 0x7fb5700b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56f7fe640 1 -- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5700d2f40 msgr2=0x7fb5700b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56f7fe640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5700d2f40 0x7fb5700b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56f7fe640 1 -- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5700b2800 msgr2=0x7fb570156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56f7fe640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5700b2800 0x7fb570156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56f7fe640 1 -- 172.21.15.104:0/3551516119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5701fa670 con 0x7fb57015f3f0 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56f7fe640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 0x7fb5701f9840 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fb56800cb00 tx=0x7fb56800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56cff9640 1 -- 172.21.15.104:0/3551516119 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568016020 con 0x7fb57015f3f0 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56cff9640 1 -- 172.21.15.104:0/3551516119 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb56800acf0 con 0x7fb57015f3f0 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb570157520 con 0x7fb57015f3f0 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb56cff9640 1 -- 172.21.15.104:0/3551516119 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568012680 con 0x7fb57015f3f0 2024-09-17T03:04:14.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.493+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5700b63a0 con 0x7fb57015f3f0 2024-09-17T03:04:14.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.494+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5700b3e90 con 0x7fb57015f3f0 2024-09-17T03:04:14.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.495+0000 7fb56cff9640 1 -- 172.21.15.104:0/3551516119 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb568019020 con 0x7fb57015f3f0 2024-09-17T03:04:14.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.495+0000 7fb56cff9640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb550078bc0 0x7fb55007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:14.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.495+0000 7fb56cff9640 1 -- 172.21.15.104:0/3551516119 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5415+0+0 (secure 0 0 0) 0x7fb56809b080 con 0x7fb57015f3f0 2024-09-17T03:04:14.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.495+0000 7fb56effd640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb550078bc0 0x7fb55007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:14.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.496+0000 7fb56effd640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb550078bc0 0x7fb55007b0d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb560034000 tx=0x7fb560004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:14.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.500+0000 7fb56cff9640 1 -- 172.21.15.104:0/3551516119 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb568020020 con 0x7fb57015f3f0 2024-09-17T03:04:14.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:14.673+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb57015c5d0 con 0x7fb57015f3f0 2024-09-17T03:04:15.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.358+0000 7fb56cff9640 1 -- 172.21.15.104:0/3551516119 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v161) ==== 169+0+0 (secure 0 0 0) 0x7fb568062f10 con 0x7fb57015f3f0 2024-09-17T03:04:15.358 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T03:04:15.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.361+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb550078bc0 msgr2=0x7fb55007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb550078bc0 0x7fb55007b0d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb560034000 tx=0x7fb560004730 comp rx=0 tx=0).stop 2024-09-17T03:04:15.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 msgr2=0x7fb5701f9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.361 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 0x7fb5701f9840 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fb56800cb00 tx=0x7fb56800a060 comp rx=0 tx=0).stop 2024-09-17T03:04:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 shutdown_connections 2024-09-17T03:04:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb550078bc0 0x7fb55007b0d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb57015f3f0 0x7fb5701f9840 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5700d2f40 0x7fb5700b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 --2- 172.21.15.104:0/3551516119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5700b2800 0x7fb570156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 >> 172.21.15.104:0/3551516119 conn(0x7fb5700d4c20 msgr2=0x7fb5700d2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 shutdown_connections 2024-09-17T03:04:15.364 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.362+0000 7fb575989640 1 -- 172.21.15.104:0/3551516119 wait complete. 2024-09-17T03:04:15.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T03:04:15.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 -- 172.21.15.104:0/2051734004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140734f0 msgr2=0x7f1414073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 --2- 172.21.15.104:0/2051734004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140734f0 0x7f1414073900 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f1414074950 tx=0x7f140802a560 comp rx=0 tx=0).stop 2024-09-17T03:04:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 -- 172.21.15.104:0/2051734004 shutdown_connections 2024-09-17T03:04:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 --2- 172.21.15.104:0/2051734004 >> v2:172.21.15.192:3300/0 conn(0x7f14140b0500 0x7f14140b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 --2- 172.21.15.104:0/2051734004 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140734f0 0x7f1414073900 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 --2- 172.21.15.104:0/2051734004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f141415c220 0x7f141406f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 -- 172.21.15.104:0/2051734004 >> 172.21.15.104:0/2051734004 conn(0x7f141406d200 msgr2=0x7f141406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 -- 172.21.15.104:0/2051734004 shutdown_connections 2024-09-17T03:04:15.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.490+0000 7f141aa69640 1 -- 172.21.15.104:0/2051734004 wait complete. 2024-09-17T03:04:15.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.491+0000 7f141aa69640 1 Processor -- start 2024-09-17T03:04:15.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.491+0000 7f141aa69640 1 -- start start 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f141aa69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14140734f0 0x7f1414156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f141aa69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140b0500 0x7f141414ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f141aa69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141415c220 0x7f14140cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f141aa69640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f14140b11e0 con 0x7f14140b0500 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f141aa69640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f14140b1060 con 0x7f141415c220 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f141aa69640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f141415f6f0 con 0x7f14140734f0 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1413fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140b0500 0x7f141414ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1413fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140b0500 0x7f141414ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49522/0 (socket says 172.21.15.104:49522) 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1413fff640 1 -- 172.21.15.104:0/1898610970 learned_addr learned my addr 172.21.15.104:0/1898610970 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:15.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1418805640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14140734f0 0x7f1414156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1419006640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141415c220 0x7f14140cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1413fff640 1 -- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14140734f0 msgr2=0x7f1414156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1413fff640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14140734f0 0x7f1414156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1413fff640 1 -- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141415c220 msgr2=0x7f14140cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1413fff640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141415c220 0x7f14140cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1413fff640 1 -- 172.21.15.104:0/1898610970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14141543d0 con 0x7f14140b0500 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.493+0000 7f1419006640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141415c220 0x7f14140cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.494+0000 7f1413fff640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140b0500 0x7f141414ce20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f1408034040 tx=0x7f14080039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.494+0000 7f14117fa640 1 -- 172.21.15.104:0/1898610970 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408035040 con 0x7f14140b0500 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.494+0000 7f14117fa640 1 -- 172.21.15.104:0/1898610970 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14080047a0 con 0x7f14140b0500 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.494+0000 7f14117fa640 1 -- 172.21.15.104:0/1898610970 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408004b70 con 0x7f14140b0500 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.494+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14141572d0 con 0x7f14140b0500 2024-09-17T03:04:15.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.494+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141414d360 con 0x7f14140b0500 2024-09-17T03:04:15.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.495+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f141414d530 con 0x7f14140b0500 2024-09-17T03:04:15.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.495+0000 7f14117fa640 1 -- 172.21.15.104:0/1898610970 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1408004d10 con 0x7f14140b0500 2024-09-17T03:04:15.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.496+0000 7f14117fa640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1400078b90 0x7f140007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:15.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.496+0000 7f14117fa640 1 -- 172.21.15.104:0/1898610970 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7f14080bd470 con 0x7f14140b0500 2024-09-17T03:04:15.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.496+0000 7f1418805640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1400078b90 0x7f140007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:15.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.497+0000 7f1418805640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1400078b90 0x7f140007b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1404005d70 tx=0x7f1404005d00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:15.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.500+0000 7f14117fa640 1 -- 172.21.15.104:0/1898610970 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1408085cd0 con 0x7f14140b0500 2024-09-17T03:04:15.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.677+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f14140b0910 con 0x7f14140b0500 2024-09-17T03:04:15.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.681+0000 7f14117fa640 1 -- 172.21.15.104:0/1898610970 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f14080855d0 con 0x7f14140b0500 2024-09-17T03:04:15.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1400078b90 msgr2=0x7f140007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1400078b90 0x7f140007b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1404005d70 tx=0x7f1404005d00 comp rx=0 tx=0).stop 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140b0500 msgr2=0x7f141414ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140b0500 0x7f141414ce20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f1408034040 tx=0x7f14080039e0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 shutdown_connections 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1400078b90 0x7f140007b0a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f141415c220 0x7f14140cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14140b0500 0x7f141414ce20 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 --2- 172.21.15.104:0/1898610970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14140734f0 0x7f1414156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 >> 172.21.15.104:0/1898610970 conn(0x7f141406d200 msgr2=0x7f14140b5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 shutdown_connections 2024-09-17T03:04:15.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.683+0000 7f141aa69640 1 -- 172.21.15.104:0/1898610970 wait complete. 2024-09-17T03:04:15.694 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-17T03:04:15.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.811+0000 7f9306900640 1 -- 172.21.15.104:0/503738223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 msgr2=0x7f92e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.811+0000 7f9306900640 1 --2- 172.21.15.104:0/503738223 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 0x7f92e8004800 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f92f40016c0 tx=0x7f92e8005830 comp rx=0 tx=0).stop 2024-09-17T03:04:15.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.811+0000 7f9304e9d640 1 -- 172.21.15.104:0/503738223 reap_dead start 2024-09-17T03:04:15.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.811+0000 7f9306900640 1 -- 172.21.15.104:0/503738223 shutdown_connections 2024-09-17T03:04:15.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.811+0000 7f9306900640 1 -- 172.21.15.104:0/503738223 >> 172.21.15.104:0/503738223 conn(0x7f93000d28a0 msgr2=0x7f93000d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:15.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.811+0000 7f9306900640 1 -- 172.21.15.104:0/503738223 shutdown_connections 2024-09-17T03:04:15.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.811+0000 7f9306900640 1 -- 172.21.15.104:0/503738223 wait complete. 2024-09-17T03:04:15.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.813+0000 7f9306900640 1 Processor -- start 2024-09-17T03:04:15.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.813+0000 7f9306900640 1 -- start start 2024-09-17T03:04:15.815 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.814+0000 7f9306900640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 0x7f930009e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:15.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.814+0000 7f9306900640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93001e4b50 0x7f93001d9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:15.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.814+0000 7f9306900640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f930009d7a0 0x7f930009dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:15.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.814+0000 7f9306900640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f93000cde90 con 0x7f92e80040b0 2024-09-17T03:04:15.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.814+0000 7f9306900640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f93000cfda0 con 0x7f930009d7a0 2024-09-17T03:04:15.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.814+0000 7f9306900640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f93000ce010 con 0x7f93001e4b50 2024-09-17T03:04:15.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 0x7f930009e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:15.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 0x7f930009e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49548/0 (socket says 172.21.15.104:49548) 2024-09-17T03:04:15.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 -- 172.21.15.104:0/1151616405 learned_addr learned my addr 172.21.15.104:0/1151616405 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92ff7fe640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93001e4b50 0x7f93001d9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 -- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93001e4b50 msgr2=0x7f93001d9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f9304e9d640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f930009d7a0 0x7f930009dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93001e4b50 0x7f93001d9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 -- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f930009d7a0 msgr2=0x7f930009dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f930009d7a0 0x7f930009dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 -- 172.21.15.104:0/1151616405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93000c63a0 con 0x7f92e80040b0 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fffff640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 0x7f930009e9e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f92f000fa00 tx=0x7f92f000fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:15.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fcff9640 1 -- 172.21.15.104:0/1151616405 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f000bcb0 con 0x7f92e80040b0 2024-09-17T03:04:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fcff9640 1 -- 172.21.15.104:0/1151616405 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92f0011440 con 0x7f92e80040b0 2024-09-17T03:04:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930009e0f0 con 0x7f92e80040b0 2024-09-17T03:04:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f92fcff9640 1 -- 172.21.15.104:0/1151616405 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0011870 con 0x7f92e80040b0 2024-09-17T03:04:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.815+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930009c9e0 con 0x7f92e80040b0 2024-09-17T03:04:15.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.816+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f930009d3e0 con 0x7f92e80040b0 2024-09-17T03:04:15.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.817+0000 7f92fcff9640 1 -- 172.21.15.104:0/1151616405 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92f0019020 con 0x7f92e80040b0 2024-09-17T03:04:15.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.817+0000 7f92fcff9640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f92ec078bc0 0x7f92ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:15.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.817+0000 7f92fcff9640 1 -- 172.21.15.104:0/1151616405 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7f92f009b440 con 0x7f92e80040b0 2024-09-17T03:04:15.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.818+0000 7f92ff7fe640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f92ec078bc0 0x7f92ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:15.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.818+0000 7f92ff7fe640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f92ec078bc0 0x7f92ec07b0d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f92f4032000 tx=0x7f92f4001190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:15.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:15.822+0000 7f92fcff9640 1 -- 172.21.15.104:0/1151616405 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f930009e0f0 con 0x7f92e80040b0 2024-09-17T03:04:16.065 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.066+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7f93000ce570 con 0x7f92e80040b0 2024-09-17T03:04:16.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.360+0000 7f92fcff9640 1 -- 172.21.15.104:0/1151616405 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v449) ==== 132+0+0 (secure 0 0 0) 0x7f92f0063b80 con 0x7f92e80040b0 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f92ec078bc0 msgr2=0x7f92ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f92ec078bc0 0x7f92ec07b0d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f92f4032000 tx=0x7f92f4001190 comp rx=0 tx=0).stop 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 msgr2=0x7f930009e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 0x7f930009e9e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f92f000fa00 tx=0x7f92f000fec0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 shutdown_connections 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f92ec078bc0 0x7f92ec07b0d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f930009d7a0 0x7f930009dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93001e4b50 0x7f93001d9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 --2- 172.21.15.104:0/1151616405 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f92e80040b0 0x7f930009e9e0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 >> 172.21.15.104:0/1151616405 conn(0x7f93000d28a0 msgr2=0x7f93001e56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 shutdown_connections 2024-09-17T03:04:16.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.362+0000 7f9306900640 1 -- 172.21.15.104:0/1151616405 wait complete. 2024-09-17T03:04:16.373 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-17T03:04:16.374 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2024-09-17T03:04:16.374 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2024-09-17T03:04:16.374 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:04:16.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.487+0000 7fb1e909d640 1 -- 172.21.15.104:0/1380982985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40cefb0 msgr2=0x7fb1e40cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.487+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1380982985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40cefb0 0x7fb1e40cf3c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc005fd0 tx=0x7fb1dc02a980 comp rx=0 tx=0).stop 2024-09-17T03:04:16.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.487+0000 7fb1e909d640 1 -- 172.21.15.104:0/1380982985 shutdown_connections 2024-09-17T03:04:16.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.487+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1380982985 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40cefb0 0x7fb1e40cf3c0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.487+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1380982985 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1e40b7bb0 0x7fb1e40cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.487+0000 7fb1e909d640 1 -- 172.21.15.104:0/1380982985 >> 172.21.15.104:0/1380982985 conn(0x7fb1e40d28a0 msgr2=0x7fb1e40d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:16.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.487+0000 7fb1e909d640 1 -- 172.21.15.104:0/1380982985 shutdown_connections 2024-09-17T03:04:16.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.487+0000 7fb1e909d640 1 -- 172.21.15.104:0/1380982985 wait complete. 2024-09-17T03:04:16.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.489+0000 7fb1e909d640 1 Processor -- start 2024-09-17T03:04:16.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.489+0000 7fb1e909d640 1 -- start start 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e909d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1e40b7bb0 0x7fb1e4159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e909d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1e40cefb0 0x7fb1e415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e909d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40d0470 0x7fb1e415d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e909d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e40cfa80 con 0x7fb1e40d0470 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e909d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e40cf900 con 0x7fb1e40cefb0 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e909d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e40cfc00 con 0x7fb1e40b7bb0 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40d0470 0x7fb1e415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40d0470 0x7fb1e415d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49566/0 (socket says 172.21.15.104:49566) 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e359e640 1 -- 172.21.15.104:0/1703280534 learned_addr learned my addr 172.21.15.104:0/1703280534 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1e2d9d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1e40b7bb0 0x7fb1e4159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.490+0000 7fb1da59c640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1e40cefb0 0x7fb1e415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:16.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1e359e640 1 -- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1e40b7bb0 msgr2=0x7fb1e4159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1e359e640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1e40b7bb0 0x7fb1e4159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1e359e640 1 -- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1e40cefb0 msgr2=0x7fb1e415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1e359e640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1e40cefb0 0x7fb1e415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1e359e640 1 -- 172.21.15.104:0/1703280534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e4166820 con 0x7fb1e40d0470 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1e359e640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40d0470 0x7fb1e415d010 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc033040 tx=0x7fb1dc003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1dbfff640 1 -- 172.21.15.104:0/1703280534 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc034040 con 0x7fb1e40d0470 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1dbfff640 1 -- 172.21.15.104:0/1703280534 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1dc004540 con 0x7fb1e40d0470 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e415a110 con 0x7fb1e40d0470 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1dbfff640 1 -- 172.21.15.104:0/1703280534 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc045480 con 0x7fb1e40d0470 2024-09-17T03:04:16.492 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.491+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e4166a90 con 0x7fb1e40d0470 2024-09-17T03:04:16.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.492+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e40a0970 con 0x7fb1e40d0470 2024-09-17T03:04:16.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.493+0000 7fb1dbfff640 1 -- 172.21.15.104:0/1703280534 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1dc037020 con 0x7fb1e40d0470 2024-09-17T03:04:16.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.493+0000 7fb1dbfff640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1c4078bc0 0x7fb1c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:16.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.494+0000 7fb1dbfff640 1 -- 172.21.15.104:0/1703280534 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7fb1dc0bc0d0 con 0x7fb1e40d0470 2024-09-17T03:04:16.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.494+0000 7fb1e2d9d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1c4078bc0 0x7fb1c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:16.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.495+0000 7fb1e2d9d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1c4078bc0 0x7fb1c407b0d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400bb30 tx=0x7fb1d400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:16.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.498+0000 7fb1dbfff640 1 -- 172.21.15.104:0/1703280534 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1e40a0970 con 0x7fb1e40d0470 2024-09-17T03:04:16.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.672+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1e40cde90 con 0x7fb1e40d0470 2024-09-17T03:04:16.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.673+0000 7fb1dbfff640 1 -- 172.21.15.104:0/1703280534 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) ==== 74+0+13093 (secure 0 0 0) 0x7fb1dc084250 con 0x7fb1e40d0470 2024-09-17T03:04:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:16.672 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":161,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:04:15.350613+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/1696726463":"2024-09-18T03:04:12.263359+0000","172.21.15.104:6833/1696726463":"2024-09-18T03:04:12.263359+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1c4078bc0 msgr2=0x7fb1c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1c4078bc0 0x7fb1c407b0d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400bb30 tx=0x7fb1d400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40d0470 msgr2=0x7fb1e415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40d0470 0x7fb1e415d010 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc033040 tx=0x7fb1dc003f70 comp rx=0 tx=0).stop 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 shutdown_connections 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb1c4078bc0 0x7fb1c407b0d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1e40cefb0 0x7fb1e415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1e40d0470 0x7fb1e415d010 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 --2- 172.21.15.104:0/1703280534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1e40b7bb0 0x7fb1e4159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 >> 172.21.15.104:0/1703280534 conn(0x7fb1e40d28a0 msgr2=0x7fb1e4075e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:16.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 shutdown_connections 2024-09-17T03:04:16.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.675+0000 7fb1e909d640 1 -- 172.21.15.104:0/1703280534 wait complete. 2024-09-17T03:04:16.686 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:04:16.687 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:04:16.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.802+0000 7fd014d41640 1 -- 172.21.15.104:0/2249027382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcffc004800 msgr2=0x7fcffc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.802+0000 7fd014d41640 1 --2- 172.21.15.104:0/2249027382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcffc004800 0x7fcffc004c10 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fcff80016c0 tx=0x7fcffc005830 comp rx=0 tx=0).stop 2024-09-17T03:04:16.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.802+0000 7fd014d41640 1 -- 172.21.15.104:0/2249027382 shutdown_connections 2024-09-17T03:04:16.802 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.802+0000 7fd014d41640 1 --2- 172.21.15.104:0/2249027382 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcffc004800 0x7fcffc004c10 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.802+0000 7fd014d41640 1 -- 172.21.15.104:0/2249027382 >> 172.21.15.104:0/2249027382 conn(0x7fd010069120 msgr2=0x7fd010069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:16.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.802+0000 7fd014d41640 1 -- 172.21.15.104:0/2249027382 shutdown_connections 2024-09-17T03:04:16.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.802+0000 7fd014d41640 1 -- 172.21.15.104:0/2249027382 wait complete. 2024-09-17T03:04:16.803 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.804+0000 7fd014d41640 1 Processor -- start 2024-09-17T03:04:16.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.804+0000 7fd014d41640 1 -- start start 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd014d41640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcffc004800 0x7fd0100ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd014d41640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0101f9190 0x7fd0101f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd014d41640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0101f95a0 0x7fd0101598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd014d41640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd0100b65e0 con 0x7fd0101f9190 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd014d41640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd0100d0800 con 0x7fcffc004800 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd014d41640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd0100b6760 con 0x7fd0101f95a0 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0101f9190 0x7fd0101f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0101f9190 0x7fd0101f5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49586/0 (socket says 172.21.15.104:49586) 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 -- 172.21.15.104:0/1814174921 learned_addr learned my addr 172.21.15.104:0/1814174921 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd00e59c640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcffc004800 0x7fd0100ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:16.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd00ed9d640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0101f95a0 0x7fd0101598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 -- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0101f95a0 msgr2=0x7fd0101598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0101f95a0 0x7fd0101598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 -- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcffc004800 msgr2=0x7fd0100ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcffc004800 0x7fd0100ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 -- 172.21.15.104:0/1814174921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0101f9d70 con 0x7fd0101f9190 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd00e59c640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcffc004800 0x7fd0100ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd005d9b640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0101f9190 0x7fd0101f5320 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcff80017e0 tx=0x7fcff80063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd0077fe640 1 -- 172.21.15.104:0/1814174921 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8038070 con 0x7fd0101f9190 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd0077fe640 1 -- 172.21.15.104:0/1814174921 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcff8003af0 con 0x7fd0101f9190 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0101fa050 con 0x7fd0101f9190 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.806+0000 7fd0077fe640 1 -- 172.21.15.104:0/1814174921 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8033420 con 0x7fd0101f9190 2024-09-17T03:04:16.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.807+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0100cdce0 con 0x7fd0101f9190 2024-09-17T03:04:16.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.807+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0101f9ae0 con 0x7fd0101f9190 2024-09-17T03:04:16.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.808+0000 7fd0077fe640 1 -- 172.21.15.104:0/1814174921 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcff8030070 con 0x7fd0101f9190 2024-09-17T03:04:16.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.809+0000 7fd0077fe640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcff0078b90 0x7fcff007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:16.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.809+0000 7fd0077fe640 1 -- 172.21.15.104:0/1814174921 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7fcff80b9d10 con 0x7fd0101f9190 2024-09-17T03:04:16.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.809+0000 7fd00e59c640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcff0078b90 0x7fcff007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:16.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.809+0000 7fd00e59c640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcff0078b90 0x7fcff007b0a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd000009cd0 tx=0x7fd000005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:16.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.813+0000 7fd0077fe640 1 -- 172.21.15.104:0/1814174921 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcff8082450 con 0x7fd0101f9190 2024-09-17T03:04:16.985 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.986+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd0100b6cc0 con 0x7fd0101f9190 2024-09-17T03:04:16.986 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.986+0000 7fd0077fe640 1 -- 172.21.15.104:0/1814174921 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) ==== 93+0+10 (secure 0 0 0) 0x7fcff8081d50 con 0x7fd0101f9190 2024-09-17T03:04:16.986 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcff0078b90 msgr2=0x7fcff007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcff0078b90 0x7fcff007b0a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd000009cd0 tx=0x7fd000005f90 comp rx=0 tx=0).stop 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0101f9190 msgr2=0x7fd0101f5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0101f9190 0x7fd0101f5320 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcff80017e0 tx=0x7fcff80063a0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 shutdown_connections 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcff0078b90 0x7fcff007b0a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0101f95a0 0x7fd0101598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd0101f9190 0x7fd0101f5320 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 --2- 172.21.15.104:0/1814174921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcffc004800 0x7fd0100ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 >> 172.21.15.104:0/1814174921 conn(0x7fd010069120 msgr2=0x7fd010075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:16.990 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 shutdown_connections 2024-09-17T03:04:16.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:16.988+0000 7fd014d41640 1 -- 172.21.15.104:0/1814174921 wait complete. 2024-09-17T03:04:16.999 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-17T03:04:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.111+0000 7ff175e9b640 1 -- 172.21.15.104:0/2454497032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b4fc0 msgr2=0x7ff1700b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.111+0000 7ff175e9b640 1 --2- 172.21.15.104:0/2454497032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b4fc0 0x7ff1700b39c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff160005fd0 tx=0x7ff16002aa90 comp rx=0 tx=0).stop 2024-09-17T03:04:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.111+0000 7ff175e9b640 1 -- 172.21.15.104:0/2454497032 shutdown_connections 2024-09-17T03:04:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.111+0000 7ff175e9b640 1 --2- 172.21.15.104:0/2454497032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1700b3f00 0x7ff1700b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.111+0000 7ff175e9b640 1 --2- 172.21.15.104:0/2454497032 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b4fc0 0x7ff1700b39c0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.111+0000 7ff175e9b640 1 -- 172.21.15.104:0/2454497032 >> 172.21.15.104:0/2454497032 conn(0x7ff1700b44a0 msgr2=0x7ff1700b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.111+0000 7ff175e9b640 1 -- 172.21.15.104:0/2454497032 shutdown_connections 2024-09-17T03:04:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.111+0000 7ff175e9b640 1 -- 172.21.15.104:0/2454497032 wait complete. 2024-09-17T03:04:17.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.113+0000 7ff175e9b640 1 Processor -- start 2024-09-17T03:04:17.112 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.113+0000 7ff175e9b640 1 -- start start 2024-09-17T03:04:17.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff175e9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1700b3f00 0x7ff170152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff175e9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1700b4fc0 0x7ff17015fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff175e9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b5d20 0x7ff17015ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff175e9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff170160f50 con 0x7ff1700b5d20 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff175e9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff1700ce160 con 0x7ff1700b4fc0 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff175e9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff1701610d0 con 0x7ff1700b3f00 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff16ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b5d20 0x7ff17015ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff16ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b5d20 0x7ff17015ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49604/0 (socket says 172.21.15.104:49604) 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff16ffff640 1 -- 172.21.15.104:0/241888849 learned_addr learned my addr 172.21.15.104:0/241888849 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff16effd640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1700b4fc0 0x7ff17015fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.114+0000 7ff16f7fe640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1700b3f00 0x7ff170152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff16ffff640 1 -- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1700b3f00 msgr2=0x7ff170152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:17.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff16ffff640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1700b3f00 0x7ff170152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:17.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff16ffff640 1 -- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1700b4fc0 msgr2=0x7ff17015fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:17.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff16ffff640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1700b4fc0 0x7ff17015fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:17.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff16ffff640 1 -- 172.21.15.104:0/241888849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1701531b0 con 0x7ff1700b5d20 2024-09-17T03:04:17.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff16ffff640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b5d20 0x7ff17015ff50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c3c0 tx=0x7ff16800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:17.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff157fff640 1 -- 172.21.15.104:0/241888849 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1680052d0 con 0x7ff1700b5d20 2024-09-17T03:04:17.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff157fff640 1 -- 172.21.15.104:0/241888849 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff168007020 con 0x7ff1700b5d20 2024-09-17T03:04:17.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17015e9f0 con 0x7ff1700b5d20 2024-09-17T03:04:17.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff157fff640 1 -- 172.21.15.104:0/241888849 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168007470 con 0x7ff1700b5d20 2024-09-17T03:04:17.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.115+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17015efb0 con 0x7ff1700b5d20 2024-09-17T03:04:17.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.116+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1700b57e0 con 0x7ff1700b5d20 2024-09-17T03:04:17.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.117+0000 7ff157fff640 1 -- 172.21.15.104:0/241888849 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1680067d0 con 0x7ff1700b5d20 2024-09-17T03:04:17.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.117+0000 7ff157fff640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff15c078bc0 0x7ff15c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:17.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.117+0000 7ff157fff640 1 -- 172.21.15.104:0/241888849 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7ff168099d10 con 0x7ff1700b5d20 2024-09-17T03:04:17.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.117+0000 7ff16f7fe640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff15c078bc0 0x7ff15c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:17.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.118+0000 7ff16f7fe640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff15c078bc0 0x7ff15c07b0d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff160035000 tx=0x7ff160038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:17.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.122+0000 7ff157fff640 1 -- 172.21.15.104:0/241888849 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff168061e00 con 0x7ff1700b5d20 2024-09-17T03:04:17.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:17.366+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7ff1700b2da0 con 0x7ff1700b5d20 2024-09-17T03:04:18.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.368+0000 7ff157fff640 1 -- 172.21.15.104:0/241888849 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v451) ==== 134+0+0 (secure 0 0 0) 0x7ff168066830 con 0x7ff1700b5d20 2024-09-17T03:04:18.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff15c078bc0 msgr2=0x7ff15c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff15c078bc0 0x7ff15c07b0d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff160035000 tx=0x7ff160038040 comp rx=0 tx=0).stop 2024-09-17T03:04:18.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b5d20 msgr2=0x7ff17015ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b5d20 0x7ff17015ff50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c3c0 tx=0x7ff16800c880 comp rx=0 tx=0).stop 2024-09-17T03:04:18.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 shutdown_connections 2024-09-17T03:04:18.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff15c078bc0 0x7ff15c07b0d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.370 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1700b4fc0 0x7ff17015fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff1700b5d20 0x7ff17015ff50 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 --2- 172.21.15.104:0/241888849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1700b3f00 0x7ff170152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.370+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 >> 172.21.15.104:0/241888849 conn(0x7ff1700b44a0 msgr2=0x7ff1700b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:18.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.371+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 shutdown_connections 2024-09-17T03:04:18.371 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.371+0000 7ff175e9b640 1 -- 172.21.15.104:0/241888849 wait complete. 2024-09-17T03:04:18.383 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:04:18.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.500+0000 7fb5e515e640 1 -- 172.21.15.104:0/444057349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 msgr2=0x7fb5cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.500+0000 7fb5e515e640 1 --2- 172.21.15.104:0/444057349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 0x7fb5cc00b9c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8005fd0 tx=0x7fb5cc005830 comp rx=0 tx=0).stop 2024-09-17T03:04:18.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.500+0000 7fb5df59e640 1 -- 172.21.15.104:0/444057349 reap_dead start 2024-09-17T03:04:18.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.500+0000 7fb5e515e640 1 -- 172.21.15.104:0/444057349 shutdown_connections 2024-09-17T03:04:18.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.500+0000 7fb5e515e640 1 -- 172.21.15.104:0/444057349 >> 172.21.15.104:0/444057349 conn(0x7fb5e006d200 msgr2=0x7fb5e006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:18.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.500+0000 7fb5e515e640 1 -- 172.21.15.104:0/444057349 shutdown_connections 2024-09-17T03:04:18.500 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.500+0000 7fb5e515e640 1 -- 172.21.15.104:0/444057349 wait complete. 2024-09-17T03:04:18.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.502+0000 7fb5e515e640 1 Processor -- start 2024-09-17T03:04:18.501 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.502+0000 7fb5e515e640 1 -- start start 2024-09-17T03:04:18.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.503+0000 7fb5e515e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 0x7fb5e015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:18.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.503+0000 7fb5e515e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e01f4d60 0x7fb5e01f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:18.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.503+0000 7fb5e515e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e01f7e40 0x7fb5e0141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:18.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.503+0000 7fb5e515e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e00b0b30 con 0x7fb5cc004e60 2024-09-17T03:04:18.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.503+0000 7fb5e515e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e00b09b0 con 0x7fb5e01f4d60 2024-09-17T03:04:18.504 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.503+0000 7fb5e515e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e00b0cb0 con 0x7fb5e01f7e40 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.503+0000 7fb5ded9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 0x7fb5e015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.503+0000 7fb5ded9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 0x7fb5e015dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49630/0 (socket says 172.21.15.104:49630) 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5ded9d640 1 -- 172.21.15.104:0/995937242 learned_addr learned my addr 172.21.15.104:0/995937242 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5d659c640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e01f4d60 0x7fb5e01f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5df59e640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e01f7e40 0x7fb5e0141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5ded9d640 1 -- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e01f7e40 msgr2=0x7fb5e0141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5ded9d640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e01f7e40 0x7fb5e0141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5ded9d640 1 -- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e01f4d60 msgr2=0x7fb5e01f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5ded9d640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e01f4d60 0x7fb5e01f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5ded9d640 1 -- 172.21.15.104:0/995937242 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e015e590 con 0x7fb5cc004e60 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5df59e640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e01f7e40 0x7fb5e0141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5ded9d640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 0x7fb5e015dd40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0004e80 tx=0x7fb5d0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:18.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5d7fff640 1 -- 172.21.15.104:0/995937242 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0015020 con 0x7fb5cc004e60 2024-09-17T03:04:18.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5d7fff640 1 -- 172.21.15.104:0/995937242 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5d0011980 con 0x7fb5cc004e60 2024-09-17T03:04:18.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e015e870 con 0x7fb5cc004e60 2024-09-17T03:04:18.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5d7fff640 1 -- 172.21.15.104:0/995937242 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0011dd0 con 0x7fb5cc004e60 2024-09-17T03:04:18.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.504+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e015ee30 con 0x7fb5cc004e60 2024-09-17T03:04:18.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.505+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e0069ed0 con 0x7fb5cc004e60 2024-09-17T03:04:18.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.506+0000 7fb5d7fff640 1 -- 172.21.15.104:0/995937242 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5d0018020 con 0x7fb5cc004e60 2024-09-17T03:04:18.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.507+0000 7fb5d7fff640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5c0078b90 0x7fb5c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:18.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.507+0000 7fb5d7fff640 1 -- 172.21.15.104:0/995937242 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7fb5d009b400 con 0x7fb5cc004e60 2024-09-17T03:04:18.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.507+0000 7fb5d659c640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5c0078b90 0x7fb5c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:18.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.507+0000 7fb5d659c640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5c0078b90 0x7fb5c007b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb5e006f7e0 tx=0x7fb5c8006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:18.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.511+0000 7fb5d7fff640 1 -- 172.21.15.104:0/995937242 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5d001f020 con 0x7fb5cc004e60 2024-09-17T03:04:18.682 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.683+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb5e0160620 con 0x7fb5cc004e60 2024-09-17T03:04:18.683 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.683+0000 7fb5d7fff640 1 -- 172.21.15.104:0/995937242 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+1472 (secure 0 0 0) 0x7fb5d0063b50 con 0x7fb5cc004e60 2024-09-17T03:04:18.683 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:04:18.683 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:04:18.683 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:04:18.683 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T03:04:18.683 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:04:18.683 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:04:18.683 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T03:04:18.684 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T03:04:18.685 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T03:04:18.685 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:04:18.685 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:04:18.685 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5c0078b90 msgr2=0x7fb5c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5c0078b90 0x7fb5c007b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb5e006f7e0 tx=0x7fb5c8006040 comp rx=0 tx=0).stop 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 msgr2=0x7fb5e015dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 0x7fb5e015dd40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0004e80 tx=0x7fb5d0001630 comp rx=0 tx=0).stop 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 shutdown_connections 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb5c0078b90 0x7fb5c007b0a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5e01f4d60 0x7fb5e01f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5e01f7e40 0x7fb5e0141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 --2- 172.21.15.104:0/995937242 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb5cc004e60 0x7fb5e015dd40 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.686 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 >> 172.21.15.104:0/995937242 conn(0x7fb5e006d200 msgr2=0x7fb5e0153350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 shutdown_connections 2024-09-17T03:04:18.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.685+0000 7fb5e515e640 1 -- 172.21.15.104:0/995937242 wait complete. 2024-09-17T03:04:18.696 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:04:18.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.812+0000 7f897539d640 1 -- 172.21.15.104:0/52747735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8958004d40 msgr2=0x7f8958005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.812+0000 7f897539d640 1 --2- 172.21.15.104:0/52747735 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8958004d40 0x7f8958005150 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8968009ed0 tx=0x7f8958005830 comp rx=0 tx=0).stop 2024-09-17T03:04:18.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.812+0000 7f8974b9c640 1 -- 172.21.15.104:0/52747735 reap_dead start 2024-09-17T03:04:18.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.812+0000 7f897539d640 1 -- 172.21.15.104:0/52747735 shutdown_connections 2024-09-17T03:04:18.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.812+0000 7f897539d640 1 -- 172.21.15.104:0/52747735 >> 172.21.15.104:0/52747735 conn(0x7f897006cfc0 msgr2=0x7f897006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:18.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.812+0000 7f897539d640 1 -- 172.21.15.104:0/52747735 shutdown_connections 2024-09-17T03:04:18.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.812+0000 7f897539d640 1 -- 172.21.15.104:0/52747735 wait complete. 2024-09-17T03:04:18.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.814+0000 7f897539d640 1 Processor -- start 2024-09-17T03:04:18.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.814+0000 7f897539d640 1 -- start start 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f897539d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958004d40 0x7f897014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f897539d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f897015f550 0x7f897015f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f897539d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f897015fea0 0x7f897013d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f897539d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8970153c40 con 0x7f897015f550 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f897539d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8970073e90 con 0x7f897015fea0 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f897539d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8970153dc0 con 0x7f8958004d40 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f897015f550 0x7f897015f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f896f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f897015f550 0x7f897015f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49650/0 (socket says 172.21.15.104:49650) 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f896f7fe640 1 -- 172.21.15.104:0/1281957258 learned_addr learned my addr 172.21.15.104:0/1281957258 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f896ffff640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958004d40 0x7f897014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:18.816 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.815+0000 7f8974b9c640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f897015fea0 0x7f897013d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896f7fe640 1 -- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958004d40 msgr2=0x7f897014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896f7fe640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958004d40 0x7f897014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896f7fe640 1 -- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f897015fea0 msgr2=0x7f897013d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896f7fe640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f897015fea0 0x7f897013d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896f7fe640 1 -- 172.21.15.104:0/1281957258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89701502a0 con 0x7f897015f550 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896f7fe640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f897015f550 0x7f897015f960 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f8964011820 tx=0x7f8964011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896cff9640 1 -- 172.21.15.104:0/1281957258 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896401f070 con 0x7f897015f550 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896cff9640 1 -- 172.21.15.104:0/1281957258 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f896400fc30 con 0x7f897015f550 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8970156520 con 0x7f897015f550 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f896cff9640 1 -- 172.21.15.104:0/1281957258 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8964012450 con 0x7f897015f550 2024-09-17T03:04:18.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.816+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8970156ae0 con 0x7f897015f550 2024-09-17T03:04:18.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.817+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89700cf250 con 0x7f897015f550 2024-09-17T03:04:18.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.818+0000 7f896cff9640 1 -- 172.21.15.104:0/1281957258 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8964022070 con 0x7f897015f550 2024-09-17T03:04:18.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.818+0000 7f896cff9640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f895c078b90 0x7f895c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:18.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.818+0000 7f896cff9640 1 -- 172.21.15.104:0/1281957258 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7f896409b3f0 con 0x7f897015f550 2024-09-17T03:04:18.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.818+0000 7f896ffff640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f895c078b90 0x7f895c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:18.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.819+0000 7f896ffff640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f895c078b90 0x7f895c07b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8960001c00 tx=0x7f8960001b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:18.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.823+0000 7f896cff9640 1 -- 172.21.15.104:0/1281957258 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f89700cf250 con 0x7f897015f550 2024-09-17T03:04:18.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.995+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f89700b20b0 con 0x7f897015f550 2024-09-17T03:04:18.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:18.999+0000 7f896cff9640 1 -- 172.21.15.104:0/1281957258 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f89640633c0 con 0x7f897015f550 2024-09-17T03:04:19.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f895c078b90 msgr2=0x7f895c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f895c078b90 0x7f895c07b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8960001c00 tx=0x7f8960001b90 comp rx=0 tx=0).stop 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f897015f550 msgr2=0x7f897015f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f897015f550 0x7f897015f960 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f8964011820 tx=0x7f8964011c20 comp rx=0 tx=0).stop 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 shutdown_connections 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f895c078b90 0x7f895c07b0a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f897015fea0 0x7f897013d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f897015f550 0x7f897015f960 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 --2- 172.21.15.104:0/1281957258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8958004d40 0x7f897014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 >> 172.21.15.104:0/1281957258 conn(0x7f897006cfc0 msgr2=0x7f89700d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 shutdown_connections 2024-09-17T03:04:19.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.001+0000 7f897539d640 1 -- 172.21.15.104:0/1281957258 wait complete. 2024-09-17T03:04:19.011 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:04:19.012 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:04:19.051 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:04:19.108 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:04:19.108 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:04:19.109 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:19.125 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:04:19.125 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:04:19.125 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:19.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:04:19.146 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:04:19.146 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:19.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:04:19.182 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:04:19.182 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:19.204 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:04:19.204 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:04:19.205 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:04:19.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 -- 172.21.15.104:0/1046835939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 msgr2=0x7f16640b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 --2- 172.21.15.104:0/1046835939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 0x7f16640b3750 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f1664069e70 tx=0x7f165c02a980 comp rx=0 tx=0).stop 2024-09-17T03:04:19.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 -- 172.21.15.104:0/1046835939 shutdown_connections 2024-09-17T03:04:19.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 --2- 172.21.15.104:0/1046835939 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 0x7f16640b3750 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 --2- 172.21.15.104:0/1046835939 >> v2:172.21.15.192:3300/0 conn(0x7f166406f840 0x7f1664072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 --2- 172.21.15.104:0/1046835939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16640cff70 0x7f166415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 -- 172.21.15.104:0/1046835939 >> 172.21.15.104:0/1046835939 conn(0x7f16640b2450 msgr2=0x7f16640b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:19.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 -- 172.21.15.104:0/1046835939 shutdown_connections 2024-09-17T03:04:19.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.335+0000 7f166bc41640 1 -- 172.21.15.104:0/1046835939 wait complete. 2024-09-17T03:04:19.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.337+0000 7f166bc41640 1 Processor -- start 2024-09-17T03:04:19.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.337+0000 7f166bc41640 1 -- start start 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.338+0000 7f166bc41640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f166406f840 0x7f16640b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.338+0000 7f166bc41640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 0x7f16641521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.338+0000 7f166bc41640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16640cff70 0x7f1664152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.338+0000 7f166bc41640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f166406fdd0 con 0x7f1664073370 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.338+0000 7f166bc41640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f166406fc50 con 0x7f166406f840 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.338+0000 7f166bc41640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f16640b3c90 con 0x7f16640cff70 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 0x7f16641521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 0x7f16641521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49662/0 (socket says 172.21.15.104:49662) 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16699dd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f166406f840 0x7f16640b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:19.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 -- 172.21.15.104:0/2995655167 learned_addr learned my addr 172.21.15.104:0/2995655167 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f166a1de640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16640cff70 0x7f1664152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 -- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16640cff70 msgr2=0x7f1664152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16640cff70 0x7f1664152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 -- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f166406f840 msgr2=0x7f16640b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f166406f840 0x7f16640b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 -- 172.21.15.104:0/2995655167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166413b150 con 0x7f1664073370 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f16691dc640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 0x7f16641521f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f165400c970 tx=0x7f165400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f165a7fc640 1 -- 172.21.15.104:0/2995655167 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654004220 con 0x7f1664073370 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f165a7fc640 1 -- 172.21.15.104:0/2995655167 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16540079b0 con 0x7f1664073370 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f165a7fc640 1 -- 172.21.15.104:0/2995655167 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654007de0 con 0x7f1664073370 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166413b430 con 0x7f1664073370 2024-09-17T03:04:19.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.339+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166413b9f0 con 0x7f1664073370 2024-09-17T03:04:19.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.340+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1664166f70 con 0x7f1664073370 2024-09-17T03:04:19.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.341+0000 7f165a7fc640 1 -- 172.21.15.104:0/2995655167 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1654005020 con 0x7f1664073370 2024-09-17T03:04:19.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.342+0000 7f165a7fc640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1648078bc0 0x7f164807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:19.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.342+0000 7f165a7fc640 1 -- 172.21.15.104:0/2995655167 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7f165409acf0 con 0x7f1664073370 2024-09-17T03:04:19.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.342+0000 7f16699dd640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1648078bc0 0x7f164807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:19.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.342+0000 7f16699dd640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1648078bc0 0x7f164807b0d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1660005fd0 tx=0x7f166000a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:19.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.346+0000 7f165a7fc640 1 -- 172.21.15.104:0/2995655167 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1664166f70 con 0x7f1664073370 2024-09-17T03:04:19.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.554+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16640b4870 con 0x7f1664073370 2024-09-17T03:04:19.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.555+0000 7f165a7fc640 1 -- 172.21.15.104:0/2995655167 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+3923 (secure 0 0 0) 0x7f165409f070 con 0x7f1664073370 2024-09-17T03:04:19.554 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:19.555 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":64,"btime":"2024-09-17T03:04:13:264903+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1088380573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1088380573},{"type":"v1","addr":"172.21.15.192:6836","nonce":1088380573}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":6838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3930263372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3930263372},{"type":"v1","addr":"172.21.15.192:6837","nonce":3930263372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7449,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/2263721697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2263721697},{"type":"v1","addr":"172.21.15.104:6834","nonce":2263721697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":7707,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1703941440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1703941440},{"type":"v1","addr":"172.21.15.104:6835","nonce":1703941440}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[]} 2024-09-17T03:04:19.555 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 64 2024-09-17T03:04:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1648078bc0 msgr2=0x7f164807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1648078bc0 0x7f164807b0d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1660005fd0 tx=0x7f166000a250 comp rx=0 tx=0).stop 2024-09-17T03:04:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 msgr2=0x7f16641521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 0x7f16641521f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f165400c970 tx=0x7f165400ce30 comp rx=0 tx=0).stop 2024-09-17T03:04:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 shutdown_connections 2024-09-17T03:04:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1648078bc0 0x7f164807b0d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16640cff70 0x7f1664152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1664073370 0x7f16641521f0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 --2- 172.21.15.104:0/2995655167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f166406f840 0x7f16640b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 >> 172.21.15.104:0/2995655167 conn(0x7f16640b2450 msgr2=0x7f16641560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 shutdown_connections 2024-09-17T03:04:19.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.557+0000 7f166bc41640 1 -- 172.21.15.104:0/2995655167 wait complete. 2024-09-17T03:04:19.568 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:04:19.568 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:04:19.568 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:04:19.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:04:19.569 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:04:19.569 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:04:19.569 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:04:19.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:04:19.569 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:04:19.569 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:04:19.570 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:04:19.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:04:19.570 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:04:19.570 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:04:19.570 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:04:19.571 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:04:19.580 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:04:19.580 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:04:19.581 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:04:19.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:04:19.582 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:04:19.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:04:19.583 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:04:19.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:04:19.623 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:04:19.624 DEBUG:teuthology.parallel:result is None 2024-09-17T03:04:19.625 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:04:19.625 DEBUG:teuthology.parallel:result is None 2024-09-17T03:04:19.626 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:04:19.626 DEBUG:teuthology.parallel:result is None 2024-09-17T03:04:19.626 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:04:19.627 DEBUG:teuthology.parallel:result is None 2024-09-17T03:04:19.627 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:04:19.709 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T03:04:19.710 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T03:04:19.719 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T03:04:19.719 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T03:04:19.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.748+0000 7f8ec8dba640 1 -- 172.21.15.104:0/496918694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec40b6cb0 msgr2=0x7f8ec415f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.748+0000 7f8ec8dba640 1 --2- 172.21.15.104:0/496918694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec40b6cb0 0x7f8ec415f0b0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f8eac005fd0 tx=0x7f8eac02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.748+0000 7f8ec8dba640 1 -- 172.21.15.104:0/496918694 shutdown_connections 2024-09-17T03:04:19.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.748+0000 7f8ec8dba640 1 --2- 172.21.15.104:0/496918694 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec40b6cb0 0x7f8ec415f0b0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.748+0000 7f8ec8dba640 1 -- 172.21.15.104:0/496918694 >> 172.21.15.104:0/496918694 conn(0x7f8ec4069120 msgr2=0x7f8ec4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:19.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.748+0000 7f8ec8dba640 1 -- 172.21.15.104:0/496918694 shutdown_connections 2024-09-17T03:04:19.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.748+0000 7f8ec8dba640 1 -- 172.21.15.104:0/496918694 wait complete. 2024-09-17T03:04:19.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.750+0000 7f8ec8dba640 1 Processor -- start 2024-09-17T03:04:19.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.750+0000 7f8ec8dba640 1 -- start start 2024-09-17T03:04:19.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec8dba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec41621e0 0x7f8ec41459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec8dba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec4162cb0 0x7f8ec4157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec8dba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec4152080 0x7f8ec40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec8dba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec4160090 con 0x7f8ec4152080 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec8dba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec415ff10 con 0x7f8ec41621e0 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec8dba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec4160210 con 0x7f8ec4162cb0 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec4152080 0x7f8ec40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec41621e0 0x7f8ec41459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec2d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec4152080 0x7f8ec40b8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49686/0 (socket says 172.21.15.104:49686) 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8eb9d9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec4162cb0 0x7f8ec4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:19.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec2d9d640 1 -- 172.21.15.104:0/3474175772 learned_addr learned my addr 172.21.15.104:0/3474175772 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec2d9d640 1 -- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec4162cb0 msgr2=0x7f8ec4157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec2d9d640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec4162cb0 0x7f8ec4157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec2d9d640 1 -- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec41621e0 msgr2=0x7f8ec41459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec2d9d640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec41621e0 0x7f8ec41459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.751+0000 7f8ec2d9d640 1 -- 172.21.15.104:0/3474175772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec4145f30 con 0x7f8ec4152080 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.752+0000 7f8ec2d9d640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec4152080 0x7f8ec40b8a50 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c730 tx=0x7f8ebc00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.752+0000 7f8ebb7fe640 1 -- 172.21.15.104:0/3474175772 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc003b70 con 0x7f8ec4152080 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.752+0000 7f8ebb7fe640 1 -- 172.21.15.104:0/3474175772 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ebc003d10 con 0x7f8ec4152080 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.752+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec4157cd0 con 0x7f8ec4152080 2024-09-17T03:04:19.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.752+0000 7f8ebb7fe640 1 -- 172.21.15.104:0/3474175772 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0052d0 con 0x7f8ec4152080 2024-09-17T03:04:19.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.752+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec40cd9e0 con 0x7f8ec4152080 2024-09-17T03:04:19.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.753+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec40b6d60 con 0x7f8ec4152080 2024-09-17T03:04:19.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.754+0000 7f8ebb7fe640 1 -- 172.21.15.104:0/3474175772 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ebc005470 con 0x7f8ec4152080 2024-09-17T03:04:19.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.754+0000 7f8ebb7fe640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea4078bc0 0x7f8ea407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:19.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.754+0000 7f8ebb7fe640 1 -- 172.21.15.104:0/3474175772 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 4943+0+0 (secure 0 0 0) 0x7f8ebc09a750 con 0x7f8ec4152080 2024-09-17T03:04:19.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.754+0000 7f8ec259c640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea4078bc0 0x7f8ea407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:19.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.755+0000 7f8ec259c640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea4078bc0 0x7f8ea407b0d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4000fb0 tx=0x7f8eb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:19.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.759+0000 7f8ebb7fe640 1 -- 172.21.15.104:0/3474175772 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ec4157cd0 con 0x7f8ec4152080 2024-09-17T03:04:19.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:19.946+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8ec415e4c0 con 0x7f8ec4152080 2024-09-17T03:04:20.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.380+0000 7f8ebb7fe640 1 -- 172.21.15.104:0/3474175772 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v163) ==== 97+0+0 (secure 0 0 0) 0x7f8ec4145f30 con 0x7f8ec4152080 2024-09-17T03:04:20.379 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T03:04:20.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea4078bc0 msgr2=0x7f8ea407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea4078bc0 0x7f8ea407b0d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4000fb0 tx=0x7f8eb4009040 comp rx=0 tx=0).stop 2024-09-17T03:04:20.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec4152080 msgr2=0x7f8ec40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec4152080 0x7f8ec40b8a50 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00c730 tx=0x7f8ebc00cb30 comp rx=0 tx=0).stop 2024-09-17T03:04:20.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 shutdown_connections 2024-09-17T03:04:20.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8ea4078bc0 0x7f8ea407b0d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ec4152080 0x7f8ec40b8a50 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ec4162cb0 0x7f8ec4157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 --2- 172.21.15.104:0/3474175772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ec41621e0 0x7f8ec41459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 >> 172.21.15.104:0/3474175772 conn(0x7f8ec4069120 msgr2=0x7f8ec415d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:20.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 shutdown_connections 2024-09-17T03:04:20.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.382+0000 7f8ec8dba640 1 -- 172.21.15.104:0/3474175772 wait complete. 2024-09-17T03:04:20.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:04:20.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.506+0000 7fd534fc6640 1 -- 172.21.15.104:0/883636393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5300b6f70 msgr2=0x7fd53015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.506+0000 7fd534fc6640 1 --2- 172.21.15.104:0/883636393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5300b6f70 0x7fd53015ef90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd520005fd0 tx=0x7fd52002a7a0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.506+0000 7fd534fc6640 1 -- 172.21.15.104:0/883636393 shutdown_connections 2024-09-17T03:04:20.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.506+0000 7fd534fc6640 1 --2- 172.21.15.104:0/883636393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5300b3b00 0x7fd5300d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.506+0000 7fd534fc6640 1 --2- 172.21.15.104:0/883636393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5300b6f70 0x7fd53015ef90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.506+0000 7fd534fc6640 1 -- 172.21.15.104:0/883636393 >> 172.21.15.104:0/883636393 conn(0x7fd530073df0 msgr2=0x7fd530068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:20.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.506+0000 7fd534fc6640 1 -- 172.21.15.104:0/883636393 shutdown_connections 2024-09-17T03:04:20.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.506+0000 7fd534fc6640 1 -- 172.21.15.104:0/883636393 wait complete. 2024-09-17T03:04:20.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.508+0000 7fd534fc6640 1 Processor -- start 2024-09-17T03:04:20.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.508+0000 7fd534fc6640 1 -- start start 2024-09-17T03:04:20.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd534fc6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5300b3b00 0x7fd5301f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:20.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd534fc6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5300b6f70 0x7fd530161f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:20.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd534fc6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5300d1710 0x7fd530149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:20.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd534fc6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd5300d0030 con 0x7fd5300b3b00 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd534fc6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5300b38d0 con 0x7fd5300d1710 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd534fc6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd5300d01b0 con 0x7fd5300b6f70 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5300b3b00 0x7fd5301f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5300b3b00 0x7fd5301f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49688/0 (socket says 172.21.15.104:49688) 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 -- 172.21.15.104:0/3464219297 learned_addr learned my addr 172.21.15.104:0/3464219297 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52dd9b640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5300b6f70 0x7fd530161f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52ed9d640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5300d1710 0x7fd530149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 -- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5300b6f70 msgr2=0x7fd530161f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5300b6f70 0x7fd530161f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 -- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5300d1710 msgr2=0x7fd530149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5300d1710 0x7fd530149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 -- 172.21.15.104:0/3464219297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5301f6e20 con 0x7fd5300b3b00 2024-09-17T03:04:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52dd9b640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5300b6f70 0x7fd530161f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd52e59c640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5300b3b00 0x7fd5301f68e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd520034040 tx=0x7fd520032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.510+0000 7fd51effd640 1 -- 172.21.15.104:0/3464219297 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520041020 con 0x7fd5300b3b00 2024-09-17T03:04:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.511+0000 7fd51effd640 1 -- 172.21.15.104:0/3464219297 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd520032e50 con 0x7fd5300b3b00 2024-09-17T03:04:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.511+0000 7fd51effd640 1 -- 172.21.15.104:0/3464219297 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520036040 con 0x7fd5300b3b00 2024-09-17T03:04:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.511+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5300b9540 con 0x7fd5300b3b00 2024-09-17T03:04:20.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.511+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5300b9b00 con 0x7fd5300b3b00 2024-09-17T03:04:20.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.512+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5300d06d0 con 0x7fd5300b3b00 2024-09-17T03:04:20.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.512+0000 7fd51effd640 1 -- 172.21.15.104:0/3464219297 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd520044020 con 0x7fd5300b3b00 2024-09-17T03:04:20.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.513+0000 7fd51effd640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd510078b90 0x7fd51007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:20.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.513+0000 7fd51effd640 1 -- 172.21.15.104:0/3464219297 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 4857+0+0 (secure 0 0 0) 0x7fd5200bb970 con 0x7fd5300b3b00 2024-09-17T03:04:20.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.513+0000 7fd52dd9b640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd510078b90 0x7fd51007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:20.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.514+0000 7fd52dd9b640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd510078b90 0x7fd51007b0a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd5300ba540 tx=0x7fd524005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:20.517 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.517+0000 7fd51effd640 1 -- 172.21.15.104:0/3464219297 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd52004b030 con 0x7fd5300b3b00 2024-09-17T03:04:20.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.759+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd5300b8a60 con 0x7fd5300b3b00 2024-09-17T03:04:20.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.760+0000 7fd51effd640 1 -- 172.21.15.104:0/3464219297 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) ==== 80+0+5304 (secure 0 0 0) 0x7fd5301f6e20 con 0x7fd5300b3b00 2024-09-17T03:04:20.759 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.760 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.761 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.762 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.763 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:04:20.764 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:04:20.765 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.766 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.767 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T03:04:20.768 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.769 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T03:04:20.770 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:04:20.771 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.772 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T03:04:20.773 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:04:20.774 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:04:20.775 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:04:20.775 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:04:20.775 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.775 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:20.775 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:04:20.775 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:04:20.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd510078b90 msgr2=0x7fd51007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd510078b90 0x7fd51007b0a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd5300ba540 tx=0x7fd524005f90 comp rx=0 tx=0).stop 2024-09-17T03:04:20.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5300b3b00 msgr2=0x7fd5301f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5300b3b00 0x7fd5301f68e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd520034040 tx=0x7fd520032c60 comp rx=0 tx=0).stop 2024-09-17T03:04:20.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 shutdown_connections 2024-09-17T03:04:20.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd510078b90 0x7fd51007b0a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5300d1710 0x7fd530149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5300b6f70 0x7fd530161f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 --2- 172.21.15.104:0/3464219297 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5300b3b00 0x7fd5301f68e0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 >> 172.21.15.104:0/3464219297 conn(0x7fd530073df0 msgr2=0x7fd53015ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:20.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 shutdown_connections 2024-09-17T03:04:20.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.762+0000 7fd534fc6640 1 -- 172.21.15.104:0/3464219297 wait complete. 2024-09-17T03:04:20.778 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:04:20.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.891+0000 7f98f228b640 1 -- 172.21.15.104:0/2175711568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0b3b00 msgr2=0x7f98ec0d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.891+0000 7f98f228b640 1 --2- 172.21.15.104:0/2175711568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0b3b00 0x7f98ec0d11d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f98ec08daa0 tx=0x7f98e002a560 comp rx=0 tx=0).stop 2024-09-17T03:04:20.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.891+0000 7f98f228b640 1 -- 172.21.15.104:0/2175711568 shutdown_connections 2024-09-17T03:04:20.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.891+0000 7f98f228b640 1 --2- 172.21.15.104:0/2175711568 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0b3b00 0x7f98ec0d11d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.891+0000 7f98f228b640 1 --2- 172.21.15.104:0/2175711568 >> v2:172.21.15.192:3300/0 conn(0x7f98ec0b6f70 0x7f98ec15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.891+0000 7f98f228b640 1 -- 172.21.15.104:0/2175711568 >> 172.21.15.104:0/2175711568 conn(0x7f98ec073df0 msgr2=0x7f98ec068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:20.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.892+0000 7f98f228b640 1 -- 172.21.15.104:0/2175711568 shutdown_connections 2024-09-17T03:04:20.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.892+0000 7f98f228b640 1 -- 172.21.15.104:0/2175711568 wait complete. 2024-09-17T03:04:20.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.893+0000 7f98f228b640 1 Processor -- start 2024-09-17T03:04:20.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.893+0000 7f98f228b640 1 -- start start 2024-09-17T03:04:20.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f228b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98ec0b3b00 0x7f98ec14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f228b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ec0b6f70 0x7f98ec1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f228b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0d1710 0x7f98ec1f9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f228b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec0d01b0 con 0x7f98ec0d1710 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f228b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec0d0030 con 0x7f98ec0b6f70 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f228b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec0d0330 con 0x7f98ec0b3b00 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0d1710 0x7f98ec1f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0d1710 0x7f98ec1f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49700/0 (socket says 172.21.15.104:49700) 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 -- 172.21.15.104:0/113523909 learned_addr learned my addr 172.21.15.104:0/113523909 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98ebfff640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98ec0b3b00 0x7f98ec14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98eb7fe640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ec0b6f70 0x7f98ec1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 -- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98ec0b3b00 msgr2=0x7f98ec14d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98ec0b3b00 0x7f98ec14d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 -- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ec0b6f70 msgr2=0x7f98ec1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ec0b6f70 0x7f98ec1504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 -- 172.21.15.104:0/113523909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec0c9c30 con 0x7f98ec0d1710 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98f0828640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0d1710 0x7f98ec1f9060 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f98e400c760 tx=0x7f98e400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.895+0000 7f98e8ff9640 1 -- 172.21.15.104:0/113523909 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e4003b70 con 0x7f98ec0d1710 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.896+0000 7f98e8ff9640 1 -- 172.21.15.104:0/113523909 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98e4003d10 con 0x7f98ec0d1710 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.896+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ec0c9f10 con 0x7f98ec0d1710 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.896+0000 7f98e8ff9640 1 -- 172.21.15.104:0/113523909 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e40052d0 con 0x7f98ec0d1710 2024-09-17T03:04:20.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.896+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ec0ca4d0 con 0x7f98ec0d1710 2024-09-17T03:04:20.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.897+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ec0d5540 con 0x7f98ec0d1710 2024-09-17T03:04:20.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.897+0000 7f98e8ff9640 1 -- 172.21.15.104:0/113523909 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98e4005470 con 0x7f98ec0d1710 2024-09-17T03:04:20.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.898+0000 7f98e8ff9640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f98d8078b90 0x7f98d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:20.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.898+0000 7f98e8ff9640 1 -- 172.21.15.104:0/113523909 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 4857+0+0 (secure 0 0 0) 0x7f98e409a7f0 con 0x7f98ec0d1710 2024-09-17T03:04:20.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.898+0000 7f98ebfff640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f98d8078b90 0x7f98d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:20.898 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.899+0000 7f98ebfff640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f98d8078b90 0x7f98d807b0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0058c0 tx=0x7f98dc005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:20.901 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:20.902+0000 7f98e8ff9640 1 -- 172.21.15.104:0/113523909 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f98e4062f80 con 0x7f98ec0d1710 2024-09-17T03:04:21.079 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.080+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f98ec0d1150 con 0x7f98ec0d1710 2024-09-17T03:04:21.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.080+0000 7f98e8ff9640 1 -- 172.21.15.104:0/113523909 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v165) ==== 84+0+65 (secure 0 0 0) 0x7f98e4062880 con 0x7f98ec0d1710 2024-09-17T03:04:21.080 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:21.080 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T03:04:21.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:04:21.080 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T03:04:21.080 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T03:04:21.080 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:04:21.080 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T03:04:21.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f98d8078b90 msgr2=0x7f98d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:21.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f98d8078b90 0x7f98d807b0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0058c0 tx=0x7f98dc005850 comp rx=0 tx=0).stop 2024-09-17T03:04:21.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0d1710 msgr2=0x7f98ec1f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0d1710 0x7f98ec1f9060 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f98e400c760 tx=0x7f98e400cb60 comp rx=0 tx=0).stop 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 shutdown_connections 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f98d8078b90 0x7f98d807b0a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ec0b6f70 0x7f98ec1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98ec0d1710 0x7f98ec1f9060 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 --2- 172.21.15.104:0/113523909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98ec0b3b00 0x7f98ec14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 >> 172.21.15.104:0/113523909 conn(0x7f98ec073df0 msgr2=0x7f98ec0cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 shutdown_connections 2024-09-17T03:04:21.083 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.083+0000 7f98f228b640 1 -- 172.21.15.104:0/113523909 wait complete. 2024-09-17T03:04:21.096 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:04:21.096 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:04:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.213+0000 7fad35aec640 1 -- 172.21.15.104:0/2517670137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad301466c0 msgr2=0x7fad30074030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.213+0000 7fad35aec640 1 --2- 172.21.15.104:0/2517670137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad301466c0 0x7fad30074030 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fad20009830 tx=0x7fad2002a510 comp rx=0 tx=0).stop 2024-09-17T03:04:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.213+0000 7fad35aec640 1 -- 172.21.15.104:0/2517670137 shutdown_connections 2024-09-17T03:04:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.213+0000 7fad35aec640 1 --2- 172.21.15.104:0/2517670137 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad301466c0 0x7fad30074030 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.213+0000 7fad35aec640 1 -- 172.21.15.104:0/2517670137 >> 172.21.15.104:0/2517670137 conn(0x7fad300b3c70 msgr2=0x7fad300d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.213+0000 7fad35aec640 1 -- 172.21.15.104:0/2517670137 shutdown_connections 2024-09-17T03:04:21.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.213+0000 7fad35aec640 1 -- 172.21.15.104:0/2517670137 wait complete. 2024-09-17T03:04:21.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.215+0000 7fad35aec640 1 Processor -- start 2024-09-17T03:04:21.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.215+0000 7fad35aec640 1 -- start start 2024-09-17T03:04:21.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad35aec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad300d0c70 0x7fad3015d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:21.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad35aec640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3015bfe0 0x7fad30073820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:21.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad35aec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3015c3f0 0x7fad30073d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:21.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad35aec640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fad3006ff60 con 0x7fad300d0c70 2024-09-17T03:04:21.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad35aec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fad3006fde0 con 0x7fad3015c3f0 2024-09-17T03:04:21.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad35aec640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fad300d1080 con 0x7fad3015bfe0 2024-09-17T03:04:21.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad2f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad300d0c70 0x7fad3015d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:21.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad2f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad300d0c70 0x7fad3015d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49730/0 (socket says 172.21.15.104:49730) 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.216+0000 7fad2f7fe640 1 -- 172.21.15.104:0/3205431213 learned_addr learned my addr 172.21.15.104:0/3205431213 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad27fff640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3015bfe0 0x7fad30073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2ffff640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3015c3f0 0x7fad30073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2f7fe640 1 -- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3015bfe0 msgr2=0x7fad30073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2f7fe640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3015bfe0 0x7fad30073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2f7fe640 1 -- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3015c3f0 msgr2=0x7fad30073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2f7fe640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3015c3f0 0x7fad30073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2f7fe640 1 -- 172.21.15.104:0/3205431213 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad301604d0 con 0x7fad300d0c70 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2ffff640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3015c3f0 0x7fad30073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad27fff640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3015bfe0 0x7fad30073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2f7fe640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad300d0c70 0x7fad3015d970 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fad20009950 tx=0x7fad20033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2cff9640 1 -- 172.21.15.104:0/3205431213 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20031d60 con 0x7fad300d0c70 2024-09-17T03:04:21.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2cff9640 1 -- 172.21.15.104:0/3205431213 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad20005020 con 0x7fad300d0c70 2024-09-17T03:04:21.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad2cff9640 1 -- 172.21.15.104:0/3205431213 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20005470 con 0x7fad300d0c70 2024-09-17T03:04:21.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad301607b0 con 0x7fad300d0c70 2024-09-17T03:04:21.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.217+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad30160d70 con 0x7fad300d0c70 2024-09-17T03:04:21.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.218+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad301466c0 con 0x7fad300d0c70 2024-09-17T03:04:21.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.219+0000 7fad2cff9640 1 -- 172.21.15.104:0/3205431213 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad200047a0 con 0x7fad300d0c70 2024-09-17T03:04:21.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.219+0000 7fad2cff9640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fad10078b90 0x7fad1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:21.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.219+0000 7fad2cff9640 1 -- 172.21.15.104:0/3205431213 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 4857+0+0 (secure 0 0 0) 0x7fad200bbc20 con 0x7fad300d0c70 2024-09-17T03:04:21.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.220+0000 7fad27fff640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fad10078b90 0x7fad1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:21.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.220+0000 7fad27fff640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fad10078b90 0x7fad1007b0a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fad3013ed10 tx=0x7fad18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:21.223 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.224+0000 7fad2cff9640 1 -- 172.21.15.104:0/3205431213 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad2003f030 con 0x7fad300d0c70 2024-09-17T03:04:21.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:21.404+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fad30141f20 con 0x7fad300d0c70 2024-09-17T03:04:22.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.388+0000 7fad2cff9640 1 -- 172.21.15.104:0/3205431213 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v166) ==== 138+0+0 (secure 0 0 0) 0x7fad20084440 con 0x7fad300d0c70 2024-09-17T03:04:22.388 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T03:04:22.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fad10078b90 msgr2=0x7fad1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:22.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fad10078b90 0x7fad1007b0a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fad3013ed10 tx=0x7fad18009040 comp rx=0 tx=0).stop 2024-09-17T03:04:22.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad300d0c70 msgr2=0x7fad3015d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:22.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad300d0c70 0x7fad3015d970 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fad20009950 tx=0x7fad20033ce0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 shutdown_connections 2024-09-17T03:04:22.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fad10078b90 0x7fad1007b0a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad3015c3f0 0x7fad30073d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fad3015bfe0 0x7fad30073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 --2- 172.21.15.104:0/3205431213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fad300d0c70 0x7fad3015d970 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.392+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 >> 172.21.15.104:0/3205431213 conn(0x7fad300b3c70 msgr2=0x7fad30145d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:22.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.393+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 shutdown_connections 2024-09-17T03:04:22.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.393+0000 7fad35aec640 1 -- 172.21.15.104:0/3205431213 wait complete. 2024-09-17T03:04:22.407 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:04:22.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.533+0000 7f6983733640 1 -- 172.21.15.104:0/2850454876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0d1400 msgr2=0x7f697c161560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:22.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.533+0000 7f6983733640 1 --2- 172.21.15.104:0/2850454876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0d1400 0x7f697c161560 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f696c009830 tx=0x7f696c02a5c0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.533+0000 7f6983733640 1 -- 172.21.15.104:0/2850454876 shutdown_connections 2024-09-17T03:04:22.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.533+0000 7f6983733640 1 --2- 172.21.15.104:0/2850454876 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0d1400 0x7f697c161560 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.533+0000 7f6983733640 1 -- 172.21.15.104:0/2850454876 >> 172.21.15.104:0/2850454876 conn(0x7f697c0b44a0 msgr2=0x7f697c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:22.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.533+0000 7f6983733640 1 -- 172.21.15.104:0/2850454876 shutdown_connections 2024-09-17T03:04:22.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.533+0000 7f6983733640 1 -- 172.21.15.104:0/2850454876 wait complete. 2024-09-17T03:04:22.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.535+0000 7f6983733640 1 Processor -- start 2024-09-17T03:04:22.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.535+0000 7f6983733640 1 -- start start 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6983733640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0b6920 0x7f697c0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6983733640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c0d0ff0 0x7f697c1f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6983733640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0d1400 0x7f697c1f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6983733640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f697c0b7440 con 0x7f697c0b6920 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6983733640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f697c161cb0 con 0x7f697c0d1400 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6983733640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f697c0b75c0 con 0x7f697c0d0ff0 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f69814cf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0b6920 0x7f697c0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f69814cf640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0b6920 0x7f697c0cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49750/0 (socket says 172.21.15.104:49750) 2024-09-17T03:04:22.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f69814cf640 1 -- 172.21.15.104:0/1965204419 learned_addr learned my addr 172.21.15.104:0/1965204419 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6980cce640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c0d0ff0 0x7f697c1f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6981cd0640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0d1400 0x7f697c1f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f69814cf640 1 -- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c0d0ff0 msgr2=0x7f697c1f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f69814cf640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c0d0ff0 0x7f697c1f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f69814cf640 1 -- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0d1400 msgr2=0x7f697c1f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f69814cf640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0d1400 0x7f697c1f7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f69814cf640 1 -- 172.21.15.104:0/1965204419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c0ccd90 con 0x7f697c0b6920 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6980cce640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c0d0ff0 0x7f697c1f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.536+0000 7f6981cd0640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0d1400 0x7f697c1f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.537+0000 7f69814cf640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0b6920 0x7f697c0cc850 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f697800c370 tx=0x7f697800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.537+0000 7f6971ffb640 1 -- 172.21.15.104:0/1965204419 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978017070 con 0x7f697c0b6920 2024-09-17T03:04:22.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.537+0000 7f6971ffb640 1 -- 172.21.15.104:0/1965204419 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69780053c0 con 0x7f697c0b6920 2024-09-17T03:04:22.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.537+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c15c300 con 0x7f697c0b6920 2024-09-17T03:04:22.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.537+0000 7f6971ffb640 1 -- 172.21.15.104:0/1965204419 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6978003850 con 0x7f697c0b6920 2024-09-17T03:04:22.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.537+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c14f380 con 0x7f697c0b6920 2024-09-17T03:04:22.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.538+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c0b6d30 con 0x7f697c0b6920 2024-09-17T03:04:22.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.539+0000 7f6971ffb640 1 -- 172.21.15.104:0/1965204419 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f697801a070 con 0x7f697c0b6920 2024-09-17T03:04:22.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.539+0000 7f6971ffb640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6960078b90 0x7f696007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:22.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.539+0000 7f6971ffb640 1 -- 172.21.15.104:0/1965204419 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5227+0+0 (secure 0 0 0) 0x7f6978099e20 con 0x7f697c0b6920 2024-09-17T03:04:22.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.539+0000 7f6980cce640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6960078b90 0x7f696007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:22.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.540+0000 7f6980cce640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6960078b90 0x7f696007b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f696c034000 tx=0x7f696c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:22.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.544+0000 7f6971ffb640 1 -- 172.21.15.104:0/1965204419 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f69780624d0 con 0x7f697c0b6920 2024-09-17T03:04:22.719 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:22.719+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f697c0d0920 con 0x7f697c0b6920 2024-09-17T03:04:23.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.390+0000 7f6971ffb640 1 -- 172.21.15.104:0/1965204419 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v167) ==== 170+0+0 (secure 0 0 0) 0x7f6978061dd0 con 0x7f697c0b6920 2024-09-17T03:04:23.390 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T03:04:23.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6960078b90 msgr2=0x7f696007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:23.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6960078b90 0x7f696007b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f696c034000 tx=0x7f696c004730 comp rx=0 tx=0).stop 2024-09-17T03:04:23.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0b6920 msgr2=0x7f697c0cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:23.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0b6920 0x7f697c0cc850 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f697800c370 tx=0x7f697800c830 comp rx=0 tx=0).stop 2024-09-17T03:04:23.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 shutdown_connections 2024-09-17T03:04:23.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6960078b90 0x7f696007b0a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:23.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f697c0d1400 0x7f697c1f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:23.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f697c0d0ff0 0x7f697c1f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:23.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 --2- 172.21.15.104:0/1965204419 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f697c0b6920 0x7f697c0cc850 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:23.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.393+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 >> 172.21.15.104:0/1965204419 conn(0x7f697c0b44a0 msgr2=0x7f697c0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:23.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.394+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 shutdown_connections 2024-09-17T03:04:23.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.394+0000 7f6983733640 1 -- 172.21.15.104:0/1965204419 wait complete. 2024-09-17T03:04:23.417 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:04:23.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.532+0000 7f9d0df20640 1 -- 172.21.15.104:0/479021130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 msgr2=0x7f9d0815bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:23.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.532+0000 7f9d0df20640 1 --2- 172.21.15.104:0/479021130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 0x7f9d0815bc00 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8005fd0 tx=0x7f9cf802a540 comp rx=0 tx=0).stop 2024-09-17T03:04:23.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.532+0000 7f9d0df20640 1 -- 172.21.15.104:0/479021130 shutdown_connections 2024-09-17T03:04:23.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.532+0000 7f9d0df20640 1 --2- 172.21.15.104:0/479021130 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d08072f90 0x7f9d080ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:23.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.532+0000 7f9d0df20640 1 --2- 172.21.15.104:0/479021130 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 0x7f9d0815bc00 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:23.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.532+0000 7f9d0df20640 1 -- 172.21.15.104:0/479021130 >> 172.21.15.104:0/479021130 conn(0x7f9d080b2450 msgr2=0x7f9d080b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:23.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.532+0000 7f9d0df20640 1 -- 172.21.15.104:0/479021130 shutdown_connections 2024-09-17T03:04:23.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.532+0000 7f9d0df20640 1 -- 172.21.15.104:0/479021130 wait complete. 2024-09-17T03:04:23.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.534+0000 7f9d0df20640 1 Processor -- start 2024-09-17T03:04:23.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.534+0000 7f9d0df20640 1 -- start start 2024-09-17T03:04:23.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d0df20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d08072470 0x7f9d0815df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:23.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d0df20640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d08072f90 0x7f9d08151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:23.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d0df20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 0x7f9d080ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:23.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d0df20640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9d080ceb90 con 0x7f9d0815b7f0 2024-09-17T03:04:23.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d0df20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d080cea10 con 0x7f9d08072470 2024-09-17T03:04:23.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d0df20640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9d080ced10 con 0x7f9d08072f90 2024-09-17T03:04:23.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 0x7f9d080ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:23.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 0x7f9d080ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49760/0 (socket says 172.21.15.104:49760) 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 -- 172.21.15.104:0/3636558239 learned_addr learned my addr 172.21.15.104:0/3636558239 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d06ffd640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d08072f90 0x7f9d08151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d077fe640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d08072470 0x7f9d0815df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 -- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d08072f90 msgr2=0x7f9d08151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d08072f90 0x7f9d08151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 -- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d08072470 msgr2=0x7f9d0815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d08072470 0x7f9d0815df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 -- 172.21.15.104:0/3636558239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d081f5b70 con 0x7f9d0815b7f0 2024-09-17T03:04:23.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d077fe640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d08072470 0x7f9d0815df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:23.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9d07fff640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 0x7f9d080ae8b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e960 tx=0x7f9d0000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:23.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9ceffff640 1 -- 172.21.15.104:0/3636558239 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00004d20 con 0x7f9d0815b7f0 2024-09-17T03:04:23.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9ceffff640 1 -- 172.21.15.104:0/3636558239 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d0000cb20 con 0x7f9d0815b7f0 2024-09-17T03:04:23.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.536+0000 7f9ceffff640 1 -- 172.21.15.104:0/3636558239 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00005020 con 0x7f9d0815b7f0 2024-09-17T03:04:23.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.537+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d080b0fe0 con 0x7f9d0815b7f0 2024-09-17T03:04:23.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.537+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d081f6110 con 0x7f9d0815b7f0 2024-09-17T03:04:23.539 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.537+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0815e6b0 con 0x7f9d0815b7f0 2024-09-17T03:04:23.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.538+0000 7f9ceffff640 1 -- 172.21.15.104:0/3636558239 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d000051c0 con 0x7f9d0815b7f0 2024-09-17T03:04:23.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.539+0000 7f9ceffff640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cf4078b90 0x7f9cf407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:23.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.539+0000 7f9ceffff640 1 -- 172.21.15.104:0/3636558239 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5609+0+0 (secure 0 0 0) 0x7f9d0009b610 con 0x7f9d0815b7f0 2024-09-17T03:04:23.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.539+0000 7f9d077fe640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cf4078b90 0x7f9cf407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:23.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.540+0000 7f9d077fe640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cf4078b90 0x7f9cf407b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8033000 tx=0x7f9cf8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:23.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.544+0000 7f9ceffff640 1 -- 172.21.15.104:0/3636558239 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9d00016030 con 0x7f9d0815b7f0 2024-09-17T03:04:23.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:23.751+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9d0814ff30 con 0x7f9d0815b7f0 2024-09-17T03:04:24.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.421+0000 7f9ceffff640 1 -- 172.21.15.104:0/3636558239 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v67) ==== 174+0+0 (secure 0 0 0) 0x7f9d00063b40 con 0x7f9d0815b7f0 2024-09-17T03:04:24.421 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 20 and data pool 21 2024-09-17T03:04:24.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.426+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cf4078b90 msgr2=0x7f9cf407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.426+0000 7f9d0df20640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cf4078b90 0x7f9cf407b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8033000 tx=0x7f9cf8004730 comp rx=0 tx=0).stop 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.426+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 msgr2=0x7f9d080ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.426+0000 7f9d0df20640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 0x7f9d080ae8b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e960 tx=0x7f9d0000ee20 comp rx=0 tx=0).stop 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.426+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 shutdown_connections 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.427+0000 7f9d0df20640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cf4078b90 0x7f9cf407b0a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.427+0000 7f9d0df20640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9d0815b7f0 0x7f9d080ae8b0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.427+0000 7f9d0df20640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d08072f90 0x7f9d08151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.427+0000 7f9d0df20640 1 --2- 172.21.15.104:0/3636558239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d08072470 0x7f9d0815df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.427+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 >> 172.21.15.104:0/3636558239 conn(0x7f9d080b2450 msgr2=0x7f9d0815eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.427+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 shutdown_connections 2024-09-17T03:04:24.427 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.427+0000 7f9d0df20640 1 -- 172.21.15.104:0/3636558239 wait complete. 2024-09-17T03:04:24.442 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:04:24.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.556+0000 7f03c5e30640 1 -- 172.21.15.104:0/3514346588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 msgr2=0x7f03a8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.556+0000 7f03c5e30640 1 --2- 172.21.15.104:0/3514346588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 0x7f03a8004c10 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f03b4009b50 tx=0x7f03a8005830 comp rx=0 tx=0).stop 2024-09-17T03:04:24.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.557+0000 7f03c5e30640 1 -- 172.21.15.104:0/3514346588 shutdown_connections 2024-09-17T03:04:24.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.557+0000 7f03c5e30640 1 --2- 172.21.15.104:0/3514346588 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 0x7f03a8004c10 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.557+0000 7f03c5e30640 1 -- 172.21.15.104:0/3514346588 >> 172.21.15.104:0/3514346588 conn(0x7f03c00d28a0 msgr2=0x7f03c00d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:24.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.557+0000 7f03c5e30640 1 -- 172.21.15.104:0/3514346588 shutdown_connections 2024-09-17T03:04:24.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.557+0000 7f03c5e30640 1 -- 172.21.15.104:0/3514346588 wait complete. 2024-09-17T03:04:24.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.558+0000 7f03c5e30640 1 Processor -- start 2024-09-17T03:04:24.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.559+0000 7f03c5e30640 1 -- start start 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03c5e30640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 0x7f03c01deb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03c5e30640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03c00cc000 0x7f03c00b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03c5e30640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03c00b1d20 0x7f03c01f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03c5e30640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f03c00ce220 con 0x7f03a8004800 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03c5e30640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f03c00ce0a0 con 0x7f03c00cc000 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03c5e30640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f03c00ce3a0 con 0x7f03c00b1d20 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 0x7f03c01deb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 0x7f03c01deb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51460/0 (socket says 172.21.15.104:51460) 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 -- 172.21.15.104:0/2723593798 learned_addr learned my addr 172.21.15.104:0/2723593798 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:24.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bffff640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03c00b1d20 0x7f03c01f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03beffd640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03c00cc000 0x7f03c00b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 -- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03c00b1d20 msgr2=0x7f03c01f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03c00b1d20 0x7f03c01f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 -- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03c00cc000 msgr2=0x7f03c00b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03c00cc000 0x7f03c00b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 -- 172.21.15.104:0/2723593798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c00b2130 con 0x7f03a8004800 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03beffd640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03c00cc000 0x7f03c00b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.560+0000 7f03bf7fe640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 0x7f03c01deb10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f03b0006110 tx=0x7f03b00065d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.561+0000 7f03a7fff640 1 -- 172.21.15.104:0/2723593798 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0015070 con 0x7f03a8004800 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.561+0000 7f03a7fff640 1 -- 172.21.15.104:0/2723593798 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03b000fb30 con 0x7f03a8004800 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.561+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c006ed80 con 0x7f03a8004800 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.561+0000 7f03a7fff640 1 -- 172.21.15.104:0/2723593798 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011430 con 0x7f03a8004800 2024-09-17T03:04:24.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.561+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c00cca40 con 0x7f03a8004800 2024-09-17T03:04:24.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.562+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c00ccc80 con 0x7f03a8004800 2024-09-17T03:04:24.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.562+0000 7f03a7fff640 1 -- 172.21.15.104:0/2723593798 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03b00115d0 con 0x7f03a8004800 2024-09-17T03:04:24.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.563+0000 7f03a7fff640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f03ac078bc0 0x7f03ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:24.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.563+0000 7f03a7fff640 1 -- 172.21.15.104:0/2723593798 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f03b009bca0 con 0x7f03a8004800 2024-09-17T03:04:24.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.563+0000 7f03beffd640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f03ac078bc0 0x7f03ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:24.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.564+0000 7f03beffd640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f03ac078bc0 0x7f03ac07b0d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f03b4035000 tx=0x7f03b40046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:24.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.567+0000 7f03a7fff640 1 -- 172.21.15.104:0/2723593798 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f03c00ccc80 con 0x7f03a8004800 2024-09-17T03:04:24.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.743+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03c00d0a90 con 0x7f03a8004800 2024-09-17T03:04:24.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.744+0000 7f03a7fff640 1 -- 172.21.15.104:0/2723593798 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) ==== 74+0+16801 (secure 0 0 0) 0x7f03c00b2130 con 0x7f03a8004800 2024-09-17T03:04:24.744 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:24.744 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":168,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:04:23.753566+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:04:21.409569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:04:22.724801+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:04:24.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f03ac078bc0 msgr2=0x7f03ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f03ac078bc0 0x7f03ac07b0d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f03b4035000 tx=0x7f03b40046c0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 msgr2=0x7f03c01deb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 0x7f03c01deb10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f03b0006110 tx=0x7f03b00065d0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 shutdown_connections 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f03ac078bc0 0x7f03ac07b0d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03c00cc000 0x7f03c00b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03c00b1d20 0x7f03c01f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 --2- 172.21.15.104:0/2723593798 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f03a8004800 0x7f03c01deb10 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 >> 172.21.15.104:0/2723593798 conn(0x7f03c00d28a0 msgr2=0x7f03c00b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 shutdown_connections 2024-09-17T03:04:24.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.747+0000 7f03c5e30640 1 -- 172.21.15.104:0/2723593798 wait complete. 2024-09-17T03:04:24.758 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:04:24.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.870+0000 7f61ee825640 1 -- 172.21.15.104:0/2404199144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e80b5cf0 msgr2=0x7f61e8166810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.870+0000 7f61ee825640 1 --2- 172.21.15.104:0/2404199144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e80b5cf0 0x7f61e8166810 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f61e0005fd0 tx=0x7f61e002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.870+0000 7f61ee825640 1 -- 172.21.15.104:0/2404199144 shutdown_connections 2024-09-17T03:04:24.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.870+0000 7f61ee825640 1 --2- 172.21.15.104:0/2404199144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e80b5cf0 0x7f61e8166810 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.870+0000 7f61ee825640 1 -- 172.21.15.104:0/2404199144 >> 172.21.15.104:0/2404199144 conn(0x7f61e80b3640 msgr2=0x7f61e80b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.870+0000 7f61ee825640 1 -- 172.21.15.104:0/2404199144 shutdown_connections 2024-09-17T03:04:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.870+0000 7f61ee825640 1 -- 172.21.15.104:0/2404199144 wait complete. 2024-09-17T03:04:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.872+0000 7f61ee825640 1 Processor -- start 2024-09-17T03:04:24.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.872+0000 7f61ee825640 1 -- start start 2024-09-17T03:04:24.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.873+0000 7f61ee825640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61e8073580 0x7f61e8144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.873+0000 7f61ee825640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61e80b5cf0 0x7f61e81403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.873+0000 7f61ee825640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e8152ce0 0x7f61e8145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.873+0000 7f61ee825640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81670e0 con 0x7f61e8152ce0 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.873+0000 7f61ee825640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8166f60 con 0x7f61e80b5cf0 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.873+0000 7f61ee825640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61e8167260 con 0x7f61e8073580 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e8152ce0 0x7f61e8145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e8152ce0 0x7f61e8145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51484/0 (socket says 172.21.15.104:51484) 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 -- 172.21.15.104:0/1146554053 learned_addr learned my addr 172.21.15.104:0/1146554053 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61e77fe640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61e80b5cf0 0x7f61e81403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61e7fff640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61e8073580 0x7f61e8144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 -- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61e8073580 msgr2=0x7f61e8144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61e8073580 0x7f61e8144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 -- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61e80b5cf0 msgr2=0x7f61e81403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:24.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61e80b5cf0 0x7f61e81403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:24.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 -- 172.21.15.104:0/1146554053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e8143970 con 0x7f61e8152ce0 2024-09-17T03:04:24.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ecdc2640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e8152ce0 0x7f61e8145020 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f61e0006010 tx=0x7f61e0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:24.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61e4ff9640 1 -- 172.21.15.104:0/1146554053 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0031b90 con 0x7f61e8152ce0 2024-09-17T03:04:24.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61e4ff9640 1 -- 172.21.15.104:0/1146554053 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61e0031e20 con 0x7f61e8152ce0 2024-09-17T03:04:24.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e8143c50 con 0x7f61e8152ce0 2024-09-17T03:04:24.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61e4ff9640 1 -- 172.21.15.104:0/1146554053 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e00332f0 con 0x7f61e8152ce0 2024-09-17T03:04:24.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.874+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e8145a80 con 0x7f61e8152ce0 2024-09-17T03:04:24.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.875+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e8148220 con 0x7f61e8152ce0 2024-09-17T03:04:24.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.876+0000 7f61e4ff9640 1 -- 172.21.15.104:0/1146554053 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61e0031660 con 0x7f61e8152ce0 2024-09-17T03:04:24.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.877+0000 7f61e4ff9640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078bc0 0x7f61d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.877+0000 7f61e4ff9640 1 -- 172.21.15.104:0/1146554053 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f61e00bc1e0 con 0x7f61e8152ce0 2024-09-17T03:04:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.877+0000 7f61e7fff640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078bc0 0x7f61d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:24.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.877+0000 7f61e7fff640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078bc0 0x7f61d407b0d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f61d8000f60 tx=0x7f61d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:24.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:24.881+0000 7f61e4ff9640 1 -- 172.21.15.104:0/1146554053 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61e003f030 con 0x7f61e8152ce0 2024-09-17T03:04:25.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.052+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61e80764d0 con 0x7f61e8152ce0 2024-09-17T03:04:25.052 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.053+0000 7f61e4ff9640 1 -- 172.21.15.104:0/1146554053 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) ==== 74+0+16801 (secure 0 0 0) 0x7f61e80764d0 con 0x7f61e8152ce0 2024-09-17T03:04:25.053 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:25.053 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":168,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:04:23.753566+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:04:21.409569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:04:22.724801+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:04:25.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078bc0 msgr2=0x7f61d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078bc0 0x7f61d407b0d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f61d8000f60 tx=0x7f61d8009040 comp rx=0 tx=0).stop 2024-09-17T03:04:25.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e8152ce0 msgr2=0x7f61e8145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e8152ce0 0x7f61e8145020 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f61e0006010 tx=0x7f61e0003ba0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 shutdown_connections 2024-09-17T03:04:25.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61d4078bc0 0x7f61d407b0d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61e80b5cf0 0x7f61e81403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61e8152ce0 0x7f61e8145020 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 --2- 172.21.15.104:0/1146554053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61e8073580 0x7f61e8144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 >> 172.21.15.104:0/1146554053 conn(0x7f61e80b3640 msgr2=0x7f61e815de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:25.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.055+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 shutdown_connections 2024-09-17T03:04:25.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.056+0000 7f61ee825640 1 -- 172.21.15.104:0/1146554053 wait complete. 2024-09-17T03:04:25.067 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:04:25.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.183+0000 7f95547c3640 1 -- 172.21.15.104:0/1640483367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 msgr2=0x7f9534003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.183+0000 7f95547c3640 1 --2- 172.21.15.104:0/1640483367 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 0x7f9534003ea0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f953c00c750 tx=0x7f9534005830 comp rx=0 tx=0).stop 2024-09-17T03:04:25.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.183+0000 7f9552d60640 1 -- 172.21.15.104:0/1640483367 reap_dead start 2024-09-17T03:04:25.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.183+0000 7f95547c3640 1 -- 172.21.15.104:0/1640483367 shutdown_connections 2024-09-17T03:04:25.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.183+0000 7f95547c3640 1 -- 172.21.15.104:0/1640483367 >> 172.21.15.104:0/1640483367 conn(0x7f954c0b3640 msgr2=0x7f954c0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:25.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.183+0000 7f95547c3640 1 -- 172.21.15.104:0/1640483367 shutdown_connections 2024-09-17T03:04:25.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.183+0000 7f95547c3640 1 -- 172.21.15.104:0/1640483367 wait complete. 2024-09-17T03:04:25.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.185+0000 7f95547c3640 1 Processor -- start 2024-09-17T03:04:25.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.185+0000 7f95547c3640 1 -- start start 2024-09-17T03:04:25.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f95547c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 0x7f954c1f9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:25.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f95547c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f954c15ad70 0x7f954c1e8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:25.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f95547c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f954c1e8c80 0x7f954c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:25.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f95547c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f954c073d20 con 0x7f9534003a30 2024-09-17T03:04:25.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f95547c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f954c073ba0 con 0x7f954c15ad70 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f95547c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f954c0b5800 con 0x7f954c1e8c80 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f955255f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 0x7f954c1f9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f955255f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 0x7f954c1f9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51494/0 (socket says 172.21.15.104:51494) 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f955255f640 1 -- 172.21.15.104:0/3991961687 learned_addr learned my addr 172.21.15.104:0/3991961687 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f9551d5e640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f954c15ad70 0x7f954c1e8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f9552d60640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f954c1e8c80 0x7f954c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f955255f640 1 -- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f954c1e8c80 msgr2=0x7f954c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f955255f640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f954c1e8c80 0x7f954c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f955255f640 1 -- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f954c15ad70 msgr2=0x7f954c1e8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f955255f640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f954c15ad70 0x7f954c1e8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f955255f640 1 -- 172.21.15.104:0/3991961687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c1e9090 con 0x7f9534003a30 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.186+0000 7f9552d60640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f954c1e8c80 0x7f954c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.187+0000 7f955255f640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 0x7f954c1f9f80 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f953c02b600 tx=0x7f953c001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.187+0000 7f954affd640 1 -- 172.21.15.104:0/3991961687 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c004d50 con 0x7f9534003a30 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.187+0000 7f954affd640 1 -- 172.21.15.104:0/3991961687 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f953c02b950 con 0x7f9534003a30 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.187+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c0c7580 con 0x7f9534003a30 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.187+0000 7f954affd640 1 -- 172.21.15.104:0/3991961687 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c02bda0 con 0x7f9534003a30 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.187+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c1f65b0 con 0x7f9534003a30 2024-09-17T03:04:25.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.188+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c0b5d60 con 0x7f9534003a30 2024-09-17T03:04:25.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.189+0000 7f954affd640 1 -- 172.21.15.104:0/3991961687 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f953c006030 con 0x7f9534003a30 2024-09-17T03:04:25.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.189+0000 7f954affd640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9538078b90 0x7f953807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:25.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.190+0000 7f954affd640 1 -- 172.21.15.104:0/3991961687 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f953c0bae40 con 0x7f9534003a30 2024-09-17T03:04:25.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.190+0000 7f9551d5e640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9538078b90 0x7f953807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:25.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.190+0000 7f9551d5e640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9538078b90 0x7f953807b0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f954c1f3ae0 tx=0x7f9540005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:25.193 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.194+0000 7f954affd640 1 -- 172.21.15.104:0/3991961687 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f954c1e9090 con 0x7f9534003a30 2024-09-17T03:04:25.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.406+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f954c15cec0 con 0x7f9534003a30 2024-09-17T03:04:25.433 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.434+0000 7f954affd640 1 -- 172.21.15.104:0/3991961687 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) ==== 118+0+0 (secure 0 0 0) 0x7f954c073ed0 con 0x7f9534003a30 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9538078b90 msgr2=0x7f953807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9538078b90 0x7f953807b0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f954c1f3ae0 tx=0x7f9540005f90 comp rx=0 tx=0).stop 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 msgr2=0x7f954c1f9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 0x7f954c1f9f80 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f953c02b600 tx=0x7f953c001490 comp rx=0 tx=0).stop 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 shutdown_connections 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9538078b90 0x7f953807b0a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f954c15ad70 0x7f954c1e8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f954c1e8c80 0x7f954c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 --2- 172.21.15.104:0/3991961687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9534003a30 0x7f954c1f9f80 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 >> 172.21.15.104:0/3991961687 conn(0x7f954c0b3640 msgr2=0x7f954c0b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 shutdown_connections 2024-09-17T03:04:25.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.436+0000 7f95547c3640 1 -- 172.21.15.104:0/3991961687 wait complete. 2024-09-17T03:04:25.447 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:04:25.447 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:04:25.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.562+0000 7febd1025640 1 -- 172.21.15.104:0/312678172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc0b6b20 msgr2=0x7febcc0d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.562+0000 7febd1025640 1 --2- 172.21.15.104:0/312678172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc0b6b20 0x7febcc0d2fd0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7febcc0cf2b0 tx=0x7febc402a820 comp rx=0 tx=0).stop 2024-09-17T03:04:25.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.562+0000 7febd1025640 1 -- 172.21.15.104:0/312678172 shutdown_connections 2024-09-17T03:04:25.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.562+0000 7febd1025640 1 --2- 172.21.15.104:0/312678172 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc0b6b20 0x7febcc0d2fd0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.562+0000 7febd1025640 1 --2- 172.21.15.104:0/312678172 >> v2:172.21.15.192:3300/0 conn(0x7febcc15faf0 0x7febcc0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.562+0000 7febd1025640 1 -- 172.21.15.104:0/312678172 >> 172.21.15.104:0/312678172 conn(0x7febcc069120 msgr2=0x7febcc069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:25.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.562+0000 7febd1025640 1 -- 172.21.15.104:0/312678172 shutdown_connections 2024-09-17T03:04:25.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.562+0000 7febd1025640 1 -- 172.21.15.104:0/312678172 wait complete. 2024-09-17T03:04:25.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.564+0000 7febd1025640 1 Processor -- start 2024-09-17T03:04:25.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.564+0000 7febd1025640 1 -- start start 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febd1025640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febcc0b6b20 0x7febcc15e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febd1025640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc15f6e0 0x7febcc1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febd1025640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febcc15faf0 0x7febcc15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febd1025640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0d3a10 con 0x7febcc15f6e0 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febd1025640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0d3890 con 0x7febcc15faf0 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febd1025640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7febcc0d3b90 con 0x7febcc0b6b20 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc15f6e0 0x7febcc1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc15f6e0 0x7febcc1583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51510/0 (socket says 172.21.15.104:51510) 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 -- 172.21.15.104:0/829365441 learned_addr learned my addr 172.21.15.104:0/829365441 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febcad9d640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febcc0b6b20 0x7febcc15e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:25.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febcb59e640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febcc15faf0 0x7febcc15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 -- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febcc0b6b20 msgr2=0x7febcc15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febcc0b6b20 0x7febcc15e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 -- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febcc15faf0 msgr2=0x7febcc15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febcc15faf0 0x7febcc15ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 -- 172.21.15.104:0/829365441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febcc15df50 con 0x7febcc15f6e0 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc259c640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc15f6e0 0x7febcc1583c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7febb400b410 tx=0x7febb400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc3fff640 1 -- 172.21.15.104:0/829365441 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4015020 con 0x7febcc15f6e0 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc3fff640 1 -- 172.21.15.104:0/829365441 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febb4011940 con 0x7febcc15f6e0 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febcc0abf50 con 0x7febcc15f6e0 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.566+0000 7febc3fff640 1 -- 172.21.15.104:0/829365441 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4011d90 con 0x7febcc15f6e0 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.567+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febcc15b7c0 con 0x7febcc15f6e0 2024-09-17T03:04:25.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.567+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febcc0abcb0 con 0x7febcc15f6e0 2024-09-17T03:04:25.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.568+0000 7febc3fff640 1 -- 172.21.15.104:0/829365441 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febb4018020 con 0x7febcc15f6e0 2024-09-17T03:04:25.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.569+0000 7febc3fff640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7febac078bc0 0x7febac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:25.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.569+0000 7febc3fff640 1 -- 172.21.15.104:0/829365441 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5709+0+0 (secure 0 0 0) 0x7febb409aa70 con 0x7febcc15f6e0 2024-09-17T03:04:25.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.569+0000 7febcad9d640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7febac078bc0 0x7febac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:25.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.570+0000 7febcad9d640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7febac078bc0 0x7febac07b0d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7febbc000f60 tx=0x7febbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:25.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.574+0000 7febc3fff640 1 -- 172.21.15.104:0/829365441 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7febcc0abcb0 con 0x7febcc15f6e0 2024-09-17T03:04:25.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:25.783+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7febcc0d4180 con 0x7febcc15f6e0 2024-09-17T03:04:26.384 INFO:tasks.ceph.mds.a.smithi104.stderr:2024-09-17T03:04:26.386+0000 7f969afd2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:04:26.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.436+0000 7febc3fff640 1 -- 172.21.15.104:0/829365441 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) ==== 122+0+0 (secure 0 0 0) 0x7febb401f020 con 0x7febcc15f6e0 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7febac078bc0 msgr2=0x7febac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7febac078bc0 0x7febac07b0d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7febbc000f60 tx=0x7febbc009040 comp rx=0 tx=0).stop 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc15f6e0 msgr2=0x7febcc1583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc15f6e0 0x7febcc1583c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7febb400b410 tx=0x7febb400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 shutdown_connections 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7febac078bc0 0x7febac07b0d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febcc15faf0 0x7febcc15ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febcc15f6e0 0x7febcc1583c0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.439 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 --2- 172.21.15.104:0/829365441 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7febcc0b6b20 0x7febcc15e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 >> 172.21.15.104:0/829365441 conn(0x7febcc069120 msgr2=0x7febcc0b9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.439+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 shutdown_connections 2024-09-17T03:04:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.440+0000 7febd1025640 1 -- 172.21.15.104:0/829365441 wait complete. 2024-09-17T03:04:26.453 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:04:26.454 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:04:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.571+0000 7fedb4a0a640 1 -- 172.21.15.104:0/3946985011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 msgr2=0x7fed98004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.571+0000 7fedb4a0a640 1 --2- 172.21.15.104:0/3946985011 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 0x7fed98004800 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7feda400c710 tx=0x7fed98005830 comp rx=0 tx=0).stop 2024-09-17T03:04:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.571+0000 7fedaed9d640 1 -- 172.21.15.104:0/3946985011 reap_dead start 2024-09-17T03:04:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.571+0000 7fedb4a0a640 1 -- 172.21.15.104:0/3946985011 shutdown_connections 2024-09-17T03:04:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.571+0000 7fedb4a0a640 1 -- 172.21.15.104:0/3946985011 >> 172.21.15.104:0/3946985011 conn(0x7fedb0073df0 msgr2=0x7fedb0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.571+0000 7fedb4a0a640 1 -- 172.21.15.104:0/3946985011 shutdown_connections 2024-09-17T03:04:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.571+0000 7fedb4a0a640 1 -- 172.21.15.104:0/3946985011 wait complete. 2024-09-17T03:04:26.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.573+0000 7fedb4a0a640 1 Processor -- start 2024-09-17T03:04:26.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.573+0000 7fedb4a0a640 1 -- start start 2024-09-17T03:04:26.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedb4a0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 0x7fedb0151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedb4a0a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb015b080 0x7fedb00b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedb4a0a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedb00b9820 0x7fedb00cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedb4a0a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fedb015f510 con 0x7fed98004040 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedb4a0a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fedb015f390 con 0x7fedb00b9820 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedb4a0a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fedb00d3c00 con 0x7fedb015b080 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 0x7fedb0151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 0x7fedb0151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51530/0 (socket says 172.21.15.104:51530) 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 -- 172.21.15.104:0/4108566746 learned_addr learned my addr 172.21.15.104:0/4108566746 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedaed9d640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedb00b9820 0x7fedb00cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedadd9b640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb015b080 0x7fedb00b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 -- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb015b080 msgr2=0x7fedb00b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb015b080 0x7fedb00b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 -- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedb00b9820 msgr2=0x7fedb00cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedb00b9820 0x7fedb00cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 -- 172.21.15.104:0/4108566746 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb00b9c30 con 0x7fed98004040 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.574+0000 7fedae59c640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 0x7fedb0151fa0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7feda0006630 tx=0x7feda00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.575+0000 7fed9effd640 1 -- 172.21.15.104:0/4108566746 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0015070 con 0x7fed98004040 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.575+0000 7fed9effd640 1 -- 172.21.15.104:0/4108566746 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feda0011920 con 0x7fed98004040 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.575+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb00c9550 con 0x7fed98004040 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.575+0000 7fed9effd640 1 -- 172.21.15.104:0/4108566746 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0011d70 con 0x7fed98004040 2024-09-17T03:04:26.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.575+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb00c9830 con 0x7fed98004040 2024-09-17T03:04:26.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.576+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb00d4160 con 0x7fed98004040 2024-09-17T03:04:26.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.577+0000 7fed9effd640 1 -- 172.21.15.104:0/4108566746 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feda0018070 con 0x7fed98004040 2024-09-17T03:04:26.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.577+0000 7fed9effd640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078b90 0x7fed9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:26.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.577+0000 7fed9effd640 1 -- 172.21.15.104:0/4108566746 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5709+0+0 (secure 0 0 0) 0x7feda009bb50 con 0x7fed98004040 2024-09-17T03:04:26.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.577+0000 7fedadd9b640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078b90 0x7fed9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:26.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.578+0000 7fedadd9b640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078b90 0x7fed9007b0a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feda4032000 tx=0x7feda4003760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:26.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.583+0000 7fed9effd640 1 -- 172.21.15.104:0/4108566746 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fedb00b9c30 con 0x7fed98004040 2024-09-17T03:04:26.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.790+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedb00cf420 con 0x7fed98004040 2024-09-17T03:04:26.790 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.791+0000 7fed9effd640 1 -- 172.21.15.104:0/4108566746 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7feda00640f0 con 0x7fed98004040 2024-09-17T03:04:26.791 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:26.791 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":69,"btime":"2024-09-17T03:04:26:435587+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1948243703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1948243703},{"type":"v1","addr":"172.21.15.192:6836","nonce":1948243703}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3037806992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3037806992},{"type":"v1","addr":"172.21.15.192:6837","nonce":3037806992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2087460219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2087460219},{"type":"v1","addr":"172.21.15.104:6833","nonce":2087460219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:04:23.753525+0000","modified":"2024-09-17T03:04:25.785201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/2260610756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2260610756},{"type":"v1","addr":"172.21.15.104:6835","nonce":2260610756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7791,"qdb_cluster":[7791]},"id":10}]} 2024-09-17T03:04:26.791 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 69 2024-09-17T03:04:26.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078b90 msgr2=0x7fed9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078b90 0x7fed9007b0a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feda4032000 tx=0x7feda4003760 comp rx=0 tx=0).stop 2024-09-17T03:04:26.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 msgr2=0x7fedb0151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 0x7fedb0151fa0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7feda0006630 tx=0x7feda00039c0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 shutdown_connections 2024-09-17T03:04:26.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078b90 0x7fed9007b0a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedb00b9820 0x7fedb00cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.793 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedb015b080 0x7fedb00b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 --2- 172.21.15.104:0/4108566746 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fed98004040 0x7fedb0151fa0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 >> 172.21.15.104:0/4108566746 conn(0x7fedb0073df0 msgr2=0x7fedb00d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:26.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 shutdown_connections 2024-09-17T03:04:26.794 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.793+0000 7fedb4a0a640 1 -- 172.21.15.104:0/4108566746 wait complete. 2024-09-17T03:04:26.804 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:04:26.916 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.917+0000 7fd632919640 1 -- 172.21.15.104:0/2334183022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b5d20 msgr2=0x7fd62c0cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.917+0000 7fd632919640 1 --2- 172.21.15.104:0/2334183022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b5d20 0x7fd62c0cfa80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fd62c074630 tx=0x7fd62402a9e0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.917+0000 7fd632919640 1 -- 172.21.15.104:0/2334183022 shutdown_connections 2024-09-17T03:04:26.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.917+0000 7fd632919640 1 --2- 172.21.15.104:0/2334183022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b5d20 0x7fd62c0cfa80 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.917+0000 7fd632919640 1 --2- 172.21.15.104:0/2334183022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd62c0cdf10 0x7fd62c0b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.917+0000 7fd632919640 1 -- 172.21.15.104:0/2334183022 >> 172.21.15.104:0/2334183022 conn(0x7fd62c0b44a0 msgr2=0x7fd62c0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:26.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.917+0000 7fd632919640 1 -- 172.21.15.104:0/2334183022 shutdown_connections 2024-09-17T03:04:26.917 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.917+0000 7fd632919640 1 -- 172.21.15.104:0/2334183022 wait complete. 2024-09-17T03:04:26.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.918+0000 7fd632919640 1 Processor -- start 2024-09-17T03:04:26.918 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.919+0000 7fd632919640 1 -- start start 2024-09-17T03:04:26.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd632919640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b4fc0 0x7fd62c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:26.920 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd632919640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd62c0b5d20 0x7fd62c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd632919640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd62c0cdf10 0x7fd62c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd632919640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c160f50 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd632919640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0d0210 con 0x7fd62c0b5d20 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd632919640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c1610d0 con 0x7fd62c0cdf10 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b4fc0 0x7fd62c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b4fc0 0x7fd62c0c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51558/0 (socket says 172.21.15.104:51558) 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 -- 172.21.15.104:0/3836666987 learned_addr learned my addr 172.21.15.104:0/3836666987 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd630eb6640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd62c0cdf10 0x7fd62c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62b7fe640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd62c0b5d20 0x7fd62c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 -- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd62c0cdf10 msgr2=0x7fd62c15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd62c0cdf10 0x7fd62c15ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 -- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd62c0b5d20 msgr2=0x7fd62c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:26.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd62c0b5d20 0x7fd62c06e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:26.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 -- 172.21.15.104:0/3836666987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c15d380 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.920+0000 7fd62bfff640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b4fc0 0x7fd62c0c5b50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00b3f0 tx=0x7fd61c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:26.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.921+0000 7fd628ff9640 1 -- 172.21.15.104:0/3836666987 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c015020 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.921+0000 7fd628ff9640 1 -- 172.21.15.104:0/3836666987 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd61c011920 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.921+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c06d1c0 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.921+0000 7fd628ff9640 1 -- 172.21.15.104:0/3836666987 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c011d70 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.921+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c06d780 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.922+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c0cfa80 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.922+0000 7fd628ff9640 1 -- 172.21.15.104:0/3836666987 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd61c018020 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.923+0000 7fd628ff9640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd618078b90 0x7fd61807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:26.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.923+0000 7fd628ff9640 1 -- 172.21.15.104:0/3836666987 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5709+0+0 (secure 0 0 0) 0x7fd61c09ac40 con 0x7fd62c0b4fc0 2024-09-17T03:04:26.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.923+0000 7fd62b7fe640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd618078b90 0x7fd61807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:26.924 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.924+0000 7fd62b7fe640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd618078b90 0x7fd61807b0a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd620005fd0 tx=0x7fd620005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:26.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:26.927+0000 7fd628ff9640 1 -- 172.21.15.104:0/3836666987 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd61c01f020 con 0x7fd62c0b4fc0 2024-09-17T03:04:27.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.102+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd62c0cead0 con 0x7fd62c0b4fc0 2024-09-17T03:04:27.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.103+0000 7fd628ff9640 1 -- 172.21.15.104:0/3836666987 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) ==== 74+0+16788 (secure 0 0 0) 0x7fd61c063110 con 0x7fd62c0b4fc0 2024-09-17T03:04:27.102 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:27.103 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":169,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:04:25.406188+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:04:21.409569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:04:22.724801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd618078b90 msgr2=0x7fd61807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd618078b90 0x7fd61807b0a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd620005fd0 tx=0x7fd620005850 comp rx=0 tx=0).stop 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b4fc0 msgr2=0x7fd62c0c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b4fc0 0x7fd62c0c5b50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00b3f0 tx=0x7fd61c00b8b0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 shutdown_connections 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd618078b90 0x7fd61807b0a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd62c0b5d20 0x7fd62c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd62c0cdf10 0x7fd62c15ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 --2- 172.21.15.104:0/3836666987 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd62c0b4fc0 0x7fd62c0c5b50 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 >> 172.21.15.104:0/3836666987 conn(0x7fd62c0b44a0 msgr2=0x7fd62c0b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:27.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 shutdown_connections 2024-09-17T03:04:27.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.105+0000 7fd632919640 1 -- 172.21.15.104:0/3836666987 wait complete. 2024-09-17T03:04:27.117 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:04:27.117 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:04:27.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.230+0000 7fcbf8de4640 1 -- 172.21.15.104:0/3438234802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf415cc30 msgr2=0x7fcbf40cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.230+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/3438234802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf415cc30 0x7fcbf40cd770 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009900 tx=0x7fcbe802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.230+0000 7fcbf8de4640 1 -- 172.21.15.104:0/3438234802 shutdown_connections 2024-09-17T03:04:27.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.230+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/3438234802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf40cdcb0 0x7fcbf40cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.230+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/3438234802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf415cc30 0x7fcbf40cd770 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.230+0000 7fcbf8de4640 1 -- 172.21.15.104:0/3438234802 >> 172.21.15.104:0/3438234802 conn(0x7fcbf406eb90 msgr2=0x7fcbf406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:27.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.230+0000 7fcbf8de4640 1 -- 172.21.15.104:0/3438234802 shutdown_connections 2024-09-17T03:04:27.230 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.230+0000 7fcbf8de4640 1 -- 172.21.15.104:0/3438234802 wait complete. 2024-09-17T03:04:27.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.232+0000 7fcbf8de4640 1 Processor -- start 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.232+0000 7fcbf8de4640 1 -- start start 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf8de4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf4073e00 0x7fcbf4148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf8de4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf40cdcb0 0x7fcbf40aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf8de4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf415cc30 0x7fcbf41f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf8de4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf40d0190 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf8de4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf40d0010 con 0x7fcbf415cc30 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf8de4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf40d0310 con 0x7fcbf4073e00 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf40cdcb0 0x7fcbf40aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf1d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf40cdcb0 0x7fcbf40aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51564/0 (socket says 172.21.15.104:51564) 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf1d9b640 1 -- 172.21.15.104:0/2805786121 learned_addr learned my addr 172.21.15.104:0/2805786121 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf259c640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf4073e00 0x7fcbf4148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.233+0000 7fcbf2d9d640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf415cc30 0x7fcbf41f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbf1d9b640 1 -- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf4073e00 msgr2=0x7fcbf4148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbf1d9b640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf4073e00 0x7fcbf4148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbf1d9b640 1 -- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf415cc30 msgr2=0x7fcbf41f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbf1d9b640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf415cc30 0x7fcbf41f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbf1d9b640 1 -- 172.21.15.104:0/2805786121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf40ae5f0 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbf1d9b640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf40cdcb0 0x7fcbf40aca60 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8034040 tx=0x7fcbe8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbe2ffd640 1 -- 172.21.15.104:0/2805786121 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe803e030 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbe2ffd640 1 -- 172.21.15.104:0/2805786121 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbe80047a0 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf4159920 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbe2ffd640 1 -- 172.21.15.104:0/2805786121 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8035040 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.234+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf4159640 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.237 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.235+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf40ce670 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.236+0000 7fcbe2ffd640 1 -- 172.21.15.104:0/2805786121 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcbe8041030 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.236+0000 7fcbe2ffd640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.236+0000 7fcbe2ffd640 1 -- 172.21.15.104:0/2805786121 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5709+0+0 (secure 0 0 0) 0x7fcbe80bb4f0 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.236+0000 7fcbf259c640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.237+0000 7fcbf259c640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4000f60 tx=0x7fcbe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:27.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.241+0000 7fcbe2ffd640 1 -- 172.21.15.104:0/2805786121 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcbe8083380 con 0x7fcbf40cdcb0 2024-09-17T03:04:27.410 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.410+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcbf41485b0 con 0x7fcbd4078bc0 2024-09-17T03:04:27.413 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.415+0000 7fcbe2ffd640 1 -- 172.21.15.104:0/2805786121 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236374 (secure 0 0 0) 0x7fcbe4001420 con 0x7fcbd4078bc0 2024-09-17T03:04:27.417 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:27.418 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:04:27.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcbd4078bc0 msgr2=0x7fcbd407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4000f60 tx=0x7fcbe4009040 comp rx=0 tx=0).stop 2024-09-17T03:04:27.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf40cdcb0 msgr2=0x7fcbf40aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf40cdcb0 0x7fcbf40aca60 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8034040 tx=0x7fcbe8003970 comp rx=0 tx=0).stop 2024-09-17T03:04:27.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 shutdown_connections 2024-09-17T03:04:27.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fcbd4078bc0 0x7fcbd407b0d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf415cc30 0x7fcbf41f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fcbf40cdcb0 0x7fcbf40aca60 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 --2- 172.21.15.104:0/2805786121 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcbf4073e00 0x7fcbf4148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.417+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 >> 172.21.15.104:0/2805786121 conn(0x7fcbf406eb90 msgr2=0x7fcbf40b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:27.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.418+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 shutdown_connections 2024-09-17T03:04:27.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.418+0000 7fcbf8de4640 1 -- 172.21.15.104:0/2805786121 wait complete. 2024-09-17T03:04:27.429 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":459,"stamp":"2024-09-17T03:04:25.774182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8277,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554222,"statfs":{"total":1600000000,"available":1591524060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001004"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":397,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:04:21.432647+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:04:21.432647+0000","last_peered":"2024-09-17T03:04:21.432647+0000","last_clean":"2024-09-17T03:04:21.432647+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:04:21.432647+0000","last_undegraded":"2024-09-17T03:04:21.432647+0000","last_fullsized":"2024-09-17T03:04:21.432647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1469,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193842,"statfs":{"total":200000000,"available":198495164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194414,"statfs":{"total":200000000,"available":199080475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194414,"statfs":{"total":200000000,"available":199080475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194414,"statfs":{"total":200000000,"available":199080475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":878,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194434,"statfs":{"total":200000000,"available":199100859,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":888,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194424,"statfs":{"total":200000000,"available":199090589,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1454,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193857,"statfs":{"total":200000000,"available":198510491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:04:27.433 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:04:27.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.583+0000 7f313104a640 1 -- 172.21.15.104:0/3816638507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0b7bb0 msgr2=0x7f312c0cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.583+0000 7f313104a640 1 --2- 172.21.15.104:0/3816638507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0b7bb0 0x7f312c0cde90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f311c009820 tx=0x7f311c02a3f0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.583+0000 7f313104a640 1 -- 172.21.15.104:0/3816638507 shutdown_connections 2024-09-17T03:04:27.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.583+0000 7f313104a640 1 --2- 172.21.15.104:0/3816638507 >> v2:172.21.15.192:3300/0 conn(0x7f312c0cefb0 0x7f312c0cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.583+0000 7f313104a640 1 --2- 172.21.15.104:0/3816638507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0b7bb0 0x7f312c0cde90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.584+0000 7f313104a640 1 -- 172.21.15.104:0/3816638507 >> 172.21.15.104:0/3816638507 conn(0x7f312c0d28a0 msgr2=0x7f312c0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:27.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.584+0000 7f313104a640 1 -- 172.21.15.104:0/3816638507 shutdown_connections 2024-09-17T03:04:27.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.584+0000 7f313104a640 1 -- 172.21.15.104:0/3816638507 wait complete. 2024-09-17T03:04:27.583 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.585+0000 7f313104a640 1 Processor -- start 2024-09-17T03:04:27.584 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.586+0000 7f313104a640 1 -- start start 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f313104a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f312c0b7bb0 0x7f312c0ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f313104a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c0cefb0 0x7f312c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f313104a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0d0470 0x7f312c0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f313104a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f312c0cfa80 con 0x7f312c0b7bb0 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f313104a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f312c0cf900 con 0x7f312c0cefb0 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f313104a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f312c0cfc00 con 0x7f312c0d0470 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f312c0b7bb0 0x7f312c0ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f312c0b7bb0 0x7f312c0ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51574/0 (socket says 172.21.15.104:51574) 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 -- 172.21.15.104:0/4245563086 learned_addr learned my addr 172.21.15.104:0/4245563086 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312b59e640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0d0470 0x7f312c0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312259c640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c0cefb0 0x7f312c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 -- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0d0470 msgr2=0x7f312c0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.587 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0d0470 0x7f312c0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 -- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c0cefb0 msgr2=0x7f312c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c0cefb0 0x7f312c15dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 -- 172.21.15.104:0/4245563086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c1f60c0 con 0x7f312c0b7bb0 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312b59e640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0d0470 0x7f312c0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312259c640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c0cefb0 0x7f312c15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.587+0000 7f312ad9d640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f312c0b7bb0 0x7f312c0ca0b0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f311c000c00 tx=0x7f311c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.588+0000 7f3123fff640 1 -- 172.21.15.104:0/4245563086 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c03f070 con 0x7f312c0b7bb0 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.588+0000 7f3123fff640 1 -- 172.21.15.104:0/4245563086 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f311c004340 con 0x7f312c0b7bb0 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.588+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c1f63a0 con 0x7f312c0b7bb0 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.588+0000 7f3123fff640 1 -- 172.21.15.104:0/4245563086 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c031bb0 con 0x7f312c0b7bb0 2024-09-17T03:04:27.588 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.588+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c1f6960 con 0x7f312c0b7bb0 2024-09-17T03:04:27.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.589+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f312c0cde90 con 0x7f312c0b7bb0 2024-09-17T03:04:27.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.589+0000 7f3123fff640 1 -- 172.21.15.104:0/4245563086 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f311c042070 con 0x7f312c0b7bb0 2024-09-17T03:04:27.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.590+0000 7f3123fff640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f310c078b90 0x7f310c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.590+0000 7f3123fff640 1 -- 172.21.15.104:0/4245563086 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5709+0+0 (secure 0 0 0) 0x7f311c0bbf60 con 0x7f312c0b7bb0 2024-09-17T03:04:27.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.590+0000 7f312259c640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f310c078b90 0x7f310c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.590 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.591+0000 7f312259c640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f310c078b90 0x7f310c07b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3114007fd0 tx=0x7f3114009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:27.592 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.594+0000 7f3123fff640 1 -- 172.21.15.104:0/4245563086 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f311c084410 con 0x7f312c0b7bb0 2024-09-17T03:04:27.767 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.768+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f312c1f5e70 con 0x7f310c078b90 2024-09-17T03:04:27.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.772+0000 7f3123fff640 1 -- 172.21.15.104:0/4245563086 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236374 (secure 0 0 0) 0x7f312c1f5e70 con 0x7f310c078b90 2024-09-17T03:04:27.775 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:27.777 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f310c078b90 msgr2=0x7f310c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f310c078b90 0x7f310c07b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3114007fd0 tx=0x7f3114009040 comp rx=0 tx=0).stop 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f312c0b7bb0 msgr2=0x7f312c0ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f312c0b7bb0 0x7f312c0ca0b0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f311c000c00 tx=0x7f311c005270 comp rx=0 tx=0).stop 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 shutdown_connections 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f310c078b90 0x7f310c07b0a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c0cefb0 0x7f312c15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f312c0d0470 0x7f312c0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 --2- 172.21.15.104:0/4245563086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f312c0b7bb0 0x7f312c0ca0b0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 >> 172.21.15.104:0/4245563086 conn(0x7f312c0d28a0 msgr2=0x7f312c0b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 shutdown_connections 2024-09-17T03:04:27.780 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.775+0000 7f313104a640 1 -- 172.21.15.104:0/4245563086 wait complete. 2024-09-17T03:04:27.785 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":459,"stamp":"2024-09-17T03:04:25.774182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8277,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554222,"statfs":{"total":1600000000,"available":1591524060,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001004"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:23.389861+0000","last_change":"2024-09-17T03:04:23.389861+0000","last_active":"2024-09-17T03:04:23.389861+0000","last_peered":"2024-09-17T03:04:23.389861+0000","last_clean":"2024-09-17T03:04:23.389861+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:23.389861+0000","last_undegraded":"2024-09-17T03:04:23.389861+0000","last_fullsized":"2024-09-17T03:04:23.389861+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:04:22.384682+0000","last_change":"2024-09-17T03:04:22.384682+0000","last_active":"2024-09-17T03:04:22.384682+0000","last_peered":"2024-09-17T03:04:22.384682+0000","last_clean":"2024-09-17T03:04:22.384682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:04:22.384682+0000","last_undegraded":"2024-09-17T03:04:22.384682+0000","last_fullsized":"2024-09-17T03:04:22.384682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":397,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T03:04:21.432647+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:04:21.432647+0000","last_peered":"2024-09-17T03:04:21.432647+0000","last_clean":"2024-09-17T03:04:21.432647+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:04:21.432647+0000","last_undegraded":"2024-09-17T03:04:21.432647+0000","last_fullsized":"2024-09-17T03:04:21.432647+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1469,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193842,"statfs":{"total":200000000,"available":198495164,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194414,"statfs":{"total":200000000,"available":199080475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":893,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194419,"statfs":{"total":200000000,"available":199085532,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194414,"statfs":{"total":200000000,"available":199080475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":897,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194414,"statfs":{"total":200000000,"available":199080475,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":878,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194434,"statfs":{"total":200000000,"available":199100859,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":888,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194424,"statfs":{"total":200000000,"available":199090589,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1454,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193857,"statfs":{"total":200000000,"available":198510491,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:04:27.789 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:04:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.940+0000 7f4141870640 1 -- 172.21.15.104:0/4138855517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 msgr2=0x7f413c06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.940+0000 7f4141870640 1 --2- 172.21.15.104:0/4138855517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 0x7f413c06f540 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f412c005fd0 tx=0x7f412c02aa10 comp rx=0 tx=0).stop 2024-09-17T03:04:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.940+0000 7f4141870640 1 -- 172.21.15.104:0/4138855517 shutdown_connections 2024-09-17T03:04:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.940+0000 7f4141870640 1 --2- 172.21.15.104:0/4138855517 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 0x7f413c06f540 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.940+0000 7f4141870640 1 -- 172.21.15.104:0/4138855517 >> 172.21.15.104:0/4138855517 conn(0x7f413c0b3640 msgr2=0x7f413c0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.940+0000 7f4141870640 1 -- 172.21.15.104:0/4138855517 shutdown_connections 2024-09-17T03:04:27.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.940+0000 7f4141870640 1 -- 172.21.15.104:0/4138855517 wait complete. 2024-09-17T03:04:27.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.942+0000 7f4141870640 1 Processor -- start 2024-09-17T03:04:27.940 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.942+0000 7f4141870640 1 -- start start 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f4141870640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f413c06fa80 0x7f413c141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f4141870640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 0x7f413c14fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f4141870640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f413c150e00 0x7f413c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f4141870640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f413c0b5a80 con 0x7f413c152ce0 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f4141870640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f413c0b5900 con 0x7f413c06fa80 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f4141870640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f413c0b5c00 con 0x7f413c150e00 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f413a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 0x7f413c14fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f413a7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 0x7f413c14fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51580/0 (socket says 172.21.15.104:51580) 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f413a7fc640 1 -- 172.21.15.104:0/278780497 learned_addr learned my addr 172.21.15.104:0/278780497 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:27.943 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f413affd640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f413c06fa80 0x7f413c141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.943+0000 7f413b7fe640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f413c150e00 0x7f413c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f413a7fc640 1 -- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f413c150e00 msgr2=0x7f413c068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f413a7fc640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f413c150e00 0x7f413c068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f413a7fc640 1 -- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f413c06fa80 msgr2=0x7f413c141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f413a7fc640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f413c06fa80 0x7f413c141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f413a7fc640 1 -- 172.21.15.104:0/278780497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c142590 con 0x7f413c152ce0 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f413a7fc640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 0x7f413c14fa30 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f4124009fd0 tx=0x7f412400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f4133fff640 1 -- 172.21.15.104:0/278780497 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124015020 con 0x7f413c152ce0 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f4133fff640 1 -- 172.21.15.104:0/278780497 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4124011920 con 0x7f413c152ce0 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c142870 con 0x7f413c152ce0 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f4133fff640 1 -- 172.21.15.104:0/278780497 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124011d50 con 0x7f413c152ce0 2024-09-17T03:04:27.944 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.944+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c142e30 con 0x7f413c152ce0 2024-09-17T03:04:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.945+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413c06f520 con 0x7f413c152ce0 2024-09-17T03:04:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.946+0000 7f4133fff640 1 -- 172.21.15.104:0/278780497 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4124018020 con 0x7f413c152ce0 2024-09-17T03:04:27.945 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.946+0000 7f4133fff640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f411c078b90 0x7f411c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.946+0000 7f4133fff640 1 -- 172.21.15.104:0/278780497 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5709+0+0 (secure 0 0 0) 0x7f412409a970 con 0x7f413c152ce0 2024-09-17T03:04:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.947+0000 7f413affd640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f411c078b90 0x7f411c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:27.946 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.947+0000 7f413affd640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f411c078b90 0x7f411c07b0a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f412c035000 tx=0x7f412c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:27.949 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:27.951+0000 7f4133fff640 1 -- 172.21.15.104:0/278780497 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f412401f020 con 0x7f413c152ce0 2024-09-17T03:04:28.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.121+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f413c150260 con 0x7f411c078b90 2024-09-17T03:04:28.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.126+0000 7f4133fff640 1 -- 172.21.15.104:0/278780497 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247980 (secure 0 0 0) 0x7f412c003af0 con 0x7f411c078b90 2024-09-17T03:04:28.127 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:28.129 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:04:28.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f411c078b90 msgr2=0x7f411c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f411c078b90 0x7f411c07b0a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f412c035000 tx=0x7f412c03b040 comp rx=0 tx=0).stop 2024-09-17T03:04:28.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 msgr2=0x7f413c14fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 0x7f413c14fa30 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f4124009fd0 tx=0x7f412400b870 comp rx=0 tx=0).stop 2024-09-17T03:04:28.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 shutdown_connections 2024-09-17T03:04:28.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f411c078b90 0x7f411c07b0a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f413c150e00 0x7f413c068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f413c152ce0 0x7f413c14fa30 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 --2- 172.21.15.104:0/278780497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f413c06fa80 0x7f413c141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 >> 172.21.15.104:0/278780497 conn(0x7f413c0b3640 msgr2=0x7f413c15d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:28.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 shutdown_connections 2024-09-17T03:04:28.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.129+0000 7f4141870640 1 -- 172.21.15.104:0/278780497 wait complete. 2024-09-17T03:04:28.139 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":460,"stamp":"2024-09-17T03:04:27.774783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8513,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553986,"statfs":{"total":1600000000,"available":1591282108,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.384094"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412425+0000","last_change":"2024-09-17T03:04:24.424404+0000","last_active":"2024-09-17T03:04:25.412425+0000","last_peered":"2024-09-17T03:04:25.412425+0000","last_clean":"2024-09-17T03:04:25.412425+0000","last_became_active":"2024-09-17T03:04:24.423621+0000","last_became_peered":"2024-09-17T03:04:24.423621+0000","last_unstale":"2024-09-17T03:04:25.412425+0000","last_undegraded":"2024-09-17T03:04:25.412425+0000","last_fullsized":"2024-09-17T03:04:25.412425+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:57.270527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408783+0000","last_change":"2024-09-17T03:04:24.419070+0000","last_active":"2024-09-17T03:04:25.408783+0000","last_peered":"2024-09-17T03:04:25.408783+0000","last_clean":"2024-09-17T03:04:25.408783+0000","last_became_active":"2024-09-17T03:04:24.418821+0000","last_became_peered":"2024-09-17T03:04:24.418821+0000","last_unstale":"2024-09-17T03:04:25.408783+0000","last_undegraded":"2024-09-17T03:04:25.408783+0000","last_fullsized":"2024-09-17T03:04:25.408783+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:36.898930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.415033+0000","last_change":"2024-09-17T03:04:24.423980+0000","last_active":"2024-09-17T03:04:25.415033+0000","last_peered":"2024-09-17T03:04:25.415033+0000","last_clean":"2024-09-17T03:04:25.415033+0000","last_became_active":"2024-09-17T03:04:24.423329+0000","last_became_peered":"2024-09-17T03:04:24.423329+0000","last_unstale":"2024-09-17T03:04:25.415033+0000","last_undegraded":"2024-09-17T03:04:25.415033+0000","last_fullsized":"2024-09-17T03:04:25.415033+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:59.379922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133088+0000","last_change":"2024-09-17T03:04:24.412087+0000","last_active":"2024-09-17T03:04:26.133088+0000","last_peered":"2024-09-17T03:04:26.133088+0000","last_clean":"2024-09-17T03:04:26.133088+0000","last_became_active":"2024-09-17T03:04:24.411805+0000","last_became_peered":"2024-09-17T03:04:24.411805+0000","last_unstale":"2024-09-17T03:04:26.133088+0000","last_undegraded":"2024-09-17T03:04:26.133088+0000","last_fullsized":"2024-09-17T03:04:26.133088+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:39.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133517+0000","last_change":"2024-09-17T03:04:24.424130+0000","last_active":"2024-09-17T03:04:26.133517+0000","last_peered":"2024-09-17T03:04:26.133517+0000","last_clean":"2024-09-17T03:04:26.133517+0000","last_became_active":"2024-09-17T03:04:24.423728+0000","last_became_peered":"2024-09-17T03:04:24.423728+0000","last_unstale":"2024-09-17T03:04:26.133517+0000","last_undegraded":"2024-09-17T03:04:26.133517+0000","last_fullsized":"2024-09-17T03:04:26.133517+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:53.341727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412261+0000","last_change":"2024-09-17T03:04:24.423916+0000","last_active":"2024-09-17T03:04:25.412261+0000","last_peered":"2024-09-17T03:04:25.412261+0000","last_clean":"2024-09-17T03:04:25.412261+0000","last_became_active":"2024-09-17T03:04:24.422984+0000","last_became_peered":"2024-09-17T03:04:24.422984+0000","last_unstale":"2024-09-17T03:04:25.412261+0000","last_undegraded":"2024-09-17T03:04:25.412261+0000","last_fullsized":"2024-09-17T03:04:25.412261+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:38.094596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132161+0000","last_change":"2024-09-17T03:04:24.421995+0000","last_active":"2024-09-17T03:04:26.132161+0000","last_peered":"2024-09-17T03:04:26.132161+0000","last_clean":"2024-09-17T03:04:26.132161+0000","last_became_active":"2024-09-17T03:04:24.421727+0000","last_became_peered":"2024-09-17T03:04:24.421727+0000","last_unstale":"2024-09-17T03:04:26.132161+0000","last_undegraded":"2024-09-17T03:04:26.132161+0000","last_fullsized":"2024-09-17T03:04:26.132161+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:58.279534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411629+0000","last_change":"2024-09-17T03:04:24.422122+0000","last_active":"2024-09-17T03:04:25.411629+0000","last_peered":"2024-09-17T03:04:25.411629+0000","last_clean":"2024-09-17T03:04:25.411629+0000","last_became_active":"2024-09-17T03:04:24.421881+0000","last_became_peered":"2024-09-17T03:04:24.421881+0000","last_unstale":"2024-09-17T03:04:25.411629+0000","last_undegraded":"2024-09-17T03:04:25.411629+0000","last_fullsized":"2024-09-17T03:04:25.411629+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:02.050650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408751+0000","last_change":"2024-09-17T03:04:24.422782+0000","last_active":"2024-09-17T03:04:25.408751+0000","last_peered":"2024-09-17T03:04:25.408751+0000","last_clean":"2024-09-17T03:04:25.408751+0000","last_became_active":"2024-09-17T03:04:24.422428+0000","last_became_peered":"2024-09-17T03:04:24.422428+0000","last_unstale":"2024-09-17T03:04:25.408751+0000","last_undegraded":"2024-09-17T03:04:25.408751+0000","last_fullsized":"2024-09-17T03:04:25.408751+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:48.972527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134134+0000","last_change":"2024-09-17T03:04:24.422209+0000","last_active":"2024-09-17T03:04:26.134134+0000","last_peered":"2024-09-17T03:04:26.134134+0000","last_clean":"2024-09-17T03:04:26.134134+0000","last_became_active":"2024-09-17T03:04:24.421648+0000","last_became_peered":"2024-09-17T03:04:24.421648+0000","last_unstale":"2024-09-17T03:04:26.134134+0000","last_undegraded":"2024-09-17T03:04:26.134134+0000","last_fullsized":"2024-09-17T03:04:26.134134+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:55.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411681+0000","last_change":"2024-09-17T03:04:24.425051+0000","last_active":"2024-09-17T03:04:25.411681+0000","last_peered":"2024-09-17T03:04:25.411681+0000","last_clean":"2024-09-17T03:04:25.411681+0000","last_became_active":"2024-09-17T03:04:24.424740+0000","last_became_peered":"2024-09-17T03:04:24.424740+0000","last_unstale":"2024-09-17T03:04:25.411681+0000","last_undegraded":"2024-09-17T03:04:25.411681+0000","last_fullsized":"2024-09-17T03:04:25.411681+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:31.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133487+0000","last_change":"2024-09-17T03:04:24.421011+0000","last_active":"2024-09-17T03:04:26.133487+0000","last_peered":"2024-09-17T03:04:26.133487+0000","last_clean":"2024-09-17T03:04:26.133487+0000","last_became_active":"2024-09-17T03:04:24.420749+0000","last_became_peered":"2024-09-17T03:04:24.420749+0000","last_unstale":"2024-09-17T03:04:26.133487+0000","last_undegraded":"2024-09-17T03:04:26.133487+0000","last_fullsized":"2024-09-17T03:04:26.133487+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:52.306592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132408+0000","last_change":"2024-09-17T03:04:24.425501+0000","last_active":"2024-09-17T03:04:26.132408+0000","last_peered":"2024-09-17T03:04:26.132408+0000","last_clean":"2024-09-17T03:04:26.132408+0000","last_became_active":"2024-09-17T03:04:24.425224+0000","last_became_peered":"2024-09-17T03:04:24.425224+0000","last_unstale":"2024-09-17T03:04:26.132408+0000","last_undegraded":"2024-09-17T03:04:26.132408+0000","last_fullsized":"2024-09-17T03:04:26.132408+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:26.085307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133354+0000","last_change":"2024-09-17T03:04:24.422071+0000","last_active":"2024-09-17T03:04:26.133354+0000","last_peered":"2024-09-17T03:04:26.133354+0000","last_clean":"2024-09-17T03:04:26.133354+0000","last_became_active":"2024-09-17T03:04:24.421761+0000","last_became_peered":"2024-09-17T03:04:24.421761+0000","last_unstale":"2024-09-17T03:04:26.133354+0000","last_undegraded":"2024-09-17T03:04:26.133354+0000","last_fullsized":"2024-09-17T03:04:26.133354+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:29.347905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134392+0000","last_change":"2024-09-17T03:04:24.415480+0000","last_active":"2024-09-17T03:04:26.134392+0000","last_peered":"2024-09-17T03:04:26.134392+0000","last_clean":"2024-09-17T03:04:26.134392+0000","last_became_active":"2024-09-17T03:04:24.415216+0000","last_became_peered":"2024-09-17T03:04:24.415216+0000","last_unstale":"2024-09-17T03:04:26.134392+0000","last_undegraded":"2024-09-17T03:04:26.134392+0000","last_fullsized":"2024-09-17T03:04:26.134392+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:34.006358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132340+0000","last_change":"2024-09-17T03:04:24.422067+0000","last_active":"2024-09-17T03:04:26.132340+0000","last_peered":"2024-09-17T03:04:26.132340+0000","last_clean":"2024-09-17T03:04:26.132340+0000","last_became_active":"2024-09-17T03:04:24.421757+0000","last_became_peered":"2024-09-17T03:04:24.421757+0000","last_unstale":"2024-09-17T03:04:26.132340+0000","last_undegraded":"2024-09-17T03:04:26.132340+0000","last_fullsized":"2024-09-17T03:04:26.132340+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:25.328043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133911+0000","last_change":"2024-09-17T03:04:24.419677+0000","last_active":"2024-09-17T03:04:26.133911+0000","last_peered":"2024-09-17T03:04:26.133911+0000","last_clean":"2024-09-17T03:04:26.133911+0000","last_became_active":"2024-09-17T03:04:24.417219+0000","last_became_peered":"2024-09-17T03:04:24.417219+0000","last_unstale":"2024-09-17T03:04:26.133911+0000","last_undegraded":"2024-09-17T03:04:26.133911+0000","last_fullsized":"2024-09-17T03:04:26.133911+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:33.944210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414772+0000","last_change":"2024-09-17T03:04:24.424628+0000","last_active":"2024-09-17T03:04:25.414772+0000","last_peered":"2024-09-17T03:04:25.414772+0000","last_clean":"2024-09-17T03:04:25.414772+0000","last_became_active":"2024-09-17T03:04:24.423689+0000","last_became_peered":"2024-09-17T03:04:24.423689+0000","last_unstale":"2024-09-17T03:04:25.414772+0000","last_undegraded":"2024-09-17T03:04:25.414772+0000","last_fullsized":"2024-09-17T03:04:25.414772+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.667019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412292+0000","last_change":"2024-09-17T03:04:24.420105+0000","last_active":"2024-09-17T03:04:25.412292+0000","last_peered":"2024-09-17T03:04:25.412292+0000","last_clean":"2024-09-17T03:04:25.412292+0000","last_became_active":"2024-09-17T03:04:24.419373+0000","last_became_peered":"2024-09-17T03:04:24.419373+0000","last_unstale":"2024-09-17T03:04:25.412292+0000","last_undegraded":"2024-09-17T03:04:25.412292+0000","last_fullsized":"2024-09-17T03:04:25.412292+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:23.069825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132505+0000","last_change":"2024-09-17T03:04:24.418218+0000","last_active":"2024-09-17T03:04:26.132505+0000","last_peered":"2024-09-17T03:04:26.132505+0000","last_clean":"2024-09-17T03:04:26.132505+0000","last_became_active":"2024-09-17T03:04:24.417798+0000","last_became_peered":"2024-09-17T03:04:24.417798+0000","last_unstale":"2024-09-17T03:04:26.132505+0000","last_undegraded":"2024-09-17T03:04:26.132505+0000","last_fullsized":"2024-09-17T03:04:26.132505+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:15.532829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132932+0000","last_change":"2024-09-17T03:04:24.420180+0000","last_active":"2024-09-17T03:04:26.132932+0000","last_peered":"2024-09-17T03:04:26.132932+0000","last_clean":"2024-09-17T03:04:26.132932+0000","last_became_active":"2024-09-17T03:04:24.419907+0000","last_became_peered":"2024-09-17T03:04:24.419907+0000","last_unstale":"2024-09-17T03:04:26.132932+0000","last_undegraded":"2024-09-17T03:04:26.132932+0000","last_fullsized":"2024-09-17T03:04:26.132932+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:51.973808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132785+0000","last_change":"2024-09-17T03:04:24.424058+0000","last_active":"2024-09-17T03:04:26.132785+0000","last_peered":"2024-09-17T03:04:26.132785+0000","last_clean":"2024-09-17T03:04:26.132785+0000","last_became_active":"2024-09-17T03:04:24.423542+0000","last_became_peered":"2024-09-17T03:04:24.423542+0000","last_unstale":"2024-09-17T03:04:26.132785+0000","last_undegraded":"2024-09-17T03:04:26.132785+0000","last_fullsized":"2024-09-17T03:04:26.132785+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:19.128972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132412+0000","last_change":"2024-09-17T03:04:24.415626+0000","last_active":"2024-09-17T03:04:26.132412+0000","last_peered":"2024-09-17T03:04:26.132412+0000","last_clean":"2024-09-17T03:04:26.132412+0000","last_became_active":"2024-09-17T03:04:24.415310+0000","last_became_peered":"2024-09-17T03:04:24.415310+0000","last_unstale":"2024-09-17T03:04:26.132412+0000","last_undegraded":"2024-09-17T03:04:26.132412+0000","last_fullsized":"2024-09-17T03:04:26.132412+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:08.559361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132406+0000","last_change":"2024-09-17T03:04:24.421934+0000","last_active":"2024-09-17T03:04:26.132406+0000","last_peered":"2024-09-17T03:04:26.132406+0000","last_clean":"2024-09-17T03:04:26.132406+0000","last_became_active":"2024-09-17T03:04:24.420872+0000","last_became_peered":"2024-09-17T03:04:24.420872+0000","last_unstale":"2024-09-17T03:04:26.132406+0000","last_undegraded":"2024-09-17T03:04:26.132406+0000","last_fullsized":"2024-09-17T03:04:26.132406+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:24.270401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132807+0000","last_change":"2024-09-17T03:04:24.420002+0000","last_active":"2024-09-17T03:04:26.132807+0000","last_peered":"2024-09-17T03:04:26.132807+0000","last_clean":"2024-09-17T03:04:26.132807+0000","last_became_active":"2024-09-17T03:04:24.419738+0000","last_became_peered":"2024-09-17T03:04:24.419738+0000","last_unstale":"2024-09-17T03:04:26.132807+0000","last_undegraded":"2024-09-17T03:04:26.132807+0000","last_fullsized":"2024-09-17T03:04:26.132807+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.827144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411876+0000","last_change":"2024-09-17T03:04:24.420736+0000","last_active":"2024-09-17T03:04:25.411876+0000","last_peered":"2024-09-17T03:04:25.411876+0000","last_clean":"2024-09-17T03:04:25.411876+0000","last_became_active":"2024-09-17T03:04:24.419991+0000","last_became_peered":"2024-09-17T03:04:24.419991+0000","last_unstale":"2024-09-17T03:04:25.411876+0000","last_undegraded":"2024-09-17T03:04:25.411876+0000","last_fullsized":"2024-09-17T03:04:25.411876+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:19.768571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132488+0000","last_change":"2024-09-17T03:04:24.418786+0000","last_active":"2024-09-17T03:04:26.132488+0000","last_peered":"2024-09-17T03:04:26.132488+0000","last_clean":"2024-09-17T03:04:26.132488+0000","last_became_active":"2024-09-17T03:04:24.418533+0000","last_became_peered":"2024-09-17T03:04:24.418533+0000","last_unstale":"2024-09-17T03:04:26.132488+0000","last_undegraded":"2024-09-17T03:04:26.132488+0000","last_fullsized":"2024-09-17T03:04:26.132488+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.689329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132033+0000","last_change":"2024-09-17T03:04:24.427930+0000","last_active":"2024-09-17T03:04:26.132033+0000","last_peered":"2024-09-17T03:04:26.132033+0000","last_clean":"2024-09-17T03:04:26.132033+0000","last_became_active":"2024-09-17T03:04:24.427669+0000","last_became_peered":"2024-09-17T03:04:24.427669+0000","last_unstale":"2024-09-17T03:04:26.132033+0000","last_undegraded":"2024-09-17T03:04:26.132033+0000","last_fullsized":"2024-09-17T03:04:26.132033+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:19.143645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411865+0000","last_change":"2024-09-17T03:04:24.424198+0000","last_active":"2024-09-17T03:04:25.411865+0000","last_peered":"2024-09-17T03:04:25.411865+0000","last_clean":"2024-09-17T03:04:25.411865+0000","last_became_active":"2024-09-17T03:04:24.423787+0000","last_became_peered":"2024-09-17T03:04:24.423787+0000","last_unstale":"2024-09-17T03:04:25.411865+0000","last_undegraded":"2024-09-17T03:04:25.411865+0000","last_fullsized":"2024-09-17T03:04:25.411865+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:07.641031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132542+0000","last_change":"2024-09-17T03:04:24.420152+0000","last_active":"2024-09-17T03:04:26.132542+0000","last_peered":"2024-09-17T03:04:26.132542+0000","last_clean":"2024-09-17T03:04:26.132542+0000","last_became_active":"2024-09-17T03:04:24.419874+0000","last_became_peered":"2024-09-17T03:04:24.419874+0000","last_unstale":"2024-09-17T03:04:26.132542+0000","last_undegraded":"2024-09-17T03:04:26.132542+0000","last_fullsized":"2024-09-17T03:04:26.132542+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:11.281845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408839+0000","last_change":"2024-09-17T03:04:24.423430+0000","last_active":"2024-09-17T03:04:25.408839+0000","last_peered":"2024-09-17T03:04:25.408839+0000","last_clean":"2024-09-17T03:04:25.408839+0000","last_became_active":"2024-09-17T03:04:24.423148+0000","last_became_peered":"2024-09-17T03:04:24.423148+0000","last_unstale":"2024-09-17T03:04:25.408839+0000","last_undegraded":"2024-09-17T03:04:25.408839+0000","last_fullsized":"2024-09-17T03:04:25.408839+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:30.918947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132672+0000","last_change":"2024-09-17T03:04:24.426022+0000","last_active":"2024-09-17T03:04:26.132672+0000","last_peered":"2024-09-17T03:04:26.132672+0000","last_clean":"2024-09-17T03:04:26.132672+0000","last_became_active":"2024-09-17T03:04:24.425317+0000","last_became_peered":"2024-09-17T03:04:24.425317+0000","last_unstale":"2024-09-17T03:04:26.132672+0000","last_undegraded":"2024-09-17T03:04:26.132672+0000","last_fullsized":"2024-09-17T03:04:26.132672+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:27.150520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132651+0000","last_change":"2024-09-17T03:04:24.426284+0000","last_active":"2024-09-17T03:04:26.132651+0000","last_peered":"2024-09-17T03:04:26.132651+0000","last_clean":"2024-09-17T03:04:26.132651+0000","last_became_active":"2024-09-17T03:04:24.425201+0000","last_became_peered":"2024-09-17T03:04:24.425201+0000","last_unstale":"2024-09-17T03:04:26.132651+0000","last_undegraded":"2024-09-17T03:04:26.132651+0000","last_fullsized":"2024-09-17T03:04:26.132651+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:50.201347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"168'4","reported_seq":19,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133099+0000","last_change":"2024-09-17T03:04:23.402488+0000","last_active":"2024-09-17T03:04:26.133099+0000","last_peered":"2024-09-17T03:04:26.133099+0000","last_clean":"2024-09-17T03:04:26.133099+0000","last_became_active":"2024-09-17T03:04:23.402230+0000","last_became_peered":"2024-09-17T03:04:23.402230+0000","last_unstale":"2024-09-17T03:04:26.133099+0000","last_undegraded":"2024-09-17T03:04:26.133099+0000","last_fullsized":"2024-09-17T03:04:26.133099+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:51.910409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408996+0000","last_change":"2024-09-17T03:04:24.421888+0000","last_active":"2024-09-17T03:04:25.408996+0000","last_peered":"2024-09-17T03:04:25.408996+0000","last_clean":"2024-09-17T03:04:25.408996+0000","last_became_active":"2024-09-17T03:04:24.421619+0000","last_became_peered":"2024-09-17T03:04:24.421619+0000","last_unstale":"2024-09-17T03:04:25.408996+0000","last_undegraded":"2024-09-17T03:04:25.408996+0000","last_fullsized":"2024-09-17T03:04:25.408996+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:01.313308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408880+0000","last_change":"2024-09-17T03:04:23.405422+0000","last_active":"2024-09-17T03:04:25.408880+0000","last_peered":"2024-09-17T03:04:25.408880+0000","last_clean":"2024-09-17T03:04:25.408880+0000","last_became_active":"2024-09-17T03:04:23.404768+0000","last_became_peered":"2024-09-17T03:04:23.404768+0000","last_unstale":"2024-09-17T03:04:25.408880+0000","last_undegraded":"2024-09-17T03:04:25.408880+0000","last_fullsized":"2024-09-17T03:04:25.408880+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:48.514407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411993+0000","last_change":"2024-09-17T03:04:24.421122+0000","last_active":"2024-09-17T03:04:25.411993+0000","last_peered":"2024-09-17T03:04:25.411993+0000","last_clean":"2024-09-17T03:04:25.411993+0000","last_became_active":"2024-09-17T03:04:24.420345+0000","last_became_peered":"2024-09-17T03:04:24.420345+0000","last_unstale":"2024-09-17T03:04:25.411993+0000","last_undegraded":"2024-09-17T03:04:25.411993+0000","last_fullsized":"2024-09-17T03:04:25.411993+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:24.330998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132743+0000","last_change":"2024-09-17T03:04:23.398221+0000","last_active":"2024-09-17T03:04:26.132743+0000","last_peered":"2024-09-17T03:04:26.132743+0000","last_clean":"2024-09-17T03:04:26.132743+0000","last_became_active":"2024-09-17T03:04:23.397953+0000","last_became_peered":"2024-09-17T03:04:23.397953+0000","last_unstale":"2024-09-17T03:04:26.132743+0000","last_undegraded":"2024-09-17T03:04:26.132743+0000","last_fullsized":"2024-09-17T03:04:26.132743+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:23.588498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134646+0000","last_change":"2024-09-17T03:04:24.425884+0000","last_active":"2024-09-17T03:04:26.134646+0000","last_peered":"2024-09-17T03:04:26.134646+0000","last_clean":"2024-09-17T03:04:26.134646+0000","last_became_active":"2024-09-17T03:04:24.425137+0000","last_became_peered":"2024-09-17T03:04:24.425137+0000","last_unstale":"2024-09-17T03:04:26.134646+0000","last_undegraded":"2024-09-17T03:04:26.134646+0000","last_fullsized":"2024-09-17T03:04:26.134646+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:54.332183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133858+0000","last_change":"2024-09-17T03:04:23.404326+0000","last_active":"2024-09-17T03:04:26.133858+0000","last_peered":"2024-09-17T03:04:26.133858+0000","last_clean":"2024-09-17T03:04:26.133858+0000","last_became_active":"2024-09-17T03:04:23.404033+0000","last_became_peered":"2024-09-17T03:04:23.404033+0000","last_unstale":"2024-09-17T03:04:26.133858+0000","last_undegraded":"2024-09-17T03:04:26.133858+0000","last_fullsized":"2024-09-17T03:04:26.133858+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:19.464963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.409132+0000","last_change":"2024-09-17T03:04:24.428412+0000","last_active":"2024-09-17T03:04:25.409132+0000","last_peered":"2024-09-17T03:04:25.409132+0000","last_clean":"2024-09-17T03:04:25.409132+0000","last_became_active":"2024-09-17T03:04:24.427997+0000","last_became_peered":"2024-09-17T03:04:24.427997+0000","last_unstale":"2024-09-17T03:04:25.409132+0000","last_undegraded":"2024-09-17T03:04:25.409132+0000","last_fullsized":"2024-09-17T03:04:25.409132+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:16.646137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132903+0000","last_change":"2024-09-17T03:04:23.403431+0000","last_active":"2024-09-17T03:04:26.132903+0000","last_peered":"2024-09-17T03:04:26.132903+0000","last_clean":"2024-09-17T03:04:26.132903+0000","last_became_active":"2024-09-17T03:04:23.403177+0000","last_became_peered":"2024-09-17T03:04:23.403177+0000","last_unstale":"2024-09-17T03:04:26.132903+0000","last_undegraded":"2024-09-17T03:04:26.132903+0000","last_fullsized":"2024-09-17T03:04:26.132903+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:19.148473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133025+0000","last_change":"2024-09-17T03:04:24.411490+0000","last_active":"2024-09-17T03:04:26.133025+0000","last_peered":"2024-09-17T03:04:26.133025+0000","last_clean":"2024-09-17T03:04:26.133025+0000","last_became_active":"2024-09-17T03:04:24.411181+0000","last_became_peered":"2024-09-17T03:04:24.411181+0000","last_unstale":"2024-09-17T03:04:26.133025+0000","last_undegraded":"2024-09-17T03:04:26.133025+0000","last_fullsized":"2024-09-17T03:04:26.133025+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:17.493410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134438+0000","last_change":"2024-09-17T03:04:23.404967+0000","last_active":"2024-09-17T03:04:26.134438+0000","last_peered":"2024-09-17T03:04:26.134438+0000","last_clean":"2024-09-17T03:04:26.134438+0000","last_became_active":"2024-09-17T03:04:23.404703+0000","last_became_peered":"2024-09-17T03:04:23.404703+0000","last_unstale":"2024-09-17T03:04:26.134438+0000","last_undegraded":"2024-09-17T03:04:26.134438+0000","last_fullsized":"2024-09-17T03:04:26.134438+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:10.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.409172+0000","last_change":"2024-09-17T03:04:24.425828+0000","last_active":"2024-09-17T03:04:25.409172+0000","last_peered":"2024-09-17T03:04:25.409172+0000","last_clean":"2024-09-17T03:04:25.409172+0000","last_became_active":"2024-09-17T03:04:24.425539+0000","last_became_peered":"2024-09-17T03:04:24.425539+0000","last_unstale":"2024-09-17T03:04:25.409172+0000","last_undegraded":"2024-09-17T03:04:25.409172+0000","last_fullsized":"2024-09-17T03:04:25.409172+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:23.548937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132375+0000","last_change":"2024-09-17T03:04:23.405787+0000","last_active":"2024-09-17T03:04:26.132375+0000","last_peered":"2024-09-17T03:04:26.132375+0000","last_clean":"2024-09-17T03:04:26.132375+0000","last_became_active":"2024-09-17T03:04:23.405355+0000","last_became_peered":"2024-09-17T03:04:23.405355+0000","last_unstale":"2024-09-17T03:04:26.132375+0000","last_undegraded":"2024-09-17T03:04:26.132375+0000","last_fullsized":"2024-09-17T03:04:26.132375+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:03.938063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133120+0000","last_change":"2024-09-17T03:04:24.418739+0000","last_active":"2024-09-17T03:04:26.133120+0000","last_peered":"2024-09-17T03:04:26.133120+0000","last_clean":"2024-09-17T03:04:26.133120+0000","last_became_active":"2024-09-17T03:04:24.418451+0000","last_became_peered":"2024-09-17T03:04:24.418451+0000","last_unstale":"2024-09-17T03:04:26.133120+0000","last_undegraded":"2024-09-17T03:04:26.133120+0000","last_fullsized":"2024-09-17T03:04:26.133120+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:10.171015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132886+0000","last_change":"2024-09-17T03:04:23.400231+0000","last_active":"2024-09-17T03:04:26.132886+0000","last_peered":"2024-09-17T03:04:26.132886+0000","last_clean":"2024-09-17T03:04:26.132886+0000","last_became_active":"2024-09-17T03:04:23.399814+0000","last_became_peered":"2024-09-17T03:04:23.399814+0000","last_unstale":"2024-09-17T03:04:26.132886+0000","last_undegraded":"2024-09-17T03:04:26.132886+0000","last_fullsized":"2024-09-17T03:04:26.132886+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:04.751839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132701+0000","last_change":"2024-09-17T03:04:24.421387+0000","last_active":"2024-09-17T03:04:26.132701+0000","last_peered":"2024-09-17T03:04:26.132701+0000","last_clean":"2024-09-17T03:04:26.132701+0000","last_became_active":"2024-09-17T03:04:24.421136+0000","last_became_peered":"2024-09-17T03:04:24.421136+0000","last_unstale":"2024-09-17T03:04:26.132701+0000","last_undegraded":"2024-09-17T03:04:26.132701+0000","last_fullsized":"2024-09-17T03:04:26.132701+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:02.544205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408947+0000","last_change":"2024-09-17T03:04:23.407258+0000","last_active":"2024-09-17T03:04:25.408947+0000","last_peered":"2024-09-17T03:04:25.408947+0000","last_clean":"2024-09-17T03:04:25.408947+0000","last_became_active":"2024-09-17T03:04:23.405839+0000","last_became_peered":"2024-09-17T03:04:23.405839+0000","last_unstale":"2024-09-17T03:04:25.408947+0000","last_undegraded":"2024-09-17T03:04:25.408947+0000","last_fullsized":"2024-09-17T03:04:25.408947+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:32.012765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133169+0000","last_change":"2024-09-17T03:04:24.416659+0000","last_active":"2024-09-17T03:04:26.133169+0000","last_peered":"2024-09-17T03:04:26.133169+0000","last_clean":"2024-09-17T03:04:26.133169+0000","last_became_active":"2024-09-17T03:04:24.416233+0000","last_became_peered":"2024-09-17T03:04:24.416233+0000","last_unstale":"2024-09-17T03:04:26.133169+0000","last_undegraded":"2024-09-17T03:04:26.133169+0000","last_fullsized":"2024-09-17T03:04:26.133169+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:06.799748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133702+0000","last_change":"2024-09-17T03:04:23.403653+0000","last_active":"2024-09-17T03:04:26.133702+0000","last_peered":"2024-09-17T03:04:26.133702+0000","last_clean":"2024-09-17T03:04:26.133702+0000","last_became_active":"2024-09-17T03:04:23.403370+0000","last_became_peered":"2024-09-17T03:04:23.403370+0000","last_unstale":"2024-09-17T03:04:26.133702+0000","last_undegraded":"2024-09-17T03:04:26.133702+0000","last_fullsized":"2024-09-17T03:04:26.133702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:47.746021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132055+0000","last_change":"2024-09-17T03:04:24.416902+0000","last_active":"2024-09-17T03:04:26.132055+0000","last_peered":"2024-09-17T03:04:26.132055+0000","last_clean":"2024-09-17T03:04:26.132055+0000","last_became_active":"2024-09-17T03:04:24.416146+0000","last_became_peered":"2024-09-17T03:04:24.416146+0000","last_unstale":"2024-09-17T03:04:26.132055+0000","last_undegraded":"2024-09-17T03:04:26.132055+0000","last_fullsized":"2024-09-17T03:04:26.132055+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:05.668824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"168'6","reported_seq":21,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.131762+0000","last_change":"2024-09-17T03:04:23.403903+0000","last_active":"2024-09-17T03:04:26.131762+0000","last_peered":"2024-09-17T03:04:26.131762+0000","last_clean":"2024-09-17T03:04:26.131762+0000","last_became_active":"2024-09-17T03:04:23.403617+0000","last_became_peered":"2024-09-17T03:04:23.403617+0000","last_unstale":"2024-09-17T03:04:26.131762+0000","last_undegraded":"2024-09-17T03:04:26.131762+0000","last_fullsized":"2024-09-17T03:04:26.131762+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:21.262073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414655+0000","last_change":"2024-09-17T03:04:24.413319+0000","last_active":"2024-09-17T03:04:25.414655+0000","last_peered":"2024-09-17T03:04:25.414655+0000","last_clean":"2024-09-17T03:04:25.414655+0000","last_became_active":"2024-09-17T03:04:24.413019+0000","last_became_peered":"2024-09-17T03:04:24.413019+0000","last_unstale":"2024-09-17T03:04:25.414655+0000","last_undegraded":"2024-09-17T03:04:25.414655+0000","last_fullsized":"2024-09-17T03:04:25.414655+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:33.863827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414476+0000","last_change":"2024-09-17T03:04:23.408694+0000","last_active":"2024-09-17T03:04:25.414476+0000","last_peered":"2024-09-17T03:04:25.414476+0000","last_clean":"2024-09-17T03:04:25.414476+0000","last_became_active":"2024-09-17T03:04:23.408398+0000","last_became_peered":"2024-09-17T03:04:23.408398+0000","last_unstale":"2024-09-17T03:04:25.414476+0000","last_undegraded":"2024-09-17T03:04:25.414476+0000","last_fullsized":"2024-09-17T03:04:25.414476+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:51.824215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408881+0000","last_change":"2024-09-17T03:04:24.419997+0000","last_active":"2024-09-17T03:04:25.408881+0000","last_peered":"2024-09-17T03:04:25.408881+0000","last_clean":"2024-09-17T03:04:25.408881+0000","last_became_active":"2024-09-17T03:04:24.419734+0000","last_became_peered":"2024-09-17T03:04:24.419734+0000","last_unstale":"2024-09-17T03:04:25.408881+0000","last_undegraded":"2024-09-17T03:04:25.408881+0000","last_fullsized":"2024-09-17T03:04:25.408881+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:30.222647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414736+0000","last_change":"2024-09-17T03:04:23.406098+0000","last_active":"2024-09-17T03:04:25.414736+0000","last_peered":"2024-09-17T03:04:25.414736+0000","last_clean":"2024-09-17T03:04:25.414736+0000","last_became_active":"2024-09-17T03:04:23.405621+0000","last_became_peered":"2024-09-17T03:04:23.405621+0000","last_unstale":"2024-09-17T03:04:25.414736+0000","last_undegraded":"2024-09-17T03:04:25.414736+0000","last_fullsized":"2024-09-17T03:04:25.414736+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:28.373706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133978+0000","last_change":"2024-09-17T03:04:24.423126+0000","last_active":"2024-09-17T03:04:26.133978+0000","last_peered":"2024-09-17T03:04:26.133978+0000","last_clean":"2024-09-17T03:04:26.133978+0000","last_became_active":"2024-09-17T03:04:24.422133+0000","last_became_peered":"2024-09-17T03:04:24.422133+0000","last_unstale":"2024-09-17T03:04:26.133978+0000","last_undegraded":"2024-09-17T03:04:26.133978+0000","last_fullsized":"2024-09-17T03:04:26.133978+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:10.761532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411545+0000","last_change":"2024-09-17T03:04:23.404041+0000","last_active":"2024-09-17T03:04:25.411545+0000","last_peered":"2024-09-17T03:04:25.411545+0000","last_clean":"2024-09-17T03:04:25.411545+0000","last_became_active":"2024-09-17T03:04:23.403745+0000","last_became_peered":"2024-09-17T03:04:23.403745+0000","last_unstale":"2024-09-17T03:04:25.411545+0000","last_undegraded":"2024-09-17T03:04:25.411545+0000","last_fullsized":"2024-09-17T03:04:25.411545+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:42.340695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414581+0000","last_change":"2024-09-17T03:04:24.418632+0000","last_active":"2024-09-17T03:04:25.414581+0000","last_peered":"2024-09-17T03:04:25.414581+0000","last_clean":"2024-09-17T03:04:25.414581+0000","last_became_active":"2024-09-17T03:04:24.418264+0000","last_became_peered":"2024-09-17T03:04:24.418264+0000","last_unstale":"2024-09-17T03:04:25.414581+0000","last_undegraded":"2024-09-17T03:04:25.414581+0000","last_fullsized":"2024-09-17T03:04:25.414581+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:56.330892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"168'8","reported_seq":23,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132175+0000","last_change":"2024-09-17T03:04:23.402406+0000","last_active":"2024-09-17T03:04:26.132175+0000","last_peered":"2024-09-17T03:04:26.132175+0000","last_clean":"2024-09-17T03:04:26.132175+0000","last_became_active":"2024-09-17T03:04:23.402144+0000","last_became_peered":"2024-09-17T03:04:23.402144+0000","last_unstale":"2024-09-17T03:04:26.132175+0000","last_undegraded":"2024-09-17T03:04:26.132175+0000","last_fullsized":"2024-09-17T03:04:26.132175+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:53.350513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134913+0000","last_change":"2024-09-17T03:04:24.423252+0000","last_active":"2024-09-17T03:04:26.134913+0000","last_peered":"2024-09-17T03:04:26.134913+0000","last_clean":"2024-09-17T03:04:26.134913+0000","last_became_active":"2024-09-17T03:04:24.422979+0000","last_became_peered":"2024-09-17T03:04:24.422979+0000","last_unstale":"2024-09-17T03:04:26.134913+0000","last_undegraded":"2024-09-17T03:04:26.134913+0000","last_fullsized":"2024-09-17T03:04:26.134913+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:46.009448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133337+0000","last_change":"2024-09-17T03:04:23.407574+0000","last_active":"2024-09-17T03:04:26.133337+0000","last_peered":"2024-09-17T03:04:26.133337+0000","last_clean":"2024-09-17T03:04:26.133337+0000","last_became_active":"2024-09-17T03:04:23.407305+0000","last_became_peered":"2024-09-17T03:04:23.407305+0000","last_unstale":"2024-09-17T03:04:26.133337+0000","last_undegraded":"2024-09-17T03:04:26.133337+0000","last_fullsized":"2024-09-17T03:04:26.133337+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:28.028704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132235+0000","last_change":"2024-09-17T03:04:24.419032+0000","last_active":"2024-09-17T03:04:26.132235+0000","last_peered":"2024-09-17T03:04:26.132235+0000","last_clean":"2024-09-17T03:04:26.132235+0000","last_became_active":"2024-09-17T03:04:24.418750+0000","last_became_peered":"2024-09-17T03:04:24.418750+0000","last_unstale":"2024-09-17T03:04:26.132235+0000","last_undegraded":"2024-09-17T03:04:26.132235+0000","last_fullsized":"2024-09-17T03:04:26.132235+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:56.831791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.409236+0000","last_change":"2024-09-17T03:04:23.405655+0000","last_active":"2024-09-17T03:04:25.409236+0000","last_peered":"2024-09-17T03:04:25.409236+0000","last_clean":"2024-09-17T03:04:25.409236+0000","last_became_active":"2024-09-17T03:04:23.405354+0000","last_became_peered":"2024-09-17T03:04:23.405354+0000","last_unstale":"2024-09-17T03:04:25.409236+0000","last_undegraded":"2024-09-17T03:04:25.409236+0000","last_fullsized":"2024-09-17T03:04:25.409236+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:22.472867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414854+0000","last_change":"2024-09-17T03:04:24.415128+0000","last_active":"2024-09-17T03:04:25.414854+0000","last_peered":"2024-09-17T03:04:25.414854+0000","last_clean":"2024-09-17T03:04:25.414854+0000","last_became_active":"2024-09-17T03:04:24.413400+0000","last_became_peered":"2024-09-17T03:04:24.413400+0000","last_unstale":"2024-09-17T03:04:25.414854+0000","last_undegraded":"2024-09-17T03:04:25.414854+0000","last_fullsized":"2024-09-17T03:04:25.414854+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:55.654450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132575+0000","last_change":"2024-09-17T03:04:23.405036+0000","last_active":"2024-09-17T03:04:26.132575+0000","last_peered":"2024-09-17T03:04:26.132575+0000","last_clean":"2024-09-17T03:04:26.132575+0000","last_became_active":"2024-09-17T03:04:23.404768+0000","last_became_peered":"2024-09-17T03:04:23.404768+0000","last_unstale":"2024-09-17T03:04:26.132575+0000","last_undegraded":"2024-09-17T03:04:26.132575+0000","last_fullsized":"2024-09-17T03:04:26.132575+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:04.189472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412146+0000","last_change":"2024-09-17T03:04:24.424203+0000","last_active":"2024-09-17T03:04:25.412146+0000","last_peered":"2024-09-17T03:04:25.412146+0000","last_clean":"2024-09-17T03:04:25.412146+0000","last_became_active":"2024-09-17T03:04:24.423292+0000","last_became_peered":"2024-09-17T03:04:24.423292+0000","last_unstale":"2024-09-17T03:04:25.412146+0000","last_undegraded":"2024-09-17T03:04:25.412146+0000","last_fullsized":"2024-09-17T03:04:25.412146+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:30.602560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408981+0000","last_change":"2024-09-17T03:04:23.403243+0000","last_active":"2024-09-17T03:04:25.408981+0000","last_peered":"2024-09-17T03:04:25.408981+0000","last_clean":"2024-09-17T03:04:25.408981+0000","last_became_active":"2024-09-17T03:04:23.402987+0000","last_became_peered":"2024-09-17T03:04:23.402987+0000","last_unstale":"2024-09-17T03:04:25.408981+0000","last_undegraded":"2024-09-17T03:04:25.408981+0000","last_fullsized":"2024-09-17T03:04:25.408981+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:27.955333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133601+0000","last_change":"2024-09-17T03:04:24.421182+0000","last_active":"2024-09-17T03:04:26.133601+0000","last_peered":"2024-09-17T03:04:26.133601+0000","last_clean":"2024-09-17T03:04:26.133601+0000","last_became_active":"2024-09-17T03:04:24.420736+0000","last_became_peered":"2024-09-17T03:04:24.420736+0000","last_unstale":"2024-09-17T03:04:26.133601+0000","last_undegraded":"2024-09-17T03:04:26.133601+0000","last_fullsized":"2024-09-17T03:04:26.133601+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:20.813854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132563+0000","last_change":"2024-09-17T03:04:23.406462+0000","last_active":"2024-09-17T03:04:26.132563+0000","last_peered":"2024-09-17T03:04:26.132563+0000","last_clean":"2024-09-17T03:04:26.132563+0000","last_became_active":"2024-09-17T03:04:23.406189+0000","last_became_peered":"2024-09-17T03:04:23.406189+0000","last_unstale":"2024-09-17T03:04:26.132563+0000","last_undegraded":"2024-09-17T03:04:26.132563+0000","last_fullsized":"2024-09-17T03:04:26.132563+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:20.692326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132268+0000","last_change":"2024-09-17T03:04:24.416484+0000","last_active":"2024-09-17T03:04:26.132268+0000","last_peered":"2024-09-17T03:04:26.132268+0000","last_clean":"2024-09-17T03:04:26.132268+0000","last_became_active":"2024-09-17T03:04:24.416041+0000","last_became_peered":"2024-09-17T03:04:24.416041+0000","last_unstale":"2024-09-17T03:04:26.132268+0000","last_undegraded":"2024-09-17T03:04:26.132268+0000","last_fullsized":"2024-09-17T03:04:26.132268+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:59.400426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133164+0000","last_change":"2024-09-17T03:04:23.405097+0000","last_active":"2024-09-17T03:04:26.133164+0000","last_peered":"2024-09-17T03:04:26.133164+0000","last_clean":"2024-09-17T03:04:26.133164+0000","last_became_active":"2024-09-17T03:04:23.404789+0000","last_became_peered":"2024-09-17T03:04:23.404789+0000","last_unstale":"2024-09-17T03:04:26.133164+0000","last_undegraded":"2024-09-17T03:04:26.133164+0000","last_fullsized":"2024-09-17T03:04:26.133164+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:55.661161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133713+0000","last_change":"2024-09-17T03:04:24.417144+0000","last_active":"2024-09-17T03:04:26.133713+0000","last_peered":"2024-09-17T03:04:26.133713+0000","last_clean":"2024-09-17T03:04:26.133713+0000","last_became_active":"2024-09-17T03:04:24.416157+0000","last_became_peered":"2024-09-17T03:04:24.416157+0000","last_unstale":"2024-09-17T03:04:26.133713+0000","last_undegraded":"2024-09-17T03:04:26.133713+0000","last_fullsized":"2024-09-17T03:04:26.133713+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:49.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.135126+0000","last_change":"2024-09-17T03:04:23.403012+0000","last_active":"2024-09-17T03:04:26.135126+0000","last_peered":"2024-09-17T03:04:26.135126+0000","last_clean":"2024-09-17T03:04:26.135126+0000","last_became_active":"2024-09-17T03:04:23.402063+0000","last_became_peered":"2024-09-17T03:04:23.402063+0000","last_unstale":"2024-09-17T03:04:26.135126+0000","last_undegraded":"2024-09-17T03:04:26.135126+0000","last_fullsized":"2024-09-17T03:04:26.135126+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:19.319566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132476+0000","last_change":"2024-09-17T03:04:24.416649+0000","last_active":"2024-09-17T03:04:26.132476+0000","last_peered":"2024-09-17T03:04:26.132476+0000","last_clean":"2024-09-17T03:04:26.132476+0000","last_became_active":"2024-09-17T03:04:24.416355+0000","last_became_peered":"2024-09-17T03:04:24.416355+0000","last_unstale":"2024-09-17T03:04:26.132476+0000","last_undegraded":"2024-09-17T03:04:26.132476+0000","last_fullsized":"2024-09-17T03:04:26.132476+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:55.861068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414809+0000","last_change":"2024-09-17T03:04:23.408376+0000","last_active":"2024-09-17T03:04:25.414809+0000","last_peered":"2024-09-17T03:04:25.414809+0000","last_clean":"2024-09-17T03:04:25.414809+0000","last_became_active":"2024-09-17T03:04:23.408014+0000","last_became_peered":"2024-09-17T03:04:23.408014+0000","last_unstale":"2024-09-17T03:04:25.414809+0000","last_undegraded":"2024-09-17T03:04:25.414809+0000","last_fullsized":"2024-09-17T03:04:25.414809+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:12.933779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134214+0000","last_change":"2024-09-17T03:04:24.422783+0000","last_active":"2024-09-17T03:04:26.134214+0000","last_peered":"2024-09-17T03:04:26.134214+0000","last_clean":"2024-09-17T03:04:26.134214+0000","last_became_active":"2024-09-17T03:04:24.421767+0000","last_became_peered":"2024-09-17T03:04:24.421767+0000","last_unstale":"2024-09-17T03:04:26.134214+0000","last_undegraded":"2024-09-17T03:04:26.134214+0000","last_fullsized":"2024-09-17T03:04:26.134214+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:23.409196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133998+0000","last_change":"2024-09-17T03:04:23.405684+0000","last_active":"2024-09-17T03:04:26.133998+0000","last_peered":"2024-09-17T03:04:26.133998+0000","last_clean":"2024-09-17T03:04:26.133998+0000","last_became_active":"2024-09-17T03:04:23.405108+0000","last_became_peered":"2024-09-17T03:04:23.405108+0000","last_unstale":"2024-09-17T03:04:26.133998+0000","last_undegraded":"2024-09-17T03:04:26.133998+0000","last_fullsized":"2024-09-17T03:04:26.133998+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.415098+0000","last_change":"2024-09-17T03:04:24.415464+0000","last_active":"2024-09-17T03:04:25.415098+0000","last_peered":"2024-09-17T03:04:25.415098+0000","last_clean":"2024-09-17T03:04:25.415098+0000","last_became_active":"2024-09-17T03:04:24.414326+0000","last_became_peered":"2024-09-17T03:04:24.414326+0000","last_unstale":"2024-09-17T03:04:25.415098+0000","last_undegraded":"2024-09-17T03:04:25.415098+0000","last_fullsized":"2024-09-17T03:04:25.415098+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:23.583633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"169'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.429902+0000","last_change":"2024-09-17T03:04:23.407980+0000","last_active":"2024-09-17T03:04:26.429902+0000","last_peered":"2024-09-17T03:04:26.429902+0000","last_clean":"2024-09-17T03:04:26.429902+0000","last_became_active":"2024-09-17T03:04:23.407699+0000","last_became_peered":"2024-09-17T03:04:23.407699+0000","last_unstale":"2024-09-17T03:04:26.429902+0000","last_undegraded":"2024-09-17T03:04:26.429902+0000","last_fullsized":"2024-09-17T03:04:26.429902+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:10.428617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.409017+0000","last_change":"2024-09-17T03:04:24.421354+0000","last_active":"2024-09-17T03:04:25.409017+0000","last_peered":"2024-09-17T03:04:25.409017+0000","last_clean":"2024-09-17T03:04:25.409017+0000","last_became_active":"2024-09-17T03:04:24.421075+0000","last_became_peered":"2024-09-17T03:04:24.421075+0000","last_unstale":"2024-09-17T03:04:25.409017+0000","last_undegraded":"2024-09-17T03:04:25.409017+0000","last_fullsized":"2024-09-17T03:04:25.409017+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:18.027423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412468+0000","last_change":"2024-09-17T03:04:23.403007+0000","last_active":"2024-09-17T03:04:25.412468+0000","last_peered":"2024-09-17T03:04:25.412468+0000","last_clean":"2024-09-17T03:04:25.412468+0000","last_became_active":"2024-09-17T03:04:23.402737+0000","last_became_peered":"2024-09-17T03:04:23.402737+0000","last_unstale":"2024-09-17T03:04:25.412468+0000","last_undegraded":"2024-09-17T03:04:25.412468+0000","last_fullsized":"2024-09-17T03:04:25.412468+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:17.344114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412077+0000","last_change":"2024-09-17T03:04:24.420813+0000","last_active":"2024-09-17T03:04:25.412077+0000","last_peered":"2024-09-17T03:04:25.412077+0000","last_clean":"2024-09-17T03:04:25.412077+0000","last_became_active":"2024-09-17T03:04:24.419715+0000","last_became_peered":"2024-09-17T03:04:24.419715+0000","last_unstale":"2024-09-17T03:04:25.412077+0000","last_undegraded":"2024-09-17T03:04:25.412077+0000","last_fullsized":"2024-09-17T03:04:25.412077+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:27.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411814+0000","last_change":"2024-09-17T03:04:23.405532+0000","last_active":"2024-09-17T03:04:25.411814+0000","last_peered":"2024-09-17T03:04:25.411814+0000","last_clean":"2024-09-17T03:04:25.411814+0000","last_became_active":"2024-09-17T03:04:23.405276+0000","last_became_peered":"2024-09-17T03:04:23.405276+0000","last_unstale":"2024-09-17T03:04:25.411814+0000","last_undegraded":"2024-09-17T03:04:25.411814+0000","last_fullsized":"2024-09-17T03:04:25.411814+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:31.107448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132800+0000","last_change":"2024-09-17T03:04:24.425704+0000","last_active":"2024-09-17T03:04:26.132800+0000","last_peered":"2024-09-17T03:04:26.132800+0000","last_clean":"2024-09-17T03:04:26.132800+0000","last_became_active":"2024-09-17T03:04:24.424897+0000","last_became_peered":"2024-09-17T03:04:24.424897+0000","last_unstale":"2024-09-17T03:04:26.132800+0000","last_undegraded":"2024-09-17T03:04:26.132800+0000","last_fullsized":"2024-09-17T03:04:26.132800+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:23.914312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132460+0000","last_change":"2024-09-17T03:04:23.400492+0000","last_active":"2024-09-17T03:04:26.132460+0000","last_peered":"2024-09-17T03:04:26.132460+0000","last_clean":"2024-09-17T03:04:26.132460+0000","last_became_active":"2024-09-17T03:04:23.400226+0000","last_became_peered":"2024-09-17T03:04:23.400226+0000","last_unstale":"2024-09-17T03:04:26.132460+0000","last_undegraded":"2024-09-17T03:04:26.132460+0000","last_fullsized":"2024-09-17T03:04:26.132460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:06.156766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133569+0000","last_change":"2024-09-17T03:04:24.422014+0000","last_active":"2024-09-17T03:04:26.133569+0000","last_peered":"2024-09-17T03:04:26.133569+0000","last_clean":"2024-09-17T03:04:26.133569+0000","last_became_active":"2024-09-17T03:04:24.421721+0000","last_became_peered":"2024-09-17T03:04:24.421721+0000","last_unstale":"2024-09-17T03:04:26.133569+0000","last_undegraded":"2024-09-17T03:04:26.133569+0000","last_fullsized":"2024-09-17T03:04:26.133569+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:27.481713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134064+0000","last_change":"2024-09-17T03:04:23.405372+0000","last_active":"2024-09-17T03:04:26.134064+0000","last_peered":"2024-09-17T03:04:26.134064+0000","last_clean":"2024-09-17T03:04:26.134064+0000","last_became_active":"2024-09-17T03:04:23.404722+0000","last_became_peered":"2024-09-17T03:04:23.404722+0000","last_unstale":"2024-09-17T03:04:26.134064+0000","last_undegraded":"2024-09-17T03:04:26.134064+0000","last_fullsized":"2024-09-17T03:04:26.134064+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:21.618164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133048+0000","last_change":"2024-09-17T03:04:24.418781+0000","last_active":"2024-09-17T03:04:26.133048+0000","last_peered":"2024-09-17T03:04:26.133048+0000","last_clean":"2024-09-17T03:04:26.133048+0000","last_became_active":"2024-09-17T03:04:24.418314+0000","last_became_peered":"2024-09-17T03:04:24.418314+0000","last_unstale":"2024-09-17T03:04:26.133048+0000","last_undegraded":"2024-09-17T03:04:26.133048+0000","last_fullsized":"2024-09-17T03:04:26.133048+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:11.040957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.415269+0000","last_change":"2024-09-17T03:04:23.410036+0000","last_active":"2024-09-17T03:04:25.415269+0000","last_peered":"2024-09-17T03:04:25.415269+0000","last_clean":"2024-09-17T03:04:25.415269+0000","last_became_active":"2024-09-17T03:04:23.409330+0000","last_became_peered":"2024-09-17T03:04:23.409330+0000","last_unstale":"2024-09-17T03:04:25.415269+0000","last_undegraded":"2024-09-17T03:04:25.415269+0000","last_fullsized":"2024-09-17T03:04:25.415269+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:39.246159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134355+0000","last_change":"2024-09-17T03:04:24.422449+0000","last_active":"2024-09-17T03:04:26.134355+0000","last_peered":"2024-09-17T03:04:26.134355+0000","last_clean":"2024-09-17T03:04:26.134355+0000","last_became_active":"2024-09-17T03:04:24.421423+0000","last_became_peered":"2024-09-17T03:04:24.421423+0000","last_unstale":"2024-09-17T03:04:26.134355+0000","last_undegraded":"2024-09-17T03:04:26.134355+0000","last_fullsized":"2024-09-17T03:04:26.134355+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:13.978168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408977+0000","last_change":"2024-09-17T03:04:23.406229+0000","last_active":"2024-09-17T03:04:25.408977+0000","last_peered":"2024-09-17T03:04:25.408977+0000","last_clean":"2024-09-17T03:04:25.408977+0000","last_became_active":"2024-09-17T03:04:23.405816+0000","last_became_peered":"2024-09-17T03:04:23.405816+0000","last_unstale":"2024-09-17T03:04:25.408977+0000","last_undegraded":"2024-09-17T03:04:25.408977+0000","last_fullsized":"2024-09-17T03:04:25.408977+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:44.882009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.131978+0000","last_change":"2024-09-17T03:04:24.416436+0000","last_active":"2024-09-17T03:04:26.131978+0000","last_peered":"2024-09-17T03:04:26.131978+0000","last_clean":"2024-09-17T03:04:26.131978+0000","last_became_active":"2024-09-17T03:04:24.416160+0000","last_became_peered":"2024-09-17T03:04:24.416160+0000","last_unstale":"2024-09-17T03:04:26.131978+0000","last_undegraded":"2024-09-17T03:04:26.131978+0000","last_fullsized":"2024-09-17T03:04:26.131978+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:16.719187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"168'3","reported_seq":18,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.415162+0000","last_change":"2024-09-17T03:04:23.409678+0000","last_active":"2024-09-17T03:04:25.415162+0000","last_peered":"2024-09-17T03:04:25.415162+0000","last_clean":"2024-09-17T03:04:25.415162+0000","last_became_active":"2024-09-17T03:04:23.408838+0000","last_became_peered":"2024-09-17T03:04:23.408838+0000","last_unstale":"2024-09-17T03:04:25.415162+0000","last_undegraded":"2024-09-17T03:04:25.415162+0000","last_fullsized":"2024-09-17T03:04:25.415162+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:38.808023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":405,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133224+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:04:26.133224+0000","last_peered":"2024-09-17T03:04:26.133224+0000","last_clean":"2024-09-17T03:04:26.133224+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:04:26.133224+0000","last_undegraded":"2024-09-17T03:04:26.133224+0000","last_fullsized":"2024-09-17T03:04:26.133224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193818,"statfs":{"total":200000000,"available":198470588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":916,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194396,"statfs":{"total":200000000,"available":199061586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055218,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":918,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194394,"statfs":{"total":200000000,"available":199059926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":923,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199054726,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1494,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193817,"statfs":{"total":200000000,"available":198469594,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:04:28.143 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:04:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.291+0000 7f95b9094640 1 -- 172.21.15.104:0/2804910420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b4073920 msgr2=0x7f95b40d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.291+0000 7f95b9094640 1 --2- 172.21.15.104:0/2804910420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b4073920 0x7f95b40d2130 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009ca0 tx=0x7f95ac02aa30 comp rx=0 tx=0).stop 2024-09-17T03:04:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.292+0000 7f95b9094640 1 -- 172.21.15.104:0/2804910420 shutdown_connections 2024-09-17T03:04:28.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.292+0000 7f95b9094640 1 --2- 172.21.15.104:0/2804910420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b4073920 0x7f95b40d2130 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.292+0000 7f95b9094640 1 --2- 172.21.15.104:0/2804910420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95b4073510 0x7f95b40d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.292+0000 7f95b9094640 1 -- 172.21.15.104:0/2804910420 >> 172.21.15.104:0/2804910420 conn(0x7f95b406cfc0 msgr2=0x7f95b406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.292+0000 7f95b9094640 1 -- 172.21.15.104:0/2804910420 shutdown_connections 2024-09-17T03:04:28.291 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.292+0000 7f95b9094640 1 -- 172.21.15.104:0/2804910420 wait complete. 2024-09-17T03:04:28.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.294+0000 7f95b9094640 1 Processor -- start 2024-09-17T03:04:28.292 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.294+0000 7f95b9094640 1 -- start start 2024-09-17T03:04:28.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b9094640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95b4073510 0x7f95b4141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:28.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b9094640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95b4073920 0x7f95b414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b9094640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b415bff0 0x7f95b40b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b9094640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f95b40710c0 con 0x7f95b415bff0 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b9094640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f95b4070f40 con 0x7f95b4073510 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b9094640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f95b4071240 con 0x7f95b4073920 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b415bff0 0x7f95b40b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b415bff0 0x7f95b40b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51596/0 (socket says 172.21.15.104:51596) 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b359e640 1 -- 172.21.15.104:0/211900893 learned_addr learned my addr 172.21.15.104:0/211900893 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b259c640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95b4073920 0x7f95b414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b2d9d640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95b4073510 0x7f95b4141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b359e640 1 -- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95b4073920 msgr2=0x7f95b414b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b359e640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95b4073920 0x7f95b414b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b359e640 1 -- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95b4073510 msgr2=0x7f95b4141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b359e640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95b4073510 0x7f95b4141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.295+0000 7f95b359e640 1 -- 172.21.15.104:0/211900893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b414be80 con 0x7f95b415bff0 2024-09-17T03:04:28.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.296+0000 7f95b359e640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b415bff0 0x7f95b40b1430 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009ca0 tx=0x7f95ac003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:28.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.296+0000 7f959b7fe640 1 -- 172.21.15.104:0/211900893 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac033050 con 0x7f95b415bff0 2024-09-17T03:04:28.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.296+0000 7f959b7fe640 1 -- 172.21.15.104:0/211900893 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95ac004450 con 0x7f95b415bff0 2024-09-17T03:04:28.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.296+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b41f74e0 con 0x7f95b415bff0 2024-09-17T03:04:28.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.296+0000 7f959b7fe640 1 -- 172.21.15.104:0/211900893 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac038450 con 0x7f95b415bff0 2024-09-17T03:04:28.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.296+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b41f7aa0 con 0x7f95b415bff0 2024-09-17T03:04:28.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.297+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b40cdc00 con 0x7f95b415bff0 2024-09-17T03:04:28.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.297+0000 7f959b7fe640 1 -- 172.21.15.104:0/211900893 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95ac036070 con 0x7f95b415bff0 2024-09-17T03:04:28.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.298+0000 7f959b7fe640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f95a0078b90 0x7f95a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:28.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.298+0000 7f959b7fe640 1 -- 172.21.15.104:0/211900893 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5709+0+0 (secure 0 0 0) 0x7f95ac0bbf30 con 0x7f95b415bff0 2024-09-17T03:04:28.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.298+0000 7f95b2d9d640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f95a0078b90 0x7f95a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:28.297 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.299+0000 7f95b2d9d640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f95a0078b90 0x7f95a007b0a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f95a4001720 tx=0x7f95a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:28.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.302+0000 7f959b7fe640 1 -- 172.21.15.104:0/211900893 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f95ac083db0 con 0x7f95b415bff0 2024-09-17T03:04:28.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.545+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f95b414bc10 con 0x7f95b415bff0 2024-09-17T03:04:28.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.546+0000 7f959b7fe640 1 -- 172.21.15.104:0/211900893 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1053 (secure 0 0 0) 0x7f95ac0887e0 con 0x7f95b415bff0 2024-09-17T03:04:28.545 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:28.545 INFO:teuthology.orchestra.run.smithi104.stdout:{"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":605,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":169,"num_osds":8,"num_up_osds":8,"osd_up_since":1726541670,"num_in_osds":8,"osd_in_since":1726541667,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":8717892,"bytes_avail":1591282108,"bytes_total":1600000000,"write_bytes_sec":2662,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":69,"btime":"2024-09-17T03:04:26:435587+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":7791}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-17T03:03:01.750288+0000","services":{}},"progress_events":{}} 2024-09-17T03:04:28.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f95a0078b90 msgr2=0x7f95a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f95a0078b90 0x7f95a007b0a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f95a4001720 tx=0x7f95a4009040 comp rx=0 tx=0).stop 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b415bff0 msgr2=0x7f95b40b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b415bff0 0x7f95b40b1430 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009ca0 tx=0x7f95ac003f10 comp rx=0 tx=0).stop 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 shutdown_connections 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f95a0078b90 0x7f95a007b0a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f95b415bff0 0x7f95b40b1430 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95b4073920 0x7f95b414b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 --2- 172.21.15.104:0/211900893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95b4073510 0x7f95b4141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 >> 172.21.15.104:0/211900893 conn(0x7f95b406cfc0 msgr2=0x7f95b4155cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 shutdown_connections 2024-09-17T03:04:28.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.548+0000 7f95b9094640 1 -- 172.21.15.104:0/211900893 wait complete. 2024-09-17T03:04:28.558 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:04:28.558 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:04:28.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.672+0000 7fb85c83f640 1 -- 172.21.15.104:0/1516291412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 msgr2=0x7fb8580b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.672+0000 7fb85c83f640 1 --2- 172.21.15.104:0/1516291412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 0x7fb8580b39c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb848005fd0 tx=0x7fb84802a530 comp rx=0 tx=0).stop 2024-09-17T03:04:28.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.672+0000 7fb85c83f640 1 -- 172.21.15.104:0/1516291412 shutdown_connections 2024-09-17T03:04:28.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.672+0000 7fb85c83f640 1 --2- 172.21.15.104:0/1516291412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8580cdf10 0x7fb8580cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.672+0000 7fb85c83f640 1 --2- 172.21.15.104:0/1516291412 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 0x7fb8580b39c0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.672+0000 7fb85c83f640 1 -- 172.21.15.104:0/1516291412 >> 172.21.15.104:0/1516291412 conn(0x7fb8580b44a0 msgr2=0x7fb8580b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:28.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.672+0000 7fb85c83f640 1 -- 172.21.15.104:0/1516291412 shutdown_connections 2024-09-17T03:04:28.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.672+0000 7fb85c83f640 1 -- 172.21.15.104:0/1516291412 wait complete. 2024-09-17T03:04:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.674+0000 7fb85c83f640 1 Processor -- start 2024-09-17T03:04:28.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.674+0000 7fb85c83f640 1 -- start start 2024-09-17T03:04:28.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb85c83f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8580b3f00 0x7fb8580b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb85c83f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 0x7fb858154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb85c83f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8580cdf10 0x7fb8581495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb85c83f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580d0210 con 0x7fb8580b4fc0 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb85c83f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb858160f50 con 0x7fb8580cdf10 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb85c83f640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb85814a230 con 0x7fb8580b3f00 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb84dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 0x7fb858154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb84dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 0x7fb858154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51618/0 (socket says 172.21.15.104:51618) 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb84dd9b640 1 -- 172.21.15.104:0/3471589031 learned_addr learned my addr 172.21.15.104:0/3471589031 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb85659c640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8580b3f00 0x7fb8580b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.675+0000 7fb856d9d640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8580cdf10 0x7fb8581495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:28.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84dd9b640 1 -- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8580b3f00 msgr2=0x7fb8580b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84dd9b640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8580b3f00 0x7fb8580b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84dd9b640 1 -- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8580cdf10 msgr2=0x7fb8581495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84dd9b640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8580cdf10 0x7fb8581495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84dd9b640 1 -- 172.21.15.104:0/3471589031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85814bde0 con 0x7fb8580b4fc0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84dd9b640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 0x7fb858154dc0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b3f0 tx=0x7fb84000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84f7fe640 1 -- 172.21.15.104:0/3471589031 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840015020 con 0x7fb8580b4fc0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84f7fe640 1 -- 172.21.15.104:0/3471589031 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb840011920 con 0x7fb8580b4fc0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8580b0930 con 0x7fb8580b4fc0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb84f7fe640 1 -- 172.21.15.104:0/3471589031 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840011d70 con 0x7fb8580b4fc0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.676+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8580b0ba0 con 0x7fb8580b4fc0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.677+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8580b39c0 con 0x7fb8580b4fc0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.678+0000 7fb84f7fe640 1 -- 172.21.15.104:0/3471589031 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb840018020 con 0x7fb8580b4fc0 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.678+0000 7fb84f7fe640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb838078b90 0x7fb83807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:28.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.678+0000 7fb84f7fe640 1 -- 172.21.15.104:0/3471589031 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 5709+0+0 (secure 0 0 0) 0x7fb84009abc0 con 0x7fb8580b4fc0 2024-09-17T03:04:28.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.679+0000 7fb85659c640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb838078b90 0x7fb83807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:28.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.679+0000 7fb85659c640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb838078b90 0x7fb83807b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb848033000 tx=0x7fb848004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:28.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.683+0000 7fb84f7fe640 1 -- 172.21.15.104:0/3471589031 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb84001f020 con 0x7fb8580b4fc0 2024-09-17T03:04:28.853 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.855+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8580d18a0 con 0x7fb838078b90 2024-09-17T03:04:28.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.859+0000 7fb84f7fe640 1 -- 172.21.15.104:0/3471589031 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247980 (secure 0 0 0) 0x7fb8480055c0 con 0x7fb838078b90 2024-09-17T03:04:28.860 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:28.861 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb838078b90 msgr2=0x7fb83807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb838078b90 0x7fb83807b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb848033000 tx=0x7fb848004730 comp rx=0 tx=0).stop 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 msgr2=0x7fb858154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 0x7fb858154dc0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b3f0 tx=0x7fb84000b8b0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 shutdown_connections 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb838078b90 0x7fb83807b0a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8580cdf10 0x7fb8581495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb8580b4fc0 0x7fb858154dc0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 --2- 172.21.15.104:0/3471589031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8580b3f00 0x7fb8580b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:28.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 >> 172.21.15.104:0/3471589031 conn(0x7fb8580b44a0 msgr2=0x7fb8580d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:28.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 shutdown_connections 2024-09-17T03:04:28.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:28.862+0000 7fb85c83f640 1 -- 172.21.15.104:0/3471589031 wait complete. 2024-09-17T03:04:28.872 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":460,"stamp":"2024-09-17T03:04:27.774783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8513,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553986,"statfs":{"total":1600000000,"available":1591282108,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.384094"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412425+0000","last_change":"2024-09-17T03:04:24.424404+0000","last_active":"2024-09-17T03:04:25.412425+0000","last_peered":"2024-09-17T03:04:25.412425+0000","last_clean":"2024-09-17T03:04:25.412425+0000","last_became_active":"2024-09-17T03:04:24.423621+0000","last_became_peered":"2024-09-17T03:04:24.423621+0000","last_unstale":"2024-09-17T03:04:25.412425+0000","last_undegraded":"2024-09-17T03:04:25.412425+0000","last_fullsized":"2024-09-17T03:04:25.412425+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:57.270527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408783+0000","last_change":"2024-09-17T03:04:24.419070+0000","last_active":"2024-09-17T03:04:25.408783+0000","last_peered":"2024-09-17T03:04:25.408783+0000","last_clean":"2024-09-17T03:04:25.408783+0000","last_became_active":"2024-09-17T03:04:24.418821+0000","last_became_peered":"2024-09-17T03:04:24.418821+0000","last_unstale":"2024-09-17T03:04:25.408783+0000","last_undegraded":"2024-09-17T03:04:25.408783+0000","last_fullsized":"2024-09-17T03:04:25.408783+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:36.898930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.415033+0000","last_change":"2024-09-17T03:04:24.423980+0000","last_active":"2024-09-17T03:04:25.415033+0000","last_peered":"2024-09-17T03:04:25.415033+0000","last_clean":"2024-09-17T03:04:25.415033+0000","last_became_active":"2024-09-17T03:04:24.423329+0000","last_became_peered":"2024-09-17T03:04:24.423329+0000","last_unstale":"2024-09-17T03:04:25.415033+0000","last_undegraded":"2024-09-17T03:04:25.415033+0000","last_fullsized":"2024-09-17T03:04:25.415033+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:59.379922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133088+0000","last_change":"2024-09-17T03:04:24.412087+0000","last_active":"2024-09-17T03:04:26.133088+0000","last_peered":"2024-09-17T03:04:26.133088+0000","last_clean":"2024-09-17T03:04:26.133088+0000","last_became_active":"2024-09-17T03:04:24.411805+0000","last_became_peered":"2024-09-17T03:04:24.411805+0000","last_unstale":"2024-09-17T03:04:26.133088+0000","last_undegraded":"2024-09-17T03:04:26.133088+0000","last_fullsized":"2024-09-17T03:04:26.133088+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:39.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133517+0000","last_change":"2024-09-17T03:04:24.424130+0000","last_active":"2024-09-17T03:04:26.133517+0000","last_peered":"2024-09-17T03:04:26.133517+0000","last_clean":"2024-09-17T03:04:26.133517+0000","last_became_active":"2024-09-17T03:04:24.423728+0000","last_became_peered":"2024-09-17T03:04:24.423728+0000","last_unstale":"2024-09-17T03:04:26.133517+0000","last_undegraded":"2024-09-17T03:04:26.133517+0000","last_fullsized":"2024-09-17T03:04:26.133517+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:53.341727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412261+0000","last_change":"2024-09-17T03:04:24.423916+0000","last_active":"2024-09-17T03:04:25.412261+0000","last_peered":"2024-09-17T03:04:25.412261+0000","last_clean":"2024-09-17T03:04:25.412261+0000","last_became_active":"2024-09-17T03:04:24.422984+0000","last_became_peered":"2024-09-17T03:04:24.422984+0000","last_unstale":"2024-09-17T03:04:25.412261+0000","last_undegraded":"2024-09-17T03:04:25.412261+0000","last_fullsized":"2024-09-17T03:04:25.412261+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:38.094596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132161+0000","last_change":"2024-09-17T03:04:24.421995+0000","last_active":"2024-09-17T03:04:26.132161+0000","last_peered":"2024-09-17T03:04:26.132161+0000","last_clean":"2024-09-17T03:04:26.132161+0000","last_became_active":"2024-09-17T03:04:24.421727+0000","last_became_peered":"2024-09-17T03:04:24.421727+0000","last_unstale":"2024-09-17T03:04:26.132161+0000","last_undegraded":"2024-09-17T03:04:26.132161+0000","last_fullsized":"2024-09-17T03:04:26.132161+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:06:58.279534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411629+0000","last_change":"2024-09-17T03:04:24.422122+0000","last_active":"2024-09-17T03:04:25.411629+0000","last_peered":"2024-09-17T03:04:25.411629+0000","last_clean":"2024-09-17T03:04:25.411629+0000","last_became_active":"2024-09-17T03:04:24.421881+0000","last_became_peered":"2024-09-17T03:04:24.421881+0000","last_unstale":"2024-09-17T03:04:25.411629+0000","last_undegraded":"2024-09-17T03:04:25.411629+0000","last_fullsized":"2024-09-17T03:04:25.411629+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:02.050650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408751+0000","last_change":"2024-09-17T03:04:24.422782+0000","last_active":"2024-09-17T03:04:25.408751+0000","last_peered":"2024-09-17T03:04:25.408751+0000","last_clean":"2024-09-17T03:04:25.408751+0000","last_became_active":"2024-09-17T03:04:24.422428+0000","last_became_peered":"2024-09-17T03:04:24.422428+0000","last_unstale":"2024-09-17T03:04:25.408751+0000","last_undegraded":"2024-09-17T03:04:25.408751+0000","last_fullsized":"2024-09-17T03:04:25.408751+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:48.972527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134134+0000","last_change":"2024-09-17T03:04:24.422209+0000","last_active":"2024-09-17T03:04:26.134134+0000","last_peered":"2024-09-17T03:04:26.134134+0000","last_clean":"2024-09-17T03:04:26.134134+0000","last_became_active":"2024-09-17T03:04:24.421648+0000","last_became_peered":"2024-09-17T03:04:24.421648+0000","last_unstale":"2024-09-17T03:04:26.134134+0000","last_undegraded":"2024-09-17T03:04:26.134134+0000","last_fullsized":"2024-09-17T03:04:26.134134+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:55.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411681+0000","last_change":"2024-09-17T03:04:24.425051+0000","last_active":"2024-09-17T03:04:25.411681+0000","last_peered":"2024-09-17T03:04:25.411681+0000","last_clean":"2024-09-17T03:04:25.411681+0000","last_became_active":"2024-09-17T03:04:24.424740+0000","last_became_peered":"2024-09-17T03:04:24.424740+0000","last_unstale":"2024-09-17T03:04:25.411681+0000","last_undegraded":"2024-09-17T03:04:25.411681+0000","last_fullsized":"2024-09-17T03:04:25.411681+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:31.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133487+0000","last_change":"2024-09-17T03:04:24.421011+0000","last_active":"2024-09-17T03:04:26.133487+0000","last_peered":"2024-09-17T03:04:26.133487+0000","last_clean":"2024-09-17T03:04:26.133487+0000","last_became_active":"2024-09-17T03:04:24.420749+0000","last_became_peered":"2024-09-17T03:04:24.420749+0000","last_unstale":"2024-09-17T03:04:26.133487+0000","last_undegraded":"2024-09-17T03:04:26.133487+0000","last_fullsized":"2024-09-17T03:04:26.133487+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:52.306592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132408+0000","last_change":"2024-09-17T03:04:24.425501+0000","last_active":"2024-09-17T03:04:26.132408+0000","last_peered":"2024-09-17T03:04:26.132408+0000","last_clean":"2024-09-17T03:04:26.132408+0000","last_became_active":"2024-09-17T03:04:24.425224+0000","last_became_peered":"2024-09-17T03:04:24.425224+0000","last_unstale":"2024-09-17T03:04:26.132408+0000","last_undegraded":"2024-09-17T03:04:26.132408+0000","last_fullsized":"2024-09-17T03:04:26.132408+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:26.085307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133354+0000","last_change":"2024-09-17T03:04:24.422071+0000","last_active":"2024-09-17T03:04:26.133354+0000","last_peered":"2024-09-17T03:04:26.133354+0000","last_clean":"2024-09-17T03:04:26.133354+0000","last_became_active":"2024-09-17T03:04:24.421761+0000","last_became_peered":"2024-09-17T03:04:24.421761+0000","last_unstale":"2024-09-17T03:04:26.133354+0000","last_undegraded":"2024-09-17T03:04:26.133354+0000","last_fullsized":"2024-09-17T03:04:26.133354+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:29.347905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134392+0000","last_change":"2024-09-17T03:04:24.415480+0000","last_active":"2024-09-17T03:04:26.134392+0000","last_peered":"2024-09-17T03:04:26.134392+0000","last_clean":"2024-09-17T03:04:26.134392+0000","last_became_active":"2024-09-17T03:04:24.415216+0000","last_became_peered":"2024-09-17T03:04:24.415216+0000","last_unstale":"2024-09-17T03:04:26.134392+0000","last_undegraded":"2024-09-17T03:04:26.134392+0000","last_fullsized":"2024-09-17T03:04:26.134392+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:34.006358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132340+0000","last_change":"2024-09-17T03:04:24.422067+0000","last_active":"2024-09-17T03:04:26.132340+0000","last_peered":"2024-09-17T03:04:26.132340+0000","last_clean":"2024-09-17T03:04:26.132340+0000","last_became_active":"2024-09-17T03:04:24.421757+0000","last_became_peered":"2024-09-17T03:04:24.421757+0000","last_unstale":"2024-09-17T03:04:26.132340+0000","last_undegraded":"2024-09-17T03:04:26.132340+0000","last_fullsized":"2024-09-17T03:04:26.132340+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:25.328043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133911+0000","last_change":"2024-09-17T03:04:24.419677+0000","last_active":"2024-09-17T03:04:26.133911+0000","last_peered":"2024-09-17T03:04:26.133911+0000","last_clean":"2024-09-17T03:04:26.133911+0000","last_became_active":"2024-09-17T03:04:24.417219+0000","last_became_peered":"2024-09-17T03:04:24.417219+0000","last_unstale":"2024-09-17T03:04:26.133911+0000","last_undegraded":"2024-09-17T03:04:26.133911+0000","last_fullsized":"2024-09-17T03:04:26.133911+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:33.944210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414772+0000","last_change":"2024-09-17T03:04:24.424628+0000","last_active":"2024-09-17T03:04:25.414772+0000","last_peered":"2024-09-17T03:04:25.414772+0000","last_clean":"2024-09-17T03:04:25.414772+0000","last_became_active":"2024-09-17T03:04:24.423689+0000","last_became_peered":"2024-09-17T03:04:24.423689+0000","last_unstale":"2024-09-17T03:04:25.414772+0000","last_undegraded":"2024-09-17T03:04:25.414772+0000","last_fullsized":"2024-09-17T03:04:25.414772+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.667019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412292+0000","last_change":"2024-09-17T03:04:24.420105+0000","last_active":"2024-09-17T03:04:25.412292+0000","last_peered":"2024-09-17T03:04:25.412292+0000","last_clean":"2024-09-17T03:04:25.412292+0000","last_became_active":"2024-09-17T03:04:24.419373+0000","last_became_peered":"2024-09-17T03:04:24.419373+0000","last_unstale":"2024-09-17T03:04:25.412292+0000","last_undegraded":"2024-09-17T03:04:25.412292+0000","last_fullsized":"2024-09-17T03:04:25.412292+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:23.069825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132505+0000","last_change":"2024-09-17T03:04:24.418218+0000","last_active":"2024-09-17T03:04:26.132505+0000","last_peered":"2024-09-17T03:04:26.132505+0000","last_clean":"2024-09-17T03:04:26.132505+0000","last_became_active":"2024-09-17T03:04:24.417798+0000","last_became_peered":"2024-09-17T03:04:24.417798+0000","last_unstale":"2024-09-17T03:04:26.132505+0000","last_undegraded":"2024-09-17T03:04:26.132505+0000","last_fullsized":"2024-09-17T03:04:26.132505+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:15.532829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132932+0000","last_change":"2024-09-17T03:04:24.420180+0000","last_active":"2024-09-17T03:04:26.132932+0000","last_peered":"2024-09-17T03:04:26.132932+0000","last_clean":"2024-09-17T03:04:26.132932+0000","last_became_active":"2024-09-17T03:04:24.419907+0000","last_became_peered":"2024-09-17T03:04:24.419907+0000","last_unstale":"2024-09-17T03:04:26.132932+0000","last_undegraded":"2024-09-17T03:04:26.132932+0000","last_fullsized":"2024-09-17T03:04:26.132932+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:51.973808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132785+0000","last_change":"2024-09-17T03:04:24.424058+0000","last_active":"2024-09-17T03:04:26.132785+0000","last_peered":"2024-09-17T03:04:26.132785+0000","last_clean":"2024-09-17T03:04:26.132785+0000","last_became_active":"2024-09-17T03:04:24.423542+0000","last_became_peered":"2024-09-17T03:04:24.423542+0000","last_unstale":"2024-09-17T03:04:26.132785+0000","last_undegraded":"2024-09-17T03:04:26.132785+0000","last_fullsized":"2024-09-17T03:04:26.132785+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:19.128972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132412+0000","last_change":"2024-09-17T03:04:24.415626+0000","last_active":"2024-09-17T03:04:26.132412+0000","last_peered":"2024-09-17T03:04:26.132412+0000","last_clean":"2024-09-17T03:04:26.132412+0000","last_became_active":"2024-09-17T03:04:24.415310+0000","last_became_peered":"2024-09-17T03:04:24.415310+0000","last_unstale":"2024-09-17T03:04:26.132412+0000","last_undegraded":"2024-09-17T03:04:26.132412+0000","last_fullsized":"2024-09-17T03:04:26.132412+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:08.559361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132406+0000","last_change":"2024-09-17T03:04:24.421934+0000","last_active":"2024-09-17T03:04:26.132406+0000","last_peered":"2024-09-17T03:04:26.132406+0000","last_clean":"2024-09-17T03:04:26.132406+0000","last_became_active":"2024-09-17T03:04:24.420872+0000","last_became_peered":"2024-09-17T03:04:24.420872+0000","last_unstale":"2024-09-17T03:04:26.132406+0000","last_undegraded":"2024-09-17T03:04:26.132406+0000","last_fullsized":"2024-09-17T03:04:26.132406+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:24.270401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132807+0000","last_change":"2024-09-17T03:04:24.420002+0000","last_active":"2024-09-17T03:04:26.132807+0000","last_peered":"2024-09-17T03:04:26.132807+0000","last_clean":"2024-09-17T03:04:26.132807+0000","last_became_active":"2024-09-17T03:04:24.419738+0000","last_became_peered":"2024-09-17T03:04:24.419738+0000","last_unstale":"2024-09-17T03:04:26.132807+0000","last_undegraded":"2024-09-17T03:04:26.132807+0000","last_fullsized":"2024-09-17T03:04:26.132807+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.827144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411876+0000","last_change":"2024-09-17T03:04:24.420736+0000","last_active":"2024-09-17T03:04:25.411876+0000","last_peered":"2024-09-17T03:04:25.411876+0000","last_clean":"2024-09-17T03:04:25.411876+0000","last_became_active":"2024-09-17T03:04:24.419991+0000","last_became_peered":"2024-09-17T03:04:24.419991+0000","last_unstale":"2024-09-17T03:04:25.411876+0000","last_undegraded":"2024-09-17T03:04:25.411876+0000","last_fullsized":"2024-09-17T03:04:25.411876+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:19.768571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132488+0000","last_change":"2024-09-17T03:04:24.418786+0000","last_active":"2024-09-17T03:04:26.132488+0000","last_peered":"2024-09-17T03:04:26.132488+0000","last_clean":"2024-09-17T03:04:26.132488+0000","last_became_active":"2024-09-17T03:04:24.418533+0000","last_became_peered":"2024-09-17T03:04:24.418533+0000","last_unstale":"2024-09-17T03:04:26.132488+0000","last_undegraded":"2024-09-17T03:04:26.132488+0000","last_fullsized":"2024-09-17T03:04:26.132488+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.689329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132033+0000","last_change":"2024-09-17T03:04:24.427930+0000","last_active":"2024-09-17T03:04:26.132033+0000","last_peered":"2024-09-17T03:04:26.132033+0000","last_clean":"2024-09-17T03:04:26.132033+0000","last_became_active":"2024-09-17T03:04:24.427669+0000","last_became_peered":"2024-09-17T03:04:24.427669+0000","last_unstale":"2024-09-17T03:04:26.132033+0000","last_undegraded":"2024-09-17T03:04:26.132033+0000","last_fullsized":"2024-09-17T03:04:26.132033+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:19.143645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411865+0000","last_change":"2024-09-17T03:04:24.424198+0000","last_active":"2024-09-17T03:04:25.411865+0000","last_peered":"2024-09-17T03:04:25.411865+0000","last_clean":"2024-09-17T03:04:25.411865+0000","last_became_active":"2024-09-17T03:04:24.423787+0000","last_became_peered":"2024-09-17T03:04:24.423787+0000","last_unstale":"2024-09-17T03:04:25.411865+0000","last_undegraded":"2024-09-17T03:04:25.411865+0000","last_fullsized":"2024-09-17T03:04:25.411865+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:07.641031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132542+0000","last_change":"2024-09-17T03:04:24.420152+0000","last_active":"2024-09-17T03:04:26.132542+0000","last_peered":"2024-09-17T03:04:26.132542+0000","last_clean":"2024-09-17T03:04:26.132542+0000","last_became_active":"2024-09-17T03:04:24.419874+0000","last_became_peered":"2024-09-17T03:04:24.419874+0000","last_unstale":"2024-09-17T03:04:26.132542+0000","last_undegraded":"2024-09-17T03:04:26.132542+0000","last_fullsized":"2024-09-17T03:04:26.132542+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:11.281845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408839+0000","last_change":"2024-09-17T03:04:24.423430+0000","last_active":"2024-09-17T03:04:25.408839+0000","last_peered":"2024-09-17T03:04:25.408839+0000","last_clean":"2024-09-17T03:04:25.408839+0000","last_became_active":"2024-09-17T03:04:24.423148+0000","last_became_peered":"2024-09-17T03:04:24.423148+0000","last_unstale":"2024-09-17T03:04:25.408839+0000","last_undegraded":"2024-09-17T03:04:25.408839+0000","last_fullsized":"2024-09-17T03:04:25.408839+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:30.918947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132672+0000","last_change":"2024-09-17T03:04:24.426022+0000","last_active":"2024-09-17T03:04:26.132672+0000","last_peered":"2024-09-17T03:04:26.132672+0000","last_clean":"2024-09-17T03:04:26.132672+0000","last_became_active":"2024-09-17T03:04:24.425317+0000","last_became_peered":"2024-09-17T03:04:24.425317+0000","last_unstale":"2024-09-17T03:04:26.132672+0000","last_undegraded":"2024-09-17T03:04:26.132672+0000","last_fullsized":"2024-09-17T03:04:26.132672+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:27.150520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132651+0000","last_change":"2024-09-17T03:04:24.426284+0000","last_active":"2024-09-17T03:04:26.132651+0000","last_peered":"2024-09-17T03:04:26.132651+0000","last_clean":"2024-09-17T03:04:26.132651+0000","last_became_active":"2024-09-17T03:04:24.425201+0000","last_became_peered":"2024-09-17T03:04:24.425201+0000","last_unstale":"2024-09-17T03:04:26.132651+0000","last_undegraded":"2024-09-17T03:04:26.132651+0000","last_fullsized":"2024-09-17T03:04:26.132651+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:50.201347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"168'4","reported_seq":19,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133099+0000","last_change":"2024-09-17T03:04:23.402488+0000","last_active":"2024-09-17T03:04:26.133099+0000","last_peered":"2024-09-17T03:04:26.133099+0000","last_clean":"2024-09-17T03:04:26.133099+0000","last_became_active":"2024-09-17T03:04:23.402230+0000","last_became_peered":"2024-09-17T03:04:23.402230+0000","last_unstale":"2024-09-17T03:04:26.133099+0000","last_undegraded":"2024-09-17T03:04:26.133099+0000","last_fullsized":"2024-09-17T03:04:26.133099+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:51.910409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408996+0000","last_change":"2024-09-17T03:04:24.421888+0000","last_active":"2024-09-17T03:04:25.408996+0000","last_peered":"2024-09-17T03:04:25.408996+0000","last_clean":"2024-09-17T03:04:25.408996+0000","last_became_active":"2024-09-17T03:04:24.421619+0000","last_became_peered":"2024-09-17T03:04:24.421619+0000","last_unstale":"2024-09-17T03:04:25.408996+0000","last_undegraded":"2024-09-17T03:04:25.408996+0000","last_fullsized":"2024-09-17T03:04:25.408996+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:01.313308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408880+0000","last_change":"2024-09-17T03:04:23.405422+0000","last_active":"2024-09-17T03:04:25.408880+0000","last_peered":"2024-09-17T03:04:25.408880+0000","last_clean":"2024-09-17T03:04:25.408880+0000","last_became_active":"2024-09-17T03:04:23.404768+0000","last_became_peered":"2024-09-17T03:04:23.404768+0000","last_unstale":"2024-09-17T03:04:25.408880+0000","last_undegraded":"2024-09-17T03:04:25.408880+0000","last_fullsized":"2024-09-17T03:04:25.408880+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:48.514407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411993+0000","last_change":"2024-09-17T03:04:24.421122+0000","last_active":"2024-09-17T03:04:25.411993+0000","last_peered":"2024-09-17T03:04:25.411993+0000","last_clean":"2024-09-17T03:04:25.411993+0000","last_became_active":"2024-09-17T03:04:24.420345+0000","last_became_peered":"2024-09-17T03:04:24.420345+0000","last_unstale":"2024-09-17T03:04:25.411993+0000","last_undegraded":"2024-09-17T03:04:25.411993+0000","last_fullsized":"2024-09-17T03:04:25.411993+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:24.330998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132743+0000","last_change":"2024-09-17T03:04:23.398221+0000","last_active":"2024-09-17T03:04:26.132743+0000","last_peered":"2024-09-17T03:04:26.132743+0000","last_clean":"2024-09-17T03:04:26.132743+0000","last_became_active":"2024-09-17T03:04:23.397953+0000","last_became_peered":"2024-09-17T03:04:23.397953+0000","last_unstale":"2024-09-17T03:04:26.132743+0000","last_undegraded":"2024-09-17T03:04:26.132743+0000","last_fullsized":"2024-09-17T03:04:26.132743+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:23.588498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134646+0000","last_change":"2024-09-17T03:04:24.425884+0000","last_active":"2024-09-17T03:04:26.134646+0000","last_peered":"2024-09-17T03:04:26.134646+0000","last_clean":"2024-09-17T03:04:26.134646+0000","last_became_active":"2024-09-17T03:04:24.425137+0000","last_became_peered":"2024-09-17T03:04:24.425137+0000","last_unstale":"2024-09-17T03:04:26.134646+0000","last_undegraded":"2024-09-17T03:04:26.134646+0000","last_fullsized":"2024-09-17T03:04:26.134646+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:54.332183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133858+0000","last_change":"2024-09-17T03:04:23.404326+0000","last_active":"2024-09-17T03:04:26.133858+0000","last_peered":"2024-09-17T03:04:26.133858+0000","last_clean":"2024-09-17T03:04:26.133858+0000","last_became_active":"2024-09-17T03:04:23.404033+0000","last_became_peered":"2024-09-17T03:04:23.404033+0000","last_unstale":"2024-09-17T03:04:26.133858+0000","last_undegraded":"2024-09-17T03:04:26.133858+0000","last_fullsized":"2024-09-17T03:04:26.133858+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:19.464963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.409132+0000","last_change":"2024-09-17T03:04:24.428412+0000","last_active":"2024-09-17T03:04:25.409132+0000","last_peered":"2024-09-17T03:04:25.409132+0000","last_clean":"2024-09-17T03:04:25.409132+0000","last_became_active":"2024-09-17T03:04:24.427997+0000","last_became_peered":"2024-09-17T03:04:24.427997+0000","last_unstale":"2024-09-17T03:04:25.409132+0000","last_undegraded":"2024-09-17T03:04:25.409132+0000","last_fullsized":"2024-09-17T03:04:25.409132+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:16.646137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132903+0000","last_change":"2024-09-17T03:04:23.403431+0000","last_active":"2024-09-17T03:04:26.132903+0000","last_peered":"2024-09-17T03:04:26.132903+0000","last_clean":"2024-09-17T03:04:26.132903+0000","last_became_active":"2024-09-17T03:04:23.403177+0000","last_became_peered":"2024-09-17T03:04:23.403177+0000","last_unstale":"2024-09-17T03:04:26.132903+0000","last_undegraded":"2024-09-17T03:04:26.132903+0000","last_fullsized":"2024-09-17T03:04:26.132903+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:19.148473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133025+0000","last_change":"2024-09-17T03:04:24.411490+0000","last_active":"2024-09-17T03:04:26.133025+0000","last_peered":"2024-09-17T03:04:26.133025+0000","last_clean":"2024-09-17T03:04:26.133025+0000","last_became_active":"2024-09-17T03:04:24.411181+0000","last_became_peered":"2024-09-17T03:04:24.411181+0000","last_unstale":"2024-09-17T03:04:26.133025+0000","last_undegraded":"2024-09-17T03:04:26.133025+0000","last_fullsized":"2024-09-17T03:04:26.133025+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:17.493410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134438+0000","last_change":"2024-09-17T03:04:23.404967+0000","last_active":"2024-09-17T03:04:26.134438+0000","last_peered":"2024-09-17T03:04:26.134438+0000","last_clean":"2024-09-17T03:04:26.134438+0000","last_became_active":"2024-09-17T03:04:23.404703+0000","last_became_peered":"2024-09-17T03:04:23.404703+0000","last_unstale":"2024-09-17T03:04:26.134438+0000","last_undegraded":"2024-09-17T03:04:26.134438+0000","last_fullsized":"2024-09-17T03:04:26.134438+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:10.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.409172+0000","last_change":"2024-09-17T03:04:24.425828+0000","last_active":"2024-09-17T03:04:25.409172+0000","last_peered":"2024-09-17T03:04:25.409172+0000","last_clean":"2024-09-17T03:04:25.409172+0000","last_became_active":"2024-09-17T03:04:24.425539+0000","last_became_peered":"2024-09-17T03:04:24.425539+0000","last_unstale":"2024-09-17T03:04:25.409172+0000","last_undegraded":"2024-09-17T03:04:25.409172+0000","last_fullsized":"2024-09-17T03:04:25.409172+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:23.548937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132375+0000","last_change":"2024-09-17T03:04:23.405787+0000","last_active":"2024-09-17T03:04:26.132375+0000","last_peered":"2024-09-17T03:04:26.132375+0000","last_clean":"2024-09-17T03:04:26.132375+0000","last_became_active":"2024-09-17T03:04:23.405355+0000","last_became_peered":"2024-09-17T03:04:23.405355+0000","last_unstale":"2024-09-17T03:04:26.132375+0000","last_undegraded":"2024-09-17T03:04:26.132375+0000","last_fullsized":"2024-09-17T03:04:26.132375+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:03.938063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133120+0000","last_change":"2024-09-17T03:04:24.418739+0000","last_active":"2024-09-17T03:04:26.133120+0000","last_peered":"2024-09-17T03:04:26.133120+0000","last_clean":"2024-09-17T03:04:26.133120+0000","last_became_active":"2024-09-17T03:04:24.418451+0000","last_became_peered":"2024-09-17T03:04:24.418451+0000","last_unstale":"2024-09-17T03:04:26.133120+0000","last_undegraded":"2024-09-17T03:04:26.133120+0000","last_fullsized":"2024-09-17T03:04:26.133120+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:10.171015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132886+0000","last_change":"2024-09-17T03:04:23.400231+0000","last_active":"2024-09-17T03:04:26.132886+0000","last_peered":"2024-09-17T03:04:26.132886+0000","last_clean":"2024-09-17T03:04:26.132886+0000","last_became_active":"2024-09-17T03:04:23.399814+0000","last_became_peered":"2024-09-17T03:04:23.399814+0000","last_unstale":"2024-09-17T03:04:26.132886+0000","last_undegraded":"2024-09-17T03:04:26.132886+0000","last_fullsized":"2024-09-17T03:04:26.132886+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:04.751839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132701+0000","last_change":"2024-09-17T03:04:24.421387+0000","last_active":"2024-09-17T03:04:26.132701+0000","last_peered":"2024-09-17T03:04:26.132701+0000","last_clean":"2024-09-17T03:04:26.132701+0000","last_became_active":"2024-09-17T03:04:24.421136+0000","last_became_peered":"2024-09-17T03:04:24.421136+0000","last_unstale":"2024-09-17T03:04:26.132701+0000","last_undegraded":"2024-09-17T03:04:26.132701+0000","last_fullsized":"2024-09-17T03:04:26.132701+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:02.544205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408947+0000","last_change":"2024-09-17T03:04:23.407258+0000","last_active":"2024-09-17T03:04:25.408947+0000","last_peered":"2024-09-17T03:04:25.408947+0000","last_clean":"2024-09-17T03:04:25.408947+0000","last_became_active":"2024-09-17T03:04:23.405839+0000","last_became_peered":"2024-09-17T03:04:23.405839+0000","last_unstale":"2024-09-17T03:04:25.408947+0000","last_undegraded":"2024-09-17T03:04:25.408947+0000","last_fullsized":"2024-09-17T03:04:25.408947+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:32.012765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133169+0000","last_change":"2024-09-17T03:04:24.416659+0000","last_active":"2024-09-17T03:04:26.133169+0000","last_peered":"2024-09-17T03:04:26.133169+0000","last_clean":"2024-09-17T03:04:26.133169+0000","last_became_active":"2024-09-17T03:04:24.416233+0000","last_became_peered":"2024-09-17T03:04:24.416233+0000","last_unstale":"2024-09-17T03:04:26.133169+0000","last_undegraded":"2024-09-17T03:04:26.133169+0000","last_fullsized":"2024-09-17T03:04:26.133169+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:06.799748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133702+0000","last_change":"2024-09-17T03:04:23.403653+0000","last_active":"2024-09-17T03:04:26.133702+0000","last_peered":"2024-09-17T03:04:26.133702+0000","last_clean":"2024-09-17T03:04:26.133702+0000","last_became_active":"2024-09-17T03:04:23.403370+0000","last_became_peered":"2024-09-17T03:04:23.403370+0000","last_unstale":"2024-09-17T03:04:26.133702+0000","last_undegraded":"2024-09-17T03:04:26.133702+0000","last_fullsized":"2024-09-17T03:04:26.133702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:47.746021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132055+0000","last_change":"2024-09-17T03:04:24.416902+0000","last_active":"2024-09-17T03:04:26.132055+0000","last_peered":"2024-09-17T03:04:26.132055+0000","last_clean":"2024-09-17T03:04:26.132055+0000","last_became_active":"2024-09-17T03:04:24.416146+0000","last_became_peered":"2024-09-17T03:04:24.416146+0000","last_unstale":"2024-09-17T03:04:26.132055+0000","last_undegraded":"2024-09-17T03:04:26.132055+0000","last_fullsized":"2024-09-17T03:04:26.132055+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:05.668824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"168'6","reported_seq":21,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.131762+0000","last_change":"2024-09-17T03:04:23.403903+0000","last_active":"2024-09-17T03:04:26.131762+0000","last_peered":"2024-09-17T03:04:26.131762+0000","last_clean":"2024-09-17T03:04:26.131762+0000","last_became_active":"2024-09-17T03:04:23.403617+0000","last_became_peered":"2024-09-17T03:04:23.403617+0000","last_unstale":"2024-09-17T03:04:26.131762+0000","last_undegraded":"2024-09-17T03:04:26.131762+0000","last_fullsized":"2024-09-17T03:04:26.131762+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:21.262073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414655+0000","last_change":"2024-09-17T03:04:24.413319+0000","last_active":"2024-09-17T03:04:25.414655+0000","last_peered":"2024-09-17T03:04:25.414655+0000","last_clean":"2024-09-17T03:04:25.414655+0000","last_became_active":"2024-09-17T03:04:24.413019+0000","last_became_peered":"2024-09-17T03:04:24.413019+0000","last_unstale":"2024-09-17T03:04:25.414655+0000","last_undegraded":"2024-09-17T03:04:25.414655+0000","last_fullsized":"2024-09-17T03:04:25.414655+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:33.863827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414476+0000","last_change":"2024-09-17T03:04:23.408694+0000","last_active":"2024-09-17T03:04:25.414476+0000","last_peered":"2024-09-17T03:04:25.414476+0000","last_clean":"2024-09-17T03:04:25.414476+0000","last_became_active":"2024-09-17T03:04:23.408398+0000","last_became_peered":"2024-09-17T03:04:23.408398+0000","last_unstale":"2024-09-17T03:04:25.414476+0000","last_undegraded":"2024-09-17T03:04:25.414476+0000","last_fullsized":"2024-09-17T03:04:25.414476+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:51.824215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408881+0000","last_change":"2024-09-17T03:04:24.419997+0000","last_active":"2024-09-17T03:04:25.408881+0000","last_peered":"2024-09-17T03:04:25.408881+0000","last_clean":"2024-09-17T03:04:25.408881+0000","last_became_active":"2024-09-17T03:04:24.419734+0000","last_became_peered":"2024-09-17T03:04:24.419734+0000","last_unstale":"2024-09-17T03:04:25.408881+0000","last_undegraded":"2024-09-17T03:04:25.408881+0000","last_fullsized":"2024-09-17T03:04:25.408881+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:30.222647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414736+0000","last_change":"2024-09-17T03:04:23.406098+0000","last_active":"2024-09-17T03:04:25.414736+0000","last_peered":"2024-09-17T03:04:25.414736+0000","last_clean":"2024-09-17T03:04:25.414736+0000","last_became_active":"2024-09-17T03:04:23.405621+0000","last_became_peered":"2024-09-17T03:04:23.405621+0000","last_unstale":"2024-09-17T03:04:25.414736+0000","last_undegraded":"2024-09-17T03:04:25.414736+0000","last_fullsized":"2024-09-17T03:04:25.414736+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:28.373706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133978+0000","last_change":"2024-09-17T03:04:24.423126+0000","last_active":"2024-09-17T03:04:26.133978+0000","last_peered":"2024-09-17T03:04:26.133978+0000","last_clean":"2024-09-17T03:04:26.133978+0000","last_became_active":"2024-09-17T03:04:24.422133+0000","last_became_peered":"2024-09-17T03:04:24.422133+0000","last_unstale":"2024-09-17T03:04:26.133978+0000","last_undegraded":"2024-09-17T03:04:26.133978+0000","last_fullsized":"2024-09-17T03:04:26.133978+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:10.761532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411545+0000","last_change":"2024-09-17T03:04:23.404041+0000","last_active":"2024-09-17T03:04:25.411545+0000","last_peered":"2024-09-17T03:04:25.411545+0000","last_clean":"2024-09-17T03:04:25.411545+0000","last_became_active":"2024-09-17T03:04:23.403745+0000","last_became_peered":"2024-09-17T03:04:23.403745+0000","last_unstale":"2024-09-17T03:04:25.411545+0000","last_undegraded":"2024-09-17T03:04:25.411545+0000","last_fullsized":"2024-09-17T03:04:25.411545+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:42.340695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414581+0000","last_change":"2024-09-17T03:04:24.418632+0000","last_active":"2024-09-17T03:04:25.414581+0000","last_peered":"2024-09-17T03:04:25.414581+0000","last_clean":"2024-09-17T03:04:25.414581+0000","last_became_active":"2024-09-17T03:04:24.418264+0000","last_became_peered":"2024-09-17T03:04:24.418264+0000","last_unstale":"2024-09-17T03:04:25.414581+0000","last_undegraded":"2024-09-17T03:04:25.414581+0000","last_fullsized":"2024-09-17T03:04:25.414581+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:56.330892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"168'8","reported_seq":23,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132175+0000","last_change":"2024-09-17T03:04:23.402406+0000","last_active":"2024-09-17T03:04:26.132175+0000","last_peered":"2024-09-17T03:04:26.132175+0000","last_clean":"2024-09-17T03:04:26.132175+0000","last_became_active":"2024-09-17T03:04:23.402144+0000","last_became_peered":"2024-09-17T03:04:23.402144+0000","last_unstale":"2024-09-17T03:04:26.132175+0000","last_undegraded":"2024-09-17T03:04:26.132175+0000","last_fullsized":"2024-09-17T03:04:26.132175+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:53.350513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134913+0000","last_change":"2024-09-17T03:04:24.423252+0000","last_active":"2024-09-17T03:04:26.134913+0000","last_peered":"2024-09-17T03:04:26.134913+0000","last_clean":"2024-09-17T03:04:26.134913+0000","last_became_active":"2024-09-17T03:04:24.422979+0000","last_became_peered":"2024-09-17T03:04:24.422979+0000","last_unstale":"2024-09-17T03:04:26.134913+0000","last_undegraded":"2024-09-17T03:04:26.134913+0000","last_fullsized":"2024-09-17T03:04:26.134913+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:46.009448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133337+0000","last_change":"2024-09-17T03:04:23.407574+0000","last_active":"2024-09-17T03:04:26.133337+0000","last_peered":"2024-09-17T03:04:26.133337+0000","last_clean":"2024-09-17T03:04:26.133337+0000","last_became_active":"2024-09-17T03:04:23.407305+0000","last_became_peered":"2024-09-17T03:04:23.407305+0000","last_unstale":"2024-09-17T03:04:26.133337+0000","last_undegraded":"2024-09-17T03:04:26.133337+0000","last_fullsized":"2024-09-17T03:04:26.133337+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:28.028704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132235+0000","last_change":"2024-09-17T03:04:24.419032+0000","last_active":"2024-09-17T03:04:26.132235+0000","last_peered":"2024-09-17T03:04:26.132235+0000","last_clean":"2024-09-17T03:04:26.132235+0000","last_became_active":"2024-09-17T03:04:24.418750+0000","last_became_peered":"2024-09-17T03:04:24.418750+0000","last_unstale":"2024-09-17T03:04:26.132235+0000","last_undegraded":"2024-09-17T03:04:26.132235+0000","last_fullsized":"2024-09-17T03:04:26.132235+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:56.831791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.409236+0000","last_change":"2024-09-17T03:04:23.405655+0000","last_active":"2024-09-17T03:04:25.409236+0000","last_peered":"2024-09-17T03:04:25.409236+0000","last_clean":"2024-09-17T03:04:25.409236+0000","last_became_active":"2024-09-17T03:04:23.405354+0000","last_became_peered":"2024-09-17T03:04:23.405354+0000","last_unstale":"2024-09-17T03:04:25.409236+0000","last_undegraded":"2024-09-17T03:04:25.409236+0000","last_fullsized":"2024-09-17T03:04:25.409236+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:22.472867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414854+0000","last_change":"2024-09-17T03:04:24.415128+0000","last_active":"2024-09-17T03:04:25.414854+0000","last_peered":"2024-09-17T03:04:25.414854+0000","last_clean":"2024-09-17T03:04:25.414854+0000","last_became_active":"2024-09-17T03:04:24.413400+0000","last_became_peered":"2024-09-17T03:04:24.413400+0000","last_unstale":"2024-09-17T03:04:25.414854+0000","last_undegraded":"2024-09-17T03:04:25.414854+0000","last_fullsized":"2024-09-17T03:04:25.414854+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:55.654450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"168'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132575+0000","last_change":"2024-09-17T03:04:23.405036+0000","last_active":"2024-09-17T03:04:26.132575+0000","last_peered":"2024-09-17T03:04:26.132575+0000","last_clean":"2024-09-17T03:04:26.132575+0000","last_became_active":"2024-09-17T03:04:23.404768+0000","last_became_peered":"2024-09-17T03:04:23.404768+0000","last_unstale":"2024-09-17T03:04:26.132575+0000","last_undegraded":"2024-09-17T03:04:26.132575+0000","last_fullsized":"2024-09-17T03:04:26.132575+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:04.189472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412146+0000","last_change":"2024-09-17T03:04:24.424203+0000","last_active":"2024-09-17T03:04:25.412146+0000","last_peered":"2024-09-17T03:04:25.412146+0000","last_clean":"2024-09-17T03:04:25.412146+0000","last_became_active":"2024-09-17T03:04:24.423292+0000","last_became_peered":"2024-09-17T03:04:24.423292+0000","last_unstale":"2024-09-17T03:04:25.412146+0000","last_undegraded":"2024-09-17T03:04:25.412146+0000","last_fullsized":"2024-09-17T03:04:25.412146+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:30.602560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408981+0000","last_change":"2024-09-17T03:04:23.403243+0000","last_active":"2024-09-17T03:04:25.408981+0000","last_peered":"2024-09-17T03:04:25.408981+0000","last_clean":"2024-09-17T03:04:25.408981+0000","last_became_active":"2024-09-17T03:04:23.402987+0000","last_became_peered":"2024-09-17T03:04:23.402987+0000","last_unstale":"2024-09-17T03:04:25.408981+0000","last_undegraded":"2024-09-17T03:04:25.408981+0000","last_fullsized":"2024-09-17T03:04:25.408981+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:27.955333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133601+0000","last_change":"2024-09-17T03:04:24.421182+0000","last_active":"2024-09-17T03:04:26.133601+0000","last_peered":"2024-09-17T03:04:26.133601+0000","last_clean":"2024-09-17T03:04:26.133601+0000","last_became_active":"2024-09-17T03:04:24.420736+0000","last_became_peered":"2024-09-17T03:04:24.420736+0000","last_unstale":"2024-09-17T03:04:26.133601+0000","last_undegraded":"2024-09-17T03:04:26.133601+0000","last_fullsized":"2024-09-17T03:04:26.133601+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:20.813854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132563+0000","last_change":"2024-09-17T03:04:23.406462+0000","last_active":"2024-09-17T03:04:26.132563+0000","last_peered":"2024-09-17T03:04:26.132563+0000","last_clean":"2024-09-17T03:04:26.132563+0000","last_became_active":"2024-09-17T03:04:23.406189+0000","last_became_peered":"2024-09-17T03:04:23.406189+0000","last_unstale":"2024-09-17T03:04:26.132563+0000","last_undegraded":"2024-09-17T03:04:26.132563+0000","last_fullsized":"2024-09-17T03:04:26.132563+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:20.692326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132268+0000","last_change":"2024-09-17T03:04:24.416484+0000","last_active":"2024-09-17T03:04:26.132268+0000","last_peered":"2024-09-17T03:04:26.132268+0000","last_clean":"2024-09-17T03:04:26.132268+0000","last_became_active":"2024-09-17T03:04:24.416041+0000","last_became_peered":"2024-09-17T03:04:24.416041+0000","last_unstale":"2024-09-17T03:04:26.132268+0000","last_undegraded":"2024-09-17T03:04:26.132268+0000","last_fullsized":"2024-09-17T03:04:26.132268+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:59.400426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133164+0000","last_change":"2024-09-17T03:04:23.405097+0000","last_active":"2024-09-17T03:04:26.133164+0000","last_peered":"2024-09-17T03:04:26.133164+0000","last_clean":"2024-09-17T03:04:26.133164+0000","last_became_active":"2024-09-17T03:04:23.404789+0000","last_became_peered":"2024-09-17T03:04:23.404789+0000","last_unstale":"2024-09-17T03:04:26.133164+0000","last_undegraded":"2024-09-17T03:04:26.133164+0000","last_fullsized":"2024-09-17T03:04:26.133164+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:55.661161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133713+0000","last_change":"2024-09-17T03:04:24.417144+0000","last_active":"2024-09-17T03:04:26.133713+0000","last_peered":"2024-09-17T03:04:26.133713+0000","last_clean":"2024-09-17T03:04:26.133713+0000","last_became_active":"2024-09-17T03:04:24.416157+0000","last_became_peered":"2024-09-17T03:04:24.416157+0000","last_unstale":"2024-09-17T03:04:26.133713+0000","last_undegraded":"2024-09-17T03:04:26.133713+0000","last_fullsized":"2024-09-17T03:04:26.133713+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:49.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.135126+0000","last_change":"2024-09-17T03:04:23.403012+0000","last_active":"2024-09-17T03:04:26.135126+0000","last_peered":"2024-09-17T03:04:26.135126+0000","last_clean":"2024-09-17T03:04:26.135126+0000","last_became_active":"2024-09-17T03:04:23.402063+0000","last_became_peered":"2024-09-17T03:04:23.402063+0000","last_unstale":"2024-09-17T03:04:26.135126+0000","last_undegraded":"2024-09-17T03:04:26.135126+0000","last_fullsized":"2024-09-17T03:04:26.135126+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:19.319566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132476+0000","last_change":"2024-09-17T03:04:24.416649+0000","last_active":"2024-09-17T03:04:26.132476+0000","last_peered":"2024-09-17T03:04:26.132476+0000","last_clean":"2024-09-17T03:04:26.132476+0000","last_became_active":"2024-09-17T03:04:24.416355+0000","last_became_peered":"2024-09-17T03:04:24.416355+0000","last_unstale":"2024-09-17T03:04:26.132476+0000","last_undegraded":"2024-09-17T03:04:26.132476+0000","last_fullsized":"2024-09-17T03:04:26.132476+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:55.861068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.414809+0000","last_change":"2024-09-17T03:04:23.408376+0000","last_active":"2024-09-17T03:04:25.414809+0000","last_peered":"2024-09-17T03:04:25.414809+0000","last_clean":"2024-09-17T03:04:25.414809+0000","last_became_active":"2024-09-17T03:04:23.408014+0000","last_became_peered":"2024-09-17T03:04:23.408014+0000","last_unstale":"2024-09-17T03:04:25.414809+0000","last_undegraded":"2024-09-17T03:04:25.414809+0000","last_fullsized":"2024-09-17T03:04:25.414809+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:12.933779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134214+0000","last_change":"2024-09-17T03:04:24.422783+0000","last_active":"2024-09-17T03:04:26.134214+0000","last_peered":"2024-09-17T03:04:26.134214+0000","last_clean":"2024-09-17T03:04:26.134214+0000","last_became_active":"2024-09-17T03:04:24.421767+0000","last_became_peered":"2024-09-17T03:04:24.421767+0000","last_unstale":"2024-09-17T03:04:26.134214+0000","last_undegraded":"2024-09-17T03:04:26.134214+0000","last_fullsized":"2024-09-17T03:04:26.134214+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:23.409196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"168'2","reported_seq":17,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133998+0000","last_change":"2024-09-17T03:04:23.405684+0000","last_active":"2024-09-17T03:04:26.133998+0000","last_peered":"2024-09-17T03:04:26.133998+0000","last_clean":"2024-09-17T03:04:26.133998+0000","last_became_active":"2024-09-17T03:04:23.405108+0000","last_became_peered":"2024-09-17T03:04:23.405108+0000","last_unstale":"2024-09-17T03:04:26.133998+0000","last_undegraded":"2024-09-17T03:04:26.133998+0000","last_fullsized":"2024-09-17T03:04:26.133998+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.415098+0000","last_change":"2024-09-17T03:04:24.415464+0000","last_active":"2024-09-17T03:04:25.415098+0000","last_peered":"2024-09-17T03:04:25.415098+0000","last_clean":"2024-09-17T03:04:25.415098+0000","last_became_active":"2024-09-17T03:04:24.414326+0000","last_became_peered":"2024-09-17T03:04:24.414326+0000","last_unstale":"2024-09-17T03:04:25.415098+0000","last_undegraded":"2024-09-17T03:04:25.415098+0000","last_fullsized":"2024-09-17T03:04:25.415098+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:23.583633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"169'1","reported_seq":16,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.429902+0000","last_change":"2024-09-17T03:04:23.407980+0000","last_active":"2024-09-17T03:04:26.429902+0000","last_peered":"2024-09-17T03:04:26.429902+0000","last_clean":"2024-09-17T03:04:26.429902+0000","last_became_active":"2024-09-17T03:04:23.407699+0000","last_became_peered":"2024-09-17T03:04:23.407699+0000","last_unstale":"2024-09-17T03:04:26.429902+0000","last_undegraded":"2024-09-17T03:04:26.429902+0000","last_fullsized":"2024-09-17T03:04:26.429902+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:10.428617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.409017+0000","last_change":"2024-09-17T03:04:24.421354+0000","last_active":"2024-09-17T03:04:25.409017+0000","last_peered":"2024-09-17T03:04:25.409017+0000","last_clean":"2024-09-17T03:04:25.409017+0000","last_became_active":"2024-09-17T03:04:24.421075+0000","last_became_peered":"2024-09-17T03:04:24.421075+0000","last_unstale":"2024-09-17T03:04:25.409017+0000","last_undegraded":"2024-09-17T03:04:25.409017+0000","last_fullsized":"2024-09-17T03:04:25.409017+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:18.027423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412468+0000","last_change":"2024-09-17T03:04:23.403007+0000","last_active":"2024-09-17T03:04:25.412468+0000","last_peered":"2024-09-17T03:04:25.412468+0000","last_clean":"2024-09-17T03:04:25.412468+0000","last_became_active":"2024-09-17T03:04:23.402737+0000","last_became_peered":"2024-09-17T03:04:23.402737+0000","last_unstale":"2024-09-17T03:04:25.412468+0000","last_undegraded":"2024-09-17T03:04:25.412468+0000","last_fullsized":"2024-09-17T03:04:25.412468+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:17.344114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.412077+0000","last_change":"2024-09-17T03:04:24.420813+0000","last_active":"2024-09-17T03:04:25.412077+0000","last_peered":"2024-09-17T03:04:25.412077+0000","last_clean":"2024-09-17T03:04:25.412077+0000","last_became_active":"2024-09-17T03:04:24.419715+0000","last_became_peered":"2024-09-17T03:04:24.419715+0000","last_unstale":"2024-09-17T03:04:25.412077+0000","last_undegraded":"2024-09-17T03:04:25.412077+0000","last_fullsized":"2024-09-17T03:04:25.412077+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:27.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.411814+0000","last_change":"2024-09-17T03:04:23.405532+0000","last_active":"2024-09-17T03:04:25.411814+0000","last_peered":"2024-09-17T03:04:25.411814+0000","last_clean":"2024-09-17T03:04:25.411814+0000","last_became_active":"2024-09-17T03:04:23.405276+0000","last_became_peered":"2024-09-17T03:04:23.405276+0000","last_unstale":"2024-09-17T03:04:25.411814+0000","last_undegraded":"2024-09-17T03:04:25.411814+0000","last_fullsized":"2024-09-17T03:04:25.411814+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:31.107448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132800+0000","last_change":"2024-09-17T03:04:24.425704+0000","last_active":"2024-09-17T03:04:26.132800+0000","last_peered":"2024-09-17T03:04:26.132800+0000","last_clean":"2024-09-17T03:04:26.132800+0000","last_became_active":"2024-09-17T03:04:24.424897+0000","last_became_peered":"2024-09-17T03:04:24.424897+0000","last_unstale":"2024-09-17T03:04:26.132800+0000","last_undegraded":"2024-09-17T03:04:26.132800+0000","last_fullsized":"2024-09-17T03:04:26.132800+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:23.914312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.132460+0000","last_change":"2024-09-17T03:04:23.400492+0000","last_active":"2024-09-17T03:04:26.132460+0000","last_peered":"2024-09-17T03:04:26.132460+0000","last_clean":"2024-09-17T03:04:26.132460+0000","last_became_active":"2024-09-17T03:04:23.400226+0000","last_became_peered":"2024-09-17T03:04:23.400226+0000","last_unstale":"2024-09-17T03:04:26.132460+0000","last_undegraded":"2024-09-17T03:04:26.132460+0000","last_fullsized":"2024-09-17T03:04:26.132460+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:06.156766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133569+0000","last_change":"2024-09-17T03:04:24.422014+0000","last_active":"2024-09-17T03:04:26.133569+0000","last_peered":"2024-09-17T03:04:26.133569+0000","last_clean":"2024-09-17T03:04:26.133569+0000","last_became_active":"2024-09-17T03:04:24.421721+0000","last_became_peered":"2024-09-17T03:04:24.421721+0000","last_unstale":"2024-09-17T03:04:26.133569+0000","last_undegraded":"2024-09-17T03:04:26.133569+0000","last_fullsized":"2024-09-17T03:04:26.133569+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:27.481713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134064+0000","last_change":"2024-09-17T03:04:23.405372+0000","last_active":"2024-09-17T03:04:26.134064+0000","last_peered":"2024-09-17T03:04:26.134064+0000","last_clean":"2024-09-17T03:04:26.134064+0000","last_became_active":"2024-09-17T03:04:23.404722+0000","last_became_peered":"2024-09-17T03:04:23.404722+0000","last_unstale":"2024-09-17T03:04:26.134064+0000","last_undegraded":"2024-09-17T03:04:26.134064+0000","last_fullsized":"2024-09-17T03:04:26.134064+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:21.618164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133048+0000","last_change":"2024-09-17T03:04:24.418781+0000","last_active":"2024-09-17T03:04:26.133048+0000","last_peered":"2024-09-17T03:04:26.133048+0000","last_clean":"2024-09-17T03:04:26.133048+0000","last_became_active":"2024-09-17T03:04:24.418314+0000","last_became_peered":"2024-09-17T03:04:24.418314+0000","last_unstale":"2024-09-17T03:04:26.133048+0000","last_undegraded":"2024-09-17T03:04:26.133048+0000","last_fullsized":"2024-09-17T03:04:26.133048+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:11.040957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.415269+0000","last_change":"2024-09-17T03:04:23.410036+0000","last_active":"2024-09-17T03:04:25.415269+0000","last_peered":"2024-09-17T03:04:25.415269+0000","last_clean":"2024-09-17T03:04:25.415269+0000","last_became_active":"2024-09-17T03:04:23.409330+0000","last_became_peered":"2024-09-17T03:04:23.409330+0000","last_unstale":"2024-09-17T03:04:25.415269+0000","last_undegraded":"2024-09-17T03:04:25.415269+0000","last_fullsized":"2024-09-17T03:04:25.415269+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:39.246159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.134355+0000","last_change":"2024-09-17T03:04:24.422449+0000","last_active":"2024-09-17T03:04:26.134355+0000","last_peered":"2024-09-17T03:04:26.134355+0000","last_clean":"2024-09-17T03:04:26.134355+0000","last_became_active":"2024-09-17T03:04:24.421423+0000","last_became_peered":"2024-09-17T03:04:24.421423+0000","last_unstale":"2024-09-17T03:04:26.134355+0000","last_undegraded":"2024-09-17T03:04:26.134355+0000","last_fullsized":"2024-09-17T03:04:26.134355+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:13.978168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.408977+0000","last_change":"2024-09-17T03:04:23.406229+0000","last_active":"2024-09-17T03:04:25.408977+0000","last_peered":"2024-09-17T03:04:25.408977+0000","last_clean":"2024-09-17T03:04:25.408977+0000","last_became_active":"2024-09-17T03:04:23.405816+0000","last_became_peered":"2024-09-17T03:04:23.405816+0000","last_unstale":"2024-09-17T03:04:25.408977+0000","last_undegraded":"2024-09-17T03:04:25.408977+0000","last_fullsized":"2024-09-17T03:04:25.408977+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:44.882009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.131978+0000","last_change":"2024-09-17T03:04:24.416436+0000","last_active":"2024-09-17T03:04:26.131978+0000","last_peered":"2024-09-17T03:04:26.131978+0000","last_clean":"2024-09-17T03:04:26.131978+0000","last_became_active":"2024-09-17T03:04:24.416160+0000","last_became_peered":"2024-09-17T03:04:24.416160+0000","last_unstale":"2024-09-17T03:04:26.131978+0000","last_undegraded":"2024-09-17T03:04:26.131978+0000","last_fullsized":"2024-09-17T03:04:26.131978+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:16.719187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"168'3","reported_seq":18,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:25.415162+0000","last_change":"2024-09-17T03:04:23.409678+0000","last_active":"2024-09-17T03:04:25.415162+0000","last_peered":"2024-09-17T03:04:25.415162+0000","last_clean":"2024-09-17T03:04:25.415162+0000","last_became_active":"2024-09-17T03:04:23.408838+0000","last_became_peered":"2024-09-17T03:04:23.408838+0000","last_unstale":"2024-09-17T03:04:25.415162+0000","last_undegraded":"2024-09-17T03:04:25.415162+0000","last_fullsized":"2024-09-17T03:04:25.415162+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:38.808023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":405,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-17T03:04:26.133224+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:04:26.133224+0000","last_peered":"2024-09-17T03:04:26.133224+0000","last_clean":"2024-09-17T03:04:26.133224+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:04:26.133224+0000","last_undegraded":"2024-09-17T03:04:26.133224+0000","last_fullsized":"2024-09-17T03:04:26.133224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1493,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193818,"statfs":{"total":200000000,"available":198470588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055162,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":916,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194396,"statfs":{"total":200000000,"available":199061586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199055218,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":918,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194394,"statfs":{"total":200000000,"available":199059926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":923,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194389,"statfs":{"total":200000000,"available":199054726,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1494,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193817,"statfs":{"total":200000000,"available":198469594,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:04:31.877 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:04:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.006+0000 7ff33d6b4640 1 -- 172.21.15.104:0/1499204836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33815fb40 msgr2=0x7ff338161380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.006+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/1499204836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33815fb40 0x7ff338161380 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff330005fd0 tx=0x7ff33002a820 comp rx=0 tx=0).stop 2024-09-17T03:04:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.006+0000 7ff33d6b4640 1 -- 172.21.15.104:0/1499204836 shutdown_connections 2024-09-17T03:04:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.006+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/1499204836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33815fb40 0x7ff338161380 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.006+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/1499204836 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff33815f1f0 0x7ff33815f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.006+0000 7ff33d6b4640 1 -- 172.21.15.104:0/1499204836 >> 172.21.15.104:0/1499204836 conn(0x7ff338069120 msgr2=0x7ff338069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.006+0000 7ff33d6b4640 1 -- 172.21.15.104:0/1499204836 shutdown_connections 2024-09-17T03:04:32.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.006+0000 7ff33d6b4640 1 -- 172.21.15.104:0/1499204836 wait complete. 2024-09-17T03:04:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.008+0000 7ff33d6b4640 1 Processor -- start 2024-09-17T03:04:32.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.008+0000 7ff33d6b4640 1 -- start start 2024-09-17T03:04:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.009+0000 7ff33d6b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3380b65e0 0x7ff3381f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.009+0000 7ff33d6b4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff33815f1f0 0x7ff3381f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.009+0000 7ff33d6b4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33815fb40 0x7ff3381f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.009+0000 7ff33d6b4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff338161d10 con 0x7ff3380b65e0 2024-09-17T03:04:32.009 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.009+0000 7ff33d6b4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff338161b90 con 0x7ff33815fb40 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.009+0000 7ff33d6b4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff338161e90 con 0x7ff33815f1f0 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.009+0000 7ff336ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3380b65e0 0x7ff3381f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff336ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3380b65e0 0x7ff3381f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51626/0 (socket says 172.21.15.104:51626) 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff336ffd640 1 -- 172.21.15.104:0/3406078144 learned_addr learned my addr 172.21.15.104:0/3406078144 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff3367fc640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff33815f1f0 0x7ff3381f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff3377fe640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33815fb40 0x7ff3381f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff336ffd640 1 -- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff33815f1f0 msgr2=0x7ff3381f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff336ffd640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff33815f1f0 0x7ff3381f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff336ffd640 1 -- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33815fb40 msgr2=0x7ff3381f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.010 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff336ffd640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33815fb40 0x7ff3381f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff336ffd640 1 -- 172.21.15.104:0/3406078144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3381f9b20 con 0x7ff3380b65e0 2024-09-17T03:04:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff336ffd640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3380b65e0 0x7ff3381f35e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c370 tx=0x7ff32800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff31f7fe640 1 -- 172.21.15.104:0/3406078144 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328017070 con 0x7ff3380b65e0 2024-09-17T03:04:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff31f7fe640 1 -- 172.21.15.104:0/3406078144 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3280053c0 con 0x7ff3380b65e0 2024-09-17T03:04:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3381fa030 con 0x7ff3380b65e0 2024-09-17T03:04:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff31f7fe640 1 -- 172.21.15.104:0/3406078144 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328003850 con 0x7ff3380b65e0 2024-09-17T03:04:32.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.010+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3381f61e0 con 0x7ff3380b65e0 2024-09-17T03:04:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.012+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff338162340 con 0x7ff3380b65e0 2024-09-17T03:04:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.012+0000 7ff31f7fe640 1 -- 172.21.15.104:0/3406078144 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff32801a070 con 0x7ff3380b65e0 2024-09-17T03:04:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.012+0000 7ff31f7fe640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff324078bc0 0x7ff32407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.013+0000 7ff31f7fe640 1 -- 172.21.15.104:0/3406078144 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7ff328099f50 con 0x7ff3380b65e0 2024-09-17T03:04:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.013+0000 7ff3367fc640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff324078bc0 0x7ff32407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.012 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.013+0000 7ff3367fc640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff324078bc0 0x7ff32407b0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0096c0 tx=0x7ff32c009260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:32.015 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.017+0000 7ff31f7fe640 1 -- 172.21.15.104:0/3406078144 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff328061db0 con 0x7ff3380b65e0 2024-09-17T03:04:32.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.189+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3381fa550 con 0x7ff324078bc0 2024-09-17T03:04:32.192 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.194+0000 7ff31f7fe640 1 -- 172.21.15.104:0/3406078144 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247982 (secure 0 0 0) 0x7ff32c00e460 con 0x7ff324078bc0 2024-09-17T03:04:32.195 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:32.196 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff324078bc0 msgr2=0x7ff32407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff324078bc0 0x7ff32407b0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0096c0 tx=0x7ff32c009260 comp rx=0 tx=0).stop 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3380b65e0 msgr2=0x7ff3381f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3380b65e0 0x7ff3381f35e0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c370 tx=0x7ff32800c830 comp rx=0 tx=0).stop 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 shutdown_connections 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff324078bc0 0x7ff32407b0d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33815fb40 0x7ff3381f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff33815f1f0 0x7ff3381f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.198 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 --2- 172.21.15.104:0/3406078144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3380b65e0 0x7ff3381f35e0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 >> 172.21.15.104:0/3406078144 conn(0x7ff338069120 msgr2=0x7ff338162a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:32.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 shutdown_connections 2024-09-17T03:04:32.199 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.197+0000 7ff33d6b4640 1 -- 172.21.15.104:0/3406078144 wait complete. 2024-09-17T03:04:32.207 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2024-09-17T03:04:31.775845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":195,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8619,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553880,"statfs":{"total":1600000000,"available":1591173496,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.364796"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127815+0000","last_change":"2024-09-17T03:04:24.424404+0000","last_active":"2024-09-17T03:04:31.127815+0000","last_peered":"2024-09-17T03:04:31.127815+0000","last_clean":"2024-09-17T03:04:31.127815+0000","last_became_active":"2024-09-17T03:04:24.423621+0000","last_became_peered":"2024-09-17T03:04:24.423621+0000","last_unstale":"2024-09-17T03:04:31.127815+0000","last_undegraded":"2024-09-17T03:04:31.127815+0000","last_fullsized":"2024-09-17T03:04:31.127815+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:57.270527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472253+0000","last_change":"2024-09-17T03:04:24.419070+0000","last_active":"2024-09-17T03:04:30.472253+0000","last_peered":"2024-09-17T03:04:30.472253+0000","last_clean":"2024-09-17T03:04:30.472253+0000","last_became_active":"2024-09-17T03:04:24.418821+0000","last_became_peered":"2024-09-17T03:04:24.418821+0000","last_unstale":"2024-09-17T03:04:30.472253+0000","last_undegraded":"2024-09-17T03:04:30.472253+0000","last_fullsized":"2024-09-17T03:04:30.472253+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:36.898930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.474941+0000","last_change":"2024-09-17T03:04:24.423980+0000","last_active":"2024-09-17T03:04:30.474941+0000","last_peered":"2024-09-17T03:04:30.474941+0000","last_clean":"2024-09-17T03:04:30.474941+0000","last_became_active":"2024-09-17T03:04:24.423329+0000","last_became_peered":"2024-09-17T03:04:24.423329+0000","last_unstale":"2024-09-17T03:04:30.474941+0000","last_undegraded":"2024-09-17T03:04:30.474941+0000","last_fullsized":"2024-09-17T03:04:30.474941+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:59.379922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.495967+0000","last_change":"2024-09-17T03:04:24.412087+0000","last_active":"2024-09-17T03:04:30.495967+0000","last_peered":"2024-09-17T03:04:30.495967+0000","last_clean":"2024-09-17T03:04:30.495967+0000","last_became_active":"2024-09-17T03:04:24.411805+0000","last_became_peered":"2024-09-17T03:04:24.411805+0000","last_unstale":"2024-09-17T03:04:30.495967+0000","last_undegraded":"2024-09-17T03:04:30.495967+0000","last_fullsized":"2024-09-17T03:04:30.495967+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:39.359002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.474773+0000","last_change":"2024-09-17T03:04:24.424130+0000","last_active":"2024-09-17T03:04:30.474773+0000","last_peered":"2024-09-17T03:04:30.474773+0000","last_clean":"2024-09-17T03:04:30.474773+0000","last_became_active":"2024-09-17T03:04:24.423728+0000","last_became_peered":"2024-09-17T03:04:24.423728+0000","last_unstale":"2024-09-17T03:04:30.474773+0000","last_undegraded":"2024-09-17T03:04:30.474773+0000","last_fullsized":"2024-09-17T03:04:30.474773+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:53.341727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127625+0000","last_change":"2024-09-17T03:04:24.423916+0000","last_active":"2024-09-17T03:04:31.127625+0000","last_peered":"2024-09-17T03:04:31.127625+0000","last_clean":"2024-09-17T03:04:31.127625+0000","last_became_active":"2024-09-17T03:04:24.422984+0000","last_became_peered":"2024-09-17T03:04:24.422984+0000","last_unstale":"2024-09-17T03:04:31.127625+0000","last_undegraded":"2024-09-17T03:04:31.127625+0000","last_fullsized":"2024-09-17T03:04:31.127625+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:38.094596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":23,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.477551+0000","last_change":"2024-09-17T03:04:30.477465+0000","last_active":"2024-09-17T03:04:30.477551+0000","last_peered":"2024-09-17T03:04:30.477551+0000","last_clean":"2024-09-17T03:04:30.477551+0000","last_became_active":"2024-09-17T03:04:30.477201+0000","last_became_peered":"2024-09-17T03:04:30.477201+0000","last_unstale":"2024-09-17T03:04:30.477551+0000","last_undegraded":"2024-09-17T03:04:30.477551+0000","last_fullsized":"2024-09-17T03:04:30.477551+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:33.750052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.126694+0000","last_change":"2024-09-17T03:04:24.422122+0000","last_active":"2024-09-17T03:04:31.126694+0000","last_peered":"2024-09-17T03:04:31.126694+0000","last_clean":"2024-09-17T03:04:31.126694+0000","last_became_active":"2024-09-17T03:04:24.421881+0000","last_became_peered":"2024-09-17T03:04:24.421881+0000","last_unstale":"2024-09-17T03:04:31.126694+0000","last_undegraded":"2024-09-17T03:04:31.126694+0000","last_fullsized":"2024-09-17T03:04:31.126694+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:02.050650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472152+0000","last_change":"2024-09-17T03:04:24.422782+0000","last_active":"2024-09-17T03:04:30.472152+0000","last_peered":"2024-09-17T03:04:30.472152+0000","last_clean":"2024-09-17T03:04:30.472152+0000","last_became_active":"2024-09-17T03:04:24.422428+0000","last_became_peered":"2024-09-17T03:04:24.422428+0000","last_unstale":"2024-09-17T03:04:30.472152+0000","last_undegraded":"2024-09-17T03:04:30.472152+0000","last_fullsized":"2024-09-17T03:04:30.472152+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:48.972527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127371+0000","last_change":"2024-09-17T03:04:24.422209+0000","last_active":"2024-09-17T03:04:31.127371+0000","last_peered":"2024-09-17T03:04:31.127371+0000","last_clean":"2024-09-17T03:04:31.127371+0000","last_became_active":"2024-09-17T03:04:24.421648+0000","last_became_peered":"2024-09-17T03:04:24.421648+0000","last_unstale":"2024-09-17T03:04:31.127371+0000","last_undegraded":"2024-09-17T03:04:31.127371+0000","last_fullsized":"2024-09-17T03:04:31.127371+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:55.096806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127046+0000","last_change":"2024-09-17T03:04:24.425051+0000","last_active":"2024-09-17T03:04:31.127046+0000","last_peered":"2024-09-17T03:04:31.127046+0000","last_clean":"2024-09-17T03:04:31.127046+0000","last_became_active":"2024-09-17T03:04:24.424740+0000","last_became_peered":"2024-09-17T03:04:24.424740+0000","last_unstale":"2024-09-17T03:04:31.127046+0000","last_undegraded":"2024-09-17T03:04:31.127046+0000","last_fullsized":"2024-09-17T03:04:31.127046+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:31.412397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127154+0000","last_change":"2024-09-17T03:04:24.421011+0000","last_active":"2024-09-17T03:04:31.127154+0000","last_peered":"2024-09-17T03:04:31.127154+0000","last_clean":"2024-09-17T03:04:31.127154+0000","last_became_active":"2024-09-17T03:04:24.420749+0000","last_became_peered":"2024-09-17T03:04:24.420749+0000","last_unstale":"2024-09-17T03:04:31.127154+0000","last_undegraded":"2024-09-17T03:04:31.127154+0000","last_fullsized":"2024-09-17T03:04:31.127154+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:52.306592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475305+0000","last_change":"2024-09-17T03:04:24.425501+0000","last_active":"2024-09-17T03:04:30.475305+0000","last_peered":"2024-09-17T03:04:30.475305+0000","last_clean":"2024-09-17T03:04:30.475305+0000","last_became_active":"2024-09-17T03:04:24.425224+0000","last_became_peered":"2024-09-17T03:04:24.425224+0000","last_unstale":"2024-09-17T03:04:30.475305+0000","last_undegraded":"2024-09-17T03:04:30.475305+0000","last_fullsized":"2024-09-17T03:04:30.475305+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:26.085307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496039+0000","last_change":"2024-09-17T03:04:24.422071+0000","last_active":"2024-09-17T03:04:30.496039+0000","last_peered":"2024-09-17T03:04:30.496039+0000","last_clean":"2024-09-17T03:04:30.496039+0000","last_became_active":"2024-09-17T03:04:24.421761+0000","last_became_peered":"2024-09-17T03:04:24.421761+0000","last_unstale":"2024-09-17T03:04:30.496039+0000","last_undegraded":"2024-09-17T03:04:30.496039+0000","last_fullsized":"2024-09-17T03:04:30.496039+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:29.347905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127617+0000","last_change":"2024-09-17T03:04:24.415480+0000","last_active":"2024-09-17T03:04:31.127617+0000","last_peered":"2024-09-17T03:04:31.127617+0000","last_clean":"2024-09-17T03:04:31.127617+0000","last_became_active":"2024-09-17T03:04:24.415216+0000","last_became_peered":"2024-09-17T03:04:24.415216+0000","last_unstale":"2024-09-17T03:04:31.127617+0000","last_undegraded":"2024-09-17T03:04:31.127617+0000","last_fullsized":"2024-09-17T03:04:31.127617+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:34.006358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127097+0000","last_change":"2024-09-17T03:04:24.422067+0000","last_active":"2024-09-17T03:04:31.127097+0000","last_peered":"2024-09-17T03:04:31.127097+0000","last_clean":"2024-09-17T03:04:31.127097+0000","last_became_active":"2024-09-17T03:04:24.421757+0000","last_became_peered":"2024-09-17T03:04:24.421757+0000","last_unstale":"2024-09-17T03:04:31.127097+0000","last_undegraded":"2024-09-17T03:04:31.127097+0000","last_fullsized":"2024-09-17T03:04:31.127097+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:25.328043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127538+0000","last_change":"2024-09-17T03:04:24.419677+0000","last_active":"2024-09-17T03:04:31.127538+0000","last_peered":"2024-09-17T03:04:31.127538+0000","last_clean":"2024-09-17T03:04:31.127538+0000","last_became_active":"2024-09-17T03:04:24.417219+0000","last_became_peered":"2024-09-17T03:04:24.417219+0000","last_unstale":"2024-09-17T03:04:31.127538+0000","last_undegraded":"2024-09-17T03:04:31.127538+0000","last_fullsized":"2024-09-17T03:04:31.127538+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:33.944210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.474805+0000","last_change":"2024-09-17T03:04:24.424628+0000","last_active":"2024-09-17T03:04:30.474805+0000","last_peered":"2024-09-17T03:04:30.474805+0000","last_clean":"2024-09-17T03:04:30.474805+0000","last_became_active":"2024-09-17T03:04:24.423689+0000","last_became_peered":"2024-09-17T03:04:24.423689+0000","last_unstale":"2024-09-17T03:04:30.474805+0000","last_undegraded":"2024-09-17T03:04:30.474805+0000","last_fullsized":"2024-09-17T03:04:30.474805+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:27.667019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127039+0000","last_change":"2024-09-17T03:04:24.420105+0000","last_active":"2024-09-17T03:04:31.127039+0000","last_peered":"2024-09-17T03:04:31.127039+0000","last_clean":"2024-09-17T03:04:31.127039+0000","last_became_active":"2024-09-17T03:04:24.419373+0000","last_became_peered":"2024-09-17T03:04:24.419373+0000","last_unstale":"2024-09-17T03:04:31.127039+0000","last_undegraded":"2024-09-17T03:04:31.127039+0000","last_fullsized":"2024-09-17T03:04:31.127039+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:23.069825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127255+0000","last_change":"2024-09-17T03:04:24.418218+0000","last_active":"2024-09-17T03:04:31.127255+0000","last_peered":"2024-09-17T03:04:31.127255+0000","last_clean":"2024-09-17T03:04:31.127255+0000","last_became_active":"2024-09-17T03:04:24.417798+0000","last_became_peered":"2024-09-17T03:04:24.417798+0000","last_unstale":"2024-09-17T03:04:31.127255+0000","last_undegraded":"2024-09-17T03:04:31.127255+0000","last_fullsized":"2024-09-17T03:04:31.127255+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:15.532829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127289+0000","last_change":"2024-09-17T03:04:24.420180+0000","last_active":"2024-09-17T03:04:31.127289+0000","last_peered":"2024-09-17T03:04:31.127289+0000","last_clean":"2024-09-17T03:04:31.127289+0000","last_became_active":"2024-09-17T03:04:24.419907+0000","last_became_peered":"2024-09-17T03:04:24.419907+0000","last_unstale":"2024-09-17T03:04:31.127289+0000","last_undegraded":"2024-09-17T03:04:31.127289+0000","last_fullsized":"2024-09-17T03:04:31.127289+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:51.973808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496312+0000","last_change":"2024-09-17T03:04:24.424058+0000","last_active":"2024-09-17T03:04:30.496312+0000","last_peered":"2024-09-17T03:04:30.496312+0000","last_clean":"2024-09-17T03:04:30.496312+0000","last_became_active":"2024-09-17T03:04:24.423542+0000","last_became_peered":"2024-09-17T03:04:24.423542+0000","last_unstale":"2024-09-17T03:04:30.496312+0000","last_undegraded":"2024-09-17T03:04:30.496312+0000","last_fullsized":"2024-09-17T03:04:30.496312+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:19.128972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.495824+0000","last_change":"2024-09-17T03:04:24.415626+0000","last_active":"2024-09-17T03:04:30.495824+0000","last_peered":"2024-09-17T03:04:30.495824+0000","last_clean":"2024-09-17T03:04:30.495824+0000","last_became_active":"2024-09-17T03:04:24.415310+0000","last_became_peered":"2024-09-17T03:04:24.415310+0000","last_unstale":"2024-09-17T03:04:30.495824+0000","last_undegraded":"2024-09-17T03:04:30.495824+0000","last_fullsized":"2024-09-17T03:04:30.495824+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:08.559361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127244+0000","last_change":"2024-09-17T03:04:24.421934+0000","last_active":"2024-09-17T03:04:31.127244+0000","last_peered":"2024-09-17T03:04:31.127244+0000","last_clean":"2024-09-17T03:04:31.127244+0000","last_became_active":"2024-09-17T03:04:24.420872+0000","last_became_peered":"2024-09-17T03:04:24.420872+0000","last_unstale":"2024-09-17T03:04:31.127244+0000","last_undegraded":"2024-09-17T03:04:31.127244+0000","last_fullsized":"2024-09-17T03:04:31.127244+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:24.270401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127464+0000","last_change":"2024-09-17T03:04:24.420002+0000","last_active":"2024-09-17T03:04:31.127464+0000","last_peered":"2024-09-17T03:04:31.127464+0000","last_clean":"2024-09-17T03:04:31.127464+0000","last_became_active":"2024-09-17T03:04:24.419738+0000","last_became_peered":"2024-09-17T03:04:24.419738+0000","last_unstale":"2024-09-17T03:04:31.127464+0000","last_undegraded":"2024-09-17T03:04:31.127464+0000","last_fullsized":"2024-09-17T03:04:31.127464+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.827144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127190+0000","last_change":"2024-09-17T03:04:24.420736+0000","last_active":"2024-09-17T03:04:31.127190+0000","last_peered":"2024-09-17T03:04:31.127190+0000","last_clean":"2024-09-17T03:04:31.127190+0000","last_became_active":"2024-09-17T03:04:24.419991+0000","last_became_peered":"2024-09-17T03:04:24.419991+0000","last_unstale":"2024-09-17T03:04:31.127190+0000","last_undegraded":"2024-09-17T03:04:31.127190+0000","last_fullsized":"2024-09-17T03:04:31.127190+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:19.768571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127353+0000","last_change":"2024-09-17T03:04:24.418786+0000","last_active":"2024-09-17T03:04:31.127353+0000","last_peered":"2024-09-17T03:04:31.127353+0000","last_clean":"2024-09-17T03:04:31.127353+0000","last_became_active":"2024-09-17T03:04:24.418533+0000","last_became_peered":"2024-09-17T03:04:24.418533+0000","last_unstale":"2024-09-17T03:04:31.127353+0000","last_undegraded":"2024-09-17T03:04:31.127353+0000","last_fullsized":"2024-09-17T03:04:31.127353+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.689329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475665+0000","last_change":"2024-09-17T03:04:24.427930+0000","last_active":"2024-09-17T03:04:30.475665+0000","last_peered":"2024-09-17T03:04:30.475665+0000","last_clean":"2024-09-17T03:04:30.475665+0000","last_became_active":"2024-09-17T03:04:24.427669+0000","last_became_peered":"2024-09-17T03:04:24.427669+0000","last_unstale":"2024-09-17T03:04:30.475665+0000","last_undegraded":"2024-09-17T03:04:30.475665+0000","last_fullsized":"2024-09-17T03:04:30.475665+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:19.143645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.126829+0000","last_change":"2024-09-17T03:04:24.424198+0000","last_active":"2024-09-17T03:04:31.126829+0000","last_peered":"2024-09-17T03:04:31.126829+0000","last_clean":"2024-09-17T03:04:31.126829+0000","last_became_active":"2024-09-17T03:04:24.423787+0000","last_became_peered":"2024-09-17T03:04:24.423787+0000","last_unstale":"2024-09-17T03:04:31.126829+0000","last_undegraded":"2024-09-17T03:04:31.126829+0000","last_fullsized":"2024-09-17T03:04:31.126829+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:07.641031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496050+0000","last_change":"2024-09-17T03:04:24.420152+0000","last_active":"2024-09-17T03:04:30.496050+0000","last_peered":"2024-09-17T03:04:30.496050+0000","last_clean":"2024-09-17T03:04:30.496050+0000","last_became_active":"2024-09-17T03:04:24.419874+0000","last_became_peered":"2024-09-17T03:04:24.419874+0000","last_unstale":"2024-09-17T03:04:30.496050+0000","last_undegraded":"2024-09-17T03:04:30.496050+0000","last_fullsized":"2024-09-17T03:04:30.496050+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:11.281845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472526+0000","last_change":"2024-09-17T03:04:24.423430+0000","last_active":"2024-09-17T03:04:30.472526+0000","last_peered":"2024-09-17T03:04:30.472526+0000","last_clean":"2024-09-17T03:04:30.472526+0000","last_became_active":"2024-09-17T03:04:24.423148+0000","last_became_peered":"2024-09-17T03:04:24.423148+0000","last_unstale":"2024-09-17T03:04:30.472526+0000","last_undegraded":"2024-09-17T03:04:30.472526+0000","last_fullsized":"2024-09-17T03:04:30.472526+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:30.918947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127437+0000","last_change":"2024-09-17T03:04:24.426022+0000","last_active":"2024-09-17T03:04:31.127437+0000","last_peered":"2024-09-17T03:04:31.127437+0000","last_clean":"2024-09-17T03:04:31.127437+0000","last_became_active":"2024-09-17T03:04:24.425317+0000","last_became_peered":"2024-09-17T03:04:24.425317+0000","last_unstale":"2024-09-17T03:04:31.127437+0000","last_undegraded":"2024-09-17T03:04:31.127437+0000","last_fullsized":"2024-09-17T03:04:31.127437+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:27.150520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127392+0000","last_change":"2024-09-17T03:04:24.426284+0000","last_active":"2024-09-17T03:04:31.127392+0000","last_peered":"2024-09-17T03:04:31.127392+0000","last_clean":"2024-09-17T03:04:31.127392+0000","last_became_active":"2024-09-17T03:04:24.425201+0000","last_became_peered":"2024-09-17T03:04:24.425201+0000","last_unstale":"2024-09-17T03:04:31.127392+0000","last_undegraded":"2024-09-17T03:04:31.127392+0000","last_fullsized":"2024-09-17T03:04:31.127392+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:50.201347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"168'4","reported_seq":22,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127679+0000","last_change":"2024-09-17T03:04:23.402488+0000","last_active":"2024-09-17T03:04:31.127679+0000","last_peered":"2024-09-17T03:04:31.127679+0000","last_clean":"2024-09-17T03:04:31.127679+0000","last_became_active":"2024-09-17T03:04:23.402230+0000","last_became_peered":"2024-09-17T03:04:23.402230+0000","last_unstale":"2024-09-17T03:04:31.127679+0000","last_undegraded":"2024-09-17T03:04:31.127679+0000","last_fullsized":"2024-09-17T03:04:31.127679+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:51.910409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472449+0000","last_change":"2024-09-17T03:04:24.421888+0000","last_active":"2024-09-17T03:04:30.472449+0000","last_peered":"2024-09-17T03:04:30.472449+0000","last_clean":"2024-09-17T03:04:30.472449+0000","last_became_active":"2024-09-17T03:04:24.421619+0000","last_became_peered":"2024-09-17T03:04:24.421619+0000","last_unstale":"2024-09-17T03:04:30.472449+0000","last_undegraded":"2024-09-17T03:04:30.472449+0000","last_fullsized":"2024-09-17T03:04:30.472449+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:01.313308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"168'1","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472314+0000","last_change":"2024-09-17T03:04:23.405422+0000","last_active":"2024-09-17T03:04:30.472314+0000","last_peered":"2024-09-17T03:04:30.472314+0000","last_clean":"2024-09-17T03:04:30.472314+0000","last_became_active":"2024-09-17T03:04:23.404768+0000","last_became_peered":"2024-09-17T03:04:23.404768+0000","last_unstale":"2024-09-17T03:04:30.472314+0000","last_undegraded":"2024-09-17T03:04:30.472314+0000","last_fullsized":"2024-09-17T03:04:30.472314+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:48.514407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127306+0000","last_change":"2024-09-17T03:04:24.421122+0000","last_active":"2024-09-17T03:04:31.127306+0000","last_peered":"2024-09-17T03:04:31.127306+0000","last_clean":"2024-09-17T03:04:31.127306+0000","last_became_active":"2024-09-17T03:04:24.420345+0000","last_became_peered":"2024-09-17T03:04:24.420345+0000","last_unstale":"2024-09-17T03:04:31.127306+0000","last_undegraded":"2024-09-17T03:04:31.127306+0000","last_fullsized":"2024-09-17T03:04:31.127306+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:24.330998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"168'2","reported_seq":21,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496228+0000","last_change":"2024-09-17T03:04:23.398221+0000","last_active":"2024-09-17T03:04:30.496228+0000","last_peered":"2024-09-17T03:04:30.496228+0000","last_clean":"2024-09-17T03:04:30.496228+0000","last_became_active":"2024-09-17T03:04:23.397953+0000","last_became_peered":"2024-09-17T03:04:23.397953+0000","last_unstale":"2024-09-17T03:04:30.496228+0000","last_undegraded":"2024-09-17T03:04:30.496228+0000","last_fullsized":"2024-09-17T03:04:30.496228+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:23.588498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127804+0000","last_change":"2024-09-17T03:04:24.425884+0000","last_active":"2024-09-17T03:04:31.127804+0000","last_peered":"2024-09-17T03:04:31.127804+0000","last_clean":"2024-09-17T03:04:31.127804+0000","last_became_active":"2024-09-17T03:04:24.425137+0000","last_became_peered":"2024-09-17T03:04:24.425137+0000","last_unstale":"2024-09-17T03:04:31.127804+0000","last_undegraded":"2024-09-17T03:04:31.127804+0000","last_fullsized":"2024-09-17T03:04:31.127804+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:54.332183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"168'2","reported_seq":21,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496227+0000","last_change":"2024-09-17T03:04:23.404326+0000","last_active":"2024-09-17T03:04:30.496227+0000","last_peered":"2024-09-17T03:04:30.496227+0000","last_clean":"2024-09-17T03:04:30.496227+0000","last_became_active":"2024-09-17T03:04:23.404033+0000","last_became_peered":"2024-09-17T03:04:23.404033+0000","last_unstale":"2024-09-17T03:04:30.496227+0000","last_undegraded":"2024-09-17T03:04:30.496227+0000","last_fullsized":"2024-09-17T03:04:30.496227+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:19.464963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472575+0000","last_change":"2024-09-17T03:04:24.428412+0000","last_active":"2024-09-17T03:04:30.472575+0000","last_peered":"2024-09-17T03:04:30.472575+0000","last_clean":"2024-09-17T03:04:30.472575+0000","last_became_active":"2024-09-17T03:04:24.427997+0000","last_became_peered":"2024-09-17T03:04:24.427997+0000","last_unstale":"2024-09-17T03:04:30.472575+0000","last_undegraded":"2024-09-17T03:04:30.472575+0000","last_fullsized":"2024-09-17T03:04:30.472575+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:16.646137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"168'1","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127634+0000","last_change":"2024-09-17T03:04:23.403431+0000","last_active":"2024-09-17T03:04:31.127634+0000","last_peered":"2024-09-17T03:04:31.127634+0000","last_clean":"2024-09-17T03:04:31.127634+0000","last_became_active":"2024-09-17T03:04:23.403177+0000","last_became_peered":"2024-09-17T03:04:23.403177+0000","last_unstale":"2024-09-17T03:04:31.127634+0000","last_undegraded":"2024-09-17T03:04:31.127634+0000","last_fullsized":"2024-09-17T03:04:31.127634+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:19.148473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496379+0000","last_change":"2024-09-17T03:04:24.411490+0000","last_active":"2024-09-17T03:04:30.496379+0000","last_peered":"2024-09-17T03:04:30.496379+0000","last_clean":"2024-09-17T03:04:30.496379+0000","last_became_active":"2024-09-17T03:04:24.411181+0000","last_became_peered":"2024-09-17T03:04:24.411181+0000","last_unstale":"2024-09-17T03:04:30.496379+0000","last_undegraded":"2024-09-17T03:04:30.496379+0000","last_fullsized":"2024-09-17T03:04:30.496379+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:17.493410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"168'1","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475948+0000","last_change":"2024-09-17T03:04:23.404967+0000","last_active":"2024-09-17T03:04:30.475948+0000","last_peered":"2024-09-17T03:04:30.475948+0000","last_clean":"2024-09-17T03:04:30.475948+0000","last_became_active":"2024-09-17T03:04:23.404703+0000","last_became_peered":"2024-09-17T03:04:23.404703+0000","last_unstale":"2024-09-17T03:04:30.475948+0000","last_undegraded":"2024-09-17T03:04:30.475948+0000","last_fullsized":"2024-09-17T03:04:30.475948+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:10.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.473118+0000","last_change":"2024-09-17T03:04:24.425828+0000","last_active":"2024-09-17T03:04:30.473118+0000","last_peered":"2024-09-17T03:04:30.473118+0000","last_clean":"2024-09-17T03:04:30.473118+0000","last_became_active":"2024-09-17T03:04:24.425539+0000","last_became_peered":"2024-09-17T03:04:24.425539+0000","last_unstale":"2024-09-17T03:04:30.473118+0000","last_undegraded":"2024-09-17T03:04:30.473118+0000","last_fullsized":"2024-09-17T03:04:30.473118+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:23.548937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127114+0000","last_change":"2024-09-17T03:04:23.405787+0000","last_active":"2024-09-17T03:04:31.127114+0000","last_peered":"2024-09-17T03:04:31.127114+0000","last_clean":"2024-09-17T03:04:31.127114+0000","last_became_active":"2024-09-17T03:04:23.405355+0000","last_became_peered":"2024-09-17T03:04:23.405355+0000","last_unstale":"2024-09-17T03:04:31.127114+0000","last_undegraded":"2024-09-17T03:04:31.127114+0000","last_fullsized":"2024-09-17T03:04:31.127114+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:03.938063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.474898+0000","last_change":"2024-09-17T03:04:24.418739+0000","last_active":"2024-09-17T03:04:30.474898+0000","last_peered":"2024-09-17T03:04:30.474898+0000","last_clean":"2024-09-17T03:04:30.474898+0000","last_became_active":"2024-09-17T03:04:24.418451+0000","last_became_peered":"2024-09-17T03:04:24.418451+0000","last_unstale":"2024-09-17T03:04:30.474898+0000","last_undegraded":"2024-09-17T03:04:30.474898+0000","last_fullsized":"2024-09-17T03:04:30.474898+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:20:10.171015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496349+0000","last_change":"2024-09-17T03:04:23.400231+0000","last_active":"2024-09-17T03:04:30.496349+0000","last_peered":"2024-09-17T03:04:30.496349+0000","last_clean":"2024-09-17T03:04:30.496349+0000","last_became_active":"2024-09-17T03:04:23.399814+0000","last_became_peered":"2024-09-17T03:04:23.399814+0000","last_unstale":"2024-09-17T03:04:30.496349+0000","last_undegraded":"2024-09-17T03:04:30.496349+0000","last_fullsized":"2024-09-17T03:04:30.496349+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:04.751839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475082+0000","last_change":"2024-09-17T03:04:24.421387+0000","last_active":"2024-09-17T03:04:30.475082+0000","last_peered":"2024-09-17T03:04:30.475082+0000","last_clean":"2024-09-17T03:04:30.475082+0000","last_became_active":"2024-09-17T03:04:24.421136+0000","last_became_peered":"2024-09-17T03:04:24.421136+0000","last_unstale":"2024-09-17T03:04:30.475082+0000","last_undegraded":"2024-09-17T03:04:30.475082+0000","last_fullsized":"2024-09-17T03:04:30.475082+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:05:02.544205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472651+0000","last_change":"2024-09-17T03:04:23.407258+0000","last_active":"2024-09-17T03:04:30.472651+0000","last_peered":"2024-09-17T03:04:30.472651+0000","last_clean":"2024-09-17T03:04:30.472651+0000","last_became_active":"2024-09-17T03:04:23.405839+0000","last_became_peered":"2024-09-17T03:04:23.405839+0000","last_unstale":"2024-09-17T03:04:30.472651+0000","last_undegraded":"2024-09-17T03:04:30.472651+0000","last_fullsized":"2024-09-17T03:04:30.472651+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:32.012765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127477+0000","last_change":"2024-09-17T03:04:24.416659+0000","last_active":"2024-09-17T03:04:31.127477+0000","last_peered":"2024-09-17T03:04:31.127477+0000","last_clean":"2024-09-17T03:04:31.127477+0000","last_became_active":"2024-09-17T03:04:24.416233+0000","last_became_peered":"2024-09-17T03:04:24.416233+0000","last_unstale":"2024-09-17T03:04:31.127477+0000","last_undegraded":"2024-09-17T03:04:31.127477+0000","last_fullsized":"2024-09-17T03:04:31.127477+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:06.799748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":18,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127384+0000","last_change":"2024-09-17T03:04:23.403653+0000","last_active":"2024-09-17T03:04:31.127384+0000","last_peered":"2024-09-17T03:04:31.127384+0000","last_clean":"2024-09-17T03:04:31.127384+0000","last_became_active":"2024-09-17T03:04:23.403370+0000","last_became_peered":"2024-09-17T03:04:23.403370+0000","last_unstale":"2024-09-17T03:04:31.127384+0000","last_undegraded":"2024-09-17T03:04:31.127384+0000","last_fullsized":"2024-09-17T03:04:31.127384+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:47.746021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.126920+0000","last_change":"2024-09-17T03:04:24.416902+0000","last_active":"2024-09-17T03:04:31.126920+0000","last_peered":"2024-09-17T03:04:31.126920+0000","last_clean":"2024-09-17T03:04:31.126920+0000","last_became_active":"2024-09-17T03:04:24.416146+0000","last_became_peered":"2024-09-17T03:04:24.416146+0000","last_unstale":"2024-09-17T03:04:31.126920+0000","last_undegraded":"2024-09-17T03:04:31.126920+0000","last_fullsized":"2024-09-17T03:04:31.126920+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:05.668824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"168'6","reported_seq":25,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475483+0000","last_change":"2024-09-17T03:04:23.403903+0000","last_active":"2024-09-17T03:04:30.475483+0000","last_peered":"2024-09-17T03:04:30.475483+0000","last_clean":"2024-09-17T03:04:30.475483+0000","last_became_active":"2024-09-17T03:04:23.403617+0000","last_became_peered":"2024-09-17T03:04:23.403617+0000","last_unstale":"2024-09-17T03:04:30.475483+0000","last_undegraded":"2024-09-17T03:04:30.475483+0000","last_fullsized":"2024-09-17T03:04:30.475483+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:21.262073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475000+0000","last_change":"2024-09-17T03:04:24.413319+0000","last_active":"2024-09-17T03:04:30.475000+0000","last_peered":"2024-09-17T03:04:30.475000+0000","last_clean":"2024-09-17T03:04:30.475000+0000","last_became_active":"2024-09-17T03:04:24.413019+0000","last_became_peered":"2024-09-17T03:04:24.413019+0000","last_unstale":"2024-09-17T03:04:30.475000+0000","last_undegraded":"2024-09-17T03:04:30.475000+0000","last_fullsized":"2024-09-17T03:04:30.475000+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:33.863827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"168'2","reported_seq":21,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.474702+0000","last_change":"2024-09-17T03:04:23.408694+0000","last_active":"2024-09-17T03:04:30.474702+0000","last_peered":"2024-09-17T03:04:30.474702+0000","last_clean":"2024-09-17T03:04:30.474702+0000","last_became_active":"2024-09-17T03:04:23.408398+0000","last_became_peered":"2024-09-17T03:04:23.408398+0000","last_unstale":"2024-09-17T03:04:30.474702+0000","last_undegraded":"2024-09-17T03:04:30.474702+0000","last_fullsized":"2024-09-17T03:04:30.474702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:51.824215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472793+0000","last_change":"2024-09-17T03:04:24.419997+0000","last_active":"2024-09-17T03:04:30.472793+0000","last_peered":"2024-09-17T03:04:30.472793+0000","last_clean":"2024-09-17T03:04:30.472793+0000","last_became_active":"2024-09-17T03:04:24.419734+0000","last_became_peered":"2024-09-17T03:04:24.419734+0000","last_unstale":"2024-09-17T03:04:30.472793+0000","last_undegraded":"2024-09-17T03:04:30.472793+0000","last_fullsized":"2024-09-17T03:04:30.472793+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:30.222647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475146+0000","last_change":"2024-09-17T03:04:23.406098+0000","last_active":"2024-09-17T03:04:30.475146+0000","last_peered":"2024-09-17T03:04:30.475146+0000","last_clean":"2024-09-17T03:04:30.475146+0000","last_became_active":"2024-09-17T03:04:23.405621+0000","last_became_peered":"2024-09-17T03:04:23.405621+0000","last_unstale":"2024-09-17T03:04:30.475146+0000","last_undegraded":"2024-09-17T03:04:30.475146+0000","last_fullsized":"2024-09-17T03:04:30.475146+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:28.373706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475437+0000","last_change":"2024-09-17T03:04:24.423126+0000","last_active":"2024-09-17T03:04:30.475437+0000","last_peered":"2024-09-17T03:04:30.475437+0000","last_clean":"2024-09-17T03:04:30.475437+0000","last_became_active":"2024-09-17T03:04:24.422133+0000","last_became_peered":"2024-09-17T03:04:24.422133+0000","last_unstale":"2024-09-17T03:04:30.475437+0000","last_undegraded":"2024-09-17T03:04:30.475437+0000","last_fullsized":"2024-09-17T03:04:30.475437+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:10.761532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.126718+0000","last_change":"2024-09-17T03:04:23.404041+0000","last_active":"2024-09-17T03:04:31.126718+0000","last_peered":"2024-09-17T03:04:31.126718+0000","last_clean":"2024-09-17T03:04:31.126718+0000","last_became_active":"2024-09-17T03:04:23.403745+0000","last_became_peered":"2024-09-17T03:04:23.403745+0000","last_unstale":"2024-09-17T03:04:31.126718+0000","last_undegraded":"2024-09-17T03:04:31.126718+0000","last_fullsized":"2024-09-17T03:04:31.126718+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:42.340695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.474726+0000","last_change":"2024-09-17T03:04:24.418632+0000","last_active":"2024-09-17T03:04:30.474726+0000","last_peered":"2024-09-17T03:04:30.474726+0000","last_clean":"2024-09-17T03:04:30.474726+0000","last_became_active":"2024-09-17T03:04:24.418264+0000","last_became_peered":"2024-09-17T03:04:24.418264+0000","last_unstale":"2024-09-17T03:04:30.474726+0000","last_undegraded":"2024-09-17T03:04:30.474726+0000","last_fullsized":"2024-09-17T03:04:30.474726+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:56.330892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"168'8","reported_seq":27,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127052+0000","last_change":"2024-09-17T03:04:23.402406+0000","last_active":"2024-09-17T03:04:31.127052+0000","last_peered":"2024-09-17T03:04:31.127052+0000","last_clean":"2024-09-17T03:04:31.127052+0000","last_became_active":"2024-09-17T03:04:23.402144+0000","last_became_peered":"2024-09-17T03:04:23.402144+0000","last_unstale":"2024-09-17T03:04:31.127052+0000","last_undegraded":"2024-09-17T03:04:31.127052+0000","last_fullsized":"2024-09-17T03:04:31.127052+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:53.350513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127990+0000","last_change":"2024-09-17T03:04:24.423252+0000","last_active":"2024-09-17T03:04:31.127990+0000","last_peered":"2024-09-17T03:04:31.127990+0000","last_clean":"2024-09-17T03:04:31.127990+0000","last_became_active":"2024-09-17T03:04:24.422979+0000","last_became_peered":"2024-09-17T03:04:24.422979+0000","last_unstale":"2024-09-17T03:04:31.127990+0000","last_undegraded":"2024-09-17T03:04:31.127990+0000","last_fullsized":"2024-09-17T03:04:31.127990+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:46.009448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"168'1","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475128+0000","last_change":"2024-09-17T03:04:23.407574+0000","last_active":"2024-09-17T03:04:30.475128+0000","last_peered":"2024-09-17T03:04:30.475128+0000","last_clean":"2024-09-17T03:04:30.475128+0000","last_became_active":"2024-09-17T03:04:23.407305+0000","last_became_peered":"2024-09-17T03:04:23.407305+0000","last_unstale":"2024-09-17T03:04:30.475128+0000","last_undegraded":"2024-09-17T03:04:30.475128+0000","last_fullsized":"2024-09-17T03:04:30.475128+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:28.028704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.126970+0000","last_change":"2024-09-17T03:04:24.419032+0000","last_active":"2024-09-17T03:04:31.126970+0000","last_peered":"2024-09-17T03:04:31.126970+0000","last_clean":"2024-09-17T03:04:31.126970+0000","last_became_active":"2024-09-17T03:04:24.418750+0000","last_became_peered":"2024-09-17T03:04:24.418750+0000","last_unstale":"2024-09-17T03:04:31.126970+0000","last_undegraded":"2024-09-17T03:04:31.126970+0000","last_fullsized":"2024-09-17T03:04:31.126970+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:27:56.831791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"168'2","reported_seq":21,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.473237+0000","last_change":"2024-09-17T03:04:23.405655+0000","last_active":"2024-09-17T03:04:30.473237+0000","last_peered":"2024-09-17T03:04:30.473237+0000","last_clean":"2024-09-17T03:04:30.473237+0000","last_became_active":"2024-09-17T03:04:23.405354+0000","last_became_peered":"2024-09-17T03:04:23.405354+0000","last_unstale":"2024-09-17T03:04:30.473237+0000","last_undegraded":"2024-09-17T03:04:30.473237+0000","last_fullsized":"2024-09-17T03:04:30.473237+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:22.472867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.474867+0000","last_change":"2024-09-17T03:04:24.415128+0000","last_active":"2024-09-17T03:04:30.474867+0000","last_peered":"2024-09-17T03:04:30.474867+0000","last_clean":"2024-09-17T03:04:30.474867+0000","last_became_active":"2024-09-17T03:04:24.413400+0000","last_became_peered":"2024-09-17T03:04:24.413400+0000","last_unstale":"2024-09-17T03:04:30.474867+0000","last_undegraded":"2024-09-17T03:04:30.474867+0000","last_fullsized":"2024-09-17T03:04:30.474867+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:55.654450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"168'1","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127349+0000","last_change":"2024-09-17T03:04:23.405036+0000","last_active":"2024-09-17T03:04:31.127349+0000","last_peered":"2024-09-17T03:04:31.127349+0000","last_clean":"2024-09-17T03:04:31.127349+0000","last_became_active":"2024-09-17T03:04:23.404768+0000","last_became_peered":"2024-09-17T03:04:23.404768+0000","last_unstale":"2024-09-17T03:04:31.127349+0000","last_undegraded":"2024-09-17T03:04:31.127349+0000","last_fullsized":"2024-09-17T03:04:31.127349+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:04.189472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127507+0000","last_change":"2024-09-17T03:04:24.424203+0000","last_active":"2024-09-17T03:04:31.127507+0000","last_peered":"2024-09-17T03:04:31.127507+0000","last_clean":"2024-09-17T03:04:31.127507+0000","last_became_active":"2024-09-17T03:04:24.423292+0000","last_became_peered":"2024-09-17T03:04:24.423292+0000","last_unstale":"2024-09-17T03:04:31.127507+0000","last_undegraded":"2024-09-17T03:04:31.127507+0000","last_fullsized":"2024-09-17T03:04:31.127507+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:30.602560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472478+0000","last_change":"2024-09-17T03:04:23.403243+0000","last_active":"2024-09-17T03:04:30.472478+0000","last_peered":"2024-09-17T03:04:30.472478+0000","last_clean":"2024-09-17T03:04:30.472478+0000","last_became_active":"2024-09-17T03:04:23.402987+0000","last_became_peered":"2024-09-17T03:04:23.402987+0000","last_unstale":"2024-09-17T03:04:30.472478+0000","last_undegraded":"2024-09-17T03:04:30.472478+0000","last_fullsized":"2024-09-17T03:04:30.472478+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:27.955333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496136+0000","last_change":"2024-09-17T03:04:24.421182+0000","last_active":"2024-09-17T03:04:30.496136+0000","last_peered":"2024-09-17T03:04:30.496136+0000","last_clean":"2024-09-17T03:04:30.496136+0000","last_became_active":"2024-09-17T03:04:24.420736+0000","last_became_peered":"2024-09-17T03:04:24.420736+0000","last_unstale":"2024-09-17T03:04:30.496136+0000","last_undegraded":"2024-09-17T03:04:30.496136+0000","last_fullsized":"2024-09-17T03:04:30.496136+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:20.813854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"168'2","reported_seq":21,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475953+0000","last_change":"2024-09-17T03:04:23.406462+0000","last_active":"2024-09-17T03:04:30.475953+0000","last_peered":"2024-09-17T03:04:30.475953+0000","last_clean":"2024-09-17T03:04:30.475953+0000","last_became_active":"2024-09-17T03:04:23.406189+0000","last_became_peered":"2024-09-17T03:04:23.406189+0000","last_unstale":"2024-09-17T03:04:30.475953+0000","last_undegraded":"2024-09-17T03:04:30.475953+0000","last_fullsized":"2024-09-17T03:04:30.475953+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:20.692326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475794+0000","last_change":"2024-09-17T03:04:24.416484+0000","last_active":"2024-09-17T03:04:30.475794+0000","last_peered":"2024-09-17T03:04:30.475794+0000","last_clean":"2024-09-17T03:04:30.475794+0000","last_became_active":"2024-09-17T03:04:24.416041+0000","last_became_peered":"2024-09-17T03:04:24.416041+0000","last_unstale":"2024-09-17T03:04:30.475794+0000","last_undegraded":"2024-09-17T03:04:30.475794+0000","last_fullsized":"2024-09-17T03:04:30.475794+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:59.400426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":18,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127790+0000","last_change":"2024-09-17T03:04:23.405097+0000","last_active":"2024-09-17T03:04:31.127790+0000","last_peered":"2024-09-17T03:04:31.127790+0000","last_clean":"2024-09-17T03:04:31.127790+0000","last_became_active":"2024-09-17T03:04:23.404789+0000","last_became_peered":"2024-09-17T03:04:23.404789+0000","last_unstale":"2024-09-17T03:04:31.127790+0000","last_undegraded":"2024-09-17T03:04:31.127790+0000","last_fullsized":"2024-09-17T03:04:31.127790+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:55.661161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.496092+0000","last_change":"2024-09-17T03:04:24.417144+0000","last_active":"2024-09-17T03:04:30.496092+0000","last_peered":"2024-09-17T03:04:30.496092+0000","last_clean":"2024-09-17T03:04:30.496092+0000","last_became_active":"2024-09-17T03:04:24.416157+0000","last_became_peered":"2024-09-17T03:04:24.416157+0000","last_unstale":"2024-09-17T03:04:30.496092+0000","last_undegraded":"2024-09-17T03:04:30.496092+0000","last_fullsized":"2024-09-17T03:04:30.496092+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:49.877684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":18,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.128240+0000","last_change":"2024-09-17T03:04:23.403012+0000","last_active":"2024-09-17T03:04:31.128240+0000","last_peered":"2024-09-17T03:04:31.128240+0000","last_clean":"2024-09-17T03:04:31.128240+0000","last_became_active":"2024-09-17T03:04:23.402063+0000","last_became_peered":"2024-09-17T03:04:23.402063+0000","last_unstale":"2024-09-17T03:04:31.128240+0000","last_undegraded":"2024-09-17T03:04:31.128240+0000","last_fullsized":"2024-09-17T03:04:31.128240+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:19.319566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475887+0000","last_change":"2024-09-17T03:04:24.416649+0000","last_active":"2024-09-17T03:04:30.475887+0000","last_peered":"2024-09-17T03:04:30.475887+0000","last_clean":"2024-09-17T03:04:30.475887+0000","last_became_active":"2024-09-17T03:04:24.416355+0000","last_became_peered":"2024-09-17T03:04:24.416355+0000","last_unstale":"2024-09-17T03:04:30.475887+0000","last_undegraded":"2024-09-17T03:04:30.475887+0000","last_fullsized":"2024-09-17T03:04:30.475887+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:55.861068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475302+0000","last_change":"2024-09-17T03:04:23.408376+0000","last_active":"2024-09-17T03:04:30.475302+0000","last_peered":"2024-09-17T03:04:30.475302+0000","last_clean":"2024-09-17T03:04:30.475302+0000","last_became_active":"2024-09-17T03:04:23.408014+0000","last_became_peered":"2024-09-17T03:04:23.408014+0000","last_unstale":"2024-09-17T03:04:30.475302+0000","last_undegraded":"2024-09-17T03:04:30.475302+0000","last_fullsized":"2024-09-17T03:04:30.475302+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:12.933779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475704+0000","last_change":"2024-09-17T03:04:24.422783+0000","last_active":"2024-09-17T03:04:30.475704+0000","last_peered":"2024-09-17T03:04:30.475704+0000","last_clean":"2024-09-17T03:04:30.475704+0000","last_became_active":"2024-09-17T03:04:24.421767+0000","last_became_peered":"2024-09-17T03:04:24.421767+0000","last_unstale":"2024-09-17T03:04:30.475704+0000","last_undegraded":"2024-09-17T03:04:30.475704+0000","last_fullsized":"2024-09-17T03:04:30.475704+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:23.409196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"168'2","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127683+0000","last_change":"2024-09-17T03:04:23.405684+0000","last_active":"2024-09-17T03:04:31.127683+0000","last_peered":"2024-09-17T03:04:31.127683+0000","last_clean":"2024-09-17T03:04:31.127683+0000","last_became_active":"2024-09-17T03:04:23.405108+0000","last_became_peered":"2024-09-17T03:04:23.405108+0000","last_unstale":"2024-09-17T03:04:31.127683+0000","last_undegraded":"2024-09-17T03:04:31.127683+0000","last_fullsized":"2024-09-17T03:04:31.127683+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:33.740351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.474988+0000","last_change":"2024-09-17T03:04:24.415464+0000","last_active":"2024-09-17T03:04:30.474988+0000","last_peered":"2024-09-17T03:04:30.474988+0000","last_clean":"2024-09-17T03:04:30.474988+0000","last_became_active":"2024-09-17T03:04:24.414326+0000","last_became_peered":"2024-09-17T03:04:24.414326+0000","last_unstale":"2024-09-17T03:04:30.474988+0000","last_undegraded":"2024-09-17T03:04:30.474988+0000","last_fullsized":"2024-09-17T03:04:30.474988+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:23.583633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"169'1","reported_seq":20,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.126901+0000","last_change":"2024-09-17T03:04:23.407980+0000","last_active":"2024-09-17T03:04:31.126901+0000","last_peered":"2024-09-17T03:04:31.126901+0000","last_clean":"2024-09-17T03:04:31.126901+0000","last_became_active":"2024-09-17T03:04:23.407699+0000","last_became_peered":"2024-09-17T03:04:23.407699+0000","last_unstale":"2024-09-17T03:04:31.126901+0000","last_undegraded":"2024-09-17T03:04:31.126901+0000","last_fullsized":"2024-09-17T03:04:31.126901+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:10.428617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472917+0000","last_change":"2024-09-17T03:04:24.421354+0000","last_active":"2024-09-17T03:04:30.472917+0000","last_peered":"2024-09-17T03:04:30.472917+0000","last_clean":"2024-09-17T03:04:30.472917+0000","last_became_active":"2024-09-17T03:04:24.421075+0000","last_became_peered":"2024-09-17T03:04:24.421075+0000","last_unstale":"2024-09-17T03:04:30.472917+0000","last_undegraded":"2024-09-17T03:04:30.472917+0000","last_fullsized":"2024-09-17T03:04:30.472917+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:18.027423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127280+0000","last_change":"2024-09-17T03:04:23.403007+0000","last_active":"2024-09-17T03:04:31.127280+0000","last_peered":"2024-09-17T03:04:31.127280+0000","last_clean":"2024-09-17T03:04:31.127280+0000","last_became_active":"2024-09-17T03:04:23.402737+0000","last_became_peered":"2024-09-17T03:04:23.402737+0000","last_unstale":"2024-09-17T03:04:31.127280+0000","last_undegraded":"2024-09-17T03:04:31.127280+0000","last_fullsized":"2024-09-17T03:04:31.127280+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:17.344114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.126935+0000","last_change":"2024-09-17T03:04:24.420813+0000","last_active":"2024-09-17T03:04:31.126935+0000","last_peered":"2024-09-17T03:04:31.126935+0000","last_clean":"2024-09-17T03:04:31.126935+0000","last_became_active":"2024-09-17T03:04:24.419715+0000","last_became_peered":"2024-09-17T03:04:24.419715+0000","last_unstale":"2024-09-17T03:04:31.126935+0000","last_undegraded":"2024-09-17T03:04:31.126935+0000","last_fullsized":"2024-09-17T03:04:31.126935+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:27.533051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127084+0000","last_change":"2024-09-17T03:04:23.405532+0000","last_active":"2024-09-17T03:04:31.127084+0000","last_peered":"2024-09-17T03:04:31.127084+0000","last_clean":"2024-09-17T03:04:31.127084+0000","last_became_active":"2024-09-17T03:04:23.405276+0000","last_became_peered":"2024-09-17T03:04:23.405276+0000","last_unstale":"2024-09-17T03:04:31.127084+0000","last_undegraded":"2024-09-17T03:04:31.127084+0000","last_fullsized":"2024-09-17T03:04:31.127084+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:31.107448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127519+0000","last_change":"2024-09-17T03:04:24.425704+0000","last_active":"2024-09-17T03:04:31.127519+0000","last_peered":"2024-09-17T03:04:31.127519+0000","last_clean":"2024-09-17T03:04:31.127519+0000","last_became_active":"2024-09-17T03:04:24.424897+0000","last_became_peered":"2024-09-17T03:04:24.424897+0000","last_unstale":"2024-09-17T03:04:31.127519+0000","last_undegraded":"2024-09-17T03:04:31.127519+0000","last_fullsized":"2024-09-17T03:04:31.127519+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:23.914312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475770+0000","last_change":"2024-09-17T03:04:23.400492+0000","last_active":"2024-09-17T03:04:30.475770+0000","last_peered":"2024-09-17T03:04:30.475770+0000","last_clean":"2024-09-17T03:04:30.475770+0000","last_became_active":"2024-09-17T03:04:23.400226+0000","last_became_peered":"2024-09-17T03:04:23.400226+0000","last_unstale":"2024-09-17T03:04:30.475770+0000","last_undegraded":"2024-09-17T03:04:30.475770+0000","last_fullsized":"2024-09-17T03:04:30.475770+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:06.156766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475286+0000","last_change":"2024-09-17T03:04:24.422014+0000","last_active":"2024-09-17T03:04:30.475286+0000","last_peered":"2024-09-17T03:04:30.475286+0000","last_clean":"2024-09-17T03:04:30.475286+0000","last_became_active":"2024-09-17T03:04:24.421721+0000","last_became_peered":"2024-09-17T03:04:24.421721+0000","last_unstale":"2024-09-17T03:04:30.475286+0000","last_undegraded":"2024-09-17T03:04:30.475286+0000","last_fullsized":"2024-09-17T03:04:30.475286+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:27.481713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":18,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127798+0000","last_change":"2024-09-17T03:04:23.405372+0000","last_active":"2024-09-17T03:04:31.127798+0000","last_peered":"2024-09-17T03:04:31.127798+0000","last_clean":"2024-09-17T03:04:31.127798+0000","last_became_active":"2024-09-17T03:04:23.404722+0000","last_became_peered":"2024-09-17T03:04:23.404722+0000","last_unstale":"2024-09-17T03:04:31.127798+0000","last_undegraded":"2024-09-17T03:04:31.127798+0000","last_fullsized":"2024-09-17T03:04:31.127798+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:21.618164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":16,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127663+0000","last_change":"2024-09-17T03:04:24.418781+0000","last_active":"2024-09-17T03:04:31.127663+0000","last_peered":"2024-09-17T03:04:31.127663+0000","last_clean":"2024-09-17T03:04:31.127663+0000","last_became_active":"2024-09-17T03:04:24.418314+0000","last_became_peered":"2024-09-17T03:04:24.418314+0000","last_unstale":"2024-09-17T03:04:31.127663+0000","last_undegraded":"2024-09-17T03:04:31.127663+0000","last_fullsized":"2024-09-17T03:04:31.127663+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:11.040957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475335+0000","last_change":"2024-09-17T03:04:23.410036+0000","last_active":"2024-09-17T03:04:30.475335+0000","last_peered":"2024-09-17T03:04:30.475335+0000","last_clean":"2024-09-17T03:04:30.475335+0000","last_became_active":"2024-09-17T03:04:23.409330+0000","last_became_peered":"2024-09-17T03:04:23.409330+0000","last_unstale":"2024-09-17T03:04:30.475335+0000","last_undegraded":"2024-09-17T03:04:30.475335+0000","last_fullsized":"2024-09-17T03:04:30.475335+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:39.246159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475820+0000","last_change":"2024-09-17T03:04:24.422449+0000","last_active":"2024-09-17T03:04:30.475820+0000","last_peered":"2024-09-17T03:04:30.475820+0000","last_clean":"2024-09-17T03:04:30.475820+0000","last_became_active":"2024-09-17T03:04:24.421423+0000","last_became_peered":"2024-09-17T03:04:24.421423+0000","last_unstale":"2024-09-17T03:04:30.475820+0000","last_undegraded":"2024-09-17T03:04:30.475820+0000","last_fullsized":"2024-09-17T03:04:30.475820+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:13.978168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":19,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.472477+0000","last_change":"2024-09-17T03:04:23.406229+0000","last_active":"2024-09-17T03:04:30.472477+0000","last_peered":"2024-09-17T03:04:30.472477+0000","last_clean":"2024-09-17T03:04:30.472477+0000","last_became_active":"2024-09-17T03:04:23.405816+0000","last_became_peered":"2024-09-17T03:04:23.405816+0000","last_unstale":"2024-09-17T03:04:30.472477+0000","last_undegraded":"2024-09-17T03:04:30.472477+0000","last_fullsized":"2024-09-17T03:04:30.472477+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:44.882009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":17,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475619+0000","last_change":"2024-09-17T03:04:24.416436+0000","last_active":"2024-09-17T03:04:30.475619+0000","last_peered":"2024-09-17T03:04:30.475619+0000","last_clean":"2024-09-17T03:04:30.475619+0000","last_became_active":"2024-09-17T03:04:24.416160+0000","last_became_peered":"2024-09-17T03:04:24.416160+0000","last_unstale":"2024-09-17T03:04:30.475619+0000","last_undegraded":"2024-09-17T03:04:30.475619+0000","last_fullsized":"2024-09-17T03:04:30.475619+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:23.389861+0000","last_clean_scrub_stamp":"2024-09-17T03:04:23.389861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:16.719187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"168'3","reported_seq":22,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:30.475058+0000","last_change":"2024-09-17T03:04:23.409678+0000","last_active":"2024-09-17T03:04:30.475058+0000","last_peered":"2024-09-17T03:04:30.475058+0000","last_clean":"2024-09-17T03:04:30.475058+0000","last_became_active":"2024-09-17T03:04:23.408838+0000","last_became_peered":"2024-09-17T03:04:23.408838+0000","last_unstale":"2024-09-17T03:04:30.475058+0000","last_undegraded":"2024-09-17T03:04:30.475058+0000","last_fullsized":"2024-09-17T03:04:30.475058+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:04:22.384682+0000","last_clean_scrub_stamp":"2024-09-17T03:04:22.384682+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:38.808023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":408,"reported_epoch":171,"state":"active+clean","last_fresh":"2024-09-17T03:04:31.127912+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:04:31.127912+0000","last_peered":"2024-09-17T03:04:31.127912+0000","last_clean":"2024-09-17T03:04:31.127912+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:04:31.127912+0000","last_undegraded":"2024-09-17T03:04:31.127912+0000","last_fullsized":"2024-09-17T03:04:31.127912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574970,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1511,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193801,"statfs":{"total":200000000,"available":198452375,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574971,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194378,"statfs":{"total":200000000,"available":199043249,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194378,"statfs":{"total":200000000,"available":199043373,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194378,"statfs":{"total":200000000,"available":199043395,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":934,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194378,"statfs":{"total":200000000,"available":199043305,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574970,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":930,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194382,"statfs":{"total":200000000,"available":199047659,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":928,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194383,"statfs":{"total":200000000,"available":199048759,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193800,"statfs":{"total":200000000,"available":198451381,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:04:32.211 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:04:32.211 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:04:32.367 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.369+0000 7f345dd0b640 1 -- 172.21.15.104:0/4101996852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580b7ae0 msgr2=0x7f34580b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.369+0000 7f345dd0b640 1 --2- 172.21.15.104:0/4101996852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580b7ae0 0x7f34580b5730 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f3448005fd0 tx=0x7f344802a980 comp rx=0 tx=0).stop 2024-09-17T03:04:32.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.369+0000 7f345dd0b640 1 -- 172.21.15.104:0/4101996852 shutdown_connections 2024-09-17T03:04:32.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.369+0000 7f345dd0b640 1 --2- 172.21.15.104:0/4101996852 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34580d1180 0x7f34580d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.369+0000 7f345dd0b640 1 --2- 172.21.15.104:0/4101996852 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580b7ae0 0x7f34580b5730 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.369+0000 7f345dd0b640 1 -- 172.21.15.104:0/4101996852 >> 172.21.15.104:0/4101996852 conn(0x7f34580d28e0 msgr2=0x7f34580d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:32.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.369+0000 7f345dd0b640 1 -- 172.21.15.104:0/4101996852 shutdown_connections 2024-09-17T03:04:32.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.369+0000 7f345dd0b640 1 -- 172.21.15.104:0/4101996852 wait complete. 2024-09-17T03:04:32.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.370+0000 7f345dd0b640 1 Processor -- start 2024-09-17T03:04:32.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.371+0000 7f345dd0b640 1 -- start start 2024-09-17T03:04:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f345dd0b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34580b7ae0 0x7f345815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f345dd0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580cdad0 0x7f34580b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f345dd0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34580d1180 0x7f34580b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f345dd0b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f34580cf380 con 0x7f34580cdad0 2024-09-17T03:04:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f345dd0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f34580cf200 con 0x7f34580d1180 2024-09-17T03:04:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f345dd0b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f34580cf500 con 0x7f34580b7ae0 2024-09-17T03:04:32.372 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3456ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580cdad0 0x7f34580b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3456ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580cdad0 0x7f34580b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51658/0 (socket says 172.21.15.104:51658) 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3456ffd640 1 -- 172.21.15.104:0/1523070090 learned_addr learned my addr 172.21.15.104:0/1523070090 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f34577fe640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34580b7ae0 0x7f345815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3457fff640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34580d1180 0x7f34580b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3456ffd640 1 -- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34580b7ae0 msgr2=0x7f345815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3456ffd640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34580b7ae0 0x7f345815b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3456ffd640 1 -- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34580d1180 msgr2=0x7f34580b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3456ffd640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34580d1180 0x7f34580b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3456ffd640 1 -- 172.21.15.104:0/1523070090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34580b2e60 con 0x7f34580cdad0 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.372+0000 7f3457fff640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34580d1180 0x7f34580b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.373+0000 7f3456ffd640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580cdad0 0x7f34580b0350 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f344c00d750 tx=0x7f344c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.373+0000 7f343ffff640 1 -- 172.21.15.104:0/1523070090 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c017070 con 0x7f34580cdad0 2024-09-17T03:04:32.373 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.373+0000 7f343ffff640 1 -- 172.21.15.104:0/1523070090 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f344c009b20 con 0x7f34580cdad0 2024-09-17T03:04:32.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.373+0000 7f343ffff640 1 -- 172.21.15.104:0/1523070090 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c010460 con 0x7f34580cdad0 2024-09-17T03:04:32.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.373+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34580b3300 con 0x7f34580cdad0 2024-09-17T03:04:32.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.373+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345809f170 con 0x7f34580cdad0 2024-09-17T03:04:32.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.374+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34580b5730 con 0x7f34580cdad0 2024-09-17T03:04:32.374 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.374+0000 7f343ffff640 1 -- 172.21.15.104:0/1523070090 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f344c01a070 con 0x7f34580cdad0 2024-09-17T03:04:32.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.375+0000 7f343ffff640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3444078b90 0x7f344407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.375+0000 7f343ffff640 1 -- 172.21.15.104:0/1523070090 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7f344c09ae80 con 0x7f34580cdad0 2024-09-17T03:04:32.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.375+0000 7f34577fe640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3444078b90 0x7f344407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.375 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.376+0000 7f34577fe640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3444078b90 0x7f344407b0a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3448035000 tx=0x7f3448004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:32.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.380+0000 7f343ffff640 1 -- 172.21.15.104:0/1523070090 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f344c063330 con 0x7f34580cdad0 2024-09-17T03:04:32.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.625+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f34580b3030 con 0x7f34580cdad0 2024-09-17T03:04:32.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.627+0000 7f343ffff640 1 -- 172.21.15.104:0/1523070090 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v34) ==== 190+0+147 (secure 0 0 0) 0x7f344c062c30 con 0x7f34580cdad0 2024-09-17T03:04:32.626 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T03:04:32.626 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T03:04:32.626 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T03:04:32.626 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T03:04:32.626 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:04:32.627 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T03:04:32.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3444078b90 msgr2=0x7f344407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3444078b90 0x7f344407b0a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3448035000 tx=0x7f3448004ab0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580cdad0 msgr2=0x7f34580b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580cdad0 0x7f34580b0350 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f344c00d750 tx=0x7f344c00dc10 comp rx=0 tx=0).stop 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 shutdown_connections 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3444078b90 0x7f344407b0a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34580d1180 0x7f34580b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f34580cdad0 0x7f34580b0350 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 --2- 172.21.15.104:0/1523070090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f34580b7ae0 0x7f345815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 >> 172.21.15.104:0/1523070090 conn(0x7f34580d28e0 msgr2=0x7f34580cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 shutdown_connections 2024-09-17T03:04:32.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.630+0000 7f345dd0b640 1 -- 172.21.15.104:0/1523070090 wait complete. 2024-09-17T03:04:32.640 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:04:32.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/2430412648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b5d20 msgr2=0x7f9f440cfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/2430412648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b5d20 0x7f9f440cfa80 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f9f440735d0 tx=0x7f9f3c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:04:32.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/2430412648 shutdown_connections 2024-09-17T03:04:32.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/2430412648 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b5d20 0x7f9f440cfa80 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/2430412648 >> v2:172.21.15.192:3300/0 conn(0x7f9f440b3f00 0x7f9f440b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/2430412648 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f440b4fc0 0x7f9f440b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/2430412648 >> 172.21.15.104:0/2430412648 conn(0x7f9f440b44a0 msgr2=0x7f9f440b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:32.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/2430412648 shutdown_connections 2024-09-17T03:04:32.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.754+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/2430412648 wait complete. 2024-09-17T03:04:32.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.755+0000 7f9f4b0c4640 1 Processor -- start 2024-09-17T03:04:32.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.756+0000 7f9f4b0c4640 1 -- start start 2024-09-17T03:04:32.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f4b0c4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f440b3f00 0x7f9f440caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f4b0c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b4fc0 0x7f9f440a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f4b0c4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f440b5d20 0x7f9f440c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f4b0c4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9f440cdf10 con 0x7f9f440b4fc0 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f4b0c4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9f440d02f0 con 0x7f9f440b5d20 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f4b0c4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9f440ce090 con 0x7f9f440b3f00 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f43fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b4fc0 0x7f9f440a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f43fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b4fc0 0x7f9f440a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51680/0 (socket says 172.21.15.104:51680) 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f43fff640 1 -- 172.21.15.104:0/865158151 learned_addr learned my addr 172.21.15.104:0/865158151 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f49661640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f440b5d20 0x7f9f440c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f48e60640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f440b3f00 0x7f9f440caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f43fff640 1 -- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f440b3f00 msgr2=0x7f9f440caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f43fff640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f440b3f00 0x7f9f440caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f43fff640 1 -- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f440b5d20 msgr2=0x7f9f440c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f43fff640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f440b5d20 0x7f9f440c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.757+0000 7f9f43fff640 1 -- 172.21.15.104:0/865158151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f440a0660 con 0x7f9f440b4fc0 2024-09-17T03:04:32.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.758+0000 7f9f43fff640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b4fc0 0x7f9f440a0120 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800d770 tx=0x7f9f3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:32.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.758+0000 7f9f417fa640 1 -- 172.21.15.104:0/865158151 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38017070 con 0x7f9f440b4fc0 2024-09-17T03:04:32.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.758+0000 7f9f417fa640 1 -- 172.21.15.104:0/865158151 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f38009d20 con 0x7f9f440b4fc0 2024-09-17T03:04:32.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.758+0000 7f9f417fa640 1 -- 172.21.15.104:0/865158151 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f380106c0 con 0x7f9f440b4fc0 2024-09-17T03:04:32.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.758+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f441f3ca0 con 0x7f9f440b4fc0 2024-09-17T03:04:32.758 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.758+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f441f4260 con 0x7f9f440b4fc0 2024-09-17T03:04:32.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.759+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f440cb1e0 con 0x7f9f440b4fc0 2024-09-17T03:04:32.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.760+0000 7f9f417fa640 1 -- 172.21.15.104:0/865158151 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f3801a070 con 0x7f9f440b4fc0 2024-09-17T03:04:32.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.760+0000 7f9f417fa640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f30078bc0 0x7f9f3007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:32.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.760+0000 7f9f417fa640 1 -- 172.21.15.104:0/865158151 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7f9f3809ad50 con 0x7f9f440b4fc0 2024-09-17T03:04:32.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.761+0000 7f9f48e60640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f30078bc0 0x7f9f3007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:32.759 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.761+0000 7f9f48e60640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f30078bc0 0x7f9f3007b0d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400bad0 tx=0x7f9f3400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:32.763 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.765+0000 7f9f417fa640 1 -- 172.21.15.104:0/865158151 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9f3809e030 con 0x7f9f440b4fc0 2024-09-17T03:04:32.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.973+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f440b39c0 con 0x7f9f440b4fc0 2024-09-17T03:04:32.972 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.974+0000 7f9f417fa640 1 -- 172.21.15.104:0/865158151 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7f9f38062bb0 con 0x7f9f440b4fc0 2024-09-17T03:04:32.972 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:32.972 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":69,"btime":"2024-09-17T03:04:26:435587+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1948243703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1948243703},{"type":"v1","addr":"172.21.15.192:6836","nonce":1948243703}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3037806992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3037806992},{"type":"v1","addr":"172.21.15.192:6837","nonce":3037806992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2087460219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2087460219},{"type":"v1","addr":"172.21.15.104:6833","nonce":2087460219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:04:23.753525+0000","modified":"2024-09-17T03:04:25.785201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/2260610756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2260610756},{"type":"v1","addr":"172.21.15.104:6835","nonce":2260610756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7791,"qdb_cluster":[7791]},"id":10}]} 2024-09-17T03:04:32.973 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 69 2024-09-17T03:04:32.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f30078bc0 msgr2=0x7f9f3007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f30078bc0 0x7f9f3007b0d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9f3400bad0 tx=0x7f9f3400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b4fc0 msgr2=0x7f9f440a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b4fc0 0x7f9f440a0120 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800d770 tx=0x7f9f3800dc30 comp rx=0 tx=0).stop 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 shutdown_connections 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9f30078bc0 0x7f9f3007b0d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f440b5d20 0x7f9f440c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9f440b4fc0 0x7f9f440a0120 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 --2- 172.21.15.104:0/865158151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f440b3f00 0x7f9f440caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 >> 172.21.15.104:0/865158151 conn(0x7f9f440b44a0 msgr2=0x7f9f440b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 shutdown_connections 2024-09-17T03:04:32.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:32.976+0000 7f9f4b0c4640 1 -- 172.21.15.104:0/865158151 wait complete. 2024-09-17T03:04:33.389 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:04:23.753525+0000', 'modified': '2024-09-17T03:04:25.785201+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7791}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7791': {'gid': 7791, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/2260610756', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6834', 'nonce': 2260610756}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 2260610756}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7791, 'qdb_cluster': [7791]} 2024-09-17T03:04:33.389 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:04:33.389 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:04:33.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.506+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/1000101427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00d18e0 msgr2=0x7fe9b00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.506+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/1000101427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00d18e0 0x7fe9b00d34f0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009830 tx=0x7fe9a802a500 comp rx=0 tx=0).stop 2024-09-17T03:04:33.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.506+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/1000101427 shutdown_connections 2024-09-17T03:04:33.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.506+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/1000101427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00d18e0 0x7fe9b00d34f0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.506+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/1000101427 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9b00b6f70 0x7fe9b015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.506+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/1000101427 >> 172.21.15.104:0/1000101427 conn(0x7fe9b0073df0 msgr2=0x7fe9b0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:33.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.506+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/1000101427 shutdown_connections 2024-09-17T03:04:33.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.506+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/1000101427 wait complete. 2024-09-17T03:04:33.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.507+0000 7fe9b5a0e640 1 Processor -- start 2024-09-17T03:04:33.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.508+0000 7fe9b5a0e640 1 -- start start 2024-09-17T03:04:33.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9b5a0e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9b00b3b00 0x7fe9b01500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9b5a0e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00b6f70 0x7fe9b00cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9b5a0e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9b00d18e0 0x7fe9b00cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9b5a0e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b00d3dc0 con 0x7fe9b00b6f70 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9b5a0e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b00d3c40 con 0x7fe9b00b3b00 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9b5a0e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b00d3f40 con 0x7fe9b00d18e0 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00b6f70 0x7fe9b00cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00b6f70 0x7fe9b00cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51700/0 (socket says 172.21.15.104:51700) 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/473395992 learned_addr learned my addr 172.21.15.104:0/473395992 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9af7fe640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9b00d18e0 0x7fe9b00cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9b00b3b00 0x7fe9b01500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9b00d18e0 msgr2=0x7fe9b00cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9b00d18e0 0x7fe9b00cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9b00b3b00 msgr2=0x7fe9b01500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9b00b3b00 0x7fe9b01500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.509+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/473395992 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b0160e50 con 0x7fe9b00b6f70 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.510+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00b6f70 0x7fe9b00cbfb0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c3a0 tx=0x7fe9a400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.510+0000 7fe997fff640 1 -- 172.21.15.104:0/473395992 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4011790 con 0x7fe9b00b6f70 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.510+0000 7fe997fff640 1 -- 172.21.15.104:0/473395992 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a4017070 con 0x7fe9b00b6f70 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.510+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/473395992 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b00ce5c0 con 0x7fe9b00b6f70 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.510+0000 7fe997fff640 1 -- 172.21.15.104:0/473395992 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4011cc0 con 0x7fe9b00b6f70 2024-09-17T03:04:33.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.510+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/473395992 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b00cd030 con 0x7fe9b00b6f70 2024-09-17T03:04:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.512+0000 7fe997fff640 1 -- 172.21.15.104:0/473395992 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9a401c460 con 0x7fe9b00b6f70 2024-09-17T03:04:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.512+0000 7fe997fff640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe99c078b90 0x7fe99c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.512+0000 7fe997fff640 1 -- 172.21.15.104:0/473395992 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7fe9a409aab0 con 0x7fe9b00b6f70 2024-09-17T03:04:33.511 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.513+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe99c078b90 0x7fe99c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.513+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe99c078b90 0x7fe99c07b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0005fd0 tx=0x7fe9a00097d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.513+0000 7fe9bca59740 1 Processor -- start 2024-09-17T03:04:33.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.513+0000 7fe9bca59740 1 -- start start 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.514+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc47270 0x55fd0e018fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e019500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc26590 0x55fd0e036400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9bca59740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fd0df61820 con 0x55fd0dc1e3b0 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9bca59740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fd0df50c50 con 0x55fd0dc47270 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9bca59740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55fd0df54a60 con 0x55fd0dc26590 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e019500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e019500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51712/0 (socket says 172.21.15.104:51712) 2024-09-17T03:04:33.514 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/3617582259 learned_addr learned my addr 172.21.15.104:0/3617582259 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9af7fe640 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc26590 0x55fd0e036400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc47270 0x55fd0e018fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/3617582259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc26590 msgr2=0x55fd0e036400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc26590 0x55fd0e036400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/3617582259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc47270 msgr2=0x55fd0e018fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc47270 0x55fd0e018fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/3617582259 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd0dcb2850 con 0x55fd0dc1e3b0 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e019500 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400cfd0 tx=0x7fe9a4062090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ed88bc79a44fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9957fa640 1 -- 172.21.15.104:0/3617582259 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4062920 con 0x55fd0dc1e3b0 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9957fa640 1 -- 172.21.15.104:0/3617582259 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a406c220 con 0x55fd0dc1e3b0 2024-09-17T03:04:33.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.515+0000 7fe9957fa640 1 -- 172.21.15.104:0/3617582259 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4061b80 con 0x55fd0dc1e3b0 2024-09-17T03:04:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 -- 172.21.15.104:0/3617582259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc1e3b0 msgr2=0x55fd0e019500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e019500 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400cfd0 tx=0x7fe9a4062090 comp rx=0 tx=0).stop 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 -- 172.21.15.104:0/3617582259 shutdown_connections 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc26590 0x55fd0e036400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e019500 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 --2- 172.21.15.104:0/3617582259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc47270 0x55fd0e018fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 -- 172.21.15.104:0/3617582259 >> 172.21.15.104:0/3617582259 conn(0x55fd0dc3b3c0 msgr2=0x55fd0dfef280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 -- 172.21.15.104:0/3617582259 shutdown_connections 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.516+0000 7fe9bca59740 1 -- 172.21.15.104:0/3617582259 wait complete. 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.517+0000 7fe9bca59740 1 -- start start 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.517+0000 7fe9bca59740 1 Processor -- start 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.518+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc1e3b0 0x55fd0e046510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.518+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc26590 0x55fd0e007520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.518+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc47270 0x55fd0e042680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9bca59740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fd0dcc1620 con 0x55fd0dc47270 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9bca59740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fd0def65f0 con 0x55fd0dc26590 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9bca59740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55fd0e019a40 con 0x55fd0dc1e3b0 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9bca59740 10 client.0 _ll_register_callbacks cb 0x55fd0defa0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc47270 0x55fd0e042680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc47270 0x55fd0e042680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51728/0 (socket says 172.21.15.104:51728) 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 -- 172.21.15.104:0/2243371607 learned_addr learned my addr 172.21.15.104:0/2243371607 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc1e3b0 0x55fd0e046510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc26590 0x55fd0e007520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 -- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc1e3b0 msgr2=0x55fd0e046510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc1e3b0 0x55fd0e046510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 -- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc26590 msgr2=0x55fd0e007520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc26590 0x55fd0e007520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 -- 172.21.15.104:0/2243371607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd0dd296b0 con 0x55fd0dc47270 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc26590 0x55fd0e007520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9af7fe640 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc47270 0x55fd0e042680 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009950 tx=0x7fe9a8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83bb9d3d15dfd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe98e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2243371607 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8003b20 con 0x55fd0dc47270 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2243371607 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7fe9a8003cc0 con 0x55fd0dc47270 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9bca59740 1 -- 172.21.15.104:0/2243371607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9a406c220 con 0x55fd0dc47270 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2243371607 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fe9a803b410 con 0x55fd0dc47270 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9bca59740 10 client.7968 fetch_fsmap learned FSMap version 69 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.519+0000 7fe9bca59740 1 -- 172.21.15.104:0/2243371607 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55fd0e0032f0 con 0x55fd0dc47270 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2243371607 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a406c220 con 0x55fd0dc47270 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2243371607 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7fe9a804d050 con 0x55fd0dc47270 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe9bca59740 10 client.7968 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T03:04:33.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe9bca59740 10 client.7968 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe9bca59740 20 client.7968 populate_metadata read hostname 'smithi104' 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] conn(0x55fd0dc05e40 0x55fd0e02d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe9bca59740 4 client.7968 mds_command: new command op to 7791 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe9bca59740 1 -- 172.21.15.104:0/2243371607 --> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd0df63770 con 0x55fd0dc05e40 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] conn(0x55fd0dc05e40 0x55fd0e02d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe98e7fc640 10 client.7968 ms_handle_connect on v2:172.21.15.104:6834/2260610756 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.520+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] conn(0x55fd0dc05e40 0x55fd0e02d340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=444758fc3f29f97a server_cookie=43ab3fedb1384f29 in_seq=0 out_seq=0 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2243371607 <== mds.0 v2:172.21.15.104:6834/2260610756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd0df63770 con 0x55fd0dc05e40 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe98e7fc640 10 client.7968 handle_command_reply: tid=0 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 client.7968 shutdown 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 -- 172.21.15.104:0/2243371607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc47270 msgr2=0x55fd0e042680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc47270 0x55fd0e042680 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009950 tx=0x7fe9a8003820 comp rx=0 tx=0).stop 2024-09-17T03:04:33.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 -- 172.21.15.104:0/2243371607 shutdown_connections 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] conn(0x55fd0dc05e40 0x55fd0e02d340 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc26590 0x55fd0e007520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc47270 0x55fd0e042680 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe98e7fc640 0 client.7968 ms_handle_reset on v2:172.21.15.104:6834/2260610756 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2243371607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc1e3b0 0x55fd0e046510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 -- 172.21.15.104:0/2243371607 >> 172.21.15.104:0/2243371607 conn(0x55fd0dc3b3c0 msgr2=0x55fd0dfe9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 -- 172.21.15.104:0/2243371607 shutdown_connections 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 1 -- 172.21.15.104:0/2243371607 wait complete. 2024-09-17T03:04:33.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.521+0000 7fe9bca59740 20 client.7968 trim_cache size 0 max 16384 2024-09-17T03:04:33.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.539+0000 7fe9bca59740 1 Processor -- start 2024-09-17T03:04:33.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.539+0000 7fe9bca59740 1 -- start start 2024-09-17T03:04:33.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e006cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e003520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.540 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 0x55fd0e003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9bca59740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0202840 con 0x55fd0dc26590 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9bca59740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b02018e0 con 0x55fd0dc1e3b0 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9bca59740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b01606b0 con 0x55fd0dc47270 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e003520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e003520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51738/0 (socket says 172.21.15.104:51738) 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/1333989375 learned_addr learned my addr 172.21.15.104:0/1333989375 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/1333989375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 msgr2=0x55fd0e003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/1333989375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 0x55fd0e003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/1333989375 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 msgr2=0x55fd0e006cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/1333989375 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e006cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/1333989375 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd0e035280 con 0x55fd0dc26590 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/1333989375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e003520 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fe9a409ad50 tx=0x7fe9a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a16a3f7207eb10 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:33.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe994ff9640 1 -- 172.21.15.104:0/1333989375 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a405ef70 con 0x55fd0dc26590 2024-09-17T03:04:33.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe994ff9640 1 -- 172.21.15.104:0/1333989375 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a4062920 con 0x55fd0dc26590 2024-09-17T03:04:33.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.541+0000 7fe994ff9640 1 -- 172.21.15.104:0/1333989375 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4061b80 con 0x55fd0dc26590 2024-09-17T03:04:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 -- 172.21.15.104:0/1333989375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 msgr2=0x55fd0e003520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 --2- 172.21.15.104:0/1333989375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e003520 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fe9a409ad50 tx=0x7fe9a4000ed0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 -- 172.21.15.104:0/1333989375 shutdown_connections 2024-09-17T03:04:33.546 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 --2- 172.21.15.104:0/1333989375 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 0x55fd0e003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 --2- 172.21.15.104:0/1333989375 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e003520 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 --2- 172.21.15.104:0/1333989375 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e006cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 -- 172.21.15.104:0/1333989375 >> 172.21.15.104:0/1333989375 conn(0x55fd0dc3b3c0 msgr2=0x55fd0dff01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 -- 172.21.15.104:0/1333989375 shutdown_connections 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.542+0000 7fe9bca59740 1 -- 172.21.15.104:0/1333989375 wait complete. 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.543+0000 7fe9bca59740 1 -- start start 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.543+0000 7fe9bca59740 1 Processor -- start 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e02d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9bca59740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 0x55fd0e0b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9bca59740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55fd0e037a80 con 0x55fd0dc26590 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9bca59740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fd0e042bc0 con 0x55fd0dc1e3b0 2024-09-17T03:04:33.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9bca59740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55fd0e004820 con 0x55fd0dc47270 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9bca59740 10 client.0 _ll_register_callbacks cb 0x7fe9a80044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e0b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51752/0 (socket says 172.21.15.104:51752) 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/2507286319 learned_addr learned my addr 172.21.15.104:0/2507286319 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9af7fe640 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 0x55fd0e0b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e02d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/2507286319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 msgr2=0x55fd0e0b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 0x55fd0e0b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/2507286319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 msgr2=0x55fd0e02d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e02d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 -- 172.21.15.104:0/2507286319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd0e0b38d0 con 0x55fd0dc26590 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9ae7fc640 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e0b3390 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400cd60 tx=0x7fe9a406c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f6e700bf97b020 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe98e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:04:33.548 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2507286319 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a405ef70 con 0x55fd0dc26590 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2507286319 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7fe9a4061b80 con 0x55fd0dc26590 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe9bca59740 1 -- 172.21.15.104:0/2507286319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9a4062920 con 0x55fd0dc26590 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.545+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2507286319 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fe9a4061d80 con 0x55fd0dc26590 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9bca59740 10 client.7974 fetch_fsmap learned FSMap version 69 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9bca59740 1 -- 172.21.15.104:0/2507286319 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55fd0e042150 con 0x55fd0dc26590 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2507286319 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9a4062920 con 0x55fd0dc26590 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2507286319 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7fe9a405e270 con 0x55fd0dc26590 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9bca59740 10 client.7974 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9bca59740 10 client.7974 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9bca59740 20 client.7974 populate_metadata read hostname 'smithi104' 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] conn(0x55fd0e001400 0x55fd0e001810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9bca59740 4 client.7974 mds_command: new command op to 7791 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:04:33.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9bca59740 1 -- 172.21.15.104:0/2507286319 --> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] -- command(tid 0: {"prefix": "status"}) -- 0x55fd0df5f220 con 0x55fd0e001400 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] conn(0x55fd0e001400 0x55fd0e001810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe98e7fc640 10 client.7974 ms_handle_connect on v2:172.21.15.104:6834/2260610756 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.546+0000 7fe9aeffd640 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] conn(0x55fd0e001400 0x55fd0e001810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e7b56c3ed0fcec3 server_cookie=f5d14240a367f66d in_seq=0 out_seq=0 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe98e7fc640 1 -- 172.21.15.104:0/2507286319 <== mds.0 v2:172.21.15.104:6834/2260610756 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fd0df5f220 con 0x55fd0e001400 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe98e7fc640 10 client.7974 handle_command_reply: tid=0 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 client.7974 shutdown 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 -- 172.21.15.104:0/2507286319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 msgr2=0x55fd0e0b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e0b3390 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400cd60 tx=0x7fe9a406c310 comp rx=0 tx=0).stop 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 -- 172.21.15.104:0/2507286319 shutdown_connections 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.104:6834/2260610756,v1:172.21.15.104:6835/2260610756] conn(0x55fd0e001400 0x55fd0e001810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55fd0dc47270 0x55fd0e0b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x55fd0dc26590 0x55fd0e0b3390 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 --2- 172.21.15.104:0/2507286319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fd0dc1e3b0 0x55fd0e02d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe98e7fc640 0 client.7974 ms_handle_reset on v2:172.21.15.104:6834/2260610756 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 -- 172.21.15.104:0/2507286319 >> 172.21.15.104:0/2507286319 conn(0x55fd0dc3b3c0 msgr2=0x55fd0e006cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 -- 172.21.15.104:0/2507286319 shutdown_connections 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 1 -- 172.21.15.104:0/2507286319 wait complete. 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9bca59740 20 client.7974 trim_cache size 0 max 16384 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 7791, 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T03:04:33.551 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T03:04:33.552 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T03:04:33.552 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 9.1239411019999999, 2024-09-17T03:04:33.552 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 69, 2024-09-17T03:04:33.552 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 171, 2024-09-17T03:04:33.552 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 169, 2024-09-17T03:04:33.552 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 13.833595227 2024-09-17T03:04:33.552 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:04:33.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe99c078b90 msgr2=0x7fe99c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe99c078b90 0x7fe99c07b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0005fd0 tx=0x7fe9a00097d0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/473395992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00b6f70 msgr2=0x7fe9b00cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00b6f70 0x7fe9b00cbfb0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c3a0 tx=0x7fe9a400c860 comp rx=0 tx=0).stop 2024-09-17T03:04:33.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/473395992 shutdown_connections 2024-09-17T03:04:33.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe99c078b90 0x7fe99c07b0a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9b00d18e0 0x7fe9b00cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe9b00b6f70 0x7fe9b00cbfb0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.547+0000 7fe9b5a0e640 1 --2- 172.21.15.104:0/473395992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9b00b3b00 0x7fe9b01500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.548+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/473395992 >> 172.21.15.104:0/473395992 conn(0x7fe9b0073df0 msgr2=0x7fe9b00b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.548+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/473395992 shutdown_connections 2024-09-17T03:04:33.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.548+0000 7fe9b5a0e640 1 -- 172.21.15.104:0/473395992 wait complete. 2024-09-17T03:04:33.557 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:04:33.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.671+0000 7fceb260a640 1 -- 172.21.15.104:0/600243214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 msgr2=0x7fce9400ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.671+0000 7fceb260a640 1 --2- 172.21.15.104:0/600243214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 0x7fce9400ba00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fcea4005fd0 tx=0x7fce94005830 comp rx=0 tx=0).stop 2024-09-17T03:04:33.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.672+0000 7fceb260a640 1 -- 172.21.15.104:0/600243214 shutdown_connections 2024-09-17T03:04:33.670 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.672+0000 7fceb260a640 1 --2- 172.21.15.104:0/600243214 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 0x7fce9400ba00 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.672+0000 7fceb260a640 1 -- 172.21.15.104:0/600243214 >> 172.21.15.104:0/600243214 conn(0x7fceac0b2450 msgr2=0x7fceac0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:33.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.672+0000 7fceb260a640 1 -- 172.21.15.104:0/600243214 shutdown_connections 2024-09-17T03:04:33.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.672+0000 7fceb260a640 1 -- 172.21.15.104:0/600243214 wait complete. 2024-09-17T03:04:33.671 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.673+0000 7fceb260a640 1 Processor -- start 2024-09-17T03:04:33.672 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.674+0000 7fceb260a640 1 -- start start 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceb260a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 0x7fceac159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceb260a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac1f4630 0x7fceac1f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceb260a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fceac0b48d0 0x7fceac0b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceb260a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fceac073240 con 0x7fce94005340 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceb260a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fceac06fe60 con 0x7fceac1f4630 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceb260a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fceac0733c0 con 0x7fceac0b48d0 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 0x7fceac159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 0x7fceac159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:51760/0 (socket says 172.21.15.104:51760) 2024-09-17T03:04:33.675 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 -- 172.21.15.104:0/760739553 learned_addr learned my addr 172.21.15.104:0/760739553 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 -- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fceac0b48d0 msgr2=0x7fceac0b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fceac0b48d0 0x7fceac0b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 -- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac1f4630 msgr2=0x7fceac1f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceab7fe640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac1f4630 0x7fceac1f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac1f4630 0x7fceac1f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 -- 172.21.15.104:0/760739553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac1f80b0 con 0x7fce94005340 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.675+0000 7fceabfff640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 0x7fceac159380 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fce9c006430 tx=0x7fce9c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.676+0000 7fcea8ff9640 1 -- 172.21.15.104:0/760739553 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c015070 con 0x7fce94005340 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.676+0000 7fcea8ff9640 1 -- 172.21.15.104:0/760739553 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce9c011840 con 0x7fce94005340 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.676+0000 7fcea8ff9640 1 -- 172.21.15.104:0/760739553 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c011c90 con 0x7fce94005340 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.676+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceac0b5220 con 0x7fce94005340 2024-09-17T03:04:33.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.676+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceac0ae7e0 con 0x7fce94005340 2024-09-17T03:04:33.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.677+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceac073740 con 0x7fce94005340 2024-09-17T03:04:33.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.678+0000 7fcea8ff9640 1 -- 172.21.15.104:0/760739553 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce9c018070 con 0x7fce94005340 2024-09-17T03:04:33.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.678+0000 7fcea8ff9640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce98078bc0 0x7fce9807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:33.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.678+0000 7fcea8ff9640 1 -- 172.21.15.104:0/760739553 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7fce9c09b870 con 0x7fce94005340 2024-09-17T03:04:33.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.678+0000 7fceab7fe640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce98078bc0 0x7fce9807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:33.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.679+0000 7fceab7fe640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce98078bc0 0x7fce9807b0d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fceac1ee1e0 tx=0x7fcea0006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:33.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.683+0000 7fcea8ff9640 1 -- 172.21.15.104:0/760739553 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fceac0b5220 con 0x7fce94005340 2024-09-17T03:04:33.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.891+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fceac15f440 con 0x7fce94005340 2024-09-17T03:04:33.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.892+0000 7fcea8ff9640 1 -- 172.21.15.104:0/760739553 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) ==== 53+0+73 (secure 0 0 0) 0x7fceac1f80b0 con 0x7fce94005340 2024-09-17T03:04:33.890 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.893+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce98078bc0 msgr2=0x7fce9807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce98078bc0 0x7fce9807b0d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fceac1ee1e0 tx=0x7fcea0006b10 comp rx=0 tx=0).stop 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 msgr2=0x7fceac159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 0x7fceac159380 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fce9c006430 tx=0x7fce9c0039c0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 shutdown_connections 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fce98078bc0 0x7fce9807b0d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac1f4630 0x7fceac1f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fceac0b48d0 0x7fceac0b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 --2- 172.21.15.104:0/760739553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fce94005340 0x7fceac159380 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:33.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 >> 172.21.15.104:0/760739553 conn(0x7fceac0b2450 msgr2=0x7fceac15a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:33.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 shutdown_connections 2024-09-17T03:04:33.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:33.894+0000 7fceb260a640 1 -- 172.21.15.104:0/760739553 wait complete. 2024-09-17T03:04:33.903 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:04:33.903 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:04:33.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T03:04:33.903 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:04:33.904 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:04:33.904 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:04:33.904 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:04:33.904 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:04:33.904 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:04:33.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:33.904 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T03:04:33.920 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:04:33.920 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:33.921 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42225sec preferred_lft 42225sec 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:33.922 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:04:33.923 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:04:33.923 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T03:04:33.923 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:33.923 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:04:33.923 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:04:33.923 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T03:04:33.923 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:33.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:33.923 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:04:33.983 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T03:04:33.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:33.985 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T03:04:34.041 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T03:04:34.041 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:04:34.041 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:04:34.041 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:04:34.041 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:04:34.042 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:04:34.042 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T03:04:34.042 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:04:34.042 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:04:34.042 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:04:34.042 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T03:04:34.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:04:34.161 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:04:34.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:34.168 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T03:04:34.183 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:04:34.183 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:04:34.184 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:04:34.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:34.184 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T03:04:34.248 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:04:34.248 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:04:34.303 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:04:34.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:04:34.304 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:04:34.359 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:04:34.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:34.359 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:04:34.453 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:04:34.453 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:04:34.453 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:04:34.465 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:04:34.465 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:04:34.465 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:04:34.465 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:04:34.465 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:04:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:04:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:04:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:04:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:04:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:04:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:04:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:04:34.471 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:04:34.472 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:04:34.472 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:04:34.472 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:04:34.472 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:04:34.472 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:04:34.474 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:04:34.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:34.474 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:04:34.499 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:04:34.589 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:04:34.593 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:04:34.599 INFO:teuthology.orchestra.run.smithi104.stdout:client6452 2024-09-17T03:04:34.599 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:04:34.599 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:34.618 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:04:34.770 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.772+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1257135420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd74072470 msgr2=0x7fdd74072880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.772+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1257135420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd74072470 0x7fdd74072880 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fdd7406ecb0 tx=0x7fdd6802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.772+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1257135420 shutdown_connections 2024-09-17T03:04:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.772+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1257135420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd74072470 0x7fdd74072880 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.772+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1257135420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd7415b7f0 0x7fdd7415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.772+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1257135420 >> 172.21.15.104:0/1257135420 conn(0x7fdd740b2450 msgr2=0x7fdd740b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.772+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1257135420 shutdown_connections 2024-09-17T03:04:34.771 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.772+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1257135420 wait complete. 2024-09-17T03:04:34.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.773+0000 7fdd7c64d640 1 Processor -- start 2024-09-17T03:04:34.772 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.773+0000 7fdd7c64d640 1 -- start start 2024-09-17T03:04:34.774 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7c64d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd74072470 0x7fdd741488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7c64d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd74072dc0 0x7fdd741f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7c64d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd7415b7f0 0x7fdd740aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7c64d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7415fe30 con 0x7fdd7415b7f0 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7c64d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdd740cf4a0 con 0x7fdd74072dc0 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7c64d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7415ffb0 con 0x7fdd74072470 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd7415b7f0 0x7fdd740aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd7415b7f0 0x7fdd740aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46016/0 (socket says 172.21.15.104:46016) 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 -- 172.21.15.104:0/1059598308 learned_addr learned my addr 172.21.15.104:0/1059598308 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd79be8640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd74072dc0 0x7fdd741f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7a3e9640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd74072470 0x7fdd741488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:34.775 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 -- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd74072470 msgr2=0x7fdd741488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd74072470 0x7fdd741488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 -- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd74072dc0 msgr2=0x7fdd741f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd74072dc0 0x7fdd741f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 -- 172.21.15.104:0/1059598308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd74149830 con 0x7fdd7415b7f0 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd79be8640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd74072dc0 0x7fdd741f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7a3e9640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd74072470 0x7fdd741488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd7abea640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd7415b7f0 0x7fdd740aa8b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400b9e0 tx=0x7fdd6400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.775+0000 7fdd72ffd640 1 -- 172.21.15.104:0/1059598308 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64019070 con 0x7fdd7415b7f0 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.776+0000 7fdd72ffd640 1 -- 172.21.15.104:0/1059598308 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd6400cc10 con 0x7fdd7415b7f0 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.776+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd74149270 con 0x7fdd7415b7f0 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.776+0000 7fdd72ffd640 1 -- 172.21.15.104:0/1059598308 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd640146a0 con 0x7fdd7415b7f0 2024-09-17T03:04:34.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.776+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd741f71b0 con 0x7fdd7415b7f0 2024-09-17T03:04:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.776+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd74148fe0 con 0x7fdd7415b7f0 2024-09-17T03:04:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.777+0000 7fdd72ffd640 1 -- 172.21.15.104:0/1059598308 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd6401c070 con 0x7fdd7415b7f0 2024-09-17T03:04:34.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.778+0000 7fdd72ffd640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdd60078b90 0x7fdd6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.778+0000 7fdd72ffd640 1 -- 172.21.15.104:0/1059598308 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7fdd6409aaa0 con 0x7fdd7415b7f0 2024-09-17T03:04:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.778+0000 7fdd7a3e9640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdd60078b90 0x7fdd6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:34.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.779+0000 7fdd7a3e9640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdd60078b90 0x7fdd6007b0a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c009890 tx=0x7fdd6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:34.781 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.782+0000 7fdd72ffd640 1 -- 172.21.15.104:0/1059598308 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd64062ed0 con 0x7fdd7415b7f0 2024-09-17T03:04:34.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.992+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdd74160530 con 0x7fdd7415b7f0 2024-09-17T03:04:34.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.993+0000 7fdd72ffd640 1 -- 172.21.15.104:0/1059598308 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) ==== 53+0+73 (secure 0 0 0) 0x7fdd640627d0 con 0x7fdd7415b7f0 2024-09-17T03:04:34.991 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:04:34.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdd60078b90 msgr2=0x7fdd6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:34.993 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdd60078b90 0x7fdd6007b0a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c009890 tx=0x7fdd6c008040 comp rx=0 tx=0).stop 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd7415b7f0 msgr2=0x7fdd740aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd7415b7f0 0x7fdd740aa8b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400b9e0 tx=0x7fdd6400bea0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 shutdown_connections 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fdd60078b90 0x7fdd6007b0a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd74072dc0 0x7fdd741f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fdd7415b7f0 0x7fdd740aa8b0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 --2- 172.21.15.104:0/1059598308 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd74072470 0x7fdd741488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 >> 172.21.15.104:0/1059598308 conn(0x7fdd740b2450 msgr2=0x7fdd74157d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 shutdown_connections 2024-09-17T03:04:34.994 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:34.995+0000 7fdd7c64d640 1 -- 172.21.15.104:0/1059598308 wait complete. 2024-09-17T03:04:35.004 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:04:35.005 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:04:35.005 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T03:04:35.005 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:04:35.005 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:04:35.005 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:04:35.005 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:04:35.005 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:04:35.005 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:04:35.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:35.005 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T03:04:35.025 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:04:35.028 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:04:35.028 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:04:35.028 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:04:35.029 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:35.030 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:04:35.030 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:35.030 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:04:35.030 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42219sec preferred_lft 42219sec 2024-09-17T03:04:35.030 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T03:04:35.030 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:35.030 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:04:35.030 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T03:04:35.031 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:04:35.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:35.032 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:04:35.093 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T03:04:35.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:35.095 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T03:04:35.153 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T03:04:35.154 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:04:35.154 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:04:35.154 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:04:35.154 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:04:35.154 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:04:35.154 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T03:04:35.154 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:04:35.154 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:04:35.154 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:04:35.154 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T03:04:35.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:04:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:04:35.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:04:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:04:35.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:35.287 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T03:04:35.303 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:04:35.303 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:04:35.303 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:04:35.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:35.304 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T03:04:35.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:04:35.370 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:04:35.425 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:04:35.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:04:35.425 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:04:35.481 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:04:35.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:35.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:04:35.575 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:04:35.576 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:04:35.576 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:04:35.587 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:04:35.587 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:04:35.587 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:04:35.587 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:04:35.587 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:04:35.592 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:04:35.592 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:04:35.592 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:04:35.592 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:04:35.592 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:04:35.593 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:04:35.593 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:04:35.593 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:04:35.593 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:04:35.593 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:04:35.593 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:04:35.593 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:04:35.594 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:04:35.595 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:04:35.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:04:35.595 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:04:35.619 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:04:35.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:04:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:04:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:04:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:04:35.716 INFO:teuthology.orchestra.run.smithi192.stdout:client6458 2024-09-17T03:04:35.716 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:04:35.716 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:04:35.733 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:04:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.851+0000 7ff3072de640 1 -- 172.21.15.104:0/2756195427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 msgr2=0x7ff2ec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.851+0000 7ff3072de640 1 --2- 172.21.15.104:0/2756195427 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 0x7ff2ec004800 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff3000b1380 tx=0x7ff2ec005830 comp rx=0 tx=0).stop 2024-09-17T03:04:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.851+0000 7ff30587b640 1 -- 172.21.15.104:0/2756195427 reap_dead start 2024-09-17T03:04:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.851+0000 7ff3072de640 1 -- 172.21.15.104:0/2756195427 shutdown_connections 2024-09-17T03:04:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.851+0000 7ff3072de640 1 -- 172.21.15.104:0/2756195427 >> 172.21.15.104:0/2756195427 conn(0x7ff30006d200 msgr2=0x7ff30006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:35.854 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.851+0000 7ff3072de640 1 -- 172.21.15.104:0/2756195427 shutdown_connections 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.851+0000 7ff3072de640 1 -- 172.21.15.104:0/2756195427 wait complete. 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.853+0000 7ff3072de640 1 Processor -- start 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.853+0000 7ff3072de640 1 -- start start 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff3072de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 0x7ff3001474a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff3072de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3000aa4a0 0x7ff3001f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff3072de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3000aa8b0 0x7ff3001f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff3072de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff3001616c0 con 0x7ff2ec003fd0 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff3072de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff300074770 con 0x7ff3000aa8b0 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff3072de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff3000d1c40 con 0x7ff3000aa4a0 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff30507a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 0x7ff3001474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff30507a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 0x7ff3001474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46036/0 (socket says 172.21.15.104:46036) 2024-09-17T03:04:35.855 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff30507a640 1 -- 172.21.15.104:0/3047999905 learned_addr learned my addr 172.21.15.104:0/3047999905 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff304879640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3000aa4a0 0x7ff3001f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.854+0000 7ff30587b640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3000aa8b0 0x7ff3001f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff30507a640 1 -- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3000aa4a0 msgr2=0x7ff3001f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff30507a640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3000aa4a0 0x7ff3001f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff30507a640 1 -- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3000aa8b0 msgr2=0x7ff3001f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff30507a640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3000aa8b0 0x7ff3001f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff30507a640 1 -- 172.21.15.104:0/3047999905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3000aae40 con 0x7ff2ec003fd0 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff30507a640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 0x7ff3001474a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc011b10 tx=0x7ff2fc009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff2f5ffb640 1 -- 172.21.15.104:0/3047999905 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc01e070 con 0x7ff2ec003fd0 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff2f5ffb640 1 -- 172.21.15.104:0/3047999905 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2fc004050 con 0x7ff2ec003fd0 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3000ab120 con 0x7ff2ec003fd0 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff2f5ffb640 1 -- 172.21.15.104:0/3047999905 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc00fea0 con 0x7ff2ec003fd0 2024-09-17T03:04:35.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.855+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3000ab6e0 con 0x7ff2ec003fd0 2024-09-17T03:04:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.856+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300069950 con 0x7ff2ec003fd0 2024-09-17T03:04:35.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.857+0000 7ff2f5ffb640 1 -- 172.21.15.104:0/3047999905 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2fc021070 con 0x7ff2ec003fd0 2024-09-17T03:04:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.857+0000 7ff2f5ffb640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2e4078bc0 0x7ff2e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.857+0000 7ff2f5ffb640 1 -- 172.21.15.104:0/3047999905 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7ff2fc09b730 con 0x7ff2ec003fd0 2024-09-17T03:04:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.858+0000 7ff304879640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2e4078bc0 0x7ff2e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:35.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.858+0000 7ff304879640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2e4078bc0 0x7ff2e407b0d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0033000 tx=0x7ff2f002d070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:35.860 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:35.862+0000 7ff2f5ffb640 1 -- 172.21.15.104:0/3047999905 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2fc063650 con 0x7ff2ec003fd0 2024-09-17T03:04:36.069 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.071+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff300069670 con 0x7ff2ec003fd0 2024-09-17T03:04:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.071+0000 7ff2f5ffb640 1 -- 172.21.15.104:0/3047999905 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7ff2fc068080 con 0x7ff2ec003fd0 2024-09-17T03:04:36.070 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:04:36.070 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":69,"btime":"2024-09-17T03:04:26:435587+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1948243703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1948243703},{"type":"v1","addr":"172.21.15.192:6836","nonce":1948243703}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3037806992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3037806992},{"type":"v1","addr":"172.21.15.192:6837","nonce":3037806992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2087460219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2087460219},{"type":"v1","addr":"172.21.15.104:6833","nonce":2087460219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:04:23.753525+0000","modified":"2024-09-17T03:04:25.785201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/2260610756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2260610756},{"type":"v1","addr":"172.21.15.104:6835","nonce":2260610756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7791,"qdb_cluster":[7791]},"id":10}]} 2024-09-17T03:04:36.070 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 69 2024-09-17T03:04:36.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2e4078bc0 msgr2=0x7ff2e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2e4078bc0 0x7ff2e407b0d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0033000 tx=0x7ff2f002d070 comp rx=0 tx=0).stop 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 msgr2=0x7ff3001474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 0x7ff3001474a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc011b10 tx=0x7ff2fc009e90 comp rx=0 tx=0).stop 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 shutdown_connections 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2e4078bc0 0x7ff2e407b0d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3000aa8b0 0x7ff3001f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3000aa4a0 0x7ff3001f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 --2- 172.21.15.104:0/3047999905 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2ec003fd0 0x7ff3001474a0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 >> 172.21.15.104:0/3047999905 conn(0x7ff30006d200 msgr2=0x7ff30006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 shutdown_connections 2024-09-17T03:04:36.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.074+0000 7ff3072de640 1 -- 172.21.15.104:0/3047999905 wait complete. 2024-09-17T03:04:36.084 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-17T03:04:36.208 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":7791,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.778486752999999,"mdsmap_epoch":69,"osdmap_epoch":171,"osdmap_epoch_barrier":169,"uptime":16.488144372000001} 2024-09-17T03:04:36.209 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 7791, "mdsmap_epoch": 69, "osdmap_epoch": 171, "osdmap_epoch_barrier": 169, "rank_uptime": 11.778486753, "state": "up:active", "uptime": 16.488144372, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:04:36.209 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-17T03:04:36.325 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.327+0000 7f3f763c6640 1 -- 172.21.15.104:0/2062997294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f700b3c90 msgr2=0x7f3f700b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:36.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.327+0000 7f3f763c6640 1 --2- 172.21.15.104:0/2062997294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f700b3c90 0x7f3f700b29a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3f700cdb50 tx=0x7f3f6002a530 comp rx=0 tx=0).stop 2024-09-17T03:04:36.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.327+0000 7f3f763c6640 1 -- 172.21.15.104:0/2062997294 shutdown_connections 2024-09-17T03:04:36.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.327+0000 7f3f763c6640 1 --2- 172.21.15.104:0/2062997294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f700b3c90 0x7f3f700b29a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:36.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.327+0000 7f3f763c6640 1 -- 172.21.15.104:0/2062997294 >> 172.21.15.104:0/2062997294 conn(0x7f3f7009ba40 msgr2=0x7f3f7009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:36.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.327+0000 7f3f763c6640 1 -- 172.21.15.104:0/2062997294 shutdown_connections 2024-09-17T03:04:36.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.327+0000 7f3f763c6640 1 -- 172.21.15.104:0/2062997294 wait complete. 2024-09-17T03:04:36.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.329+0000 7f3f763c6640 1 Processor -- start 2024-09-17T03:04:36.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.329+0000 7f3f763c6640 1 -- start start 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f763c6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f700b3c90 0x7f3f7015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f763c6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f700d0840 0x7f3f700b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f763c6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f700d2d70 0x7f3f700b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f763c6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3f700b30d0 con 0x7f3f700d2d70 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f763c6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3f700ce7c0 con 0x7f3f700b3c90 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f763c6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3f700d0c50 con 0x7f3f700d0840 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f74963640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f700d2d70 0x7f3f700b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f74963640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f700d2d70 0x7f3f700b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:46038/0 (socket says 172.21.15.104:46038) 2024-09-17T03:04:36.330 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f74963640 1 -- 172.21.15.104:0/1618205645 learned_addr learned my addr 172.21.15.104:0/1618205645 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f6ffff640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f700b3c90 0x7f3f7015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.330+0000 7f3f6f7fe640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f700d0840 0x7f3f700b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f74963640 1 -- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f700d0840 msgr2=0x7f3f700b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f74963640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f700d0840 0x7f3f700b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f74963640 1 -- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f700b3c90 msgr2=0x7f3f7015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f74963640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f700b3c90 0x7f3f7015bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f74963640 1 -- 172.21.15.104:0/1618205645 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7015c2b0 con 0x7f3f700d2d70 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f74963640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f700d2d70 0x7f3f700b6b50 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c700 tx=0x7f3f6800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f6cff9640 1 -- 172.21.15.104:0/1618205645 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f68003b70 con 0x7f3f700d2d70 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f6cff9640 1 -- 172.21.15.104:0/1618205645 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f68003d10 con 0x7f3f700d2d70 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f700b24b0 con 0x7f3f700d2d70 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f6cff9640 1 -- 172.21.15.104:0/1618205645 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800aa50 con 0x7f3f700d2d70 2024-09-17T03:04:36.331 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.331+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f701f7690 con 0x7f3f700d2d70 2024-09-17T03:04:36.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.332+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f700a07a0 con 0x7f3f700d2d70 2024-09-17T03:04:36.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.333+0000 7f3f6cff9640 1 -- 172.21.15.104:0/1618205645 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f6800abf0 con 0x7f3f700d2d70 2024-09-17T03:04:36.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.334+0000 7f3f6cff9640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:04:36.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.334+0000 7f3f6cff9640 1 -- 172.21.15.104:0/1618205645 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5738+0+0 (secure 0 0 0) 0x7f3f6809b500 con 0x7f3f700d2d70 2024-09-17T03:04:36.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.334+0000 7f3f6ffff640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:04:36.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.334+0000 7f3f6ffff640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3f60034000 tx=0x7f3f60004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:04:36.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.337+0000 7f3f6cff9640 1 -- 172.21.15.104:0/1618205645 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3f68063a00 con 0x7f3f700d2d70 2024-09-17T03:04:36.512 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:36.514+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f3f700b4dd0 con 0x7f3f700d2d70 2024-09-17T03:04:37.310 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:04:37.313 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:04:37.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.504+0000 7f3f6cff9640 1 -- 172.21.15.104:0/1618205645 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v172) ==== 181+0+0 (secure 0 0 0) 0x7f3f68063300 con 0x7f3f700d2d70 2024-09-17T03:04:37.502 INFO:teuthology.orchestra.run.smithi104.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-17T03:04:37.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3f5c078bc0 msgr2=0x7f3f5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:37.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3f60034000 tx=0x7f3f60004730 comp rx=0 tx=0).stop 2024-09-17T03:04:37.505 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f700d2d70 msgr2=0x7f3f700b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f700d2d70 0x7f3f700b6b50 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c700 tx=0x7f3f6800cbc0 comp rx=0 tx=0).stop 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 shutdown_connections 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3f5c078bc0 0x7f3f5c07b0d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3f700d2d70 0x7f3f700b6b50 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f700d0840 0x7f3f700b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 --2- 172.21.15.104:0/1618205645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f700b3c90 0x7f3f7015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 >> 172.21.15.104:0/1618205645 conn(0x7f3f7009ba40 msgr2=0x7f3f700b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 shutdown_connections 2024-09-17T03:04:37.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:04:37.507+0000 7f3f763c6640 1 -- 172.21.15.104:0/1618205645 wait complete. 2024-09-17T03:04:37.519 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-17T03:04:37.643 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_mon_report_interval":"5"} 2024-09-17T03:04:37.643 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-17T03:04:37.643 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-17T03:04:37.755 INFO:teuthology.orchestra.run.smithi104.stdout:{"mon_tick_interval":"5"} 2024-09-17T03:04:37.756 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-17T03:04:37.756 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-17T03:04:37.756 DEBUG:teuthology.orchestra.run.smithi104:> stdin-killer -- python3 -c ' 2024-09-17T03:04:37.756 DEBUG:teuthology.orchestra.run.smithi104:> import time 2024-09-17T03:04:37.756 DEBUG:teuthology.orchestra.run.smithi104:> import datetime 2024-09-17T03:04:37.756 DEBUG:teuthology.orchestra.run.smithi104:> import subprocess 2024-09-17T03:04:37.756 DEBUG:teuthology.orchestra.run.smithi104:> import os 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> # Write some buffered data through before going full, all should be well 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> print("writing some data through which we expect to succeed") 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> bytes = 0 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(f) 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> # buffered IO, the error should always only appear from fsync and not 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> # from write 2024-09-17T03:04:37.757 DEBUG:teuthology.orchestra.run.smithi104:> full = False 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> for n in range(0, int(32 * 1.1)): 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> try: 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> except OSError as e: 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> if False: 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> raise 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> else: 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> full = True 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> break 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:04:37.758 DEBUG:teuthology.orchestra.run.smithi104:> try: 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> os.fsync(f) 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> print("fsync'"'"'ed successfully") 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> except OSError as e: 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> full = True 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> break 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> else: 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> if n > 32 * 0.9: 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> # Be cautious in the last region where we expect to hit 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> time.sleep(15.0) 2024-09-17T03:04:37.759 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> if not full: 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> # close() should not raise an error because we already caught it in 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> # since then because all IOs got cancelled on the full flag. 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> print("calling close") 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> os.close(f) 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> print("close() did not raise error") 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-17T03:04:37.760 DEBUG:teuthology.orchestra.run.smithi104:> ' 2024-09-17T03:05:07.370 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:05:07.374 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:05:37.504 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:05:37.509 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:05:39.876 INFO:teuthology.orchestra.run.smithi104.stdout:writing some data through which we expect to succeed 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 1.00 MB 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 2.00 MB 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.877 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 3.00 MB 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 4.00 MB 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 5.00 MB 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 6.00 MB 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.878 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 7.00 MB 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 8.00 MB 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 9.00 MB 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 10.00 MB 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 11.00 MB 2024-09-17T03:05:39.879 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 12.00 MB 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 13.00 MB 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 14.00 MB 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 15.00 MB 2024-09-17T03:05:39.880 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 16.00 MB 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 17.00 MB 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 18.00 MB 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 19.00 MB 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.881 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 20.00 MB 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 21.00 MB 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 22.00 MB 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 23.00 MB 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.882 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 24.00 MB 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 25.00 MB 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 26.00 MB 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 27.00 MB 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 28.00 MB 2024-09-17T03:05:39.883 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 29.00 MB 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 30.00 MB 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 31.00 MB 2024-09-17T03:05:39.884 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 32.00 MB 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:fsync'ed successfully 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:Not full yet after 33.00 MB 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:Reached fullness after 33.00 MB 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:calling close 2024-09-17T03:05:39.885 INFO:teuthology.orchestra.run.smithi104.stdout:close() did not raise error 2024-09-17T03:05:39.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:05:39.890 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:05:39.890 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:05:39.930 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:05:39.974 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:05:39.974 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:05:39.974 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:05:39.974 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:39.991 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:05:39.991 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:40.049 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:05:40.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.209+0000 7f59288e5640 1 -- 172.21.15.104:0/891833213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 msgr2=0x7f590c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.209+0000 7f59288e5640 1 --2- 172.21.15.104:0/891833213 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 0x7f590c004c10 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5918009b50 tx=0x7f590c005830 comp rx=0 tx=0).stop 2024-09-17T03:05:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.209+0000 7f5922d9d640 1 -- 172.21.15.104:0/891833213 reap_dead start 2024-09-17T03:05:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.209+0000 7f59288e5640 1 -- 172.21.15.104:0/891833213 shutdown_connections 2024-09-17T03:05:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.209+0000 7f59288e5640 1 -- 172.21.15.104:0/891833213 >> 172.21.15.104:0/891833213 conn(0x7f59240d28a0 msgr2=0x7f59240d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.210+0000 7f59288e5640 1 -- 172.21.15.104:0/891833213 shutdown_connections 2024-09-17T03:05:40.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.210+0000 7f59288e5640 1 -- 172.21.15.104:0/891833213 wait complete. 2024-09-17T03:05:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.211+0000 7f59288e5640 1 Processor -- start 2024-09-17T03:05:40.211 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.212+0000 7f59288e5640 1 -- start start 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f59288e5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 0x7f59241e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f59288e5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59240af610 0x7f592406e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f59288e5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59241f9080 0x7f59241f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f59288e5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f59240cf3c0 con 0x7f590c004800 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f59288e5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f59240b35b0 con 0x7f59240af610 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f59288e5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f59240cf540 con 0x7f59241f9080 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 0x7f59241e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 0x7f59241e4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36622/0 (socket says 172.21.15.104:36622) 2024-09-17T03:05:40.214 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 -- 172.21.15.104:0/2269663031 learned_addr learned my addr 172.21.15.104:0/2269663031 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 -- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59241f9080 msgr2=0x7f59241f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59241f9080 0x7f59241f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 -- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59240af610 msgr2=0x7f592406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59240af610 0x7f592406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 -- 172.21.15.104:0/2269663031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592406e0d0 con 0x7f590c004800 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f592259c640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 0x7f59241e4c20 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5914006400 tx=0x7f59140039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.213+0000 7f5912ffd640 1 -- 172.21.15.104:0/2269663031 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914015070 con 0x7f590c004800 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.214+0000 7f5912ffd640 1 -- 172.21.15.104:0/2269663031 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5914011900 con 0x7f590c004800 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.214+0000 7f5912ffd640 1 -- 172.21.15.104:0/2269663031 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914011d50 con 0x7f590c004800 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.214+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59241f99d0 con 0x7f590c004800 2024-09-17T03:05:40.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.214+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59240b2b60 con 0x7f590c004800 2024-09-17T03:05:40.216 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.215+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59240cfaa0 con 0x7f590c004800 2024-09-17T03:05:40.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.215+0000 7f5912ffd640 1 -- 172.21.15.104:0/2269663031 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5914018070 con 0x7f590c004800 2024-09-17T03:05:40.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.216+0000 7f5912ffd640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5904078b90 0x7f590407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:40.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.216+0000 7f5912ffd640 1 -- 172.21.15.104:0/2269663031 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7f591409bb30 con 0x7f590c004800 2024-09-17T03:05:40.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.216+0000 7f5912ffd640 1 -- 172.21.15.104:0/2269663031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7f59040807d0 con 0x7f590c004800 2024-09-17T03:05:40.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.216+0000 7f5921d9b640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5904078b90 0x7f590407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:40.217 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.217+0000 7f5921d9b640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5904078b90 0x7f590407b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5918035000 tx=0x7f5918004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:40.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.221+0000 7f5912ffd640 1 -- 172.21.15.104:0/2269663031 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59241f99d0 con 0x7f590c004800 2024-09-17T03:05:40.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.404+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f59240b72d0 con 0x7f590c004800 2024-09-17T03:05:40.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.404+0000 7f5912ffd640 1 -- 172.21.15.104:0/2269663031 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v173) ==== 80+0+0 (secure 0 0 0) 0x7f592406e0d0 con 0x7f590c004800 2024-09-17T03:05:40.404 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:05:40.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.406+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5904078b90 msgr2=0x7f590407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5904078b90 0x7f590407b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5918035000 tx=0x7f5918004730 comp rx=0 tx=0).stop 2024-09-17T03:05:40.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 msgr2=0x7f59241e4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 0x7f59241e4c20 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5914006400 tx=0x7f59140039c0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 shutdown_connections 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5904078b90 0x7f590407b0a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59240af610 0x7f592406e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59241f9080 0x7f59241f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 --2- 172.21.15.104:0/2269663031 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f590c004800 0x7f59241e4c20 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 >> 172.21.15.104:0/2269663031 conn(0x7f59240d28a0 msgr2=0x7f5924070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 shutdown_connections 2024-09-17T03:05:40.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.407+0000 7f59288e5640 1 -- 172.21.15.104:0/2269663031 wait complete. 2024-09-17T03:05:40.417 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:05:40.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:05:40.418 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:05:40.447 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:05:40.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:05:40.447 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:05:40.503 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:05:40.503 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:05:40.504 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:40.524 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:05:40.524 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:40.584 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:05:40.698 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.698+0000 7feb5070b640 1 -- 172.21.15.104:0/596917476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb30004800 msgr2=0x7feb30004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.698+0000 7feb5070b640 1 --2- 172.21.15.104:0/596917476 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb30004800 0x7feb30004c10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009b50 tx=0x7feb30005830 comp rx=0 tx=0).stop 2024-09-17T03:05:40.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.698+0000 7feb4eca8640 1 -- 172.21.15.104:0/596917476 reap_dead start 2024-09-17T03:05:40.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.698+0000 7feb5070b640 1 -- 172.21.15.104:0/596917476 shutdown_connections 2024-09-17T03:05:40.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.698+0000 7feb5070b640 1 -- 172.21.15.104:0/596917476 >> 172.21.15.104:0/596917476 conn(0x7feb4806d200 msgr2=0x7feb4806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:40.699 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.698+0000 7feb5070b640 1 -- 172.21.15.104:0/596917476 shutdown_connections 2024-09-17T03:05:40.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.699+0000 7feb5070b640 1 -- 172.21.15.104:0/596917476 wait complete. 2024-09-17T03:05:40.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.700+0000 7feb5070b640 1 Processor -- start 2024-09-17T03:05:40.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.700+0000 7feb5070b640 1 -- start start 2024-09-17T03:05:40.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.701+0000 7feb5070b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb30004800 0x7feb4814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:40.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb5070b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb481553b0 0x7feb480aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:40.705 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb5070b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48157560 0x7feb480ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:40.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb5070b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb4815cd90 con 0x7feb48157560 2024-09-17T03:05:40.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb5070b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb48074770 con 0x7feb481553b0 2024-09-17T03:05:40.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb5070b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7feb4815cf10 con 0x7feb30004800 2024-09-17T03:05:40.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48157560 0x7feb480ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:40.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48157560 0x7feb480ab1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36650/0 (socket says 172.21.15.104:36650) 2024-09-17T03:05:40.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 -- 172.21.15.104:0/2048606688 learned_addr learned my addr 172.21.15.104:0/2048606688 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:40.706 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4e4a7640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb30004800 0x7feb4814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:40.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 -- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb30004800 msgr2=0x7feb4814a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4dca6640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb481553b0 0x7feb480aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:40.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb30004800 0x7feb4814a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 -- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb481553b0 msgr2=0x7feb480aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb481553b0 0x7feb480aacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 -- 172.21.15.104:0/2048606688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb48157330 con 0x7feb48157560 2024-09-17T03:05:40.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb4eca8640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48157560 0x7feb480ab1f0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7feb480d1770 tx=0x7feb40011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:40.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb46ffd640 1 -- 172.21.15.104:0/2048606688 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4000f920 con 0x7feb48157560 2024-09-17T03:05:40.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb46ffd640 1 -- 172.21.15.104:0/2048606688 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb4000fae0 con 0x7feb48157560 2024-09-17T03:05:40.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb481f3b90 con 0x7feb48157560 2024-09-17T03:05:40.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb46ffd640 1 -- 172.21.15.104:0/2048606688 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb40005020 con 0x7feb48157560 2024-09-17T03:05:40.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.702+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb481f4150 con 0x7feb48157560 2024-09-17T03:05:40.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.703+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb480738d0 con 0x7feb48157560 2024-09-17T03:05:40.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.704+0000 7feb46ffd640 1 -- 172.21.15.104:0/2048606688 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb400051c0 con 0x7feb48157560 2024-09-17T03:05:40.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.705+0000 7feb46ffd640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb34078b90 0x7feb3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:40.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.705+0000 7feb46ffd640 1 -- 172.21.15.104:0/2048606688 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7feb4009b5b0 con 0x7feb48157560 2024-09-17T03:05:40.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.705+0000 7feb46ffd640 1 -- 172.21.15.104:0/2048606688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7feb34080770 con 0x7feb48157560 2024-09-17T03:05:40.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.705+0000 7feb4e4a7640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb34078b90 0x7feb3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.706+0000 7feb4e4a7640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb34078b90 0x7feb3407b0a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7feb38001370 tx=0x7feb38001490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:40.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.709+0000 7feb46ffd640 1 -- 172.21.15.104:0/2048606688 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb40011e20 con 0x7feb48157560 2024-09-17T03:05:40.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.893+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feb4815e760 con 0x7feb48157560 2024-09-17T03:05:40.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.894+0000 7feb46ffd640 1 -- 172.21.15.104:0/2048606688 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v173) ==== 80+0+0 (secure 0 0 0) 0x7feb40063a50 con 0x7feb48157560 2024-09-17T03:05:40.893 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:05:40.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb34078b90 msgr2=0x7feb3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb34078b90 0x7feb3407b0a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7feb38001370 tx=0x7feb38001490 comp rx=0 tx=0).stop 2024-09-17T03:05:40.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48157560 msgr2=0x7feb480ab1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:40.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48157560 0x7feb480ab1f0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7feb480d1770 tx=0x7feb40011bd0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 shutdown_connections 2024-09-17T03:05:40.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb34078b90 0x7feb3407b0a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb481553b0 0x7feb480aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb48157560 0x7feb480ab1f0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.896 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 --2- 172.21.15.104:0/2048606688 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb30004800 0x7feb4814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:40.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 >> 172.21.15.104:0/2048606688 conn(0x7feb4806d200 msgr2=0x7feb4815ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:40.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 shutdown_connections 2024-09-17T03:05:40.897 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:40.896+0000 7feb5070b640 1 -- 172.21.15.104:0/2048606688 wait complete. 2024-09-17T03:05:40.907 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:05:40.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:05:40.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:05:40.940 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:05:40.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:05:40.941 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:05:41.001 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:05:41.001 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:05:41.001 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:41.017 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:05:41.017 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:05:41.017 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:05:41.017 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:41.059 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:05:41.059 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:05:41.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.172+0000 7f368587f640 1 -- 172.21.15.104:0/3000191797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 msgr2=0x7f36800d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.172+0000 7f368587f640 1 --2- 172.21.15.104:0/3000191797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 0x7f36800d34f0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f3678005fd0 tx=0x7f367802aa80 comp rx=0 tx=0).stop 2024-09-17T03:05:41.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.173+0000 7f368587f640 1 -- 172.21.15.104:0/3000191797 shutdown_connections 2024-09-17T03:05:41.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.173+0000 7f368587f640 1 --2- 172.21.15.104:0/3000191797 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 0x7f36800d34f0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.173+0000 7f368587f640 1 --2- 172.21.15.104:0/3000191797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36800b6f70 0x7f368015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.173+0000 7f368587f640 1 -- 172.21.15.104:0/3000191797 >> 172.21.15.104:0/3000191797 conn(0x7f3680073df0 msgr2=0x7f3680068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:41.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.173+0000 7f368587f640 1 -- 172.21.15.104:0/3000191797 shutdown_connections 2024-09-17T03:05:41.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.173+0000 7f368587f640 1 -- 172.21.15.104:0/3000191797 wait complete. 2024-09-17T03:05:41.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.174+0000 7f368587f640 1 Processor -- start 2024-09-17T03:05:41.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.175+0000 7f368587f640 1 -- start start 2024-09-17T03:05:41.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f368587f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36800b3b00 0x7f36801f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f368587f640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36800b6f70 0x7f3680161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f368587f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 0x7f36801500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f368587f640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f36800d3dc0 con 0x7f36800d18e0 2024-09-17T03:05:41.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f368587f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f36800d3c40 con 0x7f36800b3b00 2024-09-17T03:05:41.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f368587f640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f36800d3f40 con 0x7f36800b6f70 2024-09-17T03:05:41.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 0x7f36801500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367f7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 0x7f36801500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36672/0 (socket says 172.21.15.104:36672) 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367f7fe640 1 -- 172.21.15.104:0/1853337455 learned_addr learned my addr 172.21.15.104:0/1853337455 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367e7fc640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36800b6f70 0x7f3680161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367f7fe640 1 -- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36800b6f70 msgr2=0x7f3680161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367f7fe640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36800b6f70 0x7f3680161ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367f7fe640 1 -- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36800b3b00 msgr2=0x7f36801f70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367effd640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36800b3b00 0x7f36801f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367f7fe640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36800b3b00 0x7f36801f70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.176+0000 7f367f7fe640 1 -- 172.21.15.104:0/1853337455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3680160a10 con 0x7f36800d18e0 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.177+0000 7f367f7fe640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 0x7f36801500a0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3678009bf0 tx=0x7f3678003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.177+0000 7f3667fff640 1 -- 172.21.15.104:0/1853337455 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678044070 con 0x7f36800d18e0 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.177+0000 7f3667fff640 1 -- 172.21.15.104:0/1853337455 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3678004250 con 0x7f36800d18e0 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.177+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3680160cf0 con 0x7f36800d18e0 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.177+0000 7f3667fff640 1 -- 172.21.15.104:0/1853337455 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678004660 con 0x7f36800d18e0 2024-09-17T03:05:41.178 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.177+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36801612b0 con 0x7f36800d18e0 2024-09-17T03:05:41.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.178+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3680160780 con 0x7f36800d18e0 2024-09-17T03:05:41.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.179+0000 7f3667fff640 1 -- 172.21.15.104:0/1853337455 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3678047070 con 0x7f36800d18e0 2024-09-17T03:05:41.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.179+0000 7f3667fff640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f366c078bc0 0x7f366c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.179+0000 7f3667fff640 1 -- 172.21.15.104:0/1853337455 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7f36780bbdd0 con 0x7f36800d18e0 2024-09-17T03:05:41.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.180+0000 7f3667fff640 1 -- 172.21.15.104:0/1853337455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7f366c080800 con 0x7f36800d18e0 2024-09-17T03:05:41.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.180+0000 7f367effd640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f366c078bc0 0x7f366c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.180+0000 7f367effd640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f366c078bc0 0x7f366c07b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3670005fd0 tx=0x7f3670005bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:41.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.184+0000 7f3667fff640 1 -- 172.21.15.104:0/1853337455 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f36780bd060 con 0x7f36800d18e0 2024-09-17T03:05:41.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.391+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36800d4460 con 0x7f36800d18e0 2024-09-17T03:05:41.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.392+0000 7f3667fff640 1 -- 172.21.15.104:0/1853337455 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7f3678032030 con 0x7f36800d18e0 2024-09-17T03:05:41.392 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:41.392 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":69,"btime":"2024-09-17T03:04:26:435587+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1948243703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1948243703},{"type":"v1","addr":"172.21.15.192:6836","nonce":1948243703}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3037806992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3037806992},{"type":"v1","addr":"172.21.15.192:6837","nonce":3037806992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2087460219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2087460219},{"type":"v1","addr":"172.21.15.104:6833","nonce":2087460219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:04:23.753525+0000","modified":"2024-09-17T03:04:25.785201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/2260610756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2260610756},{"type":"v1","addr":"172.21.15.104:6835","nonce":2260610756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7791,"qdb_cluster":[7791]},"id":10}]} 2024-09-17T03:05:41.392 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 69 2024-09-17T03:05:41.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f366c078bc0 msgr2=0x7f366c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f366c078bc0 0x7f366c07b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3670005fd0 tx=0x7f3670005bc0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 msgr2=0x7f36801500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 0x7f36801500a0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f3678009bf0 tx=0x7f3678003ce0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 shutdown_connections 2024-09-17T03:05:41.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f366c078bc0 0x7f366c07b0d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f36800d18e0 0x7f36801500a0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36800b6f70 0x7f3680161ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 --2- 172.21.15.104:0/1853337455 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36800b3b00 0x7f36801f70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 >> 172.21.15.104:0/1853337455 conn(0x7f3680073df0 msgr2=0x7f368015e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:41.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 shutdown_connections 2024-09-17T03:05:41.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.394+0000 7f368587f640 1 -- 172.21.15.104:0/1853337455 wait complete. 2024-09-17T03:05:41.408 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:05:41.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.520+0000 7fa6256ec640 1 -- 172.21.15.104:0/1202059934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa62015f1f0 msgr2=0x7fa62015f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.520+0000 7fa6256ec640 1 --2- 172.21.15.104:0/1202059934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa62015f1f0 0x7fa62015f600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa614009830 tx=0x7fa61402a480 comp rx=0 tx=0).stop 2024-09-17T03:05:41.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.520+0000 7fa6256ec640 1 -- 172.21.15.104:0/1202059934 shutdown_connections 2024-09-17T03:05:41.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.520+0000 7fa6256ec640 1 --2- 172.21.15.104:0/1202059934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa62015f1f0 0x7fa62015f600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.520+0000 7fa6256ec640 1 --2- 172.21.15.104:0/1202059934 >> v2:172.21.15.192:3300/0 conn(0x7fa6200b65e0 0x7fa6200b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.520+0000 7fa6256ec640 1 -- 172.21.15.104:0/1202059934 >> 172.21.15.104:0/1202059934 conn(0x7fa620069120 msgr2=0x7fa620069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:41.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.520+0000 7fa6256ec640 1 -- 172.21.15.104:0/1202059934 shutdown_connections 2024-09-17T03:05:41.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.520+0000 7fa6256ec640 1 -- 172.21.15.104:0/1202059934 wait complete. 2024-09-17T03:05:41.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.522+0000 7fa6256ec640 1 Processor -- start 2024-09-17T03:05:41.521 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.522+0000 7fa6256ec640 1 -- start start 2024-09-17T03:05:41.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.523+0000 7fa6256ec640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6200b65e0 0x7fa6201f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.523+0000 7fa6256ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62015f1f0 0x7fa62015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6256ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62015fb40 0x7fa6200cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6256ec640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa620163490 con 0x7fa62015f1f0 2024-09-17T03:05:41.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6256ec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa6201625a0 con 0x7fa62015fb40 2024-09-17T03:05:41.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6256ec640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa620163610 con 0x7fa6200b65e0 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62015f1f0 0x7fa62015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62015f1f0 0x7fa62015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36674/0 (socket says 172.21.15.104:36674) 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 -- 172.21.15.104:0/376883362 learned_addr learned my addr 172.21.15.104:0/376883362 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61effd640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6200b65e0 0x7fa6201f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61f7fe640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62015fb40 0x7fa6200cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 -- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6200b65e0 msgr2=0x7fa6201f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6200b65e0 0x7fa6201f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 -- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62015fb40 msgr2=0x7fa6200cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62015fb40 0x7fa6200cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 -- 172.21.15.104:0/376883362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6200c9770 con 0x7fa62015f1f0 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61effd640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6200b65e0 0x7fa6201f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:41.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61f7fe640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62015fb40 0x7fa6200cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:41.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa61e7fc640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62015f1f0 0x7fa62015dbb0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fa614009950 tx=0x7fa614033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:41.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6077fe640 1 -- 172.21.15.104:0/376883362 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614031d60 con 0x7fa62015f1f0 2024-09-17T03:05:41.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6077fe640 1 -- 172.21.15.104:0/376883362 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa614033e10 con 0x7fa62015f1f0 2024-09-17T03:05:41.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6077fe640 1 -- 172.21.15.104:0/376883362 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614033310 con 0x7fa62015f1f0 2024-09-17T03:05:41.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6200c86d0 con 0x7fa62015f1f0 2024-09-17T03:05:41.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.524+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6200c8c90 con 0x7fa62015f1f0 2024-09-17T03:05:41.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.525+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa620163ac0 con 0x7fa62015f1f0 2024-09-17T03:05:41.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.526+0000 7fa6077fe640 1 -- 172.21.15.104:0/376883362 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6140334b0 con 0x7fa62015f1f0 2024-09-17T03:05:41.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.527+0000 7fa6077fe640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa60c078b90 0x7fa60c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.527+0000 7fa6077fe640 1 -- 172.21.15.104:0/376883362 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7fa6140bc100 con 0x7fa62015f1f0 2024-09-17T03:05:41.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.527+0000 7fa6077fe640 1 -- 172.21.15.104:0/376883362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7fa60c0807d0 con 0x7fa62015f1f0 2024-09-17T03:05:41.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.527+0000 7fa61effd640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa60c078b90 0x7fa60c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.527 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.528+0000 7fa61effd640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa60c078b90 0x7fa60c07b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa6200d1e60 tx=0x7fa610009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:41.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.531+0000 7fa6077fe640 1 -- 172.21.15.104:0/376883362 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa61403f030 con 0x7fa62015f1f0 2024-09-17T03:05:41.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.738+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6200d1f80 con 0x7fa62015f1f0 2024-09-17T03:05:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.739+0000 7fa6077fe640 1 -- 172.21.15.104:0/376883362 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7fa6140845b0 con 0x7fa62015f1f0 2024-09-17T03:05:41.738 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:41.738 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":69,"btime":"2024-09-17T03:04:26:435587+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1948243703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1948243703},{"type":"v1","addr":"172.21.15.192:6836","nonce":1948243703}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3037806992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3037806992},{"type":"v1","addr":"172.21.15.192:6837","nonce":3037806992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2087460219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2087460219},{"type":"v1","addr":"172.21.15.104:6833","nonce":2087460219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:04:23.753525+0000","modified":"2024-09-17T03:04:25.785201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/2260610756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2260610756},{"type":"v1","addr":"172.21.15.104:6835","nonce":2260610756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7791,"qdb_cluster":[7791]},"id":10}]} 2024-09-17T03:05:41.738 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 69 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa60c078b90 msgr2=0x7fa60c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa60c078b90 0x7fa60c07b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa6200d1e60 tx=0x7fa610009500 comp rx=0 tx=0).stop 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62015f1f0 msgr2=0x7fa62015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62015f1f0 0x7fa62015dbb0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fa614009950 tx=0x7fa614033c20 comp rx=0 tx=0).stop 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 shutdown_connections 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa60c078b90 0x7fa60c07b0a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62015fb40 0x7fa6200cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62015f1f0 0x7fa62015dbb0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 --2- 172.21.15.104:0/376883362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6200b65e0 0x7fa6201f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.741 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 >> 172.21.15.104:0/376883362 conn(0x7fa620069120 msgr2=0x7fa620069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:41.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 shutdown_connections 2024-09-17T03:05:41.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.741+0000 7fa6256ec640 1 -- 172.21.15.104:0/376883362 wait complete. 2024-09-17T03:05:41.752 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:05:41.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.866+0000 7f8baaf4a640 1 -- 172.21.15.104:0/3388541692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba4072cf0 msgr2=0x7f8ba4073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.866+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/3388541692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba4072cf0 0x7f8ba4073100 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009830 tx=0x7f8b9402a380 comp rx=0 tx=0).stop 2024-09-17T03:05:41.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.866+0000 7f8baaf4a640 1 -- 172.21.15.104:0/3388541692 shutdown_connections 2024-09-17T03:05:41.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.866+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/3388541692 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba415ce00 0x7f8ba415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.866+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/3388541692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba4072cf0 0x7f8ba4073100 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.866+0000 7f8baaf4a640 1 -- 172.21.15.104:0/3388541692 >> 172.21.15.104:0/3388541692 conn(0x7f8ba406eb90 msgr2=0x7f8ba406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:41.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.866+0000 7f8baaf4a640 1 -- 172.21.15.104:0/3388541692 shutdown_connections 2024-09-17T03:05:41.866 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.866+0000 7f8baaf4a640 1 -- 172.21.15.104:0/3388541692 wait complete. 2024-09-17T03:05:41.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.867+0000 7f8baaf4a640 1 Processor -- start 2024-09-17T03:05:41.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.868+0000 7f8baaf4a640 1 -- start start 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8baaf4a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba406f6b0 0x7f8ba4145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8baaf4a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4072cf0 0x7f8ba41599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8baaf4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ba415ce00 0x7f8ba4159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8baaf4a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba415dae0 con 0x7f8ba415ce00 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8baaf4a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba415d960 con 0x7f8ba406f6b0 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8baaf4a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba415dc60 con 0x7f8ba4072cf0 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba94e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ba415ce00 0x7f8ba4159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba94e7640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ba415ce00 0x7f8ba4159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36684/0 (socket says 172.21.15.104:36684) 2024-09-17T03:05:41.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba94e7640 1 -- 172.21.15.104:0/856652333 learned_addr learned my addr 172.21.15.104:0/856652333 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba8ce6640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba406f6b0 0x7f8ba4145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8b9bfff640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4072cf0 0x7f8ba41599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba94e7640 1 -- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4072cf0 msgr2=0x7f8ba41599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba94e7640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4072cf0 0x7f8ba41599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba94e7640 1 -- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba406f6b0 msgr2=0x7f8ba4145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba94e7640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba406f6b0 0x7f8ba4145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba94e7640 1 -- 172.21.15.104:0/856652333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba4156ab0 con 0x7f8ba415ce00 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8ba8ce6640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba406f6b0 0x7f8ba4145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.869+0000 7f8b9bfff640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4072cf0 0x7f8ba41599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.870+0000 7f8ba94e7640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ba415ce00 0x7f8ba4159ee0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00ec20 tx=0x7f8b9c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:41.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.870+0000 7f8b997fa640 1 -- 172.21.15.104:0/856652333 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c003b70 con 0x7f8ba415ce00 2024-09-17T03:05:41.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.870+0000 7f8b997fa640 1 -- 172.21.15.104:0/856652333 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b9c003e00 con 0x7f8ba415ce00 2024-09-17T03:05:41.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.870+0000 7f8b997fa640 1 -- 172.21.15.104:0/856652333 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c004280 con 0x7f8ba415ce00 2024-09-17T03:05:41.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.870+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba4156210 con 0x7f8ba415ce00 2024-09-17T03:05:41.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.870+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba41567d0 con 0x7f8ba415ce00 2024-09-17T03:05:41.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.871+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba4073100 con 0x7f8ba415ce00 2024-09-17T03:05:41.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.871+0000 7f8b997fa640 1 -- 172.21.15.104:0/856652333 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b9c004420 con 0x7f8ba415ce00 2024-09-17T03:05:41.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.872+0000 7f8b997fa640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8b90078bc0 0x7f8b9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:41.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.872+0000 7f8b997fa640 1 -- 172.21.15.104:0/856652333 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7f8b9c09bb10 con 0x7f8ba415ce00 2024-09-17T03:05:41.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.872+0000 7f8b997fa640 1 -- 172.21.15.104:0/856652333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7f8b900807a0 con 0x7f8ba415ce00 2024-09-17T03:05:41.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.872+0000 7f8ba8ce6640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8b90078bc0 0x7f8b9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:41.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.873+0000 7f8ba8ce6640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8b90078bc0 0x7f8b9007b0d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0007960 tx=0x7f8ba0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:41.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:41.877+0000 7f8b997fa640 1 -- 172.21.15.104:0/856652333 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b9c064050 con 0x7f8ba415ce00 2024-09-17T03:05:42.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.051+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ba41584b0 con 0x7f8ba415ce00 2024-09-17T03:05:42.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.052+0000 7f8b997fa640 1 -- 172.21.15.104:0/856652333 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) ==== 74+0+16864 (secure 0 0 0) 0x7f8b9c063950 con 0x7f8ba415ce00 2024-09-17T03:05:42.052 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:42.052 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":173,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:05:13.191720+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:04:21.409569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:04:22.724801+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:05:42.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8b90078bc0 msgr2=0x7f8b9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8b90078bc0 0x7f8b9007b0d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0007960 tx=0x7f8ba0009040 comp rx=0 tx=0).stop 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ba415ce00 msgr2=0x7f8ba4159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ba415ce00 0x7f8ba4159ee0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00ec20 tx=0x7f8b9c00c6a0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 shutdown_connections 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8b90078bc0 0x7f8b9007b0d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8ba415ce00 0x7f8ba4159ee0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ba4072cf0 0x7f8ba41599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 --2- 172.21.15.104:0/856652333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ba406f6b0 0x7f8ba4145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 >> 172.21.15.104:0/856652333 conn(0x7f8ba406eb90 msgr2=0x7f8ba415e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 shutdown_connections 2024-09-17T03:05:42.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.055+0000 7f8baaf4a640 1 -- 172.21.15.104:0/856652333 wait complete. 2024-09-17T03:05:42.066 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:05:42.066 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:05:42.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.179+0000 7ff2f70b6640 1 -- 172.21.15.104:0/2192989561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2d8004b10 msgr2=0x7ff2d8004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.179+0000 7ff2f70b6640 1 --2- 172.21.15.104:0/2192989561 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2d8004b10 0x7ff2d8004f80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009b50 tx=0x7ff2d8006940 comp rx=0 tx=0).stop 2024-09-17T03:05:42.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.179+0000 7ff2f5653640 1 -- 172.21.15.104:0/2192989561 reap_dead start 2024-09-17T03:05:42.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.179+0000 7ff2f70b6640 1 -- 172.21.15.104:0/2192989561 shutdown_connections 2024-09-17T03:05:42.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.179+0000 7ff2f70b6640 1 -- 172.21.15.104:0/2192989561 >> 172.21.15.104:0/2192989561 conn(0x7ff2f006eb90 msgr2=0x7ff2f006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:42.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.179+0000 7ff2f70b6640 1 -- 172.21.15.104:0/2192989561 shutdown_connections 2024-09-17T03:05:42.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.179+0000 7ff2f70b6640 1 -- 172.21.15.104:0/2192989561 wait complete. 2024-09-17T03:05:42.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.181+0000 7ff2f70b6640 1 Processor -- start 2024-09-17T03:05:42.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.181+0000 7ff2f70b6640 1 -- start start 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f70b6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2d8004b10 0x7ff2f013bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f70b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2f0157ea0 0x7ff2f00b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f70b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2f0155a40 0x7ff2f0155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f70b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00745f0 con 0x7ff2f0155a40 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f70b6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0074470 con 0x7ff2d8004b10 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f70b6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f0074770 con 0x7ff2f0157ea0 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2f0155a40 0x7ff2f0155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2f0155a40 0x7ff2f0155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36712/0 (socket says 172.21.15.104:36712) 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 -- 172.21.15.104:0/1165940837 learned_addr learned my addr 172.21.15.104:0/1165940837 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:42.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2effff640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2f0157ea0 0x7ff2f00b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f4e52640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2d8004b10 0x7ff2f013bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 -- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2f0157ea0 msgr2=0x7ff2f00b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2f0157ea0 0x7ff2f00b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 -- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2d8004b10 msgr2=0x7ff2f013bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2d8004b10 0x7ff2f013bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 -- 172.21.15.104:0/1165940837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f0156390 con 0x7ff2f0155a40 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2effff640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2f0157ea0 0x7ff2f00b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f5653640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2f0155a40 0x7ff2f0155e50 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0072920 tx=0x7ff2e80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2ed7fa640 1 -- 172.21.15.104:0/1165940837 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8011840 con 0x7ff2f0155a40 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2ed7fa640 1 -- 172.21.15.104:0/1165940837 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2e8018070 con 0x7ff2f0155a40 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f00b2680 con 0x7ff2f0155a40 2024-09-17T03:05:42.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2ed7fa640 1 -- 172.21.15.104:0/1165940837 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8011ca0 con 0x7ff2f0155a40 2024-09-17T03:05:42.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.183+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f013b4f0 con 0x7ff2f0155a40 2024-09-17T03:05:42.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.184+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f00b5fb0 con 0x7ff2f0155a40 2024-09-17T03:05:42.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.185+0000 7ff2ed7fa640 1 -- 172.21.15.104:0/1165940837 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff2e801d460 con 0x7ff2f0155a40 2024-09-17T03:05:42.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.186+0000 7ff2ed7fa640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2dc078b90 0x7ff2dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.186+0000 7ff2ed7fa640 1 -- 172.21.15.104:0/1165940837 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7ff2e809b530 con 0x7ff2f0155a40 2024-09-17T03:05:42.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.186+0000 7ff2f4e52640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2dc078b90 0x7ff2dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.186+0000 7ff2ed7fa640 1 -- 172.21.15.104:0/1165940837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7ff2dc0807d0 con 0x7ff2f0155a40 2024-09-17T03:05:42.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.186+0000 7ff2f4e52640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2dc078b90 0x7ff2dc07b0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009b50 tx=0x7ff2e002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:42.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.191+0000 7ff2ed7fa640 1 -- 172.21.15.104:0/1165940837 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff2f0156390 con 0x7ff2f0155a40 2024-09-17T03:05:42.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.398+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2f0070e20 con 0x7ff2f0155a40 2024-09-17T03:05:42.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.399+0000 7ff2ed7fa640 1 -- 172.21.15.104:0/1165940837 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7ff2f00b64f0 con 0x7ff2f0155a40 2024-09-17T03:05:42.398 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:42.398 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":69,"btime":"2024-09-17T03:04:26:435587+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1948243703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1948243703},{"type":"v1","addr":"172.21.15.192:6836","nonce":1948243703}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3037806992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3037806992},{"type":"v1","addr":"172.21.15.192:6837","nonce":3037806992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2087460219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2087460219},{"type":"v1","addr":"172.21.15.104:6833","nonce":2087460219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:04:23.753525+0000","modified":"2024-09-17T03:04:25.785201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/2260610756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2260610756},{"type":"v1","addr":"172.21.15.104:6835","nonce":2260610756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7791,"qdb_cluster":[7791]},"id":10}]} 2024-09-17T03:05:42.399 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 69 2024-09-17T03:05:42.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2dc078b90 msgr2=0x7ff2dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2dc078b90 0x7ff2dc07b0a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009b50 tx=0x7ff2e002d040 comp rx=0 tx=0).stop 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2f0155a40 msgr2=0x7ff2f0155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2f0155a40 0x7ff2f0155e50 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0072920 tx=0x7ff2e80039c0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 shutdown_connections 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff2dc078b90 0x7ff2dc07b0a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2f0155a40 0x7ff2f0155e50 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2f0157ea0 0x7ff2f00b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 --2- 172.21.15.104:0/1165940837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2d8004b10 0x7ff2f013bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 >> 172.21.15.104:0/1165940837 conn(0x7ff2f006eb90 msgr2=0x7ff2f0076790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 shutdown_connections 2024-09-17T03:05:42.401 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.401+0000 7ff2f70b6640 1 -- 172.21.15.104:0/1165940837 wait complete. 2024-09-17T03:05:42.412 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:05:42.524 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.524+0000 7fe14b913640 1 -- 172.21.15.104:0/696801455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440b3b00 msgr2=0x7fe1440d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.524+0000 7fe14b913640 1 --2- 172.21.15.104:0/696801455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440b3b00 0x7fe1440d11d0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fe134009830 tx=0x7fe13402a480 comp rx=0 tx=0).stop 2024-09-17T03:05:42.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.524+0000 7fe14b913640 1 -- 172.21.15.104:0/696801455 shutdown_connections 2024-09-17T03:05:42.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.524+0000 7fe14b913640 1 --2- 172.21.15.104:0/696801455 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440b3b00 0x7fe1440d11d0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.524+0000 7fe14b913640 1 --2- 172.21.15.104:0/696801455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1440b6f70 0x7fe14415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.524+0000 7fe14b913640 1 -- 172.21.15.104:0/696801455 >> 172.21.15.104:0/696801455 conn(0x7fe144073df0 msgr2=0x7fe144068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:42.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.525+0000 7fe14b913640 1 -- 172.21.15.104:0/696801455 shutdown_connections 2024-09-17T03:05:42.525 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.525+0000 7fe14b913640 1 -- 172.21.15.104:0/696801455 wait complete. 2024-09-17T03:05:42.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.526+0000 7fe14b913640 1 Processor -- start 2024-09-17T03:05:42.526 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.526+0000 7fe14b913640 1 -- start start 2024-09-17T03:05:42.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe14b913640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1440b3b00 0x7fe1440ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.528 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe14b913640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1440b6f70 0x7fe144158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe14b913640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440d1710 0x7fe1441f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe14b913640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe1440d01b0 con 0x7fe1440d1710 2024-09-17T03:05:42.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe14b913640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe1440d0030 con 0x7fe1440b6f70 2024-09-17T03:05:42.529 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe14b913640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe1440d0330 con 0x7fe1440b3b00 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440d1710 0x7fe1441f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440d1710 0x7fe1441f91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36734/0 (socket says 172.21.15.104:36734) 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 -- 172.21.15.104:0/189781202 learned_addr learned my addr 172.21.15.104:0/189781202 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe1496af640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1440b3b00 0x7fe1440ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe148eae640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1440b6f70 0x7fe144158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 -- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1440b3b00 msgr2=0x7fe1440ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1440b3b00 0x7fe1440ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 -- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1440b6f70 msgr2=0x7fe144158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1440b6f70 0x7fe144158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 -- 172.21.15.104:0/189781202 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14415bc70 con 0x7fe1440d1710 2024-09-17T03:05:42.530 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe148eae640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1440b6f70 0x7fe144158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:42.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe149eb0640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440d1710 0x7fe1441f91f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00caa0 tx=0x7fe13c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:42.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe139ffb640 1 -- 172.21.15.104:0/189781202 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c016020 con 0x7fe1440d1710 2024-09-17T03:05:42.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe139ffb640 1 -- 172.21.15.104:0/189781202 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe13c00acf0 con 0x7fe1440d1710 2024-09-17T03:05:42.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14415b990 con 0x7fe1440d1710 2024-09-17T03:05:42.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe139ffb640 1 -- 172.21.15.104:0/189781202 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c012680 con 0x7fe1440d1710 2024-09-17T03:05:42.531 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.529+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1441f7180 con 0x7fe1440d1710 2024-09-17T03:05:42.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.530+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14415f110 con 0x7fe1440d1710 2024-09-17T03:05:42.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.530+0000 7fe139ffb640 1 -- 172.21.15.104:0/189781202 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe13c019020 con 0x7fe1440d1710 2024-09-17T03:05:42.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.531+0000 7fe139ffb640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe128078b90 0x7fe12807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.531+0000 7fe139ffb640 1 -- 172.21.15.104:0/189781202 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7fe13c09af00 con 0x7fe1440d1710 2024-09-17T03:05:42.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.531+0000 7fe139ffb640 1 -- 172.21.15.104:0/189781202 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7fe1280807d0 con 0x7fe1440d1710 2024-09-17T03:05:42.532 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.531+0000 7fe1496af640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe128078b90 0x7fe12807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.532+0000 7fe1496af640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe128078b90 0x7fe12807b0a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe140005fd0 tx=0x7fe14000a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:42.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.535+0000 7fe139ffb640 1 -- 172.21.15.104:0/189781202 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe13c020030 con 0x7fe1440d1710 2024-09-17T03:05:42.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.742+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1440d1150 con 0x7fe1440d1710 2024-09-17T03:05:42.742 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.743+0000 7fe139ffb640 1 -- 172.21.15.104:0/189781202 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5239 (secure 0 0 0) 0x7fe14415bc70 con 0x7fe1440d1710 2024-09-17T03:05:42.743 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:42.743 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":69,"btime":"2024-09-17T03:04:26:435587+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1948243703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1948243703},{"type":"v1","addr":"172.21.15.192:6836","nonce":1948243703}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3037806992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3037806992},{"type":"v1","addr":"172.21.15.192:6837","nonce":3037806992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2087460219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2087460219},{"type":"v1","addr":"172.21.15.104:6833","nonce":2087460219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:04:23.753525+0000","modified":"2024-09-17T03:04:25.785201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7791},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7791":{"gid":7791,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/2260610756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":2260610756},{"type":"v1","addr":"172.21.15.104:6835","nonce":2260610756}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7791,"qdb_cluster":[7791]},"id":10}]} 2024-09-17T03:05:42.743 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 69 2024-09-17T03:05:42.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.745+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe128078b90 msgr2=0x7fe12807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.745+0000 7fe14b913640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe128078b90 0x7fe12807b0a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe140005fd0 tx=0x7fe14000a250 comp rx=0 tx=0).stop 2024-09-17T03:05:42.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.745+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440d1710 msgr2=0x7fe1441f91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.745+0000 7fe14b913640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440d1710 0x7fe1441f91f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00caa0 tx=0x7fe13c00cf60 comp rx=0 tx=0).stop 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.746+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 shutdown_connections 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.746+0000 7fe14b913640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe128078b90 0x7fe12807b0a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.746+0000 7fe14b913640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1440b6f70 0x7fe144158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.746+0000 7fe14b913640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe1440d1710 0x7fe1441f91f0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.746+0000 7fe14b913640 1 --2- 172.21.15.104:0/189781202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1440b3b00 0x7fe1440ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.746+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 >> 172.21.15.104:0/189781202 conn(0x7fe144073df0 msgr2=0x7fe1440d4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.746+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 shutdown_connections 2024-09-17T03:05:42.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.746+0000 7fe14b913640 1 -- 172.21.15.104:0/189781202 wait complete. 2024-09-17T03:05:42.756 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:05:42.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.868+0000 7f98411da640 1 -- 172.21.15.104:0/2796308999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0b2800 msgr2=0x7f983c0b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.868+0000 7f98411da640 1 --2- 172.21.15.104:0/2796308999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0b2800 0x7f983c0b2c10 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9834005fd0 tx=0x7f983402aa10 comp rx=0 tx=0).stop 2024-09-17T03:05:42.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.868+0000 7f98411da640 1 -- 172.21.15.104:0/2796308999 shutdown_connections 2024-09-17T03:05:42.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.868+0000 7f98411da640 1 --2- 172.21.15.104:0/2796308999 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0b2800 0x7f983c0b2c10 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.868+0000 7f98411da640 1 -- 172.21.15.104:0/2796308999 >> 172.21.15.104:0/2796308999 conn(0x7f983c0d2970 msgr2=0x7f983c0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:42.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.868+0000 7f98411da640 1 -- 172.21.15.104:0/2796308999 shutdown_connections 2024-09-17T03:05:42.869 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.868+0000 7f98411da640 1 -- 172.21.15.104:0/2796308999 wait complete. 2024-09-17T03:05:42.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.870+0000 7f98411da640 1 Processor -- start 2024-09-17T03:05:42.870 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.870+0000 7f98411da640 1 -- start start 2024-09-17T03:05:42.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f983c0b2800 0x7f983c167900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0b7c80 0x7f983c159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0d3490 0x7f983c09deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f983c168300 con 0x7f983c0d3490 2024-09-17T03:05:42.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f983c168180 con 0x7f983c0b7c80 2024-09-17T03:05:42.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f983c168480 con 0x7f983c0b2800 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0d3490 0x7f983c09deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0d3490 0x7f983c09deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36746/0 (socket says 172.21.15.104:36746) 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 -- 172.21.15.104:0/3194550840 learned_addr learned my addr 172.21.15.104:0/3194550840 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983ad9d640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f983c0b2800 0x7f983c167900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f9833fff640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0b7c80 0x7f983c159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 -- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f983c0b2800 msgr2=0x7f983c167900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f983c0b2800 0x7f983c167900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 -- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0b7c80 msgr2=0x7f983c159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0b7c80 0x7f983c159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 -- 172.21.15.104:0/3194550840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983c0a0670 con 0x7f983c0d3490 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f983b59e640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0d3490 0x7f983c09deb0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9834009d90 tx=0x7f9834003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98337fe640 1 -- 172.21.15.104:0/3194550840 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834046070 con 0x7f983c0d3490 2024-09-17T03:05:42.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98337fe640 1 -- 172.21.15.104:0/3194550840 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98340045c0 con 0x7f983c0d3490 2024-09-17T03:05:42.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98337fe640 1 -- 172.21.15.104:0/3194550840 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834033070 con 0x7f983c0d3490 2024-09-17T03:05:42.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983c09d240 con 0x7f983c0d3490 2024-09-17T03:05:42.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983c0a00b0 con 0x7f983c0d3490 2024-09-17T03:05:42.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.873+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983c167ea0 con 0x7f983c0d3490 2024-09-17T03:05:42.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.874+0000 7f98337fe640 1 -- 172.21.15.104:0/3194550840 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9834049070 con 0x7f983c0d3490 2024-09-17T03:05:42.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.874+0000 7f98337fe640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f981c078b90 0x7f981c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:42.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.875+0000 7f98337fe640 1 -- 172.21.15.104:0/3194550840 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7f98340bbf50 con 0x7f983c0d3490 2024-09-17T03:05:42.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.875+0000 7f983ad9d640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f981c078b90 0x7f981c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:42.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.875+0000 7f98337fe640 1 -- 172.21.15.104:0/3194550840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7f981c080770 con 0x7f983c0d3490 2024-09-17T03:05:42.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.875+0000 7f983ad9d640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f981c078b90 0x7f981c07b0a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f982c000f60 tx=0x7f982c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:42.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:42.879+0000 7f98337fe640 1 -- 172.21.15.104:0/3194550840 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f983403e070 con 0x7f983c0d3490 2024-09-17T03:05:43.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.051+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f983c0b2c10 con 0x7f983c0d3490 2024-09-17T03:05:43.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.052+0000 7f98337fe640 1 -- 172.21.15.104:0/3194550840 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) ==== 74+0+16864 (secure 0 0 0) 0x7f9834084490 con 0x7f983c0d3490 2024-09-17T03:05:43.052 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:43.052 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":173,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:05:13.191720+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:04:21.409569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T03:04:22.724801+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.39","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f981c078b90 msgr2=0x7f981c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f981c078b90 0x7f981c07b0a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f982c000f60 tx=0x7f982c009040 comp rx=0 tx=0).stop 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0d3490 msgr2=0x7f983c09deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0d3490 0x7f983c09deb0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9834009d90 tx=0x7f9834003f90 comp rx=0 tx=0).stop 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 shutdown_connections 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f981c078b90 0x7f981c07b0a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0b7c80 0x7f983c159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f983c0d3490 0x7f983c09deb0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 --2- 172.21.15.104:0/3194550840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f983c0b2800 0x7f983c167900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 >> 172.21.15.104:0/3194550840 conn(0x7f983c0d2970 msgr2=0x7f983c0b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 shutdown_connections 2024-09-17T03:05:43.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.055+0000 7f98411da640 1 -- 172.21.15.104:0/3194550840 wait complete. 2024-09-17T03:05:43.065 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:05:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.179+0000 7ff401a07640 1 -- 172.21.15.104:0/2947774768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3e8003a30 msgr2=0x7ff3e8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.179+0000 7ff401a07640 1 --2- 172.21.15.104:0/2947774768 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3e8003a30 0x7ff3e8003ea0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001d90 tx=0x7ff3e8005830 comp rx=0 tx=0).stop 2024-09-17T03:05:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.179+0000 7ff3fb7fe640 1 -- 172.21.15.104:0/2947774768 reap_dead start 2024-09-17T03:05:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.179+0000 7ff401a07640 1 -- 172.21.15.104:0/2947774768 shutdown_connections 2024-09-17T03:05:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.179+0000 7ff401a07640 1 -- 172.21.15.104:0/2947774768 >> 172.21.15.104:0/2947774768 conn(0x7ff3fc069120 msgr2=0x7ff3fc069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:43.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.179+0000 7ff401a07640 1 -- 172.21.15.104:0/2947774768 shutdown_connections 2024-09-17T03:05:43.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.179+0000 7ff401a07640 1 -- 172.21.15.104:0/2947774768 wait complete. 2024-09-17T03:05:43.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.181+0000 7ff401a07640 1 Processor -- start 2024-09-17T03:05:43.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.181+0000 7ff401a07640 1 -- start start 2024-09-17T03:05:43.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.183+0000 7ff401a07640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e8003a30 0x7ff3fc1f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:43.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.183+0000 7ff401a07640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3fc0c7910 0x7ff3fc15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:43.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.183+0000 7ff401a07640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3fc155a40 0x7ff3fc15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:43.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.183+0000 7ff401a07640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc161a90 con 0x7ff3fc0c7910 2024-09-17T03:05:43.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.183+0000 7ff401a07640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc15f9a0 con 0x7ff3e8003a30 2024-09-17T03:05:43.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.183+0000 7ff401a07640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff3fc161c10 con 0x7ff3fc155a40 2024-09-17T03:05:43.183 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3fc0c7910 0x7ff3fc15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3fc0c7910 0x7ff3fc15a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36764/0 (socket says 172.21.15.104:36764) 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 -- 172.21.15.104:0/94042752 learned_addr learned my addr 172.21.15.104:0/94042752 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3faffd640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e8003a30 0x7ff3fc1f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fb7fe640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3fc155a40 0x7ff3fc15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 -- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3fc155a40 msgr2=0x7ff3fc15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3fc155a40 0x7ff3fc15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 -- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e8003a30 msgr2=0x7ff3fc1f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e8003a30 0x7ff3fc1f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 -- 172.21.15.104:0/94042752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc159680 con 0x7ff3fc0c7910 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fb7fe640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3fc155a40 0x7ff3fc15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3faffd640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e8003a30 0x7ff3fc1f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3fa7fc640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3fc0c7910 0x7ff3fc15a720 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4011b10 tx=0x7ff3e4009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:43.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400fe40 con 0x7ff3fc0c7910 2024-09-17T03:05:43.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3e4004050 con 0x7ff3fc0c7910 2024-09-17T03:05:43.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4004460 con 0x7ff3fc0c7910 2024-09-17T03:05:43.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc159960 con 0x7ff3fc0c7910 2024-09-17T03:05:43.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc159f20 con 0x7ff3fc0c7910 2024-09-17T03:05:43.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.184+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc1593f0 con 0x7ff3fc0c7910 2024-09-17T03:05:43.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.185+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff3e4005020 con 0x7ff3fc0c7910 2024-09-17T03:05:43.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.185+0000 7ff3f3fff640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff3dc078b90 0x7ff3dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:43.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.185+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5738+0+0 (secure 0 0 0) 0x7ff3e409ba20 con 0x7ff3fc0c7910 2024-09-17T03:05:43.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.187+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7ff3dc080770 con 0x7ff3fc0c7910 2024-09-17T03:05:43.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.187+0000 7ff3faffd640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff3dc078b90 0x7ff3dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:43.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.187+0000 7ff3faffd640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff3dc078b90 0x7ff3dc07b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec032000 tx=0x7ff3ec001510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:43.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.190+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff3e4063e40 con 0x7ff3fc0c7910 2024-09-17T03:05:43.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.198+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 7 ==== osd_map(174..174 src has 1..174) ==== 679+0+0 (secure 0 0 0) 0x7ff3e409be00 con 0x7ff3fc0c7910 2024-09-17T03:05:43.197 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.198+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=175}) -- 0x7ff3dc081340 con 0x7ff3fc0c7910 2024-09-17T03:05:43.400 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.402+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff3fc1621a0 con 0x7ff3fc0c7910 2024-09-17T03:05:43.401 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T03:05:43.403+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:05:43.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.404+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 161+0+0 (secure 0 0 0) 0x7ff3e4063740 con 0x7ff3fc0c7910 2024-09-17T03:05:43.403 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:05:43.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.405+0000 7ff3f3fff640 1 -- 172.21.15.104:0/94042752 <== mon.0 v2:172.21.15.104:3300/0 9 ==== osd_map(175..175 src has 1..175) ==== 374+0+0 (secure 0 0 0) 0x7ff3e409a040 con 0x7ff3fc0c7910 2024-09-17T03:05:43.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff3dc078b90 msgr2=0x7ff3dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff3dc078b90 0x7ff3dc07b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec032000 tx=0x7ff3ec001510 comp rx=0 tx=0).stop 2024-09-17T03:05:43.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3fc0c7910 msgr2=0x7ff3fc15a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.406 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3fc0c7910 0x7ff3fc15a720 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4011b10 tx=0x7ff3e4009e00 comp rx=0 tx=0).stop 2024-09-17T03:05:43.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 shutdown_connections 2024-09-17T03:05:43.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff3dc078b90 0x7ff3dc07b0a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff3fc155a40 0x7ff3fc15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff3fc0c7910 0x7ff3fc15a720 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 --2- 172.21.15.104:0/94042752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3e8003a30 0x7ff3fc1f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 >> 172.21.15.104:0/94042752 conn(0x7ff3fc069120 msgr2=0x7ff3fc0d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:43.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.408+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 shutdown_connections 2024-09-17T03:05:43.408 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.409+0000 7ff401a07640 1 -- 172.21.15.104:0/94042752 wait complete. 2024-09-17T03:05:43.420 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:05:43.468 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T03:05:43.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.537+0000 7f4dd905c640 1 -- 172.21.15.104:0/1808077944 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 msgr2=0x7f4dd40b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.536 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.537+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1808077944 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 0x7f4dd40b57e0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40c98b0 tx=0x7f4dc802a560 comp rx=0 tx=0).stop 2024-09-17T03:05:43.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.538+0000 7f4dd905c640 1 -- 172.21.15.104:0/1808077944 shutdown_connections 2024-09-17T03:05:43.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.538+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1808077944 >> v2:172.21.15.192:3300/0 conn(0x7f4dd40b5d20 0x7f4dd40cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.538+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1808077944 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 0x7f4dd40b57e0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.538+0000 7f4dd905c640 1 -- 172.21.15.104:0/1808077944 >> 172.21.15.104:0/1808077944 conn(0x7f4dd40b44a0 msgr2=0x7f4dd40b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:43.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.538+0000 7f4dd905c640 1 -- 172.21.15.104:0/1808077944 shutdown_connections 2024-09-17T03:05:43.537 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.538+0000 7f4dd905c640 1 -- 172.21.15.104:0/1808077944 wait complete. 2024-09-17T03:05:43.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.540+0000 7f4dd905c640 1 Processor -- start 2024-09-17T03:05:43.538 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.540+0000 7f4dd905c640 1 -- start start 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd905c640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dd40b4fc0 0x7f4dd41f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd905c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dd40b5d20 0x7f4dd41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd905c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 0x7f4dd41e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd905c640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd40d18c0 con 0x7f4dd40cdf10 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd905c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd40d01d0 con 0x7f4dd40b5d20 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd905c640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd4160f50 con 0x7f4dd40b4fc0 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 0x7f4dd41e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd359e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 0x7f4dd41e73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:36802/0 (socket says 172.21.15.104:36802) 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd359e640 1 -- 172.21.15.104:0/1447936402 learned_addr learned my addr 172.21.15.104:0/1447936402 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:43.541 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd259c640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dd40b5d20 0x7f4dd41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd2d9d640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dd40b4fc0 0x7f4dd41f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.541+0000 7f4dd359e640 1 -- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dd40b4fc0 msgr2=0x7f4dd41f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dd359e640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dd40b4fc0 0x7f4dd41f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dd359e640 1 -- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dd40b5d20 msgr2=0x7f4dd41579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dd359e640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dd40b5d20 0x7f4dd41579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dd359e640 1 -- 172.21.15.104:0/1447936402 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd41f7900 con 0x7f4dd40cdf10 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dd359e640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 0x7f4dd41e73f0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00cad0 tx=0x7f4dcc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dbb7fe640 1 -- 172.21.15.104:0/1447936402 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00ae20 con 0x7f4dd40cdf10 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dbb7fe640 1 -- 172.21.15.104:0/1447936402 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dcc00f540 con 0x7f4dd40cdf10 2024-09-17T03:05:43.542 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd41f7be0 con 0x7f4dd40cdf10 2024-09-17T03:05:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dbb7fe640 1 -- 172.21.15.104:0/1447936402 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc00f990 con 0x7f4dd40cdf10 2024-09-17T03:05:43.543 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.542+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd40b10c0 con 0x7f4dd40cdf10 2024-09-17T03:05:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.543+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd40cfa80 con 0x7f4dd40cdf10 2024-09-17T03:05:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.544+0000 7f4dbb7fe640 1 -- 172.21.15.104:0/1447936402 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4dcc00fb30 con 0x7f4dd40cdf10 2024-09-17T03:05:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.544+0000 7f4dbb7fe640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4dc0078b90 0x7f4dc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.544+0000 7f4dbb7fe640 1 -- 172.21.15.104:0/1447936402 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5824+0+0 (secure 0 0 0) 0x7f4dcc09b770 con 0x7f4dd40cdf10 2024-09-17T03:05:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.544+0000 7f4dd2d9d640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4dc0078b90 0x7f4dc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:43.544 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.545+0000 7f4dd2d9d640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4dc0078b90 0x7f4dc007b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4006fd0 tx=0x7f4dc4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:43.547 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.549+0000 7f4dbb7fe640 1 -- 172.21.15.104:0/1447936402 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4dcc014030 con 0x7f4dd40cdf10 2024-09-17T03:05:43.756 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:43.757+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4dd40cead0 con 0x7f4dd40cdf10 2024-09-17T03:05:44.412 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.414+0000 7f4dbb7fe640 1 -- 172.21.15.104:0/1447936402 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) ==== 104+0+0 (secure 0 0 0) 0x7f4dcc00fe20 con 0x7f4dd40cdf10 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4dc0078b90 msgr2=0x7f4dc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4dc0078b90 0x7f4dc007b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4006fd0 tx=0x7f4dc4009060 comp rx=0 tx=0).stop 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 msgr2=0x7f4dd41e73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 0x7f4dd41e73f0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc00cad0 tx=0x7f4dcc00cf90 comp rx=0 tx=0).stop 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 shutdown_connections 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4dc0078b90 0x7f4dc007b0a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dd40b5d20 0x7f4dd41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4dd40cdf10 0x7f4dd41e73f0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.415 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 --2- 172.21.15.104:0/1447936402 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4dd40b4fc0 0x7f4dd41f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.416+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 >> 172.21.15.104:0/1447936402 conn(0x7f4dd40b44a0 msgr2=0x7f4dd40b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:44.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.417+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 shutdown_connections 2024-09-17T03:05:44.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.417+0000 7f4dd905c640 1 -- 172.21.15.104:0/1447936402 wait complete. 2024-09-17T03:05:44.429 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:05:44.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 -- 172.21.15.104:0/3136271667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9360160580 msgr2=0x7f93600b6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:44.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 --2- 172.21.15.104:0/3136271667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9360160580 0x7f93600b6870 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f93600c6280 tx=0x7f935c02a560 comp rx=0 tx=0).stop 2024-09-17T03:05:44.549 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 -- 172.21.15.104:0/3136271667 shutdown_connections 2024-09-17T03:05:44.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 --2- 172.21.15.104:0/3136271667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93600b72f0 0x7f93600b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 --2- 172.21.15.104:0/3136271667 >> v2:172.21.15.192:3300/0 conn(0x7f93600b7ce0 0x7f93600b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 --2- 172.21.15.104:0/3136271667 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9360160580 0x7f93600b6870 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 -- 172.21.15.104:0/3136271667 >> 172.21.15.104:0/3136271667 conn(0x7f93600b4580 msgr2=0x7f93600b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:44.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 -- 172.21.15.104:0/3136271667 shutdown_connections 2024-09-17T03:05:44.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.550+0000 7f9367fed640 1 -- 172.21.15.104:0/3136271667 wait complete. 2024-09-17T03:05:44.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.552+0000 7f9367fed640 1 Processor -- start 2024-09-17T03:05:44.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.552+0000 7f9367fed640 1 -- start start 2024-09-17T03:05:44.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.553+0000 7f9367fed640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93600b72f0 0x7f9360159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.553+0000 7f9367fed640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93600b7ce0 0x7f93600b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.553+0000 7f9367fed640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9360160580 0x7f93601f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.553+0000 7f9367fed640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9360165e90 con 0x7f93600b7ce0 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.553+0000 7f9367fed640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9360165d10 con 0x7f9360160580 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.553+0000 7f9367fed640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9360166010 con 0x7f93600b72f0 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93600b7ce0 0x7f93600b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93600b7ce0 0x7f93600b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48472/0 (socket says 172.21.15.104:48472) 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 -- 172.21.15.104:0/2459838811 learned_addr learned my addr 172.21.15.104:0/2459838811 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365d89640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93600b72f0 0x7f9360159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f936658a640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9360160580 0x7f93601f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:44.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 -- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93600b72f0 msgr2=0x7f9360159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93600b72f0 0x7f9360159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 -- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9360160580 msgr2=0x7f93601f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9360160580 0x7f93601f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 -- 172.21.15.104:0/2459838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936009f100 con 0x7f93600b7ce0 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9365588640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93600b7ce0 0x7f93600b37d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f935000c970 tx=0x7f935000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f93567fc640 1 -- 172.21.15.104:0/2459838811 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350007bb0 con 0x7f93600b7ce0 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f93567fc640 1 -- 172.21.15.104:0/2459838811 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9350007e40 con 0x7f93600b7ce0 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f93567fc640 1 -- 172.21.15.104:0/2459838811 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350005280 con 0x7f93600b7ce0 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936009f3e0 con 0x7f93600b7ce0 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.554+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936009f9a0 con 0x7f93600b7ce0 2024-09-17T03:05:44.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.555+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93600b7700 con 0x7f93600b7ce0 2024-09-17T03:05:44.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.556+0000 7f93567fc640 1 -- 172.21.15.104:0/2459838811 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9350005420 con 0x7f93600b7ce0 2024-09-17T03:05:44.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.557+0000 7f93567fc640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9344078b90 0x7f934407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:44.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.557+0000 7f93567fc640 1 -- 172.21.15.104:0/2459838811 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 5824+0+0 (secure 0 0 0) 0x7f935009b0f0 con 0x7f93600b7ce0 2024-09-17T03:05:44.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.557+0000 7f9365d89640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9344078b90 0x7f934407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:44.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.557+0000 7f9365d89640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9344078b90 0x7f934407b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f935c033000 tx=0x7f935c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:44.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.561+0000 7f93567fc640 1 -- 172.21.15.104:0/2459838811 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9350014030 con 0x7f93600b7ce0 2024-09-17T03:05:44.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:44.737+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f93600b3d10 con 0x7f93600b7ce0 2024-09-17T03:05:45.416 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.417+0000 7f93567fc640 1 -- 172.21.15.104:0/2459838811 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v176) ==== 181+0+0 (secure 0 0 0) 0x7f9350062fc0 con 0x7f93600b7ce0 2024-09-17T03:05:45.416 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9344078b90 msgr2=0x7f934407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9344078b90 0x7f934407b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f935c033000 tx=0x7f935c004730 comp rx=0 tx=0).stop 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93600b7ce0 msgr2=0x7f93600b37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93600b7ce0 0x7f93600b37d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f935000c970 tx=0x7f935000ce30 comp rx=0 tx=0).stop 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 shutdown_connections 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9344078b90 0x7f934407b0a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9360160580 0x7f93601f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f93600b7ce0 0x7f93600b37d0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 --2- 172.21.15.104:0/2459838811 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93600b72f0 0x7f9360159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 >> 172.21.15.104:0/2459838811 conn(0x7f93600b4580 msgr2=0x7f9360071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:45.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 shutdown_connections 2024-09-17T03:05:45.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.421+0000 7f9367fed640 1 -- 172.21.15.104:0/2459838811 wait complete. 2024-09-17T03:05:45.432 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:05:45.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.554+0000 7fe54f962640 1 -- 172.21.15.104:0/3704034559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5300039e0 msgr2=0x7fe530003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:45.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.554+0000 7fe54f962640 1 --2- 172.21.15.104:0/3704034559 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe5300039e0 0x7fe530003e10 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fe540001710 tx=0x7fe530005830 comp rx=0 tx=0).stop 2024-09-17T03:05:45.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.554+0000 7fe54deff640 1 -- 172.21.15.104:0/3704034559 reap_dead start 2024-09-17T03:05:45.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.554+0000 7fe54f962640 1 -- 172.21.15.104:0/3704034559 shutdown_connections 2024-09-17T03:05:45.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.554+0000 7fe54f962640 1 -- 172.21.15.104:0/3704034559 >> 172.21.15.104:0/3704034559 conn(0x7fe5480b3c70 msgr2=0x7fe5480d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:45.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.554+0000 7fe54f962640 1 -- 172.21.15.104:0/3704034559 shutdown_connections 2024-09-17T03:05:45.553 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.554+0000 7fe54f962640 1 -- 172.21.15.104:0/3704034559 wait complete. 2024-09-17T03:05:45.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.555+0000 7fe54f962640 1 Processor -- start 2024-09-17T03:05:45.554 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.555+0000 7fe54f962640 1 -- start start 2024-09-17T03:05:45.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54f962640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5300039e0 0x7fe548159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54f962640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe54815e240 0x7fe54815e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54f962640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe548147af0 0x7fe548147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54f962640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe548164950 con 0x7fe548147af0 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54f962640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe54815c030 con 0x7fe5300039e0 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54f962640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe548164ad0 con 0x7fe54815e240 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe548147af0 0x7fe548147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe548147af0 0x7fe548147f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48496/0 (socket says 172.21.15.104:48496) 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 -- 172.21.15.104:0/2759618840 learned_addr learned my addr 172.21.15.104:0/2759618840 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54cefd640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe54815e240 0x7fe54815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54d6fe640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5300039e0 0x7fe548159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:45.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 -- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe54815e240 msgr2=0x7fe54815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe54815e240 0x7fe54815e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 -- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5300039e0 msgr2=0x7fe548159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5300039e0 0x7fe548159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 -- 172.21.15.104:0/2759618840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5481590d0 con 0x7fe548147af0 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54cefd640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe54815e240 0x7fe54815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54d6fe640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5300039e0 0x7fe548159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe54deff640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe548147af0 0x7fe548147f00 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fe5480b5cf0 tx=0x7fe538010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe545ffb640 1 -- 172.21.15.104:0/2759618840 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538003970 con 0x7fe548147af0 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.557+0000 7fe545ffb640 1 -- 172.21.15.104:0/2759618840 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe538015070 con 0x7fe548147af0 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.558+0000 7fe545ffb640 1 -- 172.21.15.104:0/2759618840 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538004030 con 0x7fe548147af0 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.558+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe548158550 con 0x7fe548147af0 2024-09-17T03:05:45.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.558+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe548158b10 con 0x7fe548147af0 2024-09-17T03:05:45.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.559+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe548158290 con 0x7fe548147af0 2024-09-17T03:05:45.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.559+0000 7fe545ffb640 1 -- 172.21.15.104:0/2759618840 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5380041d0 con 0x7fe548147af0 2024-09-17T03:05:45.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.560+0000 7fe545ffb640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe534078bc0 0x7fe53407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:45.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.560+0000 7fe545ffb640 1 -- 172.21.15.104:0/2759618840 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(176..176 src has 1..176) ==== 5386+0+0 (secure 0 0 0) 0x7fe53809b2a0 con 0x7fe548147af0 2024-09-17T03:05:45.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.560+0000 7fe54d6fe640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe534078bc0 0x7fe53407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:45.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.561+0000 7fe54d6fe640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe534078bc0 0x7fe53407b0d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe54815f740 tx=0x7fe540001270 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:45.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.564+0000 7fe545ffb640 1 -- 172.21.15.104:0/2759618840 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe538063820 con 0x7fe548147af0 2024-09-17T03:05:45.734 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:45.736+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe5480b5d40 con 0x7fe548147af0 2024-09-17T03:05:46.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.423+0000 7fe545ffb640 1 -- 172.21.15.104:0/2759618840 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v177) ==== 169+0+0 (secure 0 0 0) 0x7fe538063120 con 0x7fe548147af0 2024-09-17T03:05:46.422 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T03:05:46.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe534078bc0 msgr2=0x7fe53407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe534078bc0 0x7fe53407b0d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe54815f740 tx=0x7fe540001270 comp rx=0 tx=0).stop 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe548147af0 msgr2=0x7fe548147f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe548147af0 0x7fe548147f00 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fe5480b5cf0 tx=0x7fe538010f40 comp rx=0 tx=0).stop 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 shutdown_connections 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe534078bc0 0x7fe53407b0d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe548147af0 0x7fe548147f00 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe54815e240 0x7fe54815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 --2- 172.21.15.104:0/2759618840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5300039e0 0x7fe548159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 >> 172.21.15.104:0/2759618840 conn(0x7fe5480b3c70 msgr2=0x7fe5481576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 shutdown_connections 2024-09-17T03:05:46.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.426+0000 7fe54f962640 1 -- 172.21.15.104:0/2759618840 wait complete. 2024-09-17T03:05:46.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T03:05:46.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.559+0000 7f8dc0a07640 1 -- 172.21.15.104:0/1459713774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da80039e0 msgr2=0x7f8da8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.559+0000 7f8dc0a07640 1 --2- 172.21.15.104:0/1459713774 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8da80039e0 0x7f8da8003e10 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f8dac00c2e0 tx=0x7f8da8005830 comp rx=0 tx=0).stop 2024-09-17T03:05:46.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.559+0000 7f8dbad9d640 1 -- 172.21.15.104:0/1459713774 reap_dead start 2024-09-17T03:05:46.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.559+0000 7f8dc0a07640 1 -- 172.21.15.104:0/1459713774 shutdown_connections 2024-09-17T03:05:46.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.559+0000 7f8dc0a07640 1 -- 172.21.15.104:0/1459713774 >> 172.21.15.104:0/1459713774 conn(0x7f8dbc0d2970 msgr2=0x7f8dbc0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:46.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.559+0000 7f8dc0a07640 1 -- 172.21.15.104:0/1459713774 shutdown_connections 2024-09-17T03:05:46.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.559+0000 7f8dc0a07640 1 -- 172.21.15.104:0/1459713774 wait complete. 2024-09-17T03:05:46.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.561+0000 7f8dc0a07640 1 Processor -- start 2024-09-17T03:05:46.559 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.561+0000 7f8dc0a07640 1 -- start start 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dc0a07640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8da80039e0 0x7f8dbc0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dc0a07640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc153b60 0x7f8dbc0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dc0a07640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0c9e80 0x7f8dbc0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dc0a07640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc0b2270 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dc0a07640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc0b20f0 con 0x7f8dbc153b60 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dc0a07640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc0b23f0 con 0x7f8da80039e0 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dbad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0c9e80 0x7f8dbc0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dbad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0c9e80 0x7f8dbc0ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48514/0 (socket says 172.21.15.104:48514) 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dbad9d640 1 -- 172.21.15.104:0/486535315 learned_addr learned my addr 172.21.15.104:0/486535315 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:46.562 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8dba59c640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8da80039e0 0x7f8dbc0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.562+0000 7f8db1d9b640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc153b60 0x7f8dbc0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8dbad9d640 1 -- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8da80039e0 msgr2=0x7f8dbc0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8dbad9d640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8da80039e0 0x7f8dbc0cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8dbad9d640 1 -- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc153b60 msgr2=0x7f8dbc0c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8dbad9d640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc153b60 0x7f8dbc0c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8dbad9d640 1 -- 172.21.15.104:0/486535315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc0cc0a0 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8dbad9d640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0c9e80 0x7f8dbc0ca290 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8db4001520 tx=0x7f8db4001a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8db37fe640 1 -- 172.21.15.104:0/486535315 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4011870 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8db37fe640 1 -- 172.21.15.104:0/486535315 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8db4017070 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc0cd4f0 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8db37fe640 1 -- 172.21.15.104:0/486535315 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4011dc0 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.563 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.563+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc0cff80 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.564+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dbc0cbe10 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.565+0000 7f8db37fe640 1 -- 172.21.15.104:0/486535315 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8db401c460 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.565+0000 7f8db37fe640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8d9c078bc0 0x7f8d9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:46.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.565+0000 7f8db37fe640 1 -- 172.21.15.104:0/486535315 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7f8db409b0d0 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.565+0000 7f8dba59c640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8d9c078bc0 0x7f8d9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:46.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.566+0000 7f8dba59c640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8d9c078bc0 0x7f8d9c07b0d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8dac033000 tx=0x7f8dac038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:46.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.570+0000 7f8db37fe640 1 -- 172.21.15.104:0/486535315 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8dbc0cc0a0 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.750+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7f8dbc0b2a40 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.752 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.754+0000 7f8db37fe640 1 -- 172.21.15.104:0/486535315 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v41) ==== 71+0+0 (secure 0 0 0) 0x7f8db40638a0 con 0x7f8dbc0c9e80 2024-09-17T03:05:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8d9c078bc0 msgr2=0x7f8d9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8d9c078bc0 0x7f8d9c07b0d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8dac033000 tx=0x7f8dac038040 comp rx=0 tx=0).stop 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0c9e80 msgr2=0x7f8dbc0ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0c9e80 0x7f8dbc0ca290 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8db4001520 tx=0x7f8db4001a90 comp rx=0 tx=0).stop 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 shutdown_connections 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8d9c078bc0 0x7f8d9c07b0d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dbc153b60 0x7f8dbc0c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8dbc0c9e80 0x7f8dbc0ca290 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 --2- 172.21.15.104:0/486535315 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8da80039e0 0x7f8dbc0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 >> 172.21.15.104:0/486535315 conn(0x7f8dbc0d2970 msgr2=0x7f8dbc0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 shutdown_connections 2024-09-17T03:05:46.755 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.756+0000 7f8dc0a07640 1 -- 172.21.15.104:0/486535315 wait complete. 2024-09-17T03:05:46.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-17T03:05:46.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.879+0000 7f2a0ece5640 1 -- 172.21.15.104:0/3305669208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0004b40 msgr2=0x7f29f0004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.879+0000 7f2a0ece5640 1 --2- 172.21.15.104:0/3305669208 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f29f0004b40 0x7f29f0004fb0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2a08074cd0 tx=0x7f29f0006940 comp rx=0 tx=0).stop 2024-09-17T03:05:46.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.879+0000 7f2a0d282640 1 -- 172.21.15.104:0/3305669208 reap_dead start 2024-09-17T03:05:46.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.879+0000 7f2a0ece5640 1 -- 172.21.15.104:0/3305669208 shutdown_connections 2024-09-17T03:05:46.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.879+0000 7f2a0ece5640 1 -- 172.21.15.104:0/3305669208 >> 172.21.15.104:0/3305669208 conn(0x7f2a0806eb90 msgr2=0x7f2a0806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:46.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.879+0000 7f2a0ece5640 1 -- 172.21.15.104:0/3305669208 shutdown_connections 2024-09-17T03:05:46.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.879+0000 7f2a0ece5640 1 -- 172.21.15.104:0/3305669208 wait complete. 2024-09-17T03:05:46.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.881+0000 7f2a0ece5640 1 Processor -- start 2024-09-17T03:05:46.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.881+0000 7f2a0ece5640 1 -- start start 2024-09-17T03:05:46.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0ece5640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f0004b40 0x7f2a08150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0ece5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08151450 0x7f2a080d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0ece5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a081f3f00 0x7f2a08152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0ece5640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0815bbb0 con 0x7f2a08151450 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0ece5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0815ba30 con 0x7f2a081f3f00 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0ece5640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0815bd30 con 0x7f29f0004b40 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08151450 0x7f2a080d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08151450 0x7f2a080d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48534/0 (socket says 172.21.15.104:48534) 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 -- 172.21.15.104:0/1389337055 learned_addr learned my addr 172.21.15.104:0/1389337055 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0ca81640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f0004b40 0x7f2a08150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:46.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0d282640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a081f3f00 0x7f2a08152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 -- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f0004b40 msgr2=0x7f2a08150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f0004b40 0x7f2a08150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 -- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a081f3f00 msgr2=0x7f2a08152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a081f3f00 0x7f2a08152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 -- 172.21.15.104:0/1389337055 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a080b2140 con 0x7f2a08151450 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0d282640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a081f3f00 0x7f2a08152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a07fff640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08151450 0x7f2a080d05e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f29fc003f50 tx=0x7f29fc0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a057fa640 1 -- 172.21.15.104:0/1389337055 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc011640 con 0x7f2a08151450 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a057fa640 1 -- 172.21.15.104:0/1389337055 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29fc016020 con 0x7f2a08151450 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a057fa640 1 -- 172.21.15.104:0/1389337055 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc011a60 con 0x7f2a08151450 2024-09-17T03:05:46.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.883+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a080b2420 con 0x7f2a08151450 2024-09-17T03:05:46.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.884+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a080b29e0 con 0x7f2a08151450 2024-09-17T03:05:46.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.884+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a08156770 con 0x7f2a08151450 2024-09-17T03:05:46.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.885+0000 7f2a057fa640 1 -- 172.21.15.104:0/1389337055 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29fc011c00 con 0x7f2a08151450 2024-09-17T03:05:46.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.886+0000 7f2a057fa640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f4078b90 0x7f29f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:46.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.886+0000 7f2a057fa640 1 -- 172.21.15.104:0/1389337055 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7f29fc09b670 con 0x7f2a08151450 2024-09-17T03:05:46.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.886+0000 7f2a0ca81640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f4078b90 0x7f29f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:46.886 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.886+0000 7f2a0ca81640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f4078b90 0x7f29f407b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f29f8036000 tx=0x7f29f80046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:46.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:46.890+0000 7f2a057fa640 1 -- 172.21.15.104:0/1389337055 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2a08156770 con 0x7f2a08151450 2024-09-17T03:05:47.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.136+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7f2a08076930 con 0x7f2a08151450 2024-09-17T03:05:47.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.424+0000 7f2a057fa640 1 -- 172.21.15.104:0/1389337055 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v509) ==== 131+0+0 (secure 0 0 0) 0x7f29fc020020 con 0x7f2a08151450 2024-09-17T03:05:47.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f4078b90 msgr2=0x7f29f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f4078b90 0x7f29f407b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f29f8036000 tx=0x7f29f80046c0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08151450 msgr2=0x7f2a080d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08151450 0x7f2a080d05e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f29fc003f50 tx=0x7f29fc0016f0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 shutdown_connections 2024-09-17T03:05:47.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f29f4078b90 0x7f29f407b0a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a081f3f00 0x7f2a08152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2a08151450 0x7f2a080d05e0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 --2- 172.21.15.104:0/1389337055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29f0004b40 0x7f2a08150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.426+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 >> 172.21.15.104:0/1389337055 conn(0x7f2a0806eb90 msgr2=0x7f2a0814a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:47.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.427+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 shutdown_connections 2024-09-17T03:05:47.426 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.427+0000 7f2a0ece5640 1 -- 172.21.15.104:0/1389337055 wait complete. 2024-09-17T03:05:47.437 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-17T03:05:47.437 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-17T03:05:47.437 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:05:47.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.551+0000 7fd5b5d43640 1 -- 172.21.15.104:0/1513480629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 msgr2=0x7fd5b015c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.550 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.551+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/1513480629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 0x7fd5b015c640 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00771c0 tx=0x7fd5a402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.551+0000 7fd5b5d43640 1 -- 172.21.15.104:0/1513480629 shutdown_connections 2024-09-17T03:05:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.551+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/1513480629 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 0x7fd5b015c640 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.551+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/1513480629 >> v2:172.21.15.192:3300/0 conn(0x7fd5b0156280 0x7fd5b00cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.551+0000 7fd5b5d43640 1 -- 172.21.15.104:0/1513480629 >> 172.21.15.104:0/1513480629 conn(0x7fd5b00b2710 msgr2=0x7fd5b00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.551+0000 7fd5b5d43640 1 -- 172.21.15.104:0/1513480629 shutdown_connections 2024-09-17T03:05:47.551 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.551+0000 7fd5b5d43640 1 -- 172.21.15.104:0/1513480629 wait complete. 2024-09-17T03:05:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.553+0000 7fd5b5d43640 1 Processor -- start 2024-09-17T03:05:47.552 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.553+0000 7fd5b5d43640 1 -- start start 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5b5d43640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c6990 0x7fd5b015a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5b5d43640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0156280 0x7fd5b00b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5b5d43640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 0x7fd5b015b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5b5d43640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0073de0 con 0x7fd5b015c230 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5b5d43640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0073c60 con 0x7fd5b00c6990 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5b5d43640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b0073f60 con 0x7fd5b0156280 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 0x7fd5b015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 0x7fd5b015b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48550/0 (socket says 172.21.15.104:48550) 2024-09-17T03:05:47.555 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 -- 172.21.15.104:0/3817913719 learned_addr learned my addr 172.21.15.104:0/3817913719 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5af7fe640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c6990 0x7fd5b015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5aeffd640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0156280 0x7fd5b00b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 -- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0156280 msgr2=0x7fd5b00b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0156280 0x7fd5b00b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 -- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c6990 msgr2=0x7fd5b015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c6990 0x7fd5b015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 -- 172.21.15.104:0/3817913719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b01f4270 con 0x7fd5b015c230 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5aeffd640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0156280 0x7fd5b00b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd5affff640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 0x7fd5b015b920 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c730 tx=0x7fd5a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:47.556 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.555+0000 7fd597fff640 1 -- 172.21.15.104:0/3817913719 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8003b70 con 0x7fd5b015c230 2024-09-17T03:05:47.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.556+0000 7fd597fff640 1 -- 172.21.15.104:0/3817913719 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5a8003d10 con 0x7fd5b015c230 2024-09-17T03:05:47.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.556+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b01f4550 con 0x7fd5b015c230 2024-09-17T03:05:47.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.556+0000 7fd597fff640 1 -- 172.21.15.104:0/3817913719 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800aab0 con 0x7fd5b015c230 2024-09-17T03:05:47.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.556+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b01f72e0 con 0x7fd5b015c230 2024-09-17T03:05:47.557 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.556+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b0074410 con 0x7fd5b015c230 2024-09-17T03:05:47.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.557+0000 7fd597fff640 1 -- 172.21.15.104:0/3817913719 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd5a800ac50 con 0x7fd5b015c230 2024-09-17T03:05:47.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.558+0000 7fd597fff640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd59c078b90 0x7fd59c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:47.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.558+0000 7fd597fff640 1 -- 172.21.15.104:0/3817913719 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7fd5a809a7b0 con 0x7fd5b015c230 2024-09-17T03:05:47.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.558+0000 7fd5af7fe640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd59c078b90 0x7fd59c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:47.558 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.558+0000 7fd5af7fe640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd59c078b90 0x7fd59c07b0a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009b30 tx=0x7fd5a0005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:47.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.562+0000 7fd597fff640 1 -- 172.21.15.104:0/3817913719 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd5a8062ef0 con 0x7fd5b015c230 2024-09-17T03:05:47.735 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.737+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5b01f4000 con 0x7fd5b015c230 2024-09-17T03:05:47.736 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.737+0000 7fd597fff640 1 -- 172.21.15.104:0/3817913719 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) ==== 74+0+13093 (secure 0 0 0) 0x7fd5a80627f0 con 0x7fd5b015c230 2024-09-17T03:05:47.736 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:47.736 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":177,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:05:46.418310+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/2260610756":"2024-09-18T03:05:43.403215+0000","172.21.15.104:6834/2260610756":"2024-09-18T03:05:43.403215+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd59c078b90 msgr2=0x7fd59c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd59c078b90 0x7fd59c07b0a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009b30 tx=0x7fd5a0005f90 comp rx=0 tx=0).stop 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 msgr2=0x7fd5b015b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 0x7fd5b015b920 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800c730 tx=0x7fd5a800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 shutdown_connections 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd59c078b90 0x7fd59c07b0a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd5b015c230 0x7fd5b015b920 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5b0156280 0x7fd5b00b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 --2- 172.21.15.104:0/3817913719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5b00c6990 0x7fd5b015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 >> 172.21.15.104:0/3817913719 conn(0x7fd5b00b2710 msgr2=0x7fd5b00cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 shutdown_connections 2024-09-17T03:05:47.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.740+0000 7fd5b5d43640 1 -- 172.21.15.104:0/3817913719 wait complete. 2024-09-17T03:05:47.750 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T02:54:31.652437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:05:47.750 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:05:47.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.868+0000 7f1512bad640 1 -- 172.21.15.104:0/393927857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14f4003a50 msgr2=0x7f14f4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.867 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.868+0000 7f1512bad640 1 --2- 172.21.15.104:0/393927857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14f4003a50 0x7f14f4003ec0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f1508009d20 tx=0x7f14f4005830 comp rx=0 tx=0).stop 2024-09-17T03:05:47.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.868+0000 7f1512bad640 1 -- 172.21.15.104:0/393927857 shutdown_connections 2024-09-17T03:05:47.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.868+0000 7f1512bad640 1 --2- 172.21.15.104:0/393927857 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f14f4003a50 0x7f14f4003ec0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.868+0000 7f1512bad640 1 -- 172.21.15.104:0/393927857 >> 172.21.15.104:0/393927857 conn(0x7f150c068ee0 msgr2=0x7f150c0692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:47.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.868+0000 7f1512bad640 1 -- 172.21.15.104:0/393927857 shutdown_connections 2024-09-17T03:05:47.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.868+0000 7f1512bad640 1 -- 172.21.15.104:0/393927857 wait complete. 2024-09-17T03:05:47.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.870+0000 7f1512bad640 1 Processor -- start 2024-09-17T03:05:47.868 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.870+0000 7f1512bad640 1 -- start start 2024-09-17T03:05:47.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1512bad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14f4003a50 0x7f150c1f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:47.871 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1512bad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f150c146220 0x7f150c0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1512bad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150c0ca4e0 0x7f150c0ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1512bad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f150c0d34f0 con 0x7f150c146220 2024-09-17T03:05:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1512bad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f150c15f7a0 con 0x7f150c0ca4e0 2024-09-17T03:05:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1512bad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f150c0d3670 con 0x7f14f4003a50 2024-09-17T03:05:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f150c146220 0x7f150c0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f150c146220 0x7f150c0c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48572/0 (socket says 172.21.15.104:48572) 2024-09-17T03:05:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 -- 172.21.15.104:0/1190733854 learned_addr learned my addr 172.21.15.104:0/1190733854 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:47.872 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1510949640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14f4003a50 0x7f150c1f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f151114a640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150c0ca4e0 0x7f150c0ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 -- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14f4003a50 msgr2=0x7f150c1f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14f4003a50 0x7f150c1f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 -- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150c0ca4e0 msgr2=0x7f150c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150c0ca4e0 0x7f150c0ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 -- 172.21.15.104:0/1190733854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c0cae30 con 0x7f150c146220 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1510949640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14f4003a50 0x7f150c1f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f151114a640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150c0ca4e0 0x7f150c0ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1503fff640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f150c146220 0x7f150c0c9fa0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f14fc001010 tx=0x7f14fc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f15017fa640 1 -- 172.21.15.104:0/1190733854 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc015070 con 0x7f150c146220 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f15017fa640 1 -- 172.21.15.104:0/1190733854 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14fc011900 con 0x7f150c146220 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150c1f6010 con 0x7f150c146220 2024-09-17T03:05:47.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f15017fa640 1 -- 172.21.15.104:0/1190733854 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc011d50 con 0x7f150c146220 2024-09-17T03:05:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.872+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150c15c710 con 0x7f150c146220 2024-09-17T03:05:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.873+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f150c15c150 con 0x7f150c146220 2024-09-17T03:05:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.874+0000 7f15017fa640 1 -- 172.21.15.104:0/1190733854 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14fc018070 con 0x7f150c146220 2024-09-17T03:05:47.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.875+0000 7f15017fa640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14f8078b90 0x7f14f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:47.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.875+0000 7f15017fa640 1 -- 172.21.15.104:0/1190733854 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7f14fc09b790 con 0x7f150c146220 2024-09-17T03:05:47.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.875+0000 7f1510949640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14f8078b90 0x7f14f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:47.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.876+0000 7f1510949640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14f8078b90 0x7f14f807b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1508034000 tx=0x7f15080046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:47.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:47.880+0000 7f15017fa640 1 -- 172.21.15.104:0/1190733854 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f14fc063f70 con 0x7f150c146220 2024-09-17T03:05:48.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.055+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f150c15f100 con 0x7f150c146220 2024-09-17T03:05:48.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.055+0000 7f15017fa640 1 -- 172.21.15.104:0/1190733854 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) ==== 93+0+10 (secure 0 0 0) 0x7f14fc063870 con 0x7f150c146220 2024-09-17T03:05:48.054 INFO:teuthology.orchestra.run.smithi104.stdout:pg_num: 1 2024-09-17T03:05:48.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14f8078b90 msgr2=0x7f14f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:48.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14f8078b90 0x7f14f807b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1508034000 tx=0x7f15080046c0 comp rx=0 tx=0).stop 2024-09-17T03:05:48.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f150c146220 msgr2=0x7f150c0c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:48.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f150c146220 0x7f150c0c9fa0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f14fc001010 tx=0x7f14fc0039c0 comp rx=0 tx=0).stop 2024-09-17T03:05:48.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 shutdown_connections 2024-09-17T03:05:48.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f14f8078b90 0x7f14f807b0a0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:48.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f150c0ca4e0 0x7f150c0ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:48.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f150c146220 0x7f150c0c9fa0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:48.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 --2- 172.21.15.104:0/1190733854 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14f4003a50 0x7f150c1f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:48.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 >> 172.21.15.104:0/1190733854 conn(0x7f150c068ee0 msgr2=0x7f150c0d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:48.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 shutdown_connections 2024-09-17T03:05:48.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.057+0000 7f1512bad640 1 -- 172.21.15.104:0/1190733854 wait complete. 2024-09-17T03:05:48.067 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-17T03:05:48.179 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.181+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/2010210841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e74004d40 msgr2=0x7f9e74005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:48.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.181+0000 7f9e8ee4d640 1 --2- 172.21.15.104:0/2010210841 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e74004d40 0x7f9e74005190 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009ed0 tx=0x7f9e74005830 comp rx=0 tx=0).stop 2024-09-17T03:05:48.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.181+0000 7f9e8d3ea640 1 -- 172.21.15.104:0/2010210841 reap_dead start 2024-09-17T03:05:48.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.181+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/2010210841 shutdown_connections 2024-09-17T03:05:48.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.181+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/2010210841 >> 172.21.15.104:0/2010210841 conn(0x7f9e880b3640 msgr2=0x7f9e880b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:48.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.181+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/2010210841 shutdown_connections 2024-09-17T03:05:48.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.181+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/2010210841 wait complete. 2024-09-17T03:05:48.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.183+0000 7f9e8ee4d640 1 Processor -- start 2024-09-17T03:05:48.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.183+0000 7f9e8ee4d640 1 -- start start 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e8ee4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74004d40 0x7f9e88150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e8ee4d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e8814e2c0 0x7f9e8813a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e8ee4d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e88159cc0 0x7f9e8815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e8ee4d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88164b90 con 0x7f9e8814e2c0 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e8ee4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88164a10 con 0x7f9e74004d40 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e8ee4d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9e88164d10 con 0x7f9e88159cc0 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e87fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e8814e2c0 0x7f9e8813a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e87fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e8814e2c0 0x7f9e8813a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48600/0 (socket says 172.21.15.104:48600) 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e87fff640 1 -- 172.21.15.104:0/4089917945 learned_addr learned my addr 172.21.15.104:0/4089917945 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e8d3ea640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e88159cc0 0x7f9e8815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:48.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.184+0000 7f9e8cbe9640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74004d40 0x7f9e88150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e87fff640 1 -- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e88159cc0 msgr2=0x7f9e8815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e87fff640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e88159cc0 0x7f9e8815a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e87fff640 1 -- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74004d40 msgr2=0x7f9e88150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e87fff640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74004d40 0x7f9e88150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e87fff640 1 -- 172.21.15.104:0/4089917945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e881f2810 con 0x7f9e8814e2c0 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e87fff640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e8814e2c0 0x7f9e8813a380 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f9e70003e90 tx=0x7f9e70001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e857fa640 1 -- 172.21.15.104:0/4089917945 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70015070 con 0x7f9e8814e2c0 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e857fa640 1 -- 172.21.15.104:0/4089917945 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e70011860 con 0x7f9e8814e2c0 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8815a610 con 0x7f9e8814e2c0 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e857fa640 1 -- 172.21.15.104:0/4089917945 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70011cb0 con 0x7f9e8814e2c0 2024-09-17T03:05:48.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.185+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e881f2d60 con 0x7f9e8814e2c0 2024-09-17T03:05:48.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.186+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e881511d0 con 0x7f9e8814e2c0 2024-09-17T03:05:48.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.187+0000 7f9e857fa640 1 -- 172.21.15.104:0/4089917945 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e70018070 con 0x7f9e8814e2c0 2024-09-17T03:05:48.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.187+0000 7f9e857fa640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e68078b90 0x7f9e6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:48.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.187+0000 7f9e857fa640 1 -- 172.21.15.104:0/4089917945 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7f9e7009b740 con 0x7f9e8814e2c0 2024-09-17T03:05:48.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.187+0000 7f9e8cbe9640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e68078b90 0x7f9e6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:48.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.188+0000 7f9e8cbe9640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e68078b90 0x7f9e6807b0a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9e88073380 tx=0x7f9e78006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:48.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.192+0000 7f9e857fa640 1 -- 172.21.15.104:0/4089917945 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e8815a610 con 0x7f9e8814e2c0 2024-09-17T03:05:48.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:48.439+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7f9e8806f520 con 0x7f9e8814e2c0 2024-09-17T03:05:49.431 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.433+0000 7f9e857fa640 1 -- 172.21.15.104:0/4089917945 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v511) ==== 138+0+0 (secure 0 0 0) 0x7f9e70063830 con 0x7f9e8814e2c0 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e68078b90 msgr2=0x7f9e6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e68078b90 0x7f9e6807b0a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9e88073380 tx=0x7f9e78006720 comp rx=0 tx=0).stop 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e8814e2c0 msgr2=0x7f9e8813a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e8814e2c0 0x7f9e8813a380 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f9e70003e90 tx=0x7f9e70001710 comp rx=0 tx=0).stop 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 shutdown_connections 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9e68078b90 0x7f9e6807b0a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e88159cc0 0x7f9e8815a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9e8814e2c0 0x7f9e8813a380 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 --2- 172.21.15.104:0/4089917945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e74004d40 0x7f9e88150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 >> 172.21.15.104:0/4089917945 conn(0x7f9e880b3640 msgr2=0x7f9e880d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:49.436 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 shutdown_connections 2024-09-17T03:05:49.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.437+0000 7f9e8ee4d640 1 -- 172.21.15.104:0/4089917945 wait complete. 2024-09-17T03:05:49.449 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:05:49.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.569+0000 7fc195a30640 1 -- 172.21.15.104:0/1832756408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 msgr2=0x7fc19015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.569+0000 7fc195a30640 1 --2- 172.21.15.104:0/1832756408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 0x7fc19015ef90 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fc1900d0c10 tx=0x7fc18002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.569+0000 7fc195a30640 1 -- 172.21.15.104:0/1832756408 shutdown_connections 2024-09-17T03:05:49.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.569+0000 7fc195a30640 1 --2- 172.21.15.104:0/1832756408 >> v2:172.21.15.192:3300/0 conn(0x7fc1900d18e0 0x7fc1900d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.569+0000 7fc195a30640 1 --2- 172.21.15.104:0/1832756408 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 0x7fc19015ef90 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.569+0000 7fc195a30640 1 -- 172.21.15.104:0/1832756408 >> 172.21.15.104:0/1832756408 conn(0x7fc190073df0 msgr2=0x7fc190068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:49.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.569+0000 7fc195a30640 1 -- 172.21.15.104:0/1832756408 shutdown_connections 2024-09-17T03:05:49.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.569+0000 7fc195a30640 1 -- 172.21.15.104:0/1832756408 wait complete. 2024-09-17T03:05:49.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.570+0000 7fc195a30640 1 Processor -- start 2024-09-17T03:05:49.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.571+0000 7fc195a30640 1 -- start start 2024-09-17T03:05:49.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc195a30640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1900b3b00 0x7fc1901487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc195a30640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 0x7fc190159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc195a30640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900d18e0 0x7fc1900b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc195a30640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc1900d3dc0 con 0x7fc1900b6f70 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc195a30640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc1900d3c40 con 0x7fc1900b3b00 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc195a30640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc1900d3f40 con 0x7fc1900d18e0 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 0x7fc190159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18e7fc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 0x7fc190159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48610/0 (socket says 172.21.15.104:48610) 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18e7fc640 1 -- 172.21.15.104:0/1943549608 learned_addr learned my addr 172.21.15.104:0/1943549608 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18f7fe640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900d18e0 0x7fc1900b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18effd640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1900b3b00 0x7fc1901487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:49.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18e7fc640 1 -- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900d18e0 msgr2=0x7fc1900b9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18e7fc640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900d18e0 0x7fc1900b9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18e7fc640 1 -- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1900b3b00 msgr2=0x7fc1901487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18e7fc640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1900b3b00 0x7fc1901487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18e7fc640 1 -- 172.21.15.104:0/1943549608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1901f5e30 con 0x7fc1900b6f70 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.572+0000 7fc18f7fe640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900d18e0 0x7fc1900b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.573+0000 7fc18e7fc640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 0x7fc190159250 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fc18400b420 tx=0x7fc18400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.573+0000 7fc177fff640 1 -- 172.21.15.104:0/1943549608 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184011830 con 0x7fc1900b6f70 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.573+0000 7fc177fff640 1 -- 172.21.15.104:0/1943549608 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc184016070 con 0x7fc1900b6f70 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.573+0000 7fc177fff640 1 -- 172.21.15.104:0/1943549608 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184011d60 con 0x7fc1900b6f70 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.573+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1901f6110 con 0x7fc1900b6f70 2024-09-17T03:05:49.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.573+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1901f66d0 con 0x7fc1900b6f70 2024-09-17T03:05:49.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.574+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1900d43f0 con 0x7fc1900b6f70 2024-09-17T03:05:49.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.575+0000 7fc177fff640 1 -- 172.21.15.104:0/1943549608 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc18401b460 con 0x7fc1900b6f70 2024-09-17T03:05:49.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.575+0000 7fc177fff640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc17c078b90 0x7fc17c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:49.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.575+0000 7fc177fff640 1 -- 172.21.15.104:0/1943549608 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7fc18409a530 con 0x7fc1900b6f70 2024-09-17T03:05:49.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.576+0000 7fc18effd640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc17c078b90 0x7fc17c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:49.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.576+0000 7fc18effd640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc17c078b90 0x7fc17c07b0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc180033000 tx=0x7fc180004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:49.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.580+0000 7fc177fff640 1 -- 172.21.15.104:0/1943549608 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc184020020 con 0x7fc1900b6f70 2024-09-17T03:05:49.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.754+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc19015e610 con 0x7fc1900b6f70 2024-09-17T03:05:49.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.755+0000 7fc177fff640 1 -- 172.21.15.104:0/1943549608 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v41) ==== 59+0+1472 (secure 0 0 0) 0x7fc184062d00 con 0x7fc1900b6f70 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_client 20/20 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds 20/20 2024-09-17T03:05:49.754 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced debug_ms 2/2 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_frag true 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:mds dev mds_verify_scatter true 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced client_mount_timeout 600 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_client 20/20 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced debug_ms 1/1 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:05:49.755 INFO:teuthology.orchestra.run.smithi104.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc17c078b90 msgr2=0x7fc17c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc17c078b90 0x7fc17c07b0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc180033000 tx=0x7fc180004730 comp rx=0 tx=0).stop 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 msgr2=0x7fc190159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 0x7fc190159250 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fc18400b420 tx=0x7fc18400b8e0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 shutdown_connections 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc17c078b90 0x7fc17c07b0a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900d18e0 0x7fc1900b9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc1900b6f70 0x7fc190159250 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 --2- 172.21.15.104:0/1943549608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1900b3b00 0x7fc1901487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 >> 172.21.15.104:0/1943549608 conn(0x7fc190073df0 msgr2=0x7fc190068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 shutdown_connections 2024-09-17T03:05:49.757 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.757+0000 7fc195a30640 1 -- 172.21.15.104:0/1943549608 wait complete. 2024-09-17T03:05:49.767 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:05:49.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.885+0000 7f51f279b640 1 -- 172.21.15.104:0/2532633326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51d4004d40 msgr2=0x7f51d4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.885+0000 7f51f279b640 1 --2- 172.21.15.104:0/2532633326 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51d4004d40 0x7f51d4005150 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f51e4005fd0 tx=0x7f51d4005830 comp rx=0 tx=0).stop 2024-09-17T03:05:49.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.885+0000 7f51f0d38640 1 -- 172.21.15.104:0/2532633326 reap_dead start 2024-09-17T03:05:49.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.885+0000 7f51f279b640 1 -- 172.21.15.104:0/2532633326 shutdown_connections 2024-09-17T03:05:49.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.885+0000 7f51f279b640 1 -- 172.21.15.104:0/2532633326 >> 172.21.15.104:0/2532633326 conn(0x7f51ec06d200 msgr2=0x7f51ec06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:49.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.885+0000 7f51f279b640 1 -- 172.21.15.104:0/2532633326 shutdown_connections 2024-09-17T03:05:49.884 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.885+0000 7f51f279b640 1 -- 172.21.15.104:0/2532633326 wait complete. 2024-09-17T03:05:49.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.887+0000 7f51f279b640 1 Processor -- start 2024-09-17T03:05:49.885 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.887+0000 7f51f279b640 1 -- start start 2024-09-17T03:05:49.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51f279b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51d4004d40 0x7f51ec1e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:49.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51f279b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51ec1e82c0 0x7f51ec145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:49.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51f279b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51ec145560 0x7f51ec1e63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:49.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51f279b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec0cedb0 con 0x7f51ec1e82c0 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51f279b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec0cec30 con 0x7f51d4004d40 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51f279b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f51ec0cef30 con 0x7f51ec145560 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51ec1e82c0 0x7f51ec145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51eb7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51ec1e82c0 0x7f51ec145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48632/0 (socket says 172.21.15.104:48632) 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51eb7fe640 1 -- 172.21.15.104:0/3684296211 learned_addr learned my addr 172.21.15.104:0/3684296211 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51ebfff640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51d4004d40 0x7f51ec1e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51f0d38640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51ec145560 0x7f51ec1e63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51eb7fe640 1 -- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51ec145560 msgr2=0x7f51ec1e63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51eb7fe640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51ec145560 0x7f51ec1e63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51eb7fe640 1 -- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51d4004d40 msgr2=0x7f51ec1e7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51eb7fe640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51d4004d40 0x7f51ec1e7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:49.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.888+0000 7f51eb7fe640 1 -- 172.21.15.104:0/3684296211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ec142be0 con 0x7f51ec1e82c0 2024-09-17T03:05:49.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.889+0000 7f51eb7fe640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51ec1e82c0 0x7f51ec145020 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f51e0010aa0 tx=0x7f51e0010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:49.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.889+0000 7f51e8ff9640 1 -- 172.21.15.104:0/3684296211 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004220 con 0x7f51ec1e82c0 2024-09-17T03:05:49.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.889+0000 7f51e8ff9640 1 -- 172.21.15.104:0/3684296211 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51e00043c0 con 0x7f51ec1e82c0 2024-09-17T03:05:49.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.889+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ec145d50 con 0x7f51ec1e82c0 2024-09-17T03:05:49.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.889+0000 7f51e8ff9640 1 -- 172.21.15.104:0/3684296211 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e000ec80 con 0x7f51ec1e82c0 2024-09-17T03:05:49.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.889+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ec1f5d00 con 0x7f51ec1e82c0 2024-09-17T03:05:49.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.890+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ec0b6000 con 0x7f51ec1e82c0 2024-09-17T03:05:49.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.890+0000 7f51e8ff9640 1 -- 172.21.15.104:0/3684296211 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51e00035f0 con 0x7f51ec1e82c0 2024-09-17T03:05:49.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.891+0000 7f51e8ff9640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f51d8078bc0 0x7f51d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:49.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.891+0000 7f51e8ff9640 1 -- 172.21.15.104:0/3684296211 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7f51e009b5c0 con 0x7f51ec1e82c0 2024-09-17T03:05:49.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.891+0000 7f51ebfff640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f51d8078bc0 0x7f51d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:49.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.892+0000 7f51ebfff640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f51d8078bc0 0x7f51d807b0d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f51dc001c00 tx=0x7f51dc001b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:49.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:49.896+0000 7f51e8ff9640 1 -- 172.21.15.104:0/3684296211 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f51e0063740 con 0x7f51ec1e82c0 2024-09-17T03:05:50.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.069+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f51ec070810 con 0x7f51ec1e82c0 2024-09-17T03:05:50.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.073+0000 7f51e8ff9640 1 -- 172.21.15.104:0/3684296211 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f51e0068170 con 0x7f51ec1e82c0 2024-09-17T03:05:50.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f51d8078bc0 msgr2=0x7f51d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f51d8078bc0 0x7f51d807b0d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f51dc001c00 tx=0x7f51dc001b90 comp rx=0 tx=0).stop 2024-09-17T03:05:50.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51ec1e82c0 msgr2=0x7f51ec145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51ec1e82c0 0x7f51ec145020 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f51e0010aa0 tx=0x7f51e0010f60 comp rx=0 tx=0).stop 2024-09-17T03:05:50.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 shutdown_connections 2024-09-17T03:05:50.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f51d8078bc0 0x7f51d807b0d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51ec145560 0x7f51ec1e63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f51ec1e82c0 0x7f51ec145020 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 --2- 172.21.15.104:0/3684296211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51d4004d40 0x7f51ec1e7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.075+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 >> 172.21.15.104:0/3684296211 conn(0x7f51ec06d200 msgr2=0x7f51ec075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:50.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.076+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 shutdown_connections 2024-09-17T03:05:50.075 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.076+0000 7f51f279b640 1 -- 172.21.15.104:0/3684296211 wait complete. 2024-09-17T03:05:50.085 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:05:50.085 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:05:50.127 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:05:50.174 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:05:50.174 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:05:50.174 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:50.190 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:05:50.190 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:05:50.190 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:50.210 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:05:50.210 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:05:50.210 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:50.245 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:05:50.245 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:05:50.246 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:05:50.267 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:05:50.268 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:05:50.268 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:05:50.397 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.399+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/3984707272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 msgr2=0x7f9ca8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.399+0000 7f9cc5c9b640 1 --2- 172.21.15.104:0/3984707272 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 0x7f9ca8004c10 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c260 tx=0x7f9ca8005830 comp rx=0 tx=0).stop 2024-09-17T03:05:50.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.399+0000 7f9cbffff640 1 -- 172.21.15.104:0/3984707272 reap_dead start 2024-09-17T03:05:50.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.399+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/3984707272 shutdown_connections 2024-09-17T03:05:50.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.399+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/3984707272 >> 172.21.15.104:0/3984707272 conn(0x7f9cc00b44a0 msgr2=0x7f9cc00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:50.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.399+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/3984707272 shutdown_connections 2024-09-17T03:05:50.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.399+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/3984707272 wait complete. 2024-09-17T03:05:50.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.400+0000 7f9cc5c9b640 1 Processor -- start 2024-09-17T03:05:50.399 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.401+0000 7f9cc5c9b640 1 -- start start 2024-09-17T03:05:50.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cc5c9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 0x7f9cc00af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:50.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cc5c9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cc00b1960 0x7f9cc015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:50.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cc5c9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cc00b22f0 0x7f9cc00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:50.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cc5c9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc00cfe10 con 0x7f9ca8004800 2024-09-17T03:05:50.402 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cc5c9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc00cfc90 con 0x7f9cc00b22f0 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cc5c9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc00cff90 con 0x7f9cc00b1960 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 0x7f9cc00af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 0x7f9cc00af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48654/0 (socket says 172.21.15.104:48654) 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbf7fe640 1 -- 172.21.15.104:0/1767840000 learned_addr learned my addr 172.21.15.104:0/1767840000 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbf7fe640 1 -- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cc00b1960 msgr2=0x7f9cc015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbf7fe640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cc00b1960 0x7f9cc015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbf7fe640 1 -- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cc00b22f0 msgr2=0x7f9cc00cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbffff640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cc00b22f0 0x7f9cc00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbf7fe640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cc00b22f0 0x7f9cc00cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.402+0000 7f9cbf7fe640 1 -- 172.21.15.104:0/1767840000 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc00ca4b0 con 0x7f9ca8004800 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.403+0000 7f9cbf7fe640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 0x7f9cc00af710 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0011d60 tx=0x7f9cb000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.403+0000 7f9ca7fff640 1 -- 172.21.15.104:0/1767840000 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0003d80 con 0x7f9ca8004800 2024-09-17T03:05:50.403 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.403+0000 7f9ca7fff640 1 -- 172.21.15.104:0/1767840000 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cb0011e50 con 0x7f9ca8004800 2024-09-17T03:05:50.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.403+0000 7f9ca7fff640 1 -- 172.21.15.104:0/1767840000 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0004d60 con 0x7f9ca8004800 2024-09-17T03:05:50.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.403+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc00ca790 con 0x7f9ca8004800 2024-09-17T03:05:50.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.403+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc00afd50 con 0x7f9ca8004800 2024-09-17T03:05:50.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.404+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc00b39c0 con 0x7f9ca8004800 2024-09-17T03:05:50.404 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.404+0000 7f9ca7fff640 1 -- 172.21.15.104:0/1767840000 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9cb0004050 con 0x7f9ca8004800 2024-09-17T03:05:50.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.405+0000 7f9ca7fff640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cac078b90 0x7f9cac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:50.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.405+0000 7f9ca7fff640 1 -- 172.21.15.104:0/1767840000 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7f9cb009bc10 con 0x7f9ca8004800 2024-09-17T03:05:50.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.405+0000 7f9cbeffd640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cac078b90 0x7f9cac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:50.405 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.406+0000 7f9cbeffd640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cac078b90 0x7f9cac07b0a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c260 tx=0x7f9cc00ce6a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:50.407 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.409+0000 7f9ca7fff640 1 -- 172.21.15.104:0/1767840000 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9cb00642d0 con 0x7f9ca8004800 2024-09-17T03:05:50.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.620+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cc00affb0 con 0x7f9ca8004800 2024-09-17T03:05:50.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.620+0000 7f9ca7fff640 1 -- 172.21.15.104:0/1767840000 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+3923 (secure 0 0 0) 0x7f9cb0063bd0 con 0x7f9ca8004800 2024-09-17T03:05:50.619 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:50.619 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":71,"btime":"2024-09-17T03:05:44:405240+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6347,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1948243703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1948243703},{"type":"v1","addr":"172.21.15.192:6836","nonce":1948243703}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7057,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3037806992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3037806992},{"type":"v1","addr":"172.21.15.192:6837","nonce":3037806992}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7788,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6833/2087460219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":2087460219},{"type":"v1","addr":"172.21.15.104:6833","nonce":2087460219}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":8064,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1582644379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6834","nonce":1582644379},{"type":"v1","addr":"172.21.15.104:6835","nonce":1582644379}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[]} 2024-09-17T03:05:50.619 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 71 2024-09-17T03:05:50.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cac078b90 msgr2=0x7f9cac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cac078b90 0x7f9cac07b0a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c260 tx=0x7f9cc00ce6a0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 msgr2=0x7f9cc00af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 0x7f9cc00af710 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0011d60 tx=0x7f9cb000f790 comp rx=0 tx=0).stop 2024-09-17T03:05:50.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 shutdown_connections 2024-09-17T03:05:50.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9cac078b90 0x7f9cac07b0a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cc00b22f0 0x7f9cc00cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cc00b1960 0x7f9cc015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 --2- 172.21.15.104:0/1767840000 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ca8004800 0x7f9cc00af710 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 >> 172.21.15.104:0/1767840000 conn(0x7f9cc00b44a0 msgr2=0x7f9cc00b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:50.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 shutdown_connections 2024-09-17T03:05:50.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.622+0000 7f9cc5c9b640 1 -- 172.21.15.104:0/1767840000 wait complete. 2024-09-17T03:05:50.632 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:05:50.633 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:05:50.633 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:05:50.633 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:05:50.633 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:05:50.633 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:05:50.633 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:05:50.633 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:05:50.634 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:05:50.634 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:05:50.634 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:05:50.634 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:05:50.634 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:05:50.634 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:05:50.635 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:05:50.635 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:05:50.643 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:05:50.643 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:05:50.645 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:05:50.645 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:05:50.648 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:05:50.648 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:05:50.649 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:05:50.649 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:05:50.687 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:05:50.688 DEBUG:teuthology.parallel:result is None 2024-09-17T03:05:50.689 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:05:50.689 DEBUG:teuthology.parallel:result is None 2024-09-17T03:05:50.691 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:05:50.691 DEBUG:teuthology.parallel:result is None 2024-09-17T03:05:50.692 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:05:50.692 DEBUG:teuthology.parallel:result is None 2024-09-17T03:05:50.693 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:05:50.774 INFO:tasks.ceph.mds.a.smithi104.stdout:starting mds.a at 2024-09-17T03:05:50.775 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T03:05:50.785 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2024-09-17T03:05:50.785 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2024-09-17T03:05:50.785 INFO:tasks.ceph.mds.d.smithi192.stderr:2024-09-17T03:05:50.787+0000 7f16c3166640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T03:05:50.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.814+0000 7f4fb42de640 1 -- 172.21.15.104:0/3138275332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac162cb0 msgr2=0x7f4fac0b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.814+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3138275332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac162cb0 0x7f4fac0b65a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009820 tx=0x7f4fa802a510 comp rx=0 tx=0).stop 2024-09-17T03:05:50.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.814+0000 7f4fb42de640 1 -- 172.21.15.104:0/3138275332 shutdown_connections 2024-09-17T03:05:50.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.814+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3138275332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac0b6ae0 0x7f4fac1600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.814+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3138275332 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac162cb0 0x7f4fac0b65a0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.814+0000 7f4fb42de640 1 -- 172.21.15.104:0/3138275332 >> 172.21.15.104:0/3138275332 conn(0x7f4fac069120 msgr2=0x7f4fac069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:50.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.814+0000 7f4fb42de640 1 -- 172.21.15.104:0/3138275332 shutdown_connections 2024-09-17T03:05:50.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.814+0000 7f4fb42de640 1 -- 172.21.15.104:0/3138275332 wait complete. 2024-09-17T03:05:50.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.816+0000 7f4fb42de640 1 Processor -- start 2024-09-17T03:05:50.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.816+0000 7f4fb42de640 1 -- start start 2024-09-17T03:05:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.817+0000 7f4fb42de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fac0b6ae0 0x7f4fac152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.817+0000 7f4fb42de640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac162cb0 0x7f4fac0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.817+0000 7f4fb42de640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac1630c0 0x7f4fac1f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.817+0000 7f4fb42de640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac161e10 con 0x7f4fac1630c0 2024-09-17T03:05:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.817+0000 7f4fb42de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac161c90 con 0x7f4fac0b6ae0 2024-09-17T03:05:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.817+0000 7f4fb42de640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac161f90 con 0x7f4fac162cb0 2024-09-17T03:05:50.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac1630c0 0x7f4fac1f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac1630c0 0x7f4fac1f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48706/0 (socket says 172.21.15.104:48706) 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 -- 172.21.15.104:0/3949121362 learned_addr learned my addr 172.21.15.104:0/3949121362 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb1879640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac162cb0 0x7f4fac0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb207a640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fac0b6ae0 0x7f4fac152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 -- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac162cb0 msgr2=0x7f4fac0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac162cb0 0x7f4fac0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 -- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fac0b6ae0 msgr2=0x7f4fac152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fac0b6ae0 0x7f4fac152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 -- 172.21.15.104:0/3949121362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac152560 con 0x7f4fac1630c0 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb287b640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac1630c0 0x7f4fac1f6000 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400e990 tx=0x7f4fa400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fa2ffd640 1 -- 172.21.15.104:0/3949121362 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4004d20 con 0x7f4fac1630c0 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fa2ffd640 1 -- 172.21.15.104:0/3949121362 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fa400caa0 con 0x7f4fac1630c0 2024-09-17T03:05:50.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac0cbe90 con 0x7f4fac1630c0 2024-09-17T03:05:50.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fa2ffd640 1 -- 172.21.15.104:0/3949121362 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4005020 con 0x7f4fac1630c0 2024-09-17T03:05:50.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.818+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac0cc450 con 0x7f4fac1630c0 2024-09-17T03:05:50.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.819+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac0b65a0 con 0x7f4fac1630c0 2024-09-17T03:05:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.820+0000 7f4fa2ffd640 1 -- 172.21.15.104:0/3949121362 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fa40051c0 con 0x7f4fac1630c0 2024-09-17T03:05:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.820+0000 7f4fa2ffd640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.821+0000 7f4fa2ffd640 1 -- 172.21.15.104:0/3949121362 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 4943+0+0 (secure 0 0 0) 0x7f4fa409b2b0 con 0x7f4fac1630c0 2024-09-17T03:05:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.821+0000 7f4fb207a640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:50.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.821+0000 7f4fb207a640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8034000 tx=0x7f4fa8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:50.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:50.825+0000 7f4fa2ffd640 1 -- 172.21.15.104:0/3949121362 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4fac152560 con 0x7f4fac1630c0 2024-09-17T03:05:51.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.009+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4fac069810 con 0x7f4fac1630c0 2024-09-17T03:05:51.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.449+0000 7f4fa2ffd640 1 -- 172.21.15.104:0/3949121362 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v179) ==== 97+0+0 (secure 0 0 0) 0x7f4fa4016030 con 0x7f4fac1630c0 2024-09-17T03:05:51.448 INFO:teuthology.orchestra.run.smithi104.stderr: removed all blocklist entries 2024-09-17T03:05:51.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 msgr2=0x7f4f9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8034000 tx=0x7f4fa8004730 comp rx=0 tx=0).stop 2024-09-17T03:05:51.450 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac1630c0 msgr2=0x7f4fac1f6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac1630c0 0x7f4fac1f6000 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400e990 tx=0x7f4fa400ee50 comp rx=0 tx=0).stop 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 shutdown_connections 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f90078bc0 0x7f4f9007b0d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4fac1630c0 0x7f4fac1f6000 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac162cb0 0x7f4fac0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 --2- 172.21.15.104:0/3949121362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fac0b6ae0 0x7f4fac152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 >> 172.21.15.104:0/3949121362 conn(0x7f4fac069120 msgr2=0x7f4fac075cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 shutdown_connections 2024-09-17T03:05:51.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.452+0000 7f4fb42de640 1 -- 172.21.15.104:0/3949121362 wait complete. 2024-09-17T03:05:51.462 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:05:51.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.576+0000 7f90b628b640 1 -- 172.21.15.104:0/2306574290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00b6f70 msgr2=0x7f90b015ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.576+0000 7f90b628b640 1 --2- 172.21.15.104:0/2306574290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00b6f70 0x7f90b015ef90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f90b00b44d0 tx=0x7f90a002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.576+0000 7f90b628b640 1 -- 172.21.15.104:0/2306574290 shutdown_connections 2024-09-17T03:05:51.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.576+0000 7f90b628b640 1 --2- 172.21.15.104:0/2306574290 >> v2:172.21.15.192:3300/0 conn(0x7f90b00b3b00 0x7f90b00d11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.576+0000 7f90b628b640 1 --2- 172.21.15.104:0/2306574290 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00b6f70 0x7f90b015ef90 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.576+0000 7f90b628b640 1 -- 172.21.15.104:0/2306574290 >> 172.21.15.104:0/2306574290 conn(0x7f90b0073df0 msgr2=0x7f90b0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:51.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.576+0000 7f90b628b640 1 -- 172.21.15.104:0/2306574290 shutdown_connections 2024-09-17T03:05:51.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.576+0000 7f90b628b640 1 -- 172.21.15.104:0/2306574290 wait complete. 2024-09-17T03:05:51.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.578+0000 7f90b628b640 1 Processor -- start 2024-09-17T03:05:51.576 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.578+0000 7f90b628b640 1 -- start start 2024-09-17T03:05:51.579 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b628b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90b00b3b00 0x7f90b00ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b628b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90b00b6f70 0x7f90b015f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b628b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00d1710 0x7f90b014ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b628b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00d01b0 con 0x7f90b00d1710 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b628b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00d0030 con 0x7f90b00b6f70 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b628b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f90b00d0330 con 0x7f90b00b3b00 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00d1710 0x7f90b014ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00d1710 0x7f90b014ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48724/0 (socket says 172.21.15.104:48724) 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 -- 172.21.15.104:0/2781880483 learned_addr learned my addr 172.21.15.104:0/2781880483 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90affff640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90b00b3b00 0x7f90b00ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90af7fe640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90b00b6f70 0x7f90b015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 -- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90b00b3b00 msgr2=0x7f90b00ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.580 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90b00b3b00 0x7f90b00ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 -- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90b00b6f70 msgr2=0x7f90b015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90b00b6f70 0x7f90b015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 -- 172.21.15.104:0/2781880483 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b00cbcc0 con 0x7f90b00d1710 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90affff640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90b00b3b00 0x7f90b00ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90af7fe640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90b00b6f70 0x7f90b015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b4828640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00d1710 0x7f90b014ee00 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f90a800b990 tx=0x7f90a800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90acff9640 1 -- 172.21.15.104:0/2781880483 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8019070 con 0x7f90b00d1710 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90acff9640 1 -- 172.21.15.104:0/2781880483 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90a800cc90 con 0x7f90b00d1710 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b00cbfa0 con 0x7f90b00d1710 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.580+0000 7f90acff9640 1 -- 172.21.15.104:0/2781880483 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a80146a0 con 0x7f90b00d1710 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.581+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b00cc560 con 0x7f90b00d1710 2024-09-17T03:05:51.581 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.581+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b015e250 con 0x7f90b00d1710 2024-09-17T03:05:51.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.582+0000 7f90acff9640 1 -- 172.21.15.104:0/2781880483 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90a801c070 con 0x7f90b00d1710 2024-09-17T03:05:51.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.583+0000 7f90acff9640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f909c078b90 0x7f909c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:51.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.583+0000 7f90acff9640 1 -- 172.21.15.104:0/2781880483 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4857+0+0 (secure 0 0 0) 0x7f90a809a870 con 0x7f90b00d1710 2024-09-17T03:05:51.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.583+0000 7f90affff640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f909c078b90 0x7f909c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:51.582 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.583+0000 7f90affff640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f909c078b90 0x7f909c07b0a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f90a0033000 tx=0x7f90a0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:51.585 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.587+0000 7f90acff9640 1 -- 172.21.15.104:0/2781880483 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f90a8062f80 con 0x7f90b00d1710 2024-09-17T03:05:51.825 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.827+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f90b00d5640 con 0x7f90b00d1710 2024-09-17T03:05:51.826 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.828+0000 7f90acff9640 1 -- 172.21.15.104:0/2781880483 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v34) ==== 80+0+5304 (secure 0 0 0) 0x7f90a8062880 con 0x7f90b00d1710 2024-09-17T03:05:51.826 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:51.826 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:05:51.826 INFO:teuthology.orchestra.run.smithi104.stdout: "auth_dump": [ 2024-09-17T03:05:51.826 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.a", 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmq1lWDhAA9HpnMUfs1F0MOT/uyJU8cA==", 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.b", 2024-09-17T03:05:51.827 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmplZPGxAAgznJWnQ1V8OgLIrs5nk0yg==", 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.c", 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmB3sFFhAA9SsrqHc7fCMYsCKP06XWpg==", 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:05:51.828 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mds.d", 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmAyLxIhAAwqhxpCQYbkB7EtO5H+Sjog==", 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.829 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.0", 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmEldECBAA7UGhQS9bMqVw1uuHV3zZcQ==", 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.1", 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmIjofEBAAbW0rWB4XQdkADpmwTj33IQ==", 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.830 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.2", 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hm9V2lFxAA07NbES0IHvBUeyKSKGToOA==", 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.831 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.3", 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBT7+hmBWFcHxAAb6XAP6LthlRcrX3xOk6bVw==", 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.832 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.4", 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmgAxKxAA+PX9m+V4HUt4jQnkNXfC7g==", 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.5", 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmlc3qMhAAAOD3I8HERgNC6DdDCy6Mfg==", 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:05:51.833 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.6", 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBW7+hmmqCROhAAnQSbZemcvoi6m5gFmDc67A==", 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.834 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "osd.7", 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBX7+hmaRKwBhAA3kORKoMkXMDx5+JEemxdhA==", 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow profile osd", 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile osd", 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.0", 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ==", 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow r", 2024-09-17T03:05:51.835 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.1", 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmisVaLxAAxZLsNdzxPN/JceB1iIABfg==", 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.836 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.2", 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmATyHKxAAQ2G4/nQP6RVQ5Rj2Rc4K9w==", 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.3", 2024-09-17T03:05:51.837 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmINYyMxAA6sDoCX6JK775PiBF15Q6PA==", 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow", 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow r", 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow rw", 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow rwx" 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "client.admin", 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBO7+hmcqiKLBAAqqeLUPYXnPC2ATFE7SsaGQ==", 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": "allow *", 2024-09-17T03:05:51.838 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow *", 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.x", 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmOn+BChAAzfioVTxWdZbB6gl75lHwUw==", 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:05:51.839 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: "entity": "mgr.y", 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: "key": "AQBP7+hmopYgBhAAULgHw04p8FMvBEXk+eXmvw==", 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: "caps": { 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: "mds": "allow *", 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: "mon": "allow profile mgr", 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": "allow *" 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:05:51.840 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:05:51.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f909c078b90 msgr2=0x7f909c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f909c078b90 0x7f909c07b0a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f90a0033000 tx=0x7f90a0004730 comp rx=0 tx=0).stop 2024-09-17T03:05:51.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00d1710 msgr2=0x7f90b014ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00d1710 0x7f90b014ee00 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f90a800b990 tx=0x7f90a800be50 comp rx=0 tx=0).stop 2024-09-17T03:05:51.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 shutdown_connections 2024-09-17T03:05:51.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f909c078b90 0x7f909c07b0a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90b00b6f70 0x7f90b015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f90b00d1710 0x7f90b014ee00 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 --2- 172.21.15.104:0/2781880483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90b00b3b00 0x7f90b00ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 >> 172.21.15.104:0/2781880483 conn(0x7f90b0073df0 msgr2=0x7f90b00b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:51.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 shutdown_connections 2024-09-17T03:05:51.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.830+0000 7f90b628b640 1 -- 172.21.15.104:0/2781880483 wait complete. 2024-09-17T03:05:51.846 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:05:51.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.960+0000 7fa65d07e640 1 -- 172.21.15.104:0/1650125804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa640004800 msgr2=0x7fa640004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.960+0000 7fa65d07e640 1 --2- 172.21.15.104:0/1650125804 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa640004800 0x7fa640004c10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa6580b0390 tx=0x7fa640005830 comp rx=0 tx=0).stop 2024-09-17T03:05:51.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.960+0000 7fa65759e640 1 -- 172.21.15.104:0/1650125804 reap_dead start 2024-09-17T03:05:51.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.960+0000 7fa65d07e640 1 -- 172.21.15.104:0/1650125804 shutdown_connections 2024-09-17T03:05:51.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.960+0000 7fa65d07e640 1 -- 172.21.15.104:0/1650125804 >> 172.21.15.104:0/1650125804 conn(0x7fa6580b2450 msgr2=0x7fa6580b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:51.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.960+0000 7fa65d07e640 1 -- 172.21.15.104:0/1650125804 shutdown_connections 2024-09-17T03:05:51.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.960+0000 7fa65d07e640 1 -- 172.21.15.104:0/1650125804 wait complete. 2024-09-17T03:05:51.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.962+0000 7fa65d07e640 1 Processor -- start 2024-09-17T03:05:51.960 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.962+0000 7fa65d07e640 1 -- start start 2024-09-17T03:05:51.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.963+0000 7fa65d07e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa640004800 0x7fa6581f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:51.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.963+0000 7fa65d07e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6581e5920 0x7fa6580b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:51.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.963+0000 7fa65d07e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6581f6550 0x7fa6581e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:51.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65d07e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa6580ce990 con 0x7fa6581e5920 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65d07e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa65815bef0 con 0x7fa6581f6550 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65d07e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa6580ceb10 con 0x7fa640004800 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6581e5920 0x7fa6580b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6581e5920 0x7fa6580b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48736/0 (socket says 172.21.15.104:48736) 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 -- 172.21.15.104:0/2754250022 learned_addr learned my addr 172.21.15.104:0/2754250022 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65759e640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6581f6550 0x7fa6581e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa656d9d640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa640004800 0x7fa6581f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 -- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa640004800 msgr2=0x7fa6581f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa640004800 0x7fa6581f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 -- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6581f6550 msgr2=0x7fa6581e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6581f6550 0x7fa6581e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 -- 172.21.15.104:0/2754250022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6580b4650 con 0x7fa6581e5920 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa656d9d640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa640004800 0x7fa6581f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:51.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65659c640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6581e5920 0x7fa6580b4110 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fa64c02aff0 tx=0x7fa64c006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:51.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa63f7fe640 1 -- 172.21.15.104:0/2754250022 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0037f0 con 0x7fa6581e5920 2024-09-17T03:05:51.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa63f7fe640 1 -- 172.21.15.104:0/2754250022 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa64c003a80 con 0x7fa6581e5920 2024-09-17T03:05:51.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6581f5d70 con 0x7fa6581e5920 2024-09-17T03:05:51.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa63f7fe640 1 -- 172.21.15.104:0/2754250022 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c02f470 con 0x7fa6581e5920 2024-09-17T03:05:51.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.964+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6581f9de0 con 0x7fa6581e5920 2024-09-17T03:05:51.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.966+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6580cf070 con 0x7fa6581e5920 2024-09-17T03:05:51.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.966+0000 7fa63f7fe640 1 -- 172.21.15.104:0/2754250022 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa64c02f610 con 0x7fa6581e5920 2024-09-17T03:05:51.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.966+0000 7fa63f7fe640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa644078bc0 0x7fa64407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:51.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.967+0000 7fa63f7fe640 1 -- 172.21.15.104:0/2754250022 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4857+0+0 (secure 0 0 0) 0x7fa64c0bb660 con 0x7fa6581e5920 2024-09-17T03:05:51.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.967+0000 7fa656d9d640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa644078bc0 0x7fa64407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:51.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.967+0000 7fa656d9d640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa644078bc0 0x7fa64407b0d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa648009bb0 tx=0x7fa648005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:51.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:51.971+0000 7fa63f7fe640 1 -- 172.21.15.104:0/2754250022 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa64c049030 con 0x7fa6581e5920 2024-09-17T03:05:52.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.146+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa6580d1350 con 0x7fa6581e5920 2024-09-17T03:05:52.145 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.147+0000 7fa63f7fe640 1 -- 172.21.15.104:0/2754250022 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v181) ==== 84+0+65 (secure 0 0 0) 0x7fa64c083ff0 con 0x7fa6581e5920 2024-09-17T03:05:52.145 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:52.146 INFO:teuthology.orchestra.run.smithi104.stdout:[ 2024-09-17T03:05:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:05:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: "poolnum": 1, 2024-09-17T03:05:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: "poolname": ".mgr" 2024-09-17T03:05:52.146 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:05:52.146 INFO:teuthology.orchestra.run.smithi104.stdout:] 2024-09-17T03:05:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa644078bc0 msgr2=0x7fa64407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa644078bc0 0x7fa64407b0d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa648009bb0 tx=0x7fa648005f90 comp rx=0 tx=0).stop 2024-09-17T03:05:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6581e5920 msgr2=0x7fa6580b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6581e5920 0x7fa6580b4110 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fa64c02aff0 tx=0x7fa64c006290 comp rx=0 tx=0).stop 2024-09-17T03:05:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 shutdown_connections 2024-09-17T03:05:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa644078bc0 0x7fa64407b0d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6581f6550 0x7fa6581e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:52.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6581e5920 0x7fa6580b4110 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:52.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 --2- 172.21.15.104:0/2754250022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa640004800 0x7fa6581f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:52.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 >> 172.21.15.104:0/2754250022 conn(0x7fa6580b2450 msgr2=0x7fa6580b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:52.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 shutdown_connections 2024-09-17T03:05:52.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.149+0000 7fa65d07e640 1 -- 172.21.15.104:0/2754250022 wait complete. 2024-09-17T03:05:52.159 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:05:52.159 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:05:52.276 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.277+0000 7fe1124b4640 1 -- 172.21.15.104:0/2577935802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0f40041c0 msgr2=0x7fe0f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:52.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.277+0000 7fe1124b4640 1 --2- 172.21.15.104:0/2577935802 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe0f40041c0 0x7fe0f4004800 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fe100001830 tx=0x7fe0f4005830 comp rx=0 tx=0).stop 2024-09-17T03:05:52.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.278+0000 7fe110a51640 1 -- 172.21.15.104:0/2577935802 reap_dead start 2024-09-17T03:05:52.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.278+0000 7fe1124b4640 1 -- 172.21.15.104:0/2577935802 shutdown_connections 2024-09-17T03:05:52.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.278+0000 7fe1124b4640 1 -- 172.21.15.104:0/2577935802 >> 172.21.15.104:0/2577935802 conn(0x7fe10c068ee0 msgr2=0x7fe10c0692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:52.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.278+0000 7fe1124b4640 1 -- 172.21.15.104:0/2577935802 shutdown_connections 2024-09-17T03:05:52.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.278+0000 7fe1124b4640 1 -- 172.21.15.104:0/2577935802 wait complete. 2024-09-17T03:05:52.277 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.279+0000 7fe1124b4640 1 Processor -- start 2024-09-17T03:05:52.278 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.280+0000 7fe1124b4640 1 -- start start 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe1124b4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0f40041c0 0x7fe10c1f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe1124b4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe10c1f5f90 0x7fe10c156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe1124b4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe10c157180 0x7fe10c157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe1124b4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c070b20 con 0x7fe10c1f5f90 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe1124b4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c0709a0 con 0x7fe0f40041c0 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe1124b4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe10c070ca0 con 0x7fe10c157180 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe10c1f5f90 0x7fe10c156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10b7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe10c1f5f90 0x7fe10c156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48754/0 (socket says 172.21.15.104:48754) 2024-09-17T03:05:52.281 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10b7fe640 1 -- 172.21.15.104:0/4153752106 learned_addr learned my addr 172.21.15.104:0/4153752106 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10bfff640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0f40041c0 0x7fe10c1f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe110a51640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe10c157180 0x7fe10c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10b7fe640 1 -- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe10c157180 msgr2=0x7fe10c157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10b7fe640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe10c157180 0x7fe10c157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10b7fe640 1 -- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0f40041c0 msgr2=0x7fe10c1f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10b7fe640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0f40041c0 0x7fe10c1f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10b7fe640 1 -- 172.21.15.104:0/4153752106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c1f63a0 con 0x7fe10c1f5f90 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.281+0000 7fe10bfff640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0f40041c0 0x7fe10c1f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.282+0000 7fe10b7fe640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe10c1f5f90 0x7fe10c156c40 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fe100000c00 tx=0x7fe1000060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.282+0000 7fe108ff9640 1 -- 172.21.15.104:0/4153752106 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100044070 con 0x7fe10c1f5f90 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.282+0000 7fe108ff9640 1 -- 172.21.15.104:0/4153752106 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe100003b10 con 0x7fe10c1f5f90 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.282+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10c157eb0 con 0x7fe10c1f5f90 2024-09-17T03:05:52.282 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.282+0000 7fe108ff9640 1 -- 172.21.15.104:0/4153752106 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1000064c0 con 0x7fe10c1f5f90 2024-09-17T03:05:52.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.282+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10c1f3590 con 0x7fe10c1f5f90 2024-09-17T03:05:52.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.283+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10c071200 con 0x7fe10c1f5f90 2024-09-17T03:05:52.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.284+0000 7fe108ff9640 1 -- 172.21.15.104:0/4153752106 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe1000483f0 con 0x7fe10c1f5f90 2024-09-17T03:05:52.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.284+0000 7fe108ff9640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0f8078b90 0x7fe0f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.284+0000 7fe108ff9640 1 -- 172.21.15.104:0/4153752106 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 4857+0+0 (secure 0 0 0) 0x7fe1000ba9d0 con 0x7fe10c1f5f90 2024-09-17T03:05:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.284+0000 7fe10bfff640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0f8078b90 0x7fe0f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:52.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.285+0000 7fe10bfff640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0f8078b90 0x7fe0f807b0a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009590 tx=0x7fe0fc005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:52.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.289+0000 7fe108ff9640 1 -- 172.21.15.104:0/4153752106 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe10c1f63a0 con 0x7fe10c1f5f90 2024-09-17T03:05:52.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:52.467+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe10c071200 con 0x7fe10c1f5f90 2024-09-17T03:05:53.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.466+0000 7fe108ff9640 1 -- 172.21.15.104:0/4153752106 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v182) ==== 138+0+0 (secure 0 0 0) 0x7fe100083160 con 0x7fe10c1f5f90 2024-09-17T03:05:53.465 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' created 2024-09-17T03:05:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.469+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0f8078b90 msgr2=0x7fe0f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.469+0000 7fe1124b4640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0f8078b90 0x7fe0f807b0a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc009590 tx=0x7fe0fc005f30 comp rx=0 tx=0).stop 2024-09-17T03:05:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe10c1f5f90 msgr2=0x7fe10c156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe10c1f5f90 0x7fe10c156c40 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fe100000c00 tx=0x7fe1000060e0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 shutdown_connections 2024-09-17T03:05:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe0f8078b90 0x7fe0f807b0a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe10c157180 0x7fe10c157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe10c1f5f90 0x7fe10c156c40 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 --2- 172.21.15.104:0/4153752106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0f40041c0 0x7fe10c1f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 >> 172.21.15.104:0/4153752106 conn(0x7fe10c068ee0 msgr2=0x7fe10c155490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:53.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.470+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 shutdown_connections 2024-09-17T03:05:53.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.472+0000 7fe1124b4640 1 -- 172.21.15.104:0/4153752106 wait complete. 2024-09-17T03:05:53.485 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:05:53.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.610+0000 7f4f6d119640 1 -- 172.21.15.104:0/3316564007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f68073580 msgr2=0x7f4f68073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:53.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.610+0000 7f4f6d119640 1 --2- 172.21.15.104:0/3316564007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f68073580 0x7f4f68073990 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4f68070b10 tx=0x7f4f5002a560 comp rx=0 tx=0).stop 2024-09-17T03:05:53.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.610+0000 7f4f6d119640 1 -- 172.21.15.104:0/3316564007 shutdown_connections 2024-09-17T03:05:53.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.610+0000 7f4f6d119640 1 --2- 172.21.15.104:0/3316564007 >> v2:172.21.15.192:3300/0 conn(0x7f4f680b4ce0 0x7f4f680b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.610+0000 7f4f6d119640 1 --2- 172.21.15.104:0/3316564007 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f68073580 0x7f4f68073990 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.610+0000 7f4f6d119640 1 -- 172.21.15.104:0/3316564007 >> 172.21.15.104:0/3316564007 conn(0x7f4f680b3640 msgr2=0x7f4f680b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:53.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.610+0000 7f4f6d119640 1 -- 172.21.15.104:0/3316564007 shutdown_connections 2024-09-17T03:05:53.609 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.610+0000 7f4f6d119640 1 -- 172.21.15.104:0/3316564007 wait complete. 2024-09-17T03:05:53.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.612+0000 7f4f6d119640 1 Processor -- start 2024-09-17T03:05:53.611 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.612+0000 7f4f6d119640 1 -- start start 2024-09-17T03:05:53.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.613+0000 7f4f6d119640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f68073580 0x7f4f6813bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:53.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.613+0000 7f4f6d119640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f680b4ce0 0x7f4f68138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:53.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.613+0000 7f4f6d119640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f68152ce0 0x7f4f6814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:53.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6d119640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4f680b59c0 con 0x7f4f680b4ce0 2024-09-17T03:05:53.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6d119640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f680b5840 con 0x7f4f68073580 2024-09-17T03:05:53.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6d119640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4f680b5b40 con 0x7f4f68152ce0 2024-09-17T03:05:53.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f680b4ce0 0x7f4f68138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:53.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f680b4ce0 0x7f4f68138840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:48768/0 (socket says 172.21.15.104:48768) 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 -- 172.21.15.104:0/1670800041 learned_addr learned my addr 172.21.15.104:0/1670800041 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6759e640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f68152ce0 0x7f4f6814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f66d9d640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f68073580 0x7f4f6813bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 -- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f68152ce0 msgr2=0x7f4f6814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f68152ce0 0x7f4f6814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 -- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f68073580 msgr2=0x7f4f6813bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f68073580 0x7f4f6813bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 -- 172.21.15.104:0/1670800041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f68150fc0 con 0x7f4f680b4ce0 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6659c640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f680b4ce0 0x7f4f68138840 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f4f50034040 tx=0x7f4f50003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f5f7fe640 1 -- 172.21.15.104:0/1670800041 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5003e030 con 0x7f4f680b4ce0 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f5f7fe640 1 -- 172.21.15.104:0/1670800041 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f50003e00 con 0x7f4f680b4ce0 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f68151510 con 0x7f4f680b4ce0 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f5f7fe640 1 -- 172.21.15.104:0/1670800041 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50035040 con 0x7f4f680b4ce0 2024-09-17T03:05:53.614 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.614+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6813c130 con 0x7f4f680b4ce0 2024-09-17T03:05:53.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.616+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f681e4560 con 0x7f4f680b4ce0 2024-09-17T03:05:53.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.616+0000 7f4f5f7fe640 1 -- 172.21.15.104:0/1670800041 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f50041030 con 0x7f4f680b4ce0 2024-09-17T03:05:53.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.617+0000 7f4f5f7fe640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f48078b90 0x7f4f4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:53.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.617+0000 7f4f5f7fe640 1 -- 172.21.15.104:0/1670800041 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5227+0+0 (secure 0 0 0) 0x7f4f500bb3e0 con 0x7f4f680b4ce0 2024-09-17T03:05:53.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.617+0000 7f4f66d9d640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f48078b90 0x7f4f4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:53.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.618+0000 7f4f66d9d640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f48078b90 0x7f4f4807b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4f68073380 tx=0x7f4f58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:53.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.622+0000 7f4f5f7fe640 1 -- 172.21.15.104:0/1670800041 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f50083a00 con 0x7f4f680b4ce0 2024-09-17T03:05:53.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:53.798+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4f68073990 con 0x7f4f680b4ce0 2024-09-17T03:05:54.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.473+0000 7f4f5f7fe640 1 -- 172.21.15.104:0/1670800041 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v183) ==== 170+0+0 (secure 0 0 0) 0x7f4f50083300 con 0x7f4f680b4ce0 2024-09-17T03:05:54.472 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' created 2024-09-17T03:05:54.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f48078b90 msgr2=0x7f4f4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:54.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f48078b90 0x7f4f4807b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4f68073380 tx=0x7f4f58009040 comp rx=0 tx=0).stop 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f680b4ce0 msgr2=0x7f4f68138840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f680b4ce0 0x7f4f68138840 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f4f50034040 tx=0x7f4f50003910 comp rx=0 tx=0).stop 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 shutdown_connections 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f48078b90 0x7f4f4807b0a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f68152ce0 0x7f4f6814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f680b4ce0 0x7f4f68138840 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 --2- 172.21.15.104:0/1670800041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f68073580 0x7f4f6813bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 >> 172.21.15.104:0/1670800041 conn(0x7f4f680b3640 msgr2=0x7f4f680d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 shutdown_connections 2024-09-17T03:05:54.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.476+0000 7f4f6d119640 1 -- 172.21.15.104:0/1670800041 wait complete. 2024-09-17T03:05:54.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:05:54.615 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.616+0000 7f12d11e6640 1 -- 172.21.15.104:0/3730542027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0d1400 msgr2=0x7f12cc161560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:54.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.616+0000 7f12d11e6640 1 --2- 172.21.15.104:0/3730542027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0d1400 0x7f12cc161560 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f12cc0d1930 tx=0x7f12b402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.617+0000 7f12d11e6640 1 -- 172.21.15.104:0/3730542027 shutdown_connections 2024-09-17T03:05:54.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.617+0000 7f12d11e6640 1 --2- 172.21.15.104:0/3730542027 >> v2:172.21.15.192:3300/0 conn(0x7f12cc0b6920 0x7f12cc0b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.617+0000 7f12d11e6640 1 --2- 172.21.15.104:0/3730542027 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0d1400 0x7f12cc161560 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.617+0000 7f12d11e6640 1 -- 172.21.15.104:0/3730542027 >> 172.21.15.104:0/3730542027 conn(0x7f12cc0b44a0 msgr2=0x7f12cc0b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:54.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.617+0000 7f12d11e6640 1 -- 172.21.15.104:0/3730542027 shutdown_connections 2024-09-17T03:05:54.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.617+0000 7f12d11e6640 1 -- 172.21.15.104:0/3730542027 wait complete. 2024-09-17T03:05:54.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.618+0000 7f12d11e6640 1 Processor -- start 2024-09-17T03:05:54.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.619+0000 7f12d11e6640 1 -- start start 2024-09-17T03:05:54.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12d11e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0b6920 0x7f12cc0ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:54.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12d11e6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12cc0d0ff0 0x7f12cc0cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:54.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12d11e6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12cc0d1400 0x7f12cc15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:54.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12d11e6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0b7270 con 0x7f12cc0b6920 2024-09-17T03:05:54.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12d11e6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc161cb0 con 0x7f12cc0d0ff0 2024-09-17T03:05:54.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12d11e6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f12cc0b73f0 con 0x7f12cc0d1400 2024-09-17T03:05:54.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0b6920 0x7f12cc0ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:54.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0b6920 0x7f12cc0ce760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37720/0 (socket says 172.21.15.104:37720) 2024-09-17T03:05:54.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cad9d640 1 -- 172.21.15.104:0/1100899122 learned_addr learned my addr 172.21.15.104:0/1100899122 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:54.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12c259c640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12cc0d0ff0 0x7f12cc0cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:54.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cb59e640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12cc0d1400 0x7f12cc15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:54.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cad9d640 1 -- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12cc0d1400 msgr2=0x7f12cc15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:54.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cad9d640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12cc0d1400 0x7f12cc15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cad9d640 1 -- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12cc0d0ff0 msgr2=0x7f12cc0cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:54.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cad9d640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12cc0d0ff0 0x7f12cc0cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:54.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.620+0000 7f12cad9d640 1 -- 172.21.15.104:0/1100899122 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc0ceca0 con 0x7f12cc0b6920 2024-09-17T03:05:54.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.621+0000 7f12cad9d640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0b6920 0x7f12cc0ce760 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c390 tx=0x7f12bc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:54.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.621+0000 7f12c3fff640 1 -- 172.21.15.104:0/1100899122 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc017070 con 0x7f12cc0b6920 2024-09-17T03:05:54.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.621+0000 7f12c3fff640 1 -- 172.21.15.104:0/1100899122 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12bc0035f0 con 0x7f12cc0b6920 2024-09-17T03:05:54.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.621+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12cc0d02c0 con 0x7f12cc0b6920 2024-09-17T03:05:54.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.621+0000 7f12c3fff640 1 -- 172.21.15.104:0/1100899122 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc003a20 con 0x7f12cc0b6920 2024-09-17T03:05:54.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.621+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12cc1f6d90 con 0x7f12cc0b6920 2024-09-17T03:05:54.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.622+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12cc0cee70 con 0x7f12cc0b6920 2024-09-17T03:05:54.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.623+0000 7f12c3fff640 1 -- 172.21.15.104:0/1100899122 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f12bc01a070 con 0x7f12cc0b6920 2024-09-17T03:05:54.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.623+0000 7f12c3fff640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12ac078b90 0x7f12ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:54.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.624+0000 7f12c3fff640 1 -- 172.21.15.104:0/1100899122 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5609+0+0 (secure 0 0 0) 0x7f12bc09a340 con 0x7f12cc0b6920 2024-09-17T03:05:54.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.624+0000 7f12c259c640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12ac078b90 0x7f12ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:54.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.624+0000 7f12c259c640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12ac078b90 0x7f12ac07b0a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f12b4033000 tx=0x7f12b4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:54.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.628+0000 7f12c3fff640 1 -- 172.21.15.104:0/1100899122 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f12bc021020 con 0x7f12cc0b6920 2024-09-17T03:05:54.834 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:54.835+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f12cc0b6d30 con 0x7f12cc0b6920 2024-09-17T03:05:55.473 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.475+0000 7f12c3fff640 1 -- 172.21.15.104:0/1100899122 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v74) ==== 174+0+0 (secure 0 0 0) 0x7f12bc062270 con 0x7f12cc0b6920 2024-09-17T03:05:55.473 INFO:teuthology.orchestra.run.smithi104.stderr:new fs with metadata pool 22 and data pool 23 2024-09-17T03:05:55.477 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.478+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12ac078b90 msgr2=0x7f12ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.478+0000 7f12d11e6640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12ac078b90 0x7f12ac07b0a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f12b4033000 tx=0x7f12b4004730 comp rx=0 tx=0).stop 2024-09-17T03:05:55.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.478+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0b6920 msgr2=0x7f12cc0ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.478+0000 7f12d11e6640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0b6920 0x7f12cc0ce760 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00c390 tx=0x7f12bc00c850 comp rx=0 tx=0).stop 2024-09-17T03:05:55.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.479+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 shutdown_connections 2024-09-17T03:05:55.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.479+0000 7f12d11e6640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f12ac078b90 0x7f12ac07b0a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.479+0000 7f12d11e6640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12cc0d0ff0 0x7f12cc0cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.479+0000 7f12d11e6640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12cc0d1400 0x7f12cc15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.479+0000 7f12d11e6640 1 --2- 172.21.15.104:0/1100899122 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f12cc0b6920 0x7f12cc0ce760 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.479+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 >> 172.21.15.104:0/1100899122 conn(0x7f12cc0b44a0 msgr2=0x7f12cc15d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:55.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.479+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 shutdown_connections 2024-09-17T03:05:55.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.479+0000 7f12d11e6640 1 -- 172.21.15.104:0/1100899122 wait complete. 2024-09-17T03:05:55.501 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:05:55.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.617+0000 7f66ec494640 1 -- 172.21.15.104:0/3092124659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 msgr2=0x7f66e4072880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.617+0000 7f66ec494640 1 --2- 172.21.15.104:0/3092124659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 0x7f66e4072880 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f66e406ecb0 tx=0x7f66d402a530 comp rx=0 tx=0).stop 2024-09-17T03:05:55.616 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.617+0000 7f66ec494640 1 -- 172.21.15.104:0/3092124659 shutdown_connections 2024-09-17T03:05:55.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.617+0000 7f66ec494640 1 --2- 172.21.15.104:0/3092124659 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 0x7f66e4072880 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.617+0000 7f66ec494640 1 --2- 172.21.15.104:0/3092124659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66e415b7f0 0x7f66e415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.617+0000 7f66ec494640 1 -- 172.21.15.104:0/3092124659 >> 172.21.15.104:0/3092124659 conn(0x7f66e40b2450 msgr2=0x7f66e40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:55.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.617+0000 7f66ec494640 1 -- 172.21.15.104:0/3092124659 shutdown_connections 2024-09-17T03:05:55.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.617+0000 7f66ec494640 1 -- 172.21.15.104:0/3092124659 wait complete. 2024-09-17T03:05:55.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.619+0000 7f66ec494640 1 Processor -- start 2024-09-17T03:05:55.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.619+0000 7f66ec494640 1 -- start start 2024-09-17T03:05:55.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ec494640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 0x7f66e415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:55.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ec494640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66e4072dc0 0x7f66e414d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:55.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ec494640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66e415b7f0 0x7f66e414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:55.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ec494640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f66e415fe30 con 0x7f66e4072470 2024-09-17T03:05:55.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ec494640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66e40cf4a0 con 0x7f66e4072dc0 2024-09-17T03:05:55.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ec494640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f66e415ffb0 con 0x7f66e415b7f0 2024-09-17T03:05:55.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 0x7f66e415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:55.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 0x7f66e415d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37744/0 (socket says 172.21.15.104:37744) 2024-09-17T03:05:55.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 -- 172.21.15.104:0/2022210185 learned_addr learned my addr 172.21.15.104:0/2022210185 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:55.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66eaa31640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66e415b7f0 0x7f66e414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:55.620 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66e9a2f640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66e4072dc0 0x7f66e414d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 -- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66e415b7f0 msgr2=0x7f66e414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66e415b7f0 0x7f66e414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 -- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66e4072dc0 msgr2=0x7f66e414d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66e4072dc0 0x7f66e414d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 -- 172.21.15.104:0/2022210185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e414e110 con 0x7f66e4072470 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.620+0000 7f66ea230640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 0x7f66e415d990 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f66e000d6d0 tx=0x7f66e000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.621+0000 7f66daffd640 1 -- 172.21.15.104:0/2022210185 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0017070 con 0x7f66e4072470 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.621+0000 7f66daffd640 1 -- 172.21.15.104:0/2022210185 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e0005330 con 0x7f66e4072470 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.621+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e414e3f0 con 0x7f66e4072470 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.621+0000 7f66daffd640 1 -- 172.21.15.104:0/2022210185 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0009820 con 0x7f66e4072470 2024-09-17T03:05:55.621 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.621+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e415df60 con 0x7f66e4072470 2024-09-17T03:05:55.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.622+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e415c170 con 0x7f66e4072470 2024-09-17T03:05:55.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.622+0000 7f66daffd640 1 -- 172.21.15.104:0/2022210185 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66e00099c0 con 0x7f66e4072470 2024-09-17T03:05:55.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.623+0000 7f66daffd640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c8078b90 0x7f66c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:55.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.623+0000 7f66daffd640 1 -- 172.21.15.104:0/2022210185 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7f66e009ada0 con 0x7f66e4072470 2024-09-17T03:05:55.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.623+0000 7f66e9a2f640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c8078b90 0x7f66c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:55.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.624+0000 7f66e9a2f640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c8078b90 0x7f66c807b0a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f66d4033000 tx=0x7f66d4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:55.626 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.627+0000 7f66daffd640 1 -- 172.21.15.104:0/2022210185 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66e0062b90 con 0x7f66e4072470 2024-09-17T03:05:55.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.805+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66e41604d0 con 0x7f66e4072470 2024-09-17T03:05:55.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.806+0000 7f66daffd640 1 -- 172.21.15.104:0/2022210185 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) ==== 74+0+16793 (secure 0 0 0) 0x7f66e00675c0 con 0x7f66e4072470 2024-09-17T03:05:55.805 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:55.805 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":184,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:05:54.836614+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:05:52.471547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:05:53.802461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:05:55.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c8078b90 msgr2=0x7f66c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c8078b90 0x7f66c807b0a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f66d4033000 tx=0x7f66d4004730 comp rx=0 tx=0).stop 2024-09-17T03:05:55.807 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 msgr2=0x7f66e415d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 0x7f66e415d990 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f66e000d6d0 tx=0x7f66e000db90 comp rx=0 tx=0).stop 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 shutdown_connections 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c8078b90 0x7f66c807b0a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66e4072dc0 0x7f66e414d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66e415b7f0 0x7f66e414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 --2- 172.21.15.104:0/2022210185 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66e4072470 0x7f66e415d990 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.808+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 >> 172.21.15.104:0/2022210185 conn(0x7f66e40b2450 msgr2=0x7f66e4075ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.809+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 shutdown_connections 2024-09-17T03:05:55.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.809+0000 7f66ec494640 1 -- 172.21.15.104:0/2022210185 wait complete. 2024-09-17T03:05:55.819 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:05:55.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.932+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/1605027309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 msgr2=0x7f6e4815cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.932+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/1605027309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 0x7f6e4815cc30 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f6e480cebb0 tx=0x7f6e3802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.932+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/1605027309 shutdown_connections 2024-09-17T03:05:55.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.932+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/1605027309 >> v2:172.21.15.192:3300/0 conn(0x7f6e480cde80 0x7f6e480cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.932+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/1605027309 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 0x7f6e4815cc30 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.932+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/1605027309 >> 172.21.15.104:0/1605027309 conn(0x7f6e4806eb90 msgr2=0x7f6e4806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:55.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.932+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/1605027309 shutdown_connections 2024-09-17T03:05:55.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.932+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/1605027309 wait complete. 2024-09-17T03:05:55.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.934+0000 7f6e4ddf1640 1 Processor -- start 2024-09-17T03:05:55.932 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.934+0000 7f6e4ddf1640 1 -- start start 2024-09-17T03:05:55.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e4ddf1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 0x7f6e48151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:55.934 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e4ddf1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e48155f70 0x7f6e48158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e4ddf1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e481485a0 0x7f6e48158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e4ddf1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480d0190 con 0x7f6e48073e00 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e4ddf1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480d0010 con 0x7f6e48155f70 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e4ddf1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6e480d0310 con 0x7f6e481485a0 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e477fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 0x7f6e48151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e477fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 0x7f6e48151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37770/0 (socket says 172.21.15.104:37770) 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e477fe640 1 -- 172.21.15.104:0/3087139840 learned_addr learned my addr 172.21.15.104:0/3087139840 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e3ffff640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e48155f70 0x7f6e48158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:55.935 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.935+0000 7f6e47fff640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e481485a0 0x7f6e48158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e477fe640 1 -- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e481485a0 msgr2=0x7f6e48158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e477fe640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e481485a0 0x7f6e48158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e477fe640 1 -- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e48155f70 msgr2=0x7f6e48158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e477fe640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e48155f70 0x7f6e48158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e477fe640 1 -- 172.21.15.104:0/3087139840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4814b6c0 con 0x7f6e48073e00 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e477fe640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 0x7f6e48151720 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f6e38000c00 tx=0x7f6e38003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e44ff9640 1 -- 172.21.15.104:0/3087139840 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3803e030 con 0x7f6e48073e00 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e44ff9640 1 -- 172.21.15.104:0/3087139840 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e38003e00 con 0x7f6e48073e00 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e481578b0 con 0x7f6e48073e00 2024-09-17T03:05:55.936 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e44ff9640 1 -- 172.21.15.104:0/3087139840 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38035040 con 0x7f6e48073e00 2024-09-17T03:05:55.937 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.936+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e48157e70 con 0x7f6e48073e00 2024-09-17T03:05:55.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.937+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e480d07c0 con 0x7f6e48073e00 2024-09-17T03:05:55.938 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.938+0000 7f6e44ff9640 1 -- 172.21.15.104:0/3087139840 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6e38041030 con 0x7f6e48073e00 2024-09-17T03:05:55.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.938+0000 7f6e44ff9640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e28078b90 0x7f6e2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:55.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.938+0000 7f6e44ff9640 1 -- 172.21.15.104:0/3087139840 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7f6e380bb4b0 con 0x7f6e48073e00 2024-09-17T03:05:55.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.938+0000 7f6e3ffff640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e28078b90 0x7f6e2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:55.939 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.939+0000 7f6e3ffff640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e28078b90 0x7f6e2807b0a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6e481493e0 tx=0x7f6e30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:55.941 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:55.943+0000 7f6e44ff9640 1 -- 172.21.15.104:0/3087139840 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6e380832b0 con 0x7f6e48073e00 2024-09-17T03:05:56.114 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.116+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e48070ce0 con 0x7f6e48073e00 2024-09-17T03:05:56.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.117+0000 7f6e44ff9640 1 -- 172.21.15.104:0/3087139840 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) ==== 74+0+16793 (secure 0 0 0) 0x7f6e38087ce0 con 0x7f6e48073e00 2024-09-17T03:05:56.116 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:56.116 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":184,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:05:54.836614+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:05:52.471547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:05:53.802461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:05:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e28078b90 msgr2=0x7f6e2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e28078b90 0x7f6e2807b0a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6e481493e0 tx=0x7f6e30009040 comp rx=0 tx=0).stop 2024-09-17T03:05:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 msgr2=0x7f6e48151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 0x7f6e48151720 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f6e38000c00 tx=0x7f6e38003910 comp rx=0 tx=0).stop 2024-09-17T03:05:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 shutdown_connections 2024-09-17T03:05:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6e28078b90 0x7f6e2807b0a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e48155f70 0x7f6e48158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6e481485a0 0x7f6e48158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 --2- 172.21.15.104:0/3087139840 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6e48073e00 0x7f6e48151720 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 >> 172.21.15.104:0/3087139840 conn(0x7f6e4806eb90 msgr2=0x7f6e480b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:56.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.119+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 shutdown_connections 2024-09-17T03:05:56.119 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.120+0000 7f6e4ddf1640 1 -- 172.21.15.104:0/3087139840 wait complete. 2024-09-17T03:05:56.130 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:05:56.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.246+0000 7f2c06a8b640 1 -- 172.21.15.104:0/2904329856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 msgr2=0x7f2c00160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.246+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/2904329856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 0x7f2c00160ec0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005fd0 tx=0x7f2bf002a540 comp rx=0 tx=0).stop 2024-09-17T03:05:56.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.246+0000 7f2c06a8b640 1 -- 172.21.15.104:0/2904329856 shutdown_connections 2024-09-17T03:05:56.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.246+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/2904329856 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 0x7f2c00160ec0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.246+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/2904329856 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000d3490 0x7f2c000b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.246+0000 7f2c06a8b640 1 -- 172.21.15.104:0/2904329856 >> 172.21.15.104:0/2904329856 conn(0x7f2c000d2970 msgr2=0x7f2c000d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:56.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.246+0000 7f2c06a8b640 1 -- 172.21.15.104:0/2904329856 shutdown_connections 2024-09-17T03:05:56.247 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.246+0000 7f2c06a8b640 1 -- 172.21.15.104:0/2904329856 wait complete. 2024-09-17T03:05:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.248+0000 7f2c06a8b640 1 Processor -- start 2024-09-17T03:05:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.248+0000 7f2c06a8b640 1 -- start start 2024-09-17T03:05:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.249+0000 7f2c06a8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 0x7f2c00153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.249+0000 7f2c06a8b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000d13e0 0x7f2c00153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.249+0000 7f2c06a8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c000d3490 0x7f2c000ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.249+0000 7f2c06a8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2c000b6bd0 con 0x7f2c000d0fd0 2024-09-17T03:05:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.249+0000 7f2c06a8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c000b6a50 con 0x7f2c000d3490 2024-09-17T03:05:56.251 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.249+0000 7f2c06a8b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2c000b6d50 con 0x7f2c000d13e0 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 0x7f2c00153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 0x7f2c00153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37800/0 (socket says 172.21.15.104:37800) 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 -- 172.21.15.104:0/1103482986 learned_addr learned my addr 172.21.15.104:0/1103482986 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2bf7fff640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000d13e0 0x7f2c00153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c05028640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c000d3490 0x7f2c000ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 -- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000d13e0 msgr2=0x7f2c00153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000d13e0 0x7f2c00153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 -- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c000d3490 msgr2=0x7f2c000ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c000d3490 0x7f2c000ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 -- 172.21.15.104:0/1103482986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c000ce360 con 0x7f2c000d0fd0 2024-09-17T03:05:56.252 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c05028640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c000d3490 0x7f2c000ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c04827640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 0x7f2c00153630 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00d780 tx=0x7f2bfc00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2bf57fa640 1 -- 172.21.15.104:0/1103482986 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc017070 con 0x7f2c000d0fd0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2bf57fa640 1 -- 172.21.15.104:0/1103482986 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bfc00de90 con 0x7f2c000d0fd0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2bf57fa640 1 -- 172.21.15.104:0/1103482986 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0099d0 con 0x7f2c000d0fd0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c001512b0 con 0x7f2c000d0fd0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.250+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c00154200 con 0x7f2c000d0fd0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.252+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c000b7c80 con 0x7f2c000d0fd0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.252+0000 7f2bf57fa640 1 -- 172.21.15.104:0/1103482986 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2bfc009b70 con 0x7f2c000d0fd0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.252+0000 7f2bf57fa640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2bec078b90 0x7f2bec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.253+0000 7f2bf57fa640 1 -- 172.21.15.104:0/1103482986 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7f2bfc09b080 con 0x7f2c000d0fd0 2024-09-17T03:05:56.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.253+0000 7f2bf7fff640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2bec078b90 0x7f2bec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:56.254 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.253+0000 7f2bf7fff640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2bec078b90 0x7f2bec07b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0033000 tx=0x7f2bf0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:56.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.257+0000 7f2bf57fa640 1 -- 172.21.15.104:0/1103482986 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2bfc020020 con 0x7f2c000d0fd0 2024-09-17T03:05:56.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.467+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2c000d3270 con 0x7f2c000d0fd0 2024-09-17T03:05:56.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.489+0000 7f2bf57fa640 1 -- 172.21.15.104:0/1103482986 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) ==== 118+0+0 (secure 0 0 0) 0x7f2bfc063550 con 0x7f2c000d0fd0 2024-09-17T03:05:56.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2bec078b90 msgr2=0x7f2bec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2bec078b90 0x7f2bec07b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0033000 tx=0x7f2bf0004730 comp rx=0 tx=0).stop 2024-09-17T03:05:56.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 msgr2=0x7f2c00153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 0x7f2c00153630 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00d780 tx=0x7f2bfc00dc40 comp rx=0 tx=0).stop 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 shutdown_connections 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2bec078b90 0x7f2bec07b0a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c000d3490 0x7f2c000ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c000d13e0 0x7f2c00153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 --2- 172.21.15.104:0/1103482986 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2c000d0fd0 0x7f2c00153630 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 >> 172.21.15.104:0/1103482986 conn(0x7f2c000d2970 msgr2=0x7f2c000afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 shutdown_connections 2024-09-17T03:05:56.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.492+0000 7f2c06a8b640 1 -- 172.21.15.104:0/1103482986 wait complete. 2024-09-17T03:05:56.502 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:05:56.502 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:05:56.617 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.619+0000 7fedb32f9640 1 -- 172.21.15.104:0/1996548061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac06fdf0 msgr2=0x7fedac0d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.619+0000 7fedb32f9640 1 --2- 172.21.15.104:0/1996548061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac06fdf0 0x7fedac0d1c80 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fed9c005fd0 tx=0x7fed9c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.619+0000 7fedb32f9640 1 -- 172.21.15.104:0/1996548061 shutdown_connections 2024-09-17T03:05:56.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.619+0000 7fedb32f9640 1 --2- 172.21.15.104:0/1996548061 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac06fdf0 0x7fedac0d1c80 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.619+0000 7fedb32f9640 1 --2- 172.21.15.104:0/1996548061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedac0744d0 0x7fedac160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.619+0000 7fedb32f9640 1 -- 172.21.15.104:0/1996548061 >> 172.21.15.104:0/1996548061 conn(0x7fedac06d200 msgr2=0x7fedac06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:56.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.619+0000 7fedb32f9640 1 -- 172.21.15.104:0/1996548061 shutdown_connections 2024-09-17T03:05:56.618 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.619+0000 7fedb32f9640 1 -- 172.21.15.104:0/1996548061 wait complete. 2024-09-17T03:05:56.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.620+0000 7fedb32f9640 1 Processor -- start 2024-09-17T03:05:56.619 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.620+0000 7fedb32f9640 1 -- start start 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb32f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedac06fdf0 0x7fedac0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb32f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac070200 0x7fedac150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb32f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedac0744d0 0x7fedac151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb32f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fedac069410 con 0x7fedac070200 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb32f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fedac0d2540 con 0x7fedac0744d0 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb32f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fedac069590 con 0x7fedac06fdf0 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac070200 0x7fedac150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac070200 0x7fedac150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37820/0 (socket says 172.21.15.104:37820) 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 -- 172.21.15.104:0/759609286 learned_addr learned my addr 172.21.15.104:0/759609286 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:56.622 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb1896640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedac0744d0 0x7fedac151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb1095640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedac06fdf0 0x7fedac0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 -- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedac06fdf0 msgr2=0x7fedac0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedac06fdf0 0x7fedac0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 -- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedac0744d0 msgr2=0x7fedac151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedac0744d0 0x7fedac151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 -- 172.21.15.104:0/759609286 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac1f4060 con 0x7fedac070200 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb1095640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedac06fdf0 0x7fedac0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.622+0000 7fedb0894640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac070200 0x7fedac150c30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fed9c000c00 tx=0x7fed9c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.623+0000 7feda1ffb640 1 -- 172.21.15.104:0/759609286 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c03e030 con 0x7fedac070200 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.623+0000 7feda1ffb640 1 -- 172.21.15.104:0/759609286 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed9c003ca0 con 0x7fedac070200 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.623+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedac1f4340 con 0x7fedac070200 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.623+0000 7feda1ffb640 1 -- 172.21.15.104:0/759609286 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c035040 con 0x7fedac070200 2024-09-17T03:05:56.623 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.623+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedac1f4c00 con 0x7fedac070200 2024-09-17T03:05:56.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.624+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedac069a40 con 0x7fedac070200 2024-09-17T03:05:56.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.624+0000 7feda1ffb640 1 -- 172.21.15.104:0/759609286 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed9c041030 con 0x7fedac070200 2024-09-17T03:05:56.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.625+0000 7feda1ffb640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078bc0 0x7fed9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:56.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.625+0000 7feda1ffb640 1 -- 172.21.15.104:0/759609286 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fed9c0bb240 con 0x7fedac070200 2024-09-17T03:05:56.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.625+0000 7fedb1095640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078bc0 0x7fed9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:56.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.626+0000 7fedb1095640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078bc0 0x7fed9007b0d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feda8005c40 tx=0x7feda800a410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:56.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.629+0000 7feda1ffb640 1 -- 172.21.15.104:0/759609286 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed9c0830c0 con 0x7fedac070200 2024-09-17T03:05:56.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:56.843+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fedac1f3df0 con 0x7fedac070200 2024-09-17T03:05:57.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.496+0000 7feda1ffb640 1 -- 172.21.15.104:0/759609286 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) ==== 122+0+0 (secure 0 0 0) 0x7fed9c087af0 con 0x7fedac070200 2024-09-17T03:05:57.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078bc0 msgr2=0x7fed9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078bc0 0x7fed9007b0d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feda8005c40 tx=0x7feda800a410 comp rx=0 tx=0).stop 2024-09-17T03:05:57.497 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac070200 msgr2=0x7fedac150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac070200 0x7fedac150c30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fed9c000c00 tx=0x7fed9c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 shutdown_connections 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fed90078bc0 0x7fed9007b0d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedac0744d0 0x7fedac151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fedac070200 0x7fedac150c30 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 --2- 172.21.15.104:0/759609286 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fedac06fdf0 0x7fedac0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 >> 172.21.15.104:0/759609286 conn(0x7fedac06d200 msgr2=0x7fedac1563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 shutdown_connections 2024-09-17T03:05:57.498 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.499+0000 7fedb32f9640 1 -- 172.21.15.104:0/759609286 wait complete. 2024-09-17T03:05:57.510 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:05:57.510 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:05:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.625+0000 7fb66f484640 1 -- 172.21.15.104:0/3482498744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6680cff70 msgr2=0x7fb66815b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.625+0000 7fb66f484640 1 --2- 172.21.15.104:0/3482498744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6680cff70 0x7fb66815b170 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fb668074370 tx=0x7fb65802aac0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.625+0000 7fb66f484640 1 -- 172.21.15.104:0/3482498744 shutdown_connections 2024-09-17T03:05:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.625+0000 7fb66f484640 1 --2- 172.21.15.104:0/3482498744 >> v2:172.21.15.192:3300/0 conn(0x7fb66806f840 0x7fb668072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.625+0000 7fb66f484640 1 --2- 172.21.15.104:0/3482498744 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb6680cff70 0x7fb66815b170 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.625+0000 7fb66f484640 1 -- 172.21.15.104:0/3482498744 >> 172.21.15.104:0/3482498744 conn(0x7fb6680b2450 msgr2=0x7fb6680b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.625+0000 7fb66f484640 1 -- 172.21.15.104:0/3482498744 shutdown_connections 2024-09-17T03:05:57.624 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.625+0000 7fb66f484640 1 -- 172.21.15.104:0/3482498744 wait complete. 2024-09-17T03:05:57.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.627+0000 7fb66f484640 1 Processor -- start 2024-09-17T03:05:57.625 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.627+0000 7fb66f484640 1 -- start start 2024-09-17T03:05:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66f484640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb66806f840 0x7fb66814d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66f484640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb668073370 0x7fb668167050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66f484640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6680cff70 0x7fb668167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66f484640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb66806fdd0 con 0x7fb668073370 2024-09-17T03:05:57.628 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66f484640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb66806fc50 con 0x7fb6680cff70 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66f484640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb6680b3e60 con 0x7fb66806f840 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66ca1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb668073370 0x7fb668167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66ca1f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb668073370 0x7fb668167050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37824/0 (socket says 172.21.15.104:37824) 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66ca1f640 1 -- 172.21.15.104:0/985858129 learned_addr learned my addr 172.21.15.104:0/985858129 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66d220640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb66806f840 0x7fb66814d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.628+0000 7fb66da21640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6680cff70 0x7fb668167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb66ca1f640 1 -- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb66806f840 msgr2=0x7fb66814d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb66ca1f640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb66806f840 0x7fb66814d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb66ca1f640 1 -- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6680cff70 msgr2=0x7fb668167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb66ca1f640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6680cff70 0x7fb668167590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.629 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb66ca1f640 1 -- 172.21.15.104:0/985858129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb668152520 con 0x7fb668073370 2024-09-17T03:05:57.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb66ca1f640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb668073370 0x7fb668167050 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00d6d0 tx=0x7fb65c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:57.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb665ffb640 1 -- 172.21.15.104:0/985858129 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c017070 con 0x7fb668073370 2024-09-17T03:05:57.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb665ffb640 1 -- 172.21.15.104:0/985858129 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb65c009b10 con 0x7fb668073370 2024-09-17T03:05:57.630 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66815a6b0 con 0x7fb668073370 2024-09-17T03:05:57.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb665ffb640 1 -- 172.21.15.104:0/985858129 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c010460 con 0x7fb668073370 2024-09-17T03:05:57.631 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.629+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb668152800 con 0x7fb668073370 2024-09-17T03:05:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.630+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6680b03c0 con 0x7fb668073370 2024-09-17T03:05:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.631+0000 7fb665ffb640 1 -- 172.21.15.104:0/985858129 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb65c01a070 con 0x7fb668073370 2024-09-17T03:05:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.632+0000 7fb665ffb640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb654078b90 0x7fb65407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.632+0000 7fb665ffb640 1 -- 172.21.15.104:0/985858129 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fb65c09ae30 con 0x7fb668073370 2024-09-17T03:05:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.632+0000 7fb66d220640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb654078b90 0x7fb65407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:57.632 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.632+0000 7fb66d220640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb654078b90 0x7fb65407b0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb658035000 tx=0x7fb658038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:57.634 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.636+0000 7fb665ffb640 1 -- 172.21.15.104:0/985858129 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6680b03c0 con 0x7fb668073370 2024-09-17T03:05:57.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.844+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb668072e30 con 0x7fb668073370 2024-09-17T03:05:57.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.844+0000 7fb665ffb640 1 -- 172.21.15.104:0/985858129 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7fb65c062c20 con 0x7fb668073370 2024-09-17T03:05:57.843 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:57.843 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:05:57.844 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:05:57.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb654078b90 msgr2=0x7fb65407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb654078b90 0x7fb65407b0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb658035000 tx=0x7fb658038040 comp rx=0 tx=0).stop 2024-09-17T03:05:57.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb668073370 msgr2=0x7fb668167050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb668073370 0x7fb668167050 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00d6d0 tx=0x7fb65c00db90 comp rx=0 tx=0).stop 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 shutdown_connections 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb654078b90 0x7fb65407b0a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6680cff70 0x7fb668167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb668073370 0x7fb668167050 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 --2- 172.21.15.104:0/985858129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb66806f840 0x7fb66814d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 >> 172.21.15.104:0/985858129 conn(0x7fb6680b2450 msgr2=0x7fb66815d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 shutdown_connections 2024-09-17T03:05:57.846 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.847+0000 7fb66f484640 1 -- 172.21.15.104:0/985858129 wait complete. 2024-09-17T03:05:57.857 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:05:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.970+0000 7f1faa38b640 1 -- 172.21.15.104:0/4223405931 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40b3b00 msgr2=0x7f1fa40d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.970+0000 7f1faa38b640 1 --2- 172.21.15.104:0/4223405931 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40b3b00 0x7f1fa40d34f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c005fd0 tx=0x7f1f9c02aa80 comp rx=0 tx=0).stop 2024-09-17T03:05:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.970+0000 7f1faa38b640 1 -- 172.21.15.104:0/4223405931 shutdown_connections 2024-09-17T03:05:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.970+0000 7f1faa38b640 1 --2- 172.21.15.104:0/4223405931 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40b3b00 0x7f1fa40d34f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.970+0000 7f1faa38b640 1 --2- 172.21.15.104:0/4223405931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fa40d18e0 0x7f1fa415ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.969 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.970+0000 7f1faa38b640 1 -- 172.21.15.104:0/4223405931 >> 172.21.15.104:0/4223405931 conn(0x7f1fa4073df0 msgr2=0x7f1fa4068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.970+0000 7f1faa38b640 1 -- 172.21.15.104:0/4223405931 shutdown_connections 2024-09-17T03:05:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.970+0000 7f1faa38b640 1 -- 172.21.15.104:0/4223405931 wait complete. 2024-09-17T03:05:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.972+0000 7f1faa38b640 1 Processor -- start 2024-09-17T03:05:57.970 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.972+0000 7f1faa38b640 1 -- start start 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.973+0000 7f1faa38b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fa40b3b00 0x7f1fa415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.973+0000 7f1faa38b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa40b6f70 0x7f1fa40c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.973+0000 7f1faa38b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40d18e0 0x7f1fa40b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1faa38b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa40d3dc0 con 0x7f1fa40d18e0 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1faa38b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa40d3c40 con 0x7f1fa40b6f70 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1faa38b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa40d3f40 con 0x7f1fa40b3b00 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40d18e0 0x7f1fa40b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40d18e0 0x7f1fa40b92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37842/0 (socket says 172.21.15.104:37842) 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 -- 172.21.15.104:0/2872328144 learned_addr learned my addr 172.21.15.104:0/2872328144 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa3fff640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fa40b3b00 0x7f1fa415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:57.974 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa37fe640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa40b6f70 0x7f1fa40c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 -- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fa40b3b00 msgr2=0x7f1fa415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fa40b3b00 0x7f1fa415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 -- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa40b6f70 msgr2=0x7f1fa40c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa40b6f70 0x7f1fa40c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 -- 172.21.15.104:0/2872328144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa41f5fc0 con 0x7f1fa40d18e0 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa8928640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40d18e0 0x7f1fa40b92e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009bf0 tx=0x7f1f9c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa0ff9640 1 -- 172.21.15.104:0/2872328144 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c044070 con 0x7f1fa40d18e0 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa0ff9640 1 -- 172.21.15.104:0/2872328144 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f9c004250 con 0x7f1fa40d18e0 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1fa0ff9640 1 -- 172.21.15.104:0/2872328144 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c004660 con 0x7f1fa40d18e0 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa41f62a0 con 0x7f1fa40d18e0 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.974+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa41f6860 con 0x7f1fa40d18e0 2024-09-17T03:05:57.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.975+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa41f5d30 con 0x7f1fa40d18e0 2024-09-17T03:05:57.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.976+0000 7f1fa0ff9640 1 -- 172.21.15.104:0/2872328144 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f9c047070 con 0x7f1fa40d18e0 2024-09-17T03:05:57.976 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.976+0000 7f1fa0ff9640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1f90078b90 0x7f1f9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:57.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.977+0000 7f1fa0ff9640 1 -- 172.21.15.104:0/2872328144 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f1f9c0bbbe0 con 0x7f1fa40d18e0 2024-09-17T03:05:57.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.977+0000 7f1fa3fff640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1f90078b90 0x7f1f9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:57.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.977+0000 7f1fa3fff640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1f90078b90 0x7f1f9007b0a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1f94001720 tx=0x7f1f94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:57.979 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:57.981+0000 7f1fa0ff9640 1 -- 172.21.15.104:0/2872328144 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f9c032030 con 0x7f1fa40d18e0 2024-09-17T03:05:58.154 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.156+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fa40d4460 con 0x7f1fa40d18e0 2024-09-17T03:05:58.155 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.157+0000 7f1fa0ff9640 1 -- 172.21.15.104:0/2872328144 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) ==== 74+0+16780 (secure 0 0 0) 0x7f1f9c083a60 con 0x7f1fa40d18e0 2024-09-17T03:05:58.156 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:58.156 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":185,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:05:56.475406+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:05:52.471547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:05:53.802461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:05:58.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1f90078b90 msgr2=0x7f1f9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1f90078b90 0x7f1f9007b0a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1f94001720 tx=0x7f1f94009040 comp rx=0 tx=0).stop 2024-09-17T03:05:58.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40d18e0 msgr2=0x7f1fa40b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40d18e0 0x7f1fa40b92e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009bf0 tx=0x7f1f9c003ce0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.158 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 shutdown_connections 2024-09-17T03:05:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f1f90078b90 0x7f1f9007b0a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa40b6f70 0x7f1fa40c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1fa40d18e0 0x7f1fa40b92e0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 --2- 172.21.15.104:0/2872328144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fa40b3b00 0x7f1fa415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 >> 172.21.15.104:0/2872328144 conn(0x7f1fa4073df0 msgr2=0x7f1fa40b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 shutdown_connections 2024-09-17T03:05:58.159 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.159+0000 7f1faa38b640 1 -- 172.21.15.104:0/2872328144 wait complete. 2024-09-17T03:05:58.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:05:58.170 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:05:58.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.284+0000 7fa649abd640 1 -- 172.21.15.104:0/2926740584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62c003a50 msgr2=0x7fa62c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.284+0000 7fa649abd640 1 --2- 172.21.15.104:0/2926740584 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa62c003a50 0x7fa62c003ec0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fa634009d00 tx=0x7fa62c005830 comp rx=0 tx=0).stop 2024-09-17T03:05:58.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.284+0000 7fa643fff640 1 -- 172.21.15.104:0/2926740584 reap_dead start 2024-09-17T03:05:58.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.284+0000 7fa649abd640 1 -- 172.21.15.104:0/2926740584 shutdown_connections 2024-09-17T03:05:58.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.284+0000 7fa649abd640 1 -- 172.21.15.104:0/2926740584 >> 172.21.15.104:0/2926740584 conn(0x7fa6440d2970 msgr2=0x7fa6440d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:58.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.284+0000 7fa649abd640 1 -- 172.21.15.104:0/2926740584 shutdown_connections 2024-09-17T03:05:58.283 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.284+0000 7fa649abd640 1 -- 172.21.15.104:0/2926740584 wait complete. 2024-09-17T03:05:58.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.286+0000 7fa649abd640 1 Processor -- start 2024-09-17T03:05:58.284 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.286+0000 7fa649abd640 1 -- start start 2024-09-17T03:05:58.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa649abd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa62c003a50 0x7fa6441f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:58.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa649abd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6441f79c0 0x7fa6440cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:58.287 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa649abd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6440cc700 0x7fa6440b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa649abd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa644161c60 con 0x7fa6441f79c0 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa649abd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa644161ae0 con 0x7fa6440cc700 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa649abd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa6440b6840 con 0x7fa62c003a50 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa642ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6441f79c0 0x7fa6440cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa642ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6441f79c0 0x7fa6440cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37856/0 (socket says 172.21.15.104:37856) 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.287+0000 7fa642ffd640 1 -- 172.21.15.104:0/3624488003 learned_addr learned my addr 172.21.15.104:0/3624488003 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa6437fe640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa62c003a50 0x7fa6441f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa643fff640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6440cc700 0x7fa6440b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa642ffd640 1 -- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa62c003a50 msgr2=0x7fa6441f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa642ffd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa62c003a50 0x7fa6441f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa642ffd640 1 -- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6440cc700 msgr2=0x7fa6440b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa642ffd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6440cc700 0x7fa6440b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa642ffd640 1 -- 172.21.15.104:0/3624488003 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6441f3760 con 0x7fa6441f79c0 2024-09-17T03:05:58.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa643fff640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6440cc700 0x7fa6440b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:58.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa642ffd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6441f79c0 0x7fa6440cc1c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fa63800e590 tx=0x7fa63800ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:58.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa62bfff640 1 -- 172.21.15.104:0/3624488003 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638015070 con 0x7fa6441f79c0 2024-09-17T03:05:58.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa62bfff640 1 -- 172.21.15.104:0/3624488003 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa63800c9e0 con 0x7fa6441f79c0 2024-09-17T03:05:58.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6441f3a20 con 0x7fa6441f79c0 2024-09-17T03:05:58.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa62bfff640 1 -- 172.21.15.104:0/3624488003 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63800cdf0 con 0x7fa6441f79c0 2024-09-17T03:05:58.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.288+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6441f3fe0 con 0x7fa6441f79c0 2024-09-17T03:05:58.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.289+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6440b7c80 con 0x7fa6441f79c0 2024-09-17T03:05:58.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.290+0000 7fa62bfff640 1 -- 172.21.15.104:0/3624488003 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa638018070 con 0x7fa6441f79c0 2024-09-17T03:05:58.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.291+0000 7fa62bfff640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa630078b90 0x7fa63007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:58.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.291+0000 7fa62bfff640 1 -- 172.21.15.104:0/3624488003 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fa63809b1e0 con 0x7fa6441f79c0 2024-09-17T03:05:58.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.291+0000 7fa6437fe640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa630078b90 0x7fa63007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:58.290 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.291+0000 7fa6437fe640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa630078b90 0x7fa63007b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa634035000 tx=0x7fa6340046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:58.293 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.295+0000 7fa62bfff640 1 -- 172.21.15.104:0/3624488003 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa638063620 con 0x7fa6441f79c0 2024-09-17T03:05:58.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.465+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6440d0900 con 0x7fa630078b90 2024-09-17T03:05:58.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.469+0000 7fa62bfff640 1 -- 172.21.15.104:0/3624488003 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247983 (secure 0 0 0) 0x7fa6440d0900 con 0x7fa630078b90 2024-09-17T03:05:58.471 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:58.472 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:05:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa630078b90 msgr2=0x7fa63007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa630078b90 0x7fa63007b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa634035000 tx=0x7fa6340046c0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.474 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6441f79c0 msgr2=0x7fa6440cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6441f79c0 0x7fa6440cc1c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fa63800e590 tx=0x7fa63800ea50 comp rx=0 tx=0).stop 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 shutdown_connections 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa630078b90 0x7fa63007b0a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6440cc700 0x7fa6440b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa6441f79c0 0x7fa6440cc1c0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 --2- 172.21.15.104:0/3624488003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa62c003a50 0x7fa6441f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 >> 172.21.15.104:0/3624488003 conn(0x7fa6440d2970 msgr2=0x7fa64415cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 shutdown_connections 2024-09-17T03:05:58.475 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.473+0000 7fa649abd640 1 -- 172.21.15.104:0/3624488003 wait complete. 2024-09-17T03:05:58.483 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":521,"stamp":"2024-09-17T03:05:57.800961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553262,"statfs":{"total":1600000000,"available":1590541308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.331989"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657379+0000","last_change":"2024-09-17T03:05:55.496237+0000","last_active":"2024-09-17T03:05:56.657379+0000","last_peered":"2024-09-17T03:05:56.657379+0000","last_clean":"2024-09-17T03:05:56.657379+0000","last_became_active":"2024-09-17T03:05:55.495944+0000","last_became_peered":"2024-09-17T03:05:55.495944+0000","last_unstale":"2024-09-17T03:05:56.657379+0000","last_undegraded":"2024-09-17T03:05:56.657379+0000","last_fullsized":"2024-09-17T03:05:56.657379+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:58.038735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480122+0000","last_change":"2024-09-17T03:05:55.492192+0000","last_active":"2024-09-17T03:05:56.480122+0000","last_peered":"2024-09-17T03:05:56.480122+0000","last_clean":"2024-09-17T03:05:56.480122+0000","last_became_active":"2024-09-17T03:05:55.490189+0000","last_became_peered":"2024-09-17T03:05:55.490189+0000","last_unstale":"2024-09-17T03:05:56.480122+0000","last_undegraded":"2024-09-17T03:05:56.480122+0000","last_fullsized":"2024-09-17T03:05:56.480122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:04.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657273+0000","last_change":"2024-09-17T03:05:55.492499+0000","last_active":"2024-09-17T03:05:56.657273+0000","last_peered":"2024-09-17T03:05:56.657273+0000","last_clean":"2024-09-17T03:05:56.657273+0000","last_became_active":"2024-09-17T03:05:55.491322+0000","last_became_peered":"2024-09-17T03:05:55.491322+0000","last_unstale":"2024-09-17T03:05:56.657273+0000","last_undegraded":"2024-09-17T03:05:56.657273+0000","last_fullsized":"2024-09-17T03:05:56.657273+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:24.161911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656498+0000","last_change":"2024-09-17T03:05:55.496457+0000","last_active":"2024-09-17T03:05:56.656498+0000","last_peered":"2024-09-17T03:05:56.656498+0000","last_clean":"2024-09-17T03:05:56.656498+0000","last_became_active":"2024-09-17T03:05:55.496181+0000","last_became_peered":"2024-09-17T03:05:55.496181+0000","last_unstale":"2024-09-17T03:05:56.656498+0000","last_undegraded":"2024-09-17T03:05:56.656498+0000","last_fullsized":"2024-09-17T03:05:56.656498+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:38.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480514+0000","last_change":"2024-09-17T03:05:55.487572+0000","last_active":"2024-09-17T03:05:56.480514+0000","last_peered":"2024-09-17T03:05:56.480514+0000","last_clean":"2024-09-17T03:05:56.480514+0000","last_became_active":"2024-09-17T03:05:55.487310+0000","last_became_peered":"2024-09-17T03:05:55.487310+0000","last_unstale":"2024-09-17T03:05:56.480514+0000","last_undegraded":"2024-09-17T03:05:56.480514+0000","last_fullsized":"2024-09-17T03:05:56.480514+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:23.674636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656424+0000","last_change":"2024-09-17T03:05:55.489945+0000","last_active":"2024-09-17T03:05:56.656424+0000","last_peered":"2024-09-17T03:05:56.656424+0000","last_clean":"2024-09-17T03:05:56.656424+0000","last_became_active":"2024-09-17T03:05:55.489334+0000","last_became_peered":"2024-09-17T03:05:55.489334+0000","last_unstale":"2024-09-17T03:05:56.656424+0000","last_undegraded":"2024-09-17T03:05:56.656424+0000","last_fullsized":"2024-09-17T03:05:56.656424+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:32.127744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478467+0000","last_change":"2024-09-17T03:05:55.485768+0000","last_active":"2024-09-17T03:05:56.478467+0000","last_peered":"2024-09-17T03:05:56.478467+0000","last_clean":"2024-09-17T03:05:56.478467+0000","last_became_active":"2024-09-17T03:05:55.485489+0000","last_became_peered":"2024-09-17T03:05:55.485489+0000","last_unstale":"2024-09-17T03:05:56.478467+0000","last_undegraded":"2024-09-17T03:05:56.478467+0000","last_fullsized":"2024-09-17T03:05:56.478467+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:17.745336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479864+0000","last_change":"2024-09-17T03:05:55.488828+0000","last_active":"2024-09-17T03:05:56.479864+0000","last_peered":"2024-09-17T03:05:56.479864+0000","last_clean":"2024-09-17T03:05:56.479864+0000","last_became_active":"2024-09-17T03:05:55.487813+0000","last_became_peered":"2024-09-17T03:05:55.487813+0000","last_unstale":"2024-09-17T03:05:56.479864+0000","last_undegraded":"2024-09-17T03:05:56.479864+0000","last_fullsized":"2024-09-17T03:05:56.479864+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:16.751546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479533+0000","last_change":"2024-09-17T03:05:55.485025+0000","last_active":"2024-09-17T03:05:56.479533+0000","last_peered":"2024-09-17T03:05:56.479533+0000","last_clean":"2024-09-17T03:05:56.479533+0000","last_became_active":"2024-09-17T03:05:55.484687+0000","last_became_peered":"2024-09-17T03:05:55.484687+0000","last_unstale":"2024-09-17T03:05:56.479533+0000","last_undegraded":"2024-09-17T03:05:56.479533+0000","last_fullsized":"2024-09-17T03:05:56.479533+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:16.541411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480744+0000","last_change":"2024-09-17T03:05:55.499004+0000","last_active":"2024-09-17T03:05:56.480744+0000","last_peered":"2024-09-17T03:05:56.480744+0000","last_clean":"2024-09-17T03:05:56.480744+0000","last_became_active":"2024-09-17T03:05:55.498666+0000","last_became_peered":"2024-09-17T03:05:55.498666+0000","last_unstale":"2024-09-17T03:05:56.480744+0000","last_undegraded":"2024-09-17T03:05:56.480744+0000","last_fullsized":"2024-09-17T03:05:56.480744+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:35.262033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479315+0000","last_change":"2024-09-17T03:05:55.489004+0000","last_active":"2024-09-17T03:05:56.479315+0000","last_peered":"2024-09-17T03:05:56.479315+0000","last_clean":"2024-09-17T03:05:56.479315+0000","last_became_active":"2024-09-17T03:05:55.488273+0000","last_became_peered":"2024-09-17T03:05:55.488273+0000","last_unstale":"2024-09-17T03:05:56.479315+0000","last_undegraded":"2024-09-17T03:05:56.479315+0000","last_fullsized":"2024-09-17T03:05:56.479315+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:02.795728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480461+0000","last_change":"2024-09-17T03:05:55.491651+0000","last_active":"2024-09-17T03:05:56.480461+0000","last_peered":"2024-09-17T03:05:56.480461+0000","last_clean":"2024-09-17T03:05:56.480461+0000","last_became_active":"2024-09-17T03:05:55.486282+0000","last_became_peered":"2024-09-17T03:05:55.486282+0000","last_unstale":"2024-09-17T03:05:56.480461+0000","last_undegraded":"2024-09-17T03:05:56.480461+0000","last_fullsized":"2024-09-17T03:05:56.480461+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:23.085703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656725+0000","last_change":"2024-09-17T03:05:55.496678+0000","last_active":"2024-09-17T03:05:56.656725+0000","last_peered":"2024-09-17T03:05:56.656725+0000","last_clean":"2024-09-17T03:05:56.656725+0000","last_became_active":"2024-09-17T03:05:55.496337+0000","last_became_peered":"2024-09-17T03:05:55.496337+0000","last_unstale":"2024-09-17T03:05:56.656725+0000","last_undegraded":"2024-09-17T03:05:56.656725+0000","last_fullsized":"2024-09-17T03:05:56.656725+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:50.986727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656565+0000","last_change":"2024-09-17T03:05:55.492658+0000","last_active":"2024-09-17T03:05:56.656565+0000","last_peered":"2024-09-17T03:05:56.656565+0000","last_clean":"2024-09-17T03:05:56.656565+0000","last_became_active":"2024-09-17T03:05:55.492402+0000","last_became_peered":"2024-09-17T03:05:55.492402+0000","last_unstale":"2024-09-17T03:05:56.656565+0000","last_undegraded":"2024-09-17T03:05:56.656565+0000","last_fullsized":"2024-09-17T03:05:56.656565+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:28.309004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657073+0000","last_change":"2024-09-17T03:05:55.499804+0000","last_active":"2024-09-17T03:05:56.657073+0000","last_peered":"2024-09-17T03:05:56.657073+0000","last_clean":"2024-09-17T03:05:56.657073+0000","last_became_active":"2024-09-17T03:05:55.499540+0000","last_became_peered":"2024-09-17T03:05:55.499540+0000","last_unstale":"2024-09-17T03:05:56.657073+0000","last_undegraded":"2024-09-17T03:05:56.657073+0000","last_fullsized":"2024-09-17T03:05:56.657073+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:46.639864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478601+0000","last_change":"2024-09-17T03:05:55.491926+0000","last_active":"2024-09-17T03:05:56.478601+0000","last_peered":"2024-09-17T03:05:56.478601+0000","last_clean":"2024-09-17T03:05:56.478601+0000","last_became_active":"2024-09-17T03:05:55.491242+0000","last_became_peered":"2024-09-17T03:05:55.491242+0000","last_unstale":"2024-09-17T03:05:56.478601+0000","last_undegraded":"2024-09-17T03:05:56.478601+0000","last_fullsized":"2024-09-17T03:05:56.478601+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:00.160157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656638+0000","last_change":"2024-09-17T03:05:55.488573+0000","last_active":"2024-09-17T03:05:56.656638+0000","last_peered":"2024-09-17T03:05:56.656638+0000","last_clean":"2024-09-17T03:05:56.656638+0000","last_became_active":"2024-09-17T03:05:55.488292+0000","last_became_peered":"2024-09-17T03:05:55.488292+0000","last_unstale":"2024-09-17T03:05:56.656638+0000","last_undegraded":"2024-09-17T03:05:56.656638+0000","last_fullsized":"2024-09-17T03:05:56.656638+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:05.414941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656599+0000","last_change":"2024-09-17T03:05:55.487917+0000","last_active":"2024-09-17T03:05:56.656599+0000","last_peered":"2024-09-17T03:05:56.656599+0000","last_clean":"2024-09-17T03:05:56.656599+0000","last_became_active":"2024-09-17T03:05:55.487588+0000","last_became_peered":"2024-09-17T03:05:55.487588+0000","last_unstale":"2024-09-17T03:05:56.656599+0000","last_undegraded":"2024-09-17T03:05:56.656599+0000","last_fullsized":"2024-09-17T03:05:56.656599+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:20.410132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657801+0000","last_change":"2024-09-17T03:05:55.492574+0000","last_active":"2024-09-17T03:05:56.657801+0000","last_peered":"2024-09-17T03:05:56.657801+0000","last_clean":"2024-09-17T03:05:56.657801+0000","last_became_active":"2024-09-17T03:05:55.492013+0000","last_became_peered":"2024-09-17T03:05:55.492013+0000","last_unstale":"2024-09-17T03:05:56.657801+0000","last_undegraded":"2024-09-17T03:05:56.657801+0000","last_fullsized":"2024-09-17T03:05:56.657801+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:44.293810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657423+0000","last_change":"2024-09-17T03:05:55.495769+0000","last_active":"2024-09-17T03:05:56.657423+0000","last_peered":"2024-09-17T03:05:56.657423+0000","last_clean":"2024-09-17T03:05:56.657423+0000","last_became_active":"2024-09-17T03:05:55.494067+0000","last_became_peered":"2024-09-17T03:05:55.494067+0000","last_unstale":"2024-09-17T03:05:56.657423+0000","last_undegraded":"2024-09-17T03:05:56.657423+0000","last_fullsized":"2024-09-17T03:05:56.657423+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:43.837310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656668+0000","last_change":"2024-09-17T03:05:55.488515+0000","last_active":"2024-09-17T03:05:56.656668+0000","last_peered":"2024-09-17T03:05:56.656668+0000","last_clean":"2024-09-17T03:05:56.656668+0000","last_became_active":"2024-09-17T03:05:55.488243+0000","last_became_peered":"2024-09-17T03:05:55.488243+0000","last_unstale":"2024-09-17T03:05:56.656668+0000","last_undegraded":"2024-09-17T03:05:56.656668+0000","last_fullsized":"2024-09-17T03:05:56.656668+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:32.716231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480707+0000","last_change":"2024-09-17T03:05:55.490586+0000","last_active":"2024-09-17T03:05:56.480707+0000","last_peered":"2024-09-17T03:05:56.480707+0000","last_clean":"2024-09-17T03:05:56.480707+0000","last_became_active":"2024-09-17T03:05:55.485899+0000","last_became_peered":"2024-09-17T03:05:55.485899+0000","last_unstale":"2024-09-17T03:05:56.480707+0000","last_undegraded":"2024-09-17T03:05:56.480707+0000","last_fullsized":"2024-09-17T03:05:56.480707+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:50.105245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657984+0000","last_change":"2024-09-17T03:05:55.492145+0000","last_active":"2024-09-17T03:05:56.657984+0000","last_peered":"2024-09-17T03:05:56.657984+0000","last_clean":"2024-09-17T03:05:56.657984+0000","last_became_active":"2024-09-17T03:05:55.491679+0000","last_became_peered":"2024-09-17T03:05:55.491679+0000","last_unstale":"2024-09-17T03:05:56.657984+0000","last_undegraded":"2024-09-17T03:05:56.657984+0000","last_fullsized":"2024-09-17T03:05:56.657984+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:04.619866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479179+0000","last_change":"2024-09-17T03:05:55.491230+0000","last_active":"2024-09-17T03:05:56.479179+0000","last_peered":"2024-09-17T03:05:56.479179+0000","last_clean":"2024-09-17T03:05:56.479179+0000","last_became_active":"2024-09-17T03:05:55.490934+0000","last_became_peered":"2024-09-17T03:05:55.490934+0000","last_unstale":"2024-09-17T03:05:56.479179+0000","last_undegraded":"2024-09-17T03:05:56.479179+0000","last_fullsized":"2024-09-17T03:05:56.479179+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:28.601204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657561+0000","last_change":"2024-09-17T03:05:55.496156+0000","last_active":"2024-09-17T03:05:56.657561+0000","last_peered":"2024-09-17T03:05:56.657561+0000","last_clean":"2024-09-17T03:05:56.657561+0000","last_became_active":"2024-09-17T03:05:55.495159+0000","last_became_peered":"2024-09-17T03:05:55.495159+0000","last_unstale":"2024-09-17T03:05:56.657561+0000","last_undegraded":"2024-09-17T03:05:56.657561+0000","last_fullsized":"2024-09-17T03:05:56.657561+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:11.461081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478393+0000","last_change":"2024-09-17T03:05:55.499653+0000","last_active":"2024-09-17T03:05:56.478393+0000","last_peered":"2024-09-17T03:05:56.478393+0000","last_clean":"2024-09-17T03:05:56.478393+0000","last_became_active":"2024-09-17T03:05:55.499352+0000","last_became_peered":"2024-09-17T03:05:55.499352+0000","last_unstale":"2024-09-17T03:05:56.478393+0000","last_undegraded":"2024-09-17T03:05:56.478393+0000","last_fullsized":"2024-09-17T03:05:56.478393+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:06.779287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656627+0000","last_change":"2024-09-17T03:05:55.497530+0000","last_active":"2024-09-17T03:05:56.656627+0000","last_peered":"2024-09-17T03:05:56.656627+0000","last_clean":"2024-09-17T03:05:56.656627+0000","last_became_active":"2024-09-17T03:05:55.497251+0000","last_became_peered":"2024-09-17T03:05:55.497251+0000","last_unstale":"2024-09-17T03:05:56.656627+0000","last_undegraded":"2024-09-17T03:05:56.656627+0000","last_fullsized":"2024-09-17T03:05:56.656627+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:58.542003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656772+0000","last_change":"2024-09-17T03:05:55.495044+0000","last_active":"2024-09-17T03:05:56.656772+0000","last_peered":"2024-09-17T03:05:56.656772+0000","last_clean":"2024-09-17T03:05:56.656772+0000","last_became_active":"2024-09-17T03:05:55.494356+0000","last_became_peered":"2024-09-17T03:05:55.494356+0000","last_unstale":"2024-09-17T03:05:56.656772+0000","last_undegraded":"2024-09-17T03:05:56.656772+0000","last_fullsized":"2024-09-17T03:05:56.656772+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:21.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656837+0000","last_change":"2024-09-17T03:05:55.497939+0000","last_active":"2024-09-17T03:05:56.656837+0000","last_peered":"2024-09-17T03:05:56.656837+0000","last_clean":"2024-09-17T03:05:56.656837+0000","last_became_active":"2024-09-17T03:05:55.497674+0000","last_became_peered":"2024-09-17T03:05:55.497674+0000","last_unstale":"2024-09-17T03:05:56.656837+0000","last_undegraded":"2024-09-17T03:05:56.656837+0000","last_fullsized":"2024-09-17T03:05:56.656837+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.579597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479358+0000","last_change":"2024-09-17T03:05:55.490863+0000","last_active":"2024-09-17T03:05:56.479358+0000","last_peered":"2024-09-17T03:05:56.479358+0000","last_clean":"2024-09-17T03:05:56.479358+0000","last_became_active":"2024-09-17T03:05:55.490583+0000","last_became_peered":"2024-09-17T03:05:55.490583+0000","last_unstale":"2024-09-17T03:05:56.479358+0000","last_undegraded":"2024-09-17T03:05:56.479358+0000","last_fullsized":"2024-09-17T03:05:56.479358+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479776+0000","last_change":"2024-09-17T03:05:55.492029+0000","last_active":"2024-09-17T03:05:56.479776+0000","last_peered":"2024-09-17T03:05:56.479776+0000","last_clean":"2024-09-17T03:05:56.479776+0000","last_became_active":"2024-09-17T03:05:55.491245+0000","last_became_peered":"2024-09-17T03:05:55.491245+0000","last_unstale":"2024-09-17T03:05:56.479776+0000","last_undegraded":"2024-09-17T03:05:56.479776+0000","last_fullsized":"2024-09-17T03:05:56.479776+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:20.924141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658257+0000","last_change":"2024-09-17T03:05:55.487206+0000","last_active":"2024-09-17T03:05:56.658257+0000","last_peered":"2024-09-17T03:05:56.658257+0000","last_clean":"2024-09-17T03:05:56.658257+0000","last_became_active":"2024-09-17T03:05:55.485710+0000","last_became_peered":"2024-09-17T03:05:55.485710+0000","last_unstale":"2024-09-17T03:05:56.658257+0000","last_undegraded":"2024-09-17T03:05:56.658257+0000","last_fullsized":"2024-09-17T03:05:56.658257+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:08.622671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478193+0000","last_change":"2024-09-17T03:05:55.500988+0000","last_active":"2024-09-17T03:05:56.478193+0000","last_peered":"2024-09-17T03:05:56.478193+0000","last_clean":"2024-09-17T03:05:56.478193+0000","last_became_active":"2024-09-17T03:05:55.500702+0000","last_became_peered":"2024-09-17T03:05:55.500702+0000","last_unstale":"2024-09-17T03:05:56.478193+0000","last_undegraded":"2024-09-17T03:05:56.478193+0000","last_fullsized":"2024-09-17T03:05:56.478193+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:43.145148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"184'4","reported_seq":19,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656568+0000","last_change":"2024-09-17T03:05:54.490107+0000","last_active":"2024-09-17T03:05:56.656568+0000","last_peered":"2024-09-17T03:05:56.656568+0000","last_clean":"2024-09-17T03:05:56.656568+0000","last_became_active":"2024-09-17T03:05:54.489817+0000","last_became_peered":"2024-09-17T03:05:54.489817+0000","last_unstale":"2024-09-17T03:05:56.656568+0000","last_undegraded":"2024-09-17T03:05:56.656568+0000","last_fullsized":"2024-09-17T03:05:56.656568+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:05.875207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479550+0000","last_change":"2024-09-17T03:05:55.490094+0000","last_active":"2024-09-17T03:05:56.479550+0000","last_peered":"2024-09-17T03:05:56.479550+0000","last_clean":"2024-09-17T03:05:56.479550+0000","last_became_active":"2024-09-17T03:05:55.489699+0000","last_became_peered":"2024-09-17T03:05:55.489699+0000","last_unstale":"2024-09-17T03:05:56.479550+0000","last_undegraded":"2024-09-17T03:05:56.479550+0000","last_fullsized":"2024-09-17T03:05:56.479550+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:33.686278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479347+0000","last_change":"2024-09-17T03:05:54.492735+0000","last_active":"2024-09-17T03:05:56.479347+0000","last_peered":"2024-09-17T03:05:56.479347+0000","last_clean":"2024-09-17T03:05:56.479347+0000","last_became_active":"2024-09-17T03:05:54.492370+0000","last_became_peered":"2024-09-17T03:05:54.492370+0000","last_unstale":"2024-09-17T03:05:56.479347+0000","last_undegraded":"2024-09-17T03:05:56.479347+0000","last_fullsized":"2024-09-17T03:05:56.479347+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:48.985815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656900+0000","last_change":"2024-09-17T03:05:55.489602+0000","last_active":"2024-09-17T03:05:56.656900+0000","last_peered":"2024-09-17T03:05:56.656900+0000","last_clean":"2024-09-17T03:05:56.656900+0000","last_became_active":"2024-09-17T03:05:55.488975+0000","last_became_peered":"2024-09-17T03:05:55.488975+0000","last_unstale":"2024-09-17T03:05:56.656900+0000","last_undegraded":"2024-09-17T03:05:56.656900+0000","last_fullsized":"2024-09-17T03:05:56.656900+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:10.069759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657064+0000","last_change":"2024-09-17T03:05:54.488222+0000","last_active":"2024-09-17T03:05:56.657064+0000","last_peered":"2024-09-17T03:05:56.657064+0000","last_clean":"2024-09-17T03:05:56.657064+0000","last_became_active":"2024-09-17T03:05:54.487939+0000","last_became_peered":"2024-09-17T03:05:54.487939+0000","last_unstale":"2024-09-17T03:05:56.657064+0000","last_undegraded":"2024-09-17T03:05:56.657064+0000","last_fullsized":"2024-09-17T03:05:56.657064+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:45.372599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657693+0000","last_change":"2024-09-17T03:05:55.495427+0000","last_active":"2024-09-17T03:05:56.657693+0000","last_peered":"2024-09-17T03:05:56.657693+0000","last_clean":"2024-09-17T03:05:56.657693+0000","last_became_active":"2024-09-17T03:05:55.493524+0000","last_became_peered":"2024-09-17T03:05:55.493524+0000","last_unstale":"2024-09-17T03:05:56.657693+0000","last_undegraded":"2024-09-17T03:05:56.657693+0000","last_fullsized":"2024-09-17T03:05:56.657693+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:17.172791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657477+0000","last_change":"2024-09-17T03:05:54.488042+0000","last_active":"2024-09-17T03:05:56.657477+0000","last_peered":"2024-09-17T03:05:56.657477+0000","last_clean":"2024-09-17T03:05:56.657477+0000","last_became_active":"2024-09-17T03:05:54.487736+0000","last_became_peered":"2024-09-17T03:05:54.487736+0000","last_unstale":"2024-09-17T03:05:56.657477+0000","last_undegraded":"2024-09-17T03:05:56.657477+0000","last_fullsized":"2024-09-17T03:05:56.657477+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:31.854304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478212+0000","last_change":"2024-09-17T03:05:55.485380+0000","last_active":"2024-09-17T03:05:56.478212+0000","last_peered":"2024-09-17T03:05:56.478212+0000","last_clean":"2024-09-17T03:05:56.478212+0000","last_became_active":"2024-09-17T03:05:55.485089+0000","last_became_peered":"2024-09-17T03:05:55.485089+0000","last_unstale":"2024-09-17T03:05:56.478212+0000","last_undegraded":"2024-09-17T03:05:56.478212+0000","last_fullsized":"2024-09-17T03:05:56.478212+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:52.402768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657128+0000","last_change":"2024-09-17T03:05:54.490342+0000","last_active":"2024-09-17T03:05:56.657128+0000","last_peered":"2024-09-17T03:05:56.657128+0000","last_clean":"2024-09-17T03:05:56.657128+0000","last_became_active":"2024-09-17T03:05:54.490082+0000","last_became_peered":"2024-09-17T03:05:54.490082+0000","last_unstale":"2024-09-17T03:05:56.657128+0000","last_undegraded":"2024-09-17T03:05:56.657128+0000","last_fullsized":"2024-09-17T03:05:56.657128+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:48.599539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656539+0000","last_change":"2024-09-17T03:05:55.496127+0000","last_active":"2024-09-17T03:05:56.656539+0000","last_peered":"2024-09-17T03:05:56.656539+0000","last_clean":"2024-09-17T03:05:56.656539+0000","last_became_active":"2024-09-17T03:05:55.493834+0000","last_became_peered":"2024-09-17T03:05:55.493834+0000","last_unstale":"2024-09-17T03:05:56.656539+0000","last_undegraded":"2024-09-17T03:05:56.656539+0000","last_fullsized":"2024-09-17T03:05:56.656539+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:16.586315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656897+0000","last_change":"2024-09-17T03:05:54.489157+0000","last_active":"2024-09-17T03:05:56.656897+0000","last_peered":"2024-09-17T03:05:56.656897+0000","last_clean":"2024-09-17T03:05:56.656897+0000","last_became_active":"2024-09-17T03:05:54.488876+0000","last_became_peered":"2024-09-17T03:05:54.488876+0000","last_unstale":"2024-09-17T03:05:56.656897+0000","last_undegraded":"2024-09-17T03:05:56.656897+0000","last_fullsized":"2024-09-17T03:05:56.656897+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:59.598633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656632+0000","last_change":"2024-09-17T03:05:55.497874+0000","last_active":"2024-09-17T03:05:56.656632+0000","last_peered":"2024-09-17T03:05:56.656632+0000","last_clean":"2024-09-17T03:05:56.656632+0000","last_became_active":"2024-09-17T03:05:55.496789+0000","last_became_peered":"2024-09-17T03:05:55.496789+0000","last_unstale":"2024-09-17T03:05:56.656632+0000","last_undegraded":"2024-09-17T03:05:56.656632+0000","last_fullsized":"2024-09-17T03:05:56.656632+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:15.337367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479312+0000","last_change":"2024-09-17T03:05:54.490230+0000","last_active":"2024-09-17T03:05:56.479312+0000","last_peered":"2024-09-17T03:05:56.479312+0000","last_clean":"2024-09-17T03:05:56.479312+0000","last_became_active":"2024-09-17T03:05:54.489971+0000","last_became_peered":"2024-09-17T03:05:54.489971+0000","last_unstale":"2024-09-17T03:05:56.479312+0000","last_undegraded":"2024-09-17T03:05:56.479312+0000","last_fullsized":"2024-09-17T03:05:56.479312+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:53.673437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658079+0000","last_change":"2024-09-17T03:05:55.491609+0000","last_active":"2024-09-17T03:05:56.658079+0000","last_peered":"2024-09-17T03:05:56.658079+0000","last_clean":"2024-09-17T03:05:56.658079+0000","last_became_active":"2024-09-17T03:05:55.491334+0000","last_became_peered":"2024-09-17T03:05:55.491334+0000","last_unstale":"2024-09-17T03:05:56.658079+0000","last_undegraded":"2024-09-17T03:05:56.658079+0000","last_fullsized":"2024-09-17T03:05:56.658079+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:25.988549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478207+0000","last_change":"2024-09-17T03:05:54.484801+0000","last_active":"2024-09-17T03:05:56.478207+0000","last_peered":"2024-09-17T03:05:56.478207+0000","last_clean":"2024-09-17T03:05:56.478207+0000","last_became_active":"2024-09-17T03:05:54.484341+0000","last_became_peered":"2024-09-17T03:05:54.484341+0000","last_unstale":"2024-09-17T03:05:56.478207+0000","last_undegraded":"2024-09-17T03:05:56.478207+0000","last_fullsized":"2024-09-17T03:05:56.478207+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:39.852617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658066+0000","last_change":"2024-09-17T03:05:55.497205+0000","last_active":"2024-09-17T03:05:56.658066+0000","last_peered":"2024-09-17T03:05:56.658066+0000","last_clean":"2024-09-17T03:05:56.658066+0000","last_became_active":"2024-09-17T03:05:55.496897+0000","last_became_peered":"2024-09-17T03:05:55.496897+0000","last_unstale":"2024-09-17T03:05:56.658066+0000","last_undegraded":"2024-09-17T03:05:56.658066+0000","last_fullsized":"2024-09-17T03:05:56.658066+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:27.702683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656752+0000","last_change":"2024-09-17T03:05:54.481157+0000","last_active":"2024-09-17T03:05:56.656752+0000","last_peered":"2024-09-17T03:05:56.656752+0000","last_clean":"2024-09-17T03:05:56.656752+0000","last_became_active":"2024-09-17T03:05:54.480882+0000","last_became_peered":"2024-09-17T03:05:54.480882+0000","last_unstale":"2024-09-17T03:05:56.656752+0000","last_undegraded":"2024-09-17T03:05:56.656752+0000","last_fullsized":"2024-09-17T03:05:56.656752+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:54.108066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658065+0000","last_change":"2024-09-17T03:05:55.498876+0000","last_active":"2024-09-17T03:05:56.658065+0000","last_peered":"2024-09-17T03:05:56.658065+0000","last_clean":"2024-09-17T03:05:56.658065+0000","last_became_active":"2024-09-17T03:05:55.498478+0000","last_became_peered":"2024-09-17T03:05:55.498478+0000","last_unstale":"2024-09-17T03:05:56.658065+0000","last_undegraded":"2024-09-17T03:05:56.658065+0000","last_fullsized":"2024-09-17T03:05:56.658065+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:05.075251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"184'3","reported_seq":18,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658124+0000","last_change":"2024-09-17T03:05:54.485813+0000","last_active":"2024-09-17T03:05:56.658124+0000","last_peered":"2024-09-17T03:05:56.658124+0000","last_clean":"2024-09-17T03:05:56.658124+0000","last_became_active":"2024-09-17T03:05:54.485393+0000","last_became_peered":"2024-09-17T03:05:54.485393+0000","last_unstale":"2024-09-17T03:05:56.658124+0000","last_undegraded":"2024-09-17T03:05:56.658124+0000","last_fullsized":"2024-09-17T03:05:56.658124+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:07.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479830+0000","last_change":"2024-09-17T03:05:55.494178+0000","last_active":"2024-09-17T03:05:56.479830+0000","last_peered":"2024-09-17T03:05:56.479830+0000","last_clean":"2024-09-17T03:05:56.479830+0000","last_became_active":"2024-09-17T03:05:55.493811+0000","last_became_peered":"2024-09-17T03:05:55.493811+0000","last_unstale":"2024-09-17T03:05:56.479830+0000","last_undegraded":"2024-09-17T03:05:56.479830+0000","last_fullsized":"2024-09-17T03:05:56.479830+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:37.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"184'6","reported_seq":21,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479742+0000","last_change":"2024-09-17T03:05:54.491062+0000","last_active":"2024-09-17T03:05:56.479742+0000","last_peered":"2024-09-17T03:05:56.479742+0000","last_clean":"2024-09-17T03:05:56.479742+0000","last_became_active":"2024-09-17T03:05:54.490794+0000","last_became_peered":"2024-09-17T03:05:54.490794+0000","last_unstale":"2024-09-17T03:05:56.479742+0000","last_undegraded":"2024-09-17T03:05:56.479742+0000","last_fullsized":"2024-09-17T03:05:56.479742+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:21.352846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658308+0000","last_change":"2024-09-17T03:05:55.483337+0000","last_active":"2024-09-17T03:05:56.658308+0000","last_peered":"2024-09-17T03:05:56.658308+0000","last_clean":"2024-09-17T03:05:56.658308+0000","last_became_active":"2024-09-17T03:05:55.483018+0000","last_became_peered":"2024-09-17T03:05:55.483018+0000","last_unstale":"2024-09-17T03:05:56.658308+0000","last_undegraded":"2024-09-17T03:05:56.658308+0000","last_fullsized":"2024-09-17T03:05:56.658308+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:42.138966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657174+0000","last_change":"2024-09-17T03:05:54.489488+0000","last_active":"2024-09-17T03:05:56.657174+0000","last_peered":"2024-09-17T03:05:56.657174+0000","last_clean":"2024-09-17T03:05:56.657174+0000","last_became_active":"2024-09-17T03:05:54.489162+0000","last_became_peered":"2024-09-17T03:05:54.489162+0000","last_unstale":"2024-09-17T03:05:56.657174+0000","last_undegraded":"2024-09-17T03:05:56.657174+0000","last_fullsized":"2024-09-17T03:05:56.657174+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:53.167104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478133+0000","last_change":"2024-09-17T03:05:55.488349+0000","last_active":"2024-09-17T03:05:56.478133+0000","last_peered":"2024-09-17T03:05:56.478133+0000","last_clean":"2024-09-17T03:05:56.478133+0000","last_became_active":"2024-09-17T03:05:55.488092+0000","last_became_peered":"2024-09-17T03:05:55.488092+0000","last_unstale":"2024-09-17T03:05:56.478133+0000","last_undegraded":"2024-09-17T03:05:56.478133+0000","last_fullsized":"2024-09-17T03:05:56.478133+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:13.832198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658429+0000","last_change":"2024-09-17T03:05:54.482696+0000","last_active":"2024-09-17T03:05:56.658429+0000","last_peered":"2024-09-17T03:05:56.658429+0000","last_clean":"2024-09-17T03:05:56.658429+0000","last_became_active":"2024-09-17T03:05:54.482414+0000","last_became_peered":"2024-09-17T03:05:54.482414+0000","last_unstale":"2024-09-17T03:05:56.658429+0000","last_undegraded":"2024-09-17T03:05:56.658429+0000","last_fullsized":"2024-09-17T03:05:56.658429+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:12.921560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656435+0000","last_change":"2024-09-17T03:05:55.495330+0000","last_active":"2024-09-17T03:05:56.656435+0000","last_peered":"2024-09-17T03:05:56.656435+0000","last_clean":"2024-09-17T03:05:56.656435+0000","last_became_active":"2024-09-17T03:05:55.494786+0000","last_became_peered":"2024-09-17T03:05:55.494786+0000","last_unstale":"2024-09-17T03:05:56.656435+0000","last_undegraded":"2024-09-17T03:05:56.656435+0000","last_fullsized":"2024-09-17T03:05:56.656435+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:04.294576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656986+0000","last_change":"2024-09-17T03:05:54.491577+0000","last_active":"2024-09-17T03:05:56.656986+0000","last_peered":"2024-09-17T03:05:56.656986+0000","last_clean":"2024-09-17T03:05:56.656986+0000","last_became_active":"2024-09-17T03:05:54.491298+0000","last_became_peered":"2024-09-17T03:05:54.491298+0000","last_unstale":"2024-09-17T03:05:56.656986+0000","last_undegraded":"2024-09-17T03:05:56.656986+0000","last_fullsized":"2024-09-17T03:05:56.656986+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:45.887616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656906+0000","last_change":"2024-09-17T03:05:55.487099+0000","last_active":"2024-09-17T03:05:56.656906+0000","last_peered":"2024-09-17T03:05:56.656906+0000","last_clean":"2024-09-17T03:05:56.656906+0000","last_became_active":"2024-09-17T03:05:55.486830+0000","last_became_peered":"2024-09-17T03:05:55.486830+0000","last_unstale":"2024-09-17T03:05:56.656906+0000","last_undegraded":"2024-09-17T03:05:56.656906+0000","last_fullsized":"2024-09-17T03:05:56.656906+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:30.590308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"184'8","reported_seq":23,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480114+0000","last_change":"2024-09-17T03:05:54.490232+0000","last_active":"2024-09-17T03:05:56.480114+0000","last_peered":"2024-09-17T03:05:56.480114+0000","last_clean":"2024-09-17T03:05:56.480114+0000","last_became_active":"2024-09-17T03:05:54.489935+0000","last_became_peered":"2024-09-17T03:05:54.489935+0000","last_unstale":"2024-09-17T03:05:56.480114+0000","last_undegraded":"2024-09-17T03:05:56.480114+0000","last_fullsized":"2024-09-17T03:05:56.480114+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:26.458337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656944+0000","last_change":"2024-09-17T03:05:55.497247+0000","last_active":"2024-09-17T03:05:56.656944+0000","last_peered":"2024-09-17T03:05:56.656944+0000","last_clean":"2024-09-17T03:05:56.656944+0000","last_became_active":"2024-09-17T03:05:55.496453+0000","last_became_peered":"2024-09-17T03:05:55.496453+0000","last_unstale":"2024-09-17T03:05:56.656944+0000","last_undegraded":"2024-09-17T03:05:56.656944+0000","last_fullsized":"2024-09-17T03:05:56.656944+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:43.692576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657296+0000","last_change":"2024-09-17T03:05:54.483051+0000","last_active":"2024-09-17T03:05:56.657296+0000","last_peered":"2024-09-17T03:05:56.657296+0000","last_clean":"2024-09-17T03:05:56.657296+0000","last_became_active":"2024-09-17T03:05:54.482764+0000","last_became_peered":"2024-09-17T03:05:54.482764+0000","last_unstale":"2024-09-17T03:05:56.657296+0000","last_undegraded":"2024-09-17T03:05:56.657296+0000","last_fullsized":"2024-09-17T03:05:56.657296+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:41.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658311+0000","last_change":"2024-09-17T03:05:55.484547+0000","last_active":"2024-09-17T03:05:56.658311+0000","last_peered":"2024-09-17T03:05:56.658311+0000","last_clean":"2024-09-17T03:05:56.658311+0000","last_became_active":"2024-09-17T03:05:55.484262+0000","last_became_peered":"2024-09-17T03:05:55.484262+0000","last_unstale":"2024-09-17T03:05:56.658311+0000","last_undegraded":"2024-09-17T03:05:56.658311+0000","last_fullsized":"2024-09-17T03:05:56.658311+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:54.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657771+0000","last_change":"2024-09-17T03:05:54.484662+0000","last_active":"2024-09-17T03:05:56.657771+0000","last_peered":"2024-09-17T03:05:56.657771+0000","last_clean":"2024-09-17T03:05:56.657771+0000","last_became_active":"2024-09-17T03:05:54.484361+0000","last_became_peered":"2024-09-17T03:05:54.484361+0000","last_unstale":"2024-09-17T03:05:56.657771+0000","last_undegraded":"2024-09-17T03:05:56.657771+0000","last_fullsized":"2024-09-17T03:05:56.657771+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:41.415509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656862+0000","last_change":"2024-09-17T03:05:55.495820+0000","last_active":"2024-09-17T03:05:56.656862+0000","last_peered":"2024-09-17T03:05:56.656862+0000","last_clean":"2024-09-17T03:05:56.656862+0000","last_became_active":"2024-09-17T03:05:55.493415+0000","last_became_peered":"2024-09-17T03:05:55.493415+0000","last_unstale":"2024-09-17T03:05:56.656862+0000","last_undegraded":"2024-09-17T03:05:56.656862+0000","last_fullsized":"2024-09-17T03:05:56.656862+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:19.209318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657468+0000","last_change":"2024-09-17T03:05:54.491969+0000","last_active":"2024-09-17T03:05:56.657468+0000","last_peered":"2024-09-17T03:05:56.657468+0000","last_clean":"2024-09-17T03:05:56.657468+0000","last_became_active":"2024-09-17T03:05:54.491342+0000","last_became_peered":"2024-09-17T03:05:54.491342+0000","last_unstale":"2024-09-17T03:05:56.657468+0000","last_undegraded":"2024-09-17T03:05:56.657468+0000","last_fullsized":"2024-09-17T03:05:56.657468+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:31.675901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478761+0000","last_change":"2024-09-17T03:05:55.491533+0000","last_active":"2024-09-17T03:05:56.478761+0000","last_peered":"2024-09-17T03:05:56.478761+0000","last_clean":"2024-09-17T03:05:56.478761+0000","last_became_active":"2024-09-17T03:05:55.490844+0000","last_became_peered":"2024-09-17T03:05:55.490844+0000","last_unstale":"2024-09-17T03:05:56.478761+0000","last_undegraded":"2024-09-17T03:05:56.478761+0000","last_fullsized":"2024-09-17T03:05:56.478761+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:06.310808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656924+0000","last_change":"2024-09-17T03:05:54.485173+0000","last_active":"2024-09-17T03:05:56.656924+0000","last_peered":"2024-09-17T03:05:56.656924+0000","last_clean":"2024-09-17T03:05:56.656924+0000","last_became_active":"2024-09-17T03:05:54.484902+0000","last_became_peered":"2024-09-17T03:05:54.484902+0000","last_unstale":"2024-09-17T03:05:56.656924+0000","last_undegraded":"2024-09-17T03:05:56.656924+0000","last_fullsized":"2024-09-17T03:05:56.656924+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:16.841768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657145+0000","last_change":"2024-09-17T03:05:55.495180+0000","last_active":"2024-09-17T03:05:56.657145+0000","last_peered":"2024-09-17T03:05:56.657145+0000","last_clean":"2024-09-17T03:05:56.657145+0000","last_became_active":"2024-09-17T03:05:55.494887+0000","last_became_peered":"2024-09-17T03:05:55.494887+0000","last_unstale":"2024-09-17T03:05:56.657145+0000","last_undegraded":"2024-09-17T03:05:56.657145+0000","last_fullsized":"2024-09-17T03:05:56.657145+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:26.801003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657014+0000","last_change":"2024-09-17T03:05:54.491524+0000","last_active":"2024-09-17T03:05:56.657014+0000","last_peered":"2024-09-17T03:05:56.657014+0000","last_clean":"2024-09-17T03:05:56.657014+0000","last_became_active":"2024-09-17T03:05:54.491235+0000","last_became_peered":"2024-09-17T03:05:54.491235+0000","last_unstale":"2024-09-17T03:05:56.657014+0000","last_undegraded":"2024-09-17T03:05:56.657014+0000","last_fullsized":"2024-09-17T03:05:56.657014+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:56.870788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478446+0000","last_change":"2024-09-17T03:05:55.489057+0000","last_active":"2024-09-17T03:05:56.478446+0000","last_peered":"2024-09-17T03:05:56.478446+0000","last_clean":"2024-09-17T03:05:56.478446+0000","last_became_active":"2024-09-17T03:05:55.488795+0000","last_became_peered":"2024-09-17T03:05:55.488795+0000","last_unstale":"2024-09-17T03:05:56.478446+0000","last_undegraded":"2024-09-17T03:05:56.478446+0000","last_fullsized":"2024-09-17T03:05:56.478446+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:41.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656972+0000","last_change":"2024-09-17T03:05:54.485397+0000","last_active":"2024-09-17T03:05:56.656972+0000","last_peered":"2024-09-17T03:05:56.656972+0000","last_clean":"2024-09-17T03:05:56.656972+0000","last_became_active":"2024-09-17T03:05:54.485119+0000","last_became_peered":"2024-09-17T03:05:54.485119+0000","last_unstale":"2024-09-17T03:05:56.656972+0000","last_undegraded":"2024-09-17T03:05:56.656972+0000","last_fullsized":"2024-09-17T03:05:56.656972+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:20.130846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656924+0000","last_change":"2024-09-17T03:05:55.488185+0000","last_active":"2024-09-17T03:05:56.656924+0000","last_peered":"2024-09-17T03:05:56.656924+0000","last_clean":"2024-09-17T03:05:56.656924+0000","last_became_active":"2024-09-17T03:05:55.487925+0000","last_became_peered":"2024-09-17T03:05:55.487925+0000","last_unstale":"2024-09-17T03:05:56.656924+0000","last_undegraded":"2024-09-17T03:05:56.656924+0000","last_fullsized":"2024-09-17T03:05:56.656924+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:20.864776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657277+0000","last_change":"2024-09-17T03:05:54.490663+0000","last_active":"2024-09-17T03:05:56.657277+0000","last_peered":"2024-09-17T03:05:56.657277+0000","last_clean":"2024-09-17T03:05:56.657277+0000","last_became_active":"2024-09-17T03:05:54.490371+0000","last_became_peered":"2024-09-17T03:05:54.490371+0000","last_unstale":"2024-09-17T03:05:56.657277+0000","last_undegraded":"2024-09-17T03:05:56.657277+0000","last_fullsized":"2024-09-17T03:05:56.657277+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:11.721798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657433+0000","last_change":"2024-09-17T03:05:55.483764+0000","last_active":"2024-09-17T03:05:56.657433+0000","last_peered":"2024-09-17T03:05:56.657433+0000","last_clean":"2024-09-17T03:05:56.657433+0000","last_became_active":"2024-09-17T03:05:55.483469+0000","last_became_peered":"2024-09-17T03:05:55.483469+0000","last_unstale":"2024-09-17T03:05:56.657433+0000","last_undegraded":"2024-09-17T03:05:56.657433+0000","last_fullsized":"2024-09-17T03:05:56.657433+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:24.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657535+0000","last_change":"2024-09-17T03:05:54.492315+0000","last_active":"2024-09-17T03:05:56.657535+0000","last_peered":"2024-09-17T03:05:56.657535+0000","last_clean":"2024-09-17T03:05:56.657535+0000","last_became_active":"2024-09-17T03:05:54.491690+0000","last_became_peered":"2024-09-17T03:05:54.491690+0000","last_unstale":"2024-09-17T03:05:56.657535+0000","last_undegraded":"2024-09-17T03:05:56.657535+0000","last_fullsized":"2024-09-17T03:05:56.657535+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:14.241430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656962+0000","last_change":"2024-09-17T03:05:55.498546+0000","last_active":"2024-09-17T03:05:56.656962+0000","last_peered":"2024-09-17T03:05:56.656962+0000","last_clean":"2024-09-17T03:05:56.656962+0000","last_became_active":"2024-09-17T03:05:55.497185+0000","last_became_peered":"2024-09-17T03:05:55.497185+0000","last_unstale":"2024-09-17T03:05:56.656962+0000","last_undegraded":"2024-09-17T03:05:56.656962+0000","last_fullsized":"2024-09-17T03:05:56.656962+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:08.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658917+0000","last_change":"2024-09-17T03:05:54.484012+0000","last_active":"2024-09-17T03:05:56.658917+0000","last_peered":"2024-09-17T03:05:56.658917+0000","last_clean":"2024-09-17T03:05:56.658917+0000","last_became_active":"2024-09-17T03:05:54.483033+0000","last_became_peered":"2024-09-17T03:05:54.483033+0000","last_unstale":"2024-09-17T03:05:56.658917+0000","last_undegraded":"2024-09-17T03:05:56.658917+0000","last_fullsized":"2024-09-17T03:05:56.658917+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:06.905676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478672+0000","last_change":"2024-09-17T03:05:55.492127+0000","last_active":"2024-09-17T03:05:56.478672+0000","last_peered":"2024-09-17T03:05:56.478672+0000","last_clean":"2024-09-17T03:05:56.478672+0000","last_became_active":"2024-09-17T03:05:55.491832+0000","last_became_peered":"2024-09-17T03:05:55.491832+0000","last_unstale":"2024-09-17T03:05:56.478672+0000","last_undegraded":"2024-09-17T03:05:56.478672+0000","last_fullsized":"2024-09-17T03:05:56.478672+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:01.034453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657369+0000","last_change":"2024-09-17T03:05:54.485781+0000","last_active":"2024-09-17T03:05:56.657369+0000","last_peered":"2024-09-17T03:05:56.657369+0000","last_clean":"2024-09-17T03:05:56.657369+0000","last_became_active":"2024-09-17T03:05:54.485533+0000","last_became_peered":"2024-09-17T03:05:54.485533+0000","last_unstale":"2024-09-17T03:05:56.657369+0000","last_undegraded":"2024-09-17T03:05:56.657369+0000","last_fullsized":"2024-09-17T03:05:56.657369+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:55.119892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657680+0000","last_change":"2024-09-17T03:05:55.498135+0000","last_active":"2024-09-17T03:05:56.657680+0000","last_peered":"2024-09-17T03:05:56.657680+0000","last_clean":"2024-09-17T03:05:56.657680+0000","last_became_active":"2024-09-17T03:05:55.497865+0000","last_became_peered":"2024-09-17T03:05:55.497865+0000","last_unstale":"2024-09-17T03:05:56.657680+0000","last_undegraded":"2024-09-17T03:05:56.657680+0000","last_fullsized":"2024-09-17T03:05:56.657680+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:29.193937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479652+0000","last_change":"2024-09-17T03:05:54.488584+0000","last_active":"2024-09-17T03:05:56.479652+0000","last_peered":"2024-09-17T03:05:56.479652+0000","last_clean":"2024-09-17T03:05:56.479652+0000","last_became_active":"2024-09-17T03:05:54.488317+0000","last_became_peered":"2024-09-17T03:05:54.488317+0000","last_unstale":"2024-09-17T03:05:56.479652+0000","last_undegraded":"2024-09-17T03:05:56.479652+0000","last_fullsized":"2024-09-17T03:05:56.479652+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:14.365880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658502+0000","last_change":"2024-09-17T03:05:55.489930+0000","last_active":"2024-09-17T03:05:56.658502+0000","last_peered":"2024-09-17T03:05:56.658502+0000","last_clean":"2024-09-17T03:05:56.658502+0000","last_became_active":"2024-09-17T03:05:55.489171+0000","last_became_peered":"2024-09-17T03:05:55.489171+0000","last_unstale":"2024-09-17T03:05:56.658502+0000","last_undegraded":"2024-09-17T03:05:56.658502+0000","last_fullsized":"2024-09-17T03:05:56.658502+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:56.667825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657234+0000","last_change":"2024-09-17T03:05:54.485867+0000","last_active":"2024-09-17T03:05:56.657234+0000","last_peered":"2024-09-17T03:05:56.657234+0000","last_clean":"2024-09-17T03:05:56.657234+0000","last_became_active":"2024-09-17T03:05:54.485431+0000","last_became_peered":"2024-09-17T03:05:54.485431+0000","last_unstale":"2024-09-17T03:05:56.657234+0000","last_undegraded":"2024-09-17T03:05:56.657234+0000","last_fullsized":"2024-09-17T03:05:56.657234+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:21.127128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658771+0000","last_change":"2024-09-17T03:05:55.485967+0000","last_active":"2024-09-17T03:05:56.658771+0000","last_peered":"2024-09-17T03:05:56.658771+0000","last_clean":"2024-09-17T03:05:56.658771+0000","last_became_active":"2024-09-17T03:05:55.485362+0000","last_became_peered":"2024-09-17T03:05:55.485362+0000","last_unstale":"2024-09-17T03:05:56.658771+0000","last_undegraded":"2024-09-17T03:05:56.658771+0000","last_fullsized":"2024-09-17T03:05:56.658771+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:42.789251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480386+0000","last_change":"2024-09-17T03:05:54.487046+0000","last_active":"2024-09-17T03:05:56.480386+0000","last_peered":"2024-09-17T03:05:56.480386+0000","last_clean":"2024-09-17T03:05:56.480386+0000","last_became_active":"2024-09-17T03:05:54.486738+0000","last_became_peered":"2024-09-17T03:05:54.486738+0000","last_unstale":"2024-09-17T03:05:56.480386+0000","last_undegraded":"2024-09-17T03:05:56.480386+0000","last_fullsized":"2024-09-17T03:05:56.480386+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:53.252754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480042+0000","last_change":"2024-09-17T03:05:55.491535+0000","last_active":"2024-09-17T03:05:56.480042+0000","last_peered":"2024-09-17T03:05:56.480042+0000","last_clean":"2024-09-17T03:05:56.480042+0000","last_became_active":"2024-09-17T03:05:55.490313+0000","last_became_peered":"2024-09-17T03:05:55.490313+0000","last_unstale":"2024-09-17T03:05:56.480042+0000","last_undegraded":"2024-09-17T03:05:56.480042+0000","last_fullsized":"2024-09-17T03:05:56.480042+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:11.410972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657097+0000","last_change":"2024-09-17T03:05:54.492351+0000","last_active":"2024-09-17T03:05:56.657097+0000","last_peered":"2024-09-17T03:05:56.657097+0000","last_clean":"2024-09-17T03:05:56.657097+0000","last_became_active":"2024-09-17T03:05:54.492080+0000","last_became_peered":"2024-09-17T03:05:54.492080+0000","last_unstale":"2024-09-17T03:05:56.657097+0000","last_undegraded":"2024-09-17T03:05:56.657097+0000","last_fullsized":"2024-09-17T03:05:56.657097+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:43.305299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478421+0000","last_change":"2024-09-17T03:05:55.495754+0000","last_active":"2024-09-17T03:05:56.478421+0000","last_peered":"2024-09-17T03:05:56.478421+0000","last_clean":"2024-09-17T03:05:56.478421+0000","last_became_active":"2024-09-17T03:05:55.495461+0000","last_became_peered":"2024-09-17T03:05:55.495461+0000","last_unstale":"2024-09-17T03:05:56.478421+0000","last_undegraded":"2024-09-17T03:05:56.478421+0000","last_fullsized":"2024-09-17T03:05:56.478421+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:02.667374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480078+0000","last_change":"2024-09-17T03:05:54.482975+0000","last_active":"2024-09-17T03:05:56.480078+0000","last_peered":"2024-09-17T03:05:56.480078+0000","last_clean":"2024-09-17T03:05:56.480078+0000","last_became_active":"2024-09-17T03:05:54.482699+0000","last_became_peered":"2024-09-17T03:05:54.482699+0000","last_unstale":"2024-09-17T03:05:56.480078+0000","last_undegraded":"2024-09-17T03:05:56.480078+0000","last_fullsized":"2024-09-17T03:05:56.480078+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:01.998213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657077+0000","last_change":"2024-09-17T03:05:55.493160+0000","last_active":"2024-09-17T03:05:56.657077+0000","last_peered":"2024-09-17T03:05:56.657077+0000","last_clean":"2024-09-17T03:05:56.657077+0000","last_became_active":"2024-09-17T03:05:55.492183+0000","last_became_peered":"2024-09-17T03:05:55.492183+0000","last_unstale":"2024-09-17T03:05:56.657077+0000","last_undegraded":"2024-09-17T03:05:56.657077+0000","last_fullsized":"2024-09-17T03:05:56.657077+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:38.953969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479897+0000","last_change":"2024-09-17T03:05:54.491928+0000","last_active":"2024-09-17T03:05:56.479897+0000","last_peered":"2024-09-17T03:05:56.479897+0000","last_clean":"2024-09-17T03:05:56.479897+0000","last_became_active":"2024-09-17T03:05:54.491615+0000","last_became_peered":"2024-09-17T03:05:54.491615+0000","last_unstale":"2024-09-17T03:05:56.479897+0000","last_undegraded":"2024-09-17T03:05:56.479897+0000","last_fullsized":"2024-09-17T03:05:56.479897+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.100856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658510+0000","last_change":"2024-09-17T03:05:55.497851+0000","last_active":"2024-09-17T03:05:56.658510+0000","last_peered":"2024-09-17T03:05:56.658510+0000","last_clean":"2024-09-17T03:05:56.658510+0000","last_became_active":"2024-09-17T03:05:55.497600+0000","last_became_peered":"2024-09-17T03:05:55.497600+0000","last_unstale":"2024-09-17T03:05:56.658510+0000","last_undegraded":"2024-09-17T03:05:56.658510+0000","last_fullsized":"2024-09-17T03:05:56.658510+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:22.062903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480206+0000","last_change":"2024-09-17T03:05:54.491201+0000","last_active":"2024-09-17T03:05:56.480206+0000","last_peered":"2024-09-17T03:05:56.480206+0000","last_clean":"2024-09-17T03:05:56.480206+0000","last_became_active":"2024-09-17T03:05:54.490944+0000","last_became_peered":"2024-09-17T03:05:54.490944+0000","last_unstale":"2024-09-17T03:05:56.480206+0000","last_undegraded":"2024-09-17T03:05:56.480206+0000","last_fullsized":"2024-09-17T03:05:56.480206+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:12.374399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":435,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657056+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:05:56.657056+0000","last_peered":"2024-09-17T03:05:56.657056+0000","last_clean":"2024-09-17T03:05:56.657056+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:05:56.657056+0000","last_undegraded":"2024-09-17T03:05:56.657056+0000","last_fullsized":"2024-09-17T03:05:56.657056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1587,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193725,"statfs":{"total":200000000,"available":198374711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198961111,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574989,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194303,"statfs":{"total":200000000,"available":198966829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574987,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967343,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1584,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193727,"statfs":{"total":200000000,"available":198377065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:05:58.488 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:05:58.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.637+0000 7f7817b6e640 1 -- 172.21.15.104:0/4121098833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f781015c220 msgr2=0x7f781006f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.637+0000 7f7817b6e640 1 --2- 172.21.15.104:0/4121098833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f781015c220 0x7f781006f550 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f78100ce050 tx=0x7f780c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.637+0000 7f7817b6e640 1 -- 172.21.15.104:0/4121098833 shutdown_connections 2024-09-17T03:05:58.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.637+0000 7f7817b6e640 1 --2- 172.21.15.104:0/4121098833 >> v2:172.21.15.192:3300/0 conn(0x7f78100734f0 0x7f7810073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.637+0000 7f7817b6e640 1 --2- 172.21.15.104:0/4121098833 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f781015c220 0x7f781006f550 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.637+0000 7f7817b6e640 1 -- 172.21.15.104:0/4121098833 >> 172.21.15.104:0/4121098833 conn(0x7f781006d200 msgr2=0x7f781006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:58.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.637+0000 7f7817b6e640 1 -- 172.21.15.104:0/4121098833 shutdown_connections 2024-09-17T03:05:58.636 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.637+0000 7f7817b6e640 1 -- 172.21.15.104:0/4121098833 wait complete. 2024-09-17T03:05:58.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.639+0000 7f7817b6e640 1 Processor -- start 2024-09-17T03:05:58.637 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.639+0000 7f7817b6e640 1 -- start start 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f7817b6e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78100734f0 0x7f7810158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f7817b6e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78100b0500 0x7f781014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f7817b6e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781015c220 0x7f781015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f7817b6e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f78100b4f20 con 0x7f78100734f0 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f7817b6e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78100b1230 con 0x7f78100b0500 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f7817b6e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f78100b50a0 con 0x7f781015c220 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f781590a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78100734f0 0x7f7810158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f781590a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78100734f0 0x7f7810158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37864/0 (socket says 172.21.15.104:37864) 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.640+0000 7f781590a640 1 -- 172.21.15.104:0/1039637951 learned_addr learned my addr 172.21.15.104:0/1039637951 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f7815109640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78100b0500 0x7f781014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f781590a640 1 -- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781015c220 msgr2=0x7f781015f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.640 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f781590a640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781015c220 0x7f781015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f781590a640 1 -- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78100b0500 msgr2=0x7f781014d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f781590a640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78100b0500 0x7f781014d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f781590a640 1 -- 172.21.15.104:0/1039637951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78101f7c80 con 0x7f78100734f0 2024-09-17T03:05:58.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f7815109640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78100b0500 0x7f781014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:05:58.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f781590a640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78100734f0 0x7f7810158110 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f780c034040 tx=0x7f780c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:58.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f78067fc640 1 -- 172.21.15.104:0/1039637951 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c03e030 con 0x7f78100734f0 2024-09-17T03:05:58.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f78067fc640 1 -- 172.21.15.104:0/1039637951 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f780c0047a0 con 0x7f78100734f0 2024-09-17T03:05:58.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78101f7f60 con 0x7f78100734f0 2024-09-17T03:05:58.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f78067fc640 1 -- 172.21.15.104:0/1039637951 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c035040 con 0x7f78100734f0 2024-09-17T03:05:58.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.641+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78101f8520 con 0x7f78100734f0 2024-09-17T03:05:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.642+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7810073900 con 0x7f78100734f0 2024-09-17T03:05:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.643+0000 7f78067fc640 1 -- 172.21.15.104:0/1039637951 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f780c041030 con 0x7f78100734f0 2024-09-17T03:05:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.643+0000 7f78067fc640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77f4078b90 0x7f77f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.643+0000 7f78067fc640 1 -- 172.21.15.104:0/1039637951 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f780c0bb490 con 0x7f78100734f0 2024-09-17T03:05:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.643+0000 7f7815109640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77f4078b90 0x7f77f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:58.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.644+0000 7f7815109640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77f4078b90 0x7f77f407b0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7800009aa0 tx=0x7f7800005db0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:58.646 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.648+0000 7f78067fc640 1 -- 172.21.15.104:0/1039637951 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f780c083960 con 0x7f78100734f0 2024-09-17T03:05:58.817 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.819+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7810152850 con 0x7f77f4078b90 2024-09-17T03:05:58.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.824+0000 7f78067fc640 1 -- 172.21.15.104:0/1039637951 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247983 (secure 0 0 0) 0x7f7810152850 con 0x7f77f4078b90 2024-09-17T03:05:58.825 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:58.826 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77f4078b90 msgr2=0x7f77f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77f4078b90 0x7f77f407b0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7800009aa0 tx=0x7f7800005db0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78100734f0 msgr2=0x7f7810158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78100734f0 0x7f7810158110 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f780c034040 tx=0x7f780c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 shutdown_connections 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f77f4078b90 0x7f77f407b0a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78100b0500 0x7f781014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f781015c220 0x7f781015f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 --2- 172.21.15.104:0/1039637951 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f78100734f0 0x7f7810158110 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 >> 172.21.15.104:0/1039637951 conn(0x7f781006d200 msgr2=0x7f78100b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 shutdown_connections 2024-09-17T03:05:58.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.827+0000 7f7817b6e640 1 -- 172.21.15.104:0/1039637951 wait complete. 2024-09-17T03:05:58.837 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":521,"stamp":"2024-09-17T03:05:57.800961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9237,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553262,"statfs":{"total":1600000000,"available":1590541308,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.331989"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657379+0000","last_change":"2024-09-17T03:05:55.496237+0000","last_active":"2024-09-17T03:05:56.657379+0000","last_peered":"2024-09-17T03:05:56.657379+0000","last_clean":"2024-09-17T03:05:56.657379+0000","last_became_active":"2024-09-17T03:05:55.495944+0000","last_became_peered":"2024-09-17T03:05:55.495944+0000","last_unstale":"2024-09-17T03:05:56.657379+0000","last_undegraded":"2024-09-17T03:05:56.657379+0000","last_fullsized":"2024-09-17T03:05:56.657379+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:58.038735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480122+0000","last_change":"2024-09-17T03:05:55.492192+0000","last_active":"2024-09-17T03:05:56.480122+0000","last_peered":"2024-09-17T03:05:56.480122+0000","last_clean":"2024-09-17T03:05:56.480122+0000","last_became_active":"2024-09-17T03:05:55.490189+0000","last_became_peered":"2024-09-17T03:05:55.490189+0000","last_unstale":"2024-09-17T03:05:56.480122+0000","last_undegraded":"2024-09-17T03:05:56.480122+0000","last_fullsized":"2024-09-17T03:05:56.480122+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:04.138300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657273+0000","last_change":"2024-09-17T03:05:55.492499+0000","last_active":"2024-09-17T03:05:56.657273+0000","last_peered":"2024-09-17T03:05:56.657273+0000","last_clean":"2024-09-17T03:05:56.657273+0000","last_became_active":"2024-09-17T03:05:55.491322+0000","last_became_peered":"2024-09-17T03:05:55.491322+0000","last_unstale":"2024-09-17T03:05:56.657273+0000","last_undegraded":"2024-09-17T03:05:56.657273+0000","last_fullsized":"2024-09-17T03:05:56.657273+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:24.161911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656498+0000","last_change":"2024-09-17T03:05:55.496457+0000","last_active":"2024-09-17T03:05:56.656498+0000","last_peered":"2024-09-17T03:05:56.656498+0000","last_clean":"2024-09-17T03:05:56.656498+0000","last_became_active":"2024-09-17T03:05:55.496181+0000","last_became_peered":"2024-09-17T03:05:55.496181+0000","last_unstale":"2024-09-17T03:05:56.656498+0000","last_undegraded":"2024-09-17T03:05:56.656498+0000","last_fullsized":"2024-09-17T03:05:56.656498+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:38.889950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480514+0000","last_change":"2024-09-17T03:05:55.487572+0000","last_active":"2024-09-17T03:05:56.480514+0000","last_peered":"2024-09-17T03:05:56.480514+0000","last_clean":"2024-09-17T03:05:56.480514+0000","last_became_active":"2024-09-17T03:05:55.487310+0000","last_became_peered":"2024-09-17T03:05:55.487310+0000","last_unstale":"2024-09-17T03:05:56.480514+0000","last_undegraded":"2024-09-17T03:05:56.480514+0000","last_fullsized":"2024-09-17T03:05:56.480514+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:23.674636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656424+0000","last_change":"2024-09-17T03:05:55.489945+0000","last_active":"2024-09-17T03:05:56.656424+0000","last_peered":"2024-09-17T03:05:56.656424+0000","last_clean":"2024-09-17T03:05:56.656424+0000","last_became_active":"2024-09-17T03:05:55.489334+0000","last_became_peered":"2024-09-17T03:05:55.489334+0000","last_unstale":"2024-09-17T03:05:56.656424+0000","last_undegraded":"2024-09-17T03:05:56.656424+0000","last_fullsized":"2024-09-17T03:05:56.656424+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:22:32.127744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478467+0000","last_change":"2024-09-17T03:05:55.485768+0000","last_active":"2024-09-17T03:05:56.478467+0000","last_peered":"2024-09-17T03:05:56.478467+0000","last_clean":"2024-09-17T03:05:56.478467+0000","last_became_active":"2024-09-17T03:05:55.485489+0000","last_became_peered":"2024-09-17T03:05:55.485489+0000","last_unstale":"2024-09-17T03:05:56.478467+0000","last_undegraded":"2024-09-17T03:05:56.478467+0000","last_fullsized":"2024-09-17T03:05:56.478467+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:17.745336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479864+0000","last_change":"2024-09-17T03:05:55.488828+0000","last_active":"2024-09-17T03:05:56.479864+0000","last_peered":"2024-09-17T03:05:56.479864+0000","last_clean":"2024-09-17T03:05:56.479864+0000","last_became_active":"2024-09-17T03:05:55.487813+0000","last_became_peered":"2024-09-17T03:05:55.487813+0000","last_unstale":"2024-09-17T03:05:56.479864+0000","last_undegraded":"2024-09-17T03:05:56.479864+0000","last_fullsized":"2024-09-17T03:05:56.479864+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:16.751546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479533+0000","last_change":"2024-09-17T03:05:55.485025+0000","last_active":"2024-09-17T03:05:56.479533+0000","last_peered":"2024-09-17T03:05:56.479533+0000","last_clean":"2024-09-17T03:05:56.479533+0000","last_became_active":"2024-09-17T03:05:55.484687+0000","last_became_peered":"2024-09-17T03:05:55.484687+0000","last_unstale":"2024-09-17T03:05:56.479533+0000","last_undegraded":"2024-09-17T03:05:56.479533+0000","last_fullsized":"2024-09-17T03:05:56.479533+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:16.541411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480744+0000","last_change":"2024-09-17T03:05:55.499004+0000","last_active":"2024-09-17T03:05:56.480744+0000","last_peered":"2024-09-17T03:05:56.480744+0000","last_clean":"2024-09-17T03:05:56.480744+0000","last_became_active":"2024-09-17T03:05:55.498666+0000","last_became_peered":"2024-09-17T03:05:55.498666+0000","last_unstale":"2024-09-17T03:05:56.480744+0000","last_undegraded":"2024-09-17T03:05:56.480744+0000","last_fullsized":"2024-09-17T03:05:56.480744+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:35.262033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479315+0000","last_change":"2024-09-17T03:05:55.489004+0000","last_active":"2024-09-17T03:05:56.479315+0000","last_peered":"2024-09-17T03:05:56.479315+0000","last_clean":"2024-09-17T03:05:56.479315+0000","last_became_active":"2024-09-17T03:05:55.488273+0000","last_became_peered":"2024-09-17T03:05:55.488273+0000","last_unstale":"2024-09-17T03:05:56.479315+0000","last_undegraded":"2024-09-17T03:05:56.479315+0000","last_fullsized":"2024-09-17T03:05:56.479315+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:02.795728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480461+0000","last_change":"2024-09-17T03:05:55.491651+0000","last_active":"2024-09-17T03:05:56.480461+0000","last_peered":"2024-09-17T03:05:56.480461+0000","last_clean":"2024-09-17T03:05:56.480461+0000","last_became_active":"2024-09-17T03:05:55.486282+0000","last_became_peered":"2024-09-17T03:05:55.486282+0000","last_unstale":"2024-09-17T03:05:56.480461+0000","last_undegraded":"2024-09-17T03:05:56.480461+0000","last_fullsized":"2024-09-17T03:05:56.480461+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:23.085703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656725+0000","last_change":"2024-09-17T03:05:55.496678+0000","last_active":"2024-09-17T03:05:56.656725+0000","last_peered":"2024-09-17T03:05:56.656725+0000","last_clean":"2024-09-17T03:05:56.656725+0000","last_became_active":"2024-09-17T03:05:55.496337+0000","last_became_peered":"2024-09-17T03:05:55.496337+0000","last_unstale":"2024-09-17T03:05:56.656725+0000","last_undegraded":"2024-09-17T03:05:56.656725+0000","last_fullsized":"2024-09-17T03:05:56.656725+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:50.986727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656565+0000","last_change":"2024-09-17T03:05:55.492658+0000","last_active":"2024-09-17T03:05:56.656565+0000","last_peered":"2024-09-17T03:05:56.656565+0000","last_clean":"2024-09-17T03:05:56.656565+0000","last_became_active":"2024-09-17T03:05:55.492402+0000","last_became_peered":"2024-09-17T03:05:55.492402+0000","last_unstale":"2024-09-17T03:05:56.656565+0000","last_undegraded":"2024-09-17T03:05:56.656565+0000","last_fullsized":"2024-09-17T03:05:56.656565+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:28.309004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657073+0000","last_change":"2024-09-17T03:05:55.499804+0000","last_active":"2024-09-17T03:05:56.657073+0000","last_peered":"2024-09-17T03:05:56.657073+0000","last_clean":"2024-09-17T03:05:56.657073+0000","last_became_active":"2024-09-17T03:05:55.499540+0000","last_became_peered":"2024-09-17T03:05:55.499540+0000","last_unstale":"2024-09-17T03:05:56.657073+0000","last_undegraded":"2024-09-17T03:05:56.657073+0000","last_fullsized":"2024-09-17T03:05:56.657073+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:46.639864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478601+0000","last_change":"2024-09-17T03:05:55.491926+0000","last_active":"2024-09-17T03:05:56.478601+0000","last_peered":"2024-09-17T03:05:56.478601+0000","last_clean":"2024-09-17T03:05:56.478601+0000","last_became_active":"2024-09-17T03:05:55.491242+0000","last_became_peered":"2024-09-17T03:05:55.491242+0000","last_unstale":"2024-09-17T03:05:56.478601+0000","last_undegraded":"2024-09-17T03:05:56.478601+0000","last_fullsized":"2024-09-17T03:05:56.478601+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:00.160157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656638+0000","last_change":"2024-09-17T03:05:55.488573+0000","last_active":"2024-09-17T03:05:56.656638+0000","last_peered":"2024-09-17T03:05:56.656638+0000","last_clean":"2024-09-17T03:05:56.656638+0000","last_became_active":"2024-09-17T03:05:55.488292+0000","last_became_peered":"2024-09-17T03:05:55.488292+0000","last_unstale":"2024-09-17T03:05:56.656638+0000","last_undegraded":"2024-09-17T03:05:56.656638+0000","last_fullsized":"2024-09-17T03:05:56.656638+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:05.414941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656599+0000","last_change":"2024-09-17T03:05:55.487917+0000","last_active":"2024-09-17T03:05:56.656599+0000","last_peered":"2024-09-17T03:05:56.656599+0000","last_clean":"2024-09-17T03:05:56.656599+0000","last_became_active":"2024-09-17T03:05:55.487588+0000","last_became_peered":"2024-09-17T03:05:55.487588+0000","last_unstale":"2024-09-17T03:05:56.656599+0000","last_undegraded":"2024-09-17T03:05:56.656599+0000","last_fullsized":"2024-09-17T03:05:56.656599+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:20.410132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657801+0000","last_change":"2024-09-17T03:05:55.492574+0000","last_active":"2024-09-17T03:05:56.657801+0000","last_peered":"2024-09-17T03:05:56.657801+0000","last_clean":"2024-09-17T03:05:56.657801+0000","last_became_active":"2024-09-17T03:05:55.492013+0000","last_became_peered":"2024-09-17T03:05:55.492013+0000","last_unstale":"2024-09-17T03:05:56.657801+0000","last_undegraded":"2024-09-17T03:05:56.657801+0000","last_fullsized":"2024-09-17T03:05:56.657801+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:44.293810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657423+0000","last_change":"2024-09-17T03:05:55.495769+0000","last_active":"2024-09-17T03:05:56.657423+0000","last_peered":"2024-09-17T03:05:56.657423+0000","last_clean":"2024-09-17T03:05:56.657423+0000","last_became_active":"2024-09-17T03:05:55.494067+0000","last_became_peered":"2024-09-17T03:05:55.494067+0000","last_unstale":"2024-09-17T03:05:56.657423+0000","last_undegraded":"2024-09-17T03:05:56.657423+0000","last_fullsized":"2024-09-17T03:05:56.657423+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:43.837310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656668+0000","last_change":"2024-09-17T03:05:55.488515+0000","last_active":"2024-09-17T03:05:56.656668+0000","last_peered":"2024-09-17T03:05:56.656668+0000","last_clean":"2024-09-17T03:05:56.656668+0000","last_became_active":"2024-09-17T03:05:55.488243+0000","last_became_peered":"2024-09-17T03:05:55.488243+0000","last_unstale":"2024-09-17T03:05:56.656668+0000","last_undegraded":"2024-09-17T03:05:56.656668+0000","last_fullsized":"2024-09-17T03:05:56.656668+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:32.716231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480707+0000","last_change":"2024-09-17T03:05:55.490586+0000","last_active":"2024-09-17T03:05:56.480707+0000","last_peered":"2024-09-17T03:05:56.480707+0000","last_clean":"2024-09-17T03:05:56.480707+0000","last_became_active":"2024-09-17T03:05:55.485899+0000","last_became_peered":"2024-09-17T03:05:55.485899+0000","last_unstale":"2024-09-17T03:05:56.480707+0000","last_undegraded":"2024-09-17T03:05:56.480707+0000","last_fullsized":"2024-09-17T03:05:56.480707+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:50.105245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657984+0000","last_change":"2024-09-17T03:05:55.492145+0000","last_active":"2024-09-17T03:05:56.657984+0000","last_peered":"2024-09-17T03:05:56.657984+0000","last_clean":"2024-09-17T03:05:56.657984+0000","last_became_active":"2024-09-17T03:05:55.491679+0000","last_became_peered":"2024-09-17T03:05:55.491679+0000","last_unstale":"2024-09-17T03:05:56.657984+0000","last_undegraded":"2024-09-17T03:05:56.657984+0000","last_fullsized":"2024-09-17T03:05:56.657984+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:04.619866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479179+0000","last_change":"2024-09-17T03:05:55.491230+0000","last_active":"2024-09-17T03:05:56.479179+0000","last_peered":"2024-09-17T03:05:56.479179+0000","last_clean":"2024-09-17T03:05:56.479179+0000","last_became_active":"2024-09-17T03:05:55.490934+0000","last_became_peered":"2024-09-17T03:05:55.490934+0000","last_unstale":"2024-09-17T03:05:56.479179+0000","last_undegraded":"2024-09-17T03:05:56.479179+0000","last_fullsized":"2024-09-17T03:05:56.479179+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:28.601204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657561+0000","last_change":"2024-09-17T03:05:55.496156+0000","last_active":"2024-09-17T03:05:56.657561+0000","last_peered":"2024-09-17T03:05:56.657561+0000","last_clean":"2024-09-17T03:05:56.657561+0000","last_became_active":"2024-09-17T03:05:55.495159+0000","last_became_peered":"2024-09-17T03:05:55.495159+0000","last_unstale":"2024-09-17T03:05:56.657561+0000","last_undegraded":"2024-09-17T03:05:56.657561+0000","last_fullsized":"2024-09-17T03:05:56.657561+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:07:11.461081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478393+0000","last_change":"2024-09-17T03:05:55.499653+0000","last_active":"2024-09-17T03:05:56.478393+0000","last_peered":"2024-09-17T03:05:56.478393+0000","last_clean":"2024-09-17T03:05:56.478393+0000","last_became_active":"2024-09-17T03:05:55.499352+0000","last_became_peered":"2024-09-17T03:05:55.499352+0000","last_unstale":"2024-09-17T03:05:56.478393+0000","last_undegraded":"2024-09-17T03:05:56.478393+0000","last_fullsized":"2024-09-17T03:05:56.478393+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:06.779287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656627+0000","last_change":"2024-09-17T03:05:55.497530+0000","last_active":"2024-09-17T03:05:56.656627+0000","last_peered":"2024-09-17T03:05:56.656627+0000","last_clean":"2024-09-17T03:05:56.656627+0000","last_became_active":"2024-09-17T03:05:55.497251+0000","last_became_peered":"2024-09-17T03:05:55.497251+0000","last_unstale":"2024-09-17T03:05:56.656627+0000","last_undegraded":"2024-09-17T03:05:56.656627+0000","last_fullsized":"2024-09-17T03:05:56.656627+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:58.542003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656772+0000","last_change":"2024-09-17T03:05:55.495044+0000","last_active":"2024-09-17T03:05:56.656772+0000","last_peered":"2024-09-17T03:05:56.656772+0000","last_clean":"2024-09-17T03:05:56.656772+0000","last_became_active":"2024-09-17T03:05:55.494356+0000","last_became_peered":"2024-09-17T03:05:55.494356+0000","last_unstale":"2024-09-17T03:05:56.656772+0000","last_undegraded":"2024-09-17T03:05:56.656772+0000","last_fullsized":"2024-09-17T03:05:56.656772+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:21.330525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656837+0000","last_change":"2024-09-17T03:05:55.497939+0000","last_active":"2024-09-17T03:05:56.656837+0000","last_peered":"2024-09-17T03:05:56.656837+0000","last_clean":"2024-09-17T03:05:56.656837+0000","last_became_active":"2024-09-17T03:05:55.497674+0000","last_became_peered":"2024-09-17T03:05:55.497674+0000","last_unstale":"2024-09-17T03:05:56.656837+0000","last_undegraded":"2024-09-17T03:05:56.656837+0000","last_fullsized":"2024-09-17T03:05:56.656837+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:56.579597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479358+0000","last_change":"2024-09-17T03:05:55.490863+0000","last_active":"2024-09-17T03:05:56.479358+0000","last_peered":"2024-09-17T03:05:56.479358+0000","last_clean":"2024-09-17T03:05:56.479358+0000","last_became_active":"2024-09-17T03:05:55.490583+0000","last_became_peered":"2024-09-17T03:05:55.490583+0000","last_unstale":"2024-09-17T03:05:56.479358+0000","last_undegraded":"2024-09-17T03:05:56.479358+0000","last_fullsized":"2024-09-17T03:05:56.479358+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:31.036857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479776+0000","last_change":"2024-09-17T03:05:55.492029+0000","last_active":"2024-09-17T03:05:56.479776+0000","last_peered":"2024-09-17T03:05:56.479776+0000","last_clean":"2024-09-17T03:05:56.479776+0000","last_became_active":"2024-09-17T03:05:55.491245+0000","last_became_peered":"2024-09-17T03:05:55.491245+0000","last_unstale":"2024-09-17T03:05:56.479776+0000","last_undegraded":"2024-09-17T03:05:56.479776+0000","last_fullsized":"2024-09-17T03:05:56.479776+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:20.924141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658257+0000","last_change":"2024-09-17T03:05:55.487206+0000","last_active":"2024-09-17T03:05:56.658257+0000","last_peered":"2024-09-17T03:05:56.658257+0000","last_clean":"2024-09-17T03:05:56.658257+0000","last_became_active":"2024-09-17T03:05:55.485710+0000","last_became_peered":"2024-09-17T03:05:55.485710+0000","last_unstale":"2024-09-17T03:05:56.658257+0000","last_undegraded":"2024-09-17T03:05:56.658257+0000","last_fullsized":"2024-09-17T03:05:56.658257+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:33:08.622671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478193+0000","last_change":"2024-09-17T03:05:55.500988+0000","last_active":"2024-09-17T03:05:56.478193+0000","last_peered":"2024-09-17T03:05:56.478193+0000","last_clean":"2024-09-17T03:05:56.478193+0000","last_became_active":"2024-09-17T03:05:55.500702+0000","last_became_peered":"2024-09-17T03:05:55.500702+0000","last_unstale":"2024-09-17T03:05:56.478193+0000","last_undegraded":"2024-09-17T03:05:56.478193+0000","last_fullsized":"2024-09-17T03:05:56.478193+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:43.145148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"184'4","reported_seq":19,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656568+0000","last_change":"2024-09-17T03:05:54.490107+0000","last_active":"2024-09-17T03:05:56.656568+0000","last_peered":"2024-09-17T03:05:56.656568+0000","last_clean":"2024-09-17T03:05:56.656568+0000","last_became_active":"2024-09-17T03:05:54.489817+0000","last_became_peered":"2024-09-17T03:05:54.489817+0000","last_unstale":"2024-09-17T03:05:56.656568+0000","last_undegraded":"2024-09-17T03:05:56.656568+0000","last_fullsized":"2024-09-17T03:05:56.656568+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:05.875207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479550+0000","last_change":"2024-09-17T03:05:55.490094+0000","last_active":"2024-09-17T03:05:56.479550+0000","last_peered":"2024-09-17T03:05:56.479550+0000","last_clean":"2024-09-17T03:05:56.479550+0000","last_became_active":"2024-09-17T03:05:55.489699+0000","last_became_peered":"2024-09-17T03:05:55.489699+0000","last_unstale":"2024-09-17T03:05:56.479550+0000","last_undegraded":"2024-09-17T03:05:56.479550+0000","last_fullsized":"2024-09-17T03:05:56.479550+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:33.686278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479347+0000","last_change":"2024-09-17T03:05:54.492735+0000","last_active":"2024-09-17T03:05:56.479347+0000","last_peered":"2024-09-17T03:05:56.479347+0000","last_clean":"2024-09-17T03:05:56.479347+0000","last_became_active":"2024-09-17T03:05:54.492370+0000","last_became_peered":"2024-09-17T03:05:54.492370+0000","last_unstale":"2024-09-17T03:05:56.479347+0000","last_undegraded":"2024-09-17T03:05:56.479347+0000","last_fullsized":"2024-09-17T03:05:56.479347+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:48.985815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656900+0000","last_change":"2024-09-17T03:05:55.489602+0000","last_active":"2024-09-17T03:05:56.656900+0000","last_peered":"2024-09-17T03:05:56.656900+0000","last_clean":"2024-09-17T03:05:56.656900+0000","last_became_active":"2024-09-17T03:05:55.488975+0000","last_became_peered":"2024-09-17T03:05:55.488975+0000","last_unstale":"2024-09-17T03:05:56.656900+0000","last_undegraded":"2024-09-17T03:05:56.656900+0000","last_fullsized":"2024-09-17T03:05:56.656900+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:10.069759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657064+0000","last_change":"2024-09-17T03:05:54.488222+0000","last_active":"2024-09-17T03:05:56.657064+0000","last_peered":"2024-09-17T03:05:56.657064+0000","last_clean":"2024-09-17T03:05:56.657064+0000","last_became_active":"2024-09-17T03:05:54.487939+0000","last_became_peered":"2024-09-17T03:05:54.487939+0000","last_unstale":"2024-09-17T03:05:56.657064+0000","last_undegraded":"2024-09-17T03:05:56.657064+0000","last_fullsized":"2024-09-17T03:05:56.657064+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:45.372599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657693+0000","last_change":"2024-09-17T03:05:55.495427+0000","last_active":"2024-09-17T03:05:56.657693+0000","last_peered":"2024-09-17T03:05:56.657693+0000","last_clean":"2024-09-17T03:05:56.657693+0000","last_became_active":"2024-09-17T03:05:55.493524+0000","last_became_peered":"2024-09-17T03:05:55.493524+0000","last_unstale":"2024-09-17T03:05:56.657693+0000","last_undegraded":"2024-09-17T03:05:56.657693+0000","last_fullsized":"2024-09-17T03:05:56.657693+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:17.172791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657477+0000","last_change":"2024-09-17T03:05:54.488042+0000","last_active":"2024-09-17T03:05:56.657477+0000","last_peered":"2024-09-17T03:05:56.657477+0000","last_clean":"2024-09-17T03:05:56.657477+0000","last_became_active":"2024-09-17T03:05:54.487736+0000","last_became_peered":"2024-09-17T03:05:54.487736+0000","last_unstale":"2024-09-17T03:05:56.657477+0000","last_undegraded":"2024-09-17T03:05:56.657477+0000","last_fullsized":"2024-09-17T03:05:56.657477+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:31.854304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478212+0000","last_change":"2024-09-17T03:05:55.485380+0000","last_active":"2024-09-17T03:05:56.478212+0000","last_peered":"2024-09-17T03:05:56.478212+0000","last_clean":"2024-09-17T03:05:56.478212+0000","last_became_active":"2024-09-17T03:05:55.485089+0000","last_became_peered":"2024-09-17T03:05:55.485089+0000","last_unstale":"2024-09-17T03:05:56.478212+0000","last_undegraded":"2024-09-17T03:05:56.478212+0000","last_fullsized":"2024-09-17T03:05:56.478212+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:52.402768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657128+0000","last_change":"2024-09-17T03:05:54.490342+0000","last_active":"2024-09-17T03:05:56.657128+0000","last_peered":"2024-09-17T03:05:56.657128+0000","last_clean":"2024-09-17T03:05:56.657128+0000","last_became_active":"2024-09-17T03:05:54.490082+0000","last_became_peered":"2024-09-17T03:05:54.490082+0000","last_unstale":"2024-09-17T03:05:56.657128+0000","last_undegraded":"2024-09-17T03:05:56.657128+0000","last_fullsized":"2024-09-17T03:05:56.657128+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:48.599539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656539+0000","last_change":"2024-09-17T03:05:55.496127+0000","last_active":"2024-09-17T03:05:56.656539+0000","last_peered":"2024-09-17T03:05:56.656539+0000","last_clean":"2024-09-17T03:05:56.656539+0000","last_became_active":"2024-09-17T03:05:55.493834+0000","last_became_peered":"2024-09-17T03:05:55.493834+0000","last_unstale":"2024-09-17T03:05:56.656539+0000","last_undegraded":"2024-09-17T03:05:56.656539+0000","last_fullsized":"2024-09-17T03:05:56.656539+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:16.586315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656897+0000","last_change":"2024-09-17T03:05:54.489157+0000","last_active":"2024-09-17T03:05:56.656897+0000","last_peered":"2024-09-17T03:05:56.656897+0000","last_clean":"2024-09-17T03:05:56.656897+0000","last_became_active":"2024-09-17T03:05:54.488876+0000","last_became_peered":"2024-09-17T03:05:54.488876+0000","last_unstale":"2024-09-17T03:05:56.656897+0000","last_undegraded":"2024-09-17T03:05:56.656897+0000","last_fullsized":"2024-09-17T03:05:56.656897+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:59.598633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656632+0000","last_change":"2024-09-17T03:05:55.497874+0000","last_active":"2024-09-17T03:05:56.656632+0000","last_peered":"2024-09-17T03:05:56.656632+0000","last_clean":"2024-09-17T03:05:56.656632+0000","last_became_active":"2024-09-17T03:05:55.496789+0000","last_became_peered":"2024-09-17T03:05:55.496789+0000","last_unstale":"2024-09-17T03:05:56.656632+0000","last_undegraded":"2024-09-17T03:05:56.656632+0000","last_fullsized":"2024-09-17T03:05:56.656632+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:15.337367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479312+0000","last_change":"2024-09-17T03:05:54.490230+0000","last_active":"2024-09-17T03:05:56.479312+0000","last_peered":"2024-09-17T03:05:56.479312+0000","last_clean":"2024-09-17T03:05:56.479312+0000","last_became_active":"2024-09-17T03:05:54.489971+0000","last_became_peered":"2024-09-17T03:05:54.489971+0000","last_unstale":"2024-09-17T03:05:56.479312+0000","last_undegraded":"2024-09-17T03:05:56.479312+0000","last_fullsized":"2024-09-17T03:05:56.479312+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:53.673437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658079+0000","last_change":"2024-09-17T03:05:55.491609+0000","last_active":"2024-09-17T03:05:56.658079+0000","last_peered":"2024-09-17T03:05:56.658079+0000","last_clean":"2024-09-17T03:05:56.658079+0000","last_became_active":"2024-09-17T03:05:55.491334+0000","last_became_peered":"2024-09-17T03:05:55.491334+0000","last_unstale":"2024-09-17T03:05:56.658079+0000","last_undegraded":"2024-09-17T03:05:56.658079+0000","last_fullsized":"2024-09-17T03:05:56.658079+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:25.988549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478207+0000","last_change":"2024-09-17T03:05:54.484801+0000","last_active":"2024-09-17T03:05:56.478207+0000","last_peered":"2024-09-17T03:05:56.478207+0000","last_clean":"2024-09-17T03:05:56.478207+0000","last_became_active":"2024-09-17T03:05:54.484341+0000","last_became_peered":"2024-09-17T03:05:54.484341+0000","last_unstale":"2024-09-17T03:05:56.478207+0000","last_undegraded":"2024-09-17T03:05:56.478207+0000","last_fullsized":"2024-09-17T03:05:56.478207+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:39.852617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658066+0000","last_change":"2024-09-17T03:05:55.497205+0000","last_active":"2024-09-17T03:05:56.658066+0000","last_peered":"2024-09-17T03:05:56.658066+0000","last_clean":"2024-09-17T03:05:56.658066+0000","last_became_active":"2024-09-17T03:05:55.496897+0000","last_became_peered":"2024-09-17T03:05:55.496897+0000","last_unstale":"2024-09-17T03:05:56.658066+0000","last_undegraded":"2024-09-17T03:05:56.658066+0000","last_fullsized":"2024-09-17T03:05:56.658066+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:27.702683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656752+0000","last_change":"2024-09-17T03:05:54.481157+0000","last_active":"2024-09-17T03:05:56.656752+0000","last_peered":"2024-09-17T03:05:56.656752+0000","last_clean":"2024-09-17T03:05:56.656752+0000","last_became_active":"2024-09-17T03:05:54.480882+0000","last_became_peered":"2024-09-17T03:05:54.480882+0000","last_unstale":"2024-09-17T03:05:56.656752+0000","last_undegraded":"2024-09-17T03:05:56.656752+0000","last_fullsized":"2024-09-17T03:05:56.656752+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:54.108066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658065+0000","last_change":"2024-09-17T03:05:55.498876+0000","last_active":"2024-09-17T03:05:56.658065+0000","last_peered":"2024-09-17T03:05:56.658065+0000","last_clean":"2024-09-17T03:05:56.658065+0000","last_became_active":"2024-09-17T03:05:55.498478+0000","last_became_peered":"2024-09-17T03:05:55.498478+0000","last_unstale":"2024-09-17T03:05:56.658065+0000","last_undegraded":"2024-09-17T03:05:56.658065+0000","last_fullsized":"2024-09-17T03:05:56.658065+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:05.075251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"184'3","reported_seq":18,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658124+0000","last_change":"2024-09-17T03:05:54.485813+0000","last_active":"2024-09-17T03:05:56.658124+0000","last_peered":"2024-09-17T03:05:56.658124+0000","last_clean":"2024-09-17T03:05:56.658124+0000","last_became_active":"2024-09-17T03:05:54.485393+0000","last_became_peered":"2024-09-17T03:05:54.485393+0000","last_unstale":"2024-09-17T03:05:56.658124+0000","last_undegraded":"2024-09-17T03:05:56.658124+0000","last_fullsized":"2024-09-17T03:05:56.658124+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:07.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479830+0000","last_change":"2024-09-17T03:05:55.494178+0000","last_active":"2024-09-17T03:05:56.479830+0000","last_peered":"2024-09-17T03:05:56.479830+0000","last_clean":"2024-09-17T03:05:56.479830+0000","last_became_active":"2024-09-17T03:05:55.493811+0000","last_became_peered":"2024-09-17T03:05:55.493811+0000","last_unstale":"2024-09-17T03:05:56.479830+0000","last_undegraded":"2024-09-17T03:05:56.479830+0000","last_fullsized":"2024-09-17T03:05:56.479830+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:58:37.990699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"184'6","reported_seq":21,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479742+0000","last_change":"2024-09-17T03:05:54.491062+0000","last_active":"2024-09-17T03:05:56.479742+0000","last_peered":"2024-09-17T03:05:56.479742+0000","last_clean":"2024-09-17T03:05:56.479742+0000","last_became_active":"2024-09-17T03:05:54.490794+0000","last_became_peered":"2024-09-17T03:05:54.490794+0000","last_unstale":"2024-09-17T03:05:56.479742+0000","last_undegraded":"2024-09-17T03:05:56.479742+0000","last_fullsized":"2024-09-17T03:05:56.479742+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:13:21.352846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658308+0000","last_change":"2024-09-17T03:05:55.483337+0000","last_active":"2024-09-17T03:05:56.658308+0000","last_peered":"2024-09-17T03:05:56.658308+0000","last_clean":"2024-09-17T03:05:56.658308+0000","last_became_active":"2024-09-17T03:05:55.483018+0000","last_became_peered":"2024-09-17T03:05:55.483018+0000","last_unstale":"2024-09-17T03:05:56.658308+0000","last_undegraded":"2024-09-17T03:05:56.658308+0000","last_fullsized":"2024-09-17T03:05:56.658308+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:42.138966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657174+0000","last_change":"2024-09-17T03:05:54.489488+0000","last_active":"2024-09-17T03:05:56.657174+0000","last_peered":"2024-09-17T03:05:56.657174+0000","last_clean":"2024-09-17T03:05:56.657174+0000","last_became_active":"2024-09-17T03:05:54.489162+0000","last_became_peered":"2024-09-17T03:05:54.489162+0000","last_unstale":"2024-09-17T03:05:56.657174+0000","last_undegraded":"2024-09-17T03:05:56.657174+0000","last_fullsized":"2024-09-17T03:05:56.657174+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:53.167104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478133+0000","last_change":"2024-09-17T03:05:55.488349+0000","last_active":"2024-09-17T03:05:56.478133+0000","last_peered":"2024-09-17T03:05:56.478133+0000","last_clean":"2024-09-17T03:05:56.478133+0000","last_became_active":"2024-09-17T03:05:55.488092+0000","last_became_peered":"2024-09-17T03:05:55.488092+0000","last_unstale":"2024-09-17T03:05:56.478133+0000","last_undegraded":"2024-09-17T03:05:56.478133+0000","last_fullsized":"2024-09-17T03:05:56.478133+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:13.832198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658429+0000","last_change":"2024-09-17T03:05:54.482696+0000","last_active":"2024-09-17T03:05:56.658429+0000","last_peered":"2024-09-17T03:05:56.658429+0000","last_clean":"2024-09-17T03:05:56.658429+0000","last_became_active":"2024-09-17T03:05:54.482414+0000","last_became_peered":"2024-09-17T03:05:54.482414+0000","last_unstale":"2024-09-17T03:05:56.658429+0000","last_undegraded":"2024-09-17T03:05:56.658429+0000","last_fullsized":"2024-09-17T03:05:56.658429+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:12.921560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656435+0000","last_change":"2024-09-17T03:05:55.495330+0000","last_active":"2024-09-17T03:05:56.656435+0000","last_peered":"2024-09-17T03:05:56.656435+0000","last_clean":"2024-09-17T03:05:56.656435+0000","last_became_active":"2024-09-17T03:05:55.494786+0000","last_became_peered":"2024-09-17T03:05:55.494786+0000","last_unstale":"2024-09-17T03:05:56.656435+0000","last_undegraded":"2024-09-17T03:05:56.656435+0000","last_fullsized":"2024-09-17T03:05:56.656435+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:04.294576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656986+0000","last_change":"2024-09-17T03:05:54.491577+0000","last_active":"2024-09-17T03:05:56.656986+0000","last_peered":"2024-09-17T03:05:56.656986+0000","last_clean":"2024-09-17T03:05:56.656986+0000","last_became_active":"2024-09-17T03:05:54.491298+0000","last_became_peered":"2024-09-17T03:05:54.491298+0000","last_unstale":"2024-09-17T03:05:56.656986+0000","last_undegraded":"2024-09-17T03:05:56.656986+0000","last_fullsized":"2024-09-17T03:05:56.656986+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:45.887616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656906+0000","last_change":"2024-09-17T03:05:55.487099+0000","last_active":"2024-09-17T03:05:56.656906+0000","last_peered":"2024-09-17T03:05:56.656906+0000","last_clean":"2024-09-17T03:05:56.656906+0000","last_became_active":"2024-09-17T03:05:55.486830+0000","last_became_peered":"2024-09-17T03:05:55.486830+0000","last_unstale":"2024-09-17T03:05:56.656906+0000","last_undegraded":"2024-09-17T03:05:56.656906+0000","last_fullsized":"2024-09-17T03:05:56.656906+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:30.590308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"184'8","reported_seq":23,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480114+0000","last_change":"2024-09-17T03:05:54.490232+0000","last_active":"2024-09-17T03:05:56.480114+0000","last_peered":"2024-09-17T03:05:56.480114+0000","last_clean":"2024-09-17T03:05:56.480114+0000","last_became_active":"2024-09-17T03:05:54.489935+0000","last_became_peered":"2024-09-17T03:05:54.489935+0000","last_unstale":"2024-09-17T03:05:56.480114+0000","last_undegraded":"2024-09-17T03:05:56.480114+0000","last_fullsized":"2024-09-17T03:05:56.480114+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:26.458337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656944+0000","last_change":"2024-09-17T03:05:55.497247+0000","last_active":"2024-09-17T03:05:56.656944+0000","last_peered":"2024-09-17T03:05:56.656944+0000","last_clean":"2024-09-17T03:05:56.656944+0000","last_became_active":"2024-09-17T03:05:55.496453+0000","last_became_peered":"2024-09-17T03:05:55.496453+0000","last_unstale":"2024-09-17T03:05:56.656944+0000","last_undegraded":"2024-09-17T03:05:56.656944+0000","last_fullsized":"2024-09-17T03:05:56.656944+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:43.692576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657296+0000","last_change":"2024-09-17T03:05:54.483051+0000","last_active":"2024-09-17T03:05:56.657296+0000","last_peered":"2024-09-17T03:05:56.657296+0000","last_clean":"2024-09-17T03:05:56.657296+0000","last_became_active":"2024-09-17T03:05:54.482764+0000","last_became_peered":"2024-09-17T03:05:54.482764+0000","last_unstale":"2024-09-17T03:05:56.657296+0000","last_undegraded":"2024-09-17T03:05:56.657296+0000","last_fullsized":"2024-09-17T03:05:56.657296+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:41.846186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658311+0000","last_change":"2024-09-17T03:05:55.484547+0000","last_active":"2024-09-17T03:05:56.658311+0000","last_peered":"2024-09-17T03:05:56.658311+0000","last_clean":"2024-09-17T03:05:56.658311+0000","last_became_active":"2024-09-17T03:05:55.484262+0000","last_became_peered":"2024-09-17T03:05:55.484262+0000","last_unstale":"2024-09-17T03:05:56.658311+0000","last_undegraded":"2024-09-17T03:05:56.658311+0000","last_fullsized":"2024-09-17T03:05:56.658311+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:54.475829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657771+0000","last_change":"2024-09-17T03:05:54.484662+0000","last_active":"2024-09-17T03:05:56.657771+0000","last_peered":"2024-09-17T03:05:56.657771+0000","last_clean":"2024-09-17T03:05:56.657771+0000","last_became_active":"2024-09-17T03:05:54.484361+0000","last_became_peered":"2024-09-17T03:05:54.484361+0000","last_unstale":"2024-09-17T03:05:56.657771+0000","last_undegraded":"2024-09-17T03:05:56.657771+0000","last_fullsized":"2024-09-17T03:05:56.657771+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:41.415509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656862+0000","last_change":"2024-09-17T03:05:55.495820+0000","last_active":"2024-09-17T03:05:56.656862+0000","last_peered":"2024-09-17T03:05:56.656862+0000","last_clean":"2024-09-17T03:05:56.656862+0000","last_became_active":"2024-09-17T03:05:55.493415+0000","last_became_peered":"2024-09-17T03:05:55.493415+0000","last_unstale":"2024-09-17T03:05:56.656862+0000","last_undegraded":"2024-09-17T03:05:56.656862+0000","last_fullsized":"2024-09-17T03:05:56.656862+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:19.209318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"184'1","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657468+0000","last_change":"2024-09-17T03:05:54.491969+0000","last_active":"2024-09-17T03:05:56.657468+0000","last_peered":"2024-09-17T03:05:56.657468+0000","last_clean":"2024-09-17T03:05:56.657468+0000","last_became_active":"2024-09-17T03:05:54.491342+0000","last_became_peered":"2024-09-17T03:05:54.491342+0000","last_unstale":"2024-09-17T03:05:56.657468+0000","last_undegraded":"2024-09-17T03:05:56.657468+0000","last_fullsized":"2024-09-17T03:05:56.657468+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:31.675901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478761+0000","last_change":"2024-09-17T03:05:55.491533+0000","last_active":"2024-09-17T03:05:56.478761+0000","last_peered":"2024-09-17T03:05:56.478761+0000","last_clean":"2024-09-17T03:05:56.478761+0000","last_became_active":"2024-09-17T03:05:55.490844+0000","last_became_peered":"2024-09-17T03:05:55.490844+0000","last_unstale":"2024-09-17T03:05:56.478761+0000","last_undegraded":"2024-09-17T03:05:56.478761+0000","last_fullsized":"2024-09-17T03:05:56.478761+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:06.310808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656924+0000","last_change":"2024-09-17T03:05:54.485173+0000","last_active":"2024-09-17T03:05:56.656924+0000","last_peered":"2024-09-17T03:05:56.656924+0000","last_clean":"2024-09-17T03:05:56.656924+0000","last_became_active":"2024-09-17T03:05:54.484902+0000","last_became_peered":"2024-09-17T03:05:54.484902+0000","last_unstale":"2024-09-17T03:05:56.656924+0000","last_undegraded":"2024-09-17T03:05:56.656924+0000","last_fullsized":"2024-09-17T03:05:56.656924+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:16.841768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657145+0000","last_change":"2024-09-17T03:05:55.495180+0000","last_active":"2024-09-17T03:05:56.657145+0000","last_peered":"2024-09-17T03:05:56.657145+0000","last_clean":"2024-09-17T03:05:56.657145+0000","last_became_active":"2024-09-17T03:05:55.494887+0000","last_became_peered":"2024-09-17T03:05:55.494887+0000","last_unstale":"2024-09-17T03:05:56.657145+0000","last_undegraded":"2024-09-17T03:05:56.657145+0000","last_fullsized":"2024-09-17T03:05:56.657145+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:26.801003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657014+0000","last_change":"2024-09-17T03:05:54.491524+0000","last_active":"2024-09-17T03:05:56.657014+0000","last_peered":"2024-09-17T03:05:56.657014+0000","last_clean":"2024-09-17T03:05:56.657014+0000","last_became_active":"2024-09-17T03:05:54.491235+0000","last_became_peered":"2024-09-17T03:05:54.491235+0000","last_unstale":"2024-09-17T03:05:56.657014+0000","last_undegraded":"2024-09-17T03:05:56.657014+0000","last_fullsized":"2024-09-17T03:05:56.657014+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:56.870788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478446+0000","last_change":"2024-09-17T03:05:55.489057+0000","last_active":"2024-09-17T03:05:56.478446+0000","last_peered":"2024-09-17T03:05:56.478446+0000","last_clean":"2024-09-17T03:05:56.478446+0000","last_became_active":"2024-09-17T03:05:55.488795+0000","last_became_peered":"2024-09-17T03:05:55.488795+0000","last_unstale":"2024-09-17T03:05:56.478446+0000","last_undegraded":"2024-09-17T03:05:56.478446+0000","last_fullsized":"2024-09-17T03:05:56.478446+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:41.386900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656972+0000","last_change":"2024-09-17T03:05:54.485397+0000","last_active":"2024-09-17T03:05:56.656972+0000","last_peered":"2024-09-17T03:05:56.656972+0000","last_clean":"2024-09-17T03:05:56.656972+0000","last_became_active":"2024-09-17T03:05:54.485119+0000","last_became_peered":"2024-09-17T03:05:54.485119+0000","last_unstale":"2024-09-17T03:05:56.656972+0000","last_undegraded":"2024-09-17T03:05:56.656972+0000","last_fullsized":"2024-09-17T03:05:56.656972+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:20.130846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656924+0000","last_change":"2024-09-17T03:05:55.488185+0000","last_active":"2024-09-17T03:05:56.656924+0000","last_peered":"2024-09-17T03:05:56.656924+0000","last_clean":"2024-09-17T03:05:56.656924+0000","last_became_active":"2024-09-17T03:05:55.487925+0000","last_became_peered":"2024-09-17T03:05:55.487925+0000","last_unstale":"2024-09-17T03:05:56.656924+0000","last_undegraded":"2024-09-17T03:05:56.656924+0000","last_fullsized":"2024-09-17T03:05:56.656924+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:20.864776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657277+0000","last_change":"2024-09-17T03:05:54.490663+0000","last_active":"2024-09-17T03:05:56.657277+0000","last_peered":"2024-09-17T03:05:56.657277+0000","last_clean":"2024-09-17T03:05:56.657277+0000","last_became_active":"2024-09-17T03:05:54.490371+0000","last_became_peered":"2024-09-17T03:05:54.490371+0000","last_unstale":"2024-09-17T03:05:56.657277+0000","last_undegraded":"2024-09-17T03:05:56.657277+0000","last_fullsized":"2024-09-17T03:05:56.657277+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:48:11.721798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657433+0000","last_change":"2024-09-17T03:05:55.483764+0000","last_active":"2024-09-17T03:05:56.657433+0000","last_peered":"2024-09-17T03:05:56.657433+0000","last_clean":"2024-09-17T03:05:56.657433+0000","last_became_active":"2024-09-17T03:05:55.483469+0000","last_became_peered":"2024-09-17T03:05:55.483469+0000","last_unstale":"2024-09-17T03:05:56.657433+0000","last_undegraded":"2024-09-17T03:05:56.657433+0000","last_fullsized":"2024-09-17T03:05:56.657433+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:24.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657535+0000","last_change":"2024-09-17T03:05:54.492315+0000","last_active":"2024-09-17T03:05:56.657535+0000","last_peered":"2024-09-17T03:05:56.657535+0000","last_clean":"2024-09-17T03:05:56.657535+0000","last_became_active":"2024-09-17T03:05:54.491690+0000","last_became_peered":"2024-09-17T03:05:54.491690+0000","last_unstale":"2024-09-17T03:05:56.657535+0000","last_undegraded":"2024-09-17T03:05:56.657535+0000","last_fullsized":"2024-09-17T03:05:56.657535+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:14.241430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.656962+0000","last_change":"2024-09-17T03:05:55.498546+0000","last_active":"2024-09-17T03:05:56.656962+0000","last_peered":"2024-09-17T03:05:56.656962+0000","last_clean":"2024-09-17T03:05:56.656962+0000","last_became_active":"2024-09-17T03:05:55.497185+0000","last_became_peered":"2024-09-17T03:05:55.497185+0000","last_unstale":"2024-09-17T03:05:56.656962+0000","last_undegraded":"2024-09-17T03:05:56.656962+0000","last_fullsized":"2024-09-17T03:05:56.656962+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:08.244405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"184'2","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658917+0000","last_change":"2024-09-17T03:05:54.484012+0000","last_active":"2024-09-17T03:05:56.658917+0000","last_peered":"2024-09-17T03:05:56.658917+0000","last_clean":"2024-09-17T03:05:56.658917+0000","last_became_active":"2024-09-17T03:05:54.483033+0000","last_became_peered":"2024-09-17T03:05:54.483033+0000","last_unstale":"2024-09-17T03:05:56.658917+0000","last_undegraded":"2024-09-17T03:05:56.658917+0000","last_fullsized":"2024-09-17T03:05:56.658917+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:06.905676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478672+0000","last_change":"2024-09-17T03:05:55.492127+0000","last_active":"2024-09-17T03:05:56.478672+0000","last_peered":"2024-09-17T03:05:56.478672+0000","last_clean":"2024-09-17T03:05:56.478672+0000","last_became_active":"2024-09-17T03:05:55.491832+0000","last_became_peered":"2024-09-17T03:05:55.491832+0000","last_unstale":"2024-09-17T03:05:56.478672+0000","last_undegraded":"2024-09-17T03:05:56.478672+0000","last_fullsized":"2024-09-17T03:05:56.478672+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:01.034453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657369+0000","last_change":"2024-09-17T03:05:54.485781+0000","last_active":"2024-09-17T03:05:56.657369+0000","last_peered":"2024-09-17T03:05:56.657369+0000","last_clean":"2024-09-17T03:05:56.657369+0000","last_became_active":"2024-09-17T03:05:54.485533+0000","last_became_peered":"2024-09-17T03:05:54.485533+0000","last_unstale":"2024-09-17T03:05:56.657369+0000","last_undegraded":"2024-09-17T03:05:56.657369+0000","last_fullsized":"2024-09-17T03:05:56.657369+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:55.119892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657680+0000","last_change":"2024-09-17T03:05:55.498135+0000","last_active":"2024-09-17T03:05:56.657680+0000","last_peered":"2024-09-17T03:05:56.657680+0000","last_clean":"2024-09-17T03:05:56.657680+0000","last_became_active":"2024-09-17T03:05:55.497865+0000","last_became_peered":"2024-09-17T03:05:55.497865+0000","last_unstale":"2024-09-17T03:05:56.657680+0000","last_undegraded":"2024-09-17T03:05:56.657680+0000","last_fullsized":"2024-09-17T03:05:56.657680+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:29.193937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479652+0000","last_change":"2024-09-17T03:05:54.488584+0000","last_active":"2024-09-17T03:05:56.479652+0000","last_peered":"2024-09-17T03:05:56.479652+0000","last_clean":"2024-09-17T03:05:56.479652+0000","last_became_active":"2024-09-17T03:05:54.488317+0000","last_became_peered":"2024-09-17T03:05:54.488317+0000","last_unstale":"2024-09-17T03:05:56.479652+0000","last_undegraded":"2024-09-17T03:05:56.479652+0000","last_fullsized":"2024-09-17T03:05:56.479652+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:14.365880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658502+0000","last_change":"2024-09-17T03:05:55.489930+0000","last_active":"2024-09-17T03:05:56.658502+0000","last_peered":"2024-09-17T03:05:56.658502+0000","last_clean":"2024-09-17T03:05:56.658502+0000","last_became_active":"2024-09-17T03:05:55.489171+0000","last_became_peered":"2024-09-17T03:05:55.489171+0000","last_unstale":"2024-09-17T03:05:56.658502+0000","last_undegraded":"2024-09-17T03:05:56.658502+0000","last_fullsized":"2024-09-17T03:05:56.658502+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:56.667825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657234+0000","last_change":"2024-09-17T03:05:54.485867+0000","last_active":"2024-09-17T03:05:56.657234+0000","last_peered":"2024-09-17T03:05:56.657234+0000","last_clean":"2024-09-17T03:05:56.657234+0000","last_became_active":"2024-09-17T03:05:54.485431+0000","last_became_peered":"2024-09-17T03:05:54.485431+0000","last_unstale":"2024-09-17T03:05:56.657234+0000","last_undegraded":"2024-09-17T03:05:56.657234+0000","last_fullsized":"2024-09-17T03:05:56.657234+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:21.127128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658771+0000","last_change":"2024-09-17T03:05:55.485967+0000","last_active":"2024-09-17T03:05:56.658771+0000","last_peered":"2024-09-17T03:05:56.658771+0000","last_clean":"2024-09-17T03:05:56.658771+0000","last_became_active":"2024-09-17T03:05:55.485362+0000","last_became_peered":"2024-09-17T03:05:55.485362+0000","last_unstale":"2024-09-17T03:05:56.658771+0000","last_undegraded":"2024-09-17T03:05:56.658771+0000","last_fullsized":"2024-09-17T03:05:56.658771+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:42.789251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480386+0000","last_change":"2024-09-17T03:05:54.487046+0000","last_active":"2024-09-17T03:05:56.480386+0000","last_peered":"2024-09-17T03:05:56.480386+0000","last_clean":"2024-09-17T03:05:56.480386+0000","last_became_active":"2024-09-17T03:05:54.486738+0000","last_became_peered":"2024-09-17T03:05:54.486738+0000","last_unstale":"2024-09-17T03:05:56.480386+0000","last_undegraded":"2024-09-17T03:05:56.480386+0000","last_fullsized":"2024-09-17T03:05:56.480386+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:53.252754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480042+0000","last_change":"2024-09-17T03:05:55.491535+0000","last_active":"2024-09-17T03:05:56.480042+0000","last_peered":"2024-09-17T03:05:56.480042+0000","last_clean":"2024-09-17T03:05:56.480042+0000","last_became_active":"2024-09-17T03:05:55.490313+0000","last_became_peered":"2024-09-17T03:05:55.490313+0000","last_unstale":"2024-09-17T03:05:56.480042+0000","last_undegraded":"2024-09-17T03:05:56.480042+0000","last_fullsized":"2024-09-17T03:05:56.480042+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:11.410972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657097+0000","last_change":"2024-09-17T03:05:54.492351+0000","last_active":"2024-09-17T03:05:56.657097+0000","last_peered":"2024-09-17T03:05:56.657097+0000","last_clean":"2024-09-17T03:05:56.657097+0000","last_became_active":"2024-09-17T03:05:54.492080+0000","last_became_peered":"2024-09-17T03:05:54.492080+0000","last_unstale":"2024-09-17T03:05:56.657097+0000","last_undegraded":"2024-09-17T03:05:56.657097+0000","last_fullsized":"2024-09-17T03:05:56.657097+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:43.305299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.478421+0000","last_change":"2024-09-17T03:05:55.495754+0000","last_active":"2024-09-17T03:05:56.478421+0000","last_peered":"2024-09-17T03:05:56.478421+0000","last_clean":"2024-09-17T03:05:56.478421+0000","last_became_active":"2024-09-17T03:05:55.495461+0000","last_became_peered":"2024-09-17T03:05:55.495461+0000","last_unstale":"2024-09-17T03:05:56.478421+0000","last_undegraded":"2024-09-17T03:05:56.478421+0000","last_fullsized":"2024-09-17T03:05:56.478421+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:02.667374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480078+0000","last_change":"2024-09-17T03:05:54.482975+0000","last_active":"2024-09-17T03:05:56.480078+0000","last_peered":"2024-09-17T03:05:56.480078+0000","last_clean":"2024-09-17T03:05:56.480078+0000","last_became_active":"2024-09-17T03:05:54.482699+0000","last_became_peered":"2024-09-17T03:05:54.482699+0000","last_unstale":"2024-09-17T03:05:56.480078+0000","last_undegraded":"2024-09-17T03:05:56.480078+0000","last_fullsized":"2024-09-17T03:05:56.480078+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:01.998213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657077+0000","last_change":"2024-09-17T03:05:55.493160+0000","last_active":"2024-09-17T03:05:56.657077+0000","last_peered":"2024-09-17T03:05:56.657077+0000","last_clean":"2024-09-17T03:05:56.657077+0000","last_became_active":"2024-09-17T03:05:55.492183+0000","last_became_peered":"2024-09-17T03:05:55.492183+0000","last_unstale":"2024-09-17T03:05:56.657077+0000","last_undegraded":"2024-09-17T03:05:56.657077+0000","last_fullsized":"2024-09-17T03:05:56.657077+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:38.953969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.479897+0000","last_change":"2024-09-17T03:05:54.491928+0000","last_active":"2024-09-17T03:05:56.479897+0000","last_peered":"2024-09-17T03:05:56.479897+0000","last_clean":"2024-09-17T03:05:56.479897+0000","last_became_active":"2024-09-17T03:05:54.491615+0000","last_became_peered":"2024-09-17T03:05:54.491615+0000","last_unstale":"2024-09-17T03:05:56.479897+0000","last_undegraded":"2024-09-17T03:05:56.479897+0000","last_fullsized":"2024-09-17T03:05:56.479897+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:52.100856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.658510+0000","last_change":"2024-09-17T03:05:55.497851+0000","last_active":"2024-09-17T03:05:56.658510+0000","last_peered":"2024-09-17T03:05:56.658510+0000","last_clean":"2024-09-17T03:05:56.658510+0000","last_became_active":"2024-09-17T03:05:55.497600+0000","last_became_peered":"2024-09-17T03:05:55.497600+0000","last_unstale":"2024-09-17T03:05:56.658510+0000","last_undegraded":"2024-09-17T03:05:56.658510+0000","last_fullsized":"2024-09-17T03:05:56.658510+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:54.467232+0000","last_clean_scrub_stamp":"2024-09-17T03:05:54.467232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:22.062903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.480206+0000","last_change":"2024-09-17T03:05:54.491201+0000","last_active":"2024-09-17T03:05:56.480206+0000","last_peered":"2024-09-17T03:05:56.480206+0000","last_clean":"2024-09-17T03:05:56.480206+0000","last_became_active":"2024-09-17T03:05:54.490944+0000","last_became_peered":"2024-09-17T03:05:54.490944+0000","last_unstale":"2024-09-17T03:05:56.480206+0000","last_undegraded":"2024-09-17T03:05:56.480206+0000","last_fullsized":"2024-09-17T03:05:56.480206+0000","mapping_epoch":182,"log_start":"0'0","ondisk_log_start":"0'0","created":182,"last_epoch_clean":183,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:05:53.463282+0000","last_clean_scrub_stamp":"2024-09-17T03:05:53.463282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:12.374399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":435,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-17T03:05:56.657056+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:05:56.657056+0000","last_peered":"2024-09-17T03:05:56.657056+0000","last_clean":"2024-09-17T03:05:56.657056+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:05:56.657056+0000","last_undegraded":"2024-09-17T03:05:56.657056+0000","last_fullsized":"2024-09-17T03:05:56.657056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1587,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193725,"statfs":{"total":200000000,"available":198374711,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198961111,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574989,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194303,"statfs":{"total":200000000,"available":198966829,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574987,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1016,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194296,"statfs":{"total":200000000,"available":198959451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967343,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1008,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194304,"statfs":{"total":200000000,"available":198967399,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1584,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193727,"statfs":{"total":200000000,"available":198377065,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:05:58.841 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:05:58.841 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:05:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.998+0000 7fd85e920640 1 -- 172.21.15.104:0/2705381734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580b3b00 msgr2=0x7fd8580d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:58.997 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.998+0000 7fd85e920640 1 --2- 172.21.15.104:0/2705381734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580b3b00 0x7fd8580d11d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fd85808daa0 tx=0x7fd84002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.998+0000 7fd85e920640 1 -- 172.21.15.104:0/2705381734 shutdown_connections 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.998+0000 7fd85e920640 1 --2- 172.21.15.104:0/2705381734 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8580d1710 0x7fd8580cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.998+0000 7fd85e920640 1 --2- 172.21.15.104:0/2705381734 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580b3b00 0x7fd8580d11d0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.998+0000 7fd85e920640 1 --2- 172.21.15.104:0/2705381734 >> v2:172.21.15.192:3300/0 conn(0x7fd8580b6f70 0x7fd85815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.998+0000 7fd85e920640 1 -- 172.21.15.104:0/2705381734 >> 172.21.15.104:0/2705381734 conn(0x7fd858073df0 msgr2=0x7fd858068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.999+0000 7fd85e920640 1 -- 172.21.15.104:0/2705381734 shutdown_connections 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:58.999+0000 7fd85e920640 1 -- 172.21.15.104:0/2705381734 wait complete. 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.000+0000 7fd85e920640 1 Processor -- start 2024-09-17T03:05:58.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.000+0000 7fd85e920640 1 -- start start 2024-09-17T03:05:59.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85e920640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8580b3b00 0x7fd8581499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85e920640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8580b6f70 0x7fd8580d3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85e920640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580d1710 0x7fd8580d3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85e920640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd8580d01f0 con 0x7fd8580d1710 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85e920640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd8580d0070 con 0x7fd8580b6f70 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85e920640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd8580d0370 con 0x7fd8580b3b00 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580d1710 0x7fd8580d3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580d1710 0x7fd8580d3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37872/0 (socket says 172.21.15.104:37872) 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 -- 172.21.15.104:0/480122502 learned_addr learned my addr 172.21.15.104:0/480122502 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd84ffff640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8580b6f70 0x7fd8580d3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd857fff640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8580b3b00 0x7fd8581499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 -- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8580b3b00 msgr2=0x7fd8581499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8580b3b00 0x7fd8581499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 -- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8580b6f70 msgr2=0x7fd8580d3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8580b6f70 0x7fd8580d3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 -- 172.21.15.104:0/480122502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd858149f30 con 0x7fd8580d1710 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd84ffff640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8580b6f70 0x7fd8580d3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85cebd640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580d1710 0x7fd8580d3fd0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fd85000cae0 tx=0x7fd850007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd8557fa640 1 -- 172.21.15.104:0/480122502 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850007da0 con 0x7fd8580d1710 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd8557fa640 1 -- 172.21.15.104:0/480122502 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd850004c30 con 0x7fd8580d1710 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85814a2d0 con 0x7fd8580d1710 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd8557fa640 1 -- 172.21.15.104:0/480122502 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850005280 con 0x7fd8580d1710 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.002+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85814a890 con 0x7fd8580d1710 2024-09-17T03:05:59.003 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.003+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85815ef90 con 0x7fd8580d1710 2024-09-17T03:05:59.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.004+0000 7fd8557fa640 1 -- 172.21.15.104:0/480122502 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd850005420 con 0x7fd8580d1710 2024-09-17T03:05:59.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.004+0000 7fd8557fa640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd838078b90 0x7fd83807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:59.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.005+0000 7fd8557fa640 1 -- 172.21.15.104:0/480122502 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fd85009b860 con 0x7fd8580d1710 2024-09-17T03:05:59.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.005+0000 7fd857fff640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd838078b90 0x7fd83807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:59.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.005+0000 7fd857fff640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd838078b90 0x7fd83807b0a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd848005c60 tx=0x7fd848005bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:59.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.009+0000 7fd8557fa640 1 -- 172.21.15.104:0/480122502 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd850014070 con 0x7fd8580d1710 2024-09-17T03:05:59.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.251+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd8580b50d0 con 0x7fd8580d1710 2024-09-17T03:05:59.253 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.254+0000 7fd8557fa640 1 -- 172.21.15.104:0/480122502 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v35) ==== 190+0+147 (secure 0 0 0) 0x7fd85009b030 con 0x7fd8580d1710 2024-09-17T03:05:59.253 INFO:teuthology.orchestra.run.smithi104.stdout:[client.0] 2024-09-17T03:05:59.253 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQBP7+hmTfqyJxAAwOyPPaa+FCWumSfJPxlqWQ== 2024-09-17T03:05:59.253 INFO:teuthology.orchestra.run.smithi104.stdout: caps mds = "allow" 2024-09-17T03:05:59.253 INFO:teuthology.orchestra.run.smithi104.stdout: caps mon = "allow r" 2024-09-17T03:05:59.253 INFO:teuthology.orchestra.run.smithi104.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:05:59.253 INFO:teuthology.orchestra.run.smithi104.stderr:updated caps for client.0 2024-09-17T03:05:59.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.256+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd838078b90 msgr2=0x7fd83807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.256+0000 7fd85e920640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd838078b90 0x7fd83807b0a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd848005c60 tx=0x7fd848005bf0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.256+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580d1710 msgr2=0x7fd8580d3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.256+0000 7fd85e920640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580d1710 0x7fd8580d3fd0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fd85000cae0 tx=0x7fd850007220 comp rx=0 tx=0).stop 2024-09-17T03:05:59.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.256+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 shutdown_connections 2024-09-17T03:05:59.255 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.257+0000 7fd85e920640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd838078b90 0x7fd83807b0a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.257+0000 7fd85e920640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8580b6f70 0x7fd8580d3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.257+0000 7fd85e920640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd8580d1710 0x7fd8580d3fd0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.257+0000 7fd85e920640 1 --2- 172.21.15.104:0/480122502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8580b3b00 0x7fd8581499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.257+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 >> 172.21.15.104:0/480122502 conn(0x7fd858073df0 msgr2=0x7fd858068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:59.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.257+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 shutdown_connections 2024-09-17T03:05:59.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.257+0000 7fd85e920640 1 -- 172.21.15.104:0/480122502 wait complete. 2024-09-17T03:05:59.267 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:05:59.378 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.380+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/771241824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00d0470 msgr2=0x7fa0a00d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.380+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/771241824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00d0470 0x7fa0a00d0880 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa094005fd0 tx=0x7fa09402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.380+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/771241824 shutdown_connections 2024-09-17T03:05:59.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.380+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/771241824 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00d0470 0x7fa0a00d0880 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.380+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/771241824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a00b7bb0 0x7fa0a00cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.380+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/771241824 >> 172.21.15.104:0/771241824 conn(0x7fa0a00d28a0 msgr2=0x7fa0a00d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:59.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.380+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/771241824 shutdown_connections 2024-09-17T03:05:59.379 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.380+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/771241824 wait complete. 2024-09-17T03:05:59.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.382+0000 7fa0a7f9b640 1 Processor -- start 2024-09-17T03:05:59.380 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.382+0000 7fa0a7f9b640 1 -- start start 2024-09-17T03:05:59.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a7f9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a00b7bb0 0x7fa0a01df780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:59.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a7f9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00cefb0 0x7fa0a00cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a7f9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a00d0470 0x7fa0a00b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a7f9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a00cfad0 con 0x7fa0a00cefb0 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a7f9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a00ce5e0 con 0x7fa0a00d0470 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a7f9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a00cfc50 con 0x7fa0a00b7bb0 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00cefb0 0x7fa0a00cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00cefb0 0x7fa0a00cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37894/0 (socket says 172.21.15.104:37894) 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 -- 172.21.15.104:0/339731459 learned_addr learned my addr 172.21.15.104:0/339731459 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a6538640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a00d0470 0x7fa0a00b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5d37640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a00b7bb0 0x7fa0a01df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 -- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a00b7bb0 msgr2=0x7fa0a01df780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a00b7bb0 0x7fa0a01df780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 -- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a00d0470 msgr2=0x7fa0a00b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a00d0470 0x7fa0a00b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 -- 172.21.15.104:0/339731459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a01e7e40 con 0x7fa0a00cefb0 2024-09-17T03:05:59.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.383+0000 7fa0a5536640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00cefb0 0x7fa0a00cc340 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fa094034040 tx=0x7fa0940038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:59.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.384+0000 7fa09e7fc640 1 -- 172.21.15.104:0/339731459 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09403e030 con 0x7fa0a00cefb0 2024-09-17T03:05:59.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.384+0000 7fa09e7fc640 1 -- 172.21.15.104:0/339731459 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa094003d90 con 0x7fa0a00cefb0 2024-09-17T03:05:59.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.384+0000 7fa09e7fc640 1 -- 172.21.15.104:0/339731459 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa094035040 con 0x7fa0a00cefb0 2024-09-17T03:05:59.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.384+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a01e8120 con 0x7fa0a00cefb0 2024-09-17T03:05:59.384 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.384+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a01e86e0 con 0x7fa0a00cefb0 2024-09-17T03:05:59.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.385+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a00cde90 con 0x7fa0a00cefb0 2024-09-17T03:05:59.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.385+0000 7fa09e7fc640 1 -- 172.21.15.104:0/339731459 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa094041030 con 0x7fa0a00cefb0 2024-09-17T03:05:59.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.386+0000 7fa09e7fc640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa08c078bc0 0x7fa08c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:05:59.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.386+0000 7fa09e7fc640 1 -- 172.21.15.104:0/339731459 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fa0940bb7e0 con 0x7fa0a00cefb0 2024-09-17T03:05:59.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.386+0000 7fa0a5d37640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa08c078bc0 0x7fa08c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:05:59.386 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.387+0000 7fa0a5d37640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa08c078bc0 0x7fa08c07b0d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa090005fd0 tx=0x7fa0900093b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:05:59.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.390+0000 7fa09e7fc640 1 -- 172.21.15.104:0/339731459 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa0940835d0 con 0x7fa0a00cefb0 2024-09-17T03:05:59.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.598+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0a0076350 con 0x7fa0a00cefb0 2024-09-17T03:05:59.597 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.599+0000 7fa09e7fc640 1 -- 172.21.15.104:0/339731459 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7fa094088000 con 0x7fa0a00cefb0 2024-09-17T03:05:59.598 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:05:59.598 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:05:59.598 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa08c078bc0 msgr2=0x7fa08c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa08c078bc0 0x7fa08c07b0d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa090005fd0 tx=0x7fa0900093b0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00cefb0 msgr2=0x7fa0a00cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00cefb0 0x7fa0a00cc340 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fa094034040 tx=0x7fa0940038a0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 shutdown_connections 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa08c078bc0 0x7fa08c07b0d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a00d0470 0x7fa0a00b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa0a00cefb0 0x7fa0a00cc340 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.600 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 --2- 172.21.15.104:0/339731459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a00b7bb0 0x7fa0a01df780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:05:59.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 >> 172.21.15.104:0/339731459 conn(0x7fa0a00d28a0 msgr2=0x7fa0a01e5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:05:59.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 shutdown_connections 2024-09-17T03:05:59.601 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:05:59.601+0000 7fa0a7f9b640 1 -- 172.21.15.104:0/339731459 wait complete. 2024-09-17T03:06:00.013 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:05:54.836560+0000', 'modified': '2024-09-17T03:05:56.844250+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8151}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8151': {'gid': 8151, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.104:6835/4053158179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.104:6833', 'nonce': 4053158179}, {'type': 'v1', 'addr': '172.21.15.104:6835', 'nonce': 4053158179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8151, 'qdb_cluster': [8151]} 2024-09-17T03:06:00.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:06:00.018 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:06:00.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.133+0000 7f6331113640 1 -- 172.21.15.104:0/2756602336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f632c0d13e0 msgr2=0x7f632c1615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.133+0000 7f6331113640 1 --2- 172.21.15.104:0/2756602336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f632c0d13e0 0x7f632c1615d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6324009ca0 tx=0x7f632402aa30 comp rx=0 tx=0).stop 2024-09-17T03:06:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.133+0000 7f6331113640 1 -- 172.21.15.104:0/2756602336 shutdown_connections 2024-09-17T03:06:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.133+0000 7f6331113640 1 --2- 172.21.15.104:0/2756602336 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f632c0d13e0 0x7f632c1615d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.133+0000 7f6331113640 1 --2- 172.21.15.104:0/2756602336 >> v2:172.21.15.192:3300/0 conn(0x7f632c0d3490 0x7f632c0b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.133+0000 7f6331113640 1 -- 172.21.15.104:0/2756602336 >> 172.21.15.104:0/2756602336 conn(0x7f632c0d2970 msgr2=0x7f632c0d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.133+0000 7f6331113640 1 -- 172.21.15.104:0/2756602336 shutdown_connections 2024-09-17T03:06:00.132 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.133+0000 7f6331113640 1 -- 172.21.15.104:0/2756602336 wait complete. 2024-09-17T03:06:00.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.135+0000 7f6331113640 1 Processor -- start 2024-09-17T03:06:00.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.135+0000 7f6331113640 1 -- start start 2024-09-17T03:06:00.135 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f6331113640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632c0d0fd0 0x7f632c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f6331113640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f632c0d13e0 0x7f632c0cf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f6331113640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f632c0d3490 0x7f632c1f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f6331113640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0b6bd0 con 0x7f632c0d13e0 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f6331113640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0b6a50 con 0x7f632c0d0fd0 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f6331113640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f632c0b6d50 con 0x7f632c0d3490 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f632a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f632c0d13e0 0x7f632c0cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f632a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f632c0d13e0 0x7f632c0cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37904/0 (socket says 172.21.15.104:37904) 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f632a59c640 1 -- 172.21.15.104:0/4273589689 learned_addr learned my addr 172.21.15.104:0/4273589689 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f632b59e640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f632c0d3490 0x7f632c1f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.136+0000 7f632ad9d640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632c0d0fd0 0x7f632c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f632a59c640 1 -- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f632c0d3490 msgr2=0x7f632c1f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.136 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f632a59c640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f632c0d3490 0x7f632c1f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f632a59c640 1 -- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632c0d0fd0 msgr2=0x7f632c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f632a59c640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632c0d0fd0 0x7f632c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f632a59c640 1 -- 172.21.15.104:0/4273589689 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c1531e0 con 0x7f632c0d13e0 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f632a59c640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f632c0d13e0 0x7f632c0cf750 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f632000c3a0 tx=0x7f632000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f63137fe640 1 -- 172.21.15.104:0/4273589689 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320017070 con 0x7f632c0d13e0 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f63137fe640 1 -- 172.21.15.104:0/4273589689 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63200053c0 con 0x7f632c0d13e0 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f6331113640 1 -- 172.21.15.104:0/4273589689 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c155fe0 con 0x7f632c0d13e0 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f63137fe640 1 -- 172.21.15.104:0/4273589689 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320003850 con 0x7f632c0d13e0 2024-09-17T03:06:00.137 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.137+0000 7f6331113640 1 -- 172.21.15.104:0/4273589689 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c1562c0 con 0x7f632c0d13e0 2024-09-17T03:06:00.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.139+0000 7f63137fe640 1 -- 172.21.15.104:0/4273589689 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f632001a070 con 0x7f632c0d13e0 2024-09-17T03:06:00.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.139+0000 7f63137fe640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6318078b90 0x7f631807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.139+0000 7f63137fe640 1 -- 172.21.15.104:0/4273589689 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f6320099fc0 con 0x7f632c0d13e0 2024-09-17T03:06:00.138 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.140+0000 7f632ad9d640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6318078b90 0x7f631807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.140+0000 7f632ad9d640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6318078b90 0x7f631807b0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f631c0095f0 tx=0x7f631c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:00.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.140+0000 7f633807f740 1 Processor -- start 2024-09-17T03:06:00.139 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.140+0000 7f633807f740 1 -- start start 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f633807f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 0x555776912fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f633807f740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776913500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f633807f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x555776930400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f633807f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x55577685b820 con 0x555776520590 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f633807f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55577684ac50 con 0x555776541270 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f633807f740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x55577684ea60 con 0x5557765183b0 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x555776930400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x555776930400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37914/0 (socket says 172.21.15.104:37914) 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 -- 172.21.15.104:0/4148831897 learned_addr learned my addr 172.21.15.104:0/4148831897 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632ad9d640 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 0x555776912fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.142 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632a59c640 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776913500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 -- 172.21.15.104:0/4148831897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 msgr2=0x555776913500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776913500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 -- 172.21.15.104:0/4148831897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 msgr2=0x555776912fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 0x555776912fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 -- 172.21.15.104:0/4148831897 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557765ac850 con 0x555776520590 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f632b59e640 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x555776930400 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6324009dc0 tx=0x7f6324004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f149109e26598d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f6310ff9640 1 -- 172.21.15.104:0/4148831897 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324047070 con 0x555776520590 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f6310ff9640 1 -- 172.21.15.104:0/4148831897 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6324003cb0 con 0x555776520590 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.142+0000 7f6310ff9640 1 -- 172.21.15.104:0/4148831897 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324033070 con 0x555776520590 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 -- 172.21.15.104:0/4148831897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 msgr2=0x555776930400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x555776930400 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f6324009dc0 tx=0x7f6324004ab0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 -- 172.21.15.104:0/4148831897 shutdown_connections 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x555776930400 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.143 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776913500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 --2- 172.21.15.104:0/4148831897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 0x555776912fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 -- 172.21.15.104:0/4148831897 >> 172.21.15.104:0/4148831897 conn(0x5557765353c0 msgr2=0x5557768e9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:00.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 -- 172.21.15.104:0/4148831897 shutdown_connections 2024-09-17T03:06:00.144 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.143+0000 7f633807f740 1 -- 172.21.15.104:0/4148831897 wait complete. 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.144+0000 7f633807f740 1 -- start start 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.144+0000 7f633807f740 1 Processor -- start 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557765183b0 0x5557769317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555776520590 0x5557768fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x5557768f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5557765bb620 con 0x555776541270 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557767f05f0 con 0x5557765183b0 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x555776913a40 con 0x555776520590 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 10 client.0 _ll_register_callbacks cb 0x5557767f40a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x5557768f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x5557768f03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37918/0 (socket says 172.21.15.104:37918) 2024-09-17T03:06:00.148 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 -- 172.21.15.104:0/2096971953 learned_addr learned my addr 172.21.15.104:0/2096971953 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632ad9d640 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557765183b0 0x5557769317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 -- 172.21.15.104:0/2096971953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555776520590 msgr2=0x5557768fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555776520590 0x5557768fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 -- 172.21.15.104:0/2096971953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557765183b0 msgr2=0x5557769317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557765183b0 0x5557769317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 -- 172.21.15.104:0/2096971953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557766236b0 con 0x555776541270 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f632b59e640 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x5557768f03f0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f6324045040 tx=0x7f632402fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80384499db93766 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f6309ffb640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f6309ffb640 1 -- 172.21.15.104:0/2096971953 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324033070 con 0x555776541270 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 1 -- 172.21.15.104:0/2096971953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6324003cb0 con 0x555776541270 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f6309ffb640 1 -- 172.21.15.104:0/2096971953 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f632402fd60 con 0x555776541270 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f6309ffb640 1 -- 172.21.15.104:0/2096971953 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f6324047040 con 0x555776541270 2024-09-17T03:06:00.149 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.146+0000 7f633807f740 10 client.8289 fetch_fsmap learned FSMap version 76 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f633807f740 1 -- 172.21.15.104:0/2096971953 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x555776930ff0 con 0x555776541270 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f6309ffb640 1 -- 172.21.15.104:0/2096971953 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6324003cb0 con 0x555776541270 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f6309ffb640 1 -- 172.21.15.104:0/2096971953 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f6324055030 con 0x555776541270 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f633807f740 10 client.8289 fetch_fsmap finished waiting for FSMap version 76 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f633807f740 10 client.8289 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f633807f740 20 client.8289 populate_metadata read hostname 'smithi104' 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f633807f740 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] conn(0x5557764ffe40 0x555776927310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f633807f740 4 client.8289 mds_command: new command op to 8151 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f633807f740 1 -- 172.21.15.104:0/2096971953 --> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55577685d770 con 0x5557764ffe40 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f632ad9d640 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] conn(0x5557764ffe40 0x555776927310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f6309ffb640 10 client.8289 ms_handle_connect on v2:172.21.15.104:6833/4053158179 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.147+0000 7f632ad9d640 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] conn(0x5557764ffe40 0x555776927310 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=999041953544dec7 server_cookie=6d2c193f9fac8315 in_seq=0 out_seq=0 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f6309ffb640 1 -- 172.21.15.104:0/2096971953 <== mds.0 v2:172.21.15.104:6833/4053158179 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55577685d770 con 0x5557764ffe40 2024-09-17T03:06:00.150 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f6309ffb640 10 client.8289 handle_command_reply: tid=0 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 client.8289 shutdown 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 -- 172.21.15.104:0/2096971953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 msgr2=0x5557768f03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x5557768f03f0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f6324045040 tx=0x7f632402fb70 comp rx=0 tx=0).stop 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 -- 172.21.15.104:0/2096971953 shutdown_connections 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] conn(0x5557764ffe40 0x555776927310 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x5557768f03f0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555776520590 0x5557768fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f6309ffb640 0 client.8289 ms_handle_reset on v2:172.21.15.104:6833/4053158179 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 --2- 172.21.15.104:0/2096971953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557765183b0 0x5557769317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 -- 172.21.15.104:0/2096971953 >> 172.21.15.104:0/2096971953 conn(0x5557765353c0 msgr2=0x5557768e3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 -- 172.21.15.104:0/2096971953 shutdown_connections 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 1 -- 172.21.15.104:0/2096971953 wait complete. 2024-09-17T03:06:00.151 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.148+0000 7f633807f740 20 client.8289 trim_cache size 0 max 16384 2024-09-17T03:06:00.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.166+0000 7f633807f740 1 Processor -- start 2024-09-17T03:06:00.165 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.166+0000 7f633807f740 1 -- start start 2024-09-17T03:06:00.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.167+0000 7f633807f740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776927df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.167+0000 7f633807f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776520590 0x555776901160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.167+0000 7f633807f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x555776912b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.167+0000 7f633807f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f632c155ae0 con 0x555776541270 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.167+0000 7f633807f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f632c154e40 con 0x555776520590 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.167+0000 7f633807f740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f632c155490 con 0x5557765183b0 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x555776912b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x555776912b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37934/0 (socket says 172.21.15.104:37934) 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 -- 172.21.15.104:0/1817701553 learned_addr learned my addr 172.21.15.104:0/1817701553 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 -- 172.21.15.104:0/1817701553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 msgr2=0x555776927df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 --2- 172.21.15.104:0/1817701553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776927df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 -- 172.21.15.104:0/1817701553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776520590 msgr2=0x555776901160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 --2- 172.21.15.104:0/1817701553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776520590 0x555776901160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 -- 172.21.15.104:0/1817701553 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557768deb20 con 0x555776541270 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f632b59e640 1 --2- 172.21.15.104:0/1817701553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x555776912b30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f632402b020 tx=0x7f632402fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d424cb2a269ca23c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f630bfff640 1 -- 172.21.15.104:0/1817701553 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324033040 con 0x555776541270 2024-09-17T03:06:00.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f630bfff640 1 -- 172.21.15.104:0/1817701553 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f632404d6a0 con 0x555776541270 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.168+0000 7f630bfff640 1 -- 172.21.15.104:0/1817701553 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632404dad0 con 0x555776541270 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 -- 172.21.15.104:0/1817701553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 msgr2=0x555776912b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 --2- 172.21.15.104:0/1817701553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x555776912b30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f632402b020 tx=0x7f632402fea0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 -- 172.21.15.104:0/1817701553 shutdown_connections 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 --2- 172.21.15.104:0/1817701553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776520590 0x555776901160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 --2- 172.21.15.104:0/1817701553 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776541270 0x555776912b30 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 --2- 172.21.15.104:0/1817701553 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776927df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 -- 172.21.15.104:0/1817701553 >> 172.21.15.104:0/1817701553 conn(0x5557765353c0 msgr2=0x55577693c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 -- 172.21.15.104:0/1817701553 shutdown_connections 2024-09-17T03:06:00.169 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.169+0000 7f633807f740 1 -- 172.21.15.104:0/1817701553 wait complete. 2024-09-17T03:06:00.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.170+0000 7f633807f740 1 -- start start 2024-09-17T03:06:00.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.170+0000 7f633807f740 1 Processor -- start 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f633807f740 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776994230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f633807f740 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x5557769302b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f633807f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 0x5557769a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f633807f740 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x5557769266c0 con 0x555776520590 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f633807f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555776927050 con 0x555776541270 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f633807f740 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x555776926c70 con 0x5557765183b0 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f633807f740 10 client.0 _ll_register_callbacks cb 0x7f6324045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x5557769302b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632a59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x5557769302b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37940/0 (socket says 172.21.15.104:37940) 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632a59c640 1 -- 172.21.15.104:0/2785970748 learned_addr learned my addr 172.21.15.104:0/2785970748 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632ad9d640 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776994230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632a59c640 1 -- 172.21.15.104:0/2785970748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 msgr2=0x555776994230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:06:00.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632b59e640 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 0x5557769a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632a59c640 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776994230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632a59c640 1 -- 172.21.15.104:0/2785970748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 msgr2=0x5557769a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632a59c640 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 0x5557769a22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.171+0000 7f632a59c640 1 -- 172.21.15.104:0/2785970748 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555776932060 con 0x555776520590 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f632a59c640 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x5557769302b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f6320061b40 tx=0x7f632005e360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb46407f1553b73d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f6309ffb640 10 client.0 ms_handle_connect on v2:172.21.15.104:3300/0 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f6309ffb640 1 -- 172.21.15.104:0/2785970748 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6320061e40 con 0x555776520590 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f6309ffb640 1 -- 172.21.15.104:0/2785970748 <== mon.0 v2:172.21.15.104:3300/0 2 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f6320069b60 con 0x555776520590 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 1 -- 172.21.15.104:0/2785970748 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f632404d6a0 con 0x555776520590 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f6309ffb640 1 -- 172.21.15.104:0/2785970748 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f6320066870 con 0x555776520590 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 10 client.8295 fetch_fsmap learned FSMap version 76 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 1 -- 172.21.15.104:0/2785970748 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5557768f0b40 con 0x555776520590 2024-09-17T03:06:00.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f6309ffb640 1 -- 172.21.15.104:0/2785970748 <== mon.0 v2:172.21.15.104:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f632404d6a0 con 0x555776520590 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f6309ffb640 1 -- 172.21.15.104:0/2785970748 <== mon.0 v2:172.21.15.104:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f632005d790 con 0x555776520590 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 10 client.8295 fetch_fsmap finished waiting for FSMap version 76 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 10 client.8295 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 20 client.8295 populate_metadata read hostname 'smithi104' 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] conn(0x555776925710 0x5557769271d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 4 client.8295 mds_command: new command op to 8151 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f633807f740 1 -- 172.21.15.104:0/2785970748 --> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] -- command(tid 0: {"prefix": "status"}) -- 0x555776859220 con 0x555776925710 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.172+0000 7f632ad9d640 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] conn(0x555776925710 0x5557769271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f6309ffb640 10 client.8295 ms_handle_connect on v2:172.21.15.104:6833/4053158179 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f632ad9d640 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] conn(0x555776925710 0x5557769271d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3ef6ec768ec68a server_cookie=4c057c5a48395497 in_seq=0 out_seq=0 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f6309ffb640 1 -- 172.21.15.104:0/2785970748 <== mds.0 v2:172.21.15.104:6833/4053158179 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x555776859220 con 0x555776925710 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f6309ffb640 10 client.8295 handle_command_reply: tid=0 2024-09-17T03:06:00.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 client.8295 shutdown 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 -- 172.21.15.104:0/2785970748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 msgr2=0x5557769302b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x5557769302b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f6320061b40 tx=0x7f632005e360 comp rx=0 tx=0).stop 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 -- 172.21.15.104:0/2785970748 shutdown_connections 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.104:6833/4053158179,v1:172.21.15.104:6835/4053158179] conn(0x555776925710 0x5557769271d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555776541270 0x5557769a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x555776520590 0x5557769302b0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f6309ffb640 0 client.8295 ms_handle_reset on v2:172.21.15.104:6833/4053158179 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 --2- 172.21.15.104:0/2785970748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5557765183b0 0x555776994230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 -- 172.21.15.104:0/2785970748 >> 172.21.15.104:0/2785970748 conn(0x5557765353c0 msgr2=0x55577693c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 -- 172.21.15.104:0/2785970748 shutdown_connections 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 1 -- 172.21.15.104:0/2785970748 wait complete. 2024-09-17T03:06:00.177 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.173+0000 7f633807f740 20 client.8295 trim_cache size 0 max 16384 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "whoami": 0, 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "id": 8151, 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "want_state": "up:active", 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "state": "up:active", 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "fs_name": "cephfs", 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "rank_uptime": 4.6975776910000002, 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "mdsmap_epoch": 76, 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch": 185, 2024-09-17T03:06:00.178 INFO:teuthology.orchestra.run.smithi104.stdout: "osdmap_epoch_barrier": 185, 2024-09-17T03:06:00.179 INFO:teuthology.orchestra.run.smithi104.stdout: "uptime": 9.3956555480000006 2024-09-17T03:06:00.179 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 -- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6318078b90 msgr2=0x7f631807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6318078b90 0x7f631807b0a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f631c0095f0 tx=0x7f631c005f90 comp rx=0 tx=0).stop 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 -- 172.21.15.104:0/4273589689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f632c0d13e0 msgr2=0x7f632c0cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f632c0d13e0 0x7f632c0cf750 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f632000c3a0 tx=0x7f632000c860 comp rx=0 tx=0).stop 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 -- 172.21.15.104:0/4273589689 shutdown_connections 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6318078b90 0x7f631807b0a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f632c0d3490 0x7f632c1f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f632c0d13e0 0x7f632c0cf750 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 --2- 172.21.15.104:0/4273589689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632c0d0fd0 0x7f632c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 -- 172.21.15.104:0/4273589689 >> 172.21.15.104:0/4273589689 conn(0x7f632c0d2970 msgr2=0x7f632c0b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 -- 172.21.15.104:0/4273589689 shutdown_connections 2024-09-17T03:06:00.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.174+0000 7f6331113640 1 -- 172.21.15.104:0/4273589689 wait complete. 2024-09-17T03:06:00.183 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:06:00.294 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.296+0000 7faebac20640 1 -- 172.21.15.104:0/3574228994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 msgr2=0x7faeb415bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.296+0000 7faebac20640 1 --2- 172.21.15.104:0/3574228994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 0x7faeb415bc00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7faea4005fd0 tx=0x7faea402a540 comp rx=0 tx=0).stop 2024-09-17T03:06:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.296+0000 7faebac20640 1 -- 172.21.15.104:0/3574228994 shutdown_connections 2024-09-17T03:06:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.296+0000 7faebac20640 1 --2- 172.21.15.104:0/3574228994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faeb4072f90 0x7faeb40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.296+0000 7faebac20640 1 --2- 172.21.15.104:0/3574228994 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 0x7faeb415bc00 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.296+0000 7faebac20640 1 -- 172.21.15.104:0/3574228994 >> 172.21.15.104:0/3574228994 conn(0x7faeb40b2450 msgr2=0x7faeb40b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.296+0000 7faebac20640 1 -- 172.21.15.104:0/3574228994 shutdown_connections 2024-09-17T03:06:00.295 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.296+0000 7faebac20640 1 -- 172.21.15.104:0/3574228994 wait complete. 2024-09-17T03:06:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.298+0000 7faebac20640 1 Processor -- start 2024-09-17T03:06:00.296 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.298+0000 7faebac20640 1 -- start start 2024-09-17T03:06:00.298 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faebac20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeb4072470 0x7faeb415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faebac20640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faeb4072f90 0x7faeb40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faebac20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 0x7faeb40aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faebac20640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7faeb40ceb90 con 0x7faeb415b7f0 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faebac20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faeb40cea10 con 0x7faeb4072470 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faebac20640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7faeb40ced10 con 0x7faeb4072f90 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb91bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 0x7faeb40aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb91bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 0x7faeb40aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37968/0 (socket says 172.21.15.104:37968) 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb91bd640 1 -- 172.21.15.104:0/1262244064 learned_addr learned my addr 172.21.15.104:0/1262244064 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb89bc640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeb4072470 0x7faeb415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb3fff640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faeb4072f90 0x7faeb40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb91bd640 1 -- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faeb4072f90 msgr2=0x7faeb40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb91bd640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faeb4072f90 0x7faeb40ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.299 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb91bd640 1 -- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeb4072470 msgr2=0x7faeb415e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb91bd640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeb4072470 0x7faeb415e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.299+0000 7faeb91bd640 1 -- 172.21.15.104:0/1262244064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb4150a70 con 0x7faeb415b7f0 2024-09-17T03:06:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.300+0000 7faeb91bd640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 0x7faeb40aedf0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7faeac00d690 tx=0x7faeac00db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.300+0000 7faeb17fa640 1 -- 172.21.15.104:0/1262244064 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac017070 con 0x7faeb415b7f0 2024-09-17T03:06:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.300+0000 7faeb17fa640 1 -- 172.21.15.104:0/1262244064 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeac005310 con 0x7faeb415b7f0 2024-09-17T03:06:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.300+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb415bc00 con 0x7faeb415b7f0 2024-09-17T03:06:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.300+0000 7faeb17fa640 1 -- 172.21.15.104:0/1262244064 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac009820 con 0x7faeb415b7f0 2024-09-17T03:06:00.300 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.300+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb414f020 con 0x7faeb415b7f0 2024-09-17T03:06:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.301+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb41f9ed0 con 0x7faeb415b7f0 2024-09-17T03:06:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.302+0000 7faeb17fa640 1 -- 172.21.15.104:0/1262244064 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faeac0099c0 con 0x7faeb415b7f0 2024-09-17T03:06:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.302+0000 7faeb17fa640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faea0078b90 0x7faea007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:00.301 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.302+0000 7faeb17fa640 1 -- 172.21.15.104:0/1262244064 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7faeac09ac30 con 0x7faeb415b7f0 2024-09-17T03:06:00.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.302+0000 7faeb89bc640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faea0078b90 0x7faea007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:00.302 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.303+0000 7faeb89bc640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faea0078b90 0x7faea007b0a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7faea4033000 tx=0x7faea4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:00.305 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.307+0000 7faeb17fa640 1 -- 172.21.15.104:0/1262244064 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faeac062b40 con 0x7faeb415b7f0 2024-09-17T03:06:00.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.514+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faeb415bdd0 con 0x7faeb415b7f0 2024-09-17T03:06:00.513 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.514+0000 7faeb17fa640 1 -- 172.21.15.104:0/1262244064 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) ==== 53+0+73 (secure 0 0 0) 0x7faeac067570 con 0x7faeb415b7f0 2024-09-17T03:06:00.513 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:06:00.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faea0078b90 msgr2=0x7faea007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faea0078b90 0x7faea007b0a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7faea4033000 tx=0x7faea4004730 comp rx=0 tx=0).stop 2024-09-17T03:06:00.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 msgr2=0x7faeb40aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:00.515 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 0x7faeb40aedf0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7faeac00d690 tx=0x7faeac00db50 comp rx=0 tx=0).stop 2024-09-17T03:06:00.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 shutdown_connections 2024-09-17T03:06:00.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faea0078b90 0x7faea007b0a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7faeb415b7f0 0x7faeb40aedf0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faeb4072f90 0x7faeb40ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 --2- 172.21.15.104:0/1262244064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faeb4072470 0x7faeb415e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:00.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 >> 172.21.15.104:0/1262244064 conn(0x7faeb40b2450 msgr2=0x7faeb40ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:00.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 shutdown_connections 2024-09-17T03:06:00.516 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00.517+0000 7faebac20640 1 -- 172.21.15.104:0/1262244064 wait complete. 2024-09-17T03:06:00.527 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:06:00.527 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:06:00.527 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi104.front.sepia.ceph.com 2024-09-17T03:06:00.527 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:06:00.527 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:06:00.527 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:06:00.527 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:06:00.528 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:06:00.528 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:06:00.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:00.528 DEBUG:teuthology.orchestra.run.smithi104:> ip addr 2024-09-17T03:06:00.544 INFO:teuthology.orchestra.run.smithi104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:06:00.544 INFO:teuthology.orchestra.run.smithi104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:06:00.544 INFO:teuthology.orchestra.run.smithi104.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:06:00.544 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:00.544 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 ::1/128 scope host 2024-09-17T03:06:00.545 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:00.545 INFO:teuthology.orchestra.run.smithi104.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:06:00.545 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1c brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:00.545 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f0 2024-09-17T03:06:00.545 INFO:teuthology.orchestra.run.smithi104.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:06:00.545 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:d8:a1:1d brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:00.545 INFO:teuthology.orchestra.run.smithi104.stdout: altname enp7s0f1 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:88 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 0c:c4:7a:8f:ce:89 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout: inet 172.21.15.104/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft 42138sec preferred_lft 42138sec 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::ec4:7aff:fe8f:ce89/64 scope link noprefixroute 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:00.546 INFO:teuthology.orchestra.run.smithi104.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::6060:5dff:fe98:dda2/64 scope link 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether be:af:45:5b:6e:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::bcaf:45ff:fe5b:6e85/64 scope link 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:00.547 INFO:teuthology.orchestra.run.smithi104.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:06:00.548 INFO:teuthology.orchestra.run.smithi104.stdout: link/ether 4e:69:9b:52:c6:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:06:00.548 INFO:teuthology.orchestra.run.smithi104.stdout: inet6 fe80::4c69:9bff:fe52:c6c3/64 scope link 2024-09-17T03:06:00.548 INFO:teuthology.orchestra.run.smithi104.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:00.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:00.548 DEBUG:teuthology.orchestra.run.smithi104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:06:00.608 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-17T03:06:00.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:00.610 DEBUG:teuthology.orchestra.run.smithi104:> route 2024-09-17T03:06:00.665 INFO:teuthology.orchestra.run.smithi104.stdout:Kernel IP routing table 2024-09-17T03:06:00.665 INFO:teuthology.orchestra.run.smithi104.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:06:00.666 INFO:teuthology.orchestra.run.smithi104.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:06:00.666 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:06:00.666 INFO:teuthology.orchestra.run.smithi104.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:06:00.666 DEBUG:teuthology.orchestra.run.smithi104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:06:00.666 DEBUG:teuthology.orchestra.run.smithi104:> set -e 2024-09-17T03:06:00.666 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:06:00.666 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:06:00.666 DEBUG:teuthology.orchestra.run.smithi104:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:06:00.666 DEBUG:teuthology.orchestra.run.smithi104:> ') 2024-09-17T03:06:00.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:06:00.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:06:00.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:00.791 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T03:06:00.806 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:06:00.806 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:06:00.806 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:06:00.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:00.807 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link set brx.0 up 2024-09-17T03:06:00.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:06:00.871 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:06:00.927 INFO:teuthology.orchestra.run.smithi104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:06:00.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:06:00.927 DEBUG:teuthology.orchestra.run.smithi104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:06:00.982 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:06:00.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:00.982 DEBUG:teuthology.orchestra.run.smithi104:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:06:01.077 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:06:01.077 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:06:01.077 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:06:01.088 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:06:01.088 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:06:01.088 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:06:01.088 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:06:01.088 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:06:01.093 INFO:teuthology.orchestra.run.smithi104.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:06:01.093 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:06:01.093 INFO:teuthology.orchestra.run.smithi104.stdout:invalid new device string format 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:06:01.094 INFO:teuthology.orchestra.run.smithi104.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:06:01.095 INFO:teuthology.orchestra.run.smithi104.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:06:01.096 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:06:01.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:01.096 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:06:01.121 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:06:01.210 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:06:01.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:06:01.220 INFO:teuthology.orchestra.run.smithi104.stdout:client7381 2024-09-17T03:06:01.221 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:01.221 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:01.236 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:06:01.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.389+0000 7f7a12240640 1 -- 172.21.15.104:0/73931491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0d18e0 msgr2=0x7f7a0c0d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:01.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.389+0000 7f7a12240640 1 --2- 172.21.15.104:0/73931491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0d18e0 0x7f7a0c0d34f0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c08daa0 tx=0x7f7a0402a9c0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.389+0000 7f7a12240640 1 -- 172.21.15.104:0/73931491 shutdown_connections 2024-09-17T03:06:01.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.389+0000 7f7a12240640 1 --2- 172.21.15.104:0/73931491 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0d18e0 0x7f7a0c0d34f0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.389+0000 7f7a12240640 1 --2- 172.21.15.104:0/73931491 >> v2:172.21.15.192:3300/0 conn(0x7f7a0c0b6f70 0x7f7a0c15ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.388 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.389+0000 7f7a12240640 1 -- 172.21.15.104:0/73931491 >> 172.21.15.104:0/73931491 conn(0x7f7a0c073df0 msgr2=0x7f7a0c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:01.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.389+0000 7f7a12240640 1 -- 172.21.15.104:0/73931491 shutdown_connections 2024-09-17T03:06:01.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.389+0000 7f7a12240640 1 -- 172.21.15.104:0/73931491 wait complete. 2024-09-17T03:06:01.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.391+0000 7f7a12240640 1 Processor -- start 2024-09-17T03:06:01.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.391+0000 7f7a12240640 1 -- start start 2024-09-17T03:06:01.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a12240640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a0c0b3b00 0x7f7a0c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:01.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a12240640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0b6f70 0x7f7a0c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:01.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a12240640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a0c0d18e0 0x7f7a0c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:01.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a12240640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c0d3dc0 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a12240640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c0d3c40 con 0x7f7a0c0b3b00 2024-09-17T03:06:01.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a12240640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0c0d3f40 con 0x7f7a0c0d18e0 2024-09-17T03:06:01.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0b6f70 0x7f7a0c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:01.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0b6f70 0x7f7a0c0c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:37992/0 (socket says 172.21.15.104:37992) 2024-09-17T03:06:01.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 -- 172.21.15.104:0/1071464831 learned_addr learned my addr 172.21.15.104:0/1071464831 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:01.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0bfff640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a0c0d18e0 0x7f7a0c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:01.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0b7fe640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a0c0b3b00 0x7f7a0c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 -- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a0c0d18e0 msgr2=0x7f7a0c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a0c0d18e0 0x7f7a0c0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 -- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a0c0b3b00 msgr2=0x7f7a0c158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a0c0b3b00 0x7f7a0c158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 -- 172.21.15.104:0/1071464831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c0cea20 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a0affd640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0b6f70 0x7f7a0c0c8a40 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f79f400b3e0 tx=0x7f79f400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a03fff640 1 -- 172.21.15.104:0/1071464831 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f4015020 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a03fff640 1 -- 172.21.15.104:0/1071464831 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79f4011940 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0c159080 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.393+0000 7f7a03fff640 1 -- 172.21.15.104:0/1071464831 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f4011d90 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.394 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.394+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0c159640 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.394+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0c0ce790 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.395+0000 7f7a03fff640 1 -- 172.21.15.104:0/1071464831 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79f4018020 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.396+0000 7f7a03fff640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f79ec078b90 0x7f79ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:01.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.396+0000 7f7a03fff640 1 -- 172.21.15.104:0/1071464831 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f79f409abf0 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.396+0000 7f7a0b7fe640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f79ec078b90 0x7f79ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:01.395 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.397+0000 7f7a0b7fe640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f79ec078b90 0x7f79ec07b0a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0058c0 tx=0x7f79fc005f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:01.398 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.400+0000 7f7a03fff640 1 -- 172.21.15.104:0/1071464831 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79f401f020 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.446 INFO:tasks.ceph.mds.c.smithi104.stderr:2024-09-17T03:06:01.448+0000 7f5495e1e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:06:01.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.612+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7a0c0d4430 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.610 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.612+0000 7f7a03fff640 1 -- 172.21.15.104:0/1071464831 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) ==== 53+0+73 (secure 0 0 0) 0x7f79f40629e0 con 0x7f7a0c0b6f70 2024-09-17T03:06:01.611 INFO:teuthology.orchestra.run.smithi104.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:06:01.612 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f79ec078b90 msgr2=0x7f79ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f79ec078b90 0x7f79ec07b0a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0058c0 tx=0x7f79fc005f60 comp rx=0 tx=0).stop 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0b6f70 msgr2=0x7f7a0c0c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0b6f70 0x7f7a0c0c8a40 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f79f400b3e0 tx=0x7f79f400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 shutdown_connections 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f79ec078b90 0x7f79ec07b0a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a0c0d18e0 0x7f7a0c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7a0c0b6f70 0x7f7a0c0c8a40 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 --2- 172.21.15.104:0/1071464831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a0c0b3b00 0x7f7a0c158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 >> 172.21.15.104:0/1071464831 conn(0x7f7a0c073df0 msgr2=0x7f7a0c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 shutdown_connections 2024-09-17T03:06:01.613 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:01.614+0000 7f7a12240640 1 -- 172.21.15.104:0/1071464831 wait complete. 2024-09-17T03:06:01.624 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:06:01.624 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:06:01.624 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-17T03:06:01.624 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:06:01.624 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:06:01.624 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:06:01.625 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:06:01.625 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:06:01.625 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:06:01.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:01.625 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-17T03:06:01.645 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:06:01.645 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:06:01.645 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:06:01.645 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:01.646 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42133sec preferred_lft 42133sec 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::acbf:6aff:fee4:a35b/64 scope link 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 46:e4:64:af:1c:18 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::44e4:64ff:feaf:1c18/64 scope link 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:01.647 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:06:01.648 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 32:2e:53:66:46:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:06:01.648 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::302e:53ff:fe66:4681/64 scope link 2024-09-17T03:06:01.648 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:06:01.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:01.648 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:06:01.714 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-17T03:06:01.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:01.716 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-17T03:06:01.774 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-17T03:06:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:06:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:06:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:06:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:06:01.775 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:06:01.776 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-17T03:06:01.776 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:06:01.776 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:06:01.776 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:06:01.776 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-17T03:06:01.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:06:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:06:01.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:06:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:06:01.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:01.908 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T03:06:01.924 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:06:01.924 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:06:01.925 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:06:01.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:01.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-17T03:06:01.990 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:06:01.990 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:06:02.046 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:06:02.046 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:06:02.046 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:06:02.104 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:06:02.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:02.105 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:06:02.199 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:06:02.199 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:06:02.199 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:06:02.210 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:06:02.210 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:06:02.210 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:06:02.210 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:06:02.210 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:06:02.215 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:06:02.215 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:06:02.215 INFO:teuthology.orchestra.run.smithi192.stdout:invalid new device string format 2024-09-17T03:06:02.215 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:3300,172.21.15.192:3300,172.21.15.192:3301" 2024-09-17T03:06:02.215 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:06:02.215 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790" 2024-09-17T03:06:02.215 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.104:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2024-09-17T03:06:02.215 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=5ed2cc55-4a25-471e-9183-b1048a1a073c" will pass to kernel 2024-09-17T03:06:02.216 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:06:02.216 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:06:02.216 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:06:02.216 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:06:02.216 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:06:02.217 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:06:02.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:02.218 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:06:02.248 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:06:02.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:06:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:06:02.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-17T03:06:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:06:02.343 INFO:teuthology.orchestra.run.smithi192.stdout:client7387 2024-09-17T03:06:02.344 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:06:02.344 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:02.359 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:06:02.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 -- 172.21.15.104:0/824841888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 msgr2=0x7f6f7c0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:02.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 --2- 172.21.15.104:0/824841888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 0x7f6f7c0cd800 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c073b50 tx=0x7f6f7402a980 comp rx=0 tx=0).stop 2024-09-17T03:06:02.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 -- 172.21.15.104:0/824841888 shutdown_connections 2024-09-17T03:06:02.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 --2- 172.21.15.104:0/824841888 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 0x7f6f7c0cd800 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 --2- 172.21.15.104:0/824841888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f7c0cf460 0x7f6f7c0cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.478 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 --2- 172.21.15.104:0/824841888 >> v2:172.21.15.192:3300/0 conn(0x7f6f7c0d3400 0x7f6f7c0cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 -- 172.21.15.104:0/824841888 >> 172.21.15.104:0/824841888 conn(0x7f6f7c0d28e0 msgr2=0x7f6f7c0d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:02.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 -- 172.21.15.104:0/824841888 shutdown_connections 2024-09-17T03:06:02.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.479+0000 7f6f812a4640 1 -- 172.21.15.104:0/824841888 wait complete. 2024-09-17T03:06:02.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.481+0000 7f6f812a4640 1 Processor -- start 2024-09-17T03:06:02.479 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.481+0000 7f6f812a4640 1 -- start start 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f812a4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 0x7f6f7c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f812a4640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f7c0cf460 0x7f6f7c09d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f812a4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f7c0d3400 0x7f6f7c09ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f812a4640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c0cdec0 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f812a4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c0cdd40 con 0x7f6f7c0d3400 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f812a4640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c0ce040 con 0x7f6f7c0cf460 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f7affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 0x7f6f7c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f7affd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 0x7f6f7c0ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38008/0 (socket says 172.21.15.104:38008) 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f7affd640 1 -- 172.21.15.104:0/2690715958 learned_addr learned my addr 172.21.15.104:0/2690715958 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f7a7fc640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f7c0cf460 0x7f6f7c09d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.482+0000 7f6f7b7fe640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f7c0d3400 0x7f6f7c09ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:02.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f7affd640 1 -- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f7c0cf460 msgr2=0x7f6f7c09d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f7affd640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f7c0cf460 0x7f6f7c09d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f7affd640 1 -- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f7c0d3400 msgr2=0x7f6f7c09ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f7affd640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f7c0d3400 0x7f6f7c09ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f7affd640 1 -- 172.21.15.104:0/2690715958 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c15aad0 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f7a7fc640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f7c0cf460 0x7f6f7c09d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f7affd640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 0x7f6f7c0ca3e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00d980 tx=0x7f6f6c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f637fe640 1 -- 172.21.15.104:0/2690715958 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c009c30 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f637fe640 1 -- 172.21.15.104:0/2690715958 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f6c004020 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7c09ca60 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f637fe640 1 -- 172.21.15.104:0/2690715958 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c004450 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.483+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7c0c9be0 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.484+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7c0cf870 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.485+0000 7f6f637fe640 1 -- 172.21.15.104:0/2690715958 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f6c005030 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.486+0000 7f6f637fe640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f68078bc0 0x7f6f6807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:02.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.486+0000 7f6f637fe640 1 -- 172.21.15.104:0/2690715958 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f6f6c09b170 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.486+0000 7f6f7a7fc640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f68078bc0 0x7f6f6807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:02.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.486+0000 7f6f7a7fc640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f68078bc0 0x7f6f6807b0d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0d2e60 tx=0x7f6f7000b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:02.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.490+0000 7f6f637fe640 1 -- 172.21.15.104:0/2690715958 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6f6c020020 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.698+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f7c15fda0 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.697 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.699+0000 7f6f637fe640 1 -- 172.21.15.104:0/2690715958 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7f6f6c017030 con 0x7f6f7c0cd3f0 2024-09-17T03:06:02.698 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:02.698 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:06:02.698 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f68078bc0 msgr2=0x7f6f6807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f68078bc0 0x7f6f6807b0d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0d2e60 tx=0x7f6f7000b260 comp rx=0 tx=0).stop 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 msgr2=0x7f6f7c0ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 0x7f6f7c0ca3e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00d980 tx=0x7f6f6c00de40 comp rx=0 tx=0).stop 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 shutdown_connections 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6f68078bc0 0x7f6f6807b0d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f7c0d3400 0x7f6f7c09ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f7c0cf460 0x7f6f7c09d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.700 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 --2- 172.21.15.104:0/2690715958 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6f7c0cd3f0 0x7f6f7c0ca3e0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 >> 172.21.15.104:0/2690715958 conn(0x7f6f7c0d28e0 msgr2=0x7f6f7c0b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:02.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 shutdown_connections 2024-09-17T03:06:02.701 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.701+0000 7f6f812a4640 1 -- 172.21.15.104:0/2690715958 wait complete. 2024-09-17T03:06:02.711 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T03:06:02.834 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":8151,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":7.3515771780000003,"mdsmap_epoch":76,"osdmap_epoch":185,"osdmap_epoch_barrier":185,"uptime":12.049657791} 2024-09-17T03:06:02.835 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 8151, "mdsmap_epoch": 76, "osdmap_epoch": 185, "osdmap_epoch_barrier": 185, "rank_uptime": 7.351577178, "state": "up:active", "uptime": 12.049657791, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:06:02.835 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-17T03:06:02.951 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.953+0000 7fb3fb120640 1 -- 172.21.15.104:0/4068401152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 msgr2=0x7fb3f40d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:02.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.953+0000 7fb3fb120640 1 --2- 172.21.15.104:0/4068401152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 0x7fb3f40d0c50 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40b40a0 tx=0x7fb3e802a530 comp rx=0 tx=0).stop 2024-09-17T03:06:02.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.953+0000 7fb3fb120640 1 -- 172.21.15.104:0/4068401152 shutdown_connections 2024-09-17T03:06:02.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.953+0000 7fb3fb120640 1 --2- 172.21.15.104:0/4068401152 >> v2:172.21.15.192:3300/0 conn(0x7fb3f40d2660 0x7fb3f40d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.953+0000 7fb3fb120640 1 --2- 172.21.15.104:0/4068401152 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 0x7fb3f40d0c50 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.953+0000 7fb3fb120640 1 -- 172.21.15.104:0/4068401152 >> 172.21.15.104:0/4068401152 conn(0x7fb3f409ba40 msgr2=0x7fb3f409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:02.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.953+0000 7fb3fb120640 1 -- 172.21.15.104:0/4068401152 shutdown_connections 2024-09-17T03:06:02.952 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.953+0000 7fb3fb120640 1 -- 172.21.15.104:0/4068401152 wait complete. 2024-09-17T03:06:02.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.955+0000 7fb3fb120640 1 Processor -- start 2024-09-17T03:06:02.953 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.955+0000 7fb3fb120640 1 -- start start 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3fb120640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40b3c90 0x7fb3f40b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3fb120640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 0x7fb3f415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3fb120640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f40d2660 0x7fb3f40b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3fb120640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f40cdfe0 con 0x7fb3f40d0840 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3fb120640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f40cde60 con 0x7fb3f40d2660 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3fb120640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f40ce160 con 0x7fb3f40b3c90 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3f3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 0x7fb3f415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3f3fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 0x7fb3f415ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:38034/0 (socket says 172.21.15.104:38034) 2024-09-17T03:06:02.956 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3f3fff640 1 -- 172.21.15.104:0/1797927093 learned_addr learned my addr 172.21.15.104:0/1797927093 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3f96bd640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f40d2660 0x7fb3f40b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.956+0000 7fb3f8ebc640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40b3c90 0x7fb3f40b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f3fff640 1 -- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40b3c90 msgr2=0x7fb3f40b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f3fff640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40b3c90 0x7fb3f40b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f3fff640 1 -- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f40d2660 msgr2=0x7fb3f40b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f3fff640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f40d2660 0x7fb3f40b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f3fff640 1 -- 172.21.15.104:0/1797927093 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f41f4100 con 0x7fb3f40d0840 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f3fff640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 0x7fb3f415ced0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009780 tx=0x7fb3e8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f17fa640 1 -- 172.21.15.104:0/1797927093 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8031d60 con 0x7fb3f40d0840 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f17fa640 1 -- 172.21.15.104:0/1797927093 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3e8033e10 con 0x7fb3f40d0840 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f41f43e0 con 0x7fb3f40d0840 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3f17fa640 1 -- 172.21.15.104:0/1797927093 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8005260 con 0x7fb3f40d0840 2024-09-17T03:06:02.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.957+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f41f49a0 con 0x7fb3f40d0840 2024-09-17T03:06:02.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.958+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f40ce680 con 0x7fb3f40d0840 2024-09-17T03:06:02.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.959+0000 7fb3f17fa640 1 -- 172.21.15.104:0/1797927093 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3e8005400 con 0x7fb3f40d0840 2024-09-17T03:06:02.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.959+0000 7fb3f17fa640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb3e0078b90 0x7fb3e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:02.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.959+0000 7fb3f17fa640 1 -- 172.21.15.104:0/1797927093 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fb3e80bbea0 con 0x7fb3f40d0840 2024-09-17T03:06:02.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.959+0000 7fb3f8ebc640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb3e0078b90 0x7fb3e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:02.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.960+0000 7fb3f8ebc640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb3e0078b90 0x7fb3e007b0a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40012e0 tx=0x7fb3e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:02.962 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:02.964+0000 7fb3f17fa640 1 -- 172.21.15.104:0/1797927093 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb3e803f030 con 0x7fb3f40d0840 2024-09-17T03:06:03.134 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.136+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7fb3f41e6110 con 0x7fb3f40d0840 2024-09-17T03:06:03.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.532+0000 7fb3f17fa640 1 -- 172.21.15.104:0/1797927093 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v186) ==== 181+0+0 (secure 0 0 0) 0x7fb3e8083c90 con 0x7fb3f40d0840 2024-09-17T03:06:03.533 INFO:teuthology.orchestra.run.smithi104.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-17T03:06:03.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb3e0078b90 msgr2=0x7fb3e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:03.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb3e0078b90 0x7fb3e007b0a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40012e0 tx=0x7fb3e4009040 comp rx=0 tx=0).stop 2024-09-17T03:06:03.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 msgr2=0x7fb3f415ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:03.533 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 0x7fb3f415ced0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009780 tx=0x7fb3e8033c20 comp rx=0 tx=0).stop 2024-09-17T03:06:03.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 shutdown_connections 2024-09-17T03:06:03.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb3e0078b90 0x7fb3e007b0a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:03.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3f40d2660 0x7fb3f40b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:03.534 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb3f40d0840 0x7fb3f415ced0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:03.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 --2- 172.21.15.104:0/1797927093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3f40b3c90 0x7fb3f40b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:03.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 >> 172.21.15.104:0/1797927093 conn(0x7fb3f409ba40 msgr2=0x7fb3f415ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:03.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 shutdown_connections 2024-09-17T03:06:03.535 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:03.534+0000 7fb3fb120640 1 -- 172.21.15.104:0/1797927093 wait complete. 2024-09-17T03:06:03.545 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-17T03:06:03.664 INFO:teuthology.orchestra.run.smithi104.stdout:{"osd_mon_report_interval":"5"} 2024-09-17T03:06:03.665 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-17T03:06:03.665 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-17T03:06:03.665 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:03.665 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:03.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:03.681 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-17T03:06:03.803 INFO:teuthology.orchestra.run.smithi104.stderr:16+0 records in 2024-09-17T03:06:03.803 INFO:teuthology.orchestra.run.smithi104.stderr:16+0 records out 2024-09-17T03:06:03.803 INFO:teuthology.orchestra.run.smithi104.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0626936 s, 268 MB/s 2024-09-17T03:06:03.804 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:03.804 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:03.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:03.819 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-17T03:06:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:17+0 records in 2024-09-17T03:06:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:17+0 records out 2024-09-17T03:06:03.939 INFO:teuthology.orchestra.run.smithi104.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0624613 s, 285 MB/s 2024-09-17T03:06:03.940 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-17T03:06:03.940 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:06:04.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.058+0000 7f0bc0750640 1 -- 172.21.15.104:0/1272492337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b2630 msgr2=0x7f0bb80b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:04.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.058+0000 7f0bc0750640 1 --2- 172.21.15.104:0/1272492337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b2630 0x7f0bb80b2a40 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005fd0 tx=0x7f0bb002a540 comp rx=0 tx=0).stop 2024-09-17T03:06:04.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.058+0000 7f0bc0750640 1 -- 172.21.15.104:0/1272492337 shutdown_connections 2024-09-17T03:06:04.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.058+0000 7f0bc0750640 1 --2- 172.21.15.104:0/1272492337 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b2630 0x7f0bb80b2a40 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.058+0000 7f0bc0750640 1 --2- 172.21.15.104:0/1272492337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bb80b7c80 0x7f0bb80b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.058+0000 7f0bc0750640 1 -- 172.21.15.104:0/1272492337 >> 172.21.15.104:0/1272492337 conn(0x7f0bb80d2970 msgr2=0x7f0bb80d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:04.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.058+0000 7f0bc0750640 1 -- 172.21.15.104:0/1272492337 shutdown_connections 2024-09-17T03:06:04.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.058+0000 7f0bc0750640 1 -- 172.21.15.104:0/1272492337 wait complete. 2024-09-17T03:06:04.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.060+0000 7f0bc0750640 1 Processor -- start 2024-09-17T03:06:04.058 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.060+0000 7f0bc0750640 1 -- start start 2024-09-17T03:06:04.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bc0750640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb80b2630 0x7f0bb81f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:04.061 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bc0750640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b7c80 0x7f0bb809e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bc0750640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bb80d3490 0x7f0bb80a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bc0750640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb80b6bd0 con 0x7f0bb80b7c80 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bc0750640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb80b6a50 con 0x7f0bb80b2630 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bc0750640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb80b6d50 con 0x7f0bb80d3490 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bbdceb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b7c80 0x7f0bb809e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bbdceb640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b7c80 0x7f0bb809e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53178/0 (socket says 172.21.15.104:53178) 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.061+0000 7f0bbdceb640 1 -- 172.21.15.104:0/3897772199 learned_addr learned my addr 172.21.15.104:0/3897772199 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bbe4ec640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb80b2630 0x7f0bb81f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bbeced640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bb80d3490 0x7f0bb80a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bbdceb640 1 -- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bb80d3490 msgr2=0x7f0bb80a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:04.062 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bbdceb640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bb80d3490 0x7f0bb80a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bbdceb640 1 -- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb80b2630 msgr2=0x7f0bb81f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bbdceb640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb80b2630 0x7f0bb81f3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bbdceb640 1 -- 172.21.15.104:0/3897772199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb80c8fa0 con 0x7f0bb80b7c80 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bbdceb640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b7c80 0x7f0bb809e120 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00d700 tx=0x7f0bac00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bb6ffd640 1 -- 172.21.15.104:0/3897772199 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017070 con 0x7f0bb80b7c80 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bb6ffd640 1 -- 172.21.15.104:0/3897772199 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bac009b10 con 0x7f0bb80b7c80 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb80cc470 con 0x7f0bb80b7c80 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bb6ffd640 1 -- 172.21.15.104:0/3897772199 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac010460 con 0x7f0bb80b7c80 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.062+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb80cca30 con 0x7f0bb80b7c80 2024-09-17T03:06:04.063 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.063+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb80b2a40 con 0x7f0bb80b7c80 2024-09-17T03:06:04.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.064+0000 7f0bb6ffd640 1 -- 172.21.15.104:0/3897772199 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0bac01a070 con 0x7f0bb80b7c80 2024-09-17T03:06:04.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.064+0000 7f0bb6ffd640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ba4078b90 0x7f0ba407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:04.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.064+0000 7f0bb6ffd640 1 -- 172.21.15.104:0/3897772199 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5709+0+0 (secure 0 0 0) 0x7f0bac09ae00 con 0x7f0bb80b7c80 2024-09-17T03:06:04.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.064+0000 7f0bbe4ec640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ba4078b90 0x7f0ba407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:04.064 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.065+0000 7f0bbe4ec640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ba4078b90 0x7f0ba407b0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8001e20 tx=0x7f0ba8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:04.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.069+0000 7f0bb6ffd640 1 -- 172.21.15.104:0/3897772199 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0bac062bf0 con 0x7f0bb80b7c80 2024-09-17T03:06:04.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.242+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f0bb80d0900 con 0x7f0bb80b7c80 2024-09-17T03:06:04.242 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.244+0000 7f0bb6ffd640 1 -- 172.21.15.104:0/3897772199 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v186) ==== 81+0+34318 (secure 0 0 0) 0x7f0bac067620 con 0x7f0bb80b7c80 2024-09-17T03:06:04.243 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:04.243 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:04.243 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 186, 2024-09-17T03:06:04.243 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:06:03.527107+0000", 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:06:04.244 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 23, 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:06:04.245 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:04.246 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:06:04.247 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:06:04.248 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:04.249 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:04.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:06:04.252 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 22, 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:52.471547+0000", 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:04.254 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:04.255 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "184", 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:04.256 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:04.257 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:04.258 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:04.259 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 23, 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:06:04.260 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:53.802461+0000", 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:04.261 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.262 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "186", 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:04.263 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:04.264 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:04.265 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:04.266 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:04.267 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:04.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.269 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.270 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.271 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:06:04.272 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:04.273 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.274 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.275 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:04.277 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.278 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:04.279 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.280 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.284 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:04.286 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.287 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:04.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:04.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:04.292 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.293 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.294 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:04.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:04.298 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:04.299 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.300 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:04.303 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.304 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.305 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:06:04.305 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:04.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.305 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.305 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:06:04.305 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:04.305 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:04.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:04.309 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:04.310 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:04.312 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:04.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:04.314 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.315 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:04.317 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:04.318 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:06:04.319 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:04.321 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:06:04.322 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:06:04.323 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:04.324 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ba4078b90 msgr2=0x7f0ba407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ba4078b90 0x7f0ba407b0a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8001e20 tx=0x7f0ba8009040 comp rx=0 tx=0).stop 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b7c80 msgr2=0x7f0bb809e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b7c80 0x7f0bb809e120 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00d700 tx=0x7f0bac00dbc0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 shutdown_connections 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0ba4078b90 0x7f0ba407b0a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bb80d3490 0x7f0bb80a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0bb80b7c80 0x7f0bb809e120 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.326 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 --2- 172.21.15.104:0/3897772199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb80b2630 0x7f0bb81f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 >> 172.21.15.104:0/3897772199 conn(0x7f0bb80d2970 msgr2=0x7f0bb80b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 shutdown_connections 2024-09-17T03:06:04.327 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:04.246+0000 7f0bc0750640 1 -- 172.21.15.104:0/3897772199 wait complete. 2024-09-17T03:06:04.327 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T03:06:07.679 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:06:07.682 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:06:09.328 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:06:09.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.456+0000 7f0189acc640 1 -- 172.21.15.104:0/1971406158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 msgr2=0x7f01700051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.456+0000 7f0189acc640 1 --2- 172.21.15.104:0/1971406158 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 0x7f01700051f0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f017c005fd0 tx=0x7f0170005830 comp rx=0 tx=0).stop 2024-09-17T03:06:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.456+0000 7f0183fff640 1 -- 172.21.15.104:0/1971406158 reap_dead start 2024-09-17T03:06:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.456+0000 7f0189acc640 1 -- 172.21.15.104:0/1971406158 shutdown_connections 2024-09-17T03:06:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.456+0000 7f0189acc640 1 -- 172.21.15.104:0/1971406158 >> 172.21.15.104:0/1971406158 conn(0x7f0184069120 msgr2=0x7f0184069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.456+0000 7f0189acc640 1 -- 172.21.15.104:0/1971406158 shutdown_connections 2024-09-17T03:06:09.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.456+0000 7f0189acc640 1 -- 172.21.15.104:0/1971406158 wait complete. 2024-09-17T03:06:09.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.458+0000 7f0189acc640 1 Processor -- start 2024-09-17T03:06:09.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.458+0000 7f0189acc640 1 -- start start 2024-09-17T03:06:09.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f0189acc640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 0x7f018414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:09.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f0189acc640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0184069690 0x7f0184150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:09.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f0189acc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0184151480 0x7f01841587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:09.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f0189acc640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0184168100 con 0x7f0170004d40 2024-09-17T03:06:09.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f0189acc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f01841626f0 con 0x7f0184151480 2024-09-17T03:06:09.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f0189acc640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0184168280 con 0x7f0184069690 2024-09-17T03:06:09.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 0x7f018414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:09.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 0x7f018414c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53194/0 (socket says 172.21.15.104:53194) 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 -- 172.21.15.104:0/1367537687 learned_addr learned my addr 172.21.15.104:0/1367537687 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 -- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0184069690 msgr2=0x7f0184150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0184069690 0x7f0184150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 -- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0184151480 msgr2=0x7f01841587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0184151480 0x7f01841587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 -- 172.21.15.104:0/1367537687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0184151890 con 0x7f0170004d40 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.459+0000 7f01837fe640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 0x7f018414c430 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0174004e50 tx=0x7f0174001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.460+0000 7f0180ff9640 1 -- 172.21.15.104:0/1367537687 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01740107d0 con 0x7f0170004d40 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.460+0000 7f0180ff9640 1 -- 172.21.15.104:0/1367537687 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0174016070 con 0x7f0170004d40 2024-09-17T03:06:09.464 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.460+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018414cdd0 con 0x7f0170004d40 2024-09-17T03:06:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.460+0000 7f0180ff9640 1 -- 172.21.15.104:0/1367537687 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174010c60 con 0x7f0170004d40 2024-09-17T03:06:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.460+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0184158280 con 0x7f0170004d40 2024-09-17T03:06:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.461+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01841534b0 con 0x7f0170004d40 2024-09-17T03:06:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.462+0000 7f0180ff9640 1 -- 172.21.15.104:0/1367537687 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f017401b460 con 0x7f0170004d40 2024-09-17T03:06:09.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.462+0000 7f0180ff9640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0164078bc0 0x7f016407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.462+0000 7f0180ff9640 1 -- 172.21.15.104:0/1367537687 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f017409b540 con 0x7f0170004d40 2024-09-17T03:06:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.462+0000 7f017bfff640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0164078bc0 0x7f016407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.463+0000 7f0180ff9640 1 -- 172.21.15.104:0/1367537687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=188}) -- 0x7f01640807a0 con 0x7f0170004d40 2024-09-17T03:06:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.463+0000 7f017bfff640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0164078bc0 0x7f016407b0d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f016c000f60 tx=0x7f016c000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:09.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.467+0000 7f0180ff9640 1 -- 172.21.15.104:0/1367537687 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0184151890 con 0x7f0170004d40 2024-09-17T03:06:09.641 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.642+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f018415f600 con 0x7f0170004d40 2024-09-17T03:06:09.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.643+0000 7f0180ff9640 1 -- 172.21.15.104:0/1367537687 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) ==== 81+0+34337 (secure 0 0 0) 0x7f0174063980 con 0x7f0170004d40 2024-09-17T03:06:09.643 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:09.643 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:09.643 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 187, 2024-09-17T03:06:09.643 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:06:09.643 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:06:09.643 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:06:08.202177+0000", 2024-09-17T03:06:09.643 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:06:09.644 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 23, 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:06:09.645 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:09.646 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:06:09.647 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:09.648 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:09.648 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:09.648 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:09.648 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:09.648 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:09.649 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:09.649 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:09.649 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:09.649 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:09.649 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:09.649 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:09.649 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:09.650 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:09.651 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:09.652 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 22, 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:52.471547+0000", 2024-09-17T03:06:09.653 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:09.654 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:09.655 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "184", 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:09.656 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:09.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:09.658 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:06:09.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:09.660 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 23, 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:53.802461+0000", 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1027, 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:09.661 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:09.662 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "187", 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:09.663 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:09.664 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:09.665 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:06:09.666 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.667 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:09.668 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:06:09.669 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:06:09.670 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:06:09.671 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.672 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:06:09.673 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:09.674 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.675 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:09.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.678 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.679 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:06:09.679 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:09.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.679 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.679 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:06:09.679 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:09.679 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.680 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.682 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.683 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:06:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:09.686 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:09.687 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:09.688 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:06:09.689 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.690 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.691 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:09.693 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.695 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:09.696 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:09.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.698 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:09.701 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.702 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.703 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:09.704 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:06:09.705 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:06:09.706 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.707 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.708 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:06:09.709 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:06:09.710 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:09.711 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.713 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.714 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.715 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:09.717 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:06:09.718 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:09.719 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:09.720 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:06:09.721 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:09.722 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:09.723 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:06:09.724 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:06:09.725 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:06:09.726 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:06:09.726 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:06:09.726 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:06:09.726 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:06:09.726 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:09.726 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0164078bc0 msgr2=0x7f016407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0164078bc0 0x7f016407b0d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f016c000f60 tx=0x7f016c000ed0 comp rx=0 tx=0).stop 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 msgr2=0x7f018414c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 0x7f018414c430 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f0174004e50 tx=0x7f0174001630 comp rx=0 tx=0).stop 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 shutdown_connections 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0164078bc0 0x7f016407b0d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0184151480 0x7f01841587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0184069690 0x7f0184150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 --2- 172.21.15.104:0/1367537687 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0170004d40 0x7f018414c430 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:09.728 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 >> 172.21.15.104:0/1367537687 conn(0x7f0184069120 msgr2=0x7f01840d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 shutdown_connections 2024-09-17T03:06:09.729 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:09.645+0000 7f0189acc640 1 -- 172.21.15.104:0/1367537687 wait complete. 2024-09-17T03:06:09.729 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T03:06:09.729 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:09.730 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:09.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:09.747 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-17T03:06:09.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:06:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-17T03:06:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records in 2024-09-17T03:06:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records out 2024-09-17T03:06:09.946 INFO:teuthology.orchestra.run.smithi104.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.141253 s, 371 MB/s 2024-09-17T03:06:09.947 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:06:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.066+0000 7febb0b9b640 1 -- 172.21.15.104:0/1190179237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb98004800 msgr2=0x7feb98004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.066+0000 7febb0b9b640 1 --2- 172.21.15.104:0/1190179237 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7feb98004800 0x7feb98004c10 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c710 tx=0x7feb98005830 comp rx=0 tx=0).stop 2024-09-17T03:06:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.066+0000 7febaad9d640 1 -- 172.21.15.104:0/1190179237 reap_dead start 2024-09-17T03:06:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.066+0000 7febb0b9b640 1 -- 172.21.15.104:0/1190179237 shutdown_connections 2024-09-17T03:06:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.066+0000 7febb0b9b640 1 -- 172.21.15.104:0/1190179237 >> 172.21.15.104:0/1190179237 conn(0x7febac0d28a0 msgr2=0x7febac0d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.066+0000 7febb0b9b640 1 -- 172.21.15.104:0/1190179237 shutdown_connections 2024-09-17T03:06:10.066 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.066+0000 7febb0b9b640 1 -- 172.21.15.104:0/1190179237 wait complete. 2024-09-17T03:06:10.067 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.068+0000 7febb0b9b640 1 Processor -- start 2024-09-17T03:06:10.068 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.068+0000 7febb0b9b640 1 -- start start 2024-09-17T03:06:10.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febb0b9b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb98004800 0x7febac0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:10.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febb0b9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febac0719f0 0x7febac1f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:10.070 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febb0b9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febac1f3b90 0x7febac1d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febb0b9b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7febac0cf5d0 con 0x7febac1f3b90 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febb0b9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7febac0b35e0 con 0x7febac0719f0 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febb0b9b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7febac0cf750 con 0x7feb98004800 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febac1f3b90 0x7febac1d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febac1f3b90 0x7febac1d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53212/0 (socket says 172.21.15.104:53212) 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 -- 172.21.15.104:0/3289011376 learned_addr learned my addr 172.21.15.104:0/3289011376 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7feba1d9b640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febac0719f0 0x7febac1f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaa59c640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb98004800 0x7febac0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 -- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb98004800 msgr2=0x7febac0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb98004800 0x7febac0714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 -- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febac0719f0 msgr2=0x7febac1f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febac0719f0 0x7febac1f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.071 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 -- 172.21.15.104:0/3289011376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac1d3180 con 0x7febac1f3b90 2024-09-17T03:06:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaa59c640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb98004800 0x7febac0714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7feba1d9b640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febac0719f0 0x7febac1f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febaad9d640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febac1f3b90 0x7febac1d00f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7febac0d2110 tx=0x7feba4010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7feba37fe640 1 -- 172.21.15.104:0/3289011376 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba400ec70 con 0x7febac1f3b90 2024-09-17T03:06:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7feba37fe640 1 -- 172.21.15.104:0/3289011376 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feba400ee30 con 0x7febac1f3b90 2024-09-17T03:06:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febac1d3460 con 0x7febac1f3b90 2024-09-17T03:06:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.070+0000 7feba37fe640 1 -- 172.21.15.104:0/3289011376 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4004d60 con 0x7febac1f3b90 2024-09-17T03:06:10.072 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.071+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febac1d3a20 con 0x7febac1f3b90 2024-09-17T03:06:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.071+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febac0cfce0 con 0x7febac1f3b90 2024-09-17T03:06:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.072+0000 7feba37fe640 1 -- 172.21.15.104:0/3289011376 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feba401c020 con 0x7febac1f3b90 2024-09-17T03:06:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.073+0000 7feba37fe640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb8c078b90 0x7feb8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.073+0000 7feba37fe640 1 -- 172.21.15.104:0/3289011376 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7feba409b020 con 0x7febac1f3b90 2024-09-17T03:06:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.073+0000 7feba37fe640 1 -- 172.21.15.104:0/3289011376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=188}) -- 0x7feb8c080710 con 0x7febac1f3b90 2024-09-17T03:06:10.073 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.073+0000 7febaa59c640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb8c078b90 0x7feb8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:10.074 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.073+0000 7febaa59c640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb8c078b90 0x7feb8c07b0a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7feb9c006be0 tx=0x7feb9c006770 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:10.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.077+0000 7feba37fe640 1 -- 172.21.15.104:0/3289011376 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feba4063460 con 0x7febac1f3b90 2024-09-17T03:06:10.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.250+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7febac0d0b20 con 0x7febac1f3b90 2024-09-17T03:06:10.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.251+0000 7feba37fe640 1 -- 172.21.15.104:0/3289011376 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) ==== 81+0+34337 (secure 0 0 0) 0x7feba4062d60 con 0x7febac1f3b90 2024-09-17T03:06:10.251 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:10.251 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:10.251 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 187, 2024-09-17T03:06:10.251 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:06:10.251 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:06:10.251 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:06:08.202177+0000", 2024-09-17T03:06:10.251 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:06:10.252 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 23, 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:06:10.253 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:10.254 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:10.255 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:10.256 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:10.257 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:10.257 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:10.257 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:10.258 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:10.259 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:10.260 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.261 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 22, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:52.471547+0000", 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:10.262 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:10.263 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "184", 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:10.264 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:10.265 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:10.266 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:06:10.267 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:10.268 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 23, 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:53.802461+0000", 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1027, 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:10.269 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:06:10.270 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:06:10.271 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:10.271 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:10.271 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "187", 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:10.272 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:10.273 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:10.274 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.275 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.276 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:10.277 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.278 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:10.279 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:06:10.280 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:06:10.282 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:10.283 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:10.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.285 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.285 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:06:10.285 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:10.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.288 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.288 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:10.289 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.290 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.290 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:10.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:10.291 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.292 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:10.293 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.297 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:06:10.298 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.299 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:10.300 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.301 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.303 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:10.304 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.305 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:10.306 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.307 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.308 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:10.309 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:06:10.310 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.311 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:10.312 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:10.313 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:10.314 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:10.315 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.316 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:10.317 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.318 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.319 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.320 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.321 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.322 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:10.323 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.324 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.325 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.326 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:10.327 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:06:10.328 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:10.329 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:10.330 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.331 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:10.332 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:10.333 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:06:10.334 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.335 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:06:10.336 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:06:10.337 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:06:10.338 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:10.338 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb8c078b90 msgr2=0x7feb8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb8c078b90 0x7feb8c07b0a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7feb9c006be0 tx=0x7feb9c006770 comp rx=0 tx=0).stop 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febac1f3b90 msgr2=0x7febac1d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febac1f3b90 0x7febac1d00f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7febac0d2110 tx=0x7feba4010f00 comp rx=0 tx=0).stop 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 shutdown_connections 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7feb8c078b90 0x7feb8c07b0a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febac0719f0 0x7febac1f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7febac1f3b90 0x7febac1d00f0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 --2- 172.21.15.104:0/3289011376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb98004800 0x7febac0714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 >> 172.21.15.104:0/3289011376 conn(0x7febac0d28a0 msgr2=0x7febac1e4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 shutdown_connections 2024-09-17T03:06:10.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.253+0000 7febb0b9b640 1 -- 172.21.15.104:0/3289011376 wait complete. 2024-09-17T03:06:10.341 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:06:10.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.455+0000 7fa8b45e6640 1 -- 172.21.15.104:0/15567394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8ac15f1f0 msgr2=0x7fa8ac15f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.455+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/15567394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8ac15f1f0 0x7fa8ac15f600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009830 tx=0x7fa89c02a480 comp rx=0 tx=0).stop 2024-09-17T03:06:10.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.455+0000 7fa8b45e6640 1 -- 172.21.15.104:0/15567394 shutdown_connections 2024-09-17T03:06:10.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.455+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/15567394 >> v2:172.21.15.192:3300/0 conn(0x7fa8ac15fb40 0x7fa8ac161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.455+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/15567394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8ac15f1f0 0x7fa8ac15f600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.455+0000 7fa8b45e6640 1 -- 172.21.15.104:0/15567394 >> 172.21.15.104:0/15567394 conn(0x7fa8ac069120 msgr2=0x7fa8ac069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:10.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.455+0000 7fa8b45e6640 1 -- 172.21.15.104:0/15567394 shutdown_connections 2024-09-17T03:06:10.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.455+0000 7fa8b45e6640 1 -- 172.21.15.104:0/15567394 wait complete. 2024-09-17T03:06:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.457+0000 7fa8b45e6640 1 Processor -- start 2024-09-17T03:06:10.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.457+0000 7fa8b45e6640 1 -- start start 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b45e6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8ac0b65e0 0x7fa8ac0ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b45e6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8ac15f1f0 0x7fa8ac0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b45e6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8ac15fb40 0x7fa8ac0c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b45e6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac161d60 con 0x7fa8ac15fb40 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b45e6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ac161be0 con 0x7fa8ac15f1f0 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b45e6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ac161ee0 con 0x7fa8ac0b65e0 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b2b83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8ac15fb40 0x7fa8ac0c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b2b83640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8ac15fb40 0x7fa8ac0c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53218/0 (socket says 172.21.15.104:53218) 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b2b83640 1 -- 172.21.15.104:0/2066565492 learned_addr learned my addr 172.21.15.104:0/2066565492 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b1b81640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8ac15f1f0 0x7fa8ac0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:10.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.458+0000 7fa8b2382640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8ac0b65e0 0x7fa8ac0ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8b2b83640 1 -- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8ac0b65e0 msgr2=0x7fa8ac0ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8b2b83640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8ac0b65e0 0x7fa8ac0ac200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8b2b83640 1 -- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8ac15f1f0 msgr2=0x7fa8ac0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8b2b83640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8ac15f1f0 0x7fa8ac0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8b2b83640 1 -- 172.21.15.104:0/2066565492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ac0ab4b0 con 0x7fa8ac15fb40 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8b2b83640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8ac15fb40 0x7fa8ac0c9850 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400ebf0 tx=0x7fa8a400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8a2ffd640 1 -- 172.21.15.104:0/2066565492 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4003b70 con 0x7fa8ac15fb40 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8a2ffd640 1 -- 172.21.15.104:0/2066565492 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8a4003d10 con 0x7fa8ac15fb40 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ac0ab720 con 0x7fa8ac15fb40 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8a2ffd640 1 -- 172.21.15.104:0/2066565492 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4004280 con 0x7fa8ac15fb40 2024-09-17T03:06:10.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.459+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ac0abce0 con 0x7fa8ac15fb40 2024-09-17T03:06:10.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.460+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ac1f68d0 con 0x7fa8ac15fb40 2024-09-17T03:06:10.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.461+0000 7fa8a2ffd640 1 -- 172.21.15.104:0/2066565492 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8a4004420 con 0x7fa8ac15fb40 2024-09-17T03:06:10.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.461+0000 7fa8a2ffd640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa890078b90 0x7fa89007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:10.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.461+0000 7fa8a2ffd640 1 -- 172.21.15.104:0/2066565492 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7fa8a409b8b0 con 0x7fa8ac15fb40 2024-09-17T03:06:10.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.462+0000 7fa8a2ffd640 1 -- 172.21.15.104:0/2066565492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=188}) -- 0x7fa890080770 con 0x7fa8ac15fb40 2024-09-17T03:06:10.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.462+0000 7fa8b2382640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa890078b90 0x7fa89007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:10.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.462+0000 7fa8b2382640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa890078b90 0x7fa89007b0a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8007fd0 tx=0x7fa8a8001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:10.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.466+0000 7fa8a2ffd640 1 -- 172.21.15.104:0/2066565492 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa8a40636a0 con 0x7fa8ac15fb40 2024-09-17T03:06:10.676 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.676+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8ac0d1f80 con 0x7fa8ac15fb40 2024-09-17T03:06:10.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.677+0000 7fa8a2ffd640 1 -- 172.21.15.104:0/2066565492 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7fa8a40680d0 con 0x7fa8ac15fb40 2024-09-17T03:06:10.677 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:10.677 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:06:10.677 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa890078b90 msgr2=0x7fa89007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa890078b90 0x7fa89007b0a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8007fd0 tx=0x7fa8a8001370 comp rx=0 tx=0).stop 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8ac15fb40 msgr2=0x7fa8ac0c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8ac15fb40 0x7fa8ac0c9850 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400ebf0 tx=0x7fa8a400c6a0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 shutdown_connections 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fa890078b90 0x7fa89007b0a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8ac15f1f0 0x7fa8ac0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fa8ac15fb40 0x7fa8ac0c9850 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 --2- 172.21.15.104:0/2066565492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa8ac0b65e0 0x7fa8ac0ac200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:10.679 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 >> 172.21.15.104:0/2066565492 conn(0x7fa8ac069120 msgr2=0x7fa8ac069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:10.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 shutdown_connections 2024-09-17T03:06:10.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:10.679+0000 7fa8b45e6640 1 -- 172.21.15.104:0/2066565492 wait complete. 2024-09-17T03:06:10.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T03:06:10.814 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":8151,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":15.331754607000001,"mdsmap_epoch":76,"osdmap_epoch":187,"osdmap_epoch_barrier":187,"uptime":20.029834566000002} 2024-09-17T03:06:10.815 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 8151, "mdsmap_epoch": 76, "osdmap_epoch": 187, "osdmap_epoch_barrier": 187, "rank_uptime": 15.331754607, "state": "up:active", "uptime": 20.029834566, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:06:10.815 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:06:10.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:10.815 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-17T03:06:10.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:10.832 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-17T03:06:10.896 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:06:11.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.049+0000 7f64d02f9640 1 -- 172.21.15.104:0/2858088973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64b4003a50 msgr2=0x7f64b4003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:11.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.049+0000 7f64d02f9640 1 --2- 172.21.15.104:0/2858088973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64b4003a50 0x7f64b4003ee0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f64c40016c0 tx=0x7f64b4005830 comp rx=0 tx=0).stop 2024-09-17T03:06:11.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.050+0000 7f64d02f9640 1 -- 172.21.15.104:0/2858088973 shutdown_connections 2024-09-17T03:06:11.049 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.050+0000 7f64d02f9640 1 --2- 172.21.15.104:0/2858088973 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64b4003a50 0x7f64b4003ee0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:11.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.050+0000 7f64d02f9640 1 -- 172.21.15.104:0/2858088973 >> 172.21.15.104:0/2858088973 conn(0x7f64c80b44a0 msgr2=0x7f64c80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:11.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.050+0000 7f64d02f9640 1 -- 172.21.15.104:0/2858088973 shutdown_connections 2024-09-17T03:06:11.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.050+0000 7f64d02f9640 1 -- 172.21.15.104:0/2858088973 wait complete. 2024-09-17T03:06:11.050 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.051+0000 7f64d02f9640 1 Processor -- start 2024-09-17T03:06:11.051 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.051+0000 7f64d02f9640 1 -- start start 2024-09-17T03:06:11.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64d02f9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64b4003a50 0x7f64c80cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:11.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64d02f9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c81f4900 0x7f64c81f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:11.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64d02f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c81f79b0 0x7f64c81f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:11.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64d02f9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80d01b0 con 0x7f64c81f4900 2024-09-17T03:06:11.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64d02f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80b39c0 con 0x7f64c81f79b0 2024-09-17T03:06:11.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64d02f9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f64c80cb8c0 con 0x7f64b4003a50 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c81f4900 0x7f64c81f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c81f4900 0x7f64c81f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:53230/0 (socket says 172.21.15.104:53230) 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 -- 172.21.15.104:0/2231065124 learned_addr learned my addr 172.21.15.104:0/2231065124 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 -- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64b4003a50 msgr2=0x7f64c80cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64b4003a50 0x7f64c80cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 -- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c81f79b0 msgr2=0x7f64c81f0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c81f79b0 0x7f64c81f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 -- 172.21.15.104:0/2231065124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c81f7dc0 con 0x7f64c81f4900 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64cd894640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c81f4900 0x7f64c81f7470 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f64b80066b0 tx=0x7f64b80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64beffd640 1 -- 172.21.15.104:0/2231065124 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8015070 con 0x7f64c81f4900 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64beffd640 1 -- 172.21.15.104:0/2231065124 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64b8011900 con 0x7f64c81f4900 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c815fa30 con 0x7f64c81f4900 2024-09-17T03:06:11.054 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64beffd640 1 -- 172.21.15.104:0/2231065124 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8011d30 con 0x7f64c81f4900 2024-09-17T03:06:11.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.053+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c815fff0 con 0x7f64c81f4900 2024-09-17T03:06:11.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.054+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c80b3f20 con 0x7f64c81f4900 2024-09-17T03:06:11.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.055+0000 7f64beffd640 1 -- 172.21.15.104:0/2231065124 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f64b8018070 con 0x7f64c81f4900 2024-09-17T03:06:11.055 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.056+0000 7f64beffd640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f64ac078b90 0x7f64ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:11.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.056+0000 7f64beffd640 1 -- 172.21.15.104:0/2231065124 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5709+0+0 (secure 0 0 0) 0x7f64b809ba20 con 0x7f64c81f4900 2024-09-17T03:06:11.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.056+0000 7f64beffd640 1 -- 172.21.15.104:0/2231065124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=188}) -- 0x7f64ac080770 con 0x7f64c81f4900 2024-09-17T03:06:11.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.056+0000 7f64ce095640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f64ac078b90 0x7f64ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:11.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.057+0000 7f64ce095640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f64ac078b90 0x7f64ac07b0a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f64c4032000 tx=0x7f64c4001120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:11.059 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.060+0000 7f64beffd640 1 -- 172.21.15.104:0/2231065124 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f64c81f7dc0 con 0x7f64c81f4900 2024-09-17T03:06:11.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.234+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f64c806af40 con 0x7f64c81f4900 2024-09-17T03:06:11.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.235+0000 7f64beffd640 1 -- 172.21.15.104:0/2231065124 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) ==== 81+0+34337 (secure 0 0 0) 0x7f64b8063f00 con 0x7f64c81f4900 2024-09-17T03:06:11.235 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 187, 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:06:08.202177+0000", 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:06:11.236 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:06:11.237 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 23, 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:11.238 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:06:11.239 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:11.240 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:11.241 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.242 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:06:11.243 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:11.244 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 22, 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:52.471547+0000", 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:11.245 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:11.246 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "184", 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:11.247 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:11.248 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:11.249 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:06:11.250 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:11.251 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 23, 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:53.802461+0000", 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1027, 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:11.252 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:11.253 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "187", 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:11.254 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:11.255 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:11.256 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:11.257 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:11.257 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:11.257 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:11.257 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:11.257 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:11.257 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.258 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.259 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:11.260 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.261 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.262 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.263 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.264 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.265 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.265 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:06:11.265 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:11.265 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.265 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.265 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.265 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.266 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:11.267 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.268 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.269 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:06:11.270 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.271 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:06:11.272 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:11.273 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.274 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.275 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.276 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:11.277 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:06:11.278 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:11.279 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.280 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.281 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.282 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.283 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.283 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:06:11.283 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.284 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.285 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:06:11.285 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:11.285 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.285 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.285 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.285 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:06:11.285 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:11.285 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.286 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:11.287 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.288 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.289 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:11.290 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.291 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.292 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:11.293 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.294 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.295 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:11.296 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.297 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.298 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:11.299 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:11.300 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:11.301 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:06:11.302 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.303 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.304 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:11.305 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:11.306 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:06:11.307 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:11.308 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.308 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.308 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.308 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:11.308 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.308 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.308 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.309 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.310 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.311 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:11.312 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:06:11.313 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:06:11.314 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:06:11.316 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:11.317 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:11.318 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:06:11.319 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:06:11.320 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:06:11.321 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:06:11.321 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:06:11.321 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:06:11.321 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:06:11.321 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:06:11.321 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:11.321 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f64ac078b90 msgr2=0x7f64ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f64ac078b90 0x7f64ac07b0a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f64c4032000 tx=0x7f64c4001120 comp rx=0 tx=0).stop 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c81f4900 msgr2=0x7f64c81f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c81f4900 0x7f64c81f7470 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f64b80066b0 tx=0x7f64b80039c0 comp rx=0 tx=0).stop 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 shutdown_connections 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f64ac078b90 0x7f64ac07b0a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c81f79b0 0x7f64c81f0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f64c81f4900 0x7f64c81f7470 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 --2- 172.21.15.104:0/2231065124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f64b4003a50 0x7f64c80cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:11.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 >> 172.21.15.104:0/2231065124 conn(0x7f64c80b44a0 msgr2=0x7f64c8070740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:11.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 shutdown_connections 2024-09-17T03:06:11.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:11.238+0000 7f64d02f9640 1 -- 172.21.15.104:0/2231065124 wait complete. 2024-09-17T03:06:11.324 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-17T03:06:16.325 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:06:16.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.453+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/1841085917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806d410 msgr2=0x7f0c0806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:16.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.453+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/1841085917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806d410 0x7f0c0806d820 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f0c08075010 tx=0x7f0bf802a560 comp rx=0 tx=0).stop 2024-09-17T03:06:16.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.453+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/1841085917 shutdown_connections 2024-09-17T03:06:16.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.453+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/1841085917 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806d410 0x7f0c0806d820 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.453+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/1841085917 >> v2:172.21.15.192:3300/0 conn(0x7f0c0806cde0 0x7f0c080b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.453+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/1841085917 >> 172.21.15.104:0/1841085917 conn(0x7f0c080d2970 msgr2=0x7f0c080d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:16.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.453+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/1841085917 shutdown_connections 2024-09-17T03:06:16.453 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.453+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/1841085917 wait complete. 2024-09-17T03:06:16.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.455+0000 7f0c0f4d3640 1 Processor -- start 2024-09-17T03:06:16.454 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.455+0000 7f0c0f4d3640 1 -- start start 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0f4d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806cde0 0x7f0c08168e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0f4d3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c0806d410 0x7f0c08151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0f4d3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c080cf380 0x7f0c081673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0f4d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0c080d3680 con 0x7f0c0806cde0 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0f4d3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c080d00b0 con 0x7f0c080cf380 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0f4d3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0c08169660 con 0x7f0c0806d410 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0d26f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806cde0 0x7f0c08168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0d26f640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806cde0 0x7f0c08168e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60152/0 (socket says 172.21.15.104:60152) 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0d26f640 1 -- 172.21.15.104:0/412026228 learned_addr learned my addr 172.21.15.104:0/412026228 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:16.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0ca6e640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c0806d410 0x7f0c08151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0da70640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c080cf380 0x7f0c081673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0d26f640 1 -- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c0806d410 msgr2=0x7f0c08151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0d26f640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c0806d410 0x7f0c08151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0d26f640 1 -- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c080cf380 msgr2=0x7f0c081673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0d26f640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c080cf380 0x7f0c081673e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.456+0000 7f0c0d26f640 1 -- 172.21.15.104:0/412026228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c080b0ef0 con 0x7f0c0806cde0 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.457+0000 7f0c0d26f640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806cde0 0x7f0c08168e50 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400b410 tx=0x7f0c0400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.457+0000 7f0bfdffb640 1 -- 172.21.15.104:0/412026228 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04015020 con 0x7f0c0806cde0 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.457+0000 7f0bfdffb640 1 -- 172.21.15.104:0/412026228 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c04011940 con 0x7f0c0806cde0 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.457+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c080b0130 con 0x7f0c0806cde0 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.457+0000 7f0bfdffb640 1 -- 172.21.15.104:0/412026228 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011d90 con 0x7f0c0806cde0 2024-09-17T03:06:16.458 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.457+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c080b06f0 con 0x7f0c0806cde0 2024-09-17T03:06:16.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.458+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0806d820 con 0x7f0c0806cde0 2024-09-17T03:06:16.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.459+0000 7f0bfdffb640 1 -- 172.21.15.104:0/412026228 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c04018020 con 0x7f0c0806cde0 2024-09-17T03:06:16.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.459+0000 7f0bfdffb640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bec078b90 0x7f0bec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:16.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.460+0000 7f0bfdffb640 1 -- 172.21.15.104:0/412026228 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f0c0409acd0 con 0x7f0c0806cde0 2024-09-17T03:06:16.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.460+0000 7f0c0ca6e640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bec078b90 0x7f0bec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:16.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.460+0000 7f0c0ca6e640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bec078b90 0x7f0bec07b0a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8033000 tx=0x7f0bf8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:16.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.464+0000 7f0bfdffb640 1 -- 172.21.15.104:0/412026228 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c0401f020 con 0x7f0c0806cde0 2024-09-17T03:06:16.642 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.643+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f0c08166a10 con 0x7f0c0806cde0 2024-09-17T03:06:16.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.644+0000 7f0bfdffb640 1 -- 172.21.15.104:0/412026228 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) ==== 81+0+34318 (secure 0 0 0) 0x7f0c04063110 con 0x7f0c0806cde0 2024-09-17T03:06:16.644 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:16.644 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:16.644 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 188, 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:06:13.203699+0000", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:06:16.645 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 23, 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.646 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:16.647 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:16.648 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:16.649 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:16.650 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:16.651 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.652 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 22, 2024-09-17T03:06:16.653 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:52.471547+0000", 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:16.654 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.655 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "184", 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:16.656 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:16.657 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:06:16.658 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:16.659 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 23, 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:53.802461+0000", 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:16.660 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:06:16.661 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "188", 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:16.662 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:16.664 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:06:16.665 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.666 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:16.667 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:16.668 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:16.669 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:16.670 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:06:16.671 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.672 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.673 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.674 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.675 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:16.676 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:06:16.677 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:16.678 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:16.679 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:06:16.680 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:16.681 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.681 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.681 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.681 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:06:16.681 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:16.681 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.681 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.682 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:16.683 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:16.684 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.685 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.686 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:16.687 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:16.688 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:06:16.689 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:16.690 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:16.691 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:16.692 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:16.693 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:16.694 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:16.695 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.697 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.698 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.699 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:16.700 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:16.702 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.703 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.704 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:16.705 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:16.706 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:16.707 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.708 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:16.709 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.710 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.711 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.712 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:16.713 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:16.714 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.715 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:16.716 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:16.717 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:06:16.718 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:06:16.719 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.720 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:16.721 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:16.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bec078b90 msgr2=0x7f0bec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:16.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bec078b90 0x7f0bec07b0a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8033000 tx=0x7f0bf8004730 comp rx=0 tx=0).stop 2024-09-17T03:06:16.723 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806cde0 msgr2=0x7f0c08168e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806cde0 0x7f0c08168e50 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400b410 tx=0x7f0c0400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 shutdown_connections 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0bec078b90 0x7f0bec07b0a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c080cf380 0x7f0c081673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0c0806d410 0x7f0c08151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 --2- 172.21.15.104:0/412026228 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0c0806cde0 0x7f0c08168e50 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 >> 172.21.15.104:0/412026228 conn(0x7f0c080d2970 msgr2=0x7f0c080b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 shutdown_connections 2024-09-17T03:06:16.724 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.647+0000 7f0c0f4d3640 1 -- 172.21.15.104:0/412026228 wait complete. 2024-09-17T03:06:16.725 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-17T03:06:16.725 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-17T03:06:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.838+0000 7f28051ba640 1 -- 172.21.15.104:0/2110865143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 msgr2=0x7f27ec0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.838+0000 7f28051ba640 1 --2- 172.21.15.104:0/2110865143 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 0x7f27ec0051f0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f27f800c750 tx=0x7f27ec005830 comp rx=0 tx=0).stop 2024-09-17T03:06:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.838+0000 7f27ff59e640 1 -- 172.21.15.104:0/2110865143 reap_dead start 2024-09-17T03:06:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.838+0000 7f28051ba640 1 -- 172.21.15.104:0/2110865143 shutdown_connections 2024-09-17T03:06:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.838+0000 7f28051ba640 1 -- 172.21.15.104:0/2110865143 >> 172.21.15.104:0/2110865143 conn(0x7f2800069120 msgr2=0x7f2800069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.838+0000 7f28051ba640 1 -- 172.21.15.104:0/2110865143 shutdown_connections 2024-09-17T03:06:16.838 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.838+0000 7f28051ba640 1 -- 172.21.15.104:0/2110865143 wait complete. 2024-09-17T03:06:16.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.840+0000 7f28051ba640 1 Processor -- start 2024-09-17T03:06:16.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.840+0000 7f28051ba640 1 -- start start 2024-09-17T03:06:16.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.841+0000 7f28051ba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 0x7f28001f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:16.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.841+0000 7f28051ba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f280015b410 0x7f2800154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:16.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f28051ba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28000cd260 0x7f28000cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:16.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f28051ba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2800160240 con 0x7f27ec004d40 2024-09-17T03:06:16.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f28051ba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f28001600c0 con 0x7f28000cd260 2024-09-17T03:06:16.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f28051ba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f28001603c0 con 0x7f280015b410 2024-09-17T03:06:16.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 0x7f28001f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 0x7f28001f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60164/0 (socket says 172.21.15.104:60164) 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 -- 172.21.15.104:0/3717669076 learned_addr learned my addr 172.21.15.104:0/3717669076 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27ff59e640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28000cd260 0x7f28000cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27f659c640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f280015b410 0x7f2800154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 -- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f280015b410 msgr2=0x7f2800154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f280015b410 0x7f2800154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 -- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28000cd260 msgr2=0x7f28000cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28000cd260 0x7f28000cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 -- 172.21.15.104:0/3717669076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28001559a0 con 0x7f27ec004d40 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27ff59e640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28000cd260 0x7f28000cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27fed9d640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 0x7f28001f78c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f27f0011ab0 tx=0x7f27f0011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27f7fff640 1 -- 172.21.15.104:0/3717669076 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f001e070 con 0x7f27ec004d40 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27f7fff640 1 -- 172.21.15.104:0/3717669076 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27f000fc70 con 0x7f27ec004d40 2024-09-17T03:06:16.843 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2800155c80 con 0x7f27ec004d40 2024-09-17T03:06:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f27f7fff640 1 -- 172.21.15.104:0/3717669076 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0004290 con 0x7f27ec004d40 2024-09-17T03:06:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.842+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28001f6dc0 con 0x7f27ec004d40 2024-09-17T03:06:16.844 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.843+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28001620d0 con 0x7f27ec004d40 2024-09-17T03:06:16.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.844+0000 7f27f7fff640 1 -- 172.21.15.104:0/3717669076 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27f0021070 con 0x7f27ec004d40 2024-09-17T03:06:16.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.845+0000 7f27f7fff640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f27e0078b90 0x7f27e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:16.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.845+0000 7f27f7fff640 1 -- 172.21.15.104:0/3717669076 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f27f009b530 con 0x7f27ec004d40 2024-09-17T03:06:16.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.845+0000 7f27f659c640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f27e0078b90 0x7f27e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:16.845 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.845+0000 7f27f659c640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f27e0078b90 0x7f27e007b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2800154a60 tx=0x7f27e8006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:16.848 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:16.849+0000 7f27f7fff640 1 -- 172.21.15.104:0/3717669076 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f27f000fe60 con 0x7f27ec004d40 2024-09-17T03:06:17.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.025+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f28000d3bf0 con 0x7f27ec004d40 2024-09-17T03:06:17.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.026+0000 7f27f7fff640 1 -- 172.21.15.104:0/3717669076 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) ==== 81+0+34318 (secure 0 0 0) 0x7f27f00633b0 con 0x7f27ec004d40 2024-09-17T03:06:17.026 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:17.026 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:17.026 INFO:teuthology.orchestra.run.smithi104.stdout: "epoch": 188, 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "created": "2024-09-17T02:54:23.296665+0000", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "modified": "2024-09-17T03:06:13.203699+0000", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "last_up_change": "2024-09-17T02:54:30.618449+0000", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "last_in_change": "2024-09-17T02:54:27.491467+0000", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_num": 5799936, 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_set": [ 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "pglog_hardlimit", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "purged_snapdirs", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_deletes", 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "sortbitwise" 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:17.027 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_version": 4, 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "full_ratio": 0.69999998807907104, 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_snapshot": "", 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_max": 23, 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "max_osd": 8, 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "require_min_compat_client": "luminous", 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "min_compat_client": "jewel", 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "require_osd_release": "squid", 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "allow_crimson": false, 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "pools": [ 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.028 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 1, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": ".mgr", 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T02:54:31.652437+0000", 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:17.029 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 1, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 1, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 1, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 1, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 1, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:17.030 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "111", 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:17.031 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:17.032 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:17.033 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_max": 32, 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 1 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "mgr": {} 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 8, 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 8, 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 0.25, 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:17.034 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 22, 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_metadata", 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:52.471547+0000", 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:17.035 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 32, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 32, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 32, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 32, 2024-09-17T03:06:17.036 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 32, 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "184", 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:17.037 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 0, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:17.038 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:17.039 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.040 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:17.040 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:17.040 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:17.040 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:17.040 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:17.040 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:17.040 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:17.040 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:17.041 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:17.041 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:17.041 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:17.041 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_bias": 4, 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 16, 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "recovery_priority": 5 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "metadata": "cephfs" 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 2, 2024-09-17T03:06:17.042 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 2, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 2, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 2, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "pool": 23, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_name": "cephfs_data", 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "create_time": "2024-09-17T03:05:53.802461+0000", 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "flags": 1, 2024-09-17T03:06:17.043 INFO:teuthology.orchestra.run.smithi104.stdout: "flags_names": "hashpspool", 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "type": 1, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "size": 2, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "min_size": 1, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_rule": 0, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_count": 0, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_target": 0, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "is_stretch_pool": false, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "object_hash": 2, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_autoscale_mode": "off", 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num": 64, 2024-09-17T03:06:17.044 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num": 64, 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_placement_num_target": 64, 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_target": 64, 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_pending": 64, 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "last_pg_merge_meta": { 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "source_pgid": "0.0", 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "ready_epoch": 0, 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_started": 0, 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "last_epoch_clean": 0, 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "source_version": "0'0", 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "target_version": "0'0" 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "last_change": "188", 2024-09-17T03:06:17.045 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend": "0", 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "auid": 0, 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_mode": "selfmanaged", 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_seq": 0, 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "snap_epoch": 0, 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "pool_snaps": [], 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps": "[]", 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_bytes": 33554432, 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "quota_max_objects": 0, 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "tiers": [], 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "tier_of": -1, 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "read_tier": -1, 2024-09-17T03:06:17.046 INFO:teuthology.orchestra.run.smithi104.stdout: "write_tier": -1, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_mode": "none", 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_bytes": 0, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "target_max_objects": 0, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_flush_age": 0, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "cache_min_evict_age": 0, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profile": "", 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_params": { 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "none" 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_period": 0, 2024-09-17T03:06:17.047 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_count": 0, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "use_gmt_hitset": true, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "min_read_recency_for_promote": 0, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "min_write_recency_for_promote": 0, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "hit_set_search_last_n": 0, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "grade_table": [], 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "stripe_width": 0, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "expected_num_objects": 0, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "fast_read": false, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "options": { 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_num_min": 64, 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: "target_size_ratio": 0.89999997615814209 2024-09-17T03:06:17.048 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "application_metadata": { 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "cephfs": { 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "data": "cephfs" 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "read_balance": { 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "score_type": "Fair distribution", 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "score_acting": 1.3799999952316284, 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "score_stable": 1.3799999952316284, 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "optimal_score": 1, 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity_weighted": 1, 2024-09-17T03:06:17.049 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity": 1, 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "average_primary_affinity_weighted": 1 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "osds": [ 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:17.050 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6800", 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6801", 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6802", 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.052 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6803", 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6806", 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.053 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6807", 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6804", 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.054 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6805", 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 717221549 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6801/717221549", 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6803/717221549", 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6807/717221549", 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6805/717221549", 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:17.055 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:17.056 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6808", 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6809", 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:17.057 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6810", 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6811", 2024-09-17T03:06:17.058 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6814", 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6815", 2024-09-17T03:06:17.059 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6812", 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.060 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6813", 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1763440481 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6809/1763440481", 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6811/1763440481", 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6815/1763440481", 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6813/1763440481", 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.061 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:17.062 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6824", 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6825", 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.063 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6826", 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6827", 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.064 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6830", 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6831", 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.065 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.066 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.066 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:17.066 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.066 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.066 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.066 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6828", 2024-09-17T03:06:17.066 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:17.068 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.068 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6829", 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 100151575 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6825/100151575", 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6827/100151575", 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6831/100151575", 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6829/100151575", 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:17.069 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:17.070 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6816", 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.071 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6817", 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6818", 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.072 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6819", 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6822", 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.073 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6823", 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6820", 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:17.074 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.104:6821", 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1619923136 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.104:6817/1619923136", 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.104:6819/1619923136", 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.104:6823/1619923136", 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.104:6821/1619923136", 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:17.075 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:17.076 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6818", 2024-09-17T03:06:17.077 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6819", 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.078 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6820", 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6821", 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.079 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6824", 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6825", 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.080 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6822", 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6823", 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3240881174 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.081 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6819/3240881174", 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6821/3240881174", 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6825/3240881174", 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6823/3240881174", 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:17.082 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.083 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6802", 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6803", 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.084 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6804", 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6805", 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.085 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6808", 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6810", 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:17.086 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6806", 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6807", 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3946789085 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6803/3946789085", 2024-09-17T03:06:17.087 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6805/3946789085", 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6810/3946789085", 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6807/3946789085", 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:17.088 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6809", 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:17.089 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6811", 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6812", 2024-09-17T03:06:17.090 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6813", 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6816", 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6817", 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:17.092 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6814", 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6815", 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 3422114417 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6811/3422114417", 2024-09-17T03:06:17.093 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6813/3422114417", 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6817/3422114417", 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6815/3422114417", 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "up": 1, 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "in": 1, 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "weight": 1, 2024-09-17T03:06:17.094 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_affinity": 1, 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_begin": 0, 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "last_clean_end": 0, 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "up_from": 13, 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "up_thru": 183, 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "down_at": 0, 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "lost_at": 0, 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addrs": { 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6826", 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:17.095 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6827", 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addrs": { 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.096 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6828", 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6829", 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addrs": { 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.097 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6832", 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6833", 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addrs": { 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: "addrvec": [ 2024-09-17T03:06:17.098 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v2", 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6830", 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: "type": "v1", 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: "addr": "172.21.15.192:6831", 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: "nonce": 1791040326 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.099 INFO:teuthology.orchestra.run.smithi104.stdout: "public_addr": "172.21.15.192:6827/1791040326", 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "cluster_addr": "172.21.15.192:6829/1791040326", 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_back_addr": "172.21.15.192:6833/1791040326", 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "heartbeat_front_addr": "172.21.15.192:6831/1791040326", 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "state": [ 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "exists", 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "up" 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "osd_xinfo": [ 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 0, 2024-09-17T03:06:17.100 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.605382+0000", 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 1, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:17.101 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.623043+0000", 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 2, 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.691956+0000", 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.102 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 3, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.673593+0000", 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 4, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:17.103 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.680873+0000", 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 5, 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.666617+0000", 2024-09-17T03:06:17.104 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 6, 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.599288+0000", 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: { 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "osd": 7, 2024-09-17T03:06:17.105 INFO:teuthology.orchestra.run.smithi104.stdout: "down_stamp": "0.000000", 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_probability": 0, 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "laggy_interval": 0, 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "features": 4540719139924082687, 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "old_weight": 0, 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "last_purged_snaps_scrub": "2024-09-17T02:54:28.628144+0000", 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "dead_epoch": 0 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: ], 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap": [], 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_items": [], 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_upmap_primaries": [], 2024-09-17T03:06:17.106 INFO:teuthology.orchestra.run.smithi104.stdout: "pg_temp": [], 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "primary_temp": [], 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "blocklist": {}, 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "range_blocklist": {}, 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "erasure_code_profiles": { 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "default": { 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "crush-failure-domain": "osd", 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "k": "2", 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "m": "1", 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "plugin": "jerasure", 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "technique": "reed_sol_van" 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: }, 2024-09-17T03:06:17.107 INFO:teuthology.orchestra.run.smithi104.stdout: "removed_snaps_queue": [], 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "new_removed_snaps": [], 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "new_purged_snaps": [], 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "crush_node_flags": {}, 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "device_class_flags": {}, 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode": { 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_enabled": false, 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_bucket_count": 0, 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "degraded_stretch_mode": 0, 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "recovering_stretch_mode": 0, 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: "stretch_mode_bucket": 0 2024-09-17T03:06:17.108 INFO:teuthology.orchestra.run.smithi104.stdout: } 2024-09-17T03:06:17.109 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:17.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f27e0078b90 msgr2=0x7f27e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:17.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f27e0078b90 0x7f27e007b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2800154a60 tx=0x7f27e8006ba0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 msgr2=0x7f28001f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:17.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 0x7f28001f78c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f27f0011ab0 tx=0x7f27f0011f70 comp rx=0 tx=0).stop 2024-09-17T03:06:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 shutdown_connections 2024-09-17T03:06:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f27e0078b90 0x7f27e007b0a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28000cd260 0x7f28000cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f280015b410 0x7f2800154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 --2- 172.21.15.104:0/3717669076 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f27ec004d40 0x7f28001f78c0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 >> 172.21.15.104:0/3717669076 conn(0x7f2800069120 msgr2=0x7f28000b9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 shutdown_connections 2024-09-17T03:06:17.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.029+0000 7f28051ba640 1 -- 172.21.15.104:0/3717669076 wait complete. 2024-09-17T03:06:17.112 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:06:17.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.226+0000 7f6b74e8b640 1 -- 172.21.15.104:0/3378539712 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b58004800 msgr2=0x7f6b58004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:17.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.226+0000 7f6b74e8b640 1 --2- 172.21.15.104:0/3378539712 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b58004800 0x7f6b58004c10 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009b50 tx=0x7f6b58005830 comp rx=0 tx=0).stop 2024-09-17T03:06:17.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.226+0000 7f6b74e8b640 1 -- 172.21.15.104:0/3378539712 shutdown_connections 2024-09-17T03:06:17.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.226+0000 7f6b74e8b640 1 --2- 172.21.15.104:0/3378539712 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b58004800 0x7f6b58004c10 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.226+0000 7f6b74e8b640 1 -- 172.21.15.104:0/3378539712 >> 172.21.15.104:0/3378539712 conn(0x7f6b7006d200 msgr2=0x7f6b7006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:17.226 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.226+0000 7f6b74e8b640 1 -- 172.21.15.104:0/3378539712 shutdown_connections 2024-09-17T03:06:17.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.226+0000 7f6b74e8b640 1 -- 172.21.15.104:0/3378539712 wait complete. 2024-09-17T03:06:17.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.228+0000 7f6b74e8b640 1 Processor -- start 2024-09-17T03:06:17.227 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.228+0000 7f6b74e8b640 1 -- start start 2024-09-17T03:06:17.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b74e8b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b58004800 0x7f6b700b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:17.231 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b74e8b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b70143af0 0x7f6b701e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b74e8b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b701e8620 0x7f6b70142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b74e8b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6b700cef00 con 0x7f6b70143af0 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b74e8b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b700d2520 con 0x7f6b701e8620 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b74e8b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6b70073560 con 0x7f6b58004800 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b70143af0 0x7f6b701e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6dd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b70143af0 0x7f6b701e80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60182/0 (socket says 172.21.15.104:60182) 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6dd9b640 1 -- 172.21.15.104:0/2937024912 learned_addr learned my addr 172.21.15.104:0/2937024912 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6e59c640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b58004800 0x7f6b700b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6ed9d640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b701e8620 0x7f6b70142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6dd9b640 1 -- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b58004800 msgr2=0x7f6b700b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6dd9b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b58004800 0x7f6b700b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.232 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6dd9b640 1 -- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b701e8620 msgr2=0x7f6b70142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6dd9b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b701e8620 0x7f6b70142ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6dd9b640 1 -- 172.21.15.104:0/2937024912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b700b3fb0 con 0x7f6b70143af0 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6e59c640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b58004800 0x7f6b700b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.229+0000 7f6b6ed9d640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b701e8620 0x7f6b70142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.230+0000 7f6b6dd9b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b70143af0 0x7f6b701e80e0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009a70 tx=0x7f6b640336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.230+0000 7f6b5effd640 1 -- 172.21.15.104:0/2937024912 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64038040 con 0x7f6b70143af0 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.230+0000 7f6b5effd640 1 -- 172.21.15.104:0/2937024912 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b640339d0 con 0x7f6b70143af0 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.230+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7015d030 con 0x7f6b70143af0 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.230+0000 7f6b5effd640 1 -- 172.21.15.104:0/2937024912 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64033e20 con 0x7f6b70143af0 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.230+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7015d5f0 con 0x7f6b70143af0 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.231+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b70073a70 con 0x7f6b70143af0 2024-09-17T03:06:17.233 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.232+0000 7f6b5effd640 1 -- 172.21.15.104:0/2937024912 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b64043020 con 0x7f6b70143af0 2024-09-17T03:06:17.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.232+0000 7f6b5effd640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6b50078b90 0x7f6b5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:17.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.232+0000 7f6b5effd640 1 -- 172.21.15.104:0/2937024912 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f6b640baf40 con 0x7f6b70143af0 2024-09-17T03:06:17.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.232+0000 7f6b6e59c640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6b50078b90 0x7f6b5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:17.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.233+0000 7f6b6e59c640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6b50078b90 0x7f6b5007b0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6b60000fd0 tx=0x7f6b60001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:17.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.237+0000 7f6b5effd640 1 -- 172.21.15.104:0/2937024912 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6b6404a020 con 0x7f6b70143af0 2024-09-17T03:06:17.442 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.443+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b7015ef70 con 0x7f6b70143af0 2024-09-17T03:06:17.443 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.444+0000 7f6b5effd640 1 -- 172.21.15.104:0/2937024912 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7f6b64083380 con 0x7f6b70143af0 2024-09-17T03:06:17.443 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:17.443 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:06:17.444 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:06:17.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6b50078b90 msgr2=0x7f6b5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:17.445 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6b50078b90 0x7f6b5007b0a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6b60000fd0 tx=0x7f6b60001640 comp rx=0 tx=0).stop 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b70143af0 msgr2=0x7f6b701e80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b70143af0 0x7f6b701e80e0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009a70 tx=0x7f6b640336f0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 shutdown_connections 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6b50078b90 0x7f6b5007b0a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b701e8620 0x7f6b70142ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f6b70143af0 0x7f6b701e80e0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 --2- 172.21.15.104:0/2937024912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b58004800 0x7f6b700b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 >> 172.21.15.104:0/2937024912 conn(0x7f6b7006d200 msgr2=0x7f6b701e9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 shutdown_connections 2024-09-17T03:06:17.446 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:17.446+0000 7f6b74e8b640 1 -- 172.21.15.104:0/2937024912 wait complete. 2024-09-17T03:06:17.457 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-17T03:06:17.584 INFO:teuthology.orchestra.run.smithi104.stdout:{"cluster_fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","whoami":0,"id":8151,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":22.100101516999999,"mdsmap_epoch":76,"osdmap_epoch":188,"osdmap_epoch_barrier":187,"uptime":26.798183476999998} 2024-09-17T03:06:17.584 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5ed2cc55-4a25-471e-9183-b1048a1a073c", "fs_name": "cephfs", "id": 8151, "mdsmap_epoch": 76, "osdmap_epoch": 188, "osdmap_epoch_barrier": 187, "rank_uptime": 22.100101517, "state": "up:active", "uptime": 26.798183477, "want_state": "up:active", "whoami": 0 } 2024-09-17T03:06:17.584 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T03:06:17.585 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:17.585 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:17.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:17.601 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-17T03:06:17.844 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records in 2024-09-17T03:06:17.844 INFO:teuthology.orchestra.run.smithi104.stderr:50+0 records out 2024-09-17T03:06:17.844 INFO:teuthology.orchestra.run.smithi104.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.185298 s, 283 MB/s 2024-09-17T03:06:17.844 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:06:17.844 DEBUG:teuthology.orchestra.run.smithi104:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:06:17.890 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:06:17.942 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:06:17.942 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:06:17.943 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:17.943 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:17.958 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:17.958 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:18.014 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:06:18.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.167+0000 7f8be5357640 1 -- 172.21.15.104:0/735400142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 msgr2=0x7f8bcc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.167+0000 7f8be5357640 1 --2- 172.21.15.104:0/735400142 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 0x7f8bcc004800 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8001800 tx=0x7f8bcc005830 comp rx=0 tx=0).stop 2024-09-17T03:06:18.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.167+0000 7f8bdf7fe640 1 -- 172.21.15.104:0/735400142 reap_dead start 2024-09-17T03:06:18.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.167+0000 7f8be5357640 1 -- 172.21.15.104:0/735400142 shutdown_connections 2024-09-17T03:06:18.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.167+0000 7f8be5357640 1 -- 172.21.15.104:0/735400142 >> 172.21.15.104:0/735400142 conn(0x7f8be0069120 msgr2=0x7f8be0069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:18.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.167+0000 7f8be5357640 1 -- 172.21.15.104:0/735400142 shutdown_connections 2024-09-17T03:06:18.167 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.167+0000 7f8be5357640 1 -- 172.21.15.104:0/735400142 wait complete. 2024-09-17T03:06:18.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.169+0000 7f8be5357640 1 Processor -- start 2024-09-17T03:06:18.168 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.169+0000 7f8be5357640 1 -- start start 2024-09-17T03:06:18.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8be5357640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 0x7f8be01f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:18.171 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8be5357640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8be01fa030 0x7f8be015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:18.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8be5357640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8be01f8c50 0x7f8be00ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:18.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8be5357640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8be0161a90 con 0x7f8bcc0041c0 2024-09-17T03:06:18.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8be5357640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8be00b6d10 con 0x7f8be01f8c50 2024-09-17T03:06:18.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8be5357640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8be0161c10 con 0x7f8be01fa030 2024-09-17T03:06:18.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8bdeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 0x7f8be01f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:18.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8bdeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 0x7f8be01f6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60202/0 (socket says 172.21.15.104:60202) 2024-09-17T03:06:18.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8bdeffd640 1 -- 172.21.15.104:0/3564197249 learned_addr learned my addr 172.21.15.104:0/3564197249 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:18.172 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8bd67fc640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8be01fa030 0x7f8be015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8bdf7fe640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8be01f8c50 0x7f8be00ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.170+0000 7f8bdeffd640 1 -- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8be01fa030 msgr2=0x7f8be015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bdeffd640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8be01fa030 0x7f8be015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bdeffd640 1 -- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8be01f8c50 msgr2=0x7f8be00ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bdeffd640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8be01f8c50 0x7f8be00ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bdeffd640 1 -- 172.21.15.104:0/3564197249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be00cd220 con 0x7f8bcc0041c0 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bd67fc640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8be01fa030 0x7f8be015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bdf7fe640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8be01f8c50 0x7f8be00ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bdeffd640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 0x7f8be01f6fb0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0011ab0 tx=0x7f8bd0011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bd7fff640 1 -- 172.21.15.104:0/3564197249 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd001e070 con 0x7f8bcc0041c0 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bd7fff640 1 -- 172.21.15.104:0/3564197249 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bd000fc70 con 0x7f8bcc0041c0 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8bd7fff640 1 -- 172.21.15.104:0/3564197249 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0019670 con 0x7f8bcc0041c0 2024-09-17T03:06:18.173 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be00cd4c0 con 0x7f8bcc0041c0 2024-09-17T03:06:18.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.171+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be00cda80 con 0x7f8bcc0041c0 2024-09-17T03:06:18.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.172+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be00b7c10 con 0x7f8bcc0041c0 2024-09-17T03:06:18.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.173+0000 7f8bd7fff640 1 -- 172.21.15.104:0/3564197249 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8bd0021070 con 0x7f8bcc0041c0 2024-09-17T03:06:18.174 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.173+0000 7f8bd7fff640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8bc0078b90 0x7f8bc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:18.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.173+0000 7f8bd7fff640 1 -- 172.21.15.104:0/3564197249 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f8bd009bbd0 con 0x7f8bcc0041c0 2024-09-17T03:06:18.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.173+0000 7f8bd67fc640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8bc0078b90 0x7f8bc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:18.175 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.174+0000 7f8bd67fc640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8bc0078b90 0x7f8bc007b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8032000 tx=0x7f8bc8001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:18.176 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.177+0000 7f8bd7fff640 1 -- 172.21.15.104:0/3564197249 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8be00b7c10 con 0x7f8bcc0041c0 2024-09-17T03:06:18.362 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.363+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8be0162170 con 0x7f8bcc0041c0 2024-09-17T03:06:18.363 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.363+0000 7f8bd7fff640 1 -- 172.21.15.104:0/3564197249 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v188) ==== 80+0+0 (secure 0 0 0) 0x7f8bd000fe60 con 0x7f8bcc0041c0 2024-09-17T03:06:18.363 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:06:18.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8bc0078b90 msgr2=0x7f8bc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8bc0078b90 0x7f8bc007b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8032000 tx=0x7f8bc8001360 comp rx=0 tx=0).stop 2024-09-17T03:06:18.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 msgr2=0x7f8be01f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 0x7f8be01f6fb0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0011ab0 tx=0x7f8bd0011f70 comp rx=0 tx=0).stop 2024-09-17T03:06:18.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 shutdown_connections 2024-09-17T03:06:18.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8bc0078b90 0x7f8bc007b0a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8be01f8c50 0x7f8be00ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8be01fa030 0x7f8be015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 --2- 172.21.15.104:0/3564197249 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8bcc0041c0 0x7f8be01f6fb0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 >> 172.21.15.104:0/3564197249 conn(0x7f8be0069120 msgr2=0x7f8be01636d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:18.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 shutdown_connections 2024-09-17T03:06:18.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.365+0000 7f8be5357640 1 -- 172.21.15.104:0/3564197249 wait complete. 2024-09-17T03:06:18.376 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:06:18.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:18.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:06:18.432 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:06:18.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:18.433 DEBUG:teuthology.orchestra.run.smithi104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:06:18.455 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:06:18.455 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:06:18.456 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:18.472 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:06:18.472 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:18.529 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:06:18.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.643+0000 7f2b43bba640 1 -- 172.21.15.104:0/1734103889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 msgr2=0x7f2b3c15d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.643+0000 7f2b43bba640 1 --2- 172.21.15.104:0/1734103889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 0x7f2b3c15d570 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009ca0 tx=0x7f2b3402aa50 comp rx=0 tx=0).stop 2024-09-17T03:06:18.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.643+0000 7f2b43bba640 1 -- 172.21.15.104:0/1734103889 shutdown_connections 2024-09-17T03:06:18.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.643+0000 7f2b43bba640 1 --2- 172.21.15.104:0/1734103889 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 0x7f2b3c15d570 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.643+0000 7f2b43bba640 1 --2- 172.21.15.104:0/1734103889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b3c0cf4f0 0x7f2b3c0d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.643+0000 7f2b43bba640 1 -- 172.21.15.104:0/1734103889 >> 172.21.15.104:0/1734103889 conn(0x7f2b3c06f050 msgr2=0x7f2b3c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:18.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.643+0000 7f2b43bba640 1 -- 172.21.15.104:0/1734103889 shutdown_connections 2024-09-17T03:06:18.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.643+0000 7f2b43bba640 1 -- 172.21.15.104:0/1734103889 wait complete. 2024-09-17T03:06:18.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.645+0000 7f2b43bba640 1 Processor -- start 2024-09-17T03:06:18.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.645+0000 7f2b43bba640 1 -- start start 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b43bba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b3c0cf4f0 0x7f2b3c13c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b43bba640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b3c0d1720 0x7f2b3c13c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b43bba640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 0x7f2b3c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b43bba640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c0cfa80 con 0x7f2b3c142e10 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b43bba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c0cf900 con 0x7f2b3c0cf4f0 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b43bba640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f2b3c15dab0 con 0x7f2b3c0d1720 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 0x7f2b3c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 0x7f2b3c0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60224/0 (socket says 172.21.15.104:60224) 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 -- 172.21.15.104:0/454089541 learned_addr learned my addr 172.21.15.104:0/454089541 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:18.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 -- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b3c0d1720 msgr2=0x7f2b3c13c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b41956640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b3c0cf4f0 0x7f2b3c13c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b41155640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b3c0d1720 0x7f2b3c13c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b3c0d1720 0x7f2b3c13c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 -- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b3c0cf4f0 msgr2=0x7f2b3c13c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b3c0cf4f0 0x7f2b3c13c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 -- 172.21.15.104:0/454089541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3c13d1b0 con 0x7f2b3c142e10 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.646+0000 7f2b42157640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 0x7f2b3c0b1940 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f2b34006010 tx=0x7f2b34003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.647+0000 7f2b2e7fc640 1 -- 172.21.15.104:0/454089541 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34046070 con 0x7f2b3c142e10 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.647+0000 7f2b2e7fc640 1 -- 172.21.15.104:0/454089541 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b340045c0 con 0x7f2b3c142e10 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.647+0000 7f2b2e7fc640 1 -- 172.21.15.104:0/454089541 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34033070 con 0x7f2b3c142e10 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.647+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3c0b0e60 con 0x7f2b3c142e10 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.647+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b3c13d600 con 0x7f2b3c142e10 2024-09-17T03:06:18.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.648+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3c0b0c80 con 0x7f2b3c142e10 2024-09-17T03:06:18.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.648+0000 7f2b2e7fc640 1 -- 172.21.15.104:0/454089541 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b34049070 con 0x7f2b3c142e10 2024-09-17T03:06:18.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.649+0000 7f2b2e7fc640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b20078b80 0x7f2b2007b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:18.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.649+0000 7f2b2e7fc640 1 -- 172.21.15.104:0/454089541 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f2b340bbfc0 con 0x7f2b3c142e10 2024-09-17T03:06:18.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.649+0000 7f2b41956640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b20078b80 0x7f2b2007b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:18.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.650+0000 7f2b41956640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b20078b80 0x7f2b2007b090 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000a770 tx=0x7f2b30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:18.653 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.654+0000 7f2b2e7fc640 1 -- 172.21.15.104:0/454089541 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b3c0b0c80 con 0x7f2b3c142e10 2024-09-17T03:06:18.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.839+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2b3c15e7f0 con 0x7f2b3c142e10 2024-09-17T03:06:18.839 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.839+0000 7f2b2e7fc640 1 -- 172.21.15.104:0/454089541 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v188) ==== 80+0+0 (secure 0 0 0) 0x7f2b3403e070 con 0x7f2b3c142e10 2024-09-17T03:06:18.839 INFO:teuthology.orchestra.run.smithi104.stderr:listed 0 entries 2024-09-17T03:06:18.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b20078b80 msgr2=0x7f2b2007b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b20078b80 0x7f2b2007b090 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000a770 tx=0x7f2b30008040 comp rx=0 tx=0).stop 2024-09-17T03:06:18.841 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 msgr2=0x7f2b3c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 0x7f2b3c0b1940 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f2b34006010 tx=0x7f2b34003f90 comp rx=0 tx=0).stop 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 shutdown_connections 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f2b20078b80 0x7f2b2007b090 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f2b3c142e10 0x7f2b3c0b1940 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b3c0d1720 0x7f2b3c13c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.841+0000 7f2b43bba640 1 --2- 172.21.15.104:0/454089541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b3c0cf4f0 0x7f2b3c13c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.842+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 >> 172.21.15.104:0/454089541 conn(0x7f2b3c06f050 msgr2=0x7f2b3c142700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.842+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 shutdown_connections 2024-09-17T03:06:18.842 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:18.842+0000 7f2b43bba640 1 -- 172.21.15.104:0/454089541 wait complete. 2024-09-17T03:06:18.852 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:06:18.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:18.852 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T03:06:18.881 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:06:18.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:18.882 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:06:18.938 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:06:18.938 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:18.938 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:18.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:06:18.954 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:06:18.954 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:06:18.954 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:18.993 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:06:18.994 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:06:19.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.107+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/1056317086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 msgr2=0x7fd2b40d1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.107+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/1056317086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 0x7fd2b40d1b20 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fd2b408d650 tx=0x7fd2ac02a8f0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.107+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/1056317086 shutdown_connections 2024-09-17T03:06:19.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.107+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/1056317086 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 0x7fd2b40d1b20 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.107+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/1056317086 >> v2:172.21.15.192:3300/0 conn(0x7fd2b40d3ea0 0x7fd2b40d42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.107+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/1056317086 >> 172.21.15.104:0/1056317086 conn(0x7fd2b4068ee0 msgr2=0x7fd2b40692f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:19.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.107+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/1056317086 shutdown_connections 2024-09-17T03:06:19.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.107+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/1056317086 wait complete. 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.108+0000 7fd2b9d9d640 1 Processor -- start 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.109+0000 7fd2b9d9d640 1 -- start start 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b9d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 0x7fd2b40cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b9d9d640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b40d3ea0 0x7fd2b4145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b9d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b415eed0 0x7fd2b4146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b9d9d640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40b8220 con 0x7fd2b40d1710 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b9d9d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40b80a0 con 0x7fd2b415eed0 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b9d9d640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b40b83a0 con 0x7fd2b40d3ea0 2024-09-17T03:06:19.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b8d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 0x7fd2b40cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b8d9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 0x7fd2b40cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60244/0 (socket says 172.21.15.104:60244) 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b8d9b640 1 -- 172.21.15.104:0/930835132 learned_addr learned my addr 172.21.15.104:0/930835132 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b959c640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b415eed0 0x7fd2b4146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2abfff640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b40d3ea0 0x7fd2b4145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b8d9b640 1 -- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b40d3ea0 msgr2=0x7fd2b4145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b8d9b640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b40d3ea0 0x7fd2b4145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b8d9b640 1 -- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b415eed0 msgr2=0x7fd2b4146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b8d9b640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b415eed0 0x7fd2b4146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.110+0000 7fd2b8d9b640 1 -- 172.21.15.104:0/930835132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b41e76b0 con 0x7fd2b40d1710 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.111+0000 7fd2b8d9b640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 0x7fd2b40cb030 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000b3e0 tx=0x7fd2b000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.111+0000 7fd2a97fa640 1 -- 172.21.15.104:0/930835132 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0015020 con 0x7fd2b40d1710 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.111+0000 7fd2a97fa640 1 -- 172.21.15.104:0/930835132 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2b0011940 con 0x7fd2b40d1710 2024-09-17T03:06:19.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.111+0000 7fd2a97fa640 1 -- 172.21.15.104:0/930835132 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0011d90 con 0x7fd2b40d1710 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.111+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b40cc120 con 0x7fd2b40d1710 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.111+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b40cc400 con 0x7fd2b40d1710 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.112+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b40b9ac0 con 0x7fd2b40d1710 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.113+0000 7fd2a97fa640 1 -- 172.21.15.104:0/930835132 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2b0018020 con 0x7fd2b40d1710 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.113+0000 7fd2a97fa640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2a0078b90 0x7fd2a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.113+0000 7fd2a97fa640 1 -- 172.21.15.104:0/930835132 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fd2b009b060 con 0x7fd2b40d1710 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.113+0000 7fd2abfff640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2a0078b90 0x7fd2a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.114+0000 7fd2abfff640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2a0078b90 0x7fd2a007b0a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4075f70 tx=0x7fd2a4009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:19.118 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.117+0000 7fd2a97fa640 1 -- 172.21.15.104:0/930835132 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2b001f020 con 0x7fd2b40d1710 2024-09-17T03:06:19.328 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.329+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2b406a200 con 0x7fd2b40d1710 2024-09-17T03:06:19.329 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.330+0000 7fd2a97fa640 1 -- 172.21.15.104:0/930835132 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7fd2b0062f30 con 0x7fd2b40d1710 2024-09-17T03:06:19.329 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:19.329 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:06:19.330 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:06:19.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2a0078b90 msgr2=0x7fd2a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2a0078b90 0x7fd2a007b0a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4075f70 tx=0x7fd2a4009060 comp rx=0 tx=0).stop 2024-09-17T03:06:19.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 msgr2=0x7fd2b40cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 0x7fd2b40cb030 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000b3e0 tx=0x7fd2b000b8a0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 shutdown_connections 2024-09-17T03:06:19.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd2a0078b90 0x7fd2a007b0a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2b415eed0 0x7fd2b4146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.332 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2b40d3ea0 0x7fd2b4145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 --2- 172.21.15.104:0/930835132 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd2b40d1710 0x7fd2b40cb030 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 >> 172.21.15.104:0/930835132 conn(0x7fd2b4068ee0 msgr2=0x7fd2b415dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 shutdown_connections 2024-09-17T03:06:19.333 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.332+0000 7fd2b9d9d640 1 -- 172.21.15.104:0/930835132 wait complete. 2024-09-17T03:06:19.343 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:06:19.455 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.456+0000 7f171ffc3640 1 -- 172.21.15.104:0/1864969342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1704004800 msgr2=0x7f1704004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.456+0000 7f171ffc3640 1 --2- 172.21.15.104:0/1864969342 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1704004800 0x7f1704004c10 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f1708009b50 tx=0x7f1704005830 comp rx=0 tx=0).stop 2024-09-17T03:06:19.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.456+0000 7f171e560640 1 -- 172.21.15.104:0/1864969342 reap_dead start 2024-09-17T03:06:19.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.456+0000 7f171ffc3640 1 -- 172.21.15.104:0/1864969342 shutdown_connections 2024-09-17T03:06:19.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.456+0000 7f171ffc3640 1 -- 172.21.15.104:0/1864969342 >> 172.21.15.104:0/1864969342 conn(0x7f1718073df0 msgr2=0x7f1718068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:19.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.456+0000 7f171ffc3640 1 -- 172.21.15.104:0/1864969342 shutdown_connections 2024-09-17T03:06:19.456 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.456+0000 7f171ffc3640 1 -- 172.21.15.104:0/1864969342 wait complete. 2024-09-17T03:06:19.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.458+0000 7f171ffc3640 1 Processor -- start 2024-09-17T03:06:19.457 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.458+0000 7f171ffc3640 1 -- start start 2024-09-17T03:06:19.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171ffc3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1704004800 0x7f17180c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171ffc3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17181f9eb0 0x7f17181617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.459 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171ffc3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17181f93a0 0x7f17181f97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171ffc3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f171815ef90 con 0x7f17181f93a0 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171ffc3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f17180b38d0 con 0x7f1704004800 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171ffc3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f171815f110 con 0x7f17181f9eb0 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17181f93a0 0x7f17181f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17181f93a0 0x7f17181f97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60268/0 (socket says 172.21.15.104:60268) 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 -- 172.21.15.104:0/3148984893 learned_addr learned my addr 172.21.15.104:0/3148984893 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171dd5f640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1704004800 0x7f17180c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171d55e640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17181f9eb0 0x7f17181617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 -- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17181f9eb0 msgr2=0x7f17181617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17181f9eb0 0x7f17181617c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 -- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1704004800 msgr2=0x7f17180c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1704004800 0x7f17180c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.460 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 -- 172.21.15.104:0/3148984893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1718160720 con 0x7f17181f93a0 2024-09-17T03:06:19.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.459+0000 7f171e560640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17181f93a0 0x7f17181f97b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f1710006fd0 tx=0x7f1710006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:19.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.460+0000 7f170e7fc640 1 -- 172.21.15.104:0/3148984893 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171000fc90 con 0x7f17181f93a0 2024-09-17T03:06:19.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.460+0000 7f170e7fc640 1 -- 172.21.15.104:0/3148984893 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1710018070 con 0x7f17181f93a0 2024-09-17T03:06:19.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.460+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1718160a00 con 0x7f17181f93a0 2024-09-17T03:06:19.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.460+0000 7f170e7fc640 1 -- 172.21.15.104:0/3148984893 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710011690 con 0x7f17181f93a0 2024-09-17T03:06:19.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.460+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1718160fc0 con 0x7f17181f93a0 2024-09-17T03:06:19.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.461+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17180d11d0 con 0x7f17181f93a0 2024-09-17T03:06:19.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.461+0000 7f170e7fc640 1 -- 172.21.15.104:0/3148984893 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1710011830 con 0x7f17181f93a0 2024-09-17T03:06:19.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.462+0000 7f170e7fc640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16fc078b90 0x7f16fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.462+0000 7f171dd5f640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16fc078b90 0x7f16fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.462+0000 7f170e7fc640 1 -- 172.21.15.104:0/3148984893 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f171009b5f0 con 0x7f17181f93a0 2024-09-17T03:06:19.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.463+0000 7f171dd5f640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16fc078b90 0x7f16fc07b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1714005eb0 tx=0x7f1714005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:19.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.467+0000 7f170e7fc640 1 -- 172.21.15.104:0/3148984893 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1710063ac0 con 0x7f17181f93a0 2024-09-17T03:06:19.677 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.678+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17180b9d30 con 0x7f17181f93a0 2024-09-17T03:06:19.678 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.678+0000 7f170e7fc640 1 -- 172.21.15.104:0/3148984893 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7f17100633c0 con 0x7f17181f93a0 2024-09-17T03:06:19.678 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:19.678 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:06:19.678 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:06:19.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16fc078b90 msgr2=0x7f16fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16fc078b90 0x7f16fc07b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1714005eb0 tx=0x7f1714005f90 comp rx=0 tx=0).stop 2024-09-17T03:06:19.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17181f93a0 msgr2=0x7f17181f97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17181f93a0 0x7f17181f97b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f1710006fd0 tx=0x7f1710006720 comp rx=0 tx=0).stop 2024-09-17T03:06:19.680 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 shutdown_connections 2024-09-17T03:06:19.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16fc078b90 0x7f16fc07b0a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f17181f93a0 0x7f17181f97b0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17181f9eb0 0x7f17181617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 --2- 172.21.15.104:0/3148984893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1704004800 0x7f17180c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 >> 172.21.15.104:0/3148984893 conn(0x7f1718073df0 msgr2=0x7f17180ba530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:19.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 shutdown_connections 2024-09-17T03:06:19.681 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.680+0000 7f171ffc3640 1 -- 172.21.15.104:0/3148984893 wait complete. 2024-09-17T03:06:19.691 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:06:19.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.804+0000 7fd339724640 1 -- 172.21.15.104:0/478990625 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3340b6f70 msgr2=0x7fd33415ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.804+0000 7fd339724640 1 --2- 172.21.15.104:0/478990625 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3340b6f70 0x7fd33415ef90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd324009860 tx=0x7fd32402a530 comp rx=0 tx=0).stop 2024-09-17T03:06:19.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.804+0000 7fd339724640 1 -- 172.21.15.104:0/478990625 shutdown_connections 2024-09-17T03:06:19.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.804+0000 7fd339724640 1 --2- 172.21.15.104:0/478990625 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3340b6f70 0x7fd33415ef90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.804+0000 7fd339724640 1 -- 172.21.15.104:0/478990625 >> 172.21.15.104:0/478990625 conn(0x7fd334073df0 msgr2=0x7fd334068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:19.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.804+0000 7fd339724640 1 -- 172.21.15.104:0/478990625 shutdown_connections 2024-09-17T03:06:19.804 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.804+0000 7fd339724640 1 -- 172.21.15.104:0/478990625 wait complete. 2024-09-17T03:06:19.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.806+0000 7fd339724640 1 Processor -- start 2024-09-17T03:06:19.805 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.806+0000 7fd339724640 1 -- start start 2024-09-17T03:06:19.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd339724640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3340b3b00 0x7fd334153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.808 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd339724640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3340b6f70 0x7fd3340ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd339724640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3340d18e0 0x7fd33415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd339724640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340d4000 con 0x7fd3340b3b00 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd339724640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340d3e80 con 0x7fd3340d18e0 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd339724640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd3340d4180 con 0x7fd3340b6f70 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd332ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3340b3b00 0x7fd334153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd332ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3340b3b00 0x7fd334153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60276/0 (socket says 172.21.15.104:60276) 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd332ffd640 1 -- 172.21.15.104:0/4194144719 learned_addr learned my addr 172.21.15.104:0/4194144719 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd3327fc640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3340b6f70 0x7fd3340ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.807+0000 7fd3337fe640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3340d18e0 0x7fd33415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd332ffd640 1 -- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3340b6f70 msgr2=0x7fd3340ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.809 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd332ffd640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3340b6f70 0x7fd3340ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd332ffd640 1 -- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3340d18e0 msgr2=0x7fd33415a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd332ffd640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3340d18e0 0x7fd33415a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd332ffd640 1 -- 172.21.15.104:0/4194144719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33415f730 con 0x7fd3340b3b00 2024-09-17T03:06:19.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd332ffd640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3340b3b00 0x7fd334153860 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fd32402ab20 tx=0x7fd3240040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:19.810 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd31b7fe640 1 -- 172.21.15.104:0/4194144719 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240319e0 con 0x7fd3340b3b00 2024-09-17T03:06:19.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd31b7fe640 1 -- 172.21.15.104:0/4194144719 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd324031c70 con 0x7fd3340b3b00 2024-09-17T03:06:19.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd334153da0 con 0x7fd3340b3b00 2024-09-17T03:06:19.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd31b7fe640 1 -- 172.21.15.104:0/4194144719 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324031e60 con 0x7fd3340b3b00 2024-09-17T03:06:19.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.808+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3341f9990 con 0x7fd3340b3b00 2024-09-17T03:06:19.811 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.809+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd33415ef90 con 0x7fd3340b3b00 2024-09-17T03:06:19.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.810+0000 7fd31b7fe640 1 -- 172.21.15.104:0/4194144719 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd324005280 con 0x7fd3340b3b00 2024-09-17T03:06:19.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.810+0000 7fd31b7fe640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd320078b90 0x7fd32007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:19.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.810+0000 7fd31b7fe640 1 -- 172.21.15.104:0/4194144719 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fd3240bc020 con 0x7fd3340b3b00 2024-09-17T03:06:19.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.811+0000 7fd3327fc640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd320078b90 0x7fd32007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:19.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.811+0000 7fd3327fc640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd320078b90 0x7fd32007b0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd3340d13f0 tx=0x7fd328001720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:19.814 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.815+0000 7fd31b7fe640 1 -- 172.21.15.104:0/4194144719 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd32403f030 con 0x7fd3340b3b00 2024-09-17T03:06:19.987 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.988+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3340ce9e0 con 0x7fd3340b3b00 2024-09-17T03:06:19.988 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.989+0000 7fd31b7fe640 1 -- 172.21.15.104:0/4194144719 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16787 (secure 0 0 0) 0x7fd324083e10 con 0x7fd3340b3b00 2024-09-17T03:06:19.989 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:19.989 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":188,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:06:13.203699+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:05:52.471547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:05:53.802461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:06:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd320078b90 msgr2=0x7fd32007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd320078b90 0x7fd32007b0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd3340d13f0 tx=0x7fd328001720 comp rx=0 tx=0).stop 2024-09-17T03:06:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3340b3b00 msgr2=0x7fd334153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3340b3b00 0x7fd334153860 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fd32402ab20 tx=0x7fd3240040c0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 shutdown_connections 2024-09-17T03:06:19.991 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd320078b90 0x7fd32007b0a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3340d18e0 0x7fd33415a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd3340b6f70 0x7fd3340ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 --2- 172.21.15.104:0/4194144719 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd3340b3b00 0x7fd334153860 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 >> 172.21.15.104:0/4194144719 conn(0x7fd334073df0 msgr2=0x7fd3340d5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.991+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 shutdown_connections 2024-09-17T03:06:19.992 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:19.992+0000 7fd339724640 1 -- 172.21.15.104:0/4194144719 wait complete. 2024-09-17T03:06:20.002 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:06:20.003 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:06:20.115 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.116+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2002113751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b70004d40 msgr2=0x7f0b70005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.116+0000 7f0b8ad39640 1 --2- 172.21.15.104:0/2002113751 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b70004d40 0x7f0b70005190 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c006f70 tx=0x7f0b70005830 comp rx=0 tx=0).stop 2024-09-17T03:06:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.116+0000 7f0b892d6640 1 -- 172.21.15.104:0/2002113751 reap_dead start 2024-09-17T03:06:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.116+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2002113751 shutdown_connections 2024-09-17T03:06:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.116+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2002113751 >> 172.21.15.104:0/2002113751 conn(0x7f0b840b3640 msgr2=0x7f0b840b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.116+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2002113751 shutdown_connections 2024-09-17T03:06:20.116 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.116+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2002113751 wait complete. 2024-09-17T03:06:20.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.118+0000 7f0b8ad39640 1 Processor -- start 2024-09-17T03:06:20.117 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.118+0000 7f0b8ad39640 1 -- start start 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b8ad39640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b70004d40 0x7f0b84159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b8ad39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b84159660 0x7f0b84154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b8ad39640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b84155340 0x7f0b840cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b8ad39640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840b5570 con 0x7f0b84159660 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b8ad39640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0b840b53f0 con 0x7f0b70004d40 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b8ad39640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0b840b56f0 con 0x7f0b84155340 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b83fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b84159660 0x7f0b84154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b83fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b84159660 0x7f0b84154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60290/0 (socket says 172.21.15.104:60290) 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b83fff640 1 -- 172.21.15.104:0/2876357436 learned_addr learned my addr 172.21.15.104:0/2876357436 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b88ad5640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b70004d40 0x7f0b84159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b892d6640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b84155340 0x7f0b840cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.120 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b83fff640 1 -- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b84155340 msgr2=0x7f0b840cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b83fff640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b84155340 0x7f0b840cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b83fff640 1 -- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b70004d40 msgr2=0x7f0b84159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b83fff640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b70004d40 0x7f0b84159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.119+0000 7f0b83fff640 1 -- 172.21.15.104:0/2876357436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b84155750 con 0x7f0b84159660 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.120+0000 7f0b83fff640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b84159660 0x7f0b84154e00 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f0b740015c0 tx=0x7f0b74001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.120+0000 7f0b817fa640 1 -- 172.21.15.104:0/2876357436 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74011950 con 0x7f0b84159660 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.120+0000 7f0b817fa640 1 -- 172.21.15.104:0/2876357436 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b74018020 con 0x7f0b84159660 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.120+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b84140b50 con 0x7f0b84159660 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.120+0000 7f0b817fa640 1 -- 172.21.15.104:0/2876357436 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74011d90 con 0x7f0b84159660 2024-09-17T03:06:20.121 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.120+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b841410f0 con 0x7f0b84159660 2024-09-17T03:06:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.121+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b840b5bf0 con 0x7f0b84159660 2024-09-17T03:06:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.122+0000 7f0b817fa640 1 -- 172.21.15.104:0/2876357436 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b74013450 con 0x7f0b84159660 2024-09-17T03:06:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.122+0000 7f0b817fa640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b64078b90 0x7f0b6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.122+0000 7f0b817fa640 1 -- 172.21.15.104:0/2876357436 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f0b7409de20 con 0x7f0b84159660 2024-09-17T03:06:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.122+0000 7f0b88ad5640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b64078b90 0x7f0b6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.122 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.123+0000 7f0b88ad5640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b64078b90 0x7f0b6407b0a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0b84073380 tx=0x7f0b7c009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:20.126 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.127+0000 7f0b817fa640 1 -- 172.21.15.104:0/2876357436 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b74022020 con 0x7f0b84159660 2024-09-17T03:06:20.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.339+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b840d0300 con 0x7f0b84159660 2024-09-17T03:06:20.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.340+0000 7f0b817fa640 1 -- 172.21.15.104:0/2876357436 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7f0b84155750 con 0x7f0b84159660 2024-09-17T03:06:20.342 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:20.342 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b64078b90 msgr2=0x7f0b6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b64078b90 0x7f0b6407b0a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0b84073380 tx=0x7f0b7c009500 comp rx=0 tx=0).stop 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b84159660 msgr2=0x7f0b84154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b84159660 0x7f0b84154e00 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f0b740015c0 tx=0x7f0b74001a80 comp rx=0 tx=0).stop 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 shutdown_connections 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0b64078b90 0x7f0b6407b0a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b84155340 0x7f0b840cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f0b84159660 0x7f0b84154e00 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 --2- 172.21.15.104:0/2876357436 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b70004d40 0x7f0b84159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 >> 172.21.15.104:0/2876357436 conn(0x7f0b840b3640 msgr2=0x7f0b841e80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:20.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 shutdown_connections 2024-09-17T03:06:20.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.342+0000 7f0b8ad39640 1 -- 172.21.15.104:0/2876357436 wait complete. 2024-09-17T03:06:20.353 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:06:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.465+0000 7fabc6990640 1 -- 172.21.15.104:0/80785612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00d0470 msgr2=0x7fabc00d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.465+0000 7fabc6990640 1 --2- 172.21.15.104:0/80785612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00d0470 0x7fabc00d0880 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fabc0074350 tx=0x7faba802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.465+0000 7fabc6990640 1 -- 172.21.15.104:0/80785612 shutdown_connections 2024-09-17T03:06:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.465+0000 7fabc6990640 1 --2- 172.21.15.104:0/80785612 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00d0470 0x7fabc00d0880 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.465+0000 7fabc6990640 1 --2- 172.21.15.104:0/80785612 >> v2:172.21.15.192:3300/0 conn(0x7fabc00b7bb0 0x7fabc00cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.465+0000 7fabc6990640 1 -- 172.21.15.104:0/80785612 >> 172.21.15.104:0/80785612 conn(0x7fabc00d28a0 msgr2=0x7fabc00d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.465+0000 7fabc6990640 1 -- 172.21.15.104:0/80785612 shutdown_connections 2024-09-17T03:06:20.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.465+0000 7fabc6990640 1 -- 172.21.15.104:0/80785612 wait complete. 2024-09-17T03:06:20.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.467+0000 7fabc6990640 1 Processor -- start 2024-09-17T03:06:20.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.467+0000 7fabc6990640 1 -- start start 2024-09-17T03:06:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.468+0000 7fabc6990640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabc00b7bb0 0x7fabc00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.468+0000 7fabc6990640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00cefb0 0x7fabc01d57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.468+0000 7fabc6990640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fabc00d0470 0x7fabc00ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.468+0000 7fabc6990640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fabc00b3590 con 0x7fabc00cefb0 2024-09-17T03:06:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.468+0000 7fabc6990640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fabc00ce5e0 con 0x7fabc00b7bb0 2024-09-17T03:06:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.468+0000 7fabc6990640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fabc00cfad0 con 0x7fabc00d0470 2024-09-17T03:06:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00cefb0 0x7fabc01d57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.469 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00cefb0 0x7fabc01d57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60302/0 (socket says 172.21.15.104:60302) 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 -- 172.21.15.104:0/3973598549 learned_addr learned my addr 172.21.15.104:0/3973598549 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbffff640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabc00b7bb0 0x7fabc00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabc4f2d640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fabc00d0470 0x7fabc00ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 -- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fabc00d0470 msgr2=0x7fabc00ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fabc00d0470 0x7fabc00ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 -- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabc00b7bb0 msgr2=0x7fabc00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabc00b7bb0 0x7fabc00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 -- 172.21.15.104:0/3973598549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc01f7620 con 0x7fabc00cefb0 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbf7fe640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00cefb0 0x7fabc01d57e0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7faba8034040 tx=0x7faba8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbcff9640 1 -- 172.21.15.104:0/3973598549 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba803e030 con 0x7fabc00cefb0 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbcff9640 1 -- 172.21.15.104:0/3973598549 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faba8003e00 con 0x7fabc00cefb0 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc01f7900 con 0x7fabc00cefb0 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabbcff9640 1 -- 172.21.15.104:0/3973598549 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8035040 con 0x7fabc00cefb0 2024-09-17T03:06:20.470 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.469+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc01f7ec0 con 0x7fabc00cefb0 2024-09-17T03:06:20.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.470+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc00cc990 con 0x7fabc00cefb0 2024-09-17T03:06:20.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.471+0000 7fabbcff9640 1 -- 172.21.15.104:0/3973598549 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faba8041030 con 0x7fabc00cefb0 2024-09-17T03:06:20.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.472+0000 7fabbcff9640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faba0078b90 0x7faba007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.472+0000 7fabbcff9640 1 -- 172.21.15.104:0/3973598549 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7faba80bb410 con 0x7fabc00cefb0 2024-09-17T03:06:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.472+0000 7fabbffff640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faba0078b90 0x7faba007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.472 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.472+0000 7fabbffff640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faba0078b90 0x7faba007b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fabb0005fd0 tx=0x7fabb000b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:20.476 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.476+0000 7fabbcff9640 1 -- 172.21.15.104:0/3973598549 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faba8083290 con 0x7fabc00cefb0 2024-09-17T03:06:20.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.684+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabc00cde90 con 0x7fabc00cefb0 2024-09-17T03:06:20.684 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.685+0000 7fabbcff9640 1 -- 172.21.15.104:0/3973598549 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5233 (secure 0 0 0) 0x7faba8087cc0 con 0x7fabc00cefb0 2024-09-17T03:06:20.685 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:20.685 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":76,"btime":"2024-09-17T03:05:57:490612+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:05:54.836560+0000","modified":"2024-09-17T03:05:56.844250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8151},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8151":{"gid":8151,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.104:6835/4053158179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":4053158179},{"type":"v1","addr":"172.21.15.104:6835","nonce":4053158179}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8151,"qdb_cluster":[8151]},"id":11}]} 2024-09-17T03:06:20.686 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 76 2024-09-17T03:06:20.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faba0078b90 msgr2=0x7faba007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faba0078b90 0x7faba007b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fabb0005fd0 tx=0x7fabb000b390 comp rx=0 tx=0).stop 2024-09-17T03:06:20.687 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00cefb0 msgr2=0x7fabc01d57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00cefb0 0x7fabc01d57e0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7faba8034040 tx=0x7faba8003910 comp rx=0 tx=0).stop 2024-09-17T03:06:20.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 shutdown_connections 2024-09-17T03:06:20.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7faba0078b90 0x7faba007b0a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fabc00d0470 0x7fabc00ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.688 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fabc00cefb0 0x7fabc01d57e0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 --2- 172.21.15.104:0/3973598549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabc00b7bb0 0x7fabc00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 >> 172.21.15.104:0/3973598549 conn(0x7fabc00d28a0 msgr2=0x7fabc00cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:20.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 shutdown_connections 2024-09-17T03:06:20.689 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.687+0000 7fabc6990640 1 -- 172.21.15.104:0/3973598549 wait complete. 2024-09-17T03:06:20.698 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:06:20.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.811+0000 7f7ff5838640 1 -- 172.21.15.104:0/2018918805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00d18e0 msgr2=0x7f7ff00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.812+0000 7f7ff5838640 1 --2- 172.21.15.104:0/2018918805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00d18e0 0x7f7ff00d34f0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8005fd0 tx=0x7f7fe802a8a0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.812 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.812+0000 7f7ff5838640 1 -- 172.21.15.104:0/2018918805 shutdown_connections 2024-09-17T03:06:20.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.812+0000 7f7ff5838640 1 --2- 172.21.15.104:0/2018918805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00d18e0 0x7f7ff00d34f0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.812+0000 7f7ff5838640 1 --2- 172.21.15.104:0/2018918805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff00b6f70 0x7f7ff015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.812+0000 7f7ff5838640 1 -- 172.21.15.104:0/2018918805 >> 172.21.15.104:0/2018918805 conn(0x7f7ff0073df0 msgr2=0x7f7ff0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:20.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.812+0000 7f7ff5838640 1 -- 172.21.15.104:0/2018918805 shutdown_connections 2024-09-17T03:06:20.813 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.812+0000 7f7ff5838640 1 -- 172.21.15.104:0/2018918805 wait complete. 2024-09-17T03:06:20.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.813+0000 7f7ff5838640 1 Processor -- start 2024-09-17T03:06:20.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.814+0000 7f7ff5838640 1 -- start start 2024-09-17T03:06:20.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7ff5838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00b3b00 0x7f7ff00cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7ff5838640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff00b6f70 0x7f7ff014da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.818 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7ff5838640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ff00d18e0 0x7f7ff01f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7ff5838640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff00d3dc0 con 0x7f7ff00b3b00 2024-09-17T03:06:20.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7ff5838640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff00d3c40 con 0x7f7ff00d18e0 2024-09-17T03:06:20.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7ff5838640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff00d3f40 con 0x7f7ff00b6f70 2024-09-17T03:06:20.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00b3b00 0x7f7ff00cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00b3b00 0x7f7ff00cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60320/0 (socket says 172.21.15.104:60320) 2024-09-17T03:06:20.819 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 -- 172.21.15.104:0/3348274805 learned_addr learned my addr 172.21.15.104:0/3348274805 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:20.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7fef7fe640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ff00d18e0 0x7f7ff01f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7fee7fc640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff00b6f70 0x7f7ff014da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.820 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 -- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff00b6f70 msgr2=0x7f7ff014da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff00b6f70 0x7f7ff014da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 -- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ff00d18e0 msgr2=0x7f7ff01f9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.821 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ff00d18e0 0x7f7ff01f9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 -- 172.21.15.104:0/3348274805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff00cc330 con 0x7f7ff00b3b00 2024-09-17T03:06:20.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7fef7fe640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ff00d18e0 0x7f7ff01f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:20.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.815+0000 7f7feeffd640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00b3b00 0x7f7ff00cafc0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000d780 tx=0x7f7fe000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:20.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.816+0000 7f7fd7fff640 1 -- 172.21.15.104:0/3348274805 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0017070 con 0x7f7ff00b3b00 2024-09-17T03:06:20.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.816+0000 7f7fd7fff640 1 -- 172.21.15.104:0/3348274805 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fe000de90 con 0x7f7ff00b3b00 2024-09-17T03:06:20.822 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.816+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff00cc610 con 0x7f7ff00b3b00 2024-09-17T03:06:20.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.816+0000 7f7fd7fff640 1 -- 172.21.15.104:0/3348274805 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00099d0 con 0x7f7ff00b3b00 2024-09-17T03:06:20.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.816+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff00ccbd0 con 0x7f7ff00b3b00 2024-09-17T03:06:20.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.817+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff0069080 con 0x7f7ff00b3b00 2024-09-17T03:06:20.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.817+0000 7f7fd7fff640 1 -- 172.21.15.104:0/3348274805 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fe0009b70 con 0x7f7ff00b3b00 2024-09-17T03:06:20.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.818+0000 7f7fd7fff640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7fdc078b90 0x7f7fdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:20.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.818+0000 7f7fd7fff640 1 -- 172.21.15.104:0/3348274805 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7f7fe009b1a0 con 0x7f7ff00b3b00 2024-09-17T03:06:20.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.818+0000 7f7fee7fc640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7fdc078b90 0x7f7fdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:20.823 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.819+0000 7f7fee7fc640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7fdc078b90 0x7f7fdc07b0a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0154920 tx=0x7f7fe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:20.824 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.823+0000 7f7fd7fff640 1 -- 172.21.15.104:0/3348274805 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7fe0020020 con 0x7f7ff00b3b00 2024-09-17T03:06:20.995 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.995+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ff00d4460 con 0x7f7ff00b3b00 2024-09-17T03:06:20.996 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.996+0000 7f7fd7fff640 1 -- 172.21.15.104:0/3348274805 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+16787 (secure 0 0 0) 0x7f7fe00635f0 con 0x7f7ff00b3b00 2024-09-17T03:06:20.996 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:20.996 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":188,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:06:13.203699+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:05:52.471547+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T03:05:53.802461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:06:20.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7fdc078b90 msgr2=0x7f7fdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.998 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7fdc078b90 0x7f7fdc07b0a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0154920 tx=0x7f7fe4009040 comp rx=0 tx=0).stop 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00b3b00 msgr2=0x7f7ff00cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00b3b00 0x7f7ff00cafc0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000d780 tx=0x7f7fe000dc40 comp rx=0 tx=0).stop 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 shutdown_connections 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f7fdc078b90 0x7f7fdc07b0a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ff00d18e0 0x7f7ff01f9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ff00b6f70 0x7f7ff014da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 --2- 172.21.15.104:0/3348274805 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f7ff00b3b00 0x7f7ff00cafc0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 >> 172.21.15.104:0/3348274805 conn(0x7f7ff0073df0 msgr2=0x7f7ff00ba2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 shutdown_connections 2024-09-17T03:06:20.999 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:20.999+0000 7f7ff5838640 1 -- 172.21.15.104:0/3348274805 wait complete. 2024-09-17T03:06:21.010 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:06:21.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.124+0000 7fb72cb20640 1 -- 172.21.15.104:0/1116433788 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7280b6ae0 msgr2=0x7fb7281600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:21.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.124+0000 7fb72cb20640 1 --2- 172.21.15.104:0/1116433788 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7280b6ae0 0x7fb7281600c0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fb72808d120 tx=0x7fb72002a820 comp rx=0 tx=0).stop 2024-09-17T03:06:21.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.124+0000 7fb72cb20640 1 -- 172.21.15.104:0/1116433788 shutdown_connections 2024-09-17T03:06:21.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.124+0000 7fb72cb20640 1 --2- 172.21.15.104:0/1116433788 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7280b6ae0 0x7fb7281600c0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.124 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.124+0000 7fb72cb20640 1 --2- 172.21.15.104:0/1116433788 >> v2:172.21.15.192:3300/0 conn(0x7fb728162cb0 0x7fb7280b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.124+0000 7fb72cb20640 1 -- 172.21.15.104:0/1116433788 >> 172.21.15.104:0/1116433788 conn(0x7fb728069120 msgr2=0x7fb728069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:21.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.124+0000 7fb72cb20640 1 -- 172.21.15.104:0/1116433788 shutdown_connections 2024-09-17T03:06:21.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.124+0000 7fb72cb20640 1 -- 172.21.15.104:0/1116433788 wait complete. 2024-09-17T03:06:21.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.126+0000 7fb72cb20640 1 Processor -- start 2024-09-17T03:06:21.125 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.126+0000 7fb72cb20640 1 -- start start 2024-09-17T03:06:21.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.127+0000 7fb72cb20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7280b6ae0 0x7fb728148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:21.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.127+0000 7fb72cb20640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb728162cb0 0x7fb7280caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:21.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.127+0000 7fb72cb20640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7281630c0 0x7fb7280ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:21.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb72cb20640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb728161e10 con 0x7fb7281630c0 2024-09-17T03:06:21.128 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb72cb20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb728161c90 con 0x7fb7280b6ae0 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb72cb20640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb728161f90 con 0x7fb728162cb0 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7281630c0 0x7fb7280ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7281630c0 0x7fb7280ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60350/0 (socket says 172.21.15.104:60350) 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 -- 172.21.15.104:0/3069369576 learned_addr learned my addr 172.21.15.104:0/3069369576 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb725d9b640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb728162cb0 0x7fb7280caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb72659c640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7280b6ae0 0x7fb728148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 -- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb728162cb0 msgr2=0x7fb7280caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb728162cb0 0x7fb7280caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 -- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7280b6ae0 msgr2=0x7fb728148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7280b6ae0 0x7fb728148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.129 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 -- 172.21.15.104:0/3069369576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb728155090 con 0x7fb7281630c0 2024-09-17T03:06:21.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb726d9d640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7281630c0 0x7fb7280ce270 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb720009b30 tx=0x7fb720032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:21.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb716ffd640 1 -- 172.21.15.104:0/3069369576 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720037040 con 0x7fb7281630c0 2024-09-17T03:06:21.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb716ffd640 1 -- 172.21.15.104:0/3069369576 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb720042070 con 0x7fb7281630c0 2024-09-17T03:06:21.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb728155370 con 0x7fb7281630c0 2024-09-17T03:06:21.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb716ffd640 1 -- 172.21.15.104:0/3069369576 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720004280 con 0x7fb7281630c0 2024-09-17T03:06:21.130 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.128+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb728155930 con 0x7fb7281630c0 2024-09-17T03:06:21.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.129+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb728162440 con 0x7fb7281630c0 2024-09-17T03:06:21.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.130+0000 7fb716ffd640 1 -- 172.21.15.104:0/3069369576 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb720004420 con 0x7fb7281630c0 2024-09-17T03:06:21.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.131+0000 7fb716ffd640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb708078b90 0x7fb70807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:21.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.131+0000 7fb716ffd640 1 -- 172.21.15.104:0/3069369576 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 5709+0+0 (secure 0 0 0) 0x7fb7200bc680 con 0x7fb7281630c0 2024-09-17T03:06:21.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.131+0000 7fb72659c640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb708078b90 0x7fb70807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:21.131 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.131+0000 7fb72659c640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb708078b90 0x7fb70807b0a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb718005fd0 tx=0x7fb718005dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:21.133 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.134+0000 7fb716ffd640 1 -- 172.21.15.104:0/3069369576 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb720084b50 con 0x7fb7281630c0 2024-09-17T03:06:21.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.344+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb7280d2b30 con 0x7fb7281630c0 2024-09-17T03:06:21.344 INFO:tasks.ceph.mon.a.smithi104.stderr:2024-09-17T03:06:21.344+0000 7f270410b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:06:21.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.346+0000 7fb716ffd640 1 -- 172.21.15.104:0/3069369576 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 161+0+0 (secure 0 0 0) 0x7fb720084450 con 0x7fb7281630c0 2024-09-17T03:06:21.345 INFO:teuthology.orchestra.run.smithi104.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:06:21.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.349+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb708078b90 msgr2=0x7fb70807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:21.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.349+0000 7fb72cb20640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb708078b90 0x7fb70807b0a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb718005fd0 tx=0x7fb718005dc0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.349+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7281630c0 msgr2=0x7fb7280ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:21.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.349+0000 7fb72cb20640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7281630c0 0x7fb7280ce270 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb720009b30 tx=0x7fb720032c90 comp rx=0 tx=0).stop 2024-09-17T03:06:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.350+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 shutdown_connections 2024-09-17T03:06:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.350+0000 7fb72cb20640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb708078b90 0x7fb70807b0a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.350+0000 7fb72cb20640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb7281630c0 0x7fb7280ce270 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.350+0000 7fb72cb20640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb728162cb0 0x7fb7280caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.350+0000 7fb72cb20640 1 --2- 172.21.15.104:0/3069369576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7280b6ae0 0x7fb728148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.350+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 >> 172.21.15.104:0/3069369576 conn(0x7fb728069120 msgr2=0x7fb72815e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:21.350 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.350+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 shutdown_connections 2024-09-17T03:06:21.351 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.351+0000 7fb72cb20640 1 -- 172.21.15.104:0/3069369576 wait complete. 2024-09-17T03:06:21.353 INFO:tasks.ceph.mds.c.smithi104.stderr: -8223> 2024-09-17T03:06:01.448+0000 7f5495e1e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:06:21.366 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:06:21.410 INFO:tasks.ceph.mds.c.smithi104.stdout:starting mds.c at 2024-09-17T03:06:21.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.483+0000 7fb0d5838640 1 -- 172.21.15.104:0/4231129516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00d18e0 msgr2=0x7fb0d00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:21.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.483+0000 7fb0d5838640 1 --2- 172.21.15.104:0/4231129516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00d18e0 0x7fb0d00d34f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8005fd0 tx=0x7fb0c802a9f0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.483+0000 7fb0d5838640 1 -- 172.21.15.104:0/4231129516 shutdown_connections 2024-09-17T03:06:21.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.483+0000 7fb0d5838640 1 --2- 172.21.15.104:0/4231129516 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00d18e0 0x7fb0d00d34f0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.483+0000 7fb0d5838640 1 --2- 172.21.15.104:0/4231129516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d00b6f70 0x7fb0d015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.483+0000 7fb0d5838640 1 -- 172.21.15.104:0/4231129516 >> 172.21.15.104:0/4231129516 conn(0x7fb0d0073df0 msgr2=0x7fb0d0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:21.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.483+0000 7fb0d5838640 1 -- 172.21.15.104:0/4231129516 shutdown_connections 2024-09-17T03:06:21.483 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.483+0000 7fb0d5838640 1 -- 172.21.15.104:0/4231129516 wait complete. 2024-09-17T03:06:21.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.484+0000 7fb0d5838640 1 Processor -- start 2024-09-17T03:06:21.484 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.485+0000 7fb0d5838640 1 -- start start 2024-09-17T03:06:21.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0d5838640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00b3b00 0x7fb0d014d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0d5838640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d00b6f70 0x7fb0d01534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0d5838640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d00d18e0 0x7fb0d014ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0d5838640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d00d3dc0 con 0x7fb0d00b3b00 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0d5838640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d00d3c40 con 0x7fb0d00d18e0 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0d5838640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d00d3f40 con 0x7fb0d00b6f70 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ceffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00b3b00 0x7fb0d014d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ceffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00b3b00 0x7fb0d014d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60392/0 (socket says 172.21.15.104:60392) 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ceffd640 1 -- 172.21.15.104:0/2498970267 learned_addr learned my addr 172.21.15.104:0/2498970267 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0cf7fe640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d00d18e0 0x7fb0d014ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ce7fc640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d00b6f70 0x7fb0d01534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ceffd640 1 -- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d00b6f70 msgr2=0x7fb0d01534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:21.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ceffd640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d00b6f70 0x7fb0d01534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ceffd640 1 -- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d00d18e0 msgr2=0x7fb0d014ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ceffd640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d00d18e0 0x7fb0d014ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0ceffd640 1 -- 172.21.15.104:0/2498970267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d0153230 con 0x7fb0d00b3b00 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.486+0000 7fb0cf7fe640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d00d18e0 0x7fb0d014ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.487+0000 7fb0ceffd640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00b3b00 0x7fb0d014d420 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000c970 tx=0x7fb0c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.487+0000 7fb0c7fff640 1 -- 172.21.15.104:0/2498970267 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0007bb0 con 0x7fb0d00b3b00 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.487+0000 7fb0c7fff640 1 -- 172.21.15.104:0/2498970267 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0c0007e40 con 0x7fb0d00b3b00 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.487+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d015f690 con 0x7fb0d00b3b00 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.487+0000 7fb0c7fff640 1 -- 172.21.15.104:0/2498970267 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000f690 con 0x7fb0d00b3b00 2024-09-17T03:06:21.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.487+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d015fe70 con 0x7fb0d00b3b00 2024-09-17T03:06:21.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.488+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d00d4460 con 0x7fb0d00b3b00 2024-09-17T03:06:21.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.489+0000 7fb0c7fff640 1 -- 172.21.15.104:0/2498970267 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb0c000f830 con 0x7fb0d00b3b00 2024-09-17T03:06:21.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.489+0000 7fb0c7fff640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0b0078bc0 0x7fb0b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:21.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.489+0000 7fb0c7fff640 1 -- 172.21.15.104:0/2498970267 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5795+0+0 (secure 0 0 0) 0x7fb0c009b620 con 0x7fb0d00b3b00 2024-09-17T03:06:21.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.490+0000 7fb0ce7fc640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0b0078bc0 0x7fb0b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:21.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.490+0000 7fb0ce7fc640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0b0078bc0 0x7fb0b007b0d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8006fd0 tx=0x7fb0b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:21.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.494+0000 7fb0c7fff640 1 -- 172.21.15.104:0/2498970267 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb0c0014030 con 0x7fb0d00b3b00 2024-09-17T03:06:21.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:21.703+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb0d0068da0 con 0x7fb0d00b3b00 2024-09-17T03:06:22.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.355+0000 7fb0c7fff640 1 -- 172.21.15.104:0/2498970267 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) ==== 104+0+0 (secure 0 0 0) 0x7fb0c0063a00 con 0x7fb0d00b3b00 2024-09-17T03:06:22.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0b0078bc0 msgr2=0x7fb0b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:22.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0b0078bc0 0x7fb0b007b0d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8006fd0 tx=0x7fb0b8008040 comp rx=0 tx=0).stop 2024-09-17T03:06:22.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00b3b00 msgr2=0x7fb0d014d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:22.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00b3b00 0x7fb0d014d420 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000c970 tx=0x7fb0c000ce30 comp rx=0 tx=0).stop 2024-09-17T03:06:22.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 shutdown_connections 2024-09-17T03:06:22.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb0b0078bc0 0x7fb0b007b0d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d00d18e0 0x7fb0d014ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0d00b6f70 0x7fb0d01534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 --2- 172.21.15.104:0/2498970267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb0d00b3b00 0x7fb0d014d420 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 >> 172.21.15.104:0/2498970267 conn(0x7fb0d0073df0 msgr2=0x7fb0d015e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:22.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 shutdown_connections 2024-09-17T03:06:22.359 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.358+0000 7fb0d5838640 1 -- 172.21.15.104:0/2498970267 wait complete. 2024-09-17T03:06:22.370 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:06:22.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 -- 172.21.15.104:0/1547015886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b72f0 msgr2=0x7f67740b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:22.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 --2- 172.21.15.104:0/1547015886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b72f0 0x7f67740b7700 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f67740d3aa0 tx=0x7f676c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:06:22.489 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 -- 172.21.15.104:0/1547015886 shutdown_connections 2024-09-17T03:06:22.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 --2- 172.21.15.104:0/1547015886 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b72f0 0x7f67740b7700 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 --2- 172.21.15.104:0/1547015886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b7ce0 0x7f67740b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 --2- 172.21.15.104:0/1547015886 >> v2:172.21.15.192:3300/0 conn(0x7f6774160580 0x7f67740b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 -- 172.21.15.104:0/1547015886 >> 172.21.15.104:0/1547015886 conn(0x7f67740b4580 msgr2=0x7f67740b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:22.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 -- 172.21.15.104:0/1547015886 shutdown_connections 2024-09-17T03:06:22.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.489+0000 7f677a532640 1 -- 172.21.15.104:0/1547015886 wait complete. 2024-09-17T03:06:22.490 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.491+0000 7f677a532640 1 Processor -- start 2024-09-17T03:06:22.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.491+0000 7f677a532640 1 -- start start 2024-09-17T03:06:22.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f677a532640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b72f0 0x7f67740cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:22.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f677a532640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b7ce0 0x7f677415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:22.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f677a532640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774160580 0x7f677415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:22.493 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f677a532640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6774165e90 con 0x7f67740b7ce0 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f677a532640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6774165d10 con 0x7f6774160580 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f677a532640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f6774166010 con 0x7f67740b72f0 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b7ce0 0x7f677415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b7ce0 0x7f677415a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60408/0 (socket says 172.21.15.104:60408) 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 -- 172.21.15.104:0/3634889972 learned_addr learned my addr 172.21.15.104:0/3634889972 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f6778acf640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774160580 0x7f677415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f6773fff640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b72f0 0x7f67740cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 -- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b72f0 msgr2=0x7f67740cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b72f0 0x7f67740cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 -- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774160580 msgr2=0x7f677415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774160580 0x7f677415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 -- 172.21.15.104:0/3634889972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67740b1790 con 0x7f67740b7ce0 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f67737fe640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b7ce0 0x7f677415a350 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f676800c970 tx=0x7f676800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:22.494 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f6770ff9640 1 -- 172.21.15.104:0/3634889972 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768007bb0 con 0x7f67740b7ce0 2024-09-17T03:06:22.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f6770ff9640 1 -- 172.21.15.104:0/3634889972 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6768007e40 con 0x7f67740b7ce0 2024-09-17T03:06:22.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67740b0ef0 con 0x7f67740b7ce0 2024-09-17T03:06:22.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.493+0000 7f6770ff9640 1 -- 172.21.15.104:0/3634889972 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676800f6b0 con 0x7f67740b7ce0 2024-09-17T03:06:22.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.494+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67740b14b0 con 0x7f67740b7ce0 2024-09-17T03:06:22.495 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.495+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67740b7700 con 0x7f67740b7ce0 2024-09-17T03:06:22.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.495+0000 7f6770ff9640 1 -- 172.21.15.104:0/3634889972 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6768018400 con 0x7f67740b7ce0 2024-09-17T03:06:22.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.496+0000 7f6770ff9640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6760078b90 0x7f676007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:22.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.496+0000 7f6770ff9640 1 -- 172.21.15.104:0/3634889972 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(189..189 src has 1..189) ==== 5795+0+0 (secure 0 0 0) 0x7f676809b2e0 con 0x7f67740b7ce0 2024-09-17T03:06:22.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.496+0000 7f6773fff640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6760078b90 0x7f676007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:22.496 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.497+0000 7f6773fff640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6760078b90 0x7f676007b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f676400bb50 tx=0x7f676400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:22.499 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.500+0000 7f6770ff9640 1 -- 172.21.15.104:0/3634889972 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6768014030 con 0x7f67740b7ce0 2024-09-17T03:06:22.673 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:22.674+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f67740b0c40 con 0x7f67740b7ce0 2024-09-17T03:06:23.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.206+0000 7f6770ff9640 1 -- 172.21.15.104:0/3634889972 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v190) ==== 181+0+0 (secure 0 0 0) 0x7f6768063190 con 0x7f67740b7ce0 2024-09-17T03:06:23.206 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:06:23.207 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6760078b90 msgr2=0x7f676007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6760078b90 0x7f676007b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f676400bb50 tx=0x7f676400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b7ce0 msgr2=0x7f677415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b7ce0 0x7f677415a350 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f676800c970 tx=0x7f676800ce30 comp rx=0 tx=0).stop 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 shutdown_connections 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f6760078b90 0x7f676007b0a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6774160580 0x7f677415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f67740b7ce0 0x7f677415a350 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 --2- 172.21.15.104:0/3634889972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67740b72f0 0x7f67740cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 >> 172.21.15.104:0/3634889972 conn(0x7f67740b4580 msgr2=0x7f67740b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 shutdown_connections 2024-09-17T03:06:23.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.208+0000 7f677a532640 1 -- 172.21.15.104:0/3634889972 wait complete. 2024-09-17T03:06:23.221 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:06:23.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.339+0000 7f111b36e640 1 -- 172.21.15.104:0/3302465205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1100005350 msgr2=0x7f110000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:23.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.339+0000 7f111b36e640 1 --2- 172.21.15.104:0/3302465205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1100005350 0x7f110000b9c0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f110c001dc0 tx=0x7f1100005830 comp rx=0 tx=0).stop 2024-09-17T03:06:23.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.339+0000 7f111b36e640 1 -- 172.21.15.104:0/3302465205 shutdown_connections 2024-09-17T03:06:23.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.339+0000 7f111b36e640 1 --2- 172.21.15.104:0/3302465205 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1100005350 0x7f110000b9c0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:23.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.339+0000 7f111b36e640 1 -- 172.21.15.104:0/3302465205 >> 172.21.15.104:0/3302465205 conn(0x7f11140d4c20 msgr2=0x7f11140d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:23.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.339+0000 7f111b36e640 1 -- 172.21.15.104:0/3302465205 shutdown_connections 2024-09-17T03:06:23.339 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.339+0000 7f111b36e640 1 -- 172.21.15.104:0/3302465205 wait complete. 2024-09-17T03:06:23.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.341+0000 7f111b36e640 1 Processor -- start 2024-09-17T03:06:23.340 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.341+0000 7f111b36e640 1 -- start start 2024-09-17T03:06:23.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111b36e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100005350 0x7f1114158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:23.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111b36e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11140c9070 0x7f111415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111b36e640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11141f64a0 0x7f111415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111b36e640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f11140b2d90 con 0x7f11140c9070 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111b36e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f11140b2c10 con 0x7f1100005350 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111b36e640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f11140b2f10 con 0x7f11141f64a0 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11140c9070 0x7f111415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11140c9070 0x7f111415a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:60422/0 (socket says 172.21.15.104:60422) 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 -- 172.21.15.104:0/466151883 learned_addr learned my addr 172.21.15.104:0/466151883 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111910a640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100005350 0x7f1114158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111990b640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11141f64a0 0x7f111415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 -- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11141f64a0 msgr2=0x7f111415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11141f64a0 0x7f111415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:23.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 -- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100005350 msgr2=0x7f1114158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100005350 0x7f1114158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 -- 172.21.15.104:0/466151883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1114159880 con 0x7f11140c9070 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111910a640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100005350 0x7f1114158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f111990b640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11141f64a0 0x7f111415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.342+0000 7f1118909640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11140c9070 0x7f111415a0f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1104006630 tx=0x7f11040039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.343+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104015070 con 0x7f11140c9070 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.343+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1104011920 con 0x7f11140c9070 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.343+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11141f5a00 con 0x7f11140c9070 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.343+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104011d70 con 0x7f11140c9070 2024-09-17T03:06:23.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.343+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141f5ca0 con 0x7f11140c9070 2024-09-17T03:06:23.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.344+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11141f5820 con 0x7f11140c9070 2024-09-17T03:06:23.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.345+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1104018070 con 0x7f11140c9070 2024-09-17T03:06:23.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.345+0000 7f1109ffb640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:23.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.345+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 5357+0+0 (secure 0 0 0) 0x7f110409b990 con 0x7f11140c9070 2024-09-17T03:06:23.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.345+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=191}) -- 0x7f10f807fa10 con 0x7f11140c9070 2024-09-17T03:06:23.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.345+0000 7f111910a640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:23.346 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.346+0000 7f111910a640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1110009a20 tx=0x7f1110005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:23.349 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.350+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11141f5820 con 0x7f11140c9070 2024-09-17T03:06:23.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:23.523+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f11140b3470 con 0x7f11140c9070 2024-09-17T03:06:24.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.242+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v191) ==== 169+0+0 (secure 0 0 0) 0x7f1114159880 con 0x7f11140c9070 2024-09-17T03:06:24.241 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'cephfs_data' removed 2024-09-17T03:06:24.243 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.244+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 <== mon.0 v2:172.21.15.104:3300/0 8 ==== osd_map(191..191 src has 1..191) ==== 296+0+0 (secure 0 0 0) 0x7f110409a130 con 0x7f11140c9070 2024-09-17T03:06:24.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.244+0000 7f1109ffb640 1 -- 172.21.15.104:0/466151883 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=192}) -- 0x7f10f807e7a0 con 0x7f11140c9070 2024-09-17T03:06:24.246 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.247+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 msgr2=0x7f10f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.247+0000 7f111b36e640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1110009a20 tx=0x7f1110005f90 comp rx=0 tx=0).stop 2024-09-17T03:06:24.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.247+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11140c9070 msgr2=0x7f111415a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.248 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.247+0000 7f111b36e640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11140c9070 0x7f111415a0f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1104006630 tx=0x7f11040039c0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.249+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 shutdown_connections 2024-09-17T03:06:24.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.249+0000 7f111b36e640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f10f8078b90 0x7f10f807b0a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.249+0000 7f111b36e640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11141f64a0 0x7f111415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.249+0000 7f111b36e640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f11140c9070 0x7f111415a0f0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.249+0000 7f111b36e640 1 --2- 172.21.15.104:0/466151883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100005350 0x7f1114158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.250+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 >> 172.21.15.104:0/466151883 conn(0x7f11140d4c20 msgr2=0x7f11141e7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:24.249 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.250+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 shutdown_connections 2024-09-17T03:06:24.250 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.251+0000 7f111b36e640 1 -- 172.21.15.104:0/466151883 wait complete. 2024-09-17T03:06:24.265 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 23 2024-09-17T03:06:24.382 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.382+0000 7fef7d3a1640 1 -- 172.21.15.104:0/2520148225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 msgr2=0x7fef7815f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.382+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/2520148225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 0x7fef7815f600 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009830 tx=0x7fef6c02a480 comp rx=0 tx=0).stop 2024-09-17T03:06:24.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.382+0000 7fef7d3a1640 1 -- 172.21.15.104:0/2520148225 shutdown_connections 2024-09-17T03:06:24.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.382+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/2520148225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 0x7fef7815f600 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.382+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/2520148225 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef780b65e0 0x7fef780b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.382+0000 7fef7d3a1640 1 -- 172.21.15.104:0/2520148225 >> 172.21.15.104:0/2520148225 conn(0x7fef78069120 msgr2=0x7fef78069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:24.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.382+0000 7fef7d3a1640 1 -- 172.21.15.104:0/2520148225 shutdown_connections 2024-09-17T03:06:24.383 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.382+0000 7fef7d3a1640 1 -- 172.21.15.104:0/2520148225 wait complete. 2024-09-17T03:06:24.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.384+0000 7fef7d3a1640 1 Processor -- start 2024-09-17T03:06:24.385 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.384+0000 7fef7d3a1640 1 -- start start 2024-09-17T03:06:24.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.385+0000 7fef7d3a1640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef780b65e0 0x7fef780ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:24.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef7d3a1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 0x7fef780b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:24.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef7d3a1640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7815fb40 0x7fef780c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:24.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef7d3a1640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fef78163490 con 0x7fef780b65e0 2024-09-17T03:06:24.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef7d3a1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fef781625a0 con 0x7fef7815f1f0 2024-09-17T03:06:24.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef7d3a1640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fef78163610 con 0x7fef7815fb40 2024-09-17T03:06:24.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef780b65e0 0x7fef780ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:24.389 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef780b65e0 0x7fef780ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55744/0 (socket says 172.21.15.104:55744) 2024-09-17T03:06:24.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 -- 172.21.15.104:0/4239804604 learned_addr learned my addr 172.21.15.104:0/4239804604 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:24.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef767fc640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 0x7fef780b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:24.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef777fe640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7815fb40 0x7fef780c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:24.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 -- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7815fb40 msgr2=0x7fef780c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7815fb40 0x7fef780c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.390 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 -- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 msgr2=0x7fef780b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 0x7fef780b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 -- 172.21.15.104:0/4239804604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef780b41a0 con 0x7fef780b65e0 2024-09-17T03:06:24.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef767fc640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 0x7fef780b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:24.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef76ffd640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef780b65e0 0x7fef780ab410 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fef6800eb10 tx=0x7fef6800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:24.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef5f7fe640 1 -- 172.21.15.104:0/4239804604 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68003970 con 0x7fef780b65e0 2024-09-17T03:06:24.391 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef5f7fe640 1 -- 172.21.15.104:0/4239804604 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef68003c00 con 0x7fef780b65e0 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef780c9040 con 0x7fef780b65e0 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef5f7fe640 1 -- 172.21.15.104:0/4239804604 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68004030 con 0x7fef780b65e0 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.386+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef780ca4f0 con 0x7fef780b65e0 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.387+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef780c9560 con 0x7fef780b65e0 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.388+0000 7fef5f7fe640 1 -- 172.21.15.104:0/4239804604 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef680041d0 con 0x7fef780b65e0 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.388+0000 7fef5f7fe640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fef64078bc0 0x7fef6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.389+0000 7fef5f7fe640 1 -- 172.21.15.104:0/4239804604 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fef6809b920 con 0x7fef780b65e0 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.389+0000 7fef767fc640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fef64078bc0 0x7fef6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:24.392 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.390+0000 7fef767fc640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fef64078bc0 0x7fef6407b0d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fef6c034000 tx=0x7fef6c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:24.393 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.393+0000 7fef5f7fe640 1 -- 172.21.15.104:0/4239804604 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fef780c9560 con 0x7fef780b65e0 2024-09-17T03:06:24.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.569+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "config reset", "num": 23} v 0) -- 0x7fef78163b30 con 0x7fef780b65e0 2024-09-17T03:06:24.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.575+0000 7fef5f7fe640 1 -- 172.21.15.104:0/4239804604 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 23}]=0 v43) ==== 71+0+0 (secure 0 0 0) 0x7fef680640f0 con 0x7fef780b65e0 2024-09-17T03:06:24.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fef64078bc0 msgr2=0x7fef6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fef64078bc0 0x7fef6407b0d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fef6c034000 tx=0x7fef6c004730 comp rx=0 tx=0).stop 2024-09-17T03:06:24.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef780b65e0 msgr2=0x7fef780ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef780b65e0 0x7fef780ab410 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fef6800eb10 tx=0x7fef6800c2d0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 shutdown_connections 2024-09-17T03:06:24.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fef64078bc0 0x7fef6407b0d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7815f1f0 0x7fef780b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef7815fb40 0x7fef780c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 --2- 172.21.15.104:0/4239804604 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fef780b65e0 0x7fef780ab410 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.577+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 >> 172.21.15.104:0/4239804604 conn(0x7fef78069120 msgr2=0x7fef780d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:24.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.578+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 shutdown_connections 2024-09-17T03:06:24.578 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.578+0000 7fef7d3a1640 1 -- 172.21.15.104:0/4239804604 wait complete. 2024-09-17T03:06:24.588 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-17T03:06:24.702 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/226032149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f00734f0 msgr2=0x7fd7f0073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/226032149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f00734f0 0x7fd7f0073900 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0072420 tx=0x7fd7e402a560 comp rx=0 tx=0).stop 2024-09-17T03:06:24.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/226032149 shutdown_connections 2024-09-17T03:06:24.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/226032149 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f00b0500 0x7fd7f00b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/226032149 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f00734f0 0x7fd7f0073900 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/226032149 >> v2:172.21.15.192:3300/0 conn(0x7fd7f015c220 0x7fd7f006f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/226032149 >> 172.21.15.104:0/226032149 conn(0x7fd7f006d200 msgr2=0x7fd7f006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:24.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/226032149 shutdown_connections 2024-09-17T03:06:24.703 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.703+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/226032149 wait complete. 2024-09-17T03:06:24.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.705+0000 7fd7f5ef2640 1 Processor -- start 2024-09-17T03:06:24.704 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.705+0000 7fd7f5ef2640 1 -- start start 2024-09-17T03:06:24.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7f5ef2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f00734f0 0x7fd7f014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:24.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7f5ef2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f00b0500 0x7fd7f015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:24.707 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7f5ef2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f015c220 0x7fd7f0158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7f5ef2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f00b11e0 con 0x7fd7f015c220 2024-09-17T03:06:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7f5ef2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f00b1060 con 0x7fd7f00734f0 2024-09-17T03:06:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7f5ef2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fd7f015f6f0 con 0x7fd7f00b0500 2024-09-17T03:06:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7effff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f015c220 0x7fd7f0158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7effff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f015c220 0x7fd7f0158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55754/0 (socket says 172.21.15.104:55754) 2024-09-17T03:06:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7effff640 1 -- 172.21.15.104:0/987675435 learned_addr learned my addr 172.21.15.104:0/987675435 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7eeffd640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f00b0500 0x7fd7f015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:24.708 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.706+0000 7fd7ef7fe640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f00734f0 0x7fd7f014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7effff640 1 -- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f00b0500 msgr2=0x7fd7f015b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7effff640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f00b0500 0x7fd7f015b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7effff640 1 -- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f00734f0 msgr2=0x7fd7f014af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7effff640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f00734f0 0x7fd7f014af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7effff640 1 -- 172.21.15.104:0/987675435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f00b1400 con 0x7fd7f015c220 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7ef7fe640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f00734f0 0x7fd7f014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7effff640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f015c220 0x7fd7f0158840 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800b9e0 tx=0x7fd7e800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7d7fff640 1 -- 172.21.15.104:0/987675435 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8019070 con 0x7fd7f015c220 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7d7fff640 1 -- 172.21.15.104:0/987675435 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e800cc30 con 0x7fd7f015c220 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f00b16a0 con 0x7fd7f015c220 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7d7fff640 1 -- 172.21.15.104:0/987675435 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80146a0 con 0x7fd7f015c220 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.707+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f015aed0 con 0x7fd7f015c220 2024-09-17T03:06:24.709 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.708+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f00b0910 con 0x7fd7f015c220 2024-09-17T03:06:24.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.709+0000 7fd7d7fff640 1 -- 172.21.15.104:0/987675435 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7e801c070 con 0x7fd7f015c220 2024-09-17T03:06:24.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.709+0000 7fd7d7fff640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7dc078b90 0x7fd7dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:24.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.709+0000 7fd7d7fff640 1 -- 172.21.15.104:0/987675435 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fd7e809a710 con 0x7fd7f015c220 2024-09-17T03:06:24.710 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.709+0000 7fd7ef7fe640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7dc078b90 0x7fd7dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:24.711 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.710+0000 7fd7ef7fe640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7dc078b90 0x7fd7dc07b0a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009890 tx=0x7fd7e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:24.713 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.713+0000 7fd7d7fff640 1 -- 172.21.15.104:0/987675435 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd7e800ce20 con 0x7fd7f015c220 2024-09-17T03:06:24.954 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:24.955+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7fd7f0070810 con 0x7fd7f015c220 2024-09-17T03:06:25.236 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.237+0000 7fd7d7fff640 1 -- 172.21.15.104:0/987675435 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v543) ==== 135+0+0 (secure 0 0 0) 0x7fd7e8062ee0 con 0x7fd7f015c220 2024-09-17T03:06:25.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7dc078b90 msgr2=0x7fd7dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:25.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7dc078b90 0x7fd7dc07b0a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009890 tx=0x7fd7e0008040 comp rx=0 tx=0).stop 2024-09-17T03:06:25.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f015c220 msgr2=0x7fd7f0158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:25.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f015c220 0x7fd7f0158840 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800b9e0 tx=0x7fd7e800bea0 comp rx=0 tx=0).stop 2024-09-17T03:06:25.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 shutdown_connections 2024-09-17T03:06:25.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fd7dc078b90 0x7fd7dc07b0a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:25.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fd7f015c220 0x7fd7f0158840 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:25.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f00b0500 0x7fd7f015b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:25.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 --2- 172.21.15.104:0/987675435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f00734f0 0x7fd7f014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:25.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 >> 172.21.15.104:0/987675435 conn(0x7fd7f006d200 msgr2=0x7fd7f00cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:25.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 shutdown_connections 2024-09-17T03:06:25.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:25.239+0000 7fd7f5ef2640 1 -- 172.21.15.104:0/987675435 wait complete. 2024-09-17T03:06:25.250 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-17T03:06:25.251 INFO:tasks.cephfs_test_runner: 2024-09-17T03:06:25.251 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T03:06:25.251 INFO:tasks.cephfs_test_runner:Ran 10 tests in 679.097s 2024-09-17T03:06:25.251 INFO:tasks.cephfs_test_runner: 2024-09-17T03:06:25.251 INFO:tasks.cephfs_test_runner:OK 2024-09-17T03:06:25.251 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T03:06:25.260 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T03:06:25.295 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T03:06:25.295 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:25.295 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:25.312 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:06:25.312 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-17T03:06:25.312 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:25.368 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=562 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:06:25.369 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:06:25.369 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:25.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:06:25.389 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-17T03:06:25.389 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:06:25.448 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14617 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:06:25.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.449 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T03:06:25.465 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:06:25.465 INFO:teuthology.orchestra.run.smithi104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:06:25.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.466 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:06:25.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:06:25.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.598 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-09-17T03:06:25.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.699 DEBUG:teuthology.orchestra.run.smithi104:> ip netns list 2024-09-17T03:06:25.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.715 DEBUG:teuthology.orchestra.run.smithi104:> sudo ip link delete ceph-brx 2024-09-17T03:06:25.782 INFO:teuthology.orchestra.run.smithi104.stderr:Cannot find device "ceph-brx" 2024-09-17T03:06:25.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:06:25.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.784 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T03:06:25.803 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:06:25.803 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:06:25.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.803 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:06:25.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.873 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:06:25.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:25.942 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-17T03:06:26.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:26.042 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-17T03:06:26.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:06:26.059 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-17T03:06:26.127 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-17T03:06:26.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:06:26.129 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T03:06:26.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:06:26.141 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:06:26.256 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 -- 172.21.15.104:0/2952861723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e8415dd20 msgr2=0x7f5e840cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2952861723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e8415dd20 0x7f5e840cd170 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f5e840b34f0 tx=0x7f5e6c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 -- 172.21.15.104:0/2952861723 shutdown_connections 2024-09-17T03:06:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2952861723 >> v2:172.21.15.192:3300/0 conn(0x7f5e840cd6b0 0x7f5e84156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2952861723 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e8415dd20 0x7f5e840cd170 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2952861723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e840744d0 0x7f5e8406fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 -- 172.21.15.104:0/2952861723 >> 172.21.15.104:0/2952861723 conn(0x7f5e840b2450 msgr2=0x7f5e840b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 -- 172.21.15.104:0/2952861723 shutdown_connections 2024-09-17T03:06:26.257 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.257+0000 7f5e890d3640 1 -- 172.21.15.104:0/2952861723 wait complete. 2024-09-17T03:06:26.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.259+0000 7f5e890d3640 1 Processor -- start 2024-09-17T03:06:26.258 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.259+0000 7f5e890d3640 1 -- start start 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e890d3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e840744d0 0x7f5e841f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e890d3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e840cd6b0 0x7f5e8415b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e890d3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e8415dd20 0x7f5e84153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e890d3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841572d0 con 0x7f5e840744d0 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e890d3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84157150 con 0x7f5e8415dd20 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e890d3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5e84157450 con 0x7f5e840cd6b0 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e82d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e840744d0 0x7f5e841f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e82d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e840744d0 0x7f5e841f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55774/0 (socket says 172.21.15.104:55774) 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e82d9d640 1 -- 172.21.15.104:0/2204008537 learned_addr learned my addr 172.21.15.104:0/2204008537 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e8359e640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e8415dd20 0x7f5e84153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.261 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.260+0000 7f5e7a59c640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e840cd6b0 0x7f5e8415b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e82d9d640 1 -- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e840cd6b0 msgr2=0x7f5e8415b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e82d9d640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e840cd6b0 0x7f5e8415b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e82d9d640 1 -- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e8415dd20 msgr2=0x7f5e84153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e82d9d640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e8415dd20 0x7f5e84153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e82d9d640 1 -- 172.21.15.104:0/2204008537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e84143040 con 0x7f5e840744d0 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e82d9d640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e840744d0 0x7f5e841f44a0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400d650 tx=0x7f5e7400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e7bfff640 1 -- 172.21.15.104:0/2204008537 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74017070 con 0x7f5e840744d0 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e84143320 con 0x7f5e840744d0 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e7bfff640 1 -- 172.21.15.104:0/2204008537 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e74009b10 con 0x7f5e840744d0 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e7bfff640 1 -- 172.21.15.104:0/2204008537 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74010460 con 0x7f5e840744d0 2024-09-17T03:06:26.262 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.261+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e841438e0 con 0x7f5e840744d0 2024-09-17T03:06:26.263 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.262+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e8406a740 con 0x7f5e840744d0 2024-09-17T03:06:26.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.263+0000 7f5e7bfff640 1 -- 172.21.15.104:0/2204008537 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e7401a070 con 0x7f5e840744d0 2024-09-17T03:06:26.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.263+0000 7f5e7bfff640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e64078b90 0x7f5e6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.263+0000 7f5e7bfff640 1 -- 172.21.15.104:0/2204008537 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f5e7409ab40 con 0x7f5e840744d0 2024-09-17T03:06:26.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.263+0000 7f5e7a59c640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e64078b90 0x7f5e6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.264 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.264+0000 7f5e7a59c640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e64078b90 0x7f5e6407b0a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c033000 tx=0x7f5e6c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:26.267 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.268+0000 7f5e7bfff640 1 -- 172.21.15.104:0/2204008537 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5e8406a740 con 0x7f5e840744d0 2024-09-17T03:06:26.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.437+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e84156a00 con 0x7f5e64078b90 2024-09-17T03:06:26.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.438+0000 7f5e7bfff640 1 -- 172.21.15.104:0/2204008537 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12585 (secure 0 0 0) 0x7f5e84156a00 con 0x7f5e64078b90 2024-09-17T03:06:26.438 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:26.438 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:06:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e64078b90 msgr2=0x7f5e6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e64078b90 0x7f5e6407b0a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c033000 tx=0x7f5e6c004730 comp rx=0 tx=0).stop 2024-09-17T03:06:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e840744d0 msgr2=0x7f5e841f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e840744d0 0x7f5e841f44a0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400d650 tx=0x7f5e7400db10 comp rx=0 tx=0).stop 2024-09-17T03:06:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 shutdown_connections 2024-09-17T03:06:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5e64078b90 0x7f5e6407b0a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.440 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e8415dd20 0x7f5e84153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e840cd6b0 0x7f5e8415b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 --2- 172.21.15.104:0/2204008537 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5e840744d0 0x7f5e841f44a0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.440+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 >> 172.21.15.104:0/2204008537 conn(0x7f5e840b2450 msgr2=0x7f5e840ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.441+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 shutdown_connections 2024-09-17T03:06:26.441 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.441+0000 7f5e890d3640 1 -- 172.21.15.104:0/2204008537 wait complete. 2024-09-17T03:06:26.451 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2024-09-17T03:06:25.809031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":111962,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450537,"statfs":{"total":1600000000,"available":1485349902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16820700,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-93,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":443,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-17T03:06:21.349811+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:06:21.349811+0000","last_peered":"2024-09-17T03:06:21.349811+0000","last_clean":"2024-09-17T03:06:21.349811+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:06:21.349811+0000","last_undegraded":"2024-09-17T03:06:21.349811+0000","last_fullsized":"2024-09-17T03:06:21.349811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9862,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185450,"statfs":{"total":200000000,"available":189900864,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175841,"statfs":{"total":200000000,"available":180061560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21513,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173798,"statfs":{"total":200000000,"available":177970109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7243,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188069,"statfs":{"total":200000000,"available":192582975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186087,"statfs":{"total":200000000,"available":190553389,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21519,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173793,"statfs":{"total":200000000,"available":177964542,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13326,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181985,"statfs":{"total":200000000,"available":186353206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185510,"statfs":{"total":200000000,"available":189963257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:06:26.451 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:06:26.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.564+0000 7f97ecf69640 1 -- 172.21.15.104:0/2971153039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e81630c0 msgr2=0x7f97e80b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.564+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2971153039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e81630c0 0x7f97e80b6ae0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f97d0005fd0 tx=0x7f97d002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.564+0000 7f97ecf69640 1 -- 172.21.15.104:0/2971153039 shutdown_connections 2024-09-17T03:06:26.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.564+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2971153039 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e81630c0 0x7f97e80b6ae0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.564+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2971153039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97e8162cb0 0x7f97e80b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.564+0000 7f97ecf69640 1 -- 172.21.15.104:0/2971153039 >> 172.21.15.104:0/2971153039 conn(0x7f97e8069120 msgr2=0x7f97e8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:26.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.564+0000 7f97ecf69640 1 -- 172.21.15.104:0/2971153039 shutdown_connections 2024-09-17T03:06:26.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.564+0000 7f97ecf69640 1 -- 172.21.15.104:0/2971153039 wait complete. 2024-09-17T03:06:26.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.566+0000 7f97ecf69640 1 Processor -- start 2024-09-17T03:06:26.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.566+0000 7f97ecf69640 1 -- start start 2024-09-17T03:06:26.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ecf69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97e81611d0 0x7f97e81f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ecf69640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e8162cb0 0x7f97e814bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ecf69640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97e81630c0 0x7f97e80b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ecf69640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f97e8161cf0 con 0x7f97e8162cb0 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ecf69640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f97e81605e0 con 0x7f97e81611d0 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ecf69640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f97e8161e70 con 0x7f97e81630c0 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ddd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e8162cb0 0x7f97e814bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ddd9b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e8162cb0 0x7f97e814bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55792/0 (socket says 172.21.15.104:55792) 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.567+0000 7f97ddd9b640 1 -- 172.21.15.104:0/2651416399 learned_addr learned my addr 172.21.15.104:0/2651416399 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97e659c640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97e81611d0 0x7f97e81f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97e6d9d640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97e81630c0 0x7f97e80b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97ddd9b640 1 -- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97e81630c0 msgr2=0x7f97e80b94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.569 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97ddd9b640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97e81630c0 0x7f97e80b94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97ddd9b640 1 -- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97e81611d0 msgr2=0x7f97e81f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97ddd9b640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97e81611d0 0x7f97e81f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97ddd9b640 1 -- 172.21.15.104:0/2651416399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e81f9f30 con 0x7f97e8162cb0 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97ddd9b640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e8162cb0 0x7f97e814bd70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f97d0034040 tx=0x7f97d00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97df7fe640 1 -- 172.21.15.104:0/2651416399 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d003e030 con 0x7f97e8162cb0 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97df7fe640 1 -- 172.21.15.104:0/2651416399 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97d0003ae0 con 0x7f97e8162cb0 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e81fa210 con 0x7f97e8162cb0 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97df7fe640 1 -- 172.21.15.104:0/2651416399 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0035040 con 0x7f97e8162cb0 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.568+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e8159d80 con 0x7f97e8162cb0 2024-09-17T03:06:26.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.569+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e81f9ca0 con 0x7f97e8162cb0 2024-09-17T03:06:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.570+0000 7f97df7fe640 1 -- 172.21.15.104:0/2651416399 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f97d0041030 con 0x7f97e8162cb0 2024-09-17T03:06:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.571+0000 7f97df7fe640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f97c8078b90 0x7f97c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.571+0000 7f97df7fe640 1 -- 172.21.15.104:0/2651416399 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f97d00baf20 con 0x7f97e8162cb0 2024-09-17T03:06:26.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.571+0000 7f97e659c640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f97c8078b90 0x7f97c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.571+0000 7f97e659c640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f97c8078b90 0x7f97c807b0a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009c80 tx=0x7f97d8005f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:26.575 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.575+0000 7f97df7fe640 1 -- 172.21.15.104:0/2651416399 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f97d0083010 con 0x7f97e8162cb0 2024-09-17T03:06:26.745 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.746+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97e80b7ed0 con 0x7f97c8078b90 2024-09-17T03:06:26.746 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.747+0000 7f97df7fe640 1 -- 172.21.15.104:0/2651416399 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12585 (secure 0 0 0) 0x7f97e80b7ed0 con 0x7f97c8078b90 2024-09-17T03:06:26.746 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:26.747 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f97c8078b90 msgr2=0x7f97c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f97c8078b90 0x7f97c807b0a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009c80 tx=0x7f97d8005f30 comp rx=0 tx=0).stop 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e8162cb0 msgr2=0x7f97e814bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e8162cb0 0x7f97e814bd70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f97d0034040 tx=0x7f97d00035f0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 shutdown_connections 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f97c8078b90 0x7f97c807b0a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97e81630c0 0x7f97e80b94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f97e8162cb0 0x7f97e814bd70 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 --2- 172.21.15.104:0/2651416399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97e81611d0 0x7f97e81f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.749 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 >> 172.21.15.104:0/2651416399 conn(0x7f97e8069120 msgr2=0x7f97e8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:26.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 shutdown_connections 2024-09-17T03:06:26.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.749+0000 7f97ecf69640 1 -- 172.21.15.104:0/2651416399 wait complete. 2024-09-17T03:06:26.759 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2024-09-17T03:06:25.809031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":111962,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450537,"statfs":{"total":1600000000,"available":1485349902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16820700,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-93,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":443,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-17T03:06:21.349811+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:06:21.349811+0000","last_peered":"2024-09-17T03:06:21.349811+0000","last_clean":"2024-09-17T03:06:21.349811+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:06:21.349811+0000","last_undegraded":"2024-09-17T03:06:21.349811+0000","last_fullsized":"2024-09-17T03:06:21.349811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9862,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185450,"statfs":{"total":200000000,"available":189900864,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175841,"statfs":{"total":200000000,"available":180061560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21513,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173798,"statfs":{"total":200000000,"available":177970109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7243,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188069,"statfs":{"total":200000000,"available":192582975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186087,"statfs":{"total":200000000,"available":190553389,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21519,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173793,"statfs":{"total":200000000,"available":177964542,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13326,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181985,"statfs":{"total":200000000,"available":186353206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185510,"statfs":{"total":200000000,"available":189963257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:06:26.760 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:06:26.760 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:06:26.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.873+0000 7fb12728b640 1 -- 172.21.15.104:0/4082867793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d3490 msgr2=0x7fb1200b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.873+0000 7fb12728b640 1 --2- 172.21.15.104:0/4082867793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d3490 0x7fb1200b7c80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fb1200d2500 tx=0x7fb11c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.873+0000 7fb12728b640 1 -- 172.21.15.104:0/4082867793 shutdown_connections 2024-09-17T03:06:26.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.873+0000 7fb12728b640 1 --2- 172.21.15.104:0/4082867793 >> v2:172.21.15.192:3300/0 conn(0x7fb1200d0fd0 0x7fb120160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.873 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.873+0000 7fb12728b640 1 --2- 172.21.15.104:0/4082867793 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d3490 0x7fb1200b7c80 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.873+0000 7fb12728b640 1 -- 172.21.15.104:0/4082867793 >> 172.21.15.104:0/4082867793 conn(0x7fb1200d2970 msgr2=0x7fb1200d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:26.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.873+0000 7fb12728b640 1 -- 172.21.15.104:0/4082867793 shutdown_connections 2024-09-17T03:06:26.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.873+0000 7fb12728b640 1 -- 172.21.15.104:0/4082867793 wait complete. 2024-09-17T03:06:26.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.875+0000 7fb12728b640 1 Processor -- start 2024-09-17T03:06:26.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.875+0000 7fb12728b640 1 -- start start 2024-09-17T03:06:26.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.876+0000 7fb12728b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1200d0fd0 0x7fb12014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.876+0000 7fb12728b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d13e0 0x7fb1200afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.876+0000 7fb12728b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1200d3490 0x7fb1200cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.876+0000 7fb12728b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb1200b6bd0 con 0x7fb1200d13e0 2024-09-17T03:06:26.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.876+0000 7fb12728b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb1200b6a50 con 0x7fb1200d0fd0 2024-09-17T03:06:26.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.876+0000 7fb12728b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fb1200b6d50 con 0x7fb1200d3490 2024-09-17T03:06:26.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d13e0 0x7fb1200afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d13e0 0x7fb1200afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55808/0 (socket says 172.21.15.104:55808) 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 -- 172.21.15.104:0/4027411014 learned_addr learned my addr 172.21.15.104:0/4027411014 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb125027640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1200d0fd0 0x7fb12014fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb125828640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1200d3490 0x7fb1200cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 -- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1200d3490 msgr2=0x7fb1200cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1200d3490 0x7fb1200cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 -- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1200d0fd0 msgr2=0x7fb12014fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1200d0fd0 0x7fb12014fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 -- 172.21.15.104:0/4027411014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1200b03b0 con 0x7fb1200d13e0 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb124826640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d13e0 0x7fb1200afe70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c9a0 tx=0x7fb11000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb115ffb640 1 -- 172.21.15.104:0/4027411014 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110007bb0 con 0x7fb1200d13e0 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb115ffb640 1 -- 172.21.15.104:0/4027411014 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb110007e40 con 0x7fb1200d13e0 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1201f4e80 con 0x7fb1200d13e0 2024-09-17T03:06:26.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb115ffb640 1 -- 172.21.15.104:0/4027411014 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11000f690 con 0x7fb1200d13e0 2024-09-17T03:06:26.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.877+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12009cb10 con 0x7fb1200d13e0 2024-09-17T03:06:26.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.878+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1200b7c80 con 0x7fb1200d13e0 2024-09-17T03:06:26.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.879+0000 7fb115ffb640 1 -- 172.21.15.104:0/4027411014 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb11000f830 con 0x7fb1200d13e0 2024-09-17T03:06:26.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.879+0000 7fb115ffb640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb104078bc0 0x7fb10407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:26.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.880+0000 7fb115ffb640 1 -- 172.21.15.104:0/4027411014 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fb11009b130 con 0x7fb1200d13e0 2024-09-17T03:06:26.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.880+0000 7fb125027640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb104078bc0 0x7fb10407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:26.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.880+0000 7fb125027640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb104078bc0 0x7fb10407b0d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb11c033000 tx=0x7fb11c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:26.883 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:26.884+0000 7fb115ffb640 1 -- 172.21.15.104:0/4027411014 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb110014030 con 0x7fb1200d13e0 2024-09-17T03:06:27.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.053+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1200b7a20 con 0x7fb104078bc0 2024-09-17T03:06:27.053 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.054+0000 7fb115ffb640 1 -- 172.21.15.104:0/4027411014 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12585 (secure 0 0 0) 0x7fb1200b7a20 con 0x7fb104078bc0 2024-09-17T03:06:27.054 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:27.054 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:06:27.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb104078bc0 msgr2=0x7fb10407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:27.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb104078bc0 0x7fb10407b0d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb11c033000 tx=0x7fb11c004730 comp rx=0 tx=0).stop 2024-09-17T03:06:27.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d13e0 msgr2=0x7fb1200afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:27.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d13e0 0x7fb1200afe70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c9a0 tx=0x7fb11000ce60 comp rx=0 tx=0).stop 2024-09-17T03:06:27.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 shutdown_connections 2024-09-17T03:06:27.056 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fb104078bc0 0x7fb10407b0d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1200d3490 0x7fb1200cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fb1200d13e0 0x7fb1200afe70 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 --2- 172.21.15.104:0/4027411014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1200d0fd0 0x7fb12014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.056+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 >> 172.21.15.104:0/4027411014 conn(0x7fb1200d2970 msgr2=0x7fb1200d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:27.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.057+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 shutdown_connections 2024-09-17T03:06:27.057 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.057+0000 7fb12728b640 1 -- 172.21.15.104:0/4027411014 wait complete. 2024-09-17T03:06:27.067 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2024-09-17T03:06:25.809031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":111962,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450537,"statfs":{"total":1600000000,"available":1485349902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16820700,"num_objects":-27,"num_object_clones":0,"num_object_copies":-54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-93,"num_write_kb":-33860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001457"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":443,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-09-17T03:06:21.349811+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:06:21.349811+0000","last_peered":"2024-09-17T03:06:21.349811+0000","last_clean":"2024-09-17T03:06:21.349811+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:06:21.349811+0000","last_undegraded":"2024-09-17T03:06:21.349811+0000","last_fullsized":"2024-09-17T03:06:21.349811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9862,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185450,"statfs":{"total":200000000,"available":189900864,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175841,"statfs":{"total":200000000,"available":180061560,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21513,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173798,"statfs":{"total":200000000,"available":177970109,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7243,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188069,"statfs":{"total":200000000,"available":192582975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186087,"statfs":{"total":200000000,"available":190553389,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21519,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173793,"statfs":{"total":200000000,"available":177964542,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13326,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181985,"statfs":{"total":200000000,"available":186353206,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185510,"statfs":{"total":200000000,"available":189963257,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:06:27.068 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:06:27.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.180+0000 7ff247af2640 1 -- 172.21.15.104:0/1854214851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff24015fb40 msgr2=0x7ff240161380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:27.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.180+0000 7ff247af2640 1 --2- 172.21.15.104:0/1854214851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff24015fb40 0x7ff240161380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff238005fd0 tx=0x7ff23802a820 comp rx=0 tx=0).stop 2024-09-17T03:06:27.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.180+0000 7ff247af2640 1 -- 172.21.15.104:0/1854214851 shutdown_connections 2024-09-17T03:06:27.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.180+0000 7ff247af2640 1 --2- 172.21.15.104:0/1854214851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff24015fb40 0x7ff240161380 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.180 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.180+0000 7ff247af2640 1 --2- 172.21.15.104:0/1854214851 >> v2:172.21.15.192:3300/0 conn(0x7ff24015f1f0 0x7ff24015f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.180+0000 7ff247af2640 1 -- 172.21.15.104:0/1854214851 >> 172.21.15.104:0/1854214851 conn(0x7ff240069120 msgr2=0x7ff240069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:27.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.180+0000 7ff247af2640 1 -- 172.21.15.104:0/1854214851 shutdown_connections 2024-09-17T03:06:27.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.180+0000 7ff247af2640 1 -- 172.21.15.104:0/1854214851 wait complete. 2024-09-17T03:06:27.181 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.182+0000 7ff247af2640 1 Processor -- start 2024-09-17T03:06:27.182 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.182+0000 7ff247af2640 1 -- start start 2024-09-17T03:06:27.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.183+0000 7ff247af2640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2400b65e0 0x7ff2401f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:27.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.183+0000 7ff247af2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24015f1f0 0x7ff2400c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:27.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.183+0000 7ff247af2640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff24015fb40 0x7ff240163170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:27.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.183+0000 7ff247af2640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff240161d90 con 0x7ff2400b65e0 2024-09-17T03:06:27.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.183+0000 7ff247af2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff240161c10 con 0x7ff24015f1f0 2024-09-17T03:06:27.184 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.183+0000 7ff247af2640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff240161f10 con 0x7ff24015fb40 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2400b65e0 0x7ff2401f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2400b65e0 0x7ff2401f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55824/0 (socket says 172.21.15.104:55824) 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 -- 172.21.15.104:0/1378372188 learned_addr learned my addr 172.21.15.104:0/1378372188 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24608f640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff24015fb40 0x7ff240163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24508d640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24015f1f0 0x7ff2400c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 -- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff24015fb40 msgr2=0x7ff240163170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff24015fb40 0x7ff240163170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 -- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24015f1f0 msgr2=0x7ff2400c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24015f1f0 0x7ff2400c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 -- 172.21.15.104:0/1378372188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2400c85c0 con 0x7ff2400b65e0 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff24588e640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2400b65e0 0x7ff2401f6160 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00c370 tx=0x7ff23c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff2367fc640 1 -- 172.21.15.104:0/1378372188 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c011790 con 0x7ff2400b65e0 2024-09-17T03:06:27.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff2367fc640 1 -- 172.21.15.104:0/1378372188 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff23c017070 con 0x7ff2400b65e0 2024-09-17T03:06:27.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2400c8ac0 con 0x7ff2400b65e0 2024-09-17T03:06:27.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff2367fc640 1 -- 172.21.15.104:0/1378372188 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c011c80 con 0x7ff2400b65e0 2024-09-17T03:06:27.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.184+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2400c9080 con 0x7ff2400b65e0 2024-09-17T03:06:27.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.185+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2401623c0 con 0x7ff2400b65e0 2024-09-17T03:06:27.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.186+0000 7ff2367fc640 1 -- 172.21.15.104:0/1378372188 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff23c01c460 con 0x7ff2400b65e0 2024-09-17T03:06:27.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.187+0000 7ff2367fc640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff224078bc0 0x7ff22407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:27.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.187+0000 7ff2367fc640 1 -- 172.21.15.104:0/1378372188 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7ff23c09a5f0 con 0x7ff2400b65e0 2024-09-17T03:06:27.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.187+0000 7ff24508d640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff224078bc0 0x7ff22407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:27.187 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.188+0000 7ff24508d640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff224078bc0 0x7ff22407b0d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff2400ce850 tx=0x7ff230005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:27.190 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.191+0000 7ff2367fc640 1 -- 172.21.15.104:0/1378372188 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff23c0626e0 con 0x7ff2400b65e0 2024-09-17T03:06:27.365 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.366+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2400b6170 con 0x7ff2400b65e0 2024-09-17T03:06:27.366 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.367+0000 7ff2367fc640 1 -- 172.21.15.104:0/1378372188 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) ==== 74+0+13093 (secure 0 0 0) 0x7ff23c067110 con 0x7ff2400b65e0 2024-09-17T03:06:27.366 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:27.366 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":191,"fsid":"5ed2cc55-4a25-471e-9183-b1048a1a073c","created":"2024-09-17T02:54:23.296665+0000","modified":"2024-09-17T03:06:24.235952+0000","last_up_change":"2024-09-17T02:54:30.618449+0000","last_in_change":"2024-09-17T02:54:27.491467+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T02:54:31.652437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6801","nonce":717221549}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6803","nonce":717221549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6807","nonce":717221549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":717221549},{"type":"v1","addr":"172.21.15.104:6805","nonce":717221549}]},"public_addr":"172.21.15.104:6801/717221549","cluster_addr":"172.21.15.104:6803/717221549","heartbeat_back_addr":"172.21.15.104:6807/717221549","heartbeat_front_addr":"172.21.15.104:6805/717221549","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6809","nonce":1763440481}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6811","nonce":1763440481}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6815","nonce":1763440481}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1763440481},{"type":"v1","addr":"172.21.15.104:6813","nonce":1763440481}]},"public_addr":"172.21.15.104:6809/1763440481","cluster_addr":"172.21.15.104:6811/1763440481","heartbeat_back_addr":"172.21.15.104:6815/1763440481","heartbeat_front_addr":"172.21.15.104:6813/1763440481","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6825","nonce":100151575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6827","nonce":100151575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6831","nonce":100151575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":100151575},{"type":"v1","addr":"172.21.15.104:6829","nonce":100151575}]},"public_addr":"172.21.15.104:6825/100151575","cluster_addr":"172.21.15.104:6827/100151575","heartbeat_back_addr":"172.21.15.104:6831/100151575","heartbeat_front_addr":"172.21.15.104:6829/100151575","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6817","nonce":1619923136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6819","nonce":1619923136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6823","nonce":1619923136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1619923136},{"type":"v1","addr":"172.21.15.104:6821","nonce":1619923136}]},"public_addr":"172.21.15.104:6817/1619923136","cluster_addr":"172.21.15.104:6819/1619923136","heartbeat_back_addr":"172.21.15.104:6823/1619923136","heartbeat_front_addr":"172.21.15.104:6821/1619923136","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6819","nonce":3240881174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6821","nonce":3240881174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6825","nonce":3240881174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3240881174},{"type":"v1","addr":"172.21.15.192:6823","nonce":3240881174}]},"public_addr":"172.21.15.192:6819/3240881174","cluster_addr":"172.21.15.192:6821/3240881174","heartbeat_back_addr":"172.21.15.192:6825/3240881174","heartbeat_front_addr":"172.21.15.192:6823/3240881174","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6803","nonce":3946789085}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6805","nonce":3946789085}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6810","nonce":3946789085}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":3946789085},{"type":"v1","addr":"172.21.15.192:6807","nonce":3946789085}]},"public_addr":"172.21.15.192:6803/3946789085","cluster_addr":"172.21.15.192:6805/3946789085","heartbeat_back_addr":"172.21.15.192:6810/3946789085","heartbeat_front_addr":"172.21.15.192:6807/3946789085","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6809","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6811","nonce":3422114417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6813","nonce":3422114417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6817","nonce":3422114417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":3422114417},{"type":"v1","addr":"172.21.15.192:6815","nonce":3422114417}]},"public_addr":"172.21.15.192:6811/3422114417","cluster_addr":"172.21.15.192:6813/3422114417","heartbeat_back_addr":"172.21.15.192:6817/3422114417","heartbeat_front_addr":"172.21.15.192:6815/3422114417","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6827","nonce":1791040326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6829","nonce":1791040326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6833","nonce":1791040326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1791040326},{"type":"v1","addr":"172.21.15.192:6831","nonce":1791040326}]},"public_addr":"172.21.15.192:6827/1791040326","cluster_addr":"172.21.15.192:6829/1791040326","heartbeat_back_addr":"172.21.15.192:6833/1791040326","heartbeat_front_addr":"172.21.15.192:6831/1791040326","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.605382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.623043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.691956+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.673593+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.680873+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.666617+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.599288+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T02:54:28.628144+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.104:6835/4053158179":"2024-09-18T03:06:21.345779+0000","172.21.15.104:6833/4053158179":"2024-09-18T03:06:21.345779+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:06:27.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff224078bc0 msgr2=0x7ff22407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:27.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff224078bc0 0x7ff22407b0d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff2400ce850 tx=0x7ff230005f90 comp rx=0 tx=0).stop 2024-09-17T03:06:27.368 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2400b65e0 msgr2=0x7ff2401f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2400b65e0 0x7ff2401f6160 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00c370 tx=0x7ff23c00c830 comp rx=0 tx=0).stop 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 shutdown_connections 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff224078bc0 0x7ff22407b0d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24015f1f0 0x7ff2400c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff24015fb40 0x7ff240163170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 --2- 172.21.15.104:0/1378372188 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff2400b65e0 0x7ff2401f6160 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 >> 172.21.15.104:0/1378372188 conn(0x7ff240069120 msgr2=0x7ff2400d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 shutdown_connections 2024-09-17T03:06:27.369 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:27.369+0000 7ff247af2640 1 -- 172.21.15.104:0/1378372188 wait complete. 2024-09-17T03:06:28.380 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T03:06:28.380 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:06:28.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.502+0000 7f54ab7c3640 1 -- 172.21.15.104:0/3784839002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5490005350 msgr2=0x7f549000ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.502+0000 7f54ab7c3640 1 --2- 172.21.15.104:0/3784839002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5490005350 0x7f549000ba00 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f549c001d90 tx=0x7f5490005830 comp rx=0 tx=0).stop 2024-09-17T03:06:28.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.502+0000 7f54ab7c3640 1 -- 172.21.15.104:0/3784839002 shutdown_connections 2024-09-17T03:06:28.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.502+0000 7f54ab7c3640 1 --2- 172.21.15.104:0/3784839002 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5490005350 0x7f549000ba00 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.502+0000 7f54ab7c3640 1 -- 172.21.15.104:0/3784839002 >> 172.21.15.104:0/3784839002 conn(0x7f54a409ba40 msgr2=0x7f54a409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:28.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.502+0000 7f54ab7c3640 1 -- 172.21.15.104:0/3784839002 shutdown_connections 2024-09-17T03:06:28.502 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.502+0000 7f54ab7c3640 1 -- 172.21.15.104:0/3784839002 wait complete. 2024-09-17T03:06:28.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.504+0000 7f54ab7c3640 1 Processor -- start 2024-09-17T03:06:28.503 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.504+0000 7f54ab7c3640 1 -- start start 2024-09-17T03:06:28.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54ab7c3640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5490005350 0x7f54a406f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54ab7c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54a41f5cb0 0x7f54a40b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54ab7c3640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54a40b1550 0x7f54a4071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54ab7c3640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f54a40b2b20 con 0x7f54a40b1550 2024-09-17T03:06:28.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54ab7c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54a40b29a0 con 0x7f54a41f5cb0 2024-09-17T03:06:28.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54ab7c3640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f54a40b2ca0 con 0x7f5490005350 2024-09-17T03:06:28.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54a9d60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54a40b1550 0x7f54a4071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.506 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54a9d60640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54a40b1550 0x7f54a4071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55842/0 (socket says 172.21.15.104:55842) 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54a9d60640 1 -- 172.21.15.104:0/538759550 learned_addr learned my addr 172.21.15.104:0/538759550 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.505+0000 7f54a8d5e640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54a41f5cb0 0x7f54a40b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54a955f640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5490005350 0x7f54a406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54a9d60640 1 -- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5490005350 msgr2=0x7f54a406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54a9d60640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5490005350 0x7f54a406f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54a9d60640 1 -- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54a41f5cb0 msgr2=0x7f54a40b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54a9d60640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54a41f5cb0 0x7f54a40b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54a9d60640 1 -- 172.21.15.104:0/538759550 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a406fd50 con 0x7f54a40b1550 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54a955f640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5490005350 0x7f54a406f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54a9d60640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54a40b1550 0x7f54a4071c70 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f549c001eb0 tx=0x7f549c006d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c003d80 con 0x7f54a40b1550 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f549c005b80 con 0x7f54a40b1550 2024-09-17T03:06:28.507 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a406e2d0 con 0x7f54a40b1550 2024-09-17T03:06:28.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c005fd0 con 0x7f54a40b1550 2024-09-17T03:06:28.508 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.506+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a406e890 con 0x7f54a40b1550 2024-09-17T03:06:28.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.507+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54a41f92a0 con 0x7f54a40b1550 2024-09-17T03:06:28.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.508+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f549c005070 con 0x7f54a40b1550 2024-09-17T03:06:28.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.508+0000 7f5499ffb640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5488078b90 0x7f548807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.508+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f549c0baa30 con 0x7f54a40b1550 2024-09-17T03:06:28.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.509+0000 7f5499ffb640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f548807eaa0 0x7f5488080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.509 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.509+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 --> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f549c033e50 con 0x7f548807eaa0 2024-09-17T03:06:28.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.509+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) ==== 24+0+0 (secure 0 0 0) 0x7f549c0bf2c0 con 0x7f54a40b1550 2024-09-17T03:06:28.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.509+0000 7f54a955f640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5488078b90 0x7f548807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.509+0000 7f54a8d5e640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f548807eaa0 0x7f5488080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.509+0000 7f54a8d5e640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f548807eaa0 0x7f5488080ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:28.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.509+0000 7f54a955f640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5488078b90 0x7f548807b0a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f54a0006b20 tx=0x7f54a0001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:28.510 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.510+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 <== osd.0 v2:172.21.15.104:6800/717221549 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f549c033e50 con 0x7f548807eaa0 2024-09-17T03:06:28.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 --> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54a406e080 con 0x7f548807eaa0 2024-09-17T03:06:28.520 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f5499ffb640 1 -- 172.21.15.104:0/538759550 <== osd.0 v2:172.21.15.104:6800/717221549 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f54a406e080 con 0x7f548807eaa0 2024-09-17T03:06:28.521 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:28.521 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T03:06:28.521 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:28.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f548807eaa0 msgr2=0x7f5488080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f54ab7c3640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.104:6800/717221549,v1:172.21.15.104:6801/717221549] conn(0x7f548807eaa0 0x7f5488080ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5488078b90 msgr2=0x7f548807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f54ab7c3640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5488078b90 0x7f548807b0a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f54a0006b20 tx=0x7f54a0001e50 comp rx=0 tx=0).stop 2024-09-17T03:06:28.522 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54a40b1550 msgr2=0x7f54a4071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f54ab7c3640 1 --2- 172.21.15.104:0/538759550 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f54a40b1550 0x7f54a4071c70 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f549c001eb0 tx=0x7f549c006d20 comp rx=0 tx=0).stop 2024-09-17T03:06:28.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.521+0000 7f54a9d60640 1 -- 172.21.15.104:0/538759550 reap_dead start 2024-09-17T03:06:28.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.522+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 shutdown_connections 2024-09-17T03:06:28.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.522+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 >> 172.21.15.104:0/538759550 conn(0x7f54a409ba40 msgr2=0x7f54a40b5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:28.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.522+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 shutdown_connections 2024-09-17T03:06:28.523 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.522+0000 7f54ab7c3640 1 -- 172.21.15.104:0/538759550 wait complete. 2024-09-17T03:06:28.531 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T03:06:28.643 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 -- 172.21.15.104:0/1671269786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc072dc0 msgr2=0x7f9ffc15f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 --2- 172.21.15.104:0/1671269786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc072dc0 0x7f9ffc15f720 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc06e780 tx=0x7f9ff402a9a0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 -- 172.21.15.104:0/1671269786 shutdown_connections 2024-09-17T03:06:28.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 --2- 172.21.15.104:0/1671269786 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc072dc0 0x7f9ffc15f720 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 --2- 172.21.15.104:0/1671269786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ffc072470 0x7f9ffc072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 --2- 172.21.15.104:0/1671269786 >> v2:172.21.15.192:3300/0 conn(0x7f9ffc15b7f0 0x7f9ffc15bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 -- 172.21.15.104:0/1671269786 >> 172.21.15.104:0/1671269786 conn(0x7f9ffc0b2450 msgr2=0x7f9ffc0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:28.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 -- 172.21.15.104:0/1671269786 shutdown_connections 2024-09-17T03:06:28.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.644+0000 7fa001c0a640 1 -- 172.21.15.104:0/1671269786 wait complete. 2024-09-17T03:06:28.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.645+0000 7fa001c0a640 1 Processor -- start 2024-09-17T03:06:28.645 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.646+0000 7fa001c0a640 1 -- start start 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7fa001c0a640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ffc072470 0x7f9ffc06ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7fa001c0a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc072dc0 0x7f9ffc1f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7fa001c0a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc15b7f0 0x7f9ffc148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7fa001c0a640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc15fff0 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7fa001c0a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc15fe70 con 0x7f9ffc072dc0 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7fa001c0a640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc160170 con 0x7f9ffc072470 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc15b7f0 0x7f9ffc148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc15b7f0 0x7f9ffc148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55858/0 (socket says 172.21.15.104:55858) 2024-09-17T03:06:28.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 -- 172.21.15.104:0/3321898908 learned_addr learned my addr 172.21.15.104:0/3321898908 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffaffd640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc072dc0 0x7f9ffc1f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 -- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ffc072470 msgr2=0x7f9ffc06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffb7fe640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ffc072470 0x7f9ffc06ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ffc072470 0x7f9ffc06ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 -- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc072dc0 msgr2=0x7f9ffc1f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc072dc0 0x7f9ffc1f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 -- 172.21.15.104:0/3321898908 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc156340 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffaffd640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc072dc0 0x7f9ffc1f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffb7fe640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ffc072470 0x7f9ffc06ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.647+0000 7f9ffbfff640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc15b7f0 0x7f9ffc148100 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f9ff402af90 tx=0x7f9ff4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.648+0000 7f9fe3fff640 1 -- 172.21.15.104:0/3321898908 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4033050 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.649 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.648+0000 7f9fe3fff640 1 -- 172.21.15.104:0/3321898908 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ff40044d0 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.648+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc156620 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.648+0000 7f9fe3fff640 1 -- 172.21.15.104:0/3321898908 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4038450 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.648+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc15cd20 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.650 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.649+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc15cb30 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.650+0000 7f9fe3fff640 1 -- 172.21.15.104:0/3321898908 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ff4036070 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.650+0000 7f9fe3fff640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fe8078bc0 0x7f9fe807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.650+0000 7f9fe3fff640 1 -- 172.21.15.104:0/3321898908 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f9ff40bbcf0 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.650+0000 7f9ffb7fe640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fe8078bc0 0x7f9fe807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.651 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.651+0000 7f9ffb7fe640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fe8078bc0 0x7f9fe807b0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0058c0 tx=0x7f9fec005c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:28.654 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.655+0000 7f9fe3fff640 1 -- 172.21.15.104:0/3321898908 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9ff40844c0 con 0x7f9ffc15b7f0 2024-09-17T03:06:28.827 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.828+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f9ffc15f720 con 0x7f9fe8078bc0 2024-09-17T03:06:28.828 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.828+0000 7f9fe3fff640 1 -- 172.21.15.104:0/3321898908 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9ffc15f720 con 0x7f9fe8078bc0 2024-09-17T03:06:28.828 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T03:06:28.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fe8078bc0 msgr2=0x7f9fe807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fe8078bc0 0x7f9fe807b0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0058c0 tx=0x7f9fec005c90 comp rx=0 tx=0).stop 2024-09-17T03:06:28.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc15b7f0 msgr2=0x7f9ffc148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc15b7f0 0x7f9ffc148100 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f9ff402af90 tx=0x7f9ff4003f10 comp rx=0 tx=0).stop 2024-09-17T03:06:28.830 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 shutdown_connections 2024-09-17T03:06:28.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9fe8078bc0 0x7f9fe807b0d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc072dc0 0x7f9ffc1f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9ffc15b7f0 0x7f9ffc148100 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 --2- 172.21.15.104:0/3321898908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ffc072470 0x7f9ffc06ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.830+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 >> 172.21.15.104:0/3321898908 conn(0x7f9ffc0b2450 msgr2=0x7f9ffc0b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:28.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.831+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 shutdown_connections 2024-09-17T03:06:28.831 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.831+0000 7fa001c0a640 1 -- 172.21.15.104:0/3321898908 wait complete. 2024-09-17T03:06:28.841 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T03:06:28.841 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:06:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.957+0000 7f09390ec640 1 -- 172.21.15.104:0/2265121345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 msgr2=0x7f0934073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.957+0000 7f09390ec640 1 --2- 172.21.15.104:0/2265121345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 0x7f0934073bd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f092c005fd0 tx=0x7f092c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:06:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.957+0000 7f09390ec640 1 -- 172.21.15.104:0/2265121345 shutdown_connections 2024-09-17T03:06:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.957+0000 7f09390ec640 1 --2- 172.21.15.104:0/2265121345 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 0x7f0934073bd0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.957+0000 7f09390ec640 1 --2- 172.21.15.104:0/2265121345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f093406fd10 0x7f0934070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.957 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.957+0000 7f09390ec640 1 -- 172.21.15.104:0/2265121345 >> 172.21.15.104:0/2265121345 conn(0x7f0934069610 msgr2=0x7f09340b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.957+0000 7f09390ec640 1 -- 172.21.15.104:0/2265121345 shutdown_connections 2024-09-17T03:06:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.957+0000 7f09390ec640 1 -- 172.21.15.104:0/2265121345 wait complete. 2024-09-17T03:06:28.958 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.959+0000 7f09390ec640 1 Processor -- start 2024-09-17T03:06:28.959 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.959+0000 7f09390ec640 1 -- start start 2024-09-17T03:06:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.960+0000 7f09390ec640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f093406fd10 0x7f0934142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f09390ec640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 0x7f0934143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f09390ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09341455f0 0x7f0934151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f09390ec640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0934074290 con 0x7f09340737c0 2024-09-17T03:06:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f09390ec640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0934074110 con 0x7f09341455f0 2024-09-17T03:06:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f09390ec640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f0934074410 con 0x7f093406fd10 2024-09-17T03:06:28.961 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 0x7f0934143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.963 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 0x7f0934143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55878/0 (socket says 172.21.15.104:55878) 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 -- 172.21.15.104:0/2503837267 learned_addr learned my addr 172.21.15.104:0/2503837267 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f093359e640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09341455f0 0x7f0934151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f0932d9d640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f093406fd10 0x7f0934142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 -- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f093406fd10 msgr2=0x7f0934142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f093406fd10 0x7f0934142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 -- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09341455f0 msgr2=0x7f0934151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09341455f0 0x7f0934151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 -- 172.21.15.104:0/2503837267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09341f6700 con 0x7f09340737c0 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092bfff640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 0x7f0934143360 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f091c00d650 tx=0x7f091c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c017070 con 0x7f09340737c0 2024-09-17T03:06:28.964 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f091c005310 con 0x7f09340737c0 2024-09-17T03:06:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09341f69e0 con 0x7f09340737c0 2024-09-17T03:06:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c009820 con 0x7f09340737c0 2024-09-17T03:06:28.965 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.961+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093415b960 con 0x7f09340737c0 2024-09-17T03:06:28.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.962+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09341519b0 con 0x7f09340737c0 2024-09-17T03:06:28.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.963+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f091c0099c0 con 0x7f09340737c0 2024-09-17T03:06:28.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.963+0000 7f092b7fe640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0914078b90 0x7f091407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.964+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f091c09aa80 con 0x7f09340737c0 2024-09-17T03:06:28.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.964+0000 7f092b7fe640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f091407eaa0 0x7f0914080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:28.966 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.964+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 --> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f091c009e50 con 0x7f091407eaa0 2024-09-17T03:06:28.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.964+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) ==== 24+0+0 (secure 0 0 0) 0x7f091c09f2c0 con 0x7f09340737c0 2024-09-17T03:06:28.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.964+0000 7f0932d9d640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0914078b90 0x7f091407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.964+0000 7f093359e640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f091407eaa0 0x7f0914080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:28.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.964+0000 7f093359e640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f091407eaa0 0x7f0914080ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:28.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.964+0000 7f0932d9d640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0914078b90 0x7f091407b0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0924001720 tx=0x7f0924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:28.967 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.965+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 <== osd.1 v2:172.21.15.104:6808/1763440481 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f091c009e50 con 0x7f091407eaa0 2024-09-17T03:06:28.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.976+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 --> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0934074870 con 0x7f091407eaa0 2024-09-17T03:06:28.975 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.976+0000 7f092b7fe640 1 -- 172.21.15.104:0/2503837267 <== osd.1 v2:172.21.15.104:6808/1763440481 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f0934074870 con 0x7f091407eaa0 2024-09-17T03:06:28.976 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:28.976 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T03:06:28.976 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f091407eaa0 msgr2=0x7f0914080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.104:6808/1763440481,v1:172.21.15.104:6809/1763440481] conn(0x7f091407eaa0 0x7f0914080ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0914078b90 msgr2=0x7f091407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f0914078b90 0x7f091407b0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0924001720 tx=0x7f0924009040 comp rx=0 tx=0).stop 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 msgr2=0x7f0934143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 --2- 172.21.15.104:0/2503837267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f09340737c0 0x7f0934143360 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f091c00d650 tx=0x7f091c00db10 comp rx=0 tx=0).stop 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f093359e640 1 -- 172.21.15.104:0/2503837267 reap_dead start 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 shutdown_connections 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 >> 172.21.15.104:0/2503837267 conn(0x7f0934069610 msgr2=0x7f09340b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 shutdown_connections 2024-09-17T03:06:28.977 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:28.977+0000 7f09390ec640 1 -- 172.21.15.104:0/2503837267 wait complete. 2024-09-17T03:06:28.987 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T03:06:29.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.101+0000 7f3fe78bd640 1 -- 172.21.15.104:0/3422325952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b4fc0 msgr2=0x7f3fe00b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.101+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/3422325952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b4fc0 0x7f3fe00b39c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3fe00a0a60 tx=0x7f3fdc02a560 comp rx=0 tx=0).stop 2024-09-17T03:06:29.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.101+0000 7f3fe78bd640 1 -- 172.21.15.104:0/3422325952 shutdown_connections 2024-09-17T03:06:29.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.101+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/3422325952 >> v2:172.21.15.192:3300/0 conn(0x7f3fe00b3f00 0x7f3fe00b57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.101+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/3422325952 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b4fc0 0x7f3fe00b39c0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.101+0000 7f3fe78bd640 1 -- 172.21.15.104:0/3422325952 >> 172.21.15.104:0/3422325952 conn(0x7f3fe00b44a0 msgr2=0x7f3fe00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:29.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.101+0000 7f3fe78bd640 1 -- 172.21.15.104:0/3422325952 shutdown_connections 2024-09-17T03:06:29.101 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.101+0000 7f3fe78bd640 1 -- 172.21.15.104:0/3422325952 wait complete. 2024-09-17T03:06:29.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.103+0000 7f3fe78bd640 1 Processor -- start 2024-09-17T03:06:29.102 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.103+0000 7f3fe78bd640 1 -- start start 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe78bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b3f00 0x7f3fe015bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe78bd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fe00b4fc0 0x7f3fe015f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe78bd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fe00b5d20 0x7f3fe015f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe78bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe00ce120 con 0x7f3fe00b3f00 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe78bd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0160f50 con 0x7f3fe00b4fc0 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe78bd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe00b06a0 con 0x7f3fe00b5d20 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe5659640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b3f00 0x7f3fe015bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe5659640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b3f00 0x7f3fe015bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55898/0 (socket says 172.21.15.104:55898) 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe5659640 1 -- 172.21.15.104:0/1229522967 learned_addr learned my addr 172.21.15.104:0/1229522967 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe4e58640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fe00b4fc0 0x7f3fe015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.105 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe5e5a640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fe00b5d20 0x7f3fe015f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe5659640 1 -- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fe00b5d20 msgr2=0x7f3fe015f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe5659640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fe00b5d20 0x7f3fe015f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe5659640 1 -- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fe00b4fc0 msgr2=0x7f3fe015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.104+0000 7f3fe5659640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fe00b4fc0 0x7f3fe015f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.105+0000 7f3fe5659640 1 -- 172.21.15.104:0/1229522967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe00ca8d0 con 0x7f3fe00b3f00 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.105+0000 7f3fe5659640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b3f00 0x7f3fe015bea0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc034040 tx=0x7f3fdc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.105+0000 7f3fd5ffb640 1 -- 172.21.15.104:0/1229522967 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc03e030 con 0x7f3fe00b3f00 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.105+0000 7f3fd5ffb640 1 -- 172.21.15.104:0/1229522967 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fdc0047a0 con 0x7f3fe00b3f00 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.105+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe01f4250 con 0x7f3fe00b3f00 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.105+0000 7f3fd5ffb640 1 -- 172.21.15.104:0/1229522967 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc035040 con 0x7f3fe00b3f00 2024-09-17T03:06:29.106 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.105+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe01f4810 con 0x7f3fe00b3f00 2024-09-17T03:06:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.106+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe00b57e0 con 0x7f3fe00b3f00 2024-09-17T03:06:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.107+0000 7f3fd5ffb640 1 -- 172.21.15.104:0/1229522967 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fdc041030 con 0x7f3fe00b3f00 2024-09-17T03:06:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.107+0000 7f3fd5ffb640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3fc4078b90 0x7f3fc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.107+0000 7f3fd5ffb640 1 -- 172.21.15.104:0/1229522967 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f3fdc0bb240 con 0x7f3fe00b3f00 2024-09-17T03:06:29.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.108+0000 7f3fe4e58640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3fc4078b90 0x7f3fc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.108+0000 7f3fe4e58640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3fc4078b90 0x7f3fc407b0a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3fe009ff10 tx=0x7f3fd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.112+0000 7f3fd5ffb640 1 -- 172.21.15.104:0/1229522967 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3fdc083aa0 con 0x7f3fe00b3f00 2024-09-17T03:06:29.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.285+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3fe00cead0 con 0x7f3fc4078b90 2024-09-17T03:06:29.285 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.286+0000 7f3fd5ffb640 1 -- 172.21.15.104:0/1229522967 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3fe00cead0 con 0x7f3fc4078b90 2024-09-17T03:06:29.285 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T03:06:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3fc4078b90 msgr2=0x7f3fc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3fc4078b90 0x7f3fc407b0a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3fe009ff10 tx=0x7f3fd0008040 comp rx=0 tx=0).stop 2024-09-17T03:06:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b3f00 msgr2=0x7f3fe015bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b3f00 0x7f3fe015bea0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc034040 tx=0x7f3fdc0039e0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 shutdown_connections 2024-09-17T03:06:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f3fc4078b90 0x7f3fc407b0a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.288 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fe00b4fc0 0x7f3fe015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fe00b5d20 0x7f3fe015f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 --2- 172.21.15.104:0/1229522967 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f3fe00b3f00 0x7f3fe015bea0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 >> 172.21.15.104:0/1229522967 conn(0x7f3fe00b44a0 msgr2=0x7f3fe015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 shutdown_connections 2024-09-17T03:06:29.289 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.288+0000 7f3fe78bd640 1 -- 172.21.15.104:0/1229522967 wait complete. 2024-09-17T03:06:29.299 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T03:06:29.299 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:06:29.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.417+0000 7f66e3d0b640 1 -- 172.21.15.104:0/2471299125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc0afcb0 msgr2=0x7f66dc0cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.417+0000 7f66e3d0b640 1 --2- 172.21.15.104:0/2471299125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc0afcb0 0x7f66dc0cff70 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009ca0 tx=0x7f66d802aac0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.417+0000 7f66e3d0b640 1 -- 172.21.15.104:0/2471299125 shutdown_connections 2024-09-17T03:06:29.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.417+0000 7f66e3d0b640 1 --2- 172.21.15.104:0/2471299125 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66dc0733c0 0x7f66dc0737d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.417+0000 7f66e3d0b640 1 --2- 172.21.15.104:0/2471299125 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc0afcb0 0x7f66dc0cff70 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.417+0000 7f66e3d0b640 1 -- 172.21.15.104:0/2471299125 >> 172.21.15.104:0/2471299125 conn(0x7f66dc069610 msgr2=0x7f66dc0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:29.417 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.417+0000 7f66e3d0b640 1 -- 172.21.15.104:0/2471299125 shutdown_connections 2024-09-17T03:06:29.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.417+0000 7f66e3d0b640 1 -- 172.21.15.104:0/2471299125 wait complete. 2024-09-17T03:06:29.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.419+0000 7f66e3d0b640 1 Processor -- start 2024-09-17T03:06:29.418 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.419+0000 7f66e3d0b640 1 -- start start 2024-09-17T03:06:29.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e3d0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66dc0733c0 0x7f66dc0aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e3d0b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66dc0afcb0 0x7f66dc143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e3d0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc15eed0 0x7f66dc15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e3d0b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0d0630 con 0x7f66dc15eed0 2024-09-17T03:06:29.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e3d0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0d04b0 con 0x7f66dc0733c0 2024-09-17T03:06:29.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e3d0b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc073d10 con 0x7f66dc0afcb0 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e22a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc15eed0 0x7f66dc15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e22a8640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc15eed0 0x7f66dc15dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55910/0 (socket says 172.21.15.104:55910) 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e22a8640 1 -- 172.21.15.104:0/112306452 learned_addr learned my addr 172.21.15.104:0/112306452 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e1aa7640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66dc0733c0 0x7f66dc0aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.420+0000 7f66e12a6640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66dc0afcb0 0x7f66dc143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66e22a8640 1 -- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66dc0afcb0 msgr2=0x7f66dc143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66e22a8640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f66dc0afcb0 0x7f66dc143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66e22a8640 1 -- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66dc0733c0 msgr2=0x7f66dc0aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66e22a8640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66dc0733c0 0x7f66dc0aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66e22a8640 1 -- 172.21.15.104:0/112306452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc1f6cf0 con 0x7f66dc15eed0 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66e22a8640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc15eed0 0x7f66dc15dfe0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f66d400d6d0 tx=0x7f66d400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4017070 con 0x7f66dc15eed0 2024-09-17T03:06:29.422 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66d4004310 con 0x7f66dc15eed0 2024-09-17T03:06:29.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4005280 con 0x7f66dc15eed0 2024-09-17T03:06:29.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc1f6fd0 con 0x7f66dc15eed0 2024-09-17T03:06:29.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.421+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc1f7590 con 0x7f66dc15eed0 2024-09-17T03:06:29.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.422+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66dc074200 con 0x7f66dc15eed0 2024-09-17T03:06:29.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.423+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66d4005420 con 0x7f66dc15eed0 2024-09-17T03:06:29.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.423+0000 7f66d27fc640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c0078bc0 0x7f66c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.423+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f66d409b260 con 0x7f66dc15eed0 2024-09-17T03:06:29.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.423+0000 7f66d27fc640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7f66c007ead0 0x7f66c0080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.423+0000 7f66e1aa7640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c0078bc0 0x7f66c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.423+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 --> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66c00815f0 con 0x7f66c007ead0 2024-09-17T03:06:29.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.423+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) ==== 24+0+0 (secure 0 0 0) 0x7f66d409b6f0 con 0x7f66dc15eed0 2024-09-17T03:06:29.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.423+0000 7f66e12a6640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7f66c007ead0 0x7f66c0080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.424+0000 7f66e12a6640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7f66c007ead0 0x7f66c0080f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.424+0000 7f66e1aa7640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c0078bc0 0x7f66c007b0d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f66d8035000 tx=0x7f66d8038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.425 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.424+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 <== osd.2 v2:172.21.15.104:6824/100151575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f66c00815f0 con 0x7f66c007ead0 2024-09-17T03:06:29.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.435+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 --> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66dc146bb0 con 0x7f66c007ead0 2024-09-17T03:06:29.435 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66d27fc640 1 -- 172.21.15.104:0/112306452 <== osd.2 v2:172.21.15.104:6824/100151575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f66dc146bb0 con 0x7f66c007ead0 2024-09-17T03:06:29.435 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:29.436 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T03:06:29.436 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7f66c007ead0 msgr2=0x7f66c0080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.104:6824/100151575,v1:172.21.15.104:6825/100151575] conn(0x7f66c007ead0 0x7f66c0080f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c0078bc0 msgr2=0x7f66c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f66c0078bc0 0x7f66c007b0d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f66d8035000 tx=0x7f66d8038040 comp rx=0 tx=0).stop 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc15eed0 msgr2=0x7f66dc15dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 --2- 172.21.15.104:0/112306452 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f66dc15eed0 0x7f66dc15dfe0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f66d400d6d0 tx=0x7f66d400db90 comp rx=0 tx=0).stop 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e22a8640 1 -- 172.21.15.104:0/112306452 reap_dead start 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 shutdown_connections 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 >> 172.21.15.104:0/112306452 conn(0x7f66dc069610 msgr2=0x7f66dc15d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:29.437 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 shutdown_connections 2024-09-17T03:06:29.438 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.436+0000 7f66e3d0b640 1 -- 172.21.15.104:0/112306452 wait complete. 2024-09-17T03:06:29.446 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T03:06:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.560+0000 7f836eb39640 1 -- 172.21.15.104:0/326390055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83680cdf10 msgr2=0x7f83680b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.560+0000 7f836eb39640 1 --2- 172.21.15.104:0/326390055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83680cdf10 0x7f83680b57e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f835c005fd0 tx=0x7f835c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:06:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.560+0000 7f836eb39640 1 -- 172.21.15.104:0/326390055 shutdown_connections 2024-09-17T03:06:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.560+0000 7f836eb39640 1 --2- 172.21.15.104:0/326390055 >> v2:172.21.15.192:3300/0 conn(0x7f83680b5d20 0x7f83680cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.560+0000 7f836eb39640 1 --2- 172.21.15.104:0/326390055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83680cdf10 0x7f83680b57e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.560+0000 7f836eb39640 1 -- 172.21.15.104:0/326390055 >> 172.21.15.104:0/326390055 conn(0x7f83680b44a0 msgr2=0x7f83680b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.560+0000 7f836eb39640 1 -- 172.21.15.104:0/326390055 shutdown_connections 2024-09-17T03:06:29.560 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.560+0000 7f836eb39640 1 -- 172.21.15.104:0/326390055 wait complete. 2024-09-17T03:06:29.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.562+0000 7f836eb39640 1 Processor -- start 2024-09-17T03:06:29.561 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.562+0000 7f836eb39640 1 -- start start 2024-09-17T03:06:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.563+0000 7f836eb39640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83680b4fc0 0x7f83680c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.563+0000 7f836eb39640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83680b5d20 0x7f8368150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.563+0000 7f836eb39640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83680cdf10 0x7f83680ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.563+0000 7f836eb39640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f83680d18c0 con 0x7f83680b5d20 2024-09-17T03:06:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.563+0000 7f836eb39640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f83680d0210 con 0x7f83680cdf10 2024-09-17T03:06:29.564 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.563+0000 7f836eb39640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8368160f50 con 0x7f83680b4fc0 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83680b5d20 0x7f8368150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83680b5d20 0x7f8368150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55912/0 (socket says 172.21.15.104:55912) 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 -- 172.21.15.104:0/2391172350 learned_addr learned my addr 172.21.15.104:0/2391172350 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f836d0d6640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83680cdf10 0x7f83680ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f836c8d5640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83680b4fc0 0x7f83680c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 -- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83680b4fc0 msgr2=0x7f83680c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83680b4fc0 0x7f83680c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 -- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83680cdf10 msgr2=0x7f83680ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.565 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83680cdf10 0x7f83680ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 -- 172.21.15.104:0/2391172350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83680c9e40 con 0x7f83680b5d20 2024-09-17T03:06:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f8367fff640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83680b5d20 0x7f8368150cf0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f835c006010 tx=0x7f835c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f83657fa640 1 -- 172.21.15.104:0/2391172350 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c044070 con 0x7f83680b5d20 2024-09-17T03:06:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f83657fa640 1 -- 172.21.15.104:0/2391172350 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f835c004040 con 0x7f83680b5d20 2024-09-17T03:06:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83681f42a0 con 0x7f83680b5d20 2024-09-17T03:06:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f83657fa640 1 -- 172.21.15.104:0/2391172350 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c004450 con 0x7f83680b5d20 2024-09-17T03:06:29.566 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.564+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83681f4860 con 0x7f83680b5d20 2024-09-17T03:06:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.565+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83680cfa80 con 0x7f83680b5d20 2024-09-17T03:06:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.566+0000 7f83657fa640 1 -- 172.21.15.104:0/2391172350 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f835c047070 con 0x7f83680b5d20 2024-09-17T03:06:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.566+0000 7f83657fa640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8354078b90 0x7f835407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.567+0000 7f83657fa640 1 -- 172.21.15.104:0/2391172350 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f835c0bb760 con 0x7f83680b5d20 2024-09-17T03:06:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.567+0000 7f836c8d5640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8354078b90 0x7f835407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.567+0000 7f836c8d5640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8354078b90 0x7f835407b0a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f83680ccf90 tx=0x7f8358009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.570 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.571+0000 7f83657fa640 1 -- 172.21.15.104:0/2391172350 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f835c032030 con 0x7f83680b5d20 2024-09-17T03:06:29.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.745+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f83680d3750 con 0x7f8354078b90 2024-09-17T03:06:29.744 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.745+0000 7f83657fa640 1 -- 172.21.15.104:0/2391172350 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f83680d3750 con 0x7f8354078b90 2024-09-17T03:06:29.745 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T03:06:29.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8354078b90 msgr2=0x7f835407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8354078b90 0x7f835407b0a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f83680ccf90 tx=0x7f8358009040 comp rx=0 tx=0).stop 2024-09-17T03:06:29.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83680b5d20 msgr2=0x7f8368150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.747 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83680b5d20 0x7f8368150cf0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f835c006010 tx=0x7f835c003ba0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 shutdown_connections 2024-09-17T03:06:29.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8354078b90 0x7f835407b0a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83680cdf10 0x7f83680ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f83680b5d20 0x7f8368150cf0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 --2- 172.21.15.104:0/2391172350 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83680b4fc0 0x7f83680c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 >> 172.21.15.104:0/2391172350 conn(0x7f83680b44a0 msgr2=0x7f83680b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:29.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 shutdown_connections 2024-09-17T03:06:29.748 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.748+0000 7f836eb39640 1 -- 172.21.15.104:0/2391172350 wait complete. 2024-09-17T03:06:29.758 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T03:06:29.758 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:06:29.874 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.875+0000 7ff92fb19640 1 -- 172.21.15.104:0/2571816675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff910004d40 msgr2=0x7ff910005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.875+0000 7ff92fb19640 1 --2- 172.21.15.104:0/2571816675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff910004d40 0x7ff910005150 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff9280d05d0 tx=0x7ff910005830 comp rx=0 tx=0).stop 2024-09-17T03:06:29.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.875+0000 7ff92e0b6640 1 -- 172.21.15.104:0/2571816675 reap_dead start 2024-09-17T03:06:29.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.875+0000 7ff92fb19640 1 -- 172.21.15.104:0/2571816675 shutdown_connections 2024-09-17T03:06:29.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.875+0000 7ff92fb19640 1 -- 172.21.15.104:0/2571816675 >> 172.21.15.104:0/2571816675 conn(0x7ff9280b4580 msgr2=0x7ff9280b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:29.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.875+0000 7ff92fb19640 1 -- 172.21.15.104:0/2571816675 shutdown_connections 2024-09-17T03:06:29.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.875+0000 7ff92fb19640 1 -- 172.21.15.104:0/2571816675 wait complete. 2024-09-17T03:06:29.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.877+0000 7ff92fb19640 1 Processor -- start 2024-09-17T03:06:29.876 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.877+0000 7ff92fb19640 1 -- start start 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92fb19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff910004d40 0x7ff9280cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92fb19640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9280b2970 0x7ff92806d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92fb19640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff92806dd80 0x7ff9281f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92fb19640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff9280b7700 con 0x7ff910004d40 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92fb19640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff9280b6b00 con 0x7ff92806dd80 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92fb19640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff9280b7880 con 0x7ff9280b2970 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff910004d40 0x7ff9280cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff910004d40 0x7ff9280cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55930/0 (socket says 172.21.15.104:55930) 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 -- 172.21.15.104:0/3460797305 learned_addr learned my addr 172.21.15.104:0/3460797305 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:29.879 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d0b4640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9280b2970 0x7ff92806d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92e0b6640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff92806dd80 0x7ff9281f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 -- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9280b2970 msgr2=0x7ff92806d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9280b2970 0x7ff92806d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 -- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff92806dd80 msgr2=0x7ff9281f92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff92806dd80 0x7ff9281f92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 -- 172.21.15.104:0/3460797305 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92806e190 con 0x7ff910004d40 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d0b4640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9280b2970 0x7ff92806d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.878+0000 7ff92d8b5640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff910004d40 0x7ff9280cc830 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7ff918010ce0 tx=0x7ff91800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.879+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918003b70 con 0x7ff910004d40 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.879+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff918015070 con 0x7ff910004d40 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.879+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff928155840 con 0x7ff910004d40 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.879+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918004050 con 0x7ff910004d40 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.879+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff928155f90 con 0x7ff910004d40 2024-09-17T03:06:29.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.880+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9280b6d60 con 0x7ff910004d40 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.880+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9180041f0 con 0x7ff910004d40 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.881+0000 7ff9267fc640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff914078b90 0x7ff91407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.881+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7ff91809bc10 con 0x7ff910004d40 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.881+0000 7ff9267fc640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7ff91407eaa0 0x7ff914080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.881+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 --> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff91800de90 con 0x7ff91407eaa0 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.881+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) ==== 24+0+0 (secure 0 0 0) 0x7ff91809e270 con 0x7ff910004d40 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.881+0000 7ff92d0b4640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff914078b90 0x7ff91407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.881+0000 7ff92e0b6640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7ff91407eaa0 0x7ff914080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.882+0000 7ff92e0b6640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7ff91407eaa0 0x7ff914080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.882+0000 7ff92d0b4640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff914078b90 0x7ff91407b0a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff9281f9220 tx=0x7ff91c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:29.882 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.882+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 <== osd.3 v2:172.21.15.104:6816/1619923136 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7ff91800de90 con 0x7ff91407eaa0 2024-09-17T03:06:29.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.893+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 --> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff92815eaf0 con 0x7ff91407eaa0 2024-09-17T03:06:29.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.893+0000 7ff9267fc640 1 -- 172.21.15.104:0/3460797305 <== osd.3 v2:172.21.15.104:6816/1619923136 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7ff92815eaf0 con 0x7ff91407eaa0 2024-09-17T03:06:29.893 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:29.893 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T03:06:29.893 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:29.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7ff91407eaa0 msgr2=0x7ff914080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.894 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.104:6816/1619923136,v1:172.21.15.104:6817/1619923136] conn(0x7ff91407eaa0 0x7ff914080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff914078b90 msgr2=0x7ff91407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff914078b90 0x7ff91407b0a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff9281f9220 tx=0x7ff91c005f90 comp rx=0 tx=0).stop 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff910004d40 msgr2=0x7ff9280cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 --2- 172.21.15.104:0/3460797305 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff910004d40 0x7ff9280cc830 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7ff918010ce0 tx=0x7ff91800e720 comp rx=0 tx=0).stop 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92e0b6640 1 -- 172.21.15.104:0/3460797305 reap_dead start 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 shutdown_connections 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 >> 172.21.15.104:0/3460797305 conn(0x7ff9280b4580 msgr2=0x7ff9280b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 shutdown_connections 2024-09-17T03:06:29.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:29.894+0000 7ff92fb19640 1 -- 172.21.15.104:0/3460797305 wait complete. 2024-09-17T03:06:29.904 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T03:06:30.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.018+0000 7fe945d0b640 1 -- 172.21.15.104:0/1956115267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe928004800 msgr2=0x7fe928004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.018 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.019+0000 7fe945d0b640 1 --2- 172.21.15.104:0/1956115267 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe928004800 0x7fe928004c10 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c260 tx=0x7fe928005830 comp rx=0 tx=0).stop 2024-09-17T03:06:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.019+0000 7fe93ffff640 1 -- 172.21.15.104:0/1956115267 reap_dead start 2024-09-17T03:06:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.019+0000 7fe945d0b640 1 -- 172.21.15.104:0/1956115267 shutdown_connections 2024-09-17T03:06:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.019+0000 7fe945d0b640 1 -- 172.21.15.104:0/1956115267 >> 172.21.15.104:0/1956115267 conn(0x7fe9400b2450 msgr2=0x7fe9400b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.019+0000 7fe945d0b640 1 -- 172.21.15.104:0/1956115267 shutdown_connections 2024-09-17T03:06:30.019 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.019+0000 7fe945d0b640 1 -- 172.21.15.104:0/1956115267 wait complete. 2024-09-17T03:06:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.021+0000 7fe945d0b640 1 Processor -- start 2024-09-17T03:06:30.020 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.021+0000 7fe945d0b640 1 -- start start 2024-09-17T03:06:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe945d0b640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe928004800 0x7fe94014e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe945d0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe94014a320 0x7fe9400b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe945d0b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe94014a730 0x7fe9400b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe945d0b640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe9400cda00 con 0x7fe94014a730 2024-09-17T03:06:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe945d0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe9400cd880 con 0x7fe94014a320 2024-09-17T03:06:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe945d0b640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fe940156a00 con 0x7fe928004800 2024-09-17T03:06:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe94014a730 0x7fe9400b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.023 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93ffff640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe94014a730 0x7fe9400b4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55948/0 (socket says 172.21.15.104:55948) 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93ffff640 1 -- 172.21.15.104:0/1609086432 learned_addr learned my addr 172.21.15.104:0/1609086432 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93effd640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe94014a320 0x7fe9400b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93f7fe640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe928004800 0x7fe94014e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93ffff640 1 -- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe928004800 msgr2=0x7fe94014e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93ffff640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe928004800 0x7fe94014e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93ffff640 1 -- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe94014a320 msgr2=0x7fe9400b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93ffff640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe94014a320 0x7fe9400b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.022+0000 7fe93ffff640 1 -- 172.21.15.104:0/1609086432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94014da00 con 0x7fe94014a730 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.023+0000 7fe93ffff640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe94014a730 0x7fe9400b4c90 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe9400734e0 tx=0x7fe93800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.023+0000 7fe927fff640 1 -- 172.21.15.104:0/1609086432 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938004b20 con 0x7fe94014a730 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.023+0000 7fe927fff640 1 -- 172.21.15.104:0/1609086432 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe938004cc0 con 0x7fe94014a730 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.023+0000 7fe927fff640 1 -- 172.21.15.104:0/1609086432 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938003bd0 con 0x7fe94014a730 2024-09-17T03:06:30.024 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.023+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94014ef80 con 0x7fe94014a730 2024-09-17T03:06:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.023+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94014dfc0 con 0x7fe94014a730 2024-09-17T03:06:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.024+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9400cd170 con 0x7fe94014a730 2024-09-17T03:06:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.025+0000 7fe927fff640 1 -- 172.21.15.104:0/1609086432 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe938004030 con 0x7fe94014a730 2024-09-17T03:06:30.025 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.025+0000 7fe927fff640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe92c078b90 0x7fe92c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.025+0000 7fe927fff640 1 -- 172.21.15.104:0/1609086432 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fe93809aed0 con 0x7fe94014a730 2024-09-17T03:06:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.025+0000 7fe93f7fe640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe92c078b90 0x7fe92c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.026 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.026+0000 7fe93f7fe640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe92c078b90 0x7fe92c07b0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe930006fd0 tx=0x7fe930006cf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.029 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.029+0000 7fe927fff640 1 -- 172.21.15.104:0/1609086432 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe938063050 con 0x7fe94014a730 2024-09-17T03:06:30.205 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.205+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe9400b30b0 con 0x7fe92c078b90 2024-09-17T03:06:30.206 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.206+0000 7fe927fff640 1 -- 172.21.15.104:0/1609086432 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe9400b30b0 con 0x7fe92c078b90 2024-09-17T03:06:30.206 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T03:06:30.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe92c078b90 msgr2=0x7fe92c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe92c078b90 0x7fe92c07b0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe930006fd0 tx=0x7fe930006cf0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe94014a730 msgr2=0x7fe9400b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe94014a730 0x7fe9400b4c90 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe9400734e0 tx=0x7fe93800f3c0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 shutdown_connections 2024-09-17T03:06:30.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fe92c078b90 0x7fe92c07b0a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.208 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe94014a320 0x7fe9400b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fe94014a730 0x7fe9400b4c90 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 --2- 172.21.15.104:0/1609086432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe928004800 0x7fe94014e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 >> 172.21.15.104:0/1609086432 conn(0x7fe9400b2450 msgr2=0x7fe94015f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:30.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 shutdown_connections 2024-09-17T03:06:30.209 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.208+0000 7fe945d0b640 1 -- 172.21.15.104:0/1609086432 wait complete. 2024-09-17T03:06:30.219 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T03:06:30.219 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:06:30.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.336+0000 7f10b6339640 1 -- 172.21.15.104:0/1251931769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1098004800 msgr2=0x7f1098004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.336+0000 7f10b6339640 1 --2- 172.21.15.104:0/1251931769 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1098004800 0x7f1098004c10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f10a4001690 tx=0x7f1098005830 comp rx=0 tx=0).stop 2024-09-17T03:06:30.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.336+0000 7f10b48d6640 1 -- 172.21.15.104:0/1251931769 reap_dead start 2024-09-17T03:06:30.336 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.336+0000 7f10b6339640 1 -- 172.21.15.104:0/1251931769 shutdown_connections 2024-09-17T03:06:30.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.336+0000 7f10b6339640 1 -- 172.21.15.104:0/1251931769 >> 172.21.15.104:0/1251931769 conn(0x7f10b009ba40 msgr2=0x7f10b009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:30.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.336+0000 7f10b6339640 1 -- 172.21.15.104:0/1251931769 shutdown_connections 2024-09-17T03:06:30.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.336+0000 7f10b6339640 1 -- 172.21.15.104:0/1251931769 wait complete. 2024-09-17T03:06:30.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.338+0000 7f10b6339640 1 Processor -- start 2024-09-17T03:06:30.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.338+0000 7f10b6339640 1 -- start start 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.339+0000 7f10b6339640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1098004800 0x7f10b01f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.339+0000 7f10b6339640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10b015be60 0x7f10b015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10b6339640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10b00af650 0x7f10b00afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10b6339640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f10b00cde60 con 0x7f10b015be60 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10b6339640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10b00d0ea0 con 0x7f10b00af650 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10b6339640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f10b00cdfe0 con 0x7f1098004800 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10b015be60 0x7f10b015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10b015be60 0x7f10b015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55974/0 (socket says 172.21.15.104:55974) 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 -- 172.21.15.104:0/365571014 learned_addr learned my addr 172.21.15.104:0/365571014 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:30.341 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10affff640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1098004800 0x7f10b01f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10b48d6640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10b00af650 0x7f10b00afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 -- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1098004800 msgr2=0x7f10b01f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1098004800 0x7f10b01f7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 -- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10b00af650 msgr2=0x7f10b00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10b00af650 0x7f10b00afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 -- 172.21.15.104:0/365571014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b00b7760 con 0x7f10b015be60 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10b48d6640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10b00af650 0x7f10b00afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10af7fe640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10b015be60 0x7f10b015aff0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f10a402a910 tx=0x7f10a4006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4038070 con 0x7f10b015be60 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10a4003af0 con 0x7f10b015be60 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4033420 con 0x7f10b015be60 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b00b7a40 con 0x7f10b015be60 2024-09-17T03:06:30.342 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.340+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b00b00b0 con 0x7f10b015be60 2024-09-17T03:06:30.343 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.341+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10b00ce540 con 0x7f10b015be60 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.342+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10a4043020 con 0x7f10b015be60 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.342+0000 7f10acff9640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f109c078bc0 0x7f109c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.343+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f10a40ba1e0 con 0x7f10b015be60 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.343+0000 7f10acff9640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f109c07ead0 0x7f109c080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.343+0000 7f10affff640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f109c078bc0 0x7f109c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.343+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 --> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10a402fe50 con 0x7f109c07ead0 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.343+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) ==== 24+0+0 (secure 0 0 0) 0x7f10a40c1050 con 0x7f10b015be60 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.343+0000 7f10b48d6640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f109c07ead0 0x7f109c080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.344 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.343+0000 7f10affff640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f109c078bc0 0x7f109c07b0d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f10a00018a0 tx=0x7f10a0006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.344+0000 7f10b48d6640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f109c07ead0 0x7f109c080f20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.345 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.344+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 <== osd.4 v2:172.21.15.192:6818/3240881174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f10a402fe50 con 0x7f109c07ead0 2024-09-17T03:06:30.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.355+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 --> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f10b015bc60 con 0x7f109c07ead0 2024-09-17T03:06:30.355 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.356+0000 7f10acff9640 1 -- 172.21.15.104:0/365571014 <== osd.4 v2:172.21.15.192:6818/3240881174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f10b015bc60 con 0x7f109c07ead0 2024-09-17T03:06:30.356 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:30.356 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T03:06:30.356 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f109c07ead0 msgr2=0x7f109c080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6818/3240881174,v1:172.21.15.192:6819/3240881174] conn(0x7f109c07ead0 0x7f109c080f20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f109c078bc0 msgr2=0x7f109c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f109c078bc0 0x7f109c07b0d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f10a00018a0 tx=0x7f10a0006040 comp rx=0 tx=0).stop 2024-09-17T03:06:30.357 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10b015be60 msgr2=0x7f10b015aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 --2- 172.21.15.104:0/365571014 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f10b015be60 0x7f10b015aff0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f10a402a910 tx=0x7f10a4006360 comp rx=0 tx=0).stop 2024-09-17T03:06:30.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b48d6640 1 -- 172.21.15.104:0/365571014 reap_dead start 2024-09-17T03:06:30.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 shutdown_connections 2024-09-17T03:06:30.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 >> 172.21.15.104:0/365571014 conn(0x7f10b009ba40 msgr2=0x7f10b015ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:30.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 shutdown_connections 2024-09-17T03:06:30.358 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.357+0000 7f10b6339640 1 -- 172.21.15.104:0/365571014 wait complete. 2024-09-17T03:06:30.367 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T03:06:30.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.481+0000 7f17130bd640 1 -- 172.21.15.104:0/1217612819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f170c15fb40 msgr2=0x7f170c161380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.481+0000 7f17130bd640 1 --2- 172.21.15.104:0/1217612819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f170c15fb40 0x7f170c161380 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009830 tx=0x7f16f402a480 comp rx=0 tx=0).stop 2024-09-17T03:06:30.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.481+0000 7f17130bd640 1 -- 172.21.15.104:0/1217612819 shutdown_connections 2024-09-17T03:06:30.481 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.481+0000 7f17130bd640 1 --2- 172.21.15.104:0/1217612819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f170c15fb40 0x7f170c161380 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.481+0000 7f17130bd640 1 --2- 172.21.15.104:0/1217612819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f170c15f1f0 0x7f170c15f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.481+0000 7f17130bd640 1 -- 172.21.15.104:0/1217612819 >> 172.21.15.104:0/1217612819 conn(0x7f170c069120 msgr2=0x7f170c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:30.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.481+0000 7f17130bd640 1 -- 172.21.15.104:0/1217612819 shutdown_connections 2024-09-17T03:06:30.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.481+0000 7f17130bd640 1 -- 172.21.15.104:0/1217612819 wait complete. 2024-09-17T03:06:30.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.483+0000 7f17130bd640 1 Processor -- start 2024-09-17T03:06:30.482 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.483+0000 7f17130bd640 1 -- start start 2024-09-17T03:06:30.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.484+0000 7f17130bd640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f170c0b65e0 0x7f170c0caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.485 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17130bd640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f170c15f1f0 0x7f170c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17130bd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f170c15fb40 0x7f170c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17130bd640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f170c161d60 con 0x7f170c0b65e0 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17130bd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f170c161be0 con 0x7f170c15fb40 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17130bd640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f170c161ee0 con 0x7f170c15f1f0 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f170c0b65e0 0x7f170c0caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f170c0b65e0 0x7f170c0caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:55984/0 (socket says 172.21.15.104:55984) 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 -- 172.21.15.104:0/209678451 learned_addr learned my addr 172.21.15.104:0/209678451 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f170bfff640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f170c15f1f0 0x7f170c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f171165a640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f170c15fb40 0x7f170c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 -- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f170c15f1f0 msgr2=0x7f170c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f170c15f1f0 0x7f170c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 -- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f170c15fb40 msgr2=0x7f170c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.486 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f170c15fb40 0x7f170c15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 -- 172.21.15.104:0/209678451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c1f98e0 con 0x7f170c0b65e0 2024-09-17T03:06:30.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f1710e59640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f170c0b65e0 0x7f170c0caab0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f170400c3c0 tx=0x7f170400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17097fa640 1 -- 172.21.15.104:0/209678451 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704017070 con 0x7f170c0b65e0 2024-09-17T03:06:30.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17097fa640 1 -- 172.21.15.104:0/209678451 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17040035f0 con 0x7f170c0b65e0 2024-09-17T03:06:30.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c1f9de0 con 0x7f170c0b65e0 2024-09-17T03:06:30.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17097fa640 1 -- 172.21.15.104:0/209678451 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704003a20 con 0x7f170c0b65e0 2024-09-17T03:06:30.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.485+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c1fa3a0 con 0x7f170c0b65e0 2024-09-17T03:06:30.487 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.486+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f170c0d1f80 con 0x7f170c0b65e0 2024-09-17T03:06:30.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.487+0000 7f17097fa640 1 -- 172.21.15.104:0/209678451 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f170401a070 con 0x7f170c0b65e0 2024-09-17T03:06:30.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.487+0000 7f17097fa640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16ec078bc0 0x7f16ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.488+0000 7f17097fa640 1 -- 172.21.15.104:0/209678451 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f1704099cd0 con 0x7f170c0b65e0 2024-09-17T03:06:30.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.488+0000 7f170bfff640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16ec078bc0 0x7f16ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.488 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.488+0000 7f170bfff640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16ec078bc0 0x7f16ec07b0d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f170c0ca860 tx=0x7f16fc009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.491 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.492+0000 7f17097fa640 1 -- 172.21.15.104:0/209678451 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1704062410 con 0x7f170c0b65e0 2024-09-17T03:06:30.663 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.664+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f170c069810 con 0x7f16ec078bc0 2024-09-17T03:06:30.737 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.665+0000 7f17097fa640 1 -- 172.21.15.104:0/209678451 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f170c069810 con 0x7f16ec078bc0 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.666+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16ec078bc0 msgr2=0x7f16ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.666+0000 7f17130bd640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16ec078bc0 0x7f16ec07b0d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f170c0ca860 tx=0x7f16fc009500 comp rx=0 tx=0).stop 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.666+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f170c0b65e0 msgr2=0x7f170c0caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.666+0000 7f17130bd640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f170c0b65e0 0x7f170c0caab0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f170400c3c0 tx=0x7f170400c880 comp rx=0 tx=0).stop 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.667+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 shutdown_connections 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.667+0000 7f17130bd640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f16ec078bc0 0x7f16ec07b0d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.667+0000 7f17130bd640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f170c15fb40 0x7f170c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.667+0000 7f17130bd640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f170c15f1f0 0x7f170c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.667+0000 7f17130bd640 1 --2- 172.21.15.104:0/209678451 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f170c0b65e0 0x7f170c0caab0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.667+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 >> 172.21.15.104:0/209678451 conn(0x7f170c069120 msgr2=0x7f170c0d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:30.738 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.667+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 shutdown_connections 2024-09-17T03:06:30.739 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.667+0000 7f17130bd640 1 -- 172.21.15.104:0/209678451 wait complete. 2024-09-17T03:06:30.739 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T03:06:30.739 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:06:30.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.856+0000 7f68e4b57640 1 -- 172.21.15.104:0/2236768096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc003a30 msgr2=0x7f68cc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.856+0000 7f68e4b57640 1 --2- 172.21.15.104:0/2236768096 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc003a30 0x7f68cc003ea0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f68d80013d0 tx=0x7f68cc005830 comp rx=0 tx=0).stop 2024-09-17T03:06:30.856 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.856+0000 7f68ded9d640 1 -- 172.21.15.104:0/2236768096 reap_dead start 2024-09-17T03:06:30.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.856+0000 7f68e4b57640 1 -- 172.21.15.104:0/2236768096 shutdown_connections 2024-09-17T03:06:30.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.856+0000 7f68e4b57640 1 -- 172.21.15.104:0/2236768096 >> 172.21.15.104:0/2236768096 conn(0x7f68e00d29c0 msgr2=0x7f68e00d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:30.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.856+0000 7f68e4b57640 1 -- 172.21.15.104:0/2236768096 shutdown_connections 2024-09-17T03:06:30.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.856+0000 7f68e4b57640 1 -- 172.21.15.104:0/2236768096 wait complete. 2024-09-17T03:06:30.857 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.858+0000 7f68e4b57640 1 Processor -- start 2024-09-17T03:06:30.858 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.858+0000 7f68e4b57640 1 -- start start 2024-09-17T03:06:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68e4b57640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc003a30 0x7f68e009cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68e4b57640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68e009f560 0x7f68e00b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68e4b57640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68e00707e0 0x7f68e0070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68e4b57640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f68e00b6dd0 con 0x7f68cc003a30 2024-09-17T03:06:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68e4b57640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f68e00b6c50 con 0x7f68e009f560 2024-09-17T03:06:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68e4b57640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f68e00b6f50 con 0x7f68e00707e0 2024-09-17T03:06:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc003a30 0x7f68e009cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.861 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc003a30 0x7f68e009cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56000/0 (socket says 172.21.15.104:56000) 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 -- 172.21.15.104:0/2834719396 learned_addr learned my addr 172.21.15.104:0/2834719396 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68ddd9b640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68e009f560 0x7f68e00b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68ded9d640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68e00707e0 0x7f68e0070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 -- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68e00707e0 msgr2=0x7f68e0070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f68e00707e0 0x7f68e0070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 -- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68e009f560 msgr2=0x7f68e00b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68e009f560 0x7f68e00b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 -- 172.21.15.104:0/2834719396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e0071130 con 0x7f68cc003a30 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68de59c640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc003a30 0x7f68e009cc10 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f68d8000f80 tx=0x7f68d8004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.860+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8039070 con 0x7f68cc003a30 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.861+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68d802bca0 con 0x7f68cc003a30 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.861+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8006290 con 0x7f68cc003a30 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.861+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e009d150 con 0x7f68cc003a30 2024-09-17T03:06:30.862 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.861+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e009d920 con 0x7f68cc003a30 2024-09-17T03:06:30.863 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.861+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68e00b61f0 con 0x7f68cc003a30 2024-09-17T03:06:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.862+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f68d8006430 con 0x7f68cc003a30 2024-09-17T03:06:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.863+0000 7f68d6ffd640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68c0078b90 0x7f68c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.863+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f68d80baf60 con 0x7f68cc003a30 2024-09-17T03:06:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.863+0000 7f68d6ffd640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7f68c007eaa0 0x7f68c0080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.863+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 --> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68c00815c0 con 0x7f68c007eaa0 2024-09-17T03:06:30.864 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.863+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) ==== 24+0+0 (secure 0 0 0) 0x7f68d80bb3f0 con 0x7f68cc003a30 2024-09-17T03:06:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.863+0000 7f68ddd9b640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68c0078b90 0x7f68c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.863+0000 7f68ded9d640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7f68c007eaa0 0x7f68c0080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.864+0000 7f68ddd9b640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68c0078b90 0x7f68c007b0a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f68e01f7d90 tx=0x7f68c8006f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.864+0000 7f68ded9d640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7f68c007eaa0 0x7f68c0080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:30.865 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.864+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 <== osd.5 v2:172.21.15.192:6802/3946789085 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f68c00815c0 con 0x7f68c007eaa0 2024-09-17T03:06:30.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.875+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 --> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f68e01f6e30 con 0x7f68c007eaa0 2024-09-17T03:06:30.875 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.876+0000 7f68d6ffd640 1 -- 172.21.15.104:0/2834719396 <== osd.5 v2:172.21.15.192:6802/3946789085 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f68e01f6e30 con 0x7f68c007eaa0 2024-09-17T03:06:30.876 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:30.876 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T03:06:30.876 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.876+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7f68c007eaa0 msgr2=0x7f68c0080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6802/3946789085,v1:172.21.15.192:6803/3946789085] conn(0x7f68c007eaa0 0x7f68c0080ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68c0078b90 msgr2=0x7f68c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f68c0078b90 0x7f68c007b0a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f68e01f7d90 tx=0x7f68c8006f70 comp rx=0 tx=0).stop 2024-09-17T03:06:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc003a30 msgr2=0x7f68e009cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 --2- 172.21.15.104:0/2834719396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f68cc003a30 0x7f68e009cc10 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f68d8000f80 tx=0x7f68d8004c30 comp rx=0 tx=0).stop 2024-09-17T03:06:30.877 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68ded9d640 1 -- 172.21.15.104:0/2834719396 reap_dead start 2024-09-17T03:06:30.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 shutdown_connections 2024-09-17T03:06:30.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 >> 172.21.15.104:0/2834719396 conn(0x7f68e00d29c0 msgr2=0x7f68e01e9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:30.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 shutdown_connections 2024-09-17T03:06:30.878 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:30.877+0000 7f68e4b57640 1 -- 172.21.15.104:0/2834719396 wait complete. 2024-09-17T03:06:30.887 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T03:06:31.000 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.001+0000 7f4f867ad640 1 -- 172.21.15.104:0/1260531098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f800d2300 msgr2=0x7f4f80070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.001+0000 7f4f867ad640 1 --2- 172.21.15.104:0/1260531098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f800d2300 0x7f4f80070920 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009be0 tx=0x7f4f7802a840 comp rx=0 tx=0).stop 2024-09-17T03:06:31.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.001+0000 7f4f867ad640 1 -- 172.21.15.104:0/1260531098 shutdown_connections 2024-09-17T03:06:31.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.001+0000 7f4f867ad640 1 --2- 172.21.15.104:0/1260531098 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f800d2300 0x7f4f80070920 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.001+0000 7f4f867ad640 1 -- 172.21.15.104:0/1260531098 >> 172.21.15.104:0/1260531098 conn(0x7f4f8006cfc0 msgr2=0x7f4f8006d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.001+0000 7f4f867ad640 1 -- 172.21.15.104:0/1260531098 shutdown_connections 2024-09-17T03:06:31.001 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.001+0000 7f4f867ad640 1 -- 172.21.15.104:0/1260531098 wait complete. 2024-09-17T03:06:31.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.002+0000 7f4f867ad640 1 Processor -- start 2024-09-17T03:06:31.002 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.003+0000 7f4f867ad640 1 -- start start 2024-09-17T03:06:31.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f867ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f80073510 0x7f4f80156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.004 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f867ad640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f8015bff0 0x7f4f8014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f867ad640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f801515e0 0x7f4f801e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f867ad640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80070e60 con 0x7f4f801515e0 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f867ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f80160410 con 0x7f4f80073510 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f867ad640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f4f80070fe0 con 0x7f4f8015bff0 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f801515e0 0x7f4f801e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f801515e0 0x7f4f801e74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56028/0 (socket says 172.21.15.104:56028) 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 -- 172.21.15.104:0/4144511078 learned_addr learned my addr 172.21.15.104:0/4144511078 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f7ffff640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f80073510 0x7f4f80156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f7f7fe640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f8015bff0 0x7f4f8014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 -- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f8015bff0 msgr2=0x7f4f8014f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f8015bff0 0x7f4f8014f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 -- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f80073510 msgr2=0x7f4f80156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.005 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f80073510 0x7f4f80156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 -- 172.21.15.104:0/4144511078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f80157050 con 0x7f4f801515e0 2024-09-17T03:06:31.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.004+0000 7f4f84d4a640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f801515e0 0x7f4f801e74b0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009d00 tx=0x7f4f78033f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.005+0000 7f4f7cff9640 1 -- 172.21.15.104:0/4144511078 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78042020 con 0x7f4f801515e0 2024-09-17T03:06:31.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.005+0000 7f4f7cff9640 1 -- 172.21.15.104:0/4144511078 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f78004330 con 0x7f4f801515e0 2024-09-17T03:06:31.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.005+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f80151f80 con 0x7f4f801515e0 2024-09-17T03:06:31.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.005+0000 7f4f7cff9640 1 -- 172.21.15.104:0/4144511078 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78037040 con 0x7f4f801515e0 2024-09-17T03:06:31.006 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.005+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f801f7570 con 0x7f4f801515e0 2024-09-17T03:06:31.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.006+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f80157220 con 0x7f4f801515e0 2024-09-17T03:06:31.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.006+0000 7f4f7cff9640 1 -- 172.21.15.104:0/4144511078 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4f78045020 con 0x7f4f801515e0 2024-09-17T03:06:31.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.007+0000 7f4f7cff9640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f6c078b90 0x7f4f6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.007+0000 7f4f7cff9640 1 -- 172.21.15.104:0/4144511078 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f4f780bbcb0 con 0x7f4f801515e0 2024-09-17T03:06:31.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.007+0000 7f4f7ffff640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f6c078b90 0x7f4f6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.007 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.008+0000 7f4f7ffff640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f6c078b90 0x7f4f6c07b0a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4f70006fd0 tx=0x7f4f70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.011 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.011+0000 7f4f7cff9640 1 -- 172.21.15.104:0/4144511078 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4f7804c030 con 0x7f4f801515e0 2024-09-17T03:06:31.185 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.186+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f4f80070920 con 0x7f4f6c078b90 2024-09-17T03:06:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.186+0000 7f4f7cff9640 1 -- 172.21.15.104:0/4144511078 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f80070920 con 0x7f4f6c078b90 2024-09-17T03:06:31.186 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f6c078b90 msgr2=0x7f4f6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f6c078b90 0x7f4f6c07b0a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4f70006fd0 tx=0x7f4f70008040 comp rx=0 tx=0).stop 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f801515e0 msgr2=0x7f4f801e74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f801515e0 0x7f4f801e74b0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009d00 tx=0x7f4f78033f00 comp rx=0 tx=0).stop 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 shutdown_connections 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f4f6c078b90 0x7f4f6c07b0a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f4f801515e0 0x7f4f801e74b0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f8015bff0 0x7f4f8014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 --2- 172.21.15.104:0/4144511078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f80073510 0x7f4f80156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.188 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 >> 172.21.15.104:0/4144511078 conn(0x7f4f8006cfc0 msgr2=0x7f4f8015f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 shutdown_connections 2024-09-17T03:06:31.189 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.188+0000 7f4f867ad640 1 -- 172.21.15.104:0/4144511078 wait complete. 2024-09-17T03:06:31.199 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T03:06:31.199 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:06:31.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.316+0000 7f61d76fa640 1 -- 172.21.15.104:0/403202396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61b8003a00 msgr2=0x7f61b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.316+0000 7f61d76fa640 1 --2- 172.21.15.104:0/403202396 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61b8003a00 0x7f61b8003e70 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f61c0006fd0 tx=0x7f61b8005830 comp rx=0 tx=0).stop 2024-09-17T03:06:31.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.316+0000 7f61d5c97640 1 -- 172.21.15.104:0/403202396 reap_dead start 2024-09-17T03:06:31.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.316+0000 7f61d76fa640 1 -- 172.21.15.104:0/403202396 shutdown_connections 2024-09-17T03:06:31.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.316+0000 7f61d76fa640 1 -- 172.21.15.104:0/403202396 >> 172.21.15.104:0/403202396 conn(0x7f61d009ba40 msgr2=0x7f61d009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.316+0000 7f61d76fa640 1 -- 172.21.15.104:0/403202396 shutdown_connections 2024-09-17T03:06:31.316 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.316+0000 7f61d76fa640 1 -- 172.21.15.104:0/403202396 wait complete. 2024-09-17T03:06:31.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.318+0000 7f61d76fa640 1 Processor -- start 2024-09-17T03:06:31.318 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.318+0000 7f61d76fa640 1 -- start start 2024-09-17T03:06:31.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.319+0000 7f61d76fa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b8003a00 0x7f61d01f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.319+0000 7f61d76fa640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d01f3430 0x7f61d00c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.319+0000 7f61d76fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d00c8d10 0x7f61d01467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.319+0000 7f61d76fa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00d0dd0 con 0x7f61d00c8d10 2024-09-17T03:06:31.320 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.319+0000 7f61d76fa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00d0c50 con 0x7f61b8003a00 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.319+0000 7f61d76fa640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f61d00d0f50 con 0x7f61d01f3430 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d00c8d10 0x7f61d01467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d00c8d10 0x7f61d01467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56038/0 (socket says 172.21.15.104:56038) 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 -- 172.21.15.104:0/1381645691 learned_addr learned my addr 172.21.15.104:0/1381645691 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d4c95640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d01f3430 0x7f61d00c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5496640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b8003a00 0x7f61d01f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 -- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d01f3430 msgr2=0x7f61d00c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d01f3430 0x7f61d00c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 -- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b8003a00 msgr2=0x7f61d01f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b8003a00 0x7f61d01f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 -- 172.21.15.104:0/1381645691 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d00c99f0 con 0x7f61d00c8d10 2024-09-17T03:06:31.321 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5496640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b8003a00 0x7f61d01f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:31.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d5c97640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d00c8d10 0x7f61d01467f0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f61d00d37b0 tx=0x7f61c800fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8005220 con 0x7f61d00c8d10 2024-09-17T03:06:31.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61c80054d0 con 0x7f61d00c8d10 2024-09-17T03:06:31.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d00c9e90 con 0x7f61d00c8d10 2024-09-17T03:06:31.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8004a00 con 0x7f61d00c8d10 2024-09-17T03:06:31.322 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.320+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d01e7540 con 0x7f61d00c8d10 2024-09-17T03:06:31.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.321+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61d00d2a70 con 0x7f61d00c8d10 2024-09-17T03:06:31.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.322+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61c8019030 con 0x7f61d00c8d10 2024-09-17T03:06:31.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.323+0000 7f61cdffb640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61bc078bc0 0x7f61bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.323 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.323+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f61c809abd0 con 0x7f61d00c8d10 2024-09-17T03:06:31.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.323+0000 7f61cdffb640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7f61bc07ead0 0x7f61bc080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.323+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 --> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61bc0815f0 con 0x7f61bc07ead0 2024-09-17T03:06:31.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.323+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) ==== 24+0+0 (secure 0 0 0) 0x7f61c80a02a0 con 0x7f61d00c8d10 2024-09-17T03:06:31.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.323+0000 7f61d5496640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61bc078bc0 0x7f61bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.323+0000 7f61d4c95640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7f61bc07ead0 0x7f61bc080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.323+0000 7f61d5496640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61bc078bc0 0x7f61bc07b0d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f61c0033000 tx=0x7f61c0001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.324+0000 7f61d4c95640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7f61bc07ead0 0x7f61bc080f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.324 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.324+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 <== osd.6 v2:172.21.15.192:6809/3422114417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f61bc0815f0 con 0x7f61bc07ead0 2024-09-17T03:06:31.334 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.335+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 --> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f61d00c9c40 con 0x7f61bc07ead0 2024-09-17T03:06:31.335 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.336+0000 7f61cdffb640 1 -- 172.21.15.104:0/1381645691 <== osd.6 v2:172.21.15.192:6809/3422114417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f61d00c9c40 con 0x7f61bc07ead0 2024-09-17T03:06:31.336 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:31.336 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T03:06:31.336 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.336+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7f61bc07ead0 msgr2=0x7f61bc080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.336+0000 7f61d76fa640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6809/3422114417,v1:172.21.15.192:6811/3422114417] conn(0x7f61bc07ead0 0x7f61bc080f20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61bc078bc0 msgr2=0x7f61bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d76fa640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f61bc078bc0 0x7f61bc07b0d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f61c0033000 tx=0x7f61c0001360 comp rx=0 tx=0).stop 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d00c8d10 msgr2=0x7f61d01467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d76fa640 1 --2- 172.21.15.104:0/1381645691 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f61d00c8d10 0x7f61d01467f0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f61d00d37b0 tx=0x7f61c800fa70 comp rx=0 tx=0).stop 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d5c97640 1 -- 172.21.15.104:0/1381645691 reap_dead start 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 shutdown_connections 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 >> 172.21.15.104:0/1381645691 conn(0x7f61d009ba40 msgr2=0x7f61d00b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.337 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 shutdown_connections 2024-09-17T03:06:31.338 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.337+0000 7f61d76fa640 1 -- 172.21.15.104:0/1381645691 wait complete. 2024-09-17T03:06:31.347 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T03:06:31.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.461+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3604784349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cb8003a00 msgr2=0x7f5cb8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.461+0000 7f5cd4fc6640 1 --2- 172.21.15.104:0/3604784349 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cb8003a00 0x7f5cb8003e70 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000bb20 tx=0x7f5cb8005830 comp rx=0 tx=0).stop 2024-09-17T03:06:31.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.461+0000 7f5cced9d640 1 -- 172.21.15.104:0/3604784349 reap_dead start 2024-09-17T03:06:31.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.461+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3604784349 shutdown_connections 2024-09-17T03:06:31.461 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.461+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3604784349 >> 172.21.15.104:0/3604784349 conn(0x7f5cd00b44a0 msgr2=0x7f5cd00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.461+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3604784349 shutdown_connections 2024-09-17T03:06:31.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.461+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3604784349 wait complete. 2024-09-17T03:06:31.462 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.463+0000 7f5cd4fc6640 1 Processor -- start 2024-09-17T03:06:31.463 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.463+0000 7f5cd4fc6640 1 -- start start 2024-09-17T03:06:31.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.464+0000 7f5cd4fc6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cb8003a00 0x7f5cd00712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.464+0000 7f5cd4fc6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cd015cc40 0x7f5cd006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.465 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cd4fc6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cd006d500 0x7f5cd00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cd4fc6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00cfe50 con 0x7f5cd006d500 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cd4fc6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00cfcd0 con 0x7f5cb8003a00 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cd4fc6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd00cffd0 con 0x7f5cd015cc40 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cd006d500 0x7f5cd00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cd006d500 0x7f5cd00b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56054/0 (socket says 172.21.15.104:56054) 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 -- 172.21.15.104:0/3911033675 learned_addr learned my addr 172.21.15.104:0/3911033675 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5ccdd9b640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cd015cc40 0x7f5cd006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cce59c640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cb8003a00 0x7f5cd00712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 -- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cd015cc40 msgr2=0x7f5cd006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cd015cc40 0x7f5cd006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 -- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cb8003a00 msgr2=0x7f5cd00712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cb8003a00 0x7f5cd00712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.466 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 -- 172.21.15.104:0/3911033675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd006d9b0 con 0x7f5cd006d500 2024-09-17T03:06:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cced9d640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cd006d500 0x7f5cd00b0760 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8005fd0 tx=0x7f5cc800fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cbeffd640 1 -- 172.21.15.104:0/3911033675 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8003b80 con 0x7f5cd006d500 2024-09-17T03:06:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cbeffd640 1 -- 172.21.15.104:0/3911033675 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cc8003e10 con 0x7f5cd006d500 2024-09-17T03:06:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd00c99a0 con 0x7f5cd006d500 2024-09-17T03:06:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cbeffd640 1 -- 172.21.15.104:0/3911033675 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8004d80 con 0x7f5cd006d500 2024-09-17T03:06:31.467 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.465+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd00b11c0 con 0x7f5cd006d500 2024-09-17T03:06:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.466+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd00b1420 con 0x7f5cd006d500 2024-09-17T03:06:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.467+0000 7f5cbeffd640 1 -- 172.21.15.104:0/3911033675 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5cc801a020 con 0x7f5cd006d500 2024-09-17T03:06:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.468+0000 7f5cbeffd640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5cb0078b90 0x7f5cb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.468+0000 7f5cbeffd640 1 -- 172.21.15.104:0/3911033675 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f5cc809ab50 con 0x7f5cd006d500 2024-09-17T03:06:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.468+0000 7f5cce59c640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5cb0078b90 0x7f5cb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.468 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.469+0000 7f5cce59c640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5cb0078b90 0x7f5cb007b0a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0036000 tx=0x7f5cc003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.471 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.472+0000 7f5cbeffd640 1 -- 172.21.15.104:0/3911033675 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5cc8062c40 con 0x7f5cd006d500 2024-09-17T03:06:31.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.644+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f5cd006ee10 con 0x7f5cb0078b90 2024-09-17T03:06:31.644 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.645+0000 7f5cbeffd640 1 -- 172.21.15.104:0/3911033675 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5cd006ee10 con 0x7f5cb0078b90 2024-09-17T03:06:31.644 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5cb0078b90 msgr2=0x7f5cb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5cb0078b90 0x7f5cb007b0a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0036000 tx=0x7f5cc003c040 comp rx=0 tx=0).stop 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cd006d500 msgr2=0x7f5cd00b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cd006d500 0x7f5cd00b0760 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8005fd0 tx=0x7f5cc800fd90 comp rx=0 tx=0).stop 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 shutdown_connections 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f5cb0078b90 0x7f5cb007b0a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f5cd006d500 0x7f5cd00b0760 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5cd015cc40 0x7f5cd006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.647 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 --2- 172.21.15.104:0/3911033675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cb8003a00 0x7f5cd00712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 >> 172.21.15.104:0/3911033675 conn(0x7f5cd00b44a0 msgr2=0x7f5cd00719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 shutdown_connections 2024-09-17T03:06:31.648 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.647+0000 7f5cd4fc6640 1 -- 172.21.15.104:0/3911033675 wait complete. 2024-09-17T03:06:31.658 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T03:06:31.659 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:06:31.776 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.776+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/2172206726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a140b7ce0 msgr2=0x7f9a140b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.777+0000 7f9a1b2a9640 1 --2- 172.21.15.104:0/2172206726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a140b7ce0 0x7f9a140b6f80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009830 tx=0x7f9a0802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.777+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/2172206726 shutdown_connections 2024-09-17T03:06:31.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.777+0000 7f9a1b2a9640 1 --2- 172.21.15.104:0/2172206726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a140b74c0 0x7f9a14166b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.777+0000 7f9a1b2a9640 1 --2- 172.21.15.104:0/2172206726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a140b7ce0 0x7f9a140b6f80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.777+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/2172206726 >> 172.21.15.104:0/2172206726 conn(0x7f9a140b4580 msgr2=0x7f9a140b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.777+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/2172206726 shutdown_connections 2024-09-17T03:06:31.777 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.777+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/2172206726 wait complete. 2024-09-17T03:06:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.778+0000 7f9a1b2a9640 1 Processor -- start 2024-09-17T03:06:31.778 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.778+0000 7f9a1b2a9640 1 -- start start 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a1b2a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a140b74c0 0x7f9a140cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a1b2a9640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a140b7ce0 0x7f9a141f9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a1b2a9640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a14160580 0x7f9a141f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a1b2a9640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9a14167050 con 0x7f9a140b7ce0 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a1b2a9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9a140b7ae0 con 0x7f9a140b74c0 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a1b2a9640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f9a141671d0 con 0x7f9a14160580 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a140b7ce0 0x7f9a141f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a140b7ce0 0x7f9a141f9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56058/0 (socket says 172.21.15.104:56058) 2024-09-17T03:06:31.782 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 -- 172.21.15.104:0/4082046670 learned_addr learned my addr 172.21.15.104:0/4082046670 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a19045640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a140b74c0 0x7f9a140cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 -- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a14160580 msgr2=0x7f9a141f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a14160580 0x7f9a141f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 -- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a140b74c0 msgr2=0x7f9a140cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a140b74c0 0x7f9a140cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 -- 172.21.15.104:0/4082046670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a140cbee0 con 0x7f9a140b7ce0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a18844640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a140b7ce0 0x7f9a141f9910 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009950 tx=0x7f9a08003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08005c90 con 0x7f9a140b7ce0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a141fa660 con 0x7f9a140b7ce0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a08005020 con 0x7f9a140b7ce0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.780+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08005450 con 0x7f9a140b7ce0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.781+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a14149a60 con 0x7f9a140b7ce0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.781+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a14073010 con 0x7f9a140b7ce0 2024-09-17T03:06:31.783 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.783+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a080317c0 con 0x7f9a140b7ce0 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.783+0000 7f9a11ffb640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a00078b90 0x7f9a0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.783+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f9a080bc040 con 0x7f9a140b7ce0 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.783+0000 7f9a11ffb640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f9a0007eaa0 0x7f9a00080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.783+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 --> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a08045e50 con 0x7f9a0007eaa0 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.783+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=191) ==== 24+0+0 (secure 0 0 0) 0x7f9a080bc3f0 con 0x7f9a140b7ce0 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.783+0000 7f9a19045640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a00078b90 0x7f9a0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.783+0000 7f9a19846640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f9a0007eaa0 0x7f9a00080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.784+0000 7f9a19045640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a00078b90 0x7f9a0007b0a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9a140d0f80 tx=0x7f9a04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.784+0000 7f9a19846640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f9a0007eaa0 0x7f9a00080ef0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.785 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.785+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 <== osd.7 v2:172.21.15.192:6826/1791040326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f9a08045e50 con 0x7f9a0007eaa0 2024-09-17T03:06:31.795 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.796+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 --> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9a141fa3f0 con 0x7f9a0007eaa0 2024-09-17T03:06:31.796 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.796+0000 7f9a11ffb640 1 -- 172.21.15.104:0/4082046670 <== osd.7 v2:172.21.15.192:6826/1791040326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f9a141fa3f0 con 0x7f9a0007eaa0 2024-09-17T03:06:31.796 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-17T03:06:31.796 INFO:teuthology.orchestra.run.smithi104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T03:06:31.796 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-17T03:06:31.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f9a0007eaa0 msgr2=0x7f9a00080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6826/1791040326,v1:172.21.15.192:6827/1791040326] conn(0x7f9a0007eaa0 0x7f9a00080ef0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.797 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a00078b90 msgr2=0x7f9a0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9a00078b90 0x7f9a0007b0a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9a140d0f80 tx=0x7f9a04009040 comp rx=0 tx=0).stop 2024-09-17T03:06:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a140b7ce0 msgr2=0x7f9a141f9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 --2- 172.21.15.104:0/4082046670 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f9a140b7ce0 0x7f9a141f9910 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009950 tx=0x7f9a08003c10 comp rx=0 tx=0).stop 2024-09-17T03:06:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a19846640 1 -- 172.21.15.104:0/4082046670 reap_dead start 2024-09-17T03:06:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 shutdown_connections 2024-09-17T03:06:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 >> 172.21.15.104:0/4082046670 conn(0x7f9a140b4580 msgr2=0x7f9a140b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 shutdown_connections 2024-09-17T03:06:31.798 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.797+0000 7f9a1b2a9640 1 -- 172.21.15.104:0/4082046670 wait complete. 2024-09-17T03:06:31.807 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T03:06:31.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.922+0000 7ff85acde640 1 -- 172.21.15.104:0/4183530705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83c004db0 msgr2=0x7ff83c005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.922+0000 7ff85acde640 1 --2- 172.21.15.104:0/4183530705 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff83c004db0 0x7ff83c005280 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009b20 tx=0x7ff83c005830 comp rx=0 tx=0).stop 2024-09-17T03:06:31.921 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.922+0000 7ff85927b640 1 -- 172.21.15.104:0/4183530705 reap_dead start 2024-09-17T03:06:31.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.922+0000 7ff85acde640 1 -- 172.21.15.104:0/4183530705 shutdown_connections 2024-09-17T03:06:31.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.922+0000 7ff85acde640 1 -- 172.21.15.104:0/4183530705 >> 172.21.15.104:0/4183530705 conn(0x7ff85406d200 msgr2=0x7ff85406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:31.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.922+0000 7ff85acde640 1 -- 172.21.15.104:0/4183530705 shutdown_connections 2024-09-17T03:06:31.922 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.922+0000 7ff85acde640 1 -- 172.21.15.104:0/4183530705 wait complete. 2024-09-17T03:06:31.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.923+0000 7ff85acde640 1 Processor -- start 2024-09-17T03:06:31.923 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.923+0000 7ff85acde640 1 -- start start 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85acde640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff83c004db0 0x7ff8541f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85acde640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8541f68a0 0x7ff8540af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85acde640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff854154900 0x7ff854154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85acde640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540b0b00 con 0x7ff854154900 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85acde640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540b0980 con 0x7ff83c004db0 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85acde640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7ff8540b0c80 con 0x7ff8541f68a0 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85927b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff854154900 0x7ff854154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85927b640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff854154900 0x7ff854154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56088/0 (socket says 172.21.15.104:56088) 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85927b640 1 -- 172.21.15.104:0/2094016148 learned_addr learned my addr 172.21.15.104:0/2094016148 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff858a7a640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff83c004db0 0x7ff8541f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff853fff640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8541f68a0 0x7ff8540af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85927b640 1 -- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8541f68a0 msgr2=0x7ff8540af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.926 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85927b640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8541f68a0 0x7ff8540af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85927b640 1 -- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff83c004db0 msgr2=0x7ff8541f32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85927b640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff83c004db0 0x7ff8541f32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.925+0000 7ff85927b640 1 -- 172.21.15.104:0/2094016148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff854155250 con 0x7ff854154900 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.926+0000 7ff85927b640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff854154900 0x7ff854154d10 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009c40 tx=0x7ff84c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.926+0000 7ff8517fa640 1 -- 172.21.15.104:0/2094016148 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c038040 con 0x7ff854154900 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.926+0000 7ff8517fa640 1 -- 172.21.15.104:0/2094016148 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff84c004130 con 0x7ff854154900 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.926+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8540afe70 con 0x7ff854154900 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.926+0000 7ff8517fa640 1 -- 172.21.15.104:0/2094016148 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0336e0 con 0x7ff854154900 2024-09-17T03:06:31.927 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.926+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8541f3e50 con 0x7ff854154900 2024-09-17T03:06:31.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.927+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8541f38e0 con 0x7ff854154900 2024-09-17T03:06:31.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.928+0000 7ff8517fa640 1 -- 172.21.15.104:0/2094016148 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff84c033880 con 0x7ff854154900 2024-09-17T03:06:31.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.928+0000 7ff8517fa640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff840078bc0 0x7ff84007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:31.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.928+0000 7ff8517fa640 1 -- 172.21.15.104:0/2094016148 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7ff84c0bacc0 con 0x7ff854154900 2024-09-17T03:06:31.928 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.928+0000 7ff858a7a640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff840078bc0 0x7ff84007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:31.929 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.929+0000 7ff858a7a640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff840078bc0 0x7ff84007b0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff844001050 tx=0x7ff844001da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:31.931 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:31.932+0000 7ff8517fa640 1 -- 172.21.15.104:0/2094016148 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff854155250 con 0x7ff854154900 2024-09-17T03:06:32.107 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.108+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff854155cc0 con 0x7ff840078bc0 2024-09-17T03:06:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.108+0000 7ff8517fa640 1 -- 172.21.15.104:0/2094016148 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff854155cc0 con 0x7ff840078bc0 2024-09-17T03:06:32.108 INFO:teuthology.orchestra.run.smithi104.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T03:06:32.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff840078bc0 msgr2=0x7ff84007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:32.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff840078bc0 0x7ff84007b0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff844001050 tx=0x7ff844001da0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff854154900 msgr2=0x7ff854154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:32.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff854154900 0x7ff854154d10 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7ff84c009c40 tx=0x7ff84c033670 comp rx=0 tx=0).stop 2024-09-17T03:06:32.110 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 shutdown_connections 2024-09-17T03:06:32.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7ff840078bc0 0x7ff84007b0d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7ff854154900 0x7ff854154d10 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff8541f68a0 0x7ff8540af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.110+0000 7ff85acde640 1 --2- 172.21.15.104:0/2094016148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff83c004db0 0x7ff8541f32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.111+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 >> 172.21.15.104:0/2094016148 conn(0x7ff85406d200 msgr2=0x7ff85415a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:32.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.111+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 shutdown_connections 2024-09-17T03:06:32.111 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.111+0000 7ff85acde640 1 -- 172.21.15.104:0/2094016148 wait complete. 2024-09-17T03:06:32.121 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:06:32.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.234+0000 7f108fe27640 1 -- 172.21.15.104:0/2599281909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1074004d40 msgr2=0x7f10740051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:32.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.234+0000 7f108fe27640 1 --2- 172.21.15.104:0/2599281909 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1074004d40 0x7f10740051f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f1080005fd0 tx=0x7f1074005830 comp rx=0 tx=0).stop 2024-09-17T03:06:32.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.234+0000 7f108e3c4640 1 -- 172.21.15.104:0/2599281909 reap_dead start 2024-09-17T03:06:32.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.234+0000 7f108fe27640 1 -- 172.21.15.104:0/2599281909 shutdown_connections 2024-09-17T03:06:32.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.234+0000 7f108fe27640 1 -- 172.21.15.104:0/2599281909 >> 172.21.15.104:0/2599281909 conn(0x7f10880b44a0 msgr2=0x7f10880b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:32.234 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.234+0000 7f108fe27640 1 -- 172.21.15.104:0/2599281909 shutdown_connections 2024-09-17T03:06:32.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.234+0000 7f108fe27640 1 -- 172.21.15.104:0/2599281909 wait complete. 2024-09-17T03:06:32.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.236+0000 7f108fe27640 1 Processor -- start 2024-09-17T03:06:32.235 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.236+0000 7f108fe27640 1 -- start start 2024-09-17T03:06:32.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108fe27640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1074004d40 0x7f10880b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:32.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108fe27640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10880c8060 0x7f10881582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:32.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108fe27640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1088158800 0x7f10880c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:32.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108fe27640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f10880d0010 con 0x7f1088158800 2024-09-17T03:06:32.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108fe27640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f10880cfe90 con 0x7f10880c8060 2024-09-17T03:06:32.238 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108fe27640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f10880d0190 con 0x7f1074004d40 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108e3c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1088158800 0x7f10880c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108e3c4640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1088158800 0x7f10880c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:56102/0 (socket says 172.21.15.104:56102) 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.237+0000 7f108e3c4640 1 -- 172.21.15.104:0/30080872 learned_addr learned my addr 172.21.15.104:0/30080872 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108dbc3640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1074004d40 0x7f10880b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108d3c2640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10880c8060 0x7f10881582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108e3c4640 1 -- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1074004d40 msgr2=0x7f10880b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108e3c4640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1074004d40 0x7f10880b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108e3c4640 1 -- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10880c8060 msgr2=0x7f10881582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108e3c4640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10880c8060 0x7f10881582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108e3c4640 1 -- 172.21.15.104:0/30080872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10880caee0 con 0x7f1088158800 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108dbc3640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1074004d40 0x7f10880b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:06:32.239 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108e3c4640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1088158800 0x7f10880c9900 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f108002b840 tx=0x7f1080033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:32.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f107a7fc640 1 -- 172.21.15.104:0/30080872 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1080042070 con 0x7f1088158800 2024-09-17T03:06:32.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f107a7fc640 1 -- 172.21.15.104:0/30080872 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1080003970 con 0x7f1088158800 2024-09-17T03:06:32.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1088153810 con 0x7f1088158800 2024-09-17T03:06:32.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f107a7fc640 1 -- 172.21.15.104:0/30080872 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1080038040 con 0x7f1088158800 2024-09-17T03:06:32.240 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.238+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10881f3d70 con 0x7f1088158800 2024-09-17T03:06:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.239+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10880cb0b0 con 0x7f1088158800 2024-09-17T03:06:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.240+0000 7f107a7fc640 1 -- 172.21.15.104:0/30080872 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1080004030 con 0x7f1088158800 2024-09-17T03:06:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.240+0000 7f107a7fc640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f106c078bc0 0x7f106c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.240+0000 7f107a7fc640 1 -- 172.21.15.104:0/30080872 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f10800bae00 con 0x7f1088158800 2024-09-17T03:06:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.240+0000 7f108dbc3640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f106c078bc0 0x7f106c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:32.241 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.241+0000 7f108dbc3640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f106c078bc0 0x7f106c07b0d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1084000fb0 tx=0x7f10840067a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:32.244 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.245+0000 7f107a7fc640 1 -- 172.21.15.104:0/30080872 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1080082ef0 con 0x7f1088158800 2024-09-17T03:06:32.420 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.421+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10881f7e40 con 0x7f106c078bc0 2024-09-17T03:06:32.421 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.421+0000 7f107a7fc640 1 -- 172.21.15.104:0/30080872 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12565 (secure 0 0 0) 0x7f10881f7e40 con 0x7f106c078bc0 2024-09-17T03:06:32.421 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:32.421 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:06:32.423 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f106c078bc0 msgr2=0x7f106c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f106c078bc0 0x7f106c07b0d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1084000fb0 tx=0x7f10840067a0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1088158800 msgr2=0x7f10880c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1088158800 0x7f10880c9900 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f108002b840 tx=0x7f1080033ba0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 shutdown_connections 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f106c078bc0 0x7f106c07b0d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10880c8060 0x7f10881582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f1088158800 0x7f10880c9900 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 --2- 172.21.15.104:0/30080872 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1074004d40 0x7f10880b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 >> 172.21.15.104:0/30080872 conn(0x7f10880b44a0 msgr2=0x7f1088071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 shutdown_connections 2024-09-17T03:06:32.424 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:32.424+0000 7f108fe27640 1 -- 172.21.15.104:0/30080872 wait complete. 2024-09-17T03:06:32.434 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2024-09-17T03:06:31.810448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9557,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552942,"statfs":{"total":1600000000,"available":1590212808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.599925"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":446,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-17T03:06:24.651353+0000","last_change":"2024-09-17T02:54:33.708430+0000","last_active":"2024-09-17T03:06:24.651353+0000","last_peered":"2024-09-17T03:06:24.651353+0000","last_clean":"2024-09-17T03:06:24.651353+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:06:24.651353+0000","last_undegraded":"2024-09-17T03:06:24.651353+0000","last_fullsized":"2024-09-17T03:06:24.651353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T02:54:32.644537+0000","last_clean_scrub_stamp":"2024-09-17T02:54:32.644537+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.489004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333825,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333825,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:06:32.438 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T02:54:32.644537+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=2, tm_min=54, tm_sec=32, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=3, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T03:06:32.438 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T03:06:37.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:06:37.768 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:06:52.439 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:06:52.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.567+0000 7f8f724b6640 1 -- 172.21.15.104:0/1224897461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 msgr2=0x7f8f6c15bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:52.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.567+0000 7f8f724b6640 1 --2- 172.21.15.104:0/1224897461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 0x7f8f6c15bc00 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c06ecb0 tx=0x7f8f5c02a530 comp rx=0 tx=0).stop 2024-09-17T03:06:52.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.567+0000 7f8f724b6640 1 -- 172.21.15.104:0/1224897461 shutdown_connections 2024-09-17T03:06:52.567 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.567+0000 7f8f724b6640 1 --2- 172.21.15.104:0/1224897461 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f6c072470 0x7f8f6c072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.567+0000 7f8f724b6640 1 --2- 172.21.15.104:0/1224897461 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 0x7f8f6c15bc00 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.567+0000 7f8f724b6640 1 -- 172.21.15.104:0/1224897461 >> 172.21.15.104:0/1224897461 conn(0x7f8f6c0b2450 msgr2=0x7f8f6c0b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:52.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.567+0000 7f8f724b6640 1 -- 172.21.15.104:0/1224897461 shutdown_connections 2024-09-17T03:06:52.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.567+0000 7f8f724b6640 1 -- 172.21.15.104:0/1224897461 wait complete. 2024-09-17T03:06:52.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.569+0000 7f8f724b6640 1 Processor -- start 2024-09-17T03:06:52.568 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.569+0000 7f8f724b6640 1 -- start start 2024-09-17T03:06:52.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.570+0000 7f8f724b6640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f6c072470 0x7f8f6c151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:52.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.570+0000 7f8f724b6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f6c072dc0 0x7f8f6c15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:52.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.570+0000 7f8f724b6640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 0x7f8f6c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:52.571 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.570+0000 7f8f724b6640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c15fe30 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.570+0000 7f8f724b6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c0cf4a0 con 0x7f8f6c072dc0 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.570+0000 7f8f724b6640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6c15ffb0 con 0x7f8f6c072470 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 0x7f8f6c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 0x7f8f6c153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49732/0 (socket says 172.21.15.104:49732) 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 -- 172.21.15.104:0/827953503 learned_addr learned my addr 172.21.15.104:0/827953503 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f6bfff640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f6c072470 0x7f8f6c151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f63fff640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f6c072dc0 0x7f8f6c15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 -- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f6c072470 msgr2=0x7f8f6c151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f6c072470 0x7f8f6c151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 -- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f6c072dc0 msgr2=0x7f8f6c15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f6c072dc0 0x7f8f6c15ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.572 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 -- 172.21.15.104:0/827953503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c1f7b60 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f6bfff640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f6c072470 0x7f8f6c151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:52.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f63fff640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f6c072dc0 0x7f8f6c15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:06:52.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f70a53640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 0x7f8f6c153e70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c760 tx=0x7f8f6400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:52.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f697fa640 1 -- 172.21.15.104:0/827953503 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64003b70 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f697fa640 1 -- 172.21.15.104:0/827953503 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f64003d10 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f6c1f72c0 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f697fa640 1 -- 172.21.15.104:0/827953503 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64005330 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.573 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.571+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6c1f7880 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.572+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f6c1f7030 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.573+0000 7f8f697fa640 1 -- 172.21.15.104:0/827953503 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f640054d0 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.574+0000 7f8f697fa640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.574+0000 7f8f697fa640 1 -- 172.21.15.104:0/827953503 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f8f6409a6f0 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.574+0000 7f8f6bfff640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:52.574 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.575+0000 7f8f6bfff640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c033000 tx=0x7f8f5c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:52.577 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.578+0000 7f8f697fa640 1 -- 172.21.15.104:0/827953503 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8f64062ec0 con 0x7f8f6c15b7f0 2024-09-17T03:06:52.750 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.751+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 --> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f6c1604f0 con 0x7f8f4c078b90 2024-09-17T03:06:52.751 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.752+0000 7f8f697fa640 1 -- 172.21.15.104:0/827953503 <== mgr.4100 v2:172.21.15.192:6800/3619997215 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12552 (secure 0 0 0) 0x7f8f6c1604f0 con 0x7f8f4c078b90 2024-09-17T03:06:52.751 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:52.751 INFO:teuthology.orchestra.run.smithi104.stderr:dumped all 2024-09-17T03:06:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f4c078b90 msgr2=0x7f8f4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:52.753 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c033000 tx=0x7f8f5c004730 comp rx=0 tx=0).stop 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 msgr2=0x7f8f6c153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 0x7f8f6c153e70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c760 tx=0x7f8f6400cb60 comp rx=0 tx=0).stop 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 shutdown_connections 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f8f4c078b90 0x7f8f4c07b0a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f6c072dc0 0x7f8f6c15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f8f6c15b7f0 0x7f8f6c153e70 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 --2- 172.21.15.104:0/827953503 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8f6c072470 0x7f8f6c151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 >> 172.21.15.104:0/827953503 conn(0x7f8f6c0b2450 msgr2=0x7f8f6c1574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 shutdown_connections 2024-09-17T03:06:52.754 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.754+0000 7f8f724b6640 1 -- 172.21.15.104:0/827953503 wait complete. 2024-09-17T03:06:52.764 INFO:teuthology.orchestra.run.smithi104.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2024-09-17T03:06:51.815462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9557,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552942,"statfs":{"total":1600000000,"available":1590212808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003083"},"pg_stats":[{"pgid":"1.0","version":"191'74","reported_seq":457,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-17T03:06:32.227427+0000","last_change":"2024-09-17T03:06:32.227331+0000","last_active":"2024-09-17T03:06:32.227427+0000","last_peered":"2024-09-17T03:06:32.227427+0000","last_clean":"2024-09-17T03:06:32.227427+0000","last_became_active":"2024-09-17T02:54:33.708230+0000","last_became_peered":"2024-09-17T02:54:33.708230+0000","last_unstale":"2024-09-17T03:06:32.227427+0000","last_undegraded":"2024-09-17T03:06:32.227427+0000","last_fullsized":"2024-09-17T03:06:32.227427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'74","last_scrub_stamp":"2024-09-17T03:06:32.227248+0000","last_deep_scrub":"191'74","last_deep_scrub_stamp":"2024-09-17T03:06:32.227248+0000","last_clean_scrub_stamp":"2024-09-17T03:06:32.227248+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:45:35.067839+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333825,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1050,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194261,"statfs":{"total":200000000,"available":198924193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1627,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193685,"statfs":{"total":200000000,"available":198333825,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-17T03:06:52.765 DEBUG:teuthology.orchestra.run.smithi104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T03:06:52.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.880+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/3939757550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8a40d0fd0 msgr2=0x7fc8a4160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:52.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.880+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/3939757550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8a40d0fd0 0x7fc8a4160ec0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0005fd0 tx=0x7fc8a002a540 comp rx=0 tx=0).stop 2024-09-17T03:06:52.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.880+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/3939757550 shutdown_connections 2024-09-17T03:06:52.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.880+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/3939757550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8a40d0fd0 0x7fc8a4160ec0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.880 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.880+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/3939757550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8a40d3490 0x7fc8a40b7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.880+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/3939757550 >> 172.21.15.104:0/3939757550 conn(0x7fc8a40d2970 msgr2=0x7fc8a40d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.880+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/3939757550 shutdown_connections 2024-09-17T03:06:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.880+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/3939757550 wait complete. 2024-09-17T03:06:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.882+0000 7fc8ac4fa640 1 Processor -- start 2024-09-17T03:06:52.881 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.882+0000 7fc8ac4fa640 1 -- start start 2024-09-17T03:06:52.887 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.883+0000 7fc8ac4fa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8a40d0fd0 0x7fc8a41529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:52.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.883+0000 7fc8ac4fa640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8a40d13e0 0x7fc8a406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:52.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.883+0000 7fc8ac4fa640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8a40d3490 0x7fc8a406e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:52.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8ac4fa640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a40b6bd0 con 0x7fc8a40d13e0 2024-09-17T03:06:52.888 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8ac4fa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a40b6a50 con 0x7fc8a40d0fd0 2024-09-17T03:06:52.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8ac4fa640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a40b6d50 con 0x7fc8a40d3490 2024-09-17T03:06:52.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8a40d13e0 0x7fc8a406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:52.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8a40d13e0 0x7fc8a406dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49738/0 (socket says 172.21.15.104:49738) 2024-09-17T03:06:52.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 -- 172.21.15.104:0/4017514264 learned_addr learned my addr 172.21.15.104:0/4017514264 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:52.889 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8aa296640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8a40d0fd0 0x7fc8a41529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:52.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8aaa97640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8a40d3490 0x7fc8a406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:52.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 -- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8a40d3490 msgr2=0x7fc8a406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:52.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8a40d3490 0x7fc8a406e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 -- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8a40d0fd0 msgr2=0x7fc8a41529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:52.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8a40d0fd0 0x7fc8a41529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:52.890 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 -- 172.21.15.104:0/4017514264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a41588c0 con 0x7fc8a40d13e0 2024-09-17T03:06:52.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8a9a95640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8a40d13e0 0x7fc8a406dac0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034040 tx=0x7fc8a00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:52.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc89affd640 1 -- 172.21.15.104:0/4017514264 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a003e030 con 0x7fc8a40d13e0 2024-09-17T03:06:52.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc89affd640 1 -- 172.21.15.104:0/4017514264 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8a0003db0 con 0x7fc8a40d13e0 2024-09-17T03:06:52.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc89affd640 1 -- 172.21.15.104:0/4017514264 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0035040 con 0x7fc8a40d13e0 2024-09-17T03:06:52.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.884+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a4158ba0 con 0x7fc8a40d13e0 2024-09-17T03:06:52.891 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.885+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a4159160 con 0x7fc8a40d13e0 2024-09-17T03:06:52.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.885+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a4158630 con 0x7fc8a40d13e0 2024-09-17T03:06:52.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.886+0000 7fc89affd640 1 -- 172.21.15.104:0/4017514264 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8a0041030 con 0x7fc8a40d13e0 2024-09-17T03:06:52.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.887+0000 7fc89affd640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc888078bc0 0x7fc88807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:52.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.887+0000 7fc89affd640 1 -- 172.21.15.104:0/4017514264 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7fc8a00bb000 con 0x7fc8a40d13e0 2024-09-17T03:06:52.892 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.887+0000 7fc8aa296640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc888078bc0 0x7fc88807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:52.893 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.888+0000 7fc8aa296640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc888078bc0 0x7fc88807b0d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc8940095f0 tx=0x7fc894005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:52.895 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:52.896+0000 7fc89affd640 1 -- 172.21.15.104:0/4017514264 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8a0083180 con 0x7fc8a40d13e0 2024-09-17T03:06:53.076 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.077+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fc8a41594d0 con 0x7fc8a40d13e0 2024-09-17T03:06:53.080 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.081+0000 7fc89affd640 1 -- 172.21.15.104:0/4017514264 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v44)=0 v44) ==== 123+0+0 (secure 0 0 0) 0x7fc8a0087bb0 con 0x7fc8a40d13e0 2024-09-17T03:06:53.082 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.082+0000 7fc89affd640 1 -- 172.21.15.104:0/4017514264 <== mon.0 v2:172.21.15.104:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fc8a0082c90 con 0x7fc8a40d13e0 2024-09-17T03:06:53.084 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc888078bc0 msgr2=0x7fc88807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc888078bc0 0x7fc88807b0d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc8940095f0 tx=0x7fc894005f90 comp rx=0 tx=0).stop 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8a40d13e0 msgr2=0x7fc8a406dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8a40d13e0 0x7fc8a406dac0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0034040 tx=0x7fc8a00038a0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 shutdown_connections 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7fc888078bc0 0x7fc88807b0d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8a40d3490 0x7fc8a406e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7fc8a40d13e0 0x7fc8a406dac0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 --2- 172.21.15.104:0/4017514264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8a40d0fd0 0x7fc8a41529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 >> 172.21.15.104:0/4017514264 conn(0x7fc8a40d2970 msgr2=0x7fc8a4070740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 shutdown_connections 2024-09-17T03:06:53.085 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.084+0000 7fc8ac4fa640 1 -- 172.21.15.104:0/4017514264 wait complete. 2024-09-17T03:06:53.095 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:06:53.095 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:06:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.212+0000 7f985cb19640 1 -- 172.21.15.104:0/3594266420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580b3b00 msgr2=0x7f98580d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.212+0000 7f985cb19640 1 --2- 172.21.15.104:0/3594266420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580b3b00 0x7f98580d11d0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f98580d1fc0 tx=0x7f984002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.212 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.212+0000 7f985cb19640 1 -- 172.21.15.104:0/3594266420 shutdown_connections 2024-09-17T03:06:53.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.212+0000 7f985cb19640 1 --2- 172.21.15.104:0/3594266420 >> v2:172.21.15.192:3300/0 conn(0x7f98580d1710 0x7f98580cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.212+0000 7f985cb19640 1 --2- 172.21.15.104:0/3594266420 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580b3b00 0x7f98580d11d0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.212+0000 7f985cb19640 1 --2- 172.21.15.104:0/3594266420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98580b6f70 0x7f985815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.212+0000 7f985cb19640 1 -- 172.21.15.104:0/3594266420 >> 172.21.15.104:0/3594266420 conn(0x7f9858073df0 msgr2=0x7f9858068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:53.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.212+0000 7f985cb19640 1 -- 172.21.15.104:0/3594266420 shutdown_connections 2024-09-17T03:06:53.213 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.213+0000 7f985cb19640 1 -- 172.21.15.104:0/3594266420 wait complete. 2024-09-17T03:06:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.216+0000 7f985cb19640 1 Processor -- start 2024-09-17T03:06:53.215 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.216+0000 7f985cb19640 1 -- start start 2024-09-17T03:06:53.218 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f985cb19640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98580b3b00 0x7f9858159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f985cb19640 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98580b6f70 0x7f98581f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f985cb19640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580d1710 0x7f98580d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f985cb19640 1 -- --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_getmap magic: 0 -- 0x7f98580d01f0 con 0x7f98580d1710 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f985cb19640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f98580d0070 con 0x7f98580b3b00 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f985cb19640 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 -- 0x7f98580d0370 con 0x7f98580b6f70 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f9856d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580d1710 0x7f98580d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f9856d9d640 1 --2- >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580d1710 0x7f98580d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.104:3300/0 says I am v2:172.21.15.104:49750/0 (socket says 172.21.15.104:49750) 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f9856d9d640 1 -- 172.21.15.104:0/2205959803 learned_addr learned my addr 172.21.15.104:0/2205959803 (peer_addr_for_me v2:172.21.15.104:0/0) 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f985659c640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98580b3b00 0x7f9858159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f984ffff640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98580b6f70 0x7f98581f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f9856d9d640 1 -- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98580b6f70 msgr2=0x7f98581f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f9856d9d640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98580b6f70 0x7f98581f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.219 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f9856d9d640 1 -- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98580b3b00 msgr2=0x7f9858159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f9856d9d640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98580b3b00 0x7f9858159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.218+0000 7f9856d9d640 1 -- 172.21.15.104:0/2205959803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98581fa030 con 0x7f98580d1710 2024-09-17T03:06:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.219+0000 7f9856d9d640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580d1710 0x7f98580d3b20 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f985000e990 tx=0x7f985000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.219+0000 7f984effd640 1 -- 172.21.15.104:0/2205959803 <== mon.0 v2:172.21.15.104:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850004d20 con 0x7f98580d1710 2024-09-17T03:06:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.219+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98581f5f90 con 0x7f98580d1710 2024-09-17T03:06:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.219+0000 7f984effd640 1 -- 172.21.15.104:0/2205959803 <== mon.0 v2:172.21.15.104:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f985000ca40 con 0x7f98580d1710 2024-09-17T03:06:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.219+0000 7f984effd640 1 -- 172.21.15.104:0/2205959803 <== mon.0 v2:172.21.15.104:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850005020 con 0x7f98580d1710 2024-09-17T03:06:53.220 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.219+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98581f6550 con 0x7f98580d1710 2024-09-17T03:06:53.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.220+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98581f5d80 con 0x7f98580d1710 2024-09-17T03:06:53.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.221+0000 7f984effd640 1 -- 172.21.15.104:0/2205959803 <== mon.0 v2:172.21.15.104:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98500051c0 con 0x7f98580d1710 2024-09-17T03:06:53.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.222+0000 7f984effd640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9838078b90 0x7f983807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:06:53.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.222+0000 7f984effd640 1 -- 172.21.15.104:0/2205959803 <== mon.0 v2:172.21.15.104:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 4943+0+0 (secure 0 0 0) 0x7f985009b200 con 0x7f98580d1710 2024-09-17T03:06:53.221 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.222+0000 7f985659c640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9838078b90 0x7f983807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:06:53.222 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.223+0000 7f985659c640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9838078b90 0x7f983807b0a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9848005fd0 tx=0x7f984800b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:06:53.229 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.230+0000 7f984effd640 1 -- 172.21.15.104:0/2205959803 <== mon.0 v2:172.21.15.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9850016030 con 0x7f98580d1710 2024-09-17T03:06:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.449+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 --> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f985815ef90 con 0x7f98580d1710 2024-09-17T03:06:53.448 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.449+0000 7f984effd640 1 -- 172.21.15.104:0/2205959803 <== mon.0 v2:172.21.15.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+3917 (secure 0 0 0) 0x7f9850063390 con 0x7f98580d1710 2024-09-17T03:06:53.449 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-17T03:06:53.449 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":78,"btime":"2024-09-17T03:06:22:348125+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/579895175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":579895175},{"type":"v1","addr":"172.21.15.192:6836","nonce":579895175}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/681363447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":681363447},{"type":"v1","addr":"172.21.15.192:6837","nonce":681363447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6834/3701119754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6832","nonce":3701119754},{"type":"v1","addr":"172.21.15.104:6834","nonce":3701119754}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":8439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.104:6835/1225366885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6833","nonce":1225366885},{"type":"v1","addr":"172.21.15.104:6835","nonce":1225366885}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[]} 2024-09-17T03:06:53.449 INFO:teuthology.orchestra.run.smithi104.stderr:dumped fsmap epoch 78 2024-09-17T03:06:53.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9838078b90 msgr2=0x7f983807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:53.451 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9838078b90 0x7f983807b0a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9848005fd0 tx=0x7f984800b260 comp rx=0 tx=0).stop 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580d1710 msgr2=0x7f98580d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580d1710 0x7f98580d3b20 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f985000e990 tx=0x7f985000ee50 comp rx=0 tx=0).stop 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 shutdown_connections 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:6800/3619997215,v1:172.21.15.192:6801/3619997215] conn(0x7f9838078b90 0x7f983807b0a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] conn(0x7f98580d1710 0x7f98580d3b20 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f98580b6f70 0x7f98581f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 --2- 172.21.15.104:0/2205959803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98580b3b00 0x7f9858159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 >> 172.21.15.104:0/2205959803 conn(0x7f9858073df0 msgr2=0x7f985815e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 shutdown_connections 2024-09-17T03:06:53.452 INFO:teuthology.orchestra.run.smithi104.stderr:2024-09-17T03:06:53.452+0000 7f985cb19640 1 -- 172.21.15.104:0/2205959803 wait complete. 2024-09-17T03:06:53.462 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T03:06:53.462 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T03:06:53.463 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:06:53.463 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.471 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:06:53.472 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:06:53.472 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.524 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:06:53.524 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:06:53.525 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.536 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:06:53.537 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:06:53.537 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.588 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:06:53.588 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T03:06:53.589 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T03:06:53.589 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.607 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T03:06:53.608 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T03:06:53.608 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.667 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T03:06:53.668 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T03:06:53.668 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.737 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T03:06:53.737 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T03:06:53.737 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.793 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T03:06:53.794 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T03:06:53.794 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.815 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T03:06:53.815 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T03:06:53.815 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.874 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T03:06:53.874 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T03:06:53.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.936 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T03:06:53.936 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T03:06:53.936 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:53.994 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T03:06:53.995 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T03:06:53.995 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T03:06:53.996 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:54.024 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T03:06:54.025 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T03:06:54.025 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:54.066 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T03:06:54.066 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T03:06:54.067 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T03:06:54.067 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:54.079 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T03:06:54.079 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T03:06:54.079 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:54.119 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T03:06:54.119 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T03:06:54.120 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:06:54.173 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T03:06:54.174 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T03:06:54.174 DEBUG:teuthology.orchestra.run.smithi104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-17T03:06:54.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:06:54.213 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T03:06:54.437 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:06:54.437 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T03:06:54.534 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:06:54.534 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T03:06:54.577 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:06:54.577 DEBUG:teuthology.orchestra.run.smithi104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T03:06:54.684 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:06:54.684 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T03:06:54.895 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:06:54.895 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T03:06:54.967 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:06:54.968 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T03:06:55.024 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:06:55.024 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T03:06:55.082 INFO:tasks.ceph:Archiving mon data... 2024-09-17T03:06:55.083 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/data/mon.a.tgz 2024-09-17T03:06:55.084 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-09-17T03:06:55.099 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.MMg6e5bnqk 2024-09-17T03:06:55.099 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.MMg6e5bnqk 2024-09-17T03:06:55.270 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.MMg6e5bnqk 2024-09-17T03:06:55.353 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.MMg6e5bnqk is 463KB 2024-09-17T03:06:55.454 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.MMg6e5bnqk 2024-09-17T03:06:55.469 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/data/mon.b.tgz 2024-09-17T03:06:55.469 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-17T03:06:55.488 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.G5ZmJPwxW1 2024-09-17T03:06:55.488 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.G5ZmJPwxW1 2024-09-17T03:06:55.659 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.G5ZmJPwxW1 2024-09-17T03:06:55.745 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.G5ZmJPwxW1 is 478KB 2024-09-17T03:06:55.845 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.G5ZmJPwxW1 2024-09-17T03:06:55.861 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/data/mon.c.tgz 2024-09-17T03:06:55.861 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-17T03:06:55.918 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.tecAbernm2 2024-09-17T03:06:55.918 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.tecAbernm2 2024-09-17T03:06:56.072 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.tecAbernm2 2024-09-17T03:06:56.157 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.tecAbernm2 is 478KB 2024-09-17T03:06:56.253 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.tecAbernm2 2024-09-17T03:06:56.269 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T03:06:56.269 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:06:56.271 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:06:56.357 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:06:56.388 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:06:56.388 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T03:06:56.390 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/remote/smithi104/crash 2024-09-17T03:06:56.391 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:06:56.425 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/remote/smithi192/crash 2024-09-17T03:06:56.426 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:06:56.455 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T03:06:56.456 DEBUG:teuthology.orchestra.run.smithi104:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:06:56.469 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:06:56.562 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:06:56.589 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:06:56.614 INFO:tasks.ceph:Compressing logs... 2024-09-17T03:06:56.614 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:06:56.632 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:06:56.656 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T03:06:56.656 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37621.log 2024-09-17T03:06:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49331.log 2024-09-17T03:06:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54960.log 2024-09-17T03:06:56.657 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37621.log.gz 2024-09-17T03:06:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63310.log 2024-09-17T03:06:56.657 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49331.log.gz 2024-09-17T03:06:56.657 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51845.log 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36787.log 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32126.log 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.36787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36787.log.gz 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38522.log 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.32126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37954.log 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32126.log.gz 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.38522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.39040.log 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38522.log.gz 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.37954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35767.log 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37954.log.gz 2024-09-17T03:06:56.711 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.39040.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.39040.log.gz 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.35767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33270.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35767.log.gz 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36289.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.33270.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33270.log.gz 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.36289.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36289.log.gz 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34737.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.34737.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.1.34737.log.gz 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr: --verbose -- /var/log/ceph/ceph-client.1.39044.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35249.log 2024-09-17T03:06:56.712 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.39044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37950.log 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.39044.log.gz 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.35249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32286.log 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35249.log.gz 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.37950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36783.log 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37950.log.gz 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.32286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37372.log 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32286.log.gz 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.36783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32166.log 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36783.log.gz 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.37372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32046.log 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37372.log.gz 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.32166.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32166.log.gz 2024-09-17T03:06:56.713 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.32046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32206.log 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32046.log.gz 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36285.log 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.32206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32246.log 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32206.log.gz/var/log/ceph/ceph-client.1.36285.log: 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36285.log.gz 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gzgzip 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr: -5 --verbose -- /var/log/ceph/ceph-client.1.37368.log 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.32246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33688.log 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32246.log.gz 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.37368.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37368.log.gz 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34273.log 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.3.33688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33688.log.gz 2024-09-17T03:06:56.714 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32086.log 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.34273.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.1.34273.log.gz 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr: --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.32086.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32086.log.gz 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35771.log 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.35771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35771.log.gz 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35253.log 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34741.log 2024-09-17T03:06:56.715 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.35253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35253.log.gz 2024-09-17T03:06:56.724 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33684.log 2024-09-17T03:06:56.724 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.34741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34741.log.gz 2024-09-17T03:06:56.737 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38526.log 2024-09-17T03:06:56.737 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.3.33684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33684.log.gz 2024-09-17T03:06:56.747 INFO:teuthology.orchestra.run.smithi192.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T03:06:56.747 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T03:06:56.747 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.38526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38526.log.gz 2024-09-17T03:06:56.747 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33265.log 2024-09-17T03:06:56.770 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32326.log 2024-09-17T03:06:56.771 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.33265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33265.log.gz 2024-09-17T03:06:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34277.log 2024-09-17T03:06:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.32326.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32326.log.gz 2024-09-17T03:06:56.797 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.34277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34277.log.gz 2024-09-17T03:06:56.843 INFO:teuthology.orchestra.run.smithi192.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T03:06:56.855 INFO:teuthology.orchestra.run.smithi192.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T03:06:56.937 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49468.log 2024-09-17T03:06:56.937 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54960.log.gz 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51845.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63310.log.gz 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43207.log 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51845.log.gz 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51532.log 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49468.log.gz 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49952.log 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43207.log.gz 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65167.log 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51532.log.gz 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66177.log 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gz 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32119.log 2024-09-17T03:06:56.938 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65167.log.gz 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44012.log 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66177.log.gz 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41496.log 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32119.log: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.32119.log.gz 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46856.log 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44012.log.gz 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55925.log 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41496.log.gz 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54112.log 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46856.log.gz 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64661.log 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55925.log.gz 2024-09-17T03:06:56.939 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47415.log 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54112.log.gz 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56830.log 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64661.log.gz 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45842.log 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47415.log.gz 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58689.log 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56830.log.gz 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46113.log 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7%/var/log/ceph/ceph-client.admin.58689.log: -- replaced with /var/log/ceph/ceph-client.admin.45842.log.gz 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38034.log 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58689.log.gz 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53492.log 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46113.log.gz 2024-09-17T03:06:56.940 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61874.log 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38034.log.gz 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48175.log 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53492.log.gz 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40570.log 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61874.log.gz 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55424.log 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48175.log.gz 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55676.log 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40570.log.gz 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39180.log 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55424.log.gz 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46991.log 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55676.log.gz 2024-09-17T03:06:56.941 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9%/var/log/ceph/ceph-client.admin.46991.log: -- replaced with /var/log/ceph/ceph-client.admin.39180.log.gz 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48233.log 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46991.log.gz 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65209.log 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58941.log 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6%/var/log/ceph/ceph-client.admin.65209.log: -- replaced with /var/log/ceph/ceph-client.admin.48233.log.gz 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65209.log.gz 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50102.log 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45234.log 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.58941.log.gz 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50102.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2024-09-17T03:06:56.942 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40486.log 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50102.log.gz 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.45234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40925.log 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45234.log.gz 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36998.log 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40486.log.gz 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42720.log 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40925.log.gz 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37058.log 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36998.log.gz 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54659.log 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6%/var/log/ceph/ceph-client.admin.37058.log: -- replaced with /var/log/ceph/ceph-client.admin.42720.log.gz 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39414.log 2024-09-17T03:06:56.943 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37058.log.gz 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33711.log 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54659.log.gz 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34093.log 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33711.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39414.log.gz 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58815.log 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33711.log.gz 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65522.log 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34093.log.gz 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65522.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.58815.log.gz 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52946.log 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65522.log.gz 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32147.log 2024-09-17T03:06:56.944 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40654.log 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8%/var/log/ceph/ceph-client.admin.32147.log: -- replaced with /var/log/ceph/ceph-client.admin.52946.log.gz 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44976.log 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32147.log.gz 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66387.log 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40654.log.gz 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39987.log 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42437.log 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66387.log.gz 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44976.log.gz 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65109.log 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39987.log.gz 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46683.log 2024-09-17T03:06:56.945 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42437.log: /var/log/ceph/ceph-client.admin.65109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35815.log 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42437.log.gz 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65109.log.gz 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51761.log 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46683.log.gz 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32259.log 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35815.log.gz 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66219.log 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51761.log.gz 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50851.log 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60764.log 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66219.log.gz 2024-09-17T03:06:56.946 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52398.log 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50851.log.gz 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56113.log 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60764.log.gz 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62885.log 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52398.log.gz 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.56113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45230.log 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56113.log.gz 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52736.log 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62885.log.gz/var/log/ceph/ceph-client.0.45230.log: 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37531.log 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45230.log.gz 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53450.log 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52736.log.gz 2024-09-17T03:06:56.947 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61030.log 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37531.log.gz 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51490.log 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53450.log.gz 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35408.log 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61030.log.gz 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46385.log 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51490.log.gz 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44892.log 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35408.log.gz 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46385.log.gz 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60339.log 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44892.log.gz 2024-09-17T03:06:56.948 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43469.log 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43908.log 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60339.log.gz 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53631.log 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43469.log.gz 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43908.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43908.log.gz 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66782.log 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53631.log.gz 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48527.log 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32455.log 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66782.log: /var/log/ceph/ceph-client.admin.48527.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66782.log.gz 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50562.log 2024-09-17T03:06:56.949 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48527.log.gz 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59007.log 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32455.log.gz 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51803.log 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50562.log.gz 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48443.log 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59007.log.gz 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45884.log 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51803.log: /var/log/ceph/ceph-client.admin.48443.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51803.log.gz 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66303.log 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48443.log.gz 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66741.log 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45884.log: /var/log/ceph/ceph-client.admin.66303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60561.log 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45884.log.gz 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66303.log.gz 2024-09-17T03:06:56.950 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36382.log 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60561.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66741.log.gz 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60561.log.gz 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66555.log 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.36382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36382.log.gz 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61202.log 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33753.log 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.66555.log.gz 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48756.log 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61202.log: /var/log/ceph/ceph-client.admin.33753.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61202.log.gz 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58563.log 2024-09-17T03:06:56.951 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33753.log.gz 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38704.log 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48756.log: /var/log/ceph/ceph-client.admin.58563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63268.log 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48756.log.gz 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58563.log.gz 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38704.log.gz 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41933.log 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63268.log.gz 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66093.log 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49375.log: /var/log/ceph/ceph-client.admin.41933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35404.log 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41933.log.gz 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55041.log 2024-09-17T03:06:56.952 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66093.log.gz 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54155.log 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35404.log.gz 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60423.log 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55041.log.gz 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60026.log 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52610.log 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60423.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54155.log.gz 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60423.log.gz 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56280.log 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60026.log.gz 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32651.log 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52610.log: /var/log/ceph/ceph-client.admin.56280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44850.log 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52610.log.gz 2024-09-17T03:06:56.953 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56280.log.gz 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38797.log 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr: 75.6% -- replaced with /var/log/ceph/ceph-client.admin.32651.log.gz 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37193.log 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44850.log.gz 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45758.log 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38797.log.gz 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58731.log 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37193.log.gz 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50294.log 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45758.log: /var/log/ceph/ceph-client.admin.58731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63187.log 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45758.log.gz 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58731.log.gz 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.50294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50294.log.gz 2024-09-17T03:06:56.954 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59984.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63187.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30508.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63187.log.gz 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32567.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59984.log.gz 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35288.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.tmp-client.admin.30508.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30508.log.gz 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63982.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32567.log.gz 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55817.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35288.log.gz 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65031.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63982.log.gz 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52652.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55817.log: /var/log/ceph/ceph-client.admin.65031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46812.log 2024-09-17T03:06:56.955 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55817.log.gz 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65031.log.gz 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54533.log 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52652.log.gz 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49287.log 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46812.log: /var/log/ceph/ceph-client.admin.54533.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46812.log.gz 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63352.log 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54533.log.gz 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49245.log 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49287.log: /var/log/ceph/ceph-client.admin.63352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37782.log 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49287.log.gz 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.63352.log.gz 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61916.log 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49245.log.gz 2024-09-17T03:06:56.956 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51448.log 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37782.log.gz 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32371.log 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61916.log: /var/log/ceph/ceph-client.admin.51448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60068.log 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61916.log.gz 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32371.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51448.log.gz 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr: 74.6% -- replaced with /var/log/ceph/ceph-client.admin.32371.log.gz 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54575.log 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60068.log.gz 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47565.log 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54575.log.gz 2024-09-17T03:06:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65293.log 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47565.log: /var/log/ceph/ceph-client.admin.43698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54323.log 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47565.log.gz 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46725.log 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65293.log.gz 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64619.log 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54323.log: /var/log/ceph/ceph-client.admin.46725.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54323.log.gz 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52862.log 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46725.log.gz 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35647.log 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64619.log: /var/log/ceph/ceph-client.admin.52862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57449.log 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64619.log.gz 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52862.log.gz 2024-09-17T03:06:56.958 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57533.log 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35647.log.gz 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55382.log 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57449.log.gz 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38755.log 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57533.log: /var/log/ceph/ceph-client.admin.55382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46323.log 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57533.log.gz 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38755.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55382.log.gz 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62404.log 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38755.log.gz 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51364.log 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46323.log: /var/log/ceph/ceph-client.admin.62404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34734.log 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46323.log.gz 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62404.log.gz 2024-09-17T03:06:56.959 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42313.log 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51364.log.gz 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57827.log 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34734.log: /var/log/ceph/ceph-client.0.42313.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34734.log.gz 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42313.log.gz 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42395.log 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39138.log 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57827.log: /var/log/ceph/ceph-client.admin.42395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35406.log 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57827.log.gz 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42395.log.gz 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44054.log 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39138.log.gz 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48588.log 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35406.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35406.log.gz 2024-09-17T03:06:56.960 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58433.log 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44054.log.gz 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64883.log 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48588.log: /var/log/ceph/ceph-client.admin.58433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43637.log 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48588.log.gz 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58433.log.gz 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43059.log 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64883.log.gz 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47037.log 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43637.log.gz 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49510.log 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43059.log: /var/log/ceph/ceph-client.admin.47037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46010.log 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43059.log.gz 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47037.log.gz 2024-09-17T03:06:56.961 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41454.log 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49510.log.gz 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35071.log 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45968.log 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41454.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46010.log.gz 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35071.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41454.log.gz 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35071.log.gz 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54449.log 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45968.log: /var/log/ceph/ceph-client.admin.49041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62927.log 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45968.log.gz 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52270.log 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54449.log.gz 2024-09-17T03:06:56.962 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35068.log 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62927.log: /var/log/ceph/ceph-client.admin.52270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62927.log.gz 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52270.log.gz 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49161.log 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35068.log.gz 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44412.log 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41807.log: /var/log/ceph/ceph-client.admin.49161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34177.log 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49161.log.gz 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59381.log 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57061.log 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44412.log.gz 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34177.log: /var/log/ceph/ceph-client.admin.59381.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.34177.log.gz 2024-09-17T03:06:56.963 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46907.log 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59381.log.gz 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34731.log 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58349.log 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46907.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57061.log.gz 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46907.log.gz 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48275.log 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34731.log.gz 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64799.log 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48275.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58349.log.gz 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32034.log 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48275.log.gz 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38198.log 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64799.log.gz 2024-09-17T03:06:56.964 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55760.log 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41635.log 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32034.log.gz 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38198.log.gz 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36515.log 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55760.log.gz 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52568.log 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40738.log 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41635.log.gz 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52568.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36515.log.gz 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46071.log 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52568.log.gz 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41765.log 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40738.log.gz 2024-09-17T03:06:56.965 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47757.log 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46071.log: /var/log/ceph/ceph-client.admin.41765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43824.log 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46071.log.gz 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41765.log.gz 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.47757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47757.log.gz 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49766.log 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58254.log 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43824.log: /var/log/ceph/ceph-client.admin.49766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37992.log 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43824.log.gz 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49766.log.gz 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43017.log 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58254.log.gz 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.37992.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65925.log 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54880.log 2024-09-17T03:06:56.966 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37992.log.gz 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43017.log.gz 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65925.log.gz 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52988.log 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54880.log: /var/log/ceph/ceph-client.admin.44808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43553.log 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54880.log.gz 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52988.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44594.log 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52988.log.gz 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33967.log 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43553.log.gz 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60806.log 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44594.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44594.log.gz 2024-09-17T03:06:56.967 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32399.log 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33967.log.gz 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62184.log 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60806.log: /var/log/ceph/ceph-client.admin.32399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59195.log 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32399.log.gz 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60806.log.gz 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63916.log 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.62184.log.gz 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.59195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59195.log.gz 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35063.log 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62320.log 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63916.log.gz 2024-09-17T03:06:56.968 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35063.log.gz 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37908.log 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32343.log 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62320.log.gz 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54407.log 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37908.log.gz 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32175.log 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32343.log: /var/log/ceph/ceph-client.admin.54407.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32343.log.gz 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54407.log.gz 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32175.log.gz 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35289.log 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2024-09-17T03:06:56.969 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39306.log 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35289.log.gz 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66513.log 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39306.log: /var/log/ceph/ceph-client.admin.34429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61118.log 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39306.log.gz 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62843.log 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48841.log 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66513.log.gz 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61118.log: /var/log/ceph/ceph-client.admin.62843.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.49598.log 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61118.log.gz 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62843.log.gz 2024-09-17T03:06:56.970 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35407.log 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48841.log.gz 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43427.log 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50679.log 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35407.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49598.log.gz 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43427.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35407.log.gz 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60213.log 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43427.log.gz 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38839.log 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50679.log: /var/log/ceph/ceph-client.admin.60213.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50679.log.gz 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35731.log 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60213.log.gz 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61792.log 2024-09-17T03:06:56.971 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38839.log: /var/log/ceph/ceph-client.admin.35731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42891.log 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38839.log.gz 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35731.log.gz 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.61792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61792.log.gz 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64841.log 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58209.log 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42891.log: /var/log/ceph/ceph-client.admin.64841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59942.log 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42891.log.gz 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64841.log.gz 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61538.log 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58209.log.gz 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42975.log 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59942.log.gz 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37866.log 2024-09-17T03:06:56.972 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61538.log: /var/log/ceph/ceph-client.admin.42975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34051.log 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37866.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42975.log.gz 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45312.log 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.61538.log.gz 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37866.log.gz 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54785.log 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34051.log: /var/log/ceph/ceph-client.admin.45312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60946.log 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34051.log.gz 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54785.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45312.log.gz 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40386.log 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54785.log.gz 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55298.log 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60946.log: /var/log/ceph/ceph-client.admin.40386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45042.log 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60946.log.gz 2024-09-17T03:06:56.973 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49203.log 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55298.log.gz 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55859.log 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45042.log: /var/log/ceph/ceph-client.admin.49203.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45042.log.gz 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33218.log 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49203.log.gz 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51322.log 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55859.log: /var/log/ceph/ceph-client.admin.33218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44682.log 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51322.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33218.log.gz 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32539.log 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55859.log.gz 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51322.log.gz 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61496.log 2024-09-17T03:06:56.974 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44682.log.gz 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56703.log 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32539.log.gz 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39744.log 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61496.log.gz 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56703.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56703.log.gz 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64174.log 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52778.log 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39744.log.gz 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.64174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38616.log 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64174.log.gz 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48317.log 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52778.log.gz 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55718.log 2024-09-17T03:06:56.975 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38616.log.gz 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58167.log 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48317.log: /var/log/ceph/ceph-client.admin.55718.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48317.log.gz 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58391.log 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55718.log.gz 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47079.log 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58167.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58167.log.gz 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46949.log 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58391.log.gz 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37740.log 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47079.log: /var/log/ceph/ceph-client.admin.46949.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47079.log.gz 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33925.log 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46949.log.gz 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63107.log 2024-09-17T03:06:56.976 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37740.log: /var/log/ceph/ceph-client.admin.33925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58479.log 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37740.log.gz 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33925.log.gz 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53072.log 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58479.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.63107.log.gz 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58647.log 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58479.log.gz 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65377.log 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36823.log 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53072.log.gz 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58647.log.gz 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.65377.log: /var/log/ceph/ceph-client.admin.61328.log 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.2.36823.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65377.log.gz 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36823.log.gz 2024-09-17T03:06:56.977 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33629.log 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55256.log 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61328.log: /var/log/ceph/ceph-client.admin.33629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61796.log 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61328.log.gz 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33629.log.gz 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47331.log 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55256.log.gz 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.61796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61796.log.gz 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43866.log 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47331.log.gz 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62614.log 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43866.log.gz 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56238.log 2024-09-17T03:06:56.978 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34303.log: /var/log/ceph/ceph-client.admin.62614.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz /var/log/ceph/ceph-client.admin.43740.log 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62614.log.gz 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52354.log 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56238.log.gz 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40528.log 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43740.log.gz 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64170.log 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52354.log: /var/log/ceph/ceph-client.admin.40528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41891.log 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52354.log.gz 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40528.log.gz 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.64170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64170.log.gz 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51719.log 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48904.log 2024-09-17T03:06:56.979 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41891.log: /var/log/ceph/ceph-client.admin.51719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63441.log 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.41891.log.gz 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48904.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51719.log.gz 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38970.log 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48904.log.gz 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43285.log 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63441.log.gz 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65883.log 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38970.log: /var/log/ceph/ceph-client.admin.43285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64294.log 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38970.log.gz 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43285.log.gz 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57659.log 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65883.log.gz 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35072.log 2024-09-17T03:06:56.980 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64294.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64294.log.gz 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42059.log 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57659.log.gz 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66135.log 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35072.log: /var/log/ceph/ceph-client.admin.42059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41113.log 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35072.log.gz 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56426.log 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66135.log.gz 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42059.log.gz 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65841.log 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41113.log.gz 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44934.log 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56426.log: /var/log/ceph/ceph-client.admin.65841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55340.log 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56426.log.gz 2024-09-17T03:06:56.981 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65841.log.gz 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38490.log 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44934.log.gz 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53589.log 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55340.log: /var/log/ceph/ceph-client.admin.38490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55340.log.gz 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38490.log.gz 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49868.log 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53589.log.gz 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47499.log 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42762.log: /var/log/ceph/ceph-client.admin.49868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66597.log 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49868.log.gz 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66345.log 2024-09-17T03:06:56.982 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33532.log 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66597.log: /var/log/ceph/ceph-client.admin.66345.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.66597.log.gz 91.0% 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr: --verbose -- replaced with /var/log/ceph/ceph-client.admin.47499.log.gz -- 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.48672.log 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66345.log.gz 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35899.log 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56788.log 87.3% 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33532.log.gz 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48672.log.gz 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40444.log 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53408.log 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35899.log.gz 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56788.log.gz 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43385.log 2024-09-17T03:06:56.983 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60297.log 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40444.log.gz 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53408.log.gz 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43385.log.gz 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60297.log: /var/log/ceph/ceph-client.admin.44766.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60297.log.gz 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35857.log 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38532.log 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.35857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47121.log 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35857.log.gz 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66824.log 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47121.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38532.log.gz 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55550.log 2024-09-17T03:06:56.984 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47121.log.gz 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63011.log 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66824.log.gz 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53976.log 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63011.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55550.log.gz 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63832.log 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63011.log.gz 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45580.log 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53976.log.gz 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34471.log 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45580.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63832.log.gz 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35773.log 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45580.log.gz 2024-09-17T03:06:56.985 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34471.log.gz 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38448.log 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46239.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35773.log.gz 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49640.log 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44370.log 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38448.log.gz 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39903.log 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49640.log.gz 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47163.log 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44370.log.gz 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63790.log 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39903.log.gz 2024-09-17T03:06:56.986 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63397.log 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47163.log.gz 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58521.log 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.63790.log.gz 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58857.log 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63397.log.gz 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43782.log 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44328.log 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58521.log.gz 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58857.log: /var/log/ceph/ceph-client.admin.43782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38927.log 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58857.log.gz 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41975.log 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44328.log.gz 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56510.log 2024-09-17T03:06:56.987 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41975.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38927.log.gz 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58773.log 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56510.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41975.log.gz 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63576.log 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56510.log.gz 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57407.log 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63576.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58773.log.gz 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41719.log 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63576.log.gz 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66429.log 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57407.log.gz 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51677.log 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66429.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41719.log.gz 2024-09-17T03:06:56.988 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57139.log 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66429.log.gz 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32622.log 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51677.log.gz 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47247.log 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32622.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57139.log.gz 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55083.log 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32622.log.gz 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59816.log 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47247.log.gz 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48630.log 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59816.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55083.log.gz 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34729.log 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59816.log.gz 2024-09-17T03:06:56.989 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47753.log 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48630.log.gz 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54197.log 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.47753.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34729.log.gz 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54743.log 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47753.log.gz 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34009.log 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54197.log.gz 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36377.log 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34009.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54743.log.gz 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55634.log 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34009.log.gz 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.36377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65251.log 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36377.log.gz 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60851.log 2024-09-17T03:06:56.990 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55634.log: /var/log/ceph/ceph-client.admin.65251.log: gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.62572.log -- replaced with /var/log/ceph/ceph-client.admin.55634.log.gz 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65251.log.gz 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38660.log 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60851.log.gz 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33795.log 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62572.log.gz 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35055.log 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38660.log.gz 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51971.log 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33795.log.gz/var/log/ceph/ceph-client.admin.35055.log: 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40799.log 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35055.log.gz 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41009.log 2024-09-17T03:06:56.991 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51971.log.gz 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57617.log 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40799.log.gz 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38362.log 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41009.log.gz 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66639.log 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57617.log.gz 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59319.log 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38362.log.gz 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66009.log 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66639.log.gz 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62530.log 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59319.log.gz 2024-09-17T03:06:56.992 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54365.log 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66009.log.gz 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60465.log 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62530.log: /var/log/ceph/ceph-client.admin.54365.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62530.log.gz 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41412.log 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54365.log.gz 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55125.log 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60465.log.gz 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59199.log 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41412.log.gz 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55125.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55125.log.gz 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.59199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32231.log 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59199.log.gz 2024-09-17T03:06:56.993 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51168.log 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.32231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42645.log 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr: 74.5% -- replaced with /var/log/ceph/ceph-client.admin.32231.log.gz 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52442.log 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51168.log.gz 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65648.log 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42645.log.gz 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65335.log 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52442.log.gz 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51887.log 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65648.log.gz 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59716.log 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65335.log.gz 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.51887.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40084.log 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59716.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51887.log.gz 2024-09-17T03:06:56.994 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59716.log.gz 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.45800.log 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32091.log 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40084.log.gz 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57575.log 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56196.log 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32091.log.gz 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.57575.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32594.log 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56196.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57575.log.gz 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56196.log.gz 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37950.log 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32594.log.gz 2024-09-17T03:06:56.995 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41330.log 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43595.log 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37950.log.gz 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50604.log 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43595.log: -- replaced with /var/log/ceph/ceph-client.admin.41330.log.gz 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43511.log 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43595.log.gz 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50604.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50721.log 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45716.log: /var/log/ceph/ceph-client.admin.43511.log: gzip 87.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz -- 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.61076.log 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43511.log.gz 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54701.log/var/log/ceph/ceph-client.admin.50721.log: 2024-09-17T03:06:56.996 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61076.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50721.log.gz 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61076.log.gz 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34725.log 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54701.log.gz 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58125.log 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34725.log.gz 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48798.log 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51574.log 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58125.log: -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49556.log 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58125.log.gz 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51574.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48798.log.gz 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41051.log 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51574.log.gz 2024-09-17T03:06:56.997 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37300.log 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49556.log.gz 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54281.log 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41051.log.gz 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63622.log 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6%/var/log/ceph/ceph-client.admin.54281.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37300.log.gz 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54281.log.gz 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63622.log.gz 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39806.log 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.38076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42933.log 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-09-17T03:06:56.998 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61454.log 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39806.log.gz/var/log/ceph/ceph-client.admin.42933.log: 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41250.log 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42933.log.gz 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61454.log: gzip -5 --verbose 87.4% -- /var/log/ceph/ceph-client.admin.59277.log 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61454.log.gz 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32287.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41250.log.gz 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39012.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59277.log.gz 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32287.log.gz 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64757.log 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.admin.39012.log: --verbose -- /var/log/ceph/ceph-client.admin.57281.log 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64757.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39012.log.gz 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52312.log 2024-09-17T03:06:56.999 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64757.log.gz 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.57281.log: -- /var/log/ceph/ceph-client.admin.46602.log 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52312.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57281.log.gz 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48401.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52312.log.gz 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46602.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.56627.log 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61370.log 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48401.log.gz 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37824.log 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56627.log.gz 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61370.log: gzip -5 --verbose 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61370.log.gz 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.65564.log 2024-09-17T03:06:57.000 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50893.log 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37824.log.gz 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65564.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65564.log.gz 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.34736.log 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50036.log 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50893.log.gz 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32203.log 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34736.log.gz 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41155.log 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39096.log 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50036.log.gz 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32203.log: /var/log/ceph/ceph-client.admin.41155.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32203.log.gzgzip 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41155.log.gz 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-mgr.y.log 2024-09-17T03:06:57.001 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57869.log 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39096.log.gz 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61286.log 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57701.log 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57869.log.gz 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34135.log 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57701.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61286.log.gz 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57701.log.gz 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46522.log 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52904.log 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34135.log.gz 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32427.log 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52904.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46522.log.gz 2024-09-17T03:06:57.002 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52904.log.gz 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49724.log 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32427.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60988.log 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32427.log.gz 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52820.log 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49724.log: /var/log/ceph/ceph-client.admin.60988.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60988.log.gz 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49724.log.gz 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60381.log 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65419.log 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52820.log.gz 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64252.log 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65419.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60381.log.gz 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65419.log.gz 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58298.log 2024-09-17T03:06:57.003 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47835.log 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64252.log.gz 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54239.log 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47835.log: 87.6% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58298.log.gz 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47835.log.gz 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48485.log 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54239.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54239.log.gz 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41584.log 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48485.log.gz 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42125.log 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54617.log 2024-09-17T03:06:57.004 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41584.log.gz 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.42125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51406.log 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54617.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42125.log.gz 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54617.log.gz 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42017.log 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40696.log 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51406.log: /var/log/ceph/ceph-client.admin.42017.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51406.log.gzgzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42017.log.gz 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.62488.log 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40696.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40696.log.gz 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64356.log 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56468.log 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62488.log.gz 2024-09-17T03:06:57.005 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48946.log 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64356.log.gz 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58899.log 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56468.log: /var/log/ceph/ceph-client.admin.48946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35605.log 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58899.log: 87.8% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48946.log.gz 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56468.log.gz 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58899.log.gz 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60255.log 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62362.log 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.35605.log.gz 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33839.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60255.log.gz 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.006 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62362.log: gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62362.log.gz 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59774.log 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53326.log 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33839.log.gz 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49426.log 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59774.log.gz 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.53326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53326.log.gz 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62675.log 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.admin.49426.log: --verbose -- /var/log/ceph/ceph-client.admin.63492.log 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62675.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49426.log.gz 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39602.log 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62675.log.gz 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42317.log 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63492.log.gz 2024-09-17T03:06:57.007 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.39602.log: /var/log/ceph/ceph-client.admin.63748.log 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39602.log.gz 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.42317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42317.log.gz 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60895.log 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63748.log: gzip -5 --verbose 86.8% -- replaced with /var/log/ceph/ceph-client.admin.63748.log.gz 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.46155.log 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60895.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60895.log.gz 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.48097.log 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46155.log: gzip -5 --verbose 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46155.log.gz 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.32511.log 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.48097.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr: -- /var/log/ceph/ceph-client.admin.62717.log 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32511.log.gz 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65967.log 2024-09-17T03:06:57.008 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50372.log 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62717.log.gz/var/log/ceph/ceph-client.admin.65967.log: 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46281.log 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65967.log.gz 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39945.log/var/log/ceph/ceph-client.admin.50372.log: 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46281.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50372.log.gz 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49682.log 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46281.log.gz 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.39945.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62262.log 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49682.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39945.log.gz 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55592.log 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49682.log.gz 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62262.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32315.log 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62262.log.gz 2024-09-17T03:06:57.009 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66681.log 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57491.log 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55592.log.gz 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr: 86.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58605.log 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32315.log.gz 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66681.log: /var/log/ceph/ceph-client.admin.57491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51246.log 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.66681.log.gz 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57491.log.gz 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58605.log: 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58605.log.gz 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66471.log 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.51246.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39054.log 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7%/var/log/ceph/ceph-client.admin.66471.log: -- replaced with /var/log/ceph/ceph-client.admin.51246.log.gz 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53691.log 2024-09-17T03:06:57.010 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66471.log.gz 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39054.log: -- /var/log/ceph/ceph-client.admin.39684.log 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53691.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39054.log.gz 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44501.log 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53691.log.gz 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46767.log 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39684.log: /var/log/ceph/ceph-client.admin.44501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34345.log 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46767.log: 87.8% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39684.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44501.log.gz 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46767.log.gz 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51020.log 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34345.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34345.log.gz 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56746.log 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.51020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36819.log 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51020.log.gz 2024-09-17T03:06:57.011 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38574.log 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56746.log.gz 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.2.36819.log: --verbose -- /var/log/ceph/ceph-client.admin.49994.log 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36819.log.gz 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35409.log 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38574.log.gz 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55508.log 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49994.log.gz 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.admin.35409.log: --verbose -- /var/log/ceph/ceph-client.admin.66261.log 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55508.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35409.log.gz 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39222.log 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55508.log.gz 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35069.log 2024-09-17T03:06:57.012 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.66261.log: /var/log/ceph/ceph-client.admin.39222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56890.log 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39222.log.gz 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35069.log: -- replaced with /var/log/ceph/ceph-client.admin.66261.log.gz 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35069.log.gz 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40841.log 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56890.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56890.log.gz 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57239.log 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64544.log 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40841.log.gz/var/log/ceph/ceph-client.admin.57239.log: 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34513.log 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57239.log.gz 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.64544.log: /var/log/ceph/ceph-client.admin.56932.log 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34513.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.64544.log.gz 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38118.log 2024-09-17T03:06:57.013 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34513.log.gz 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63874.log 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56932.log: /var/log/ceph/ceph-client.admin.38118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56932.log.gz 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63874.log: -- replaced with /var/log/ceph/ceph-client.admin.38118.log.gz 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63874.log.gz 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61978.log 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47877.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35405.log 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34219.log 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61978.log.gz 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49910.log 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35405.log.gz 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.34219.log: -- /var/log/ceph/ceph-client.admin.53030.log 2024-09-17T03:06:57.014 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.49910.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.34219.log.gz 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51929.log 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49910.log.gz 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45658.log 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53030.log: /var/log/ceph/ceph-client.admin.51929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44552.log 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5%/var/log/ceph/ceph-client.admin.45658.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51929.log.gz 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53030.log.gz 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52694.log 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45658.log.gz 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56117.log 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44552.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62759.log 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52694.log: /var/log/ceph/ceph-client.0.56117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52526.log 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56117.log.gz 2024-09-17T03:06:57.015 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3%/var/log/ceph/ceph-client.admin.62759.log: -- replaced with /var/log/ceph/ceph-client.admin.52694.log.gz 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62759.log.gz 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46427.log 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49808.log 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52526.log.gz 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39264.log 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46427.log.gz 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49808.log: -- /var/log/ceph/ceph-client.admin.34261.log 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39264.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49808.log.gz 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48359.log 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39264.log.gz 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44724.log 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34261.log: /var/log/ceph/ceph-client.admin.48359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60641.log 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44724.log: 87.5% 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48359.log.gz -- replaced with /var/log/ceph/ceph-client.admin.34261.log.gz 2024-09-17T03:06:57.016 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44724.log.gz 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62801.log 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60641.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60641.log.gz 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39348.log 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55170.log 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62801.log.gz 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.39348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47289.log 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr: 91.1%/var/log/ceph/ceph-client.admin.55170.log: -- replaced with /var/log/ceph/ceph-client.admin.39348.log.gz 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.46197.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55170.log.gz 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54491.log 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47289.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47289.log.gz 2024-09-17T03:06:57.017 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.64484.log 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37143.log 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54491.log.gz 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.64484.log: gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64484.log.gz 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45354.log 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66051.log 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37143.log.gz 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.45354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61604.log 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45354.log.gz 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.66051.log: /var/log/ceph/ceph-client.admin.41677.log 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61604.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57197.log 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66051.log.gz 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61604.log.gz 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55466.log 2024-09-17T03:06:57.018 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41677.log: /var/log/ceph/ceph-client.admin.57197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47457.log 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz/var/log/ceph/ceph-client.admin.55466.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57197.log.gz 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37453.log 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55466.log.gz 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43950.log 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47457.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51616.log 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37453.log: /var/log/ceph/ceph-client.admin.43950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50290.log 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8%/var/log/ceph/ceph-client.admin.51616.log: -- replaced with /var/log/ceph/ceph-client.admin.37453.log.gz 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43950.log.gz 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51616.log.gz 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57365.log 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.0.50290.log: --verbose -- /var/log/ceph/ceph-client.admin.52484.log 0.0% -- replaced with /var/log/ceph/ceph-client.0.50290.log.gz 2024-09-17T03:06:57.019 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57365.log: gzip 87.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.44247.log 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57365.log.gz 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37698.log 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52484.log.gzgzip 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44247.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44247.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57785.log 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37698.log: /var/log/ceph/ceph-client.admin.34737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63664.log 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37698.log.gz/var/log/ceph/ceph-client.admin.57785.log: 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57785.log.gz 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40967.log 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.63664.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53138.log 2024-09-17T03:06:57.020 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60171.log 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63664.log.gz 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60129.log 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40967.log.gz 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53138.log: /var/log/ceph/ceph-client.admin.60171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44167.log 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60171.log.gz 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60129.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53138.log.gz 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34730.log 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60129.log.gz 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37101.log 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44167.log: /var/log/ceph/ceph-client.admin.34730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36956.log 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37101.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44167.log.gz 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34730.log.gz 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37101.log.gz 2024-09-17T03:06:57.021 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44457.log 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr:gzip/var/log/ceph/ceph-client.admin.36956.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34555.log 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.44457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63534.log 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36956.log.gz 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65606.log 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44457.log.gz 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34555.log: /var/log/ceph/ceph-client.admin.63534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7%/var/log/ceph/ceph-client.admin.65606.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34555.log.gz 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63534.log.gz 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65606.log.gz 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50936.log 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52188.log 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz/var/log/ceph/ceph-client.admin.50936.log: 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59858.log 2024-09-17T03:06:57.022 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50936.log.gz 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52188.log: gzip -5 87.7% --verbose -- /var/log/ceph/ceph-client.admin.32483.log 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52188.log.gz 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57323.log 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59858.log.gz 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32483.log.gz 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35073.log 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50414.log 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2%/var/log/ceph/ceph-client.admin.35073.log: -- replaced with /var/log/ceph/ceph-client.admin.57323.log.gz 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35073.log.gz 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr: /var/log/ceph/ceph-client.admin.55214.log 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50414.log: gzip 87.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.52108.log 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50414.log.gz 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.55214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34387.log 2024-09-17T03:06:57.023 INFO:teuthology.orchestra.run.smithi104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55214.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37237.log 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52108.log: 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52108.log.gz 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34735.log 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.34387.log: /var/log/ceph/ceph-client.admin.37237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33028.log 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34387.log.gz 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4%/var/log/ceph/ceph-client.admin.34735.log: -- replaced with /var/log/ceph/ceph-client.admin.37237.log.gz 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38406.log 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34735.log.gz 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.admin.33028.log: --verbose -- /var/log/ceph/ceph-client.admin.59900.log 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38406.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.33028.log.gz 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39606.log 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38406.log.gz 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60722.log 2024-09-17T03:06:57.024 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59900.log.gz 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5/var/log/ceph/ceph-client.0.39606.log: --verbose -- /var/log/ceph/ceph-client.admin.36037.log 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39606.log.gz 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.60722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47205.log 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60722.log.gz 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.36037.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36037.log.gz 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52013.log 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.47205.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47205.log.gz 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.52013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59638.log 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52013.log.gz 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.3.log: -- /var/log/ceph/ceph-client.admin.63706.log 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.59638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40883.log 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59638.log.gz 2024-09-17T03:06:57.025 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.63706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37342.log 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.40883.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63706.log.gz 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40883.log.gz 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38320.log 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33883.log 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.37342.log: /var/log/ceph/ceph-client.admin.38320.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37342.log.gz 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38320.log.gz 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53330.log 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33883.log: /var/log/ceph/ceph-mds.c.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33883.log.gz 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61412.log 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.0.53330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53330.log.gz 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65461.log 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61412.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61412.log.gz 2024-09-17T03:06:57.026 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.65461.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65461.log.gz 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32980.log 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.43343.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61244.log 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.32980.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32980.log.gz 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62446.log 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61244.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61244.log.gz 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62969.log 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62446.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62446.log.gz 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56585.log 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.62969.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62969.log.gz 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57964.log 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.56585.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56585.log.gz 2024-09-17T03:06:57.027 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54054.log 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57964.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57964.log.gz 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53788.log 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.54054.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54054.log.gz 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38885.log 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.53788.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53788.log.gz 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50978.log 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.38885.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38885.log.gz 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41849.log 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.50978.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50978.log.gz 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33465.log 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.41849.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41849.log.gz 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58044.log 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.33465.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33465.log.gz 2024-09-17T03:06:57.028 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35065.log 2024-09-17T03:06:57.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.58044.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58044.log.gz 2024-09-17T03:06:57.029 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57743.log 2024-09-17T03:06:57.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.35065.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35065.log.gz 2024-09-17T03:06:57.029 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61160.log 2024-09-17T03:06:57.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.57743.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57743.log.gz 2024-09-17T03:06:57.029 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/ceph-client.admin.61160.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61160.log.gz 2024-09-17T03:06:57.094 INFO:teuthology.orchestra.run.smithi192.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T03:06:57.130 INFO:teuthology.orchestra.run.smithi192.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T03:06:57.163 INFO:teuthology.orchestra.run.smithi104.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T03:06:57.276 INFO:teuthology.orchestra.run.smithi104.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T03:06:57.478 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T03:06:57.515 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T03:06:57.522 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T03:06:57.571 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T03:06:57.573 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-17T03:06:57.573 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m0.902s 2024-09-17T03:06:57.573 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m4.340s 2024-09-17T03:06:57.573 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.195s 2024-09-17T03:06:57.639 INFO:teuthology.orchestra.run.smithi104.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T03:06:57.646 INFO:teuthology.orchestra.run.smithi104.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T03:06:57.660 INFO:teuthology.orchestra.run.smithi104.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T03:06:57.727 INFO:teuthology.orchestra.run.smithi104.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T03:06:57.793 INFO:teuthology.orchestra.run.smithi104.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T03:06:57.795 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-17T03:06:57.795 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m1.151s 2024-09-17T03:06:57.795 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m5.576s 2024-09-17T03:06:57.795 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.557s 2024-09-17T03:06:57.796 INFO:tasks.ceph:Archiving logs... 2024-09-17T03:06:57.796 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/remote/smithi104/log 2024-09-17T03:06:57.797 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:06:58.970 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/remote/smithi192/log 2024-09-17T03:06:58.970 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:06:59.573 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T03:06:59.581 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T03:06:59.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:06:59.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:06:59.675 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T03:06:59.685 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T03:06:59.686 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:06:59.688 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:06:59.703 INFO:teuthology.orchestra.run.smithi104.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:06:59.704 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:06:59.708 INFO:teuthology.orchestra.run.smithi104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:06:59.708 INFO:teuthology.orchestra.run.smithi104.stdout:=============================================================================== 2024-09-17T03:06:59.708 INFO:teuthology.orchestra.run.smithi104.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +2553us[+2517us] +/- 58ms 2024-09-17T03:06:59.708 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -810us[ -846us] +/- 67ms 2024-09-17T03:06:59.708 INFO:teuthology.orchestra.run.smithi104.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -2347us[-2383us] +/- 73ms 2024-09-17T03:06:59.708 INFO:teuthology.orchestra.run.smithi104.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:06:59.709 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:06:59.710 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-17T03:06:59.710 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +2567us[+2520us] +/- 58ms 2024-09-17T03:06:59.710 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -773us[ -773us] +/- 67ms 2024-09-17T03:06:59.710 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -2334us[-2381us] +/- 73ms 2024-09-17T03:06:59.710 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:06:59.712 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T03:06:59.731 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T03:06:59.732 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T03:06:59.754 DEBUG:teuthology.orchestra.run.smithi104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:06:59.842 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:06:59.913 DEBUG:teuthology.orchestra.run.smithi104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:06:59.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:06:59.944 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:06:59.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:06:59.975 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T03:06:59.986 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T03:07:00.006 INFO:teuthology.task.internal:Duration was 1111.924494 seconds 2024-09-17T03:07:00.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T03:07:00.028 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T03:07:00.028 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:07:00.031 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:07:00.068 INFO:teuthology.orchestra.run.smithi104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:07:00.071 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:07:00.336 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T03:07:00.336 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-09-17T03:07:00.336 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:07:00.397 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-09-17T03:07:00.398 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:07:00.427 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T03:07:00.427 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:07:00.440 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:07:00.494 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T03:07:00.494 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:07:00.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:07:00.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T03:07:00.655 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T03:07:00.655 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:07:00.680 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:07:00.705 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T03:07:00.715 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:07:00.723 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:07:00.744 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-09-17T03:07:00.769 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-09-17T03:07:00.782 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:07:00.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:07:00.812 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:07:00.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:07:00.836 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T03:07:00.847 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T03:07:00.848 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/remote/smithi104 2024-09-17T03:07:00.848 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:07:00.889 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908385/remote/smithi192 2024-09-17T03:07:00.889 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:07:00.923 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T03:07:00.923 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:07:00.926 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:07:00.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T03:07:00.984 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T03:07:00.985 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T03:07:01.006 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T03:07:01.006 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:07:01.009 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:07:01.022 INFO:teuthology.orchestra.run.smithi104.stdout: 266054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:07 /home/ubuntu/cephtest 2024-09-17T03:07:01.028 INFO:teuthology.orchestra.run.smithi192.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:07 /home/ubuntu/cephtest 2024-09-17T03:07:01.029 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T03:07:01.039 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T03:07:01.086 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/mds-full} duration: 1111.9244935512543 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T03:07:01.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:07:01.171 INFO:teuthology.run:pass